Leader emergence through interpersonal neural synchronization

Interbrain Synchrony in the Expectation of Cooperation Behavior: A Hyperscanning Study Using Functional Near-Infrared Spectroscopy

Expectation of others' cooperative behavior plays a core role in economic cooperation. However, the dynamic neural substrates of expectation of cooperation (hereafter EOC) are little understood. To fully understand EOC behavior in more natural social interactions, the present study employed functional near-infrared spectroscopy (fNIRS) hyperscanning to simultaneously measure pairs of participants' brain activations in a modified prisoner's dilemma game (PDG). The data analysis revealed the following results. Firstly, under the high incentive condition, team EOC behavior elicited higher interbrain synchrony (IBS) in the right inferior frontal gyrus (rIFG) than individual EOC behavior. Meanwhile, the IBS in the IFG could predict the relationship between empathy/agreeableness and EOC behavior, and this prediction role was modulated by social environmental cues. These results indicate the involvement of the human mirror neuron system (MNS) in the EOC behavior and the different neural substrates between team EOC and individual EOC, which also conform with theory that social behavior was affected by internal (i.e., empathy/agreeableness) and external factors (i.e., incentive). Secondly, female dyads exhibited a higher IBS value of cooperative expectation than male dyads in the team EOC than the individual EOC in the dorsal medial prefrontal cortex (DMPFC), while in the individual EOC stage, the coherence value of female dyads was significantly higher than that of male dyads under the low incentive reward condition in the rIFG. These sex effects thus provide presumptive evidence that females are more sensitive to environmental cues and also suggest that during economic social interaction, females' EOC behavior depends on more social cognitive abilities. Overall, these results raise intriguing questions for future research on human cooperative behaviors.

Capturing Human Interaction in the Virtual Age: A Perspective on the Future of fNIRS Hyperscanning

Advances in video conferencing capabilities combined with dramatic socio-dynamic shifts brought about by COVID-19, have redefined the ways in which humans interact in modern society. From business meetings to medical exams, or from classroom instruction to yoga class, virtual interfacing has permeated nearly every aspect of our daily lives. A seemingly endless stream of technological advances combined with our newfound reliance on virtual interfacing makes it likely that humans will continue to use this modern form of social interaction into the future. However, emergent evidence suggests that virtual interfacing may not be equivalent to face-to-face interactions. Ultimately, too little is currently understood about the mechanisms that underlie human interactions over the virtual divide, including how these mechanisms differ from traditional face-to-face interaction. Here, we propose functional near-infrared spectroscopy (fNIRS) hyperscanning—simultaneous measurement of two or more brains—as an optimal approach to quantify potential neurocognitive differences between virtual and in-person interactions. We argue that increased focus on this understudied domain will help elucidate the reasons why virtual conferencing doesn't always stack up to in-person meetings and will also serve to spur new technologies designed to improve the virtual interaction experience. On the basis of existing fNIRS hyperscanning literature, we highlight the current gaps in research regarding virtual interactions. Furthermore, we provide insight into current hurdles regarding fNIRS hyperscanning hardware and methodology that should be addressed in order to shed light on this newly critical element of everyday life.

Natural Leaders: Some Interlocutors Elicit Greater Convergence Across Conversations and Across Characteristics

Are there individual tendencies in convergence, such that some speakers consistently converge more than others? Similarly, are there natural "leaders," speakers with whom others converge more? Are such tendencies consistent across different linguistic characteristics? We use the Switchboard Corpus to perform a large-scale convergence study of speakers in multiple conversations with different interlocutors, across six linguistic characteristics. Because each speaker participated in several conversations, it is possible to look for individual differences in speakers' likelihood of converging and interlocutors' likelihood of eliciting convergence. We only find evidence for individual differences by interlocutor, not by speaker: There are natural leaders of convergence, who elicit more convergence than others across characteristics and across conversations. The lack of similar evidence for speakers who converge more than others suggests that social factors have a stronger effect in mediating convergence than putative individual tendencies in producing convergence, or that such tendencies are characteristic-specific.

Neural processes for live pro-social dialogue between dyads with socioeconomic disparity

An emerging theoretical framework suggests that neural functions associated with stereotyping and prejudice are associated with frontal lobe networks. Using a novel neuroimaging technique, functional near-infrared spectroscopy (fNIRS), during a face-to-face live communication paradigm, we explore an extension of this model to include live dynamic interactions. Neural activations were compared for dyads of similar and dissimilar socioeconomic backgrounds. The socioeconomic status of each participant was based on education and income levels. Both groups of dyads engaged in pro-social dialectic discourse during acquisition of hemodynamic signals. Post-scan questionnaires confirmed increased anxiety and effort for high-disparity dyads. Consistent with the frontal lobe hypothesis, left dorsolateral pre-frontal cortex (DLPFC), frontopolar area and pars triangularis were more active during speech dialogue in high than in low-disparity groups. Further, frontal lobe signals were more synchronous across brains for high- than low-disparity dyads. Convergence of these behavioral, neuroimaging and neural coupling findings associate left frontal lobe processes with natural pro-social dialogue under 'out-group' conditions and advance both theoretical and technical approaches for further investigation.

What has social neuroscience learned from hyperscanning studies of spoken communication? A systematic review

A growing body of literature examining the neurocognitive processes of interpersonal linguistic interaction indicates the emergence of neural alignment as participants engage in oral communication. However, questions have arisen whether the study results can be interpreted beyond observations of cortical functionality and extended to the mutual understanding between communicators. This review presents evidence from electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS) hyperscanning studies of interbrain synchrony (IBS) in which participants communicated via spoken language. The studies are classified into: knowledge sharing; turn-taking speech co-ordination; cooperation, problem-solving and creativity; and naturalistic discussion paradigms according to the type of interaction specified in each study. Alignment predominantly occurred in the frontal and temporo-parietal areas, which may reflect activation of the mirror and mentalizing systems. We argue that the literature presents a significant contribution to advancing our understanding of IBS and mutual understanding between communicators. We end with suggestions for future research, including analytical approaches and experimental conditions and hypothesize that brain-inspired neural networks are promising techniques for better understanding of IBS through hyperscanning.

Brain-to-Brain Neural Synchrony During Social Interactions: A Systematic Review on Hyperscanning Studies

The aim of this study was to conduct a comprehensive review on hyperscanning research (measuring brain activity simultaneously from more than two people interacting) using an explicit systematic method, the preferred reporting items for systematic reviews and meta-analyses (PRISMA). Data were searched from IEEE Xplore, PubMed, Engineering Village, Web of Science and Scopus databases. Inclusion criteria were journal articles written in English from 2000 to 19 June 2019. A total of 126 empirical studies were screened out to address three specific questions regarding the neuroimaging method, the application domain, and the experiment paradigm. Results showed that the most used neuroimaging method with hyperscanning was magnetoencephalography/electroencephalography (MEG/EEG; 47%), and the least used neuroimaging method was hyper-transcranial Alternating Current Stimulation (tACS) (1%). Applications in cognition accounted for almost half the studies (48%), while educational applications accounted for less than 5% of the studies. Applications in decision-making tasks were the second most common (26%), shortly followed by applications in motor synchronization (23%). The findings from this systematic review that were based on documented, transparent and reproducible searches should help build cumulative knowledge and guide future research regarding inter-brain neural synchrony during social interactions, that is, hyperscanning research.

Experience-Dependent Counselor-Client Brain Synchronization during Psychological Counseling

The role of the counselor’s experience in building an alliance with the clients remains controversial. Recently, the expanding nascent studies on interpersonal brain synchronization (IBS) using functional near-infrared spectroscopy (fNIRS) on human subjects have hinted at the possible neural substrates underlying the relationship qualities between the counselor-client dyads. Our study assessed the clients’ self-report working alliance (WA) as well as simultaneously measured IBS by fNIRS in 14 experienced versus 16 novice counselor-client dyads during the first integrative-orientation psychological counseling session. We observed that synchronous brain activity patterns were elicited from the right temporo-parietal junction (rTPJ) across counselor-client dyads. Furthermore, such IBS, together with alliance quality, was especially evident when counselors had more psychotherapy experience. Time-lagged counselor-client brain synchronization might co-vary with the alliance (goal component) when the client’s brain activity preceded that of the counselor. These findings favor the notion that the IBS between counselor-client associated with the WA is an experience-dependent phenomenon, suggesting that a potential adaptive mechanism is embedded in psychological counseling.

Brain-to-Brain Synchrony in the STEM Classroom

Cognitive neuroscience research is typically conducted in controlled laboratory environments that hold very little resemblance to science, technology, engineering, and mathematics classrooms. Fortunately, recent advances in portable electroencephalography technology now allow researchers to collect brain data from groups of students in real-world classrooms. Even though this line of research is still new, there is growing evidence that students' engagement, memory retention, and social dynamics are reflected in the brain-to-brain synchrony between students and teachers (i.e., the similarity in their brain responses). In this Essay, I will provide an overview of this emerging line of research, discuss how this approach can facilitate new collaborations between neuroscientists and discipline-based education researchers, and propose directions for future research.

A Multi-Brain Framework for Social Interaction

Social interaction can be seen as a dynamic feedback loop that couples action, reaction, and internal cognitive processes across individual agents. A fuller understanding of the social brain requires a description of how the neural dynamics across coupled brains are linked and how they coevolve over time. We elaborate a multi-brain framework that considers social interaction as an integrated network of neural systems that dynamically shape behavior, shared cognitive states, and social relationships. We describe key findings from multi-brain experiments in humans and animal models that shed new light on the function of social circuits in health and disease. Finally, we discuss recent progress in elucidating the cellular-level mechanisms underlying inter-brain neural dynamics and outline key areas for future research.

Neural alignment during face-to-face spontaneous deception: Does gender make a difference?

This study investigated the gender differences in deception and their neural basis in the perspective of two‐person neuroscience. Both male and female dyads were asked to perform a face‐to‐face spontaneous sender–receiver deception task, while their neural activities in the prefrontal cortex (PFC) and right temporal parietal junction (rTPJ) were recorded simultaneously using functional near‐infrared spectroscopy (fNIRS)‐based hyperscanning. Male and female dyads displayed similar deception rate, successful deception rate, and eye contact in deception trials. Moreover, eye contact in deception trials was positively correlated with the success rate of deception in both genders. The fNIRS data showed that the interpersonal neural synchronization (INS) in PFC was significantly enhanced only in female dyads when performed the deception task, while INS in rTPJ was increased only in male dyads. Such INS was correlated with the success rate of deception in both dyads. Granger causality analysis showed that no significant directionality between time series of PFC (or rTPJ) in each dyad, which could indicate that sender and receiver played equally important role during deception task. Finally, enhanced INS in PFC in female dyads mediated the contribution of eye contact to the success rate of deception. All findings in this study suggest that differential patterns of INS are recruited when male and female dyads perform the face‐to‐face deception task. To our knowledge, this is the first interbrain evidence for gender difference of successful deception, which could make us a deeper understanding of spontaneous face‐to‐face deception.

Effect of Picture-Book Reading With Additive Audio on Bilingual Preschoolers' Prefrontal Activation: A Naturalistic Functional Near-Infrared Spectroscopy Study

Acquiring a second language (L2) has the power to shape cognition and even the function and structure of the brain. Picture-book reading with additive audio (PRA) is a popular and convenient means of providing L2 exposure for non-balanced bilingual children; however, its contribution to bilingual children’s brain activity is unclear. This study conducted a rigorous bilingual word comprehension experiment and a naturalistic PRA task to explore the effect of L2 processing on brain activation among English as a foreign language (EFL) preschoolers, using functional near-infrared spectroscopy (fNIRS). We found that the two contexts of comprehending English words and bilingual switching (BS), which impose more cognitive control demands, activated the prefrontal cortex (PFC) more than did the condition of comprehending Chinese words. Furthermore, the effect of PFC activity in the condition of picture-book reading with additive English audio (English PRA) was also found to be greater than in the condition of picture-book reading with additive Chinese audio (Chinese PRA); moreover, the effect was modulated by story difficulty. Finally, a positive correlation was shown between EFL children’s English competence and PFC activation through English PRA. This study indicates that the experiences of hearing L2 auditory stories in a picture-book reading activity yielded significant changes to early bilinguals’ PFC functional for cognitive control and language processing.

A New Unifying Account of the Roles of Neuronal Entrainment

Rhythms are a fundamental and defining feature of neuronal activity in animals including humans. This rhythmic brain activity interacts in complex ways with rhythms in the internal and external environment through the phenomenon of 'neuronal entrainment', which is attracting increasing attention due to its suggested role in a multitude of sensory and cognitive processes. Some senses, such as touch and vision, sample the environment rhythmically, while others, like audition, are faced with mostly rhythmic inputs. Entrainment couples rhythmic brain activity to external and internal rhythmic events, serving fine-grained routing and modulation of external and internal signals across multiple spatial and temporal hierarchies. This interaction between a brain and its environment can be experimentally investigated and even modified by rhythmic sensory stimuli or invasive and non-invasive neuromodulation techniques. We provide a comprehensive overview of the topic and propose a theoretical framework of how neuronal entrainment dynamically structures information from incoming neuronal, bodily and environmental sources. We discuss the different types of neuronal entrainment, the conceptual advances in the field, and converging evidence for general principles.

Joint Attention During Live Person-to-Person Contact Activates rTPJ, Including a Sub-Component Associated With Spontaneous Eye-to-Eye Contact

Eye-to-eye contact is a spontaneous behavior between interacting partners that occurs naturally during social interactions. However, individuals differ with respect to eye gaze behaviors such as frequency of eye-to-eye contacts, and these variations may reflect underlying differences in social behavior in the population. While the use of eye signaling to indicate a shared object of attention in joint attention tasks has been well-studied, the effects of the natural variation in establishing eye contact during joint attention have not been isolated. Here, we investigate this question using a novel two-person joint attention task. Participants were not instructed regarding the use of eye contacts; thus all mutual eye contact events between interacting partners that occurred during the joint attention task were spontaneous and varied with respect to frequency. We predicted that joint attention systems would be modulated by differences in the social behavior across participant pairs, which could be measured by the frequency of eye contact behavior. We used functional near-infrared spectroscopy (fNIRS) hyperscanning and eye-tracking to measure the neural signals associated with joint attention in interacting dyads and to record the number of eye contact events between them. Participants engaged in a social joint attention task in which real partners used eye gaze to direct each other's attention to specific targets. Findings were compared to a non-social joint attention task in which an LED cue directed both partners' attention to the same target. The social joint attention condition showed greater activity in right temporoparietal junction than the non-social condition, replicating prior joint attention results. Eye-contact frequency modulated the joint attention activity, revealing bilateral activity in social and high level visual areas associated with partners who made more eye contact. Additionally, when the number of mutual eye contact events was used to classify each pair as either "high eye contact" or "low eye contact" dyads, cross-brain coherence analysis revealed greater coherence between high eye contact dyads than low eye contact dyads in these same areas. Together, findings suggest that variation in social behavior as measured by eye contact modulates activity in a subunit of the network associated with joint attention.

Physiological and Behavioral Synchrony Predict Group Cohesion and Performance

Interpersonal synchrony contributes to social functioning in dyads, but it remains unknown how synchrony shapes group experiences and performance. To this end, we designed a novel group drumming task in which participants matched their drumming to either predictable or unpredictable tempos. Fifty-one three-person groups were randomly assigned to one of two conditions: synchronized or asynchronized drumming. Outcome measures included electrocardiograms and self-reports of group cohesion and synchrony. The drumming task elicited an increase in physiological synchrony between group members (specifically their hearts' interbeat intervals). We also found that physiological synchronization and behavioral synchronization predicted individuals' experience of group cohesion. Physiological synchrony also predicted performance in a subsequent group task that involved freely drumming together. The findings suggest that the behavioral and physiological consequences of synchronization contribute to the formation of group bonds and coordination. They also confirm that insights from translational social neuroscience can inform our knowledge of the development of cohesive and efficacious groups.

Within-group synchronization in the prefrontal cortex associates with intergroup conflict

Individuals immersed in groups sometimes lose their individuality, take risks they would normally avoid and approach outsiders with unprovoked hostility. In this study, we identified within-group neural synchronization in the right dorsolateral prefrontal cortex (rDLPFC) and the right temporoparietal junction (rTPJ) as a candidate mechanism underlying intergroup hostility. We organized 546 individuals into 91 three-versus-three-person intergroup competitions, induced in-group bonding or no-bonding control manipulation and measured neural activity and within-group synchronization using functional near-infrared spectroscopy. After in-group bonding (versus control), individuals gave more money to in-group members than to out-group members and contributed more money to outcompete their rivals. In-group bonding decreased rDLPFC activity and increased functional connectivity between the rDLPFC and the rTPJ. Especially during the out-group attack, in-group bonding also increased within-group synchronization in both the rDLPFC and the rTPJ, and within-group rDLPFC synchronization positively correlated with intergroup hostility. Within-group synchronized reduction in prefrontal activity might explain how in-group bonding leads to impulsive and collective hostility toward outsiders.

Using second-person neuroscience to elucidate the mechanisms of social interaction

Although a large proportion of our lives are spent participating in social interactions, the investigation of the neural mechanisms supporting these interactions has largely been restricted to situations of social observation - that is, situations in which an individual observes a social stimulus without opportunity for interaction. In recent years, efforts have been made to develop a truly social, or 'second-person', neuroscientific approach to these investigations in which neural processes are examined within the context of a real-time reciprocal social interaction. These developments have helped to elucidate the behavioural and neural mechanisms of social interactions; however, further theoretical and methodological innovations are still needed. Findings to date suggest that the neural mechanisms supporting social interaction differ from those involved in social observation and highlight a role of the so-called 'mentalizing network' as important in this distinction. Taking social interaction seriously may also be particularly important for the advancement of the neuroscientific study of different psychiatric conditions.

The present and future use of functional near-infrared spectroscopy (fNIRS) for cognitive neuroscience

The past few decades have seen a rapid increase in the use of functional near-infrared spectroscopy (fNIRS) in cognitive neuroscience. This fast growth is due to the several advances that fNIRS offers over the other neuroimaging modalities such as functional magnetic resonance imaging and electroencephalography/magnetoencephalography. In particular, fNIRS is harmless, tolerant to bodily movements, and highly portable, being suitable for all possible participant populations, from newborns to the elderly and experimental settings, both inside and outside the laboratory. In this review we aim to provide a comprehensive and state-of-the-art review of fNIRS basics, technical developments, and applications. In particular, we discuss some of the open challenges and the potential of fNIRS for cognitive neuroscience research, with a particular focus on neuroimaging in naturalistic environments and social cognitive neuroscience.

Hyperscanning: A Valid Method to Study Neural Inter-brain Underpinnings of Social Interaction

Social interactions are a crucial part of human life. Understanding the neural underpinnings of social interactions is a challenging task that the hyperscanning method has been trying to tackle over the last two decades. Here, we review the existing literature and evaluate the current state of the hyperscanning method. We review the type of methods (fMRI, M/EEG, and fNIRS) that are used to measure brain activity from more than one participant simultaneously and weigh their pros and cons for hyperscanning. Further, we discuss different types of analyses that are used to estimate brain networks and synchronization. Lastly, we present results of hyperscanning studies in the context of different cognitive functions and their relations to social interactions. All in all, we aim to comprehensively present methods, analyses, and results from the last 20 years of hyperscanning research.

Bed-Sharing in Couples Is Associated With Increased and Stabilized REM Sleep and Sleep-Stage Synchronization

BACKGROUND/OBJECTIVES

Sharing the bed with a partner is common among adults and impacts sleep quality with potential implications for mental health. However, hitherto findings are contradictory and particularly polysomnographic data on co-sleeping couples are extremely rare. The present study aimed to investigate the effects of a bed partner's presence on individual and dyadic sleep neurophysiology.

METHODS

Young healthy heterosexual couples underwent sleep-lab-based polysomnography of two sleeping arrangements: individual sleep and co-sleep. Individual and dyadic sleep parameters (i.e., synchronization of sleep stages) were collected. The latter were assessed using cross-recurrence quantification analysis. Additionally, subjective sleep quality, relationship characteristics, and chronotype were monitored. Data were analyzed comparing co-sleep vs. individual sleep. Interaction effects of the sleeping arrangement with gender, chronotype, or relationship characteristics were moreover tested.

RESULTS

As compared to sleeping individually, co-sleeping was associated with about 10% more REM sleep, less fragmented REM sleep (p = 0.008), longer undisturbed REM fragments (p = 0.0006), and more limb movements (p = 0.007). None of the other sleep stages was significantly altered. Social support interacted with sleeping arrangement in a way that individuals with suboptimal social support showed the biggest impact of the sleeping arrangement on REM sleep. Sleep architectures were more synchronized between partners during co-sleep (p = 0.005) even if wake phases were excluded (p = 0.022). Moreover, sleep architectures are significantly coupled across a lag of ± 5min. Depth of relationship represented an additional significant main effect regarding synchronization, reflecting a positive association between the two. Neither REM sleep nor synchronization was influenced by gender, chronotype, or other relationship characteristics.

CONCLUSION

Depending on the sleeping arrangement, couple's sleep architecture and synchronization show alterations that are modified by relationship characteristics. We discuss that these alterations could be part of a self-enhancing feedback loop of REM sleep and sociality and a mechanism through which sociality prevents mental illness.

Two-Person Approaches to Studying Social Interaction in Psychiatry: Uses and Clinical Relevance

Social interaction is ubiquitous in human society. The two-person approach-a new, powerful tool to study information exchange and social behaviors-aims to characterize the behavioral dynamics and neural mechanisms of real-time social interactions. In this review, we discuss the benefits of two-person approaches compared to those for conventional, single-person approaches. We describe measures and paradigms that model social interaction in three dimensions (3-D), including eye-to-eye, body-to-body, and brain-to-brain relationships. We then discuss how these two-person measures and paradigms are used in psychiatric conditions (e.g., autism, mood disorders, schizophrenia, borderline personality disorder, and psychotherapy). Furthermore, the advantages of a two-person approach (e.g., dual brain stimulation, multi-person neurofeedback) in clinical interventions are described. Finally, we discuss the methodological and translational challenges surrounding the application of two-person approaches in psychiatry, as well as prospects for future two-/multi-person studies. We conclude that two-person approaches serve as useful additions to the range of behavioral and neuroscientific methods available to assess social interaction in psychiatric settings, for both diagnostic techniques and complementary interventions.

Optimization of wavelet coherence analysis as a measure of neural synchrony during hyperscanning using functional near-infrared spectroscopy

Significance: The expanding field of human social interaction is enabled by functional near-infrared spectroscopy (fNIRS) that acquires hemodynamic signals during live two-person interactions. These advances call for development of methods to quantify interactive processes. Aim: Wavelet coherence analysis has been applied to cross-brain neural coupling. However, fNIRS-specific computations have not been explored. This investigation determines the effects of global mean removal, wavelet equation, and choice of oxyhemoglobin versus deoxyhemoglobin signals. Approach: We compare signals with a known coherence with acquired signals to determine optimal computational approaches. The known coherence was calculated using three visual stimulation sequences of a contrast-reversing checkerboard convolved with the canonical hemodynamic response function. This standard was compared with acquired human fNIRS responses within visual cortex using the same sequences. Results: Observed coherence was consistent with known coherence with highest correlations within the wavelength range between 10 and 20 s. Removal of the global mean improved the correlation irrespective of the specific equation for wavelet coherence, and the oxyhemoglobin signal was associated with a marginal correlation advantage. Conclusions: These findings provide both methodological and computational guidance that enhances the validity and interpretability of wavelet coherence analysis for fNIRS signals acquired during live social interactions.

Behavioral and brain synchronization differences between expert and novice teachers when collaborating with students

Differences in behavior and neural mechanisms between expert and novice teachers when collaborating with students are poorly understood. This study investigated whether expert teachers do better in collaborating with students than novice teachers and explored the neural basis of such differences. Novice teacher and student (NT-S) dyads and expert teacher and student (ET-S) dyads were recruited to complete an interactive task consisting of a cooperation and an independent condition. During the experiment, neural activity in the prefrontal cortex of the participants was recorded with functional near-infrared spectroscopy. The results show higher accuracy for the ET-S dyads than the NT-S dyads in the cooperation condition; however, no difference was found in the independent condition. Increased interpersonal brain synchronization (IBS) was detected in the left dorsolateral prefrontal cortex of participants in ET-S dyads, but not in NT-S dyads in the cooperation condition. Moreover, an interaction effect of dyad type and conditions on IBS was observed, revealing IBS was stronger in ET-S dyads than in NT-S dyads. In ET-S dyads, IBS was positively correlated with the teachers' perspective-taking ability and accuracy. These findings suggest that expert teachers collaborate better with students than novice teachers, and IBS might be the neural marker for this difference.

Coordination Elicits Synchronous Brain Activity Between Co-actors: Frequency Ratio Matters

People could behave in two different ways when engaging in interpersonal coordination activities: moving at the same frequency (isofrequency pattern, IP; the movement frequency ratio is 1:1) or at different frequencies (multifrequency pattern, MP; the movement frequency ratio is non 1:1). However, how the interpersonal coordination pattern modulates coordination outcome and the related brain-to-brain connectivity is not fully understood. Here, we adopted a continuous joint drawing task in which two participants co-drew parallelogram shapes according to two coordination patterns (i.e., IP vs. MP) while their brain activities were simultaneously recorded by the functional near-infrared spectroscopy (fNIRS) based hyperscanning technique. Dyads showed better coordination performance, as well as relatively greater interpersonal brain synchronization (IBS) at the left frontopolar area, in the MP condition compared to the IP condition. Granger causality analyses further disclosed the bidirectional influences between the brains of the coordinating individuals. Such interpersonal influences were enhanced when individuals coordinated in the MP condition. Finally, the IBS during coordination was related to the dyadic self-control level. Taken together, our study revealed that interpersonal multifrequency coordination pattern facilitates the coordination efficiency, which was associated with the enhanced brain-to-brain connectivity. Our work also suggests the potentially positive role of self-control during the interpersonal coordination process.

Simultaneous EEG Acquisition System for Multiple Users: Development and Related Issues

Social interaction is one of humans' most important activities and many efforts have been made to understand the phenomenon. Recently, some investigators have attempted to apply advanced brain signal acquisition systems that allow dynamic brain activities to be measured simultaneously during social interactions. Most studies to date have investigated dyadic interactions, although multilateral interactions are more common in reality. However, it is believed that most studies have focused on such interactions because of methodological limitations, in that it is very difficult to design a well-controlled experiment for multiple users at a reasonable cost. Accordingly, there are few simultaneous acquisition systems for multiple users. In this study, we propose a design framework for an acquisition system that measures EEG data simultaneously in an environment with 10 or more people. Our proposed framework allowed us to acquire EEG data at up to 1 kHz frequency from up to 20 people simultaneously. Details of our acquisition system are described from hardware and software perspectives. In addition, various related issues that arose in the system's development-such as synchronization techniques, system loads, electrodes, and applications-are discussed. In addition, simultaneous visual ERP experiments were conducted with a group of nine people to validate the EEG acquisition framework proposed. We found that our framework worked reasonably well with respect to less than 4 ms delay and average loss rates of 1%. It is expected that this system can be used in various hyperscanning studies, such as those on crowd psychology, large-scale human interactions, and collaborative brain-computer interface, among others.

Are You on My Wavelength? Interpersonal Coordination in Dyadic Conversations

Conversation between two people involves subtle nonverbal coordination in addition to speech. However, the precise parameters and timing of this coordination remain unclear, which limits our ability to theorize about the neural and cognitive mechanisms of social coordination. In particular, it is unclear if conversation is dominated by synchronization (with no time lag), rapid and reactive mimicry (with lags under 1 s) or traditionally observed mimicry (with several seconds lag), each of which demands a different neural mechanism. Here we describe data from high-resolution motion capture of the head movements of pairs of participants (n = 31 dyads) engaged in structured conversations. In a pre-registered analysis pathway, we calculated the wavelet coherence of head motion within dyads as a measure of their nonverbal coordination and report two novel results. First, low-frequency coherence (0.2–1.1 Hz) is consistent with traditional observations of mimicry, and modeling shows this behavior is generated by a mechanism with a constant 600 ms lag between leader and follower. This is in line with rapid reactive (rather than predictive or memory-driven) models of mimicry behavior, and could be implemented in mirror neuron systems. Second, we find an unexpected pattern of lower-than-chance coherence between participants, or hypo-coherence, at high frequencies (2.6–6.5 Hz). Exploratory analyses show that this systematic decoupling is driven by fast nodding from the listening member of the dyad, and may be a newly identified social signal. These results provide a step towards the quantification of real-world human behavior in high resolution and provide new insights into the mechanisms of social coordination.

Learning Desire Is Predicted by Similar Neural Processing of Naturalistic Educational Materials

Naturalistic stimuli can elicit highly similar brain activity across viewers. How do naturalistic educational materials engage human brains and evoke learning desire? Here, we presented 15 audiovisual course clips (each lasting ∼120 s) to university students and recorded their neural activity through electroencephalography. Upon finishing all the video viewings, subjects ranked 15 courses in order of learning desire and reported the reasons for high learning desire (i.e., “value” and “interest”). The brain activity during the video viewing was measured as the neural similarity via intersubject correlation (ISC), that is, correlation between each subject’s neural responses and those of others. Based on averaged learning desire rankings across subjects, course clips were classified with high versus medium versus low motivational effectiveness. We found that the ISC of high effective course clips was larger than that of low effective ones. The ISC difference (high vs low) was positively associated with subjects’ learning desire difference (high vs low). Such an association occurred when viewing time accumulated to ∼80 s. Moreover, ISC was correlated with “interest-based” rather than “value-based” learning desire. These findings advance our understanding of learning motivation via the neural similarity in the context of on-line education and provide potential neurophysiological suggestions for pedagogical practices.

Prior physical synchrony enhances rapport and inter-brain synchronization during subsequent educational communication

Physical synchrony has been suggested to have positive effects on not only concurrent but also subsequent communication, but the underlying neural processes are unclear. Using functional near-infrared spectroscopy (fNIRS) hyperscanning, we tested the effects of preceding physical synchrony on subsequent dyadic teaching-learning communication. Thirty-two pairs of participants performed two experimental sessions. In each session, they underwent a rhythmic arm movement block with synchronous or asynchronous conditions, and then taught/learned unknown words to/from each other according to a given scenario. Neural activities in their medial and left lateral prefrontal cortex (PFC) were measured and inter-brain synchronization (IBS) during the teaching-learning blocks was evaluated. Participants rated their subjective rapport during the teaching-learning blocks, and took a word memory test. The analyses revealed that (1) prior physical synchrony enhanced teacher-learner rapport; (2) prior physical synchrony also enhanced IBS in the lateral PFC; and (3) IBS changes correlated positively with rapport changes. Physical synchrony did however not affect word memory performance. These results suggest that IBS can be useful to measure the effects of social-bonding facilitation activities for educational communication.

Ease and control: the cognitive benefits of hierarchy

This review identifies two cognitive benefits of social hierarchy that may contribute to hierarchy maintenance. First, research indicates that people pay attention to hierarchies automatically, early, and accurately. As a result, hierarchies feel easy to process, which increases liking and support of hierarchy. Second, through their clear, predictable structures and the opportunities they provide for personal agency, hierarchies help people satisfy their need for control, which may lead people to seek out and maintain hierarchy, especially if they currently hold a high rank or believe in social mobility. These cognitive benefits of ease and control may have effects on the performance of hierarchies and on people's willingness to change unfair structures.

Real-Life Neuroscience: An Ecological Approach to Brain and Behavior Research

Owing to advances in neuroimaging technology, the past couple of decades have witnessed a surge of research on brain mechanisms that underlie human cognition. Despite the immense development in cognitive neuroscience, the vast majority of neuroimaging experiments examine isolated agents carrying out artificial tasks in sensory and socially deprived environments. Thus, the understanding of the mechanisms of various domains in cognitive neuroscience, including social cognition and episodic memory, is sorely lacking. Here we focus on social and memory research as representatives of cognitive functions and propose that mainstream, lab-based experimental designs in these fields suffer from two fundamental limitations, pertaining to person-dependent and situation-dependent factors. The person-dependent factor addresses the issue of limiting the active role of the participants in lab-based paradigms that may interfere with their sense of agency and embodiment. The situation-dependent factor addresses the issue of the artificial decontextualized environment in most available paradigms. Building on recent findings showing that real-life as opposed to controlled experimental paradigms involve different mechanisms, we argue that adopting a real-life approach may radically change our understanding of brain and behavior. Therefore, we advocate in favor of a paradigm shift toward a nonreductionist approach, exploiting portable technology in semicontrolled environments, to explore behavior in real life.

Measuring shared responses across subjects using intersubject correlation

Our capacity to jointly represent information about the world underpins our social experience. By leveraging one individual's brain activity to model another's, we can measure shared information across brains-even in dynamic, naturalistic scenarios where an explicit response model may be unobtainable. Introducing experimental manipulations allows us to measure, for example, shared responses between speakers and listeners or between perception and recall. In this tutorial, we develop the logic of intersubject correlation (ISC) analysis and discuss the family of neuroscientific questions that stem from this approach. We also extend this logic to spatially distributed response patterns and functional network estimation. We provide a thorough and accessible treatment of methodological considerations specific to ISC analysis and outline best practices.

Using second-person neuroscience to elucidate the mechanisms of social interaction

Although a large proportion of our lives are spent participating in social interactions, the investigation of the neural mechanisms supporting these interactions has largely been restricted to situations of social observation - that is, situations in which an individual observes a social stimulus without opportunity for interaction. In recent years, efforts have been made to develop a truly social, or 'second-person', neuroscientific approach to these investigations in which neural processes are examined within the context of a real-time reciprocal social interaction. These developments have helped to elucidate the behavioural and neural mechanisms of social interactions; however, further theoretical and methodological innovations are still needed. Findings to date suggest that the neural mechanisms supporting social interaction differ from those involved in social observation and highlight a role of the so-called 'mentalizing network' as important in this distinction. Taking social interaction seriously may also be particularly important for the advancement of the neuroscientific study of different psychiatric conditions.

Multimodal Language Processing in Human Communication

The natural ecology of human language is face-to-face interaction comprising the exchange of a plethora of multimodal signals. Trying to understand the psycholinguistic processing of language in its natural niche raises new issues, first and foremost the binding of multiple, temporally offset signals under tight time constraints posed by a turn-taking system. This might be expected to overload and slow our cognitive system, but the reverse is in fact the case. We propose cognitive mechanisms that may explain this phenomenon and call for a multimodal, situated psycholinguistic framework to unravel the full complexities of human language processing.

Correlated Neural Activity and Encoding of Behavior across Brains of Socially Interacting Animals

Social interactions involve complex decision-making tasks that are shaped by dynamic, mutual feedback between participants. An open question is whether and how emergent properties may arise across brains of socially interacting individuals to influence social decisions. By simultaneously performing microendoscopic calcium imaging in pairs of socially interacting mice, we find that animals exhibit interbrain correlations of neural activity in the prefrontal cortex that are dependent on ongoing social interaction. Activity synchrony arises from two neuronal populations that separately encode one's own behaviors and those of the social partner. Strikingly, interbrain correlations predict future social interactions as well as dominance relationships in a competitive context. Together, our study provides conclusive evidence for interbrain synchrony in rodents, uncovers how synchronization arises from activity at the single-cell level, and presents a role for interbrain neural activity coupling as a property of multi-animal systems in coordinating and sustaining social interactions between individuals.

Tracking the Leader: Gaze Behavior in Group Interactions

Can social gaze behavior reveal the leader during real-world group interactions? To answer this question, we developed a novel tripartite approach combining (1) computer vision methods for remote gaze estimation, (2) a detailed taxonomy to encode the implicit semantics of multi-party gaze features, and (3) machine learning methods to establish dependencies between leadership and visual behaviors. We found that social gaze behavior distinctively identified group leaders. Crucially, the relationship between leadership and gaze behavior generalized across democratic and autocratic leadership styles under conditions of low and high time-pressure, suggesting that gaze can serve as a general marker of leadership. These findings provide the first direct evidence that group visual patterns can reveal leadership across different social behaviors and validate a new promising method for monitoring natural group interactions.

•

Leadership shapes gaze dynamics during real-world human group interactions

•

Social gaze behavior distinctively identifies group leaders

•

Identification generalizes across leadership styles and situational conditions

•

Gaze can serve as a general marker of leadership

Shared neural representations of syntax during online dyadic communication

When people communicate, they come to see the world in a similar way to each other by aligning their mental representations at such levels as syntax. Syntax is an essential feature of human language that distinguishes humans from other non-human animals. However, whether and how communicators share neural representations of syntax is not well understood. Here we addressed this issue by measuring the brain activity of both communicators in a series of dyadic communication contexts, by using functional near-infrared spectroscopy (fNIRS)-based hyperscanning. Two communicators alternatively spoke sentences either with the same or with different syntactic structures. Results showed a significantly higher-level increase of interpersonal neural synchronization (INS) at right posterior superior temporal cortex when communicators produced the same syntactic structures as each other compared to when they produced different syntactic structures. These increases of INS correlated significantly with communication quality. Our findings provide initial evidence for shared neural representations of syntax between communicators.

Communication of emotion via drumming: dual-brain imaging with functional near-infrared spectroscopy

Nonverbal communication of emotion is essential to human interaction and relevant to many clinical applications, yet it is an understudied topic in social neuroscience. Drumming is an ancient nonverbal communication modality for expression of emotion that has not been previously investigated in this context. We investigate the neural response to live, natural communication of emotion via drumming using a novel dual-brain neuroimaging paradigm. Hemodynamic signals were acquired using whole-head functional near-infrared spectroscopy (fNIRS). Dyads of 36 subjects participated in two conditions, drumming and talking, alternating between 'sending' (drumming or talking to partner) and 'receiving' (listening to partner) in response to emotionally salient images from the International Affective Picture System. Increased frequency and amplitude of drum strikes was behaviorally correlated with higher arousal and lower valence measures and neurally correlated with temporoparietal junction (TPJ) activation in the listener. Contrast comparisons of drumming greater than talking also revealed neural activity in right TPJ. Together, findings suggest that emotional content communicated by drumming engages right TPJ mechanisms in an emotionally and behaviorally sensitive fashion. Drumming may provide novel, effective clinical approaches for treating social-emotional psychopathology.

Interplay between prior knowledge and communication mode on teaching effectiveness: Interpersonal neural synchronization as a neural marker

Teacher-student interaction allows students to combine prior knowledge with new information to develop new knowledge. It is widely understood that both communication mode and students' knowledge state contribute to the teaching effectiveness (i.e., higher students' scores), but the nature of the interplay of these factors and the underlying neural mechanism remain unknown. In the current study, we manipulated the communication modes (face-to-face [FTF] communication mode/computer-mediated communication [CMC] mode) and prior knowledge states (with vs. without) when teacher-student dyads participated in a teaching task. Using functional near-infrared spectroscopy, the brain activities of both the teacher and student in the dyads were recorded simultaneously. After teaching, perceived teacher-student interaction and teaching effectiveness were assessed. The behavioral results demonstrated that, during teaching with prior knowledge, FTF communication improved students' academic performance, as compared with CMC. Conversely, no such effect was found for teaching without prior knowledge. Accordingly, higher task-related interpersonal neural synchronization (INS) in the left prefrontal cortex (PFC) was found in the FTF teaching condition with prior knowledge. Such INS mediated the relationship between perceived interaction and students' test scores. Furthermore, the cumulative INS in the left PFC could predict the teaching effectiveness early in the teaching process (around 25-35 s into the teaching task) only in FTF teaching with prior knowledge. These findings provide insight into how the interplay between the communication mode and students' knowledge state affects teaching effectiveness. Moreover, our findings suggest that INS could be a possible neuromarker for dynamic evaluation of teacher-student interaction and teaching effectiveness.

Are We Ready for Real-world Neuroscience?

Real-world environments are typically dynamic, complex, and multisensory in nature and require the support of top-down attention and memory mechanisms for us to be able to drive a car, make a shopping list, or pour a cup of coffee. Fundamental principles of perception and functional brain organization have been established by research utilizing well-controlled but simplified paradigms with basic stimuli. The last 30 years ushered a revolution in computational power, brain mapping, and signal processing techniques. Drawing on those theoretical and methodological advances, over the years, research has departed more and more from traditional, rigorous, and well-understood paradigms to directly investigate cognitive functions and their underlying brain mechanisms in real-world environments. These investigations typically address the role of one or, more recently, multiple attributes of real-world environments. Fundamental assumptions about perception, attention, or brain functional organization have been challenged-by studies adapting the traditional paradigms to emulate, for example, the multisensory nature or varying relevance of stimulation or dynamically changing task demands. Here, we present the state of the field within the emerging heterogeneous domain of real-world neuroscience. To be precise, the aim of this Special Focus is to bring together a variety of the emerging "real-world neuroscientific" approaches. These approaches differ in their principal aims, assumptions, or even definitions of "real-world neuroscience" research. Here, we showcase the commonalities and distinctive features of the different "real-world neuroscience" approaches. To do so, four early-career researchers and the speakers of the Cognitive Neuroscience Society 2017 Meeting symposium under the same title answer questions pertaining to the added value of such approaches in bringing us closer to accurate models of functional brain organization and cognitive functions.

Groups and Emotional Arousal Mediate Neural Synchrony and Perceived Ritual Efficacy

We present the first neurophysiological signatures showing distinctive effects of group social context and emotional arousal on cultural perceptions, such as the efficacy of religious rituals. Using a novel protocol, EEG data were simultaneously recorded from ethnic Chinese religious believers in group and individual settings as they rated the perceived efficacy of low, medium, and high arousal spirit-medium rituals presented as video clips. Neural oscillatory patterns were then analyzed for these perceptual judgements, categorized as low, medium, and high efficacy. The results revealed distinct neural signatures and behavioral patterns between the experimental conditions. Arousal levels predicted ratings of ritual efficacy. Increased efficacy was marked by suppressed alpha and beta power, regardless of group or individual setting. In groups, efficacy ratings converged. Individual setting showed increased within-participant phase synchronization in alpha and beta bands, while group setting enhanced between-participant theta phase synchronization. This reflected group participants' orientation toward a common perspective and social coordination. These findings suggest that co-presence in groups leads to a social-tuning effect supported by between-participant theta phase synchrony. Together these neural synchrony patterns reveal how collective rituals have both individual and communal dimensions. The emotionality of spirit-medium rituals drives individual perceptions of efficacy, while co-presence in groups signals the significance of an event and socially tunes enhanced agreement in perceptual ratings. In other words, mass gatherings may foster social cohesion without necessarily requiring group-size scaling limitations of direct face-to-face interaction. This could have implications for the scaling computability of synchrony in large groups as well as for humanistic studies in areas such as symbolic interactionism.

Hemispheric mPFC asymmetry in decision making under ambiguity and risk: An fNIRS study

The Iowa Gambling Task (IGT) is a commonly used task for testing decision-making under ambiguity (the early stage) and risk (the late stage). However, differences between the temporal dynamic signals underlying these two types of decision-making as well as the hemispheric specificity of decision making during the IGT remain unknown. The present study sought to address this gap by focusing on the medial prefrontal cortex (mPFC), which plays an important role in decision-making across life domains. We used functional near-infrared spectroscopy (fNIRS) with high spatial and temporal resolution and measured oxy-hemoglobin concentration within the mPFC in 25 healthy participants who performed the IGT. Results showed that there are different activations of the right and left hemispheres of the mPFC during the different stages of IGT and types of decisions. This implies that the left and right mPFC can have different patterns of involvement in decision making, at least in IGT decisions, including making good (low risk) and bad (high risk) choices, under ambiguity and under risk conditions.