Conceptual Alignment: How Brains Achieve Mutual Understanding

Self-views converge during enjoyable conversations

Based on current research, it is evident that the way people see themselves is shaped by their conversation partners. Historically, this literature focuses on how one individual's expectations can shape another person's self-views. Given the reciprocal nature of conversation, we wondered whether conversation partners' self-views may mutually evolve. Using four-person round-robin conversation networks, we found that participants tended to have more similar self-views post-conversation than pre-conversation, an effect we term "inter-self alignment." Further, the more two partners' self-views aligned, the more they enjoyed their conversation and were inclined to interact again. This effect depended on both conversation partners becoming aligned. These findings suggest that the way we see ourselves is coauthored in the act of dialogue and that as shared self-views develop, the desire to continue the conversation increases.

Brain-to-brain coupling forecasts future joint action outcomes

In this study, we investigated whether brain-to-brain coupling patterns could predict performance in a time-estimation task that requires two players to cooperate. The participant pairs were tasked with synchronizing button presses after converging on a shared representation of "short," "medium," and "long" time intervals while utilizing feedback to adjust responses. We employed electroencephalogram (EEG)-hyperscanning and focused on post-feedback brain activity. We found that negative feedback led to increased frontal mid-line theta activity across individuals. Moreover, a correlation in post-feedback theta power between players forecasted failed joint action, while an anti-correlation forecasted success. These findings suggest that temporally coupled feedback-related brain activity between two individuals serves as an indicator of redundancy in adjustment of a common goal representation. Additionally, the anti-correlation of this activity reflects cognitive strategic mechanisms that ensure optimal joint action outcomes. Rather than a paired overcompensation, successful cooperation requires flexible strategic agility from both partners.

When "more for others, less for self" leads to co-benefits: A tri-MRI dyad-hyperscanning study

Unselfishness is admired, especially when collaborations between groups of various scales are urgently needed. However, its neural mechanisms remain elusive. In a tri-MRI dyad-hyperscanning experiment involving 26 groups, each containing 4 participants as two rotating pairs in a coordination game, we sought to achieve reciprocity, or "winning in turn by the two interacting players," as the precursor to unselfishness. Due to its critical role in social processing, the right temporal-parietal junction (rTPJ) was the seed for both time domain (connectivity) and frequency domain (i.e., coherence) analyses. For the former, negative connectivity between the rTPJ and the mentalizing network areas (e.g., the right inferior parietal lobule, rIPL) was identified, and such connectivity was further negatively correlated with the individual's final gain, supporting our task design that "rewarded" the reciprocal participants. For the latter, cerebral coherences of the rTPJs emerged between the interacting pairs (i.e., within-group interacting pairs), and the coupling between the rTPJ and the right superior temporal gyrus (rSTG) between the players who were not interacting with each other (i.e., within-group noninteracting pairs). These coherences reinforce the hypotheses that the rTPJ-rTPJ coupling tracks the collaboration processes and the rTPJ-rSTG coupling for the emergence of decontextualized shared meaning. Our results underpin two social roles (inferring others' behavior and interpreting social outcomes) subserved by the rTPJ-related network and highlight its interaction with other-self/other-concerning brain areas in reaching co-benefits among unselfish players.

The Emerging Science of Interacting Minds

For over a century, psychology has focused on uncovering mental processes of a single individual. However, humans rarely navigate the world in isolation. The most important determinants of successful development, mental health, and our individual traits and preferences arise from interacting with other individuals. Social interaction underpins who we are, how we think, and how we behave. Here we discuss the key methodological challenges that have limited progress in establishing a robust science of how minds interact and the new tools that are beginning to overcome these challenges. A deep understanding of the human mind requires studying the context within which it originates and exists: social interaction.

Influence of interpersonal distance on collaborative performance in the joint Simon task-An fNIRS-based hyperscanning study

Collaboration is a critical skill in everyday life. It has been suggested that collaborative performance may be influenced by social factors such as interpersonal distance, which is defined as the perceived psychological distance between individuals. Previous literature has reported that close interpersonal distance may promote the level of self-other integration between interacting members, and in turn, enhance collaborative performance. These studies mainly focused on interdependent collaboration, which requires high levels of shared representations and self-other integration. However, little is known about the effect of interpersonal distance on independent collaboration (e.g., the joint Simon task), in which individuals perform the task independently while the final outcome is determined by the parties. To address this issue, we simultaneously measured the frontal activations of ninety-four pairs of participants using a functional near-infrared spectroscopy (fNIRS)-based hyperscanning technique while they performed a joint Simon task. Behavioral results showed that the Joint Simon Effect (JSE), defined as the RT difference between incongruent and congruent conditions indicating the level of self-other integration between collaborators, was larger in the friend group than in the stranger group. Consistently, the inter-brain neural synchronization (INS) across the dorsolateral and medial parts of the prefrontal cortex was also stronger in the friend group. In addition, INS in the left dorsolateral prefrontal cortex negatively predicted JSE only in the friend group. These results suggest that close interpersonal distance may enhance the shared mental representation among collaborators, which in turn influences their collaborative performance.

Multi-Level Linguistic Alignment in a Dynamic Collaborative Problem-Solving Task

Cocreating meaning in collaboration is challenging. Success is often determined by people's abilities to coordinate their language to converge upon shared mental representations. Here we explore one set of low-level linguistic behaviors, linguistic alignment, that both emerges from, and facilitates, outcomes of high-level convergence. Linguistic alignment captures the ways people reuse, that is, "align to," the lexical, syntactic, and semantic forms of others' utterances. Our focus is on the temporal change of multi-level linguistic alignment, as well as how alignment is related to communicative outcomes within a unique collaborative problem-solving paradigm. The primary task, situated within a virtual educational video game, requires creative thinking between three people where the paths for possible solutions are highly variable. We find that over time interactions are marked by decreasing lexical and syntactic alignment, with a trade-off of increasing semantic alignment. However, greater semantic alignment does not translate into better team performance. Overall, these findings provide greater clarity on the role of linguistic coordination within complex and dynamic collaborative problem-solving tasks.

Interpersonal alignment of neural evidence accumulation to social exchange of confidence

Private, subjective beliefs about uncertainty have been found to have idiosyncratic computational and neural substrates yet, humans share such beliefs seamlessly and cooperate successfully. Bringing together decision making under uncertainty and interpersonal alignment in communication, in a discovery plus pre-registered replication design, we examined the neuro-computational basis of the relationship between privately held and socially shared uncertainty. Examining confidence-speed-accuracy trade-off in uncertainty-ridden perceptual decisions under social vs isolated context, we found that shared (i.e. reported confidence) and subjective (inferred from pupillometry) uncertainty dynamically followed social information. An attractor neural network model incorporating social information as top-down additive input captured the observed behavior and demonstrated the emergence of social alignment in virtual dyadic simulations. Electroencephalography showed that social exchange of confidence modulated the neural signature of perceptual evidence accumulation in the central parietal cortex. Our findings offer a neural population model for interpersonal alignment of shared beliefs.

Characterizing the mechanisms of social connection

Understanding how individuals form and maintain strong social networks has emerged as a significant public health priority as a result of the increased focus on the epidemic of loneliness and the myriad protective benefits conferred by social connection. In this review, we highlight the psychological and neural mechanisms that enable us to connect with others, which in turn help buffer against the consequences of stress and isolation. Central to this process is the experience of rewards derived from positive social interactions, which encourage the sharing of perspectives and preferences that unite individuals. Sharing affective states with others helps us to align our understanding of the world with another's, thereby continuing to reinforce bonds and strengthen relationships. These psychological processes depend on neural systems supporting reward and social cognitive function. Lastly, we also consider limitations associated with pursuing healthy social connections and outline potential avenues of future research.

EEG-based speaker-listener neural coupling reflects speech-selective attentional mechanisms beyond the speech stimulus

When we pay attention to someone, do we focus only on the sound they make, the word they use, or do we form a mental space shared with the speaker we want to pay attention to? Some would argue that the human language is no other than a simple signal, but others claim that human beings understand each other because they form a shared mental ground between the speaker and the listener. Our study aimed to explore the neural mechanisms of speech-selective attention by investigating the electroencephalogram-based neural coupling between the speaker and the listener in a cocktail party paradigm. The temporal response function method was employed to reveal how the listener was coupled to the speaker at the neural level. The results showed that the neural coupling between the listener and the attended speaker peaked 5 s before speech onset at the delta band over the left frontal region, and was correlated with speech comprehension performance. In contrast, the attentional processing of speech acoustics and semantics occurred primarily at a later stage after speech onset and was not significantly correlated with comprehension performance. These findings suggest a predictive mechanism to achieve speaker-listener neural coupling for successful speech comprehension.

Synchronized affect in shared experiences strengthens social connection

People structure their days to experience events with others. We gather to eat meals, watch TV, and attend concerts together. What constitutes a shared experience and how does it manifest in dyadic behavior? The present study investigates how shared experiences-measured through emotional, motoric, physiological, and cognitive alignment-promote social bonding. We recorded the facial expressions and electrodermal activity (EDA) of participants as they watched four episodes of a TV show for a total of 4 h with another participant. Participants displayed temporally synchronized and spatially aligned emotional facial expressions and the degree of synchronization predicted the self-reported social connection ratings between viewing partners. We observed a similar pattern of results for dyadic physiological synchrony measured via EDA and their cognitive impressions of the characters. All four of these factors, temporal synchrony of positive facial expressions, spatial alignment of expressions, EDA synchrony, and character impression similarity, contributed to a latent factor of a shared experience that predicted social connection. Our findings suggest that the development of interpersonal affiliations in shared experiences emerges from shared affective experiences comprising synchronous processes and demonstrate that these complex interpersonal processes can be studied in a holistic and multi-modal framework leveraging naturalistic experimental designs.

Verbal information exchange enhances collective performance through increasing group identification

Information exchange is a key factor in the attainment of collective outcomes and the navigation of social life. In the current study, we investigated whether and how information exchange enhanced collective performance by combining behavioral and neuroimaging approaches from the perspective of multiparticipant neuroscience. To evaluate collective performance, we measured the collaborative problem-solving abilities of triads working on a murder mystery case. We first found that verbal information exchange significantly enhanced collective performance compared to nonverbal exchange. Moreover, both group sharing and group discussion positively contributed to this effect, with group discussion being more essential. Importantly, group identification mediated the positive effect of verbal information exchange on collective performance. This mediation was supported by higher interactive frequency and enhanced within-group neural synchronization (GNS) in the dorsolateral prefrontal cortex (DLPFC). Taken together, we provided a multiparticipant theoretical model to explain how verbal information exchange enhanced collective performance. Our findings deepen the insight into the workings of group decision-making.

Shared intentionality modulates interpersonal neural synchronization at the establishment of communication system

Whether and how shared intentionality (SI) influences the establishment of a novel interpersonal communication system is poorly understood. To investigate this issue, we designed a coordinating symbolic communication game (CSCG) and applied behavioral, functional near-infrared spectroscopy (fNIRS)-based hyperscanning, and hyper-transcranial alternating current stimulation (hyper-tACS) methods. Here we show that SI is a strong contributor to communicative accuracy. Moreover, SI, communicative accuracy, and interpersonal neural synchronization (INS) in the right superior temporal gyrus (rSTG) are higher when dyads successfully establish a novel communication system. Furthermore, the SI influences communicative accuracy by increasing INS. Additionally, using time series and long short-term memory neural network analyses, we find that the INS can predict communicative accuracy at the early formation stage of the communication system. Importantly, the INS partially mediates the relationship between the SI and the communicative accuracy only at the formation stage of the communication system. In contrast, when the communication system is established, SI and INS no longer contribute to communicative accuracy. Finally, the hyper-tACS experiment confirms that INS has a causal effect on communicative accuracy. These findings suggest a behavioral and neural mechanism, subserved by the SI and INS, that underlies the establishment of a novel interpersonal communication system.

Beyond speaking: neurocognitive perspectives on language production in social interaction

The human faculty to speak has evolved, so has been argued, for communicating with others and for engaging in social interactions. Hence the human cognitive system should be equipped to address the demands that social interaction places on the language production system. These demands include the need to coordinate speaking with listening, the need to integrate own (verbal) actions with the interlocutor's actions, and the need to adapt language flexibly to the interlocutor and the social context. In order to meet these demands, core processes of language production are supported by cognitive processes that enable interpersonal coordination and social cognition. To fully understand the cognitive architecture and its neural implementation enabling humans to speak in social interaction, our understanding of how humans produce language needs to be connected to our understanding of how humans gain insights into other people's mental states and coordinate in social interaction. This article reviews theories and neurocognitive experiments that make this connection and can contribute to advancing our understanding of speaking in social interaction. This article is part of a discussion meeting issue 'Face2face: advancing the science of social interaction'.

The development of the conversation skills assessment tool

Background and aims

Having a conversation with someone or even more within a group of people is complex. We are never taught at school how to do it, which implies we consider having a conversation as something simple and straightforward. Instead, we just learn from observing others. Some people are great conversationalists - it comes naturally to them - while others struggle. Some people may not fully understand how the process works, how turn-taking happens, don't understand visual cues such as body language and facial expressions, and fail to comprehend that some topics may be appropriate or inappropriate. This can be the case for both neurotypical and neurodivergent people. The Conversation skills Assessment Tool has been developed in this first instance to help in assessing and examining conversation skills in an intervention with young autistic adults on a virtual platform (a virtual world). This paper will present the evolution of the new measure through the exploratory phase, the development phase and finally a detailed account of the inter-rater reliability process.

Methods

The intervention associated with this study was carried out though a multiple baseline design with 3 autistic participants (in their early 20 s) and took place over 4 phases (15-17 sessions). The sessions involved semi-structured conversations in face-to-face (phases 1 and 4) and virtual (phases 2 and 3) settings and were videotaped with the participants' consent. Twelve of those were used by this study in the development process through iterative inter-rater reliability stages between two coding teams.

Results

Evaluation of the Conversation skills Assessment Tool tool revealed the potential benefit of implementing interventions with measures that more objectively and concretely (e.g., by noting frequencies) assess observable behaviours that are associated with having positive conversations with others. Beyond this, it is anticipated that Conversation skills Assessment Tool can emerge as a tool capable of not only accounting for the environment an interaction takes place in (e.g., professional, casual), but also offers beneficial feedback for both autistic students and other populations (e.g., young children, English language learners).

Conclusions

This measure has the potential to offer quantifiable and trackable guidance to people who have difficulties conversing. The authors do not wish to perpetuate an ableist social construct of what is a 'good' conversation, nor do they suggest that conversation skills training is useful solely for people with communication and/or socialization difficulties. Rather, they hope that Conversation skills Assessment Tool can be adopted more broadly to give both neurotypical and neurodivergent people a better understanding of how to communicate more effectively with others, while also becoming more aware and accepting of differing conversational styles.

Implications

Because of its ability to track (or self-monitor) one's development of conversational skills over time, Conversation skills Assessment Tool could serve as an educative tool in early childhood education. It can be used by occupational/speech therapists and other professionals and also used to self-monitor one's development of conversational skills. Conversation skills Assessment Tool was developed to assess conversation skills on a one-to-one basis; therefore, another iteration of Conversation skills Assessment Tool would have to look at group conversations.

Distinct cerebral coherence in task-based fMRI hyperscanning: cooperation versus competition

This study features an functional magnetic resonance imaging (fMRI) hyperscanning experiment from 2 sites, 305 km apart. The experiment contains 2 conditions: the dyad collaborated to win and then split the reward in the cooperation condition, whereas the winner took all the reward in the competition condition, thereby resulting in dynamic strategic interactions. To calculate the cerebral coherence in such jittered event-related fMRI tasks, we first iteratively estimated the feedback-related blood oxygenation level-dependent responses of each trial, using 8 finite impulse response functions (16 s) and then concatenated the beta volume series. With the right temporal-parietal junction (rTPJ) as the seed, the interpersonal connected brain areas were separately identified: the right superior temporal gyrus (rSTG) (cooperation) and the left precuneus (lPrecuneus) (competition), both peaking at the designated frequency bin (1/16 s = 0.0625 Hz), but not in permuted pairs. In addition, the extended coherence analyses on shorter and longer concatenated volumes verified that only in the optimal trial frequency did the rTPJ-rSTG and rTPJ-lPrecuneus couplings peak. In sum, our approach both showcases a flexible analysis method that widens the applicability of interpersonal coherence in the rapid event-related fMRI hyperscanning and reveals a context-based inter-brain coupling between interacting pairs during cooperation and during competition.

The CABB dataset: A multimodal corpus of communicative interactions for behavioural and neural analyses

We present a dataset of behavioural and fMRI observations acquired in the context of humans involved in multimodal referential communication. The dataset contains audio/video and motion-tracking recordings of face-to-face, task-based communicative interactions in Dutch, as well as behavioural and neural correlates of participants' representations of dialogue referents. Seventy-one pairs of unacquainted participants performed two interleaved interactional tasks in which they described and located 16 novel geometrical objects (i.e., Fribbles) yielding spontaneous interactions of about one hour. We share high-quality video (from three cameras), audio (from head-mounted microphones), and motion-tracking (Kinect) data, as well as speech transcripts of the interactions. Before and after engaging in the face-to-face communicative interactions, participants' individual representations of the 16 Fribbles were estimated. Behaviourally, participants provided a written description (one to three words) for each Fribble and positioned them along 29 independent conceptual dimensions (e.g., rounded, human, audible). Neurally, fMRI signal evoked by each Fribble was measured during a one-back working-memory task. To enable functional hyperalignment across participants, the dataset also includes fMRI measurements obtained during visual presentation of eight animated movies (35 min total). We present analyses for the various types of data demonstrating their quality and consistency with earlier research. Besides high-resolution multimodal interactional data, this dataset includes different correlates of communicative referents, obtained before and after face-to-face dialogue, allowing for novel investigations into the relation between communicative behaviours and the representational space shared by communicators. This unique combination of data can be used for research in neuroscience, psychology, linguistics, and beyond.

Gamma‐band neural coupling during conceptual alignment

Conceptual alignment is a prerequisite for mutual understanding. However, little is known about the neurophysiological brain‐to‐brain underpinning during conceptual alignment for mutual understanding. Here, we recorded multi‐channel electroencephalogram (EEG) simultaneously from two participants in Experiment 1 and adopted the dual‐tACS techniques in Experiment 2 to investigate the underlying brain‐to‐brain EEG coupling during conceptual alignment and the possible enhancement effect. Our results showed that 1) higher phase‐locking value (PLV), a sensitive measure for quantifying neural coupling strength between EEG signals, at the gamma frequency band (28–40 Hz), was observed in the left temporoparietal site (left TP) area between successful versus unsuccessful conceptual alignment. The left TP gamma coupling strength correlated with the accuracy of conceptual alignment and differentiated whether subjects belonged to the SUCCESS or FAILURE groups in our study. 2) In‐phase gamma‐band transcranial alternating current stimulation (tACS) over the left TP area increased the accuracy of subjects in the SUCCESS group but not the FAILURE group. 3) The effect of perspective‐taking on the accuracy was mediated by the gamma coupling strength within the left TP area. Our results support the role of gamma‐band coupling between brains for interpersonal conceptual alignment. We provide dynamic interpersonal neurophysiological insights into the formation of successful communication.

Eye contact marks the rise and fall of shared attention in conversation

Conversation is the platform where minds meet: the venue where information is shared, ideas cocreated, cultural norms shaped, and social bonds forged. Its frequency and ease belie its complexity. Every conversation weaves a unique shared narrative from the contributions of independent minds, requiring partners to flexibly move into and out of alignment as needed for conversation to both cohere and evolve. How two minds achieve this coordination is poorly understood. Here we test whether eye contact, a common feature of conversation, predicts this coordination by measuring dyadic pupillary synchrony (a corollary of shared attention) during natural conversation. We find that eye contact is positively correlated with synchrony as well as ratings of engagement by conversation partners. However, rather than elicit synchrony, eye contact commences as synchrony peaks and predicts its immediate and subsequent decline until eye contact breaks. This relationship suggests that eye contact signals when shared attention is high. Furthermore, we speculate that eye contact may play a corrective role in disrupting shared attention (reducing synchrony) as needed to facilitate independent contributions to conversation.

Intolerance of uncertainty modulates brain-to-brain synchrony during politically polarized perception

Political partisans see the world through an ideologically biased lens. What drives political polarization? Although it has been posited that polarization arises because of an inability to tolerate uncertainty and a need to hold predictable beliefs about the world, evidence for this hypothesis remains elusive. We examined the relationship between uncertainty tolerance and political polarization using a combination of brain-to-brain synchrony and intersubject representational similarity analysis, which measured committed liberals' and conservatives' (n = 44) subjective interpretation of naturalistic political video material. Shared ideology between participants increased neural synchrony throughout the brain during a polarizing political debate filled with provocative language but not during a neutrally worded news clip on polarized topics or a nonpolitical documentary. During the political debate, neural synchrony in mentalizing and valuation networks was modulated by one's aversion to uncertainty: Uncertainty-intolerant individuals experienced greater brain-to-brain synchrony with politically like-minded peers and lower synchrony with political opponents-an effect observed for liberals and conservatives alike. Moreover, the greater the neural synchrony between committed partisans, the more likely that two individuals formed similar, polarized attitudes about the debate. These results suggest that uncertainty attitudes gate the shared neural processing of political narratives, thereby fueling polarized attitude formation about hot-button issues.

Reduced listener-speaker neural coupling underlies speech understanding difficulty in older adults

An increasing number of studies have highlighted the importance of listener-speaker neural coupling in successful verbal communication. Whether the brain-to-brain coupling changes with healthy aging and the possible role of this change in the speech comprehension of older adults remain unexplored. In this study, we scanned with fMRI a young and an older speaker telling real-life stories and then played the audio recordings to a group of young (N = 28, aged 19-27 year) and a group of older adults during scanning (N = 27, aged 53-75 year), respectively. The older listeners understood the speech less well than did the young listeners, and the age of the older listeners was negatively correlated with their level of speech understanding. Compared to the young listener-speaker dyads, the older dyads exhibited reduced neural couplings in both linguistic and extra-linguistic areas. Moreover, within the older group, the listener's age was negatively correlated with the overall strength of interbrain coupling, which in turn was associated with reduced speech understanding. These results reveal the deficits of older adults in achieving neural alignment with other brains, which may underlie the age-related decline in speech understanding.

Examining the effect of online advertisement cues on human responses using eye-tracking, EEG, and MRI

This study sought to emphasize how disciplines such as neuroscience and marketing can be applied in advertising and consumer behavior. The application of neuroscience methods in analyzing and understanding human behavior related to the Elaboration Likelihood Model (ELM) and brain activity has recently garnered attention. This study examines brain processes while participants attempted to elicit preferences for a product, and demonstrates factors that influence consumer behavior using eye-tracking, electroencephalography (EEG), and magnetic resonance imaging (MRI) from a neuroscience approach. We planned two conditions of online advertising, namely, peripheral cues without argument and central cues with argument strength. Thirty respondents participated in the experiment, consisting of eye-tracking, EEG, and MRI instruments to explore brain activity in central cue conditions. We investigated whether diffusion tensor imaging (DTI) analysis could detect regional brain changes. Using eye-tracking, we found that the responses were mainly in the mean fixation duration, number of fixations, mean saccade duration, and number of saccade durations for the central cue condition. Moreover, the findings show that the fusiform gyrus and frontal cortex are significantly associated with building a relationship by inferring central cues in the EEG assay. The MRI images show that the fusiform gyrus and frontal cortex are significantly active in the central cue condition. DTI analysis indicates that the corpus callosum has changed in the central cue condition. We used eye-tracking, EEG, MRI, and DTI to understand that these connections may apprehend responses when viewing advertisements, especially in the fusiform gyrus, frontal cortex, and corpus callosum.

A World Unto Itself: Human Communication as Active Inference

Recent theoretical work in developmental psychology suggests that humans are predisposed to align their mental states with those of other individuals. One way this manifests is in cooperative communication; that is, intentional communication aimed at aligning individuals' mental states with respect to events in their shared environment. This idea has received strong empirical support. The purpose of this paper is to extend this account by proposing an integrative model of the biobehavioral dynamics of cooperative communication. Our formulation is based on active inference. Active inference suggests that action-perception cycles operate to minimize uncertainty and optimize an individual's internal model of the world. We propose that humans are characterized by an evolved adaptive prior belief that their mental states are aligned with, or similar to, those of conspecifics (i.e., that 'we are the same sort of creature, inhabiting the same sort of niche'). The use of cooperative communication emerges as the principal means to gather evidence for this belief, allowing for the development of a shared narrative that is used to disambiguate interactants' (hidden and inferred) mental states. Thus, by using cooperative communication, individuals effectively attune to a hermeneutic niche composed, in part, of others' mental states; and, reciprocally, attune the niche to their own ends via epistemic niche construction. This means that niche construction enables features of the niche to encode precise, reliable cues about the deontic or shared value of certain action policies (e.g., the utility of using communicative constructions to disambiguate mental states, given expectations about shared prior beliefs). In turn, the alignment of mental states (prior beliefs) enables the emergence of a novel, contextualizing scale of cultural dynamics that encompasses the actions and mental states of the ensemble of interactants and their shared environment. The dynamics of this contextualizing layer of cultural organization feedback, across scales, to constrain the variability of the prior expectations of the individuals who constitute it. Our theory additionally builds upon the active inference literature by introducing a new set of neurobiologically plausible computational hypotheses for cooperative communication. We conclude with directions for future research.

Beyond the Isolated Brain: The Promise and Challenge of Interacting Minds

As scientists, we brainstorm and develop experimental designs with our colleagues and students. Paradoxically, this teamwork has produced a field focused nearly exclusively on mapping the brain as if it evolved in isolation. Here, we discuss promises and challenges in advancing our understanding of how human minds connect during social interaction.

Emotions amplify speaker-listener neural alignment

Individuals often align their emotional states during conversation. Here, we reveal how such emotional alignment is reflected in synchronization of brain activity across speakers and listeners. Two "speaker" subjects told emotional and neutral autobiographical stories while their hemodynamic brain activity was measured with functional magnetic resonance imaging (fMRI). The stories were recorded and played back to 16 "listener" subjects during fMRI. After scanning, both speakers and listeners rated the moment-to-moment valence and arousal of the stories. Time-varying similarity of the blood-oxygenation-level-dependent (BOLD) time series was quantified by intersubject phase synchronization (ISPS) between speaker-listener pairs. Telling and listening to the stories elicited similar emotions across speaker-listener pairs. Arousal was associated with increased speaker-listener neural synchronization in brain regions supporting attentional, auditory, somatosensory, and motor processing. Valence was associated with increased speaker-listener neural synchronization in brain regions involved in emotional processing, including amygdala, hippocampus, and temporal pole. Speaker-listener synchronization of subjective feelings of arousal was associated with increased neural synchronization in somatosensory and subcortical brain regions; synchronization of valence was associated with neural synchronization in parietal cortices and midline structures. We propose that emotion-dependent speaker-listener neural synchronization is associated with emotional contagion, thereby implying that listeners reproduce some aspects of the speaker's emotional state at the neural level.

Shared neural representations of syntax during online dyadic communication

When people communicate, they come to see the world in a similar way to each other by aligning their mental representations at such levels as syntax. Syntax is an essential feature of human language that distinguishes humans from other non-human animals. However, whether and how communicators share neural representations of syntax is not well understood. Here we addressed this issue by measuring the brain activity of both communicators in a series of dyadic communication contexts, by using functional near-infrared spectroscopy (fNIRS)-based hyperscanning. Two communicators alternatively spoke sentences either with the same or with different syntactic structures. Results showed a significantly higher-level increase of interpersonal neural synchronization (INS) at right posterior superior temporal cortex when communicators produced the same syntactic structures as each other compared to when they produced different syntactic structures. These increases of INS correlated significantly with communication quality. Our findings provide initial evidence for shared neural representations of syntax between communicators.

Navigating cognition: Spatial codes for human thinking

The hippocampal formation has long been suggested to underlie both memory formation and spatial navigation. We discuss how neural mechanisms identified in spatial navigation research operate across information domains to support a wide spectrum of cognitive functions. In our framework, place and grid cell population codes provide a representational format to map variable dimensions of cognitive spaces. This highly dynamic mapping system enables rapid reorganization of codes through remapping between orthogonal representations across behavioral contexts, yielding a multitude of stable cognitive spaces at different resolutions and hierarchical levels. Action sequences result in trajectories through cognitive space, which can be simulated via sequential coding in the hippocampus. In this way, the spatial representational format of the hippocampal formation has the capacity to support flexible cognition and behavior.

Communicative misalignment in Autism Spectrum Disorder

Communication deficits are a defining feature of Autism Spectrum Disorder (ASD), manifest during social interactions. Previous studies investigating communicative deficits have largely focused on the perceptual biases, social motivation, cognitive flexibility, or mentalizing abilities of isolated individuals. By embedding autistic individuals in live non-verbal interactions, we characterized a novel cause for their communication deficits. Adults with ASD matched neurotypical individuals in their ability and propensity to generate and modify intelligible behaviors for a communicative partner. However, they struggled to align the meaning of those behaviors with their partner when meaning required referencing their recent communicative history. This communicative misalignment explains why autistic individuals are vulnerable in everyday interactions, which entail fleeting ambiguities, but succeed in social cognition tests involving stereotyped contextual cues. These findings illustrate the cognitive and clinical importance of considering social interaction as a communicative alignment challenge, and how ineffective human communication is without this key interactional ingredient.

The neural oscillatory markers of phonetic convergence during verbal interaction

During a conversation, the neural processes supporting speech production and perception overlap in time and, based on context, expectations and the dynamics of interaction, they are also continuously modulated in real time. Recently, the growing interest in the neural dynamics underlying interactive tasks, in particular in the language domain, has mainly tackled the temporal aspects of turn-taking in dialogs. Besides temporal coordination, an under-investigated phenomenon is the implicit convergence of the speakers toward a shared phonetic space. Here, we used dual electroencephalography (dual-EEG) to record brain signals from subjects involved in a relatively constrained interactive task where they were asked to take turns in chaining words according to a phonetic rhyming rule. We quantified participants' initial phonetic fingerprints and tracked their phonetic convergence during the interaction via a robust and automatic speaker verification technique. Results show that phonetic convergence is associated to left frontal alpha/low-beta desynchronization during speech preparation and by high-beta suppression before and during listening to speech in right centro-parietal and left frontal sectors, respectively. By this work, we provide evidence that mutual adaptation of speech phonetic targets, correlates with specific alpha and beta oscillatory dynamics. Alpha and beta oscillatory dynamics may index the coordination of the "when" as well as the "how" speech interaction takes place, reinforcing the suggestion that perception and production processes are highly interdependent and co-constructed during a conversation.

Perception of social synchrony induces mother-child gamma coupling in the social brain

The recent call to move from focus on one brain’s functioning to two-brain communication initiated a search for mechanisms that enable two humans to coordinate brain response during social interactions. Here, we utilized the mother–child context as a developmentally salient setting to study two-brain coupling. Mothers and their 9-year-old children were videotaped at home in positive and conflictual interactions. Positive interactions were microcoded for social synchrony and conflicts for overall dialogical style. Following, mother and child underwent magnetoencephalography while observing the positive vignettes. Episodes of behavioral synchrony, compared to non-synchrony, increased gamma-band power in the superior temporal sulcus (STS), hub of social cognition, mirroring and mentalizing. This neural pattern was coupled between mother and child. Brain-to-brain coordination was anchored in behavioral synchrony; only during episodes of behavioral synchrony, but not during non-synchronous moments, mother’s and child's STS gamma power was coupled. Importantly, neural synchrony was not found during observation of unfamiliar mother-child interaction Maternal empathic/dialogical conflict style predicted mothers’ STS activations whereas child withdrawal predicted attenuated STS response in both partners. Results define a novel neural marker for brain-to-brain synchrony, highlight the role of rapid bottom-up oscillatory mechanisms for neural coupling and indicate that behavior-based processes may drive synchrony between two brains during social interactions.

Neural Mechanisms of Social Cognition in Primates

Activity in a network of areas spanning the superior temporal sulcus, dorsomedial frontal cortex, and anterior cingulate cortex is concerned with how nonhuman primates negotiate the social worlds in which they live. Central aspects of these circuits are retained in humans. Activity in these areas codes for primates' interactions with one another, their attempts to find out about one another, and their attempts to prevent others from finding out too much about themselves. Moreover, important features of the social world, such as dominance status, cooperation, and competition, modulate activity in these areas. We consider the degree to which activity in these regions is simply encoding an individual's own actions and choices or whether this activity is especially and specifically concerned with social cognition. Recent advances in comparative anatomy and computational modeling may help us to gain deeper insights into the nature and boundaries of primate social cognition.

How to Create Shared Symbols

Human cognition and behavior are dominated by symbol use. This paper examines the social learning strategies that give rise to symbolic communication. Experiment 1 contrasts an individual-level account, based on observational learning and cognitive bias, with an inter-individual account, based on social coordinative learning. Participants played a referential communication game in which they tried to communicate a range of recurring meanings to a partner by drawing, but without using their conventional language. Individual-level learning, via observation and cognitive bias, was sufficient to produce signs that became increasingly effective, efficient, and shared over games. However, breaking a referential precedent eliminated these benefits. The most effective, most efficient, and most shared signs arose when participants could directly interact with their partner, indicating that social coordinative learning is important to the creation of shared symbols. Experiment 2 investigated the contribution of two distinct aspects of social interaction: behavior alignment and concurrent partner feedback. Each played a complementary role in the creation of shared symbols: Behavior alignment primarily drove communication effectiveness, and partner feedback primarily drove the efficiency of the evolved signs. In conclusion, inter-individual social coordinative learning is important to the evolution of effective, efficient, and shared symbols.

Probabilistic language models in cognitive neuroscience: Promises and pitfalls

Cognitive neuroscientists of language comprehension study how neural computations relate to cognitive computations during comprehension. On the cognitive part of the equation, it is important that the computations and processing complexity are explicitly defined. Probabilistic language models can be used to give a computationally explicit account of language complexity during comprehension. Whereas such models have so far predominantly been evaluated against behavioral data, only recently have the models been used to explain neurobiological signals. Measures obtained from these models emphasize the probabilistic, information-processing view of language understanding and provide a set of tools that can be used for testing neural hypotheses about language comprehension. Here, we provide a cursory review of the theoretical foundations and example neuroimaging studies employing probabilistic language models. We highlight the advantages and potential pitfalls of this approach and indicate avenues for future research.

How language shapes the cultural inheritance of categories

It is widely recognized that language plays a key role in the transmission of human culture, but relatively little is known about the mechanisms by which language simultaneously encourages both cultural stability and cultural innovation. This paper examines this issue by focusing on the use of language to transmit categories, focusing on two universal devices: labels (e.g., shark, woman) and generics (e.g., "sharks attack swimmers"; "women are nurturing"). We propose that labels and generics each assume two key principles: norms and essentialism. The normative assumption permits transmission of category information with great fidelity, whereas essentialism invites innovation by means of an open-ended, placeholder structure. Additionally, we sketch out how labels and generics aid in conceptual alignment and the progressive "looping" between categories and cultural practices. In this way, human language is a technology that enhances and expands the categorization capacities that we share with other animals.

Structure Mapping and Vocabularies for Thinking

While extremes tend to capture attention, the ordinary is often most of the story. So it may be with the structure-mapping process. The structure-mapping process can account for such pinnacles of thinking as analogy and metaphor, which can lead to overlooking the mundane, incremental use of structure mapping. Consequently, the current discussion shifts focus to the value of close comparisons between literally similar items for the development of knowledge. The intent is to foster greater integration between process and content as well as between individuals and collectives. The payoff is identifying some undue simplifications and some promising new directions.

What can we learn from a two-brain approach to verbal interaction?

Verbal interaction is one of the most frequent social interactions humans encounter on a daily basis. In the current paper, we zoom in on what the multi-brain approach has contributed, and can contribute in the future, to our understanding of the neural mechanisms supporting verbal interaction. Indeed, since verbal interaction can only exist between individuals, it seems intuitive to focus analyses on inter-individual neural markers, i.e. between-brain neural coupling. To date, however, there is a severe lack of theoretically-driven, testable hypotheses about what between-brain neural coupling actually reflects. In this paper, we develop a testable hypothesis in which between-pair variation in between-brain neural coupling is of key importance. Based on theoretical frameworks and empirical data, we argue that the level of between-brain neural coupling reflects speaker-listener alignment at different levels of linguistic and extra-linguistic representation. We discuss the possibility that between-brain neural coupling could inform us about the highest level of inter-speaker alignment: mutual understanding.