Implicit Perception of Differences between NLP-Produced and Human-Produced Language in the Mentalizing Network

Natural language processing (NLP) is central to the communication with machines and among ourselves, and NLP research field has long sought to produce human-quality language. Identification of informative criteria for measuring NLP-produced language quality will support development of ever-better NLP tools. The authors hypothesize that mentalizing network neural activity may be used to distinguish NLP-produced language from human-produced language, even for cases where human judges cannot subjectively distinguish the language source. Using the social chatbots Google Meena in English and Microsoft XiaoIce in Chinese to generate NLP-produced language, behavioral tests which reveal that variance of personality perceived from chatbot chats is larger than for human chats are conducted, suggesting that chatbot language usage patterns are not stable. Using an identity rating task with functional magnetic resonance imaging, neuroimaging analyses which reveal distinct patterns of brain activity in the mentalizing network including the DMPFC and rTPJ in response to chatbot versus human chats that cannot be distinguished subjectively are conducted. This study illustrates a promising empirical basis for measuring the quality of NLP-produced language: adding a judge's implicit perception as an additional criterion.

The Role of the Left Inferior Frontal Gyrus in Introspection during Verbal Communication

Conversation enables the sharing of our subjective experiences through verbalizing introspected thoughts and feelings. The mentalizing network represents introspection, and successful conversation is characterized by alignment through imitation mediated by the mirror neuron system (MNS). Therefore, we hypothesized that the interaction between the mentalizing network and MNS mediates the conversational exchange of introspection. To test this, we performed hyperscanning functional magnetic resonance imaging during structured real-time conversations between 19 pairs of healthy participants. The participants first evaluated their preference for and familiarity with a presented object and then disclosed it. The control was the object feature identification task. When contrasted with the control, the preference/familiarity evaluation phase activated the dorso-medial prefrontal cortex, anterior cingulate cortex, precuneus, left hippocampus, right cerebellum, and orbital portion of the left inferior frontal gyrus (IFG), which represents introspection. The left IFG was activated when the two participants' statements of introspection were mismatched during the disclosure. Disclosing introspection enhanced the functional connectivity of the left IFG with the bilateral superior temporal gyrus and primary motor cortex, representing the auditory MNS. Thus, the mentalizing system and MNS are hierarchically linked in the left IFG during a conversation, allowing for the sharing of introspection of the self and others.

Development of the mentalizing network structures and theory of mind in extremely preterm youth

Adolescents born preterm (<37 weeks of gestation) are at elevated risk for deficits in social cognition and peer relationships. Theory of Mind (ToM) is a complex form of social cognition important for regulating social interactions. ToM and the underlying mentalizing network continue to develop across adolescence. The present study recruited 48 adolescents (12-17 years old) who were either born extremely preterm (EPT; <28 weeks of gestation) or full-term (FT) at birth. Cortical thickness, gray matter volume and surface area were measured in four regions of the mentalizing network: the temporoparietal junction, anterior temporal cortex, posterior superior temporal sulcus and frontal pole (mBA10). We also assessed the adolescents' performance on a ToM task. Findings revealed both group differences and group-by-age interaction effects in the gray matter indices within the temporal lobe regions of the mentalizing network. The EPT group also performed significantly worse than the FT group on the ToM task. The cortical structural measures that discriminated the EPT and FT groups were not related to ToM performance. These results highlight altered developmental changes in brain regions underlying mentalizing functions in EPT adolescents relative to FT controls.

Neurobiological Bases of Social Networks

A social network is a web that integrates multiple levels of interindividual social relationships and has direct associations with an individual’s health and well-being. Previous research has mainly focused on how brain and social network structures (structural properties) act on each other and on how the brain supports the spread of ideas and behaviors within social networks (functional properties). The structure of the social network is correlated with activity in the amygdala, which links decoding and interpreting social signals and social values. The structure also relies on the mentalizing network, which is central to an individual’s ability to infer the mental states of others. Network functional properties depend on multilayer brain-social networks, indicating that information transmission is supported by the default mode system, the valuation system, and the mentalizing system. From the perspective of neuroendocrinology, overwhelming evidence shows that variations in oxytocin, β-endorphin and dopamine receptor genes, including oxytocin receptor (OXTR), mu opioid receptor 1 (OPRM1) and dopamine receptor 2 (DRD2), predict an individual’s social network structure, whereas oxytocin also contributes to improved transmission of emotional and behavioral information from person to person. Overall, previous studies have comprehensively revealed the effects of the brain, endocrine system, and genes on social networks. Future studies are required to determine the effects of cognitive abilities, such as memory, on social networks, the characteristics and neural mechanism of social networks in mental illness and how social networks change over time through the use of longitudinal methods.

Neural processing of social interaction: Coordinate-based meta-analytic evidence from human neuroimaging studies

While the action observation and mentalizing networks are considered to play complementary roles in understanding others' goals and intentions, they might be concurrently engaged when processing social interactions. We assessed this hypothesis via three activation-likelihood-estimation meta-analyses of neuroimaging studies on the neural processing of: (a) social interactions, (b) individual actions by the action observation network, and (c) mental states by the mentalizing network. Conjunction analyses and direct comparisons unveiled overlapping and specific regions among the resulting maps. We report quantitative meta-analytic evidence for a "social interaction network" including key nodes of the action observation and mentalizing networks. An action-social interaction-mentalizing gradient of activity along the posterior temporal cortex highlighted a hierarchical processing of interactions, from visuomotor analyses decoding individual and shared intentions to in-depth inferences on actors' intentional states. The medial prefrontal cortex, possibly in conjunction with the amygdala, might provide additional information concerning the affective valence of the interaction. This evidence suggests that the functional architecture underlying the neural processing of interactions involves the joint involvement of the action observation and mentalizing networks. These data might inform the design of rehabilitative treatments for social cognition disorders in pathological conditions, and the assessment of their outcome in randomized controlled trials.

Losing Control in Social Situations: How the Presence of Others Affects Neural Processes Related to Sense of Agency

Social contexts substantially influence individual behavior, but little is known about how they affect cognitive processes related to voluntary action. Previously, it has been shown that social context reduces participants' sense of agency over the outcomes of their actions and outcome monitoring. In this fMRI study on human volunteers, we investigated the neural mechanisms by which social context alters sense of agency. Participants made costly actions to stop inflating a balloon before it burst. On "social" trials, another player could act in their stead, but we analyzed only trials in which the other player remained passive. We hypothesized that mentalizing processes during social trials would affect decision-making fluency and lead to a decreased sense of agency. In line with this hypothesis, we found increased activity in the bilateral temporo-parietal junction (TPJ), precuneus, and middle frontal gyrus during social trials compared with nonsocial trials. Activity in the precuneus was, in turn, negatively related to sense of agency at a single-trial level. We further found a double dissociation between TPJ and angular gyrus (AG): activity in the left AG was not sensitive to social context but was negatively related to sense of agency. In contrast, activity in the TPJ was modulated by social context but was not sensitive to sense of agency.

Increases in brain activity during social competition predict decreases in working memory performance and later recall

In our fMRI experiment, participants completed a learning task in both a noncompetitive and a socially competitive learning environment. Despite reporting a preference for completing the task while competing, participants remembered significantly more during the task and later recalled more from the noncompetitive learning environment. Furthermore, during working memory maintenance, there was performance-related deactivation in the medial prefrontal cortex (mPFC) and the precuneus/PCC. During feedback presentation, there was greater activation in the mPFC and the precuneus/PCC while competing. Differential activation in the precuneus/PCC predicted worse later recall for information learned competitively. Since previous research suggests that the mPFC is involved in social-referencing, while the precuneus/PCC is implicated in off-task thoughts, our results suggest that receiving feedback regarding competition produces more activation in brain regions implicated in social interaction, as well as task distraction. While competition may make a task more enjoyable, the goal of winning may distract from maximizing performance. Hum Brain Mapp 38:457-471, 2017. © 2016 Wiley Periodicals, Inc.

Differential Patterns of Dysconnectivity in Mirror Neuron and Mentalizing Networks in Schizophrenia

Impairments of social cognition are well documented in patients with schizophrenia (SCZ), but the neural basis remains poorly understood. In light of evidence that suggests that the "mirror neuron system" (MNS) and the "mentalizing network" (MENT) are key substrates of intersubjectivity and joint action, it has been suggested that dysfunction of these neural networks may underlie social difficulties in SCZ patients. Additionally, MNS and MENT might be associated differently with positive vs negative symptoms, given prior social cognitive and symptom associations. We assessed resting state functional connectivity (RSFC) in meta-analytically defined MNS and MENT networks in this patient group. Magnetic resonance imaging (MRI) scans were obtained from 116 patients and 133 age-, gender- and movement-matched healthy controls (HC) at 5 different MRI sites. Network connectivity was analyzed for group differences and correlations with clinical symptoms. Results demonstrated decreased connectivity within the MNS and also the MENT in patients compared to controls. Notably, dysconnectivity of the MNS was related to symptom severity, while no such relationship was observed for the MENT. In sum, these findings demonstrate that differential patterns of dysconnectivity exist in SCZ patients, which may contribute differently to the interpersonal difficulties commonly observed in the disorder.