The influence of perceptual and knowledge-based familiarity on the neural substrates of face perception

Perceiving social injustice during arrests of Black and White civilians by White police officers: An fMRI investigation

From social media to courts of law, recordings of interracial police officer-civilian interactions are now widespread and publicly available. People may be motivated to preferentially understand the dynamics of these interactions when they perceive injustice towards those whose communities experience disproportionate policing relative to others (e.g., non-White racial/ethnic groups). To explore these questions, two studies were conducted (study 1 neuroimaging n = 69 and study 2 behavioral n = 58). The fMRI study examined White participants' neural activity when viewing real-world videos with varying degrees of aggression or conflict of White officers arresting a Black or White civilian. Activity in brain regions supporting social cognition was greater when viewing Black (vs. White) civilians involved in more aggressive police encounters. Additionally, although an independent sample of perceivers rated videos featuring Black and White civilians as similar in overall levels of aggression when civilian race was obscured, participants in the fMRI study (where race was not obscured) rated officers as more aggressive and their use of force as less legitimate when the civilian was Black. In study 2, participants who had not viewed the videos also reported that they believe police are generally more unjustly aggressive towards Black compared with White civilians. These findings inform our understanding of how perceptions of conflict with the potential for injustice shape social cognitive engagement when viewing arrests of Black and White individuals by White police officers.

Infrequent faces bias social attention differently in manual and oculomotor measures

Although attention is thought to be spontaneously biased by social cues like faces and eyes, recent data have demonstrated that when extraneous content, context, and task factors are controlled, attentional biasing is abolished in manual responses while still occurring sparingly in oculomotor measures. Here, we investigated how social attentional biasing was affected by face novelty by measuring responses to frequently presented (i.e., those with lower novelty) and infrequently presented (i.e., those with higher novelty) face identities. Using a dot-probe task, participants viewed either the same face and house identity that was frequently presented on half of the trials or sixteen different face and house identities that were infrequently presented on the other half of the trials. A response target occurred with equal probability at the previous location of the eyes or mouth of the face or the top or bottom of the house. Experiment 1 measured manual responses to the target while participants maintained central fixation. Experiment 2 additionally measured participants' natural oculomotor behaviour when their eye movements were not restricted. Across both experiments, no evidence of social attentional biasing was found in manual data. However, in Experiment 2, there was a reliable oculomotor bias towards the eyes of infrequently presented upright faces. Together, these findings suggest that face novelty does not facilitate manual measures of social attention, but it appears to promote spontaneous oculomotor biasing towards the eyes of infrequently presented novel faces.

Spatially Adjacent Regions in Posterior Cingulate Cortex Represent Familiar Faces at Different Levels of Complexity

Extensive research has shown that perceptual information of faces is processed in a network of hierarchically-organized areas within ventral temporal cortex. For familiar and famous faces, perceptual processing of faces is normally accompanied by extraction of semantic knowledge about the social status of persons. Semantic processing of familiar faces could entail progressive stages of information abstraction. However, the cortical mechanisms supporting multistage processing of familiar faces have not been characterized. Here, using an event-related fMRI experiment, familiar faces from four celebrity groups (actors, singers, politicians, and football players) and unfamiliar faces were presented to the human subjects (both males and females) while they were engaged in a face categorization task. We systematically explored the cortical representations for faces, familiar faces, subcategories of familiar faces, and familiar face identities using whole-brain univariate analysis, searchlight-based multivariate pattern analysis (MVPA), and functional connectivity analysis. Convergent evidence from all these analyses revealed a set of overlapping regions within posterior cingulate cortex (PCC) that contained decodable fMRI responses for representing different levels of semantic knowledge about familiar faces. Our results suggest a multistage pathway in PCC for processing semantic information of faces, analogous to the multistage pathway in ventral temporal cortex for processing perceptual information of faces.SIGNIFICANCE STATEMENT Recognizing familiar faces is an important component of social communications. Previous research has shown that a distributed network of brain areas is involved in processing the semantic information of familiar faces. However, it is not clear how different levels of semantic information are represented in the brain. Here, we evaluated the multivariate response patterns across the entire cortex to discover the areas that contain information for familiar faces, subcategories of familiar faces, and identities of familiar faces. The searchlight maps revealed that different levels of semantic information are represented in topographically adjacent areas within posterior cingulate cortex (PCC). The results suggest that semantic processing of faces is mediated through progressive stages of information abstraction in PCC.

Shared neural codes for visual and semantic information about familiar faces in a common representational space

Our brain processes faces of close others differently than faces of visually familiar individuals. While both types of faces activate similar visual areas, faces of close others activate areas involved in processing social and semantic information. Here, we used between-subject linear classifiers trained on hyperaligned brain data to investigate the neural code for visual and semantic information about familiar others. The identity of both visually and personally familiar faces could be decoded across participants from brain activity in visual areas. Instead, only the identity of personally familiar faces could be decoded in areas involved in social cognition. Our results suggest that individually distinctive information associated with familiar faces is embedded in a neural code that is shared across brains.

Processes evoked by seeing a personally familiar face encompass recognition of visual appearance and activation of social and person knowledge. Whereas visual appearance is the same for all viewers, social and person knowledge may be more idiosyncratic. Using between-subject multivariate decoding of hyperaligned functional magnetic resonance imaging data, we investigated whether representations of personally familiar faces in different parts of the distributed neural system for face perception are shared across individuals who know the same people. We found that the identities of both personally familiar and merely visually familiar faces were decoded accurately across brains in the core system for visual processing, but only the identities of personally familiar faces could be decoded across brains in the extended system for processing nonvisual information associated with faces. Our results show that personal interactions with the same individuals lead to shared neural representations of both the seen and unseen features that distinguish their identities.

Computational approaches to the neuroscience of social perception

Across multiple domains of social perception-including social categorization, emotion perception, impression formation and mentalizing-multivariate pattern analysis (MVPA) of functional magnetic resonance imaging (fMRI) data has permitted a more detailed understanding of how social information is processed and represented in the brain. As in other neuroimaging fields, the neuroscientific study of social perception initially relied on broad structure-function associations derived from univariate fMRI analysis to map neural regions involved in these processes. In this review, we trace the ways that social neuroscience studies using MVPA have built on these neuroanatomical associations to better characterize the computational relevance of different brain regions, and discuss how MVPA allows explicit tests of the correspondence between psychological models and the neural representation of social information. We also describe current and future advances in methodological approaches to multivariate fMRI data and their theoretical value for the neuroscience of social perception.

Decoding category and familiarity information during visual imagery

Visual imagery relies on a widespread network of brain regions, partly engaged during the perception of external stimuli. Beyond the recruitment of category-selective areas (FFA, PPA), perception of familiar faces and places has been reported to engage brain areas associated with semantic information, comprising the precuneus, temporo-parietal junction (TPJ), medial prefrontal cortex (mPFC) and posterior cingulate cortex (PCC). Here we used multivariate pattern analyzes (MVPA) to examine to which degree areas of the visual imagery network, category-selective and semantic areas contain information regarding the category and familiarity of imagined stimuli. Participants were instructed via auditory cues to imagine personally familiar and unfamiliar stimuli (i.e. faces and places). Using region-of-interest (ROI)-based MVPA, we were able to distinguish between imagined faces and places within nodes of the visual imagery network (V1, SPL, aIPS), within category-selective inferotemporal regions (FFA, PPA) and across all brain regions of the extended semantic network (i.e. precuneus, mPFC, IFG and TPJ). Moreover, we were able to decode familiarity of imagined stimuli in the SPL and aIPS, and in some regions of the extended semantic network (in particular, right precuneus, right TPJ), but not in V1. Our results suggest that posterior visual areas - including V1 - host categorical representations about imagined stimuli, and that stimulus familiarity might be an additional aspect that is shared between perception and visual imagery.

Interracial Contact Differentially Shapes Brain Networks Involved in Social and Non-Social Judgments From Faces: A Combination of Univariate and Multivariate Approaches

The present work explores the relationship between interracial contact and the neural substrates of explicit social and non-social judgments about both racial ingroup and outgroup targets. Convergent evidence from univariate and multivariate partial least squares (PLS) analyses reveals that contact shapes the recruitment of brain regions involved in social cognition similarly for both ingroup and outgroup targets. Results support the hypothesis that increased contact is associated with generalized changes in social cognition toward both ingroup and outgroup faces. Specifically, regardless of target race, low- and average-contact perceivers showed the typically observed increased recruitment of temporoparietal junction and dorsomedial prefrontal cortex during social compared to perceptual judgments. However, high-contact perceivers did not show selective recruitment of these brain regions for social judgments. Complimenting univariate results, multivariate PLS analyses reveal that greater perceiver contact leads to reduced co-activation in networks of brain regions associated with face processing (e.g. fusiform gyrus) and salience detection (e.g. anterior cingulate cortex and insula). Across univariate and multivariate analyses, we found no evidence that contact differentially impacted cross-race face perception. Instead, when performing either a social or a novel perceptual task, interracial contact appears to broadly shape how perceivers engage with all faces.

The influence of item familiarization on neural discriminability during associative memory encoding and retrieval

Associative memory requires one to encode and form memory representations not just for individual items, but for the association or link between those items. Past work has suggested that associative memory is facilitated when individual items are familiar rather than simultaneously learning the items and their associative link. The current study employed multivoxel pattern analyses (MVPA) to investigate whether item familiarization prior to associative encoding affects the distinctiveness of neural patterns, and whether that distinctiveness is also present during associative retrieval. Our results suggest that prior exposure to item stimuli impacts the representations of their shared association compared to stimuli that are novel at the time of associative encoding throughout most of the associative memory network. While this distinction was also present at retrieval, the overall extent of the difference was diminished. Overall the results suggest that stimulus familiarity influences the representation of associative pairings during memory encoding and retrieval, and the pair-specific representation is maintained across memory phases irrespective of this distinction.

Facemasks and face recognition: Potential impact on synaptic plasticity

Visual recognition of facial expression modulates our social interactions. Compelling experimental evidence indicates that face conveys plenty of information that are fundamental for humans to interact. These are encoded at neural level in specific cortical and subcortical brain regions through activity- and experience-dependent synaptic plasticity processes. The current pandemic, due to the spread of SARS-CoV-2 infection, is causing relevant social and psychological detrimental effects. The institutional recommendations on physical distancing, namely social distancing and wearing of facemasks are effective in reducing the rate of viral spread. However, by impacting social interaction, facemasks might impair the neural responses to recognition of facial cues that are overall critical to our behaviors. In this survey, we briefly review the current knowledge on the neurobiological substrate of facial recognition and discuss how the lack of salient stimuli might impact the ability to retain and consolidate learning and memory phenomena underlying face recognition. Such an "abnormal" visual experience raises the intriguing possibility of a "reset" mechanism, a renewed ability of adult brain to undergo synaptic plasticity adaptations.

Getting to Know Someone: Familiarity, Person Recognition, and Identification in the Human Brain

In our everyday life, we continuously get to know people, dominantly through their faces. Several neuroscientific experiments showed that familiarization changes the behavioral processing and underlying neural representation of faces of others. Here, we propose a model of the process of how we actually get to know someone. First, the purely visual familiarization of unfamiliar faces occurs. Second, the accumulation of associated, nonsensory information refines person representation, and finally, one reaches a stage where the effortless identification of very well-known persons occurs. We offer here an overview of neuroimaging studies, first evaluating how and in what ways the processing of unfamiliar and familiar faces differs and, second, by analyzing the fMRI adaptation and multivariate pattern analysis results we estimate where identity-specific representation is found in the brain. The available neuroimaging data suggest that different aspects of the information emerge gradually as one gets more and more familiar with a person within the same network. We propose a novel model of familiarity and identity processing, where the differential activation of long-term memory and emotion processing areas is essential for correct identification.

Am I the same person across my life span? An event-related brain potentials study of the temporal perspective in self-identity

While self-identity recognition has been largely explored, less is known on how self-identity changes as a function of time. The present work aims to explore the influence of the temporal perspective on self-identity by studying event-related brain potentials (ERP) associated with face processing. To this purpose, participants had to perform a recognition task in two blocks with different task demands: (i) identity recognition (self, close-friend, unknown), and (ii) life stage recognition (adulthood -current-, adolescence, and childhood). The results showed that the N170 component was sensitive to changes in the global face configuration when comparing adulthood with other life stages. The N250 was the earliest neural marker discriminating self from other identities and may be related to a preferential deployment of attentional resources to recognize own face. The P3 was a robust index of self-specificity, reflecting stimulus categorization and presumably adding an emotional value. The results of interest emerged for the subsequent late positive complex (LPC). The larger amplitude for the LPC to the self-face was probably associated with further personal significance. The LPC, therefore, was able to distinguish the continuity of the self over time (i.e., between current self and past selves). Likewise, this component also could discriminate, at each life stage, the self-identity from other identities (e.g., between past self and past close-friend). This would confirm a remarkable role of the LPC reflecting higher self-relevance processes. Taken together, the neural representation of oneself (i.e., "I am myself") seems to be stable and also updated across time.

The ventromedial prefrontal cortex is particularly responsive to social evaluations requiring the use of person-knowledge

Humans can rely on diverse sources of information to evaluate others, including knowledge (e.g., occupation, likes and dislikes, education, etc.) and perceptual cues (e.g., attractiveness, race, etc.). Previous research has identified brain regions supporting person evaluations, but are evaluations based on perceptual cues versus person-knowledge processed differently? Moreover, are neural responses consistent when person-knowledge is available but unnecessary for the evaluation? This fMRI study examined how the use and availability of person-knowledge shapes the neural underpinnings of social evaluations. Participants evaluated well-known actors based on attractiveness or body of work (i.e., person-knowledge) and unknown models based on attractiveness only. Analyses focused on the VMPFC, following research implicating this region in positive evaluations based on person-knowledge. The VMPFC was sensitive to the (1) availability of person-knowledge, showing greater responses as ratings became more positive for actors (but not models) regardless of rating dimension and (2) use of available person-knowledge, showing greater activity as ratings for likability based on body of work became more positive for actors versus models rated on attractiveness. These findings indicate that although brain regions supporting person evaluation are sensitive to the availability to person-knowledge, they are even more responsive when judgments require the use of available person-knowledge.

Idiosyncratic, Retinotopic Bias in Face Identification Modulated by Familiarity

The perception of gender and age of unfamiliar faces is reported to vary idiosyncratically across retinal locations such that, for example, the same androgynous face may appear to be male at one location but female at another. Here, we test spatial heterogeneity for the recognition of the identity of personally familiar faces in human participants. We found idiosyncratic biases that were stable within participants and that varied more across locations for low as compared to high familiar faces. These data suggest that like face gender and age, face identity is processed, in part, by independent populations of neurons monitoring restricted spatial regions and that the recognition responses vary for the same face across these different locations. Moreover, repeated and varied social interactions appear to lead to adjustments of these independent face recognition neurons so that the same familiar face is eventually more likely to elicit the same recognition response across widely separated visual field locations. We provide a mechanistic account of this reduced retinotopic bias based on computational simulations.

Decoding the neural representation of self and person knowledge with multivariate pattern analysis and data-driven approaches

Multivariate pattern analysis and data-driven approaches to understand how the human brain encodes sensory information and higher level conceptual knowledge have become increasingly dominant in visual and cognitive neuroscience; however, it is only in recent years that these methods have been applied to the domain of social information processing. This review examines recent research in the field of social cognitive neuroscience focusing on how multivariate pattern analysis (e.g., pattern classification, representational similarity analysis) and data-driven methods (e.g., reverse correlation, intersubject correlation) have been used to decode and characterize high-level information about the self, other persons, and social groups. We begin with a review of what is known about how self-referential processing and person perception are represented in the medial prefrontal cortex based on conventional activation-based neuroimaging approaches. This is followed by a nontechnical overview of current multivariate pattern-based and data-driven neuroimaging methods designed to characterize and/or decode neural representations. The remainder of the review focuses on examining how these methods have been applied to the topic of self, person perception, and the perception of social groups. In this review, we highlight recent trends (e.g., analysis of social networks, decoding race and social groups, and the use of naturalistic stimuli) and discuss several theoretical challenges that arise from the application of these new methods to the question of how the brain represents knowledge about the self and others. This article is categorized under: Neuroscience > Cognition.

The neural representation of personally familiar and unfamiliar faces in the distributed system for face perception

Personally familiar faces are processed more robustly and efficiently than unfamiliar faces. The human face processing system comprises a core system that analyzes the visual appearance of faces and an extended system for the retrieval of person-knowledge and other nonvisual information. We applied multivariate pattern analysis to fMRI data to investigate aspects of familiarity that are shared by all familiar identities and information that distinguishes specific face identities from each other. Both identity-independent familiarity information and face identity could be decoded in an overlapping set of areas in the core and extended systems. Representational similarity analysis revealed a clear distinction between the two systems and a subdivision of the core system into ventral, dorsal and anterior components. This study provides evidence that activity in the extended system carries information about both individual identities and personal familiarity, while clarifying and extending the organization of the core system for face perception.

Consistent Neural Activity Patterns Represent Personally Familiar People

How does the brain encode and organize our understanding of the people we know? In this study, participants imagined personally familiar others in a variety of contexts while undergoing fMRI. Using multivoxel pattern analysis, we demonstrated that thinking about familiar others elicits consistent fine-grained patterns of neural activity. Person-specific patterns were distributed across many regions previously associated with social cognition, including medial prefrontal, medial parietal, and lateral temporoparietal cortices, as well as other regions including the anterior and mid-cingulate, insula, and precentral gyrus. Analogous context-specific patterns were observed in medial parietal and superior occipital regions. These results suggest that medial parietal cortex may play a particularly central role in simulating familiar others, as this is the only region to simultaneously represent both person and context information. Moreover, within portions of medial parietal cortex, the degree to which person-specific patterns were typically instated on a given trial predicted subsequent judgments of accuracy and vividness in the mental simulation. This suggests that people may access neural representations in this region to form metacognitive judgments of confidence in their mental simulations. In addition to fine-grained patterns within brain regions, we also observed encoding of both familiar people and contexts in coarse-grained patterns spread across the independently defined social brain network. Finally, we found tentative evidence that several established theories of person perception might explain the relative similarity between person-specific patterns within the social brain network.

Tell me twice: A multi-study analysis of the functional connectivity between the cerebrum and cerebellum after repeated trait information

This multi-study analysis (6 fMRI studies; 142 participants) explores the functional activation and connectivity of the cerebellum with the cerebrum during repeated behavioral information uptake informing about personality traits of different persons. The results suggest that trait repetition recruits activity in areas belonging to the mentalizing and executive control networks in the cerebrum, and the executive control areas in the cerebellum. Cerebral activation was observed in the executive control network including the posterior medial frontal cortex (pmFC), the bilateral prefrontal cortex (PFC) and bilateral inferior parietal cortex (IPC), in the mentalizing network including the bilateral middle temporal cortex (MTC) extending to the right superior temporal cortex (STC), as well as in the visual network including the left cuneus (Cun) and the left inferior occipital cortex. Moreover, cerebellar activation was found bilaterally in lobules VI and VII belonging to the executive control network. Importantly, significant patterns of functional connectivity were found linking these cerebellar executive areas with cerebral executive areas in the medial pmFC, the left PFC and the left IPC, and mentalizing areas in the left MTC. In addition, connectivity was found between the cerebral areas in the left hemisphere involved in the executive and mentalizing networks, as well as with their homolog areas in the right hemisphere. The discussion centers on the role of these cerebello-cerebral connections in matching internal predictions generated by the cerebellum with external information from the cerebrum, presumably involving the sequencing of behaviors.

Neural dissociations between meaningful and mere inconsistency in impression updating

Recent neuroimaging work has identified a network of regions that work in concert to update impressions of other people, particularly in response to inconsistent behavior. However, the specific functional contributions of these regions to the updating process remain unclear. Using fMRI, we tested whether increases in activity triggered by inconsistent behavior reflect changes in the stored representations of other people in response to behavioral inconsistency, or merely a response to the inconsistency itself. Participants encountered a series of individuals whose behavior either changed in an attributionally meaningful fashion or was merely inconsistent with the immediately preceding behavior. We observed that left ventrolateral prefrontal cortex (vlPFC) and left inferior frontal gyrus (IFG) were preferentially recruited in response to unexpected, immoral behavior, whereas a separate set of regions (including dorsal anterior cingulate cortex, posterior cingulate cortex and temporoparietal junction/inferior parietal lobule) was preferentially recruited in response to more mundane inconsistencies in behavior. These results shed light on the distributed systems supporting impression updating. Specifically, while many regions supporting updating may primarily respond to moment-to-moment changes in behavior, a subset of regions (e.g. vlPFC and IFG) may contribute to updating person representations in response to trait-relevant changes in behavior.

Linking person perception and person knowledge in the human brain

Neuroscience research has examined separately how we detect human agents on the basis of their face and body (person perception) and how we reason about their thoughts, traits or intentions (person knowledge). Neuroanatomically distinct networks have been associated with person perception and person knowledge, but it remains unknown how multiple features of a person (e.g. thin and kind) are linked to form a holistic identity representation. In this fMRI experiment, we investigated the hypothesis that when encountering another person specialised person perception circuits would be functionally coupled with circuits involved in person knowledge. In a factorial design, we paired bodies or names with trait-based or neutral statements, and independent localiser scans identified body-selective and mentalising networks. When observing a body paired with a trait-implying statement, functional connectivity analyses demonstrated that body-selective patches in bilateral fusiform gyri were functionally coupled with nodes of the mentalising network. We demonstrate that when forming a representation of a person circuits for representing another person's physical appearance are linked to circuits that are engaged when reasoning about trait-based character. These data support the view that a 'who' system for social cognition involves communication between perceptual and inferential mechanisms when forming a representation of another's identity.

Getting to know you: general and specific neural computations for learning about people

Learning about other peoples' attributes, e.g. whether an individual is generous or selfish, is central to human social cognition. It is well documented that a network of cortical regions is reliably activated when we engage social processes. However, little is known about the specific computations performed by these regions or whether such processing is specialized for the social domain. We investigated these questions using a task in which participants (N= 26) learned about four peoples' generosity by watching them choose to share money with third party partners, or not. In a non-social control condition, participants learned the win/loss rates of four lotteries. fMRI analysis revealed learning-related general (social + non-social) prediction error signals in the dorsomedial and dorsolateral prefrontal cortices (bilaterally), and in the right lateral parietal cortex. Socially specific (social > non-social) prediction error signals were found in the precuneus. Interestingly, the region that exhibited social prediction errors was a distinct subregion of the area in the precuneus and posterior cingulate cortex that exhibited a commonly reported main effect of higher overall activity for social vs non-social stimuli. These findings elucidate the domain--general and--specific computations underlying learning about other people and demonstrate the increased explanatory power of computational approaches to social cognition.

Brain Metabolic Dysfunction in Capgras Delusion During Alzheimer's Disease: A Positron Emission Tomography Study

Capgras delusion is characterized by the misidentification of people and by the delusional belief that the misidentified persons have been replaced by impostors, generally perceived as persecutors. Since little is known regarding the neural correlates of Capgras syndrome, the cerebral metabolic pattern of a patient with probable Alzheimer's disease (AD) and Capgras syndrome was compared with those of 24-healthy elderly participants and 26 patients with AD without delusional syndrome. Comparing the healthy group with the AD group, the patient with AD had significant hypometabolism in frontal and posterior midline structures. In the light of current neural models of face perception, our patients with Capgras syndrome may be related to impaired recognition of a familiar face, subserved by the posterior cingulate/precuneus cortex, and impaired reflection about personally relevant knowledge related to a face, subserved by the dorsomedial prefrontal cortex.

Familiar Face Detection in 180 ms

The visual system is tuned for rapid detection of faces, with the fastest choice saccade to a face at 100 ms. Familiar faces have a more robust representation than do unfamiliar faces, and are detected faster in the absence of awareness and with reduced attentional resources. Faces of family and close friends become familiar over a protracted period involving learning the unique visual appearance, including a view-invariant representation, as well as person knowledge. We investigated the effect of personal familiarity on the earliest stages of face processing by using a saccadic-choice task to measure how fast familiar face detection can happen. Subjects made correct and reliable saccades to familiar faces when unfamiliar faces were distractors at 180 ms--very rapid saccades that are 30 to 70 ms earlier than the earliest evoked potential modulated by familiarity. By contrast, accuracy of saccades to unfamiliar faces with familiar faces as distractors did not exceed chance. Saccades to faces with object distractors were even faster (110 to 120 ms) and equivalent for familiar and unfamiliar faces, indicating that familiarity does not affect ultra-rapid saccades. We propose that detectors of diagnostic facial features for familiar faces develop in visual cortices through learning and allow rapid detection that precedes explicit recognition of identity.

An fMRI investigation of the effects of culture on evaluations of stigmatized individuals

Certain groups (e.g., women, older adults, and the economically disadvantaged) are universally stigmatized. Numerous studies, however, have identified cross-cultural differences in the attitudes expressed toward stigmatized groups. These differences may potentially be due to existing cross-cultural dissimilarities in social status for some groups. The current study used fMRI to examine whether Chinese and Caucasian-American participants engage the same cognitive and affective mechanisms when perceiving stigmatized individuals with similarly low social status in both cultures (homeless individuals), but different cognitive and/or affective processes when evaluating stigmatized individuals whose status differs across cultures (older adults). Using a social neuroscience approach can provide unique insight into this question because the neural regions involved in cognitive and affective evaluations of stigmatized individuals have been well characterized. Results revealed that Chinese participants and Caucasian-American participants engaged similar patterns of negative affective processing associated with disgust (left anterior insula) when evaluating homeless individuals. Moreover, self-reported negative explicit attitudes toward homeless individuals were associated with increased activity in the insula. However, Chinese participants and Caucasian-American participants engaged increased activity in neural regions associated with status (ventral striatum) when they evaluated older adults. Moreover, self-reported attitudes toward older adults and ventral striatal activity were correlated with the extent to which participants reported being affiliated with their respective cultural traditions.

Spatiotemporal changes in neural response patterns to faces varying in visual familiarity

Increasing experience with a previously unfamiliar face improves human ability to recognize it in challenging and novel viewing conditions. Differential neural responses to familiar versus unfamiliar faces in multiple regions of the ventral-temporal and parietal cortex have been reported in previous work, but with limited attention to how behavioral and neural measures change with increasing familiarity. We examined changes in the spatial and temporal characteristics of neural response patterns elicited by faces that vary in their degree of visual familiarity. First, we developed a behavioral paradigm to familiarize participants to low-, medium-, and high-levels of familiarity with faces. Recognition of novel, naturalistic images of the learned individuals improved with increasing familiarity with faces. Next, a new set of participants learned faces using the behavioral paradigm, outside the fMRI scanner, and subsequently viewed blocks of whole-body images of the learned and novel people, inside the scanner. We found that the face-selective FFA and OFA, and a combination of the ventral-temporal areas (e.g., fusiform gyrus) and parietal areas (e.g., precuneus) contained patterns useful for classifying highly familiar versus unfamiliar faces. Classification along the temporal-sequence of the face blocks revealed an early separation of neural patterns elicited in response to highly familiar versus unfamiliar faces in the FFA and OFA, but not in other regions of interest. This indicates the potential for a rapid assessment of the "known versus unknown" status of faces in core face-selective regions of the brain. The present study provides a first look at the perceptual and neural correlates underlying experience gains with faces as they become familiar.

The Impact of Childhood Experience on Amygdala Response to Perceptually Familiar Black and White Faces

Given the well-documented involvement of the amygdala in race perception, the current study aimed to investigate how interracial contact during childhood shapes amygdala response to racial outgroup members in adulthood. Of particular interest was the impact of childhood experience on amygdala response to familiar, compared with novel, Black faces. Controlling for a number of well-established individual difference measures related to interracial attitudes, the results reveal that perceivers with greater childhood exposure to racial outgroup members display greater relative reduction in amygdala response to familiar Black faces. The implications of such findings are discussed in the context of previous investigations into the neural substrates of race perception and in consideration of potential mechanisms by which childhood experience may shape race perception.

The Dorsomedial Prefrontal Cortex Plays a Causal Role in Integrating Social Impressions from Faces and Verbal Descriptions

Several neuroimaging studies point to a key role of the dorsomedial prefrontal cortex (dmPFC) in the formation of socially relevant impressions. In 3 different experiments, participants were required to form socially relevant impressions about other individuals on the basis of text descriptions of their social behaviors, and to decide whether a face alone, a trait adjective (e.g., "selfish"), or a face presented with a trait adjective was consistent or inconsistent with the impression they had formed. Before deciding whether the target stimulus matched the impression they had previously formed, participants received transcranial magnetic stimulation (TMS) over the dmPFC, the inferior frontal gyrus (IFG, also implicated in social impression formation), or over a control site (vertex). Results from the 3 experiments converged in showing that interfering with dmPFC activity significantly delayed participants in responding whether a face-adjective pair was consistent with the impression they had formed. No effects of TMS were observed following stimulation of the IFG or when evaluations had to be made on faces or trait adjectives presented alone. Our findings critically extend previous neuroimaging evidence by indicating a causal role of the dmPFC in creating coherent impressions based on the integration of face and verbal description of social behaviors.

Medial temporal lobe resection attenuates superior temporal sulcus response to faces

Face perception depends on activation of a core face processing network including the fusiform face area, the occipital face area and the superior temporal sulcus (STS). The medial temporal lobe (MTL) is also involved in decoding facial expression and damage to the anterior MTL, including the amygdala, generally interferes with emotion recognition. The impairment in emotion recognition following anterior MTL injury can be a direct result from injured MTL circuitry, as well as an indirect result from decreased MTL modulation of areas in the core face network. To test whether the MTL modulates activity in the core face network, we used functional magnetic resonance imaging to investigate activation in the core face processing network in patients with right or left anterior temporal lobe resections (ATR) due to intractable epilepsy. We found reductions of face-related activation in the right STS after both right and left ATR together with impaired recognition of facial expressions. Reduced activity in the fusiform and the occipital face areas was also observed in patients after right ATR suggesting widespread effects on activity in the core face network in this group. The reduction in face-related STS activity after both right and left ATR suggests that MTL modulation of the STS may facilitate recognition of facial expression.

Distinct regions of prefrontal cortex are associated with the controlled retrieval and selection of social information

Research in social neuroscience has uncovered a social knowledge network that is particularly attuned to making social judgments. However, the processes that are being performed by both regions within this network and those outside of this network that are nevertheless engaged in the service of making a social judgment remain unclear. To help address this, we drew upon research in semantic memory, which suggests that making a semantic judgment engages 2 distinct control processes: A controlled retrieval process, which aids in bringing goal-relevant information to mind from long-term stores, and a selection process, which aids in selecting the information that is goal-relevant from the information retrieved. In a neuroimaging study, we investigated whether controlled retrieval and selection for social information engage distinct portions of both the social knowledge network and regions outside this network. Controlled retrieval for social information engaged an anterior ventrolateral portion of the prefrontal cortex, whereas selection engaged both the dorsomedial prefrontal cortex and temporoparietal junction within the social knowledge network. These results suggest that the social knowledge network may be more involved with the selection of social information than the controlled retrieval of it and incorporates lateral prefrontal regions in accessing memory for making social judgments.

Diagnostic value underlies asymmetric updating of impressions in the morality and ability domains

While positive behavioral information is diagnostic when evaluating a person's abilities, negative information is diagnostic when evaluating morality. Although social psychology has considered these two domains as orthogonal and distinct from one another, we demonstrate that this asymmetry in diagnosticity can be explained by a single parsimonious principle--the perceived frequency of behaviors in these domains. Less frequent behaviors (e.g., high ability and low morality) are weighed more heavily in evaluations. We show that this statistical principle of frequency-derived diagnosticity is evident in human participants at both behavioral and neural levels of analysis. Specifically, activity in right ventrolateral prefrontal cortex increased preferentially when participants updated impressions based on diagnostic behaviors, and further, activity in this region covaried parametrically with the perceived frequency of behaviors. Activity in left ventrolateral PFC, left inferior frontal gyrus, and left superior temporal sulcus showed similar patterns of diagnosticity and sensitivity, though additional analyses confirmed that these regions responded primarily to updates based on immoral behaviors.

Representations of individuals in ventral temporal cortex defined by faces and biographies

The fusiform gyrus responds more strongly to faces than to other categories of objects. This response could reflect either categorical detection of faces or recognition of particular facial identities. Recent fMRI studies have attempted to address the question of what information is encoded in these regions, but have reported mixed results. We tested whether the creation of richer identity representations via training on visual and social information, and the use of an adaptation design, would reveal more robust representations of these identities in ventral temporal cortex. Examining the patterns of activation across voxels in bilateral fusiform gyri, we identified unique patterns for particular identities. Attaching distinctive biographical information to identities did not increase the strength of these representations, but did produce a grouping effect: faces associated with the same amount of biographical information were represented more similarly to each other. These results are consistent with the possibility that identity exemplars are represented in posterior visual areas best known for their role in representing categorical information, and suggest that these areas may be sensitive to some forms of non-visual information, including from the social domain.

Anterior temporal face patches: a meta-analysis and empirical study

Evidence suggests the anterior temporal lobe (ATL) plays an important role in person identification and memory. In humans, neuroimaging studies of person memory report consistent activations in the ATL to famous and personally familiar faces and studies of patients report resection or damage of the ATL causes an associative prosopagnosia in which face perception is intact but face memory is compromised. In addition, high-resolution fMRI studies of non-human primates and electrophysiological studies of humans also suggest regions of the ventral ATL are sensitive to novel faces. The current study extends previous findings by investigating whether similar subregions in the dorsal, ventral, lateral, or polar aspects of the ATL are sensitive to personally familiar, famous, and novel faces. We present the results of two studies of person memory: a meta-analysis of existing fMRI studies and an empirical fMRI study using optimized imaging parameters. Both studies showed left-lateralized ATL activations to familiar individuals while novel faces activated the right ATL. Activations to famous faces were quite ventral, similar to what has been reported in previous high-resolution fMRI studies of non-human primates. These findings suggest that face memory-sensitive patches in the human ATL are in the ventral/polar ATL.

The neural substrates of person perception: spontaneous use of financial and moral status knowledge

The current study examines the effect of status information on the neural substrates of person perception. In an event-related fMRI experiment, participants were presented with photographs of faces preceded with information denoting either: low or high financial status (e.g., "earns $25,000" or "earns $350,000"), or low or high moral status (e.g., "is a tobacco executive" or "does cancer research"). Participants were asked to form an impression of the targets, but were not instructed to explicitly evaluate their social status. Building on previous brain-imaging investigations, regions of interest analyses were performed for brain regions expected to support either cognitive (i.e., intraparietal sulcus) or emotional (i.e., ventromedial prefrontal cortex) components of social status perception. Activation of the intraparietal sulcus was found to be sensitive to the financial status of individuals while activation of the ventromedial prefrontal cortex was sensitive to the moral status of individuals. The implications of these results towards uncovering the neural substrates of status perception and, more broadly, the extended network of brain regions involved in person perception are discussed.

Remembering first impressions: effects of intentionality and diagnosticity on subsequent memory

People rely on first impressions every day as an important tool to interpret social behavior. While research is beginning to reveal the neural underpinnings of first impressions, particularly through understanding the role of dorsal medial prefrontal cortex (dmPFC), little is known about the way in which first impressions are encoded into memory. This is surprising because first impressions are relevant from a social perspective for future interactions, requiring that they be transferred to memory. The present study used a subsequent-memory paradigm to test the conditions under which the dmPFC is implicated in the encoding of first impressions. We found that intentionally forming impressions engages the dmPFC more than does incidentally forming impressions, and that this engagement supports the encoding of remembered impressions. In addition, we found that diagnostic information, which more readily lends itself to forming trait impressions, engages the dmPFC more than does neutral information. These results indicate that the neural system subserving memory for impressions is sensitive to consciously formed impressions. The results also suggest a distinction between a social memory system and other explicit memory systems governed by the medial temporal lobes.

The representation of self and person knowledge in the medial prefrontal cortex

Nearly 40 years ago, social psychologists began applying the information processing framework of cognitive psychology to the question of how humans understand and represent knowledge about themselves and others. This approach gave rise to the immensely successful field of social cognition and fundamentally changed the way in which social psychological phenomena are studied. More recently, social scientists of many stripes have turned to the methods of cognitive neuroscience to understand the neural basis of social cognition. A pervasive finding from this research is that social knowledge, be it about one's self or of others, is represented in the medial prefrontal cortex (MPFC). This review focuses on the social cognitive neuroscience of self and person knowledge in the MPFC. We begin with a brief historical overview of social cognition, followed by a review of recent and influential research on the brain basis of self and person knowledge. In the latter half of this review, we discuss the role of familiarity and similarity in person perception and of spontaneous processes in self and other-referential cognition. Throughout, we discuss the myriad ways in which the social cognitive neuroscience approach has provided new insights into the nature and structure of self and person knowledge. WIREs Cogn Sci 2012, 3:451-470. doi: 10.1002/wcs.1183 This article is categorized under: Neuroscience > Cognition.

The neural dynamics of updating person impressions

Person perception is a dynamic, evolving process. Because other people are an endless source of social information, people need to update their impressions of others based upon new information. We devised an fMRI study to identify brain regions involved in updating impressions. Participants saw faces paired with valenced behavioral information and were asked to form impressions of these individuals. Each face was seen five times in a row, each time with a different behavioral description. Critically, for half of the faces the behaviors were evaluatively consistent, while for the other half they were inconsistent. In line with prior work, dorsomedial prefrontal cortex (dmPFC) was associated with forming impressions of individuals based on behavioral information. More importantly, a whole-brain analysis revealed a network of other regions associated with updating impressions of individuals who exhibited evaluatively inconsistent behaviors, including rostrolateral PFC, superior temporal sulcus, right inferior parietal lobule and posterior cingulate cortex.

Does context matter in evaluations of stigmatized individuals? An fMRI study

The manner in which disparate affective responses shape attitudes toward other individuals has received a great deal of attention in neuroscience research. However, the malleability of these affective responses remains largely unexplored. The perceived controllability of a stigma (whether or not the bearer of the stigma is perceived as being responsible for his or her condition) has been found to polarize behavioral affective responses to that stigma. The current study uses functional magnetic resonance imaging to identify the neural correlates underlying the evaluation of stigmatized individuals (people who are homeless) when perceptions of the controllability of their condition are altered. Results demonstrated that perceivers engaged neural networks implicated in inferring intentionality (e.g. the medial prefrontal cortex) when they evaluated a homeless individual who was described as being responsible for becoming homeless. Conversely, neural networks associated with resolving strong affective responses (e.g. insula) were engaged when evaluating a homeless individual who was described as not being responsible for becoming homeless.

Visual personal familiarity in amnestic mild cognitive impairment

BACKGROUND

Patients with amnestic mild cognitive impairment are at high risk for developing Alzheimer's disease. Besides episodic memory dysfunction they show deficits in accessing contextual knowledge that further specifies a general concept or helps to identify an object or a person.

METHODOLOGY/PRINCIPAL FINDINGS

Using functional magnetic resonance imaging, we investigated the neural networks associated with the perception of personal familiar faces and places in patients with amnestic mild cognitive impairment and healthy control subjects. Irrespective of stimulus type, patients compared to control subjects showed lower activity in right prefrontal brain regions when perceiving personally familiar versus unfamiliar faces and places. Both groups did not show different neural activity when perceiving faces or places irrespective of familiarity.

CONCLUSIONS/SIGNIFICANCE

Our data highlight changes in a frontal cortical network associated with knowledge-based personal familiarity among patients with amnestic mild cognitive impairment. These changes could contribute to deficits in social cognition and may reduce the patients' ability to transition from basic to complex situations and tasks.

An fMRI study of violations of social expectations: when people are not who we expect them to be

The current study examines the effect of violations of social expectancies on the neural substrates of person perception. In an event-related fMRI experiment, participants were presented with the photographs of either Republican or Democrat politicians paired with either typical Republican or Democrat political views (e.g., "wants a smaller government" or "wants liberal supreme court judges"). Subjects were asked to form an impression of the targets using information about both their political affiliation and their political views. Of interest was the contrast between stereotypically congruent trials and stereotypically incongruent trials. The results reveal that brain regions previously involved in mentalizing (i.e., temporoparietal junction and medial prefrontal cortex) are preferentially recruited when viewing incongruent social targets.

Age and the neural network of personal familiarity

Background

Accessing information that defines personally familiar context in real-world situations is essential for the social interactions and the independent functioning of an individual. Personal familiarity is associated with the availability of semantic and episodic information as well as the emotional meaningfulness surrounding a stimulus. These features are known to be associated with neural activity in distinct brain regions across different stimulus conditions (e.g., when perceiving faces, voices, places, objects), which may reflect a shared neural basis. Although perceiving context-rich personal familiarity may appear unchanged in aging on the behavioral level, it has not yet been studied whether this can be supported by neuroimaging data.

Methodology/Principal Findings

We used functional magnetic resonance imaging to investigate the neural network associated with personal familiarity during the perception of personally familiar faces and places. Twelve young and twelve elderly cognitively healthy subjects participated in the study. Both age groups showed a similar activation pattern underlying personal familiarity, predominantly in anterior cingulate and posterior cingulate cortices, irrespective of the stimulus type. The young subjects, but not the elderly subjects demonstrated an additional anterior cingulate deactivation when perceiving unfamiliar stimuli.

Conclusions/Significance

Although we found evidence for an age-dependent reduction in frontal cortical deactivation, our data show that there is a stimulus-independent neural network associated with personal familiarity of faces and places, which is less susceptible to aging-related changes.