Defining face perception areas in the human brain: A large-scale factorial fMRI face localizer analysis

Quantifying interindividual variability and asymmetry of face-selective regions: a probabilistic functional atlas

Face-selective regions (FSRs) are among the most widely studied functional regions in the human brain. However, individual variability of the FSRs has not been well quantified. Here we use functional magnetic resonance imaging (fMRI) to localize the FSRs and quantify their spatial and functional variabilities in 202 healthy adults. The occipital face area (OFA), posterior and anterior fusiform face areas (pFFA and aFFA), posterior continuation of the superior temporal sulcus (pcSTS), and posterior and anterior STS (pSTS and aSTS) were delineated for each individual with a semi-automated procedure. A probabilistic atlas was constructed to characterize their interindividual variability, revealing that the FSRs were highly variable in location and extent across subjects. The variability of FSRs was further quantified on both functional (i.e., face selectivity) and spatial (i.e., volume, location of peak activation, and anatomical location) features. Considerable interindividual variability and rightward asymmetry were found in all FSRs on these features. Taken together, our work presents the first effort to characterize comprehensively the variability of FSRs in a large sample of healthy subjects, and invites future work on the origin of the variability and its relation to individual differences in behavioral performance. Moreover, the probabilistic functional atlas will provide an adequate spatial reference for mapping the face network.

Successful decoding of famous faces in the fusiform face area

What are the neural mechanisms of face recognition? It is believed that the network of face-selective areas, which spans the occipital, temporal, and frontal cortices, is important in face recognition. A number of previous studies indeed reported that face identity could be discriminated based on patterns of multivoxel activity in the fusiform face area and the anterior temporal lobe. However, given the difficulty in localizing the face-selective area in the anterior temporal lobe, its role in face recognition is still unknown. Furthermore, previous studies limited their analysis to occipito-temporal regions without testing identity decoding in more anterior face-selective regions, such as the amygdala and prefrontal cortex. In the current high-resolution functional Magnetic Resonance Imaging study, we systematically examined the decoding of the identity of famous faces in the temporo-frontal network of face-selective and adjacent non-face-selective regions. A special focus has been put on the face-area in the anterior temporal lobe, which was reliably localized using an optimized scanning protocol. We found that face-identity could be discriminated above chance level only in the fusiform face area. Our results corroborate the role of the fusiform face area in face recognition. Future studies are needed to further explore the role of the more recently discovered anterior face-selective areas in face recognition.

The neural basis of perceiving person interactions

This study examined whether the grouping of people into meaningful social scenes (e.g., two people having a chat) impacts the basic perceptual analysis of each partaking individual. To explore this issue, we measured neural activity using functional magnetic resonance imaging (fMRI) while participants sex-categorized congruent as well as incongruent person dyads (i.e., two people interacting in a plausible or implausible manner). Incongruent person dyads elicited enhanced neural processing in several high-level visual areas dedicated to face and body encoding and in the posterior middle temporal gyrus compared to congruent person dyads. Incongruent and congruent person scenes were also successfully differentiated by a linear multivariate pattern classifier in the right fusiform body area and the left extrastriate body area. Finally, increases in the person scenes' meaningfulness as judged by independent observers was accompanied by enhanced activity in the bilateral posterior insula. These findings demonstrate that the processing of person scenes goes beyond a mere stimulus-bound encoding of their partaking agents, suggesting that changes in relations between agents affect their representation in category-selective regions of the visual cortex and beyond.

Tracking the evolution of crossmodal plasticity and visual functions before and after sight restoration

Visual deprivation leads to massive reorganization in both the structure and function of the occipital cortex, raising crucial challenges for sight restoration. We tracked the behavioral, structural, and neurofunctional changes occurring in an early and severely visually impaired patient before and 1.5 and 7 mo after sight restoration with magnetic resonance imaging. Robust presurgical auditory responses were found in occipital cortex despite residual preoperative vision. In primary visual cortex, crossmodal auditory responses overlapped with visual responses and remained elevated even 7 mo after surgery. However, these crossmodal responses decreased in extrastriate occipital regions after surgery, together with improved behavioral vision and with increases in both gray matter density and neural activation in low-level visual regions. Selective responses in high-level visual regions involved in motion and face processing were observable even before surgery and did not evolve after surgery. Taken together, these findings demonstrate that structural and functional reorganization of occipital regions are present in an individual with a long-standing history of severe visual impairment and that such reorganizations can be partially reversed by visual restoration in adulthood.

The effect of face inversion for neurons inside and outside fMRI-defined face-selective cortical regions

It is widely believed that face processing in the primate brain occurs in a network of category-selective cortical regions. Combined functional MRI (fMRI)-single-cell recording studies in macaques have identified high concentrations of neurons that respond more to faces than objects within face-selective patches. However, cells with a preference for faces over objects are also found scattered throughout inferior temporal (IT) cortex, raising the question whether face-selective cells inside and outside of the face patches differ functionally. Here, we compare the properties of face-selective cells inside and outside of face-selective patches in the IT cortex by means of an image manipulation that reliably disrupts behavior toward face processing: inversion. We recorded IT neurons from two fMRI-defined face-patches (ML and AL) and a region outside of the face patches (herein labeled OUT) during upright and inverted face stimulation. Overall, turning faces upside down reduced the firing rate of face-selective cells. However, there were differences among the recording regions. First, the reduced neuronal response for inverted faces was independent of stimulus position, relative to fixation, in the face-selective patches (ML and AL) only. Additionally, the effect of inversion for face-selective cells in ML, but not those in AL or OUT, was impervious to whether the neurons were initially searched for using upright or inverted stimuli. Collectively, these results show that face-selective cells differ in their functional characteristics depending on their anatomicofunctional location, suggesting that upright faces are preferably coded by face-selective cells inside but not outside of the fMRI-defined face-selective regions of the posterior IT cortex.

Valence asymmetries in the human amygdala: task relevance modulates amygdala responses to positive more than negative affective cues

Organisms must constantly balance appetitive needs with vigilance for potential threats. Recent research suggests that the amygdala may play an important role in both of these goals. Although the amygdala plays a role in processing motivationally relevant stimuli that are positive or negative, negative information often appears to carry greater weight. From a functional perspective, this may reflect the fact that threatening stimuli generally require action, whereas appetitive stimuli can often be safely ignored. In this study, we examine whether amygdala activation to positive stimuli may be more sensitive to task goals than negative stimuli, which are often related to self-preservation concerns. During fMRI, participants were presented with two images that varied on valence and extremity and were instructed to focus on one of the images. Results indicated that negative stimuli elicited greater amygdala activity regardless of task relevance. In contrast, positive stimuli only led to a relative increase in amygdala activity when they were task relevant. This suggests that the amygdala may be more responsive to negative stimuli regardless of their relevance to immediate goals, whereas positive stimuli may only elicit amygdala activity when they are relevant to the perceivers' goals. This pattern of valence asymmetry in the human amygdala may help balance approach-related goal pursuit with chronic self-preservation goals.

A neural network approach to fMRI binocular visual rivalry task analysis

The purpose of this study was to investigate whether artificial neural networks (ANN) are able to decode participants’ conscious experience perception from brain activity alone, using complex and ecological stimuli. To reach the aim we conducted pattern recognition data analysis on fMRI data acquired during the execution of a binocular visual rivalry paradigm (BR). Twelve healthy participants were submitted to fMRI during the execution of a binocular non-rivalry (BNR) and a BR paradigm in which two classes of stimuli (faces and houses) were presented. During the binocular rivalry paradigm, behavioral responses related to the switching between consciously perceived stimuli were also collected. First, we used the BNR paradigm as a functional localizer to identify the brain areas involved the processing of the stimuli. Second, we trained the ANN on the BNR fMRI data restricted to these regions of interest. Third, we applied the trained ANN to the BR data as a ‘brain reading’ tool to discriminate the pattern of neural activity between the two stimuli. Fourth, we verified the consistency of the ANN outputs with the collected behavioral indicators of which stimulus was consciously perceived by the participants. Our main results showed that the trained ANN was able to generalize across the two different tasks (i.e. BNR and BR) and to identify with high accuracy the cognitive state of the participants (i.e. which stimulus was consciously perceived) during the BR condition. The behavioral response, employed as control parameter, was compared with the network output and a statistically significant percentage of correspondences (p-value <0.05) were obtained for all subjects. In conclusion the present study provides a method based on multivariate pattern analysis to investigate the neural basis of visual consciousness during the BR phenomenon when behavioral indicators lack or are inconsistent, like in disorders of consciousness or sedated patients.

Intracerebral electrical stimulation of a face-selective area in the right inferior occipital cortex impairs individual face discrimination

During intracerebral stimulation of the right inferior occipital cortex, a patient with refractory epilepsy was transiently impaired at discriminating two simultaneously presented photographs of unfamiliar faces. The critical electrode contact was located in the most posterior face-selective brain area of the human brain (right "occipital face area", rOFA) as shown both by low- (ERP) and high-frequency (gamma) electrophysiological responses as well as a face localizer in fMRI. At this electrode contact, periodic visual presentation of 6 different faces by second evoked a larger electrophysiological periodic response at 6 Hz than when the same face identity was repeated at the same rate. This intracerebral EEG repetition suppression effect was markedly reduced when face stimuli were presented upside-down, a manipulation that impairs individual face discrimination. These findings provide original evidence for a causal relationship between the face-selective right inferior occipital cortex and individual face discrimination, independently of long-term memory representations. More generally, they support the functional value of electrophysiological repetition suppression effects, indicating that these effects can be used as an index of a necessary neural representation of the changing stimulus property.

Beyond the FFA: The role of the ventral anterior temporal lobes in face processing

Extensive research has supported the existence of a specialized face-processing network that is distinct from the visual processing areas used for general object recognition. The majority of this work has been aimed at characterizing the response properties of the fusiform face area (FFA) and the occipital face area (OFA), which together are thought to constitute the core network of brain areas responsible for facial identification. Although accruing evidence has shown that face-selective patches in the ventral anterior temporal lobes (vATLs) are interconnected with the FFA and OFA, and that they play a role in facial identification, the relative contribution of these brain areas to the core face-processing network has remained unarticulated. Here we review recent research critically implicating the vATLs in face perception and memory. We propose that current models of face processing should be revised such that the ventral anterior temporal lobes serve a centralized role in the visual face-processing network. We speculate that a hierarchically organized system of face processing areas extends bilaterally from the inferior occipital gyri to the vATLs, with facial representations becoming increasingly complex and abstracted from low-level perceptual features as they move forward along this network. The anterior temporal face areas may serve as the apex of this hierarchy, instantiating the final stages of face recognition. We further argue that the anterior temporal face areas are ideally suited to serve as an interface between face perception and face memory, linking perceptual representations of individual identity with person-specific semantic knowledge.

Expertise Effects in Face-Selective Areas are Robust to Clutter and Diverted Attention, but not to Competition

Expertise effects for nonface objects in face-selective brain areas may reflect stable aspects of neuronal selectivity that determine how observers perceive objects. However, bottom-up (e.g., clutter from irrelevant objects) and top-down manipulations (e.g., attentional selection) can influence activity, affecting the link between category selectivity and individual performance. We test the prediction that individual differences expressed as neural expertise effects for cars in face-selective areas are sufficiently stable to survive clutter and manipulations of attention. Additionally, behavioral work and work using event related potentials suggest that expertise effects may not survive competition; we investigate this using functional magnetic resonance imaging. Subjects varying in expertise with cars made 1-back decisions about cars, faces, and objects in displays containing one or 2 objects, with only one category attended. Univariate analyses suggest car expertise effects are robust to clutter, dampened by reducing attention to cars, but nonetheless more robust to manipulations of attention than competition. While univariate expertise effects are severely abolished by competition between cars and faces, multivariate analyses reveal new information related to car expertise. These results demonstrate that signals in face-selective areas predict expertise effects for nonface objects in a variety of conditions, although individual differences may be expressed in different dependent measures depending on task and instructions.

Stimulus-induced reversal of information flow through a cortical network for animacy perception

Decades of research have demonstrated that a region of the right fusiform gyrus (FG) and right posterior superior temporal sulcus (pSTS) responds preferentially to static faces and biological motion, respectively. Despite this view, both regions activate in response to both stimulus categories and to a range of other stimuli, such as goal-directed actions, suggesting that these regions respond to characteristics of animate agents more generally. Here we propose a neural model for animacy detection composed of processing streams that are initially differentially sensitive to cues signaling animacy, but that ultimately act in concert to support reasoning about animate agents. We use dynamic causal modeling, a measure of effective connectivity, to demonstrate that the directional flow of information between the FG and pSTS is initially dependent on the characteristics of the animate agent presented, a key prediction of our proposed network for animacy detection.

Resting-state fMRI reveals functional connectivity between face-selective perirhinal cortex and the fusiform face area related to face inversion

Studies examining the neural correlates of face perception and recognition in humans have revealed multiple brain regions that appear to play a specialized role in face processing. These include an anterior portion of perirhinal cortex (PrC) that appears to be homologous to the face-selective 'anterior face patch' recently reported in non-human primates. Electrical stimulation studies in the macaque indicate that the anterior face patch is strongly connected with other face-selective patches of cortex, even in the absence of face stimuli. The intrinsic functional connectivity of face-selective PrC and other regions of the face-processing network in humans are currently less well understood. Here, we examined resting-state fMRI connectivity across five face-selective regions in the right hemisphere that were identified with separate functional localizer scans: the PrC, amygdala (Amg), superior temporal sulcus, fusiform face area (FFA), and occipital face area. A partial correlation technique, controlling for fluctuations in occipitotemporal cortex that were not face specific, revealed connectivity between the PrC and the FFA, as well as the Amg. When examining the 'unique' connectivity of PrC within this face processing network, we found that the connectivity between the PrC and the FFA as well as that between the PrC and the Amg persisted even after controlling for potential mediating effects of other face-selective regions. Lastly, we examined the behavioral relevance of PrC connectivity by examining inter-individual differences in resting-state fluctuations in relation to differences in behavioral performance for a forced-choice recognition memory task that involved judgments on upright and inverted faces. This analysis revealed a significant correlation between the increased accuracy for upright faces (i.e., the face inversion effect) and the strength of connectivity between the PrC and the FFA. Together, these findings point to a high degree of functional integration of face-selective aspects of PrC in the face processing network with notable behavioral relevance.

The neuroscience of face processing and identification in eyewitnesses and offenders

Humans are experts in face perception. We are better able to distinguish between the differences of faces and their components than between any other kind of objects. Several studies investigating the underlying neural networks provided evidence for deviated face processing in criminal individuals, although results are often confounded by accompanying mental or addiction disorders. On the other hand, face processing in non-criminal healthy persons can be of high juridical interest in cases of witnessing a felony and afterward identifying a culprit. Memory and therefore recognition of a person can be affected by many parameters and thus become distorted. But also face processing itself is modulated by different factors like facial characteristics, degree of familiarity, and emotional relation. These factors make the comparison of different cases, as well as the transfer of laboratory results to real live settings very challenging. Several neuroimaging studies have been published in recent years and some progress was made connecting certain brain activation patterns with the correct recognition of an individual. However, there is still a long way to go before brain imaging can make a reliable contribution to court procedures.

Dynamic gamma frequency feedback coupling between higher and lower order visual cortices underlies perceptual completion in humans

To perceive a coherent environment, incomplete or overlapping visual forms must be integrated into meaningful coherent percepts, a process referred to as "Gestalt" formation or perceptual completion. Increasing evidence suggests that this process engages oscillatory neuronal activity in a distributed neuronal assembly. A separate line of evidence suggests that Gestalt formation requires top-down feedback from higher order brain regions to early visual cortex. Here we combine magnetoencephalography (MEG) and effective connectivity analysis in the frequency domain to specifically address the effective coupling between sources of oscillatory brain activity during Gestalt formation. We demonstrate that perceptual completion of two-tone "Mooney" faces induces increased gamma frequency band power (55-71Hz) in human early visual, fusiform and parietal cortices. Within this distributed neuronal assembly fusiform and parietal gamma oscillators are coupled by forward and backward connectivity during Mooney face perception, indicating reciprocal influences of gamma activity between these higher order visual brain regions. Critically, gamma band oscillations in early visual cortex are modulated by top-down feedback connectivity from both fusiform and parietal cortices. Thus, we provide a mechanistic account of Gestalt perception in which gamma oscillations in feature sensitive and spatial attention-relevant brain regions reciprocally drive one another and convey global stimulus aspects to local processing units at low levels of the sensory hierarchy by top-down feedback. Our data therefore support the notion of inverse hierarchical processing within the visual system underlying awareness of coherent percepts.

Robust selectivity for faces in the human amygdala in the absence of expressions

There is a well-established posterior network of cortical regions that plays a central role in face processing and that has been investigated extensively. In contrast, although responsive to faces, the amygdala is not considered a core face-selective region, and its face selectivity has never been a topic of systematic research in human neuroimaging studies. Here, we conducted a large-scale group analysis of fMRI data from 215 participants. We replicated the posterior network observed in prior studies but found equally robust and reliable responses to faces in the amygdala. These responses were detectable in most individual participants, but they were also highly sensitive to the initial statistical threshold and habituated more rapidly than the responses in posterior face-selective regions. A multivariate analysis showed that the pattern of responses to faces across voxels in the amygdala had high reliability over time. Finally, functional connectivity analyses showed stronger coupling between the amygdala and posterior face-selective regions during the perception of faces than during the perception of control visual categories. These findings suggest that the amygdala should be considered a core face-selective region.

Effects of intranasal oxytocin on the neural basis of face processing in autism spectrum disorder

BACKGROUND

Autism spectrum disorder (ASD) is associated with altered face processing and decreased activity in brain regions involved in face processing. The neuropeptide oxytocin has been shown to promote face processing and modulate brain activity in healthy adults. The present study examined the effects of oxytocin on the neural basis of face processing in adults with Asperger syndrome (AS).

METHODS

A group of 14 individuals with AS and a group of 14 neurotypical control participants performed a face-matching and a house-matching task during functional magnetic resonance imaging. The effects of a single dose of 24 IU intranasally administered oxytocin were tested in a randomized, placebo-controlled, within-subject, cross-over design.

RESULTS

Under placebo, the AS group showed decreased activity in the right amygdala, fusiform gyrus, and inferior occipital gyrus compared with the control group during face processing. After oxytocin treatment, right amygdala activity to facial stimuli increased in the AS group.

CONCLUSIONS

These findings indicate that oxytocin increases the saliency of social stimuli and in ASD and suggest that oxytocin might promote face processing and eye contact in individuals with ASD as prerequisites for neurotypical social interaction.

Probabilistic atlases for face and biological motion perception: an analysis of their reliability and overlap

Neuroimaging research has identified several category-selective regions in visual cortex that respond most strongly when viewing an exemplar image from a preferred category, such as faces. Recent studies, however, have suggested a more complex pattern of activation that has been heretofore unrecognized, e.g., the presence of additional patches of activation to faces beyond the well-studied fusiform face area, and the activation of ostensible face selective regions by animate motion of non-biological forms. Here, we characterize the spatial pattern of brain activity evoked by viewing faces or biological motion in large fMRI samples (N>120). We create probabilistic atlases for both face and biological motion activation, and directly compare their spatial patterns of activation. Our findings support the suggestion that the fusiform face area is composed of at least two separable foci of activation. The face-evoked response in the fusiform and nearby ventral temporal cortex has good reliability across runs; however, we found surprisingly high variability in lateral brain regions by faces, and for all brain regions by biological motion, which had an overall much lower effect size. We found that faces and biological motion evoke substantially overlapping activation distributions in both ventral and lateral occipitotemporal cortices. The peaks of activation for these different categories within these overlapping regions were close but distinct.

Representational demands modulate involvement of perirhinal cortex in face processing

The classic view holds that the medial temporal lobes (MTL) are dedicated to declarative memory functioning. Recent evidence, however, suggests that perirhinal cortex (PrC), a structure within the anterior MTL, may also play a role in perceptual discriminations when representations of complex conjunctions of features, or of gestalt-characteristics of objects must be generated. Interestingly, neuroimaging and electrophysiological recordings in nonhuman primates have also revealed a face patch in the anterior collateral sulcus with preferential responses to face stimuli in various task contexts. In the present fMRI study, we investigated the representational demands that influence PrC involvement in different types of judgments on human faces. Holding stimulus complexity constant, we independently manipulated the nature of the task and the orientation of the stimuli presented (through face inversion). Aspects of right PrC showed increased responses in a forced-choice recognition-memory and a perceptual-oddity task, as compared to a feature-search task that was included to probe visual detection of an isolated face feature. Effects of stimulus orientation in right PrC were observed when the recognition-memory condition for upright faces was compared with all other experimental conditions, including recognition-memory for inverted faces-a result that can be related to past work on the role of PrC in object unitization. Notably, both effects in right PrC paralleled activity patterns in broader networks of regions that also included the right fusiform gyrus and the amygdala, regions frequently implicated in face processing in prior research. As such, the current findings do not support the view that reference to a prior study episode clearly distinguishes the role of PrC from that of more posterior ventral visual pathway regions. They add to a growing body of evidence suggesting that the functional role of specific MTL structures may be best understood in terms of the representations that are required by the task and the stimuli at hand.

Functional and structural aging of the speech sensorimotor neural system: functional magnetic resonance imaging evidence

The ability to perceive and produce speech undergoes important changes in late adulthood. The goal of the present study was to characterize functional and structural age-related differences in the cortical network that support speech perception and production, using magnetic resonance imaging, as well as the relationship between functional and structural age-related changes occurring in this network. We asked young and older adults to observe videos of a speaker producing single words (perception), and to observe and repeat the words produced (production). Results show a widespread bilateral network of brain activation for Perception and Production that was not correlated with age. In addition, several regions did show age-related change (auditory cortex, planum temporale, superior temporal sulcus, premotor cortices, SMA-proper). Examination of the relationship between brain signal and regional and global gray matter volume and cortical thickness revealed a complex set of relationships between structure and function, with some regions showing a relationship between structure and function and some not. The present results provide novel findings about the neurobiology of aging and verbal communication.

The hierarchical brain network for face recognition

Numerous functional magnetic resonance imaging (fMRI) studies have identified multiple cortical regions that are involved in face processing in the human brain. However, few studies have characterized the face-processing network as a functioning whole. In this study, we used fMRI to identify face-selective regions in the entire brain and then explore the hierarchical structure of the face-processing network by analyzing functional connectivity among these regions. We identified twenty-five regions mainly in the occipital, temporal and frontal cortex that showed a reliable response selective to faces (versus objects) across participants and across scan sessions. Furthermore, these regions were clustered into three relatively independent sub-networks in a face-recognition task on the basis of the strength of functional connectivity among them. The functionality of the sub-networks likely corresponds to the recognition of individual identity, retrieval of semantic knowledge and representation of emotional information. Interestingly, when the task was switched to object recognition from face recognition, the functional connectivity between the inferior occipital gyrus and the rest of the face-selective regions were significantly reduced, suggesting that this region may serve as an entry node in the face-processing network. In sum, our study provides empirical evidence for cognitive and neural models of face recognition and helps elucidate the neural mechanisms underlying face recognition at the network level.

Focal electrical intracerebral stimulation of a face-sensitive area causes transient prosopagnosia

Face perception is subtended by a large set of areas in the human ventral occipito-temporal cortex. However, the role of these areas and their importance for face recognition remain largely unclear. Here we report a case of transient selective impairment in face recognition (prosopagnosia) induced by focal electrical intracerebral stimulation of the right inferior occipital gyrus. This area presents with typical face-sensitivity as evidenced by functional neuroimaging right occipital face area (OFA). A face-sensitive intracerebral N170 was also recorded in this area, supporting its contribution as a source of the well-known N170 component typically recorded on the scalp. Altogether, these observations indicate that face recognition can be selectively impaired by local disruption of a single face-sensitive area of the network subtending this function, the right OFA.

The lateral occipital cortex in the face perception network: an effective connectivity study

The perception of faces involves a large network of cortical areas of the human brain. While several studies tested this network recently, its relationship to the lateral occipital (LO) cortex known to be involved in visual object perception remains largely unknown. We used functional magnetic resonance imaging and dynamic causal modeling (DCM) to test the effective connectivity among the major areas of the face-processing core network and LO. Specifically, we tested how LO is connected to the fusiform face area (FFA) and occipital face area (OFA) and which area provides the major face/object input to the network. We found that LO is connected via significant bidirectional connections to both OFA and FFA, suggesting the existence of a triangular network. In addition, our results also suggest that face- and object-related stimulus inputs are not entirely segregated at these lower level stages of face-processing and enter the network via the LO. These results support the role of LO in face perception, at least at the level of face/non-face stimulus discrimination.