The neural mechanisms for the recognition of face identity in humans

What is developmental about developmental prosopagnosia?

Developmental prosopagnosia (DP) is characterised by difficulties recognising face identities and is associated with diverse co-occurring object recognition difficulties. The high co-occurrence rate and heterogeneity of associated difficulties in DP is an intrinsic feature of developmental conditions, where co-occurrence of difficulties is the rule, rather than the exception. However, despite its name, cognitive and neural theories of DP rarely consider the developmental context in which these difficulties occur. This leaves a large gap in our understanding of how DP emerges in light of the developmental trajectory of face recognition. Here, we argue that progress in the field requires re-considering the developmental origins of differences in face recognition abilities, rather than studying the end-state alone. In practice, considering development in DP necessitates a re-evaluation of current approaches in recruitment, design, and analyses.

Neural Correlates of Social Decision-Making

Objective: Recent studies have utilized innovative techniques to investigate the neural mechanisms underlying social and individual decision-making, aiming to understand how individuals respond to the world. Method : In this review, we summarized current scientific evidence concerning the neural underpinnings of social decision-making and their impact on social behavior. Results: Critical brain regions involved in social cognition and decision-making are integral to the process of social decision-making. Notably, the medial prefrontal cortex (mPFC) and temporoparietal junction (TPJ) contribute to the comprehension of others' mental states. Similarly, the posterior superior temporal sulcus (pSTS) shows heightened activity when individuals observe faces and movements. On the lateral surface of the brain, the inferior frontal gyrus (IFG) and inferior parietal sulcus (IPS) play a role in social cognition. Furthermore, the medial surface of the brain, including the amygdala, anterior cingulate cortex (ACC), and anterior insula (AI), also participates in social cognition processes. Regarding decision-making, functional magnetic resonance imaging (fMRI) studies have illuminated the involvement of a network of brain regions, encompassing the ventromedial prefrontal cortex (vmPFC), ventral striatum (VS), and nucleus accumbens (NAcc). Conclusion: Dysfunction in specific subregions of the prefrontal cortex (PFC) has been linked to various psychiatric conditions. These subregions play pivotal roles in cognitive, emotional, and social processing, and their impairment can contribute to the development and manifestation of psychiatric symptoms. A comprehensive understanding of the unique contributions of these PFC subregions to psychiatric disorders has the potential to inform the development of targeted interventions and treatments for affected individuals.

Familiarity Processing through Faces and Names: Insights from Multivoxel Pattern Analysis

The way our brain processes personal familiarity is still debatable. We used searchlight multivoxel pattern analysis (MVPA) to identify areas where local fMRI patterns could contribute to familiarity detection for both faces and name categories. Significantly, we identified cortical areas in frontal, temporal, cingulate, and insular areas, where it is possible to accurately cross-classify familiar stimuli from one category using a classifier trained with the stimulus from the other (i.e., abstract familiarity) based on local fMRI patterns. We also discovered several areas in the fusiform gyrus, frontal, and temporal regions-primarily lateralized to the right hemisphere-supporting the classification of familiar faces but failing to do so for names. Also, responses to familiar names (compared to unfamiliar names) consistently showed less activation strength than responses to familiar faces (compared to unfamiliar faces). The results evinced a set of abstract familiarity areas (independent of the stimulus type) and regions specifically related only to face familiarity, contributing to recognizing familiar individuals.

Improving the validity of neuroimaging decoding tests of invariant and configural neural representation

Many research questions in sensory neuroscience involve determining whether the neural representation of a stimulus property is invariant or specific to a particular stimulus context (e.g., Is object representation invariant to translation? Is the representation of a face feature specific to the context of other face features?). Between these two extremes, representations may also be context-tolerant or context-sensitive. Most neuroimaging studies have used operational tests in which a target property is inferred from a significant test against the null hypothesis of the opposite property. For example, the popular cross-classification test concludes that representations are invariant or tolerant when the null hypothesis of specificity is rejected. A recently developed neurocomputational theory suggests two insights regarding such tests. First, tests against the null of context-specificity, and for the alternative of context-invariance, are prone to false positives due to the way in which the underlying neural representations are transformed into indirect measurements in neuroimaging studies. Second, jointly performing tests against the nulls of invariance and specificity allows one to reach more precise and valid conclusions about the underlying representations, particularly when the null of invariance is tested using the fine-grained information from classifier decision variables rather than only accuracies (i.e., using the decoding separability test). Here, we provide empirical and computational evidence supporting both of these theoretical insights. In our empirical study, we use encoding of orientation and spatial position in primary visual cortex as a case study, as previous research has established that these properties are encoded in a context-sensitive way. Using fMRI decoding, we show that the cross-classification test produces false-positive conclusions of invariance, but that more valid conclusions can be reached by jointly performing tests against the null of invariance. The results of two simulations further support both of these conclusions. We conclude that more valid inferences about invariance or specificity of neural representations can be reached by jointly testing against both hypotheses, and using neurocomputational theory to guide the interpretation of results.

Twenty years of investigation with the case of prosopagnosia PS to understand human face identity recognition. Part II: Neural basis

Patient PS sustained her dramatic brain injury in 1992, the same year as the first report of a neuroimaging study of human face recognition. The present paper complements the review on the functional nature of PS's prosopagnosia (part I), illustrating how her case study directly, i.e., through neuroimaging investigations of her brain structure and activity, but also indirectly, through neural studies performed on other clinical cases and neurotypical individuals, inspired and constrained neural models of human face recognition. In the dominant right hemisphere for face recognition in humans, PS's main lesion concerns (inputs to) the inferior occipital gyrus (IOG), in a region where face-selective activity is typically found in normal individuals ('Occipital Face Area', OFA). Her case study initially supported the criticality of this region for face identity recognition (FIR) and provided the impetus for transcranial magnetic stimulation (TMS), intracerebral electrical stimulation, and cortical surgery studies that have generally supported this view. Despite PS's right IOG lesion, typical face-selectivity is found anteriorly in the middle portion of the fusiform gyrus, a hominoid structure (termed the right 'Fusiform Face Area', FFA) that is widely considered to be the most important region for human face recognition. This finding led to the original proposal of direct anatomico-functional connections from early visual cortices to the FFA, bypassing the IOG/OFA (lulu), a hypothesis supported by further neuroimaging studies of PS, other neurological cases and neuro-typical individuals with original visual stimulation paradigms, data recordings and analyses. The proposal of a lack of sensitivity to face identity in PS's right FFA due to defective reentrant inputs from the IOG/FFA has also been supported by other cases, functional connectivity and cortical surgery studies. Overall, neural studies of, and based on, the case of prosopagnosia PS strongly question the hierarchical organization of the human neural face recognition system, supporting a more flexible and dynamic view of this key social brain function.

Parallel processing in human visual cortex revealed through the influence of their neural responses on the visual evoked potential

The neural response in the human visual system is composed of magno-, parvo- and koniocellular input from the retina. Signal differences from functional imaging between health and individuals with a cognitive weakness are attributed to a dysfunction of a specific retinal input. Yet, anatomical interconnections within the human visual system obscure individual contribution to the neural response in V1. Deflections in the visual evoked potential (VEP) arise from an interaction between electric dipoles, their strength determined by the size of the neural population active during temporal - and spatial luminance contrast processing. To investigate interaction between these neural responses, we recorded the VEP over visual cortex of 14 healthy adults viewing four series of windmill patterns. Within a series, the relative area white in a pattern varied systematically. Between series, the number of sectors across which this area was distributed doubled. These patterns were viewed as pattern alternating and on-/off stimuli. P100/P1 amplitude increased linearly with the relative area white in the pattern, while N135/N1 and P240/P2 amplitude increased with the number of sectors of which the area white was distributed. The decreases P100 amplitude with increasing number of sectors is attributed to an interaction between electric dipoles located in granular and supragranular layers of V1. Differences between the VEP components obtained during a pattern reversing display and following pattern onset are accounted for by the transient and sustained nature of neural responses processing temporal - and spatial luminance contrast and ability of these responses to manifest in the VEP.

Cosmetic appreciation and emotional processing in patients with a peripheral facial palsy: A systematic review

Background; The goal of this review is 1) to summarize the studies assessing PFP by casual observers, patients themselves and the cosmetic appreciation of the PFP and 2) to summarize the studies assessing whether there is a difference in emotional recognition/processing of facial emotions and/or cognitive tasks in patients with a PFP. Materials and Methods; A multi-database systematic literature search was performed using the following databases: Pubmed, Embase, Medline, and The Cochrane Library from the earliest date of each database up to December 2019. Population of interest consisted of patients with a PFP and studies that investigated cosmetic appreciation and/or emotional recognition and/or emotional processing in these patients. Two authors rated the methodological quality of the included studies independently using the 'Newcastle - Ottawa Quality Assessment Scale' for nonrandomised studies' (NOS). Two authors extracted the outcome data regarding cosmetic appreciation and/or emotional recognition/processing from the included studies. Results; Twelve hundred and thirty-two studies were found of which eleven studies met the inclusion criteria. Most studies were assessed to be of 'fair' to 'good' methodological quality. The Cohen's kappa (between author RL and SP) was 0.68. Two studies investigated emotional processing and/or emotional recognition. Nine studies investigated cosmetic appreciation in both patients and casual observers. Important findings of this systematic review are that there is a correlation between the perceived severity of the PFP of the patients and the ratings by casual observers. Secondly there seems to be a laterality difference in cosmetic appreciation and thirdly there might to be a decreased emotional recognition and processing in patients with a PFP. Conclusion; Emotional recognition and cosmetic appreciation in patients with a PFP is an under investigated area, in which further studies are needed to substantiate the findings in current literature.

Sleep, inflammation, and perception of sad facial emotion: A laboratory-based study in older adults

BACKGROUND

Facial emotion perception (FEP) is pivotal for discriminating salient emotional information. Accumulating data indicate that FEP responses, particularly to sad emotional stimuli, are impaired in depression. This study tests whether sleep disturbance and inflammation, two risk factors for depression, contribute to impaired FEP to sad emotional stimuli.

METHODS

In older adults (n = 40, 71.7 ± 6.8y, 56.4% female), disturbance of sleep maintenance (i.e., wake time after sleep onset [WASO]) was evaluated by polysomnography. In the morning, plasma concentrations of two markers of systemic inflammation were evaluated (i.e., interleukin [IL]-6, tumor necrosis factor [TNF]-α), followed by two FEP tasks, which assessed delays in emotion recognition (ER) and ratings of perceived emotion intensity (EI) in response to sad facial emotional stimuli, with exploration of FEP responses to happiness and anger. Linear regression models tested whether WASO, IL-6, and TNF-α would be associated with impaired FEP to sad emotional stimuli. In addition, moderation tests examined whether inflammation would moderate the link between sleep disturbance and impaired FEP to sad emotional stimuli.

RESULTS

Longer WASO predicted longer ER delays (p < 0.05) and lower EI ratings in response to sad faces (p < 0.01). Further, higher TNF-α (p < 0.05) but not IL-6 predicted longer ER delays for sad faces, whereas higher IL-6 (p < 0.01) but not TNF-α predicted lower EI ratings for sad faces. Finally, TNF-α moderated the relationship between longer WASO and longer ER delays to sad faces (p < 0.001), while IL-6 moderated the relationship between longer WASO and lower EI ratings to sad faces (p < 0.01). Neither sleep nor inflammatory measures were associated with FEP responses to happiness or anger.

CONCLUSION

In older adults, disturbance of sleep maintenance is associated with impaired FEP to sad emotion, a relationship that appears to be moderated by inflammation. These data indicate that sleep disturbance and inflammation converge and contribute to impaired FEP with implications for risk for late-life depression.

FaReT: A free and open-source toolkit of three-dimensional models and software to study face perception

A problem in the study of face perception is that results can be confounded by poor stimulus control. Ideally, experiments should precisely manipulate facial features under study and tightly control irrelevant features. Software for 3D face modeling provides such control, but there is a lack of free and open source alternatives specifically created for face perception research. Here, we provide such tools by expanding the open-source software MakeHuman. We present a database of 27 identity models and six expression pose models (sadness, anger, happiness, disgust, fear, and surprise), together with software to manipulate the models in ways that are common in the face perception literature, allowing researchers to: (1) create a sequence of renders from interpolations between two or more 3D models (differing in identity, expression, and/or pose), resulting in a "morphing" sequence; (2) create renders by extrapolation in a direction of face space, obtaining 3D "anti-faces" and caricatures; (3) obtain videos of dynamic faces from rendered images; (4) obtain average face models; (5) standardize a set of models so that they differ only in selected facial shape features, and (6) communicate with experiment software (e.g., PsychoPy) to render faces dynamically online. These tools vastly improve both the speed at which face stimuli can be produced and the level of control that researchers have over face stimuli. We validate the face model database and software tools through a small study on human perceptual judgments of stimuli produced with the toolkit.

A closer look at the paralyzed face; a narrative review of the neurobiological basis for functional and aesthetic appreciation between patients with a left and a right peripheral facial palsy

BACKGROUND

The facial nerve or n. facialis (NVII) is the seventh cranial nerve and it is responsible for the innervation of the mimic muscles, the gustatory organ, and the secretomotor function to the salivary, lacrimal, nasal and palatine glands. Clinical presentation of Facial Palsy (FP) is characterized by unilateral facial asymmetry and may present with a change in taste, decreased saliva production, and dysarthria. A facial palsy has a notable effect on the facial appreciation by both the patient and the environment and also affects quality of life and emotional processing. There appear to be differences in the appreciation of people with a left and right facial palsy.

PURPOSE OF THIS REVIEW

The purpose of the review is to give an overview of the anatomy of the facial nerve, neuro-anatomy of face processing, and hemispheric specialization and lateralization. Further,an overview is given of the clinical studies that translated the neuro-anatomical and neurobiological basis of these concepts into clinical studies. What this review adds: This review emphasizes the neurobiological evidence of differences in face processing between the left and right cerebral hemisphere, wherein it seems that the right hemisphere is superior in emotional processing. Several theories are proposed; 1) a familiarity hypothesis and 2) a left-right hemispheric specialization hypothesis. In clinical studies, promising evidence might indicate that, in patients with FP, there is indeed a difference in how left and right FP are perceived. This might give differences in decreased quality of life and finally in occurrence of depression. Further research must aim to substantiate these findings and determine the need for altering the standard therapeutic advice given to patients.

The Acquisition of Person Knowledge

How do we learn what we know about others? Answering this question requires understanding the perceptual mechanisms with which we recognize individuals and their actions, and the processes by which the resulting perceptual representations lead to inferences about people's mental states and traits. This review discusses recent behavioral, neural, and computational studies that have contributed to this broad research program, encompassing both social perception and social cognition.

Effects of individuation and categorization on face representations in the visual cortex

The human faculty of distinguishing thousands of faces critically contributes to face identification and our social interactions. While prior studies have revealed the involvement of the fusiform face area (FFA) in the individuation processing of faces, there are also reports supporting that the responses of the FFA is flexible depending on tasks. Here, we investigated whether the specificity of neural responses in the FFA for individual faces depends on the need for individuation using functional magnetic resonance imaging (fMRI). We found that individual face images could be decoded from response patterns of the FFA when individuation was required for the task but not when only categorization according to a common feature such as race or gender was necessary. These results suggest that the specificity of neural responses for individual faces is flexible in the FFA, depending on the behavioral goal of face individuation.

Predicting Blood Oxygenation Level-Dependent Activity in Fusiform Face Area from the Activity in Other Visual Areas

Neuroimaging studies have shown that discrete regions in ventral visual pathway respond selectively to specific object categories. For example, the fusiform face area (FFA) in humans is consistently more responsive to face than nonface images. However, it is not clear how other cortical regions contribute to this preferential response in FFA. To address this question, we performed a functional magnetic resonance imaging study on human subjects watching naturalistic movie clips from human actions. We then used correlation and multivariate regression (partial least-squares regression) analyses to estimate/predict the mean BOLD (blood oxygenation level-dependent) activity in FFA, from the mean and pattern of responses in 24 visual cortical areas. Higher tier retinotopic areas V3, hV4, and LO2, motion-selective area middle temporal, body-selective areas, and non-FFA face-selective areas had the best prediction accuracy particularly when they were located ipsilateral to FFA. All non-FFA collectively could explain up to 75% of variance in the FFA response. The regression models were also designed to predict the mean activity in one face area from the pattern of activity in another face area. The prediction power was significantly higher between the occipital face area and FFA. The multivariate regression analysis provides a new framework for investigating functional connectivity between cortical areas, and it could inform hierarchical models of visual cortex.

Linking signal detection theory and encoding models to reveal independent neural representations from neuroimaging data

Many research questions in visual perception involve determining whether stimulus properties are represented and processed independently. In visual neuroscience, there is great interest in determining whether important object dimensions are represented independently in the brain. For example, theories of face recognition have proposed either completely or partially independent processing of identity and emotional expression. Unfortunately, most previous research has only vaguely defined what is meant by “independence,” which hinders its precise quantification and testing. This article develops a new quantitative framework that links signal detection theory from psychophysics and encoding models from computational neuroscience, focusing on a special form of independence defined in the psychophysics literature: perceptual separability. The new theory allowed us, for the first time, to precisely define separability of neural representations and to theoretically link behavioral and brain measures of separability. The framework formally specifies the relation between these different levels of perceptual and brain representation, providing the tools for a truly integrative research approach. In particular, the theory identifies exactly what valid inferences can be made about independent encoding of stimulus dimensions from the results of multivariate analyses of neuroimaging data and psychophysical studies. In addition, commonly used operational tests of independence are re-interpreted within this new theoretical framework, providing insights on their correct use and interpretation. Finally, we apply this new framework to the study of separability of brain representations of face identity and emotional expression (neutral/sad) in a human fMRI study with male and female participants.

A common question in vision research is whether certain stimulus properties, like face identity and expression, are represented and processed independently. We develop a theoretical framework that allowed us, for the first time, to link behavioral and brain measures of independence. Unlike previous approaches, our framework formally specifies the relation between these different levels of perceptual and brain representation, providing the tools for a truly integrative research approach in the study of independence. This allows to identify what kind of inferences can be made about brain representations from multivariate analyses of neuroimaging data or psychophysical studies. We apply this framework to the study of independent processing of face identity and expression.

Neuroimaging of person perception: A social-visual interface

The visual system is able to extract an enormous amount of socially relevant information from the face, including social categories, personality traits, and emotion. While facial features may be directly tied to certain perceptions, emerging research suggests that top-down social cognitive factors (e.g., stereotypes, social-conceptual knowledge, prejudice) considerably influence and shape the perceptual process. The rapid integration of higher-order social cognitive processes into visual perception can give rise to systematic biases in face perception and may potentially act as a mediating factor for intergroup behavioral and evaluative biases. Drawing on neuroimaging evidence, we review the ways that top-down social cognitive factors shape visual perception of facial features. This emerging work in social and affective neuroscience builds upon work on predictive coding and perceptual priors in cognitive neuroscience and visual cognition, suggesting domain-general mechanisms that underlie a social-visual interface through which social cognition affects visual perception.

Low-frequency oscillations employ a general coding of the spatio-temporal similarity of dynamic faces

Brain networks use neural oscillations as information transfer mechanisms. Although the face perception network in occipitotemporal cortex is well-studied, contributions of oscillations to face representation remain an open question. We tested for links between oscillatory responses that encode facial dimensions and the theoretical proposal that faces are encoded in similarity-based "face spaces". We quantified similarity-based encoding of dynamic faces in magnetoencephalographic sensor-level oscillatory power for identity, expression, physical and perceptual similarity of facial form and motion. Our data show that evoked responses manifest physical and perceptual form similarity that distinguishes facial identities. Low-frequency induced oscillations (< 20Hz) manifested more general similarity structure, which was not limited to identity, and spanned physical and perceived form and motion. A supplementary fMRI-constrained source reconstruction implicated fusiform gyrus and V5 in this similarity-based representation. These findings introduce a potential link between "face space" encoding and oscillatory network communication, which generates new hypotheses about the potential oscillation-mediated mechanisms that might encode facial dimensions.

Action recognition is sensitive to the identity of the actor

Recognizing who is carrying out an action is essential for successful human interaction. The cognitive mechanisms underlying this ability are little understood and have been subject of discussions in embodied approaches to action recognition. Here we examine one solution, that visual action recognition processes are at least partly sensitive to the actor's identity. We investigated the dependency between identity information and action related processes by testing the sensitivity of neural action recognition processes to clothing and facial identity information with a behavioral adaptation paradigm. Our results show that action adaptation effects are in fact modulated by both clothing information and the actor's facial identity. The finding demonstrates that neural processes underlying action recognition are sensitive to identity information (including facial identity) and thereby not exclusively tuned to actions. We suggest that such response properties are useful to help humans in knowing who carried out an action.

Dynamic neural architecture for social knowledge retrieval

Social behavior is often shaped by the rich storehouse of biographical information that we hold for other people. In our daily life, we rapidly and flexibly retrieve a host of biographical details about individuals in our social network, which often guide our decisions as we navigate complex social interactions. Even abstract traits associated with an individual, such as their political affiliation, can cue a rich cascade of person-specific knowledge. Here, we asked whether the anterior temporal lobe (ATL) serves as a hub for a distributed neural circuit that represents person knowledge. Fifty participants across two studies learned biographical information about fictitious people in a 2-d training paradigm. On day 3, they retrieved this biographical information while undergoing an fMRI scan. A series of multivariate and connectivity analyses suggest that the ATL stores abstract person identity representations. Moreover, this region coordinates interactions with a distributed network to support the flexible retrieval of person attributes. Together, our results suggest that the ATL is a central hub for representing and retrieving person knowledge.

Prenatal maternal cortisol concentrations predict neurodevelopment in middle childhood

Glucocorticoids (cortisol in humans) are the end product of the hypothalamic-pituitary-adrenocortical (HPA) axis and are proposed as a key mechanism for programming fetal brain development. The present prospective longitudinal study evaluates the association between prenatal maternal cortisol concentrations and child neurodevelopment. Participants included a low risk sample of 91 mother-child pairs. Prenatal maternal plasma cortisol concentrations were measured at 19 and 31 gestational weeks. Brain development and cognitive functioning were assessed when children were 6-9 years of age. Structural magnetic resonance imaging scans were acquired and cortical thickness was determined. Child cognitive functioning was evaluated using standardized measures (Wechsler Intelligence Scale for Children IV and Expressive Vocabulary Test, Second Edition). Higher maternal cortisol concentrations during the third trimester were associated with greater child cortical thickness primarily in frontal regions. No significant associations were observed between prenatal maternal cortisol concentrations and child cortical thinning. Elevated third trimester maternal cortisol additionally was associated with enhanced child cognitive performance. Findings in this normative sample of typically developing children suggest that elevated maternal cortisol during late gestation exert lasting benefits for brain development and cognitive functioning 6-9 years later. The benefits of fetal exposure to higher maternal cortisol during the third trimester for child neurodevelopment are consistent with the role cortisol plays in maturation of the human fetus. It is plausible that more extreme elevations in maternal cortisol concentrations late in gestation, as well as exposure to pharmacological levels of synthetic glucocorticoids, may have neurotoxic effects on the developing fetal brain.

Neural mechanisms of face perception, their emergence over development, and their breakdown

Face perception is probably the most developed visual perceptual skill in humans, most likely as a result of its unique evolutionary and social significance. Much recent research has converged to identify a host of relevant psychological mechanisms that support face recognition. In parallel, there has been substantial progress in uncovering the neural mechanisms that mediate rapid and accurate face perception, with specific emphasis on a broadly distributed neural circuit, comprised of multiple nodes whose joint activity supports face perception. This article focuses specifically on the neural underpinnings of face recognition, and reviews recent structural and functional imaging studies that elucidate the neural basis of this ability. In addition, the article covers some of the recent investigations that characterize the emergence of the neural basis of face recognition over the course of development, and explores the relationship between these changes and increasing behavioural competence. This paper also describes studies that characterize the nature of the breakdown of face recognition in individuals who are impaired in face recognition, either as a result of brain damage acquired at some point or as a result of the failure to master face recognition over the course of development. Finally, information regarding similarities between the neural circuits for face perception in humans and in nonhuman primates is briefly covered, as is the contribution of subcortical regions to face perception. WIREs Cogn Sci 2016, 7:247-263. doi: 10.1002/wcs.1388 For further resources related to this article, please visit the WIREs website.

The Neural Basis of Individual Face and Object Perception

We routinely need to process the identity of many faces around us, and how the brain achieves this is still the subject of much research in cognitive neuroscience. To date, insights on face identity processing have come from both healthy and clinical populations. However, in order to directly compare results across and within participant groups, and across different studies, it is crucial that a standard task is utilized which includes different exemplars (for example, non-face stimuli along with faces), is memory-neutral, and taps into identity matching across orientation and across viewpoint change. The goal of this study was to test a previously behaviourally tested face and object identity matching design in a healthy control sample whilst being scanned using fMRI. Specifically, we investigated categorical, orientation, and category-specific orientation effects while participants were focused on identity matching of simultaneously presented exemplar stimuli. Alongside observing category and orientation specific effects in a distributed set of brain regions, we also saw an interaction between stimulus category and orientation in the bilateral fusiform gyrus and bilateral middle occipital gyrus. Generally these clusters showed the pattern of a heightened response to inverted versus upright faces, and to upright, as compared to inverted shoes. These results are discussed in relation to previous studies and to potential future research within prosopagnosic individuals.

Structural attributes of the temporal lobe predict face recognition ability in youth

The face recognition ability varies across individuals. However, it remains elusive how brain anatomical structure is related to the face recognition ability in healthy subjects. In this study, we adopted voxel-based morphometry analysis and machine learning approach to investigate the neural basis of individual face recognition ability using anatomical magnetic resonance imaging. We demonstrated that the gray matter volume (GMV) of the right ventral anterior temporal lobe (vATL), an area sensitive to face identity, is significant positively correlated with the subject's face recognition ability which was measured by the Cambridge face memory test (CFMT) score. Furthermore, the predictive model established by the balanced cross-validation combined with linear regression method revealed that the right vATL GMV can predict subjects' face ability. However, the subjects' Cambridge face memory test scores cannot be predicted by the GMV of the face processing network core brain regions including the right occipital face area (OFA) and the right face fusion area (FFA). Our results suggest that the right vATL may play an important role in face recognition and might provide insight into the neural mechanisms underlying face recognition deficits in patients with pathophysiological conditions such as prosopagnosia.

Trial-level information for individual faces in the fusiform face area depends on subsequent memory

Previous research has shown that face-sensitive brain regions, such as the fusiform face area (FFA) and anterior inferior temporal lobe (aIT), not only respond selectively to face stimuli, but also respond uniquely to individual faces. A common factor in the existing literature is that face stimuli in these experiments are highly familiar to participants, usually by design. We set out to investigate to what extent familiarity correlates with the emergence of face-specific information in face-sensitive regions by testing novel faces with only a single repetition. Our results, consistent with a familiarity hypothesis, demonstrate that the FFA and aIT show face-specific information only when participants demonstrate subsequent memory for those faces. Functionally-defined regions that are not believed to process faces holistically showed no face-specific information, regardless of subsequent memory. To our knowledge, this is the first demonstration of face-specific information in face-sensitive regions for stimuli that were not highly familiar. These results contribute to our understanding of how individuating information comes to be represented in face-sensitive regions and suggest that this process can take place even after a single repetition of a particular face.

From Parts to Identity: Invariance and Sensitivity of Face Representations to Different Face Halves

Recognizing the identity of a face is computationally challenging, because it requires distinguishing between similar images depicting different people, while recognizing even very different images depicting a same person. Previous human fMRI studies investigated representations of face identity in the presence of changes in viewpoint and in expression. Despite the importance of holistic processing for face recognition, an investigation of representations of face identity across different face parts is missing. To fill this gap, we investigated representations of face identity and their invariance across different face halves. Information about face identity with invariance across changes in the face half was individuated in the right anterior temporal lobe, indicating this region as the most plausible candidate brain area for the representation of face identity. In a complementary analysis, information distinguishing between different face halves was found to decline along the posterior to anterior axis in the ventral stream.