Individual differences in holistic processing predict face recognition ability

A new approach to the diagnosis of deficits in processing faces: Potential application in autism research

Deficits in social communication are one of the behavioral signatures of autism spectrum disorder (ASD). Because faces are arguably the most important social stimuli that we encounter in everyday life, investigating the ability of individuals with ASD to process faces is thought to be important for understanding the nature of ASD. However, although a considerable body of evidence suggests that ASD individuals show specific impairments in face processing, a significant number of studies argue otherwise. Through a literature review, we found that this controversy is largely attributable to the different face tests used across different studies. Therefore, a more reliable and valid face test is needed. To this end, we performed a meta-analysis on data gleaned from a variety of face tests conducted on individuals with developmental prosopagnosia (DP) who suffer a selective deficit in face processing. Based on this meta-analysis, we selected an old/new face recognition test that relies on face memory as a standard diagnostic test for measuring specific face processing deficits. This test not only reliably reflects DP individuals' subjective experiences with faces in their daily lives, but also effectively differentiates deficits in face processing from deficits caused by other general problems. In addition, DP individuals' performance in this test predicts their performance in a variety of face tests that examine specific components of face processing (e.g., holistic processing of faces). Finally, this test can be easily administrated and is not overly sensitive to prior knowledge. In summary, this test can be used to evaluate face-processing ability, and it helped to resolve the controversy whether individuals with ASD exhibit face-processing deficits.

Altered spontaneous neural activity in the occipital face area reflects behavioral deficits in developmental prosopagnosia

Individuals with developmental prosopagnosia (DP) exhibit severe difficulties in recognizing faces and to a lesser extent, also exhibit difficulties in recognizing non-face objects. We used fMRI to investigate whether these behavioral deficits could be accounted for by altered spontaneous neural activity. Two aspects of spontaneous neural activity were measured: the intensity of neural activity in a voxel indexed by the fractional amplitude of spontaneous low-frequency fluctuations (fALFF), and the connectivity of a voxel to neighboring voxels indexed by regional homogeneity (ReHo). Compared with normal adults, both the fALFF and ReHo values within the right occipital face area (rOFA) were significantly reduced in DP subjects. Follow-up studies on the normal adults revealed that these two measures indicated further functional division of labor within the rOFA. The fALFF in the rOFA was positively correlated with behavioral performance in recognition of non-face objects, whereas ReHo in the rOFA was positively correlated with processing of faces. When considered together, the altered fALFF and ReHo within the same region (rOFA) may account for the comorbid deficits in both face and object recognition in DPs, whereas the functional division of labor in these two measures helps to explain the relative independency of deficits in face recognition and object recognition in DP.

Of Kith and Kin: Perceptual Enrichment, Expectancy, and Reciprocity in Face Perception

Race powerfully affects perceivers' responses to faces, promoting biases in attention, classification, and memory. To account for these diverse effects, we propose a model that integrates social cognitive work with two prominent accounts of visual processing: perceptual learning and predictive coding. Our argument is that differential experience with a racial ingroup promotes both (a) perceptual enrichment, including richer, more well-integrated visual representations of ingroup relative to outgroup faces, and (b) expectancies that ingroup faces are normative, which influence subsequent visual processing. By allowing for "top-down" expectancy-based processes, this model accounts for both experience- and non-experience-based influences, such as motivation, context, and task instructions. Fundamentally, we suggest that we treat race as an important psychological dimension because it structures our social environment, which in turn structures mental representation.

The definition and diagnosis of developmental prosopagnosia

Over the last 20 years much attention in the field of face recognition has been directed towards the study of developmental prosopagnosia (DP), with some authors investigating the behavioural characteristics of the condition, and many others using these individuals to further our theoretical understanding of the typical face-processing system. It is broadly agreed that the term "DP" refers to people who have failed to develop the ability to recognize faces in the absence of neurological illness or injury, yet more precise terminology in relation to potential subtypes of the population are yet to be confirmed. Furthermore, specific diagnostic techniques and inclusion and exclusion criteria have yet to be uniformly accepted across the field, making cross-paper comparisons and meta-analyses very difficult. This paper presents an overview of the current challenges that face research into DP and introduces a series of papers that attempt to further our understanding of the condition's characteristics. It is hoped that this special issue will provide a springboard for further research addressing these issues, improving the current state of the art by ensuring the quality of theoretical investigations into DP, and by posing advances that will assist those who have the condition.

The Hierarchical Structure of the Face Network Revealed by Its Functional Connectivity Pattern

A major principle of human brain organization is "integrating" some regions into networks while "segregating" other sets of regions into separate networks. However, little is known about the cognitive function of the integration and segregation of brain networks. Here, we examined the well-studied brain network for face processing, and asked whether the integration and segregation of the face network (FN) are related to face recognition performance. To do so, we used a voxel-based global brain connectivity method based on resting-state fMRI to characterize the within-network connectivity (WNC) and the between-network connectivity (BNC) of the FN. We found that 95.4% of voxels in the FN had a significantly stronger WNC than BNC, suggesting that the FN is a relatively encapsulated network. Importantly, individuals with a stronger WNC (i.e., integration) in the right fusiform face area were better at recognizing faces, whereas individuals with a weaker BNC (i.e., segregation) in the right occipital face area performed better in the face recognition tasks. In short, our study not only demonstrates the behavioral relevance of integration and segregation of the FN but also provides evidence supporting functional division of labor between the occipital face area and fusiform face area in the hierarchically organized FN. Significance statement: Although the integration and segregation are major principles of human brain organization, little is known about whether they support the cognitive processes. By correlating the within-network connectivity (WNC) and between-network connectivity (BNC) of the face network with face recognition performance, we found that individuals with stronger WNC in the right fusiform face area or weaker BNC in the right occipital face area were better at recognizing faces. Our study not only demonstrates the behavioral relevance of the integration and segregation but also provides evidence supporting functional division of labor between the occipital face area and fusiform face area in the hierarchically organized face network.

Functional integration of the posterior superior temporal sulcus correlates with facial expression recognition

Face perception is essential for daily and social activities. Neuroimaging studies have revealed a distributed face network (FN) consisting of multiple regions that exhibit preferential responses to invariant or changeable facial information. However, our understanding about how these regions work collaboratively to facilitate facial information processing is limited. Here, we focused on changeable facial information processing, and investigated how the functional integration of the FN is related to the performance of facial expression recognition. To do so, we first defined the FN as voxels that responded more strongly to faces than objects, and then used a voxel-based global brain connectivity method based on resting-state fMRI to characterize the within-network connectivity (WNC) of each voxel in the FN. By relating the WNC and performance in the "Reading the Mind in the Eyes" Test across participants, we found that individuals with stronger WNC in the right posterior superior temporal sulcus (rpSTS) were better at recognizing facial expressions. Further, the resting-state functional connectivity (FC) between the rpSTS and right occipital face area (rOFA), early visual cortex (EVC), and bilateral STS were positively correlated with the ability of facial expression recognition, and the FCs of EVC-pSTS and OFA-pSTS contributed independently to facial expression recognition. In short, our study highlights the behavioral significance of intrinsic functional integration of the FN in facial expression processing, and provides evidence for the hub-like role of the rpSTS for facial expression recognition. Hum Brain Mapp 37:1930-1940, 2016. © 2016 Wiley Periodicals, Inc.

Reliability of composite-task measurements of holistic face processing

There is growing interest in the study of individual differences in face recognition, including one of its hallmarks, holistic processing, which can be defined as a failure of selective attention to parts. These efforts demand that researchers be aware of, and try to maximize, the reliability of their measurements. Here we report on the reliability of measurements using the composite task (complete design), a measure of holistic processing that has been shown to have relatively good validity. Several studies have used the composite task to investigate individual differences, yet only one study has discussed its reliability. We investigate the reliability of composite-task measurements in eight data sets from five different samples of subjects. In general, we found reliability to be fairly low, but there was substantial variability across experiments. Researchers should keep in mind that reliability is a property of measurements, not of a task, and think about the ways in which measurements in a particular task may be improved before embarking on individual differences research.

Eye-movement strategies in developmental prosopagnosia and "super" face recognition

Developmental prosopagnosia (DP) is a cognitive condition characterized by a severe deficit in face recognition. Few investigations have examined whether impairments at the early stages of processing may underpin the condition, and it is also unknown whether DP is simply the "bottom end" of the typical face-processing spectrum. To address these issues, we monitored the eye-movements of DPs, typical perceivers, and "super recognizers" (SRs) while they viewed a set of static images displaying people engaged in naturalistic social scenarios. Three key findings emerged: (a) Individuals with more severe prosopagnosia spent less time examining the internal facial region, (b) as observed in acquired prosopagnosia, some DPs spent less time examining the eyes and more time examining the mouth than controls, and (c) SRs spent more time examining the nose-a measure that also correlated with face recognition ability in controls. These findings support previous suggestions that DP is a heterogeneous condition, but suggest that at least the most severe cases represent a group of individuals that qualitatively differ from the typical population. While SRs seem to merely be those at the "top end" of normal, this work identifies the nose as a critical region for successful face recognition.

Neural Univariate Activity and Multivariate Pattern in the Posterior Superior Temporal Sulcus Differentially Encode Facial Expression and Identity

Faces contain a variety of information such as one’s identity and expression. One prevailing model suggests a functional division of labor in processing faces that different aspects of facial information are processed in anatomically separated and functionally encapsulated brain regions. Here, we demonstrate that facial identity and expression can be processed in the same region, yet with different neural coding strategies. To this end, we employed functional magnetic resonance imaging to examine two types of coding schemes, namely univariate activity and multivariate pattern, in the posterior superior temporal cortex (pSTS) - a face-selective region that is traditionally viewed as being specialized for processing facial expression. With the individual difference approach, we found that participants with higher overall face selectivity in the right pSTS were better at differentiating facial expressions measured outside of the scanner. In contrast, individuals whose spatial pattern for faces in the right pSTS was less similar to that for objects were more accurate in identifying previously presented faces. The double dissociation of behavioral relevance between overall neural activity and spatial neural pattern suggests that the functional-division-of-labor model on face processing is over-simplified, and that coding strategies shall be incorporated in a revised model.

The "parts and wholes" of face recognition: A review of the literature

It has been claimed that faces are recognized as a "whole" rather than by the recognition of individual parts. In a paper published in the Quarterly Journal of Experimental Psychology in 1993, Martha Farah and I attempted to operationalize the holistic claim using the part/whole task. In this task, participants studied a face and then their memory presented in isolation and in the whole face. Consistent with the holistic view, recognition of the part was superior when tested in the whole-face condition compared to when it was tested in isolation. The "whole face" or holistic advantage was not found for faces that were inverted, or scrambled, nor for non-face objects, suggesting that holistic encoding was specific to normal, intact faces. In this paper, we reflect on the part/whole paradigm and how it has contributed to our understanding of what it means to recognize a face as a "whole" stimulus. We describe the value of part/whole task for developing theories of holistic and non-holistic recognition of faces and objects. We discuss the research that has probed the neural substrates of holistic processing in healthy adults and people with prosopagnosia and autism. Finally, we examine how experience shapes holistic face recognition in children and recognition of own- and other-race faces in adults. The goal of this article is to summarize the research on the part/whole task and speculate on how it has informed our understanding of holistic face processing.

Typical and Atypical Development of Functional Connectivity in the Face Network

Extensive studies have demonstrated that face recognition performance does not reach adult levels until adolescence. However, there is no consensus on whether such prolonged improvement stems from development of general cognitive factors or face-specific mechanisms. Here, we used behavioral experiments and functional magnetic resonance imaging (fMRI) to evaluate these two hypotheses. With a large cohort of children (n = 379), we found that the ability of face-specific recognition in humans increased with age throughout childhood and into late adolescence in both face memory and face perception. Neurally, to circumvent the potential problem of age differences in task performance, attention, or cognitive strategies in task-state fMRI studies, we measured the resting-state functional connectivity (RSFC) between the occipital face area (OFA) and fusiform face area (FFA) in human brain and found that the OFA-FFA RSFC increased until 11-13 years of age. Moreover, the OFA-FFA RSFC was selectively impaired in adults with developmental prosopagnosia (DP). In contrast, no age-related changes or differences between DP and normal adults were observed for RSFCs in the object system. Finally, the OFA-FFA RSFC matured earlier than face selectivity in either the OFA or FFA. These results suggest the critical role of the OFA-FFA RSFC in the development of face recognition. Together, our findings support the hypothesis that prolonged development of face recognition is face specific, not domain general.

Face Perception and Test Reliabilities in Congenital Prosopagnosia in Seven Tests

Congenital prosopagnosia, the innate impairment in recognizing faces, is a very heterogeneous disorder with different phenotypical manifestations. To investigate the nature of prosopagnosia in more detail, we tested 16 prosopagnosics and 21 controls with an extended test battery addressing various aspects of face recognition. Our results show that prosopagnosics exhibited significant impairments in several face recognition tasks: impaired holistic processing (they were tested amongst others with the Cambridge Face Memory Test (CFMT)) as well as reduced processing of configural information of faces. This test battery also revealed some new findings. While controls recognized moving faces better than static faces, prosopagnosics did not exhibit this effect. Furthermore, prosopagnosics had significantly impaired gender recognition—which is shown on a groupwise level for the first time in our study. There was no difference between groups in the automatic extraction of face identity information or in object recognition as tested with the Cambridge Car Memory Test. In addition, a methodological analysis of the tests revealed reduced reliability for holistic face processing tests in prosopagnosics. To our knowledge, this is the first study to show that prosopagnosics showed a significantly reduced reliability coefficient (Cronbach’s alpha) in the CFMT compared to the controls. We suggest that compensatory strategies employed by the prosopagnosics might be the cause for the vast variety of response patterns revealed by the reduced test reliability. This finding raises the question whether classical face tests measure the same perceptual processes in controls and prosopagnosics.

Real-life experience with personally familiar faces enhances discrimination based on global information

Despite the agreement that experience with faces leads to more efficient processing, the underlying mechanisms remain largely unknown. Building on empirical evidence from unfamiliar face processing in healthy populations and neuropsychological patients, the present experiment tested the hypothesis that personal familiarity is associated with superior discrimination when identity information is derived based on global, as opposed to local facial information. Diagnosticity and availability of local and global information was manipulated through varied physical similarity and spatial resolution of morph faces created from personally familiar or unfamiliar faces. We found that discrimination of subtle changes between highly similar morph faces was unaffected by familiarity. Contrariwise, relatively more pronounced physical (i.e., identity) differences were more efficiently discriminated for personally familiar faces, indicating more efficient processing of global, as opposed to local facial information through real-life experience.

The Facial Expressive Action Stimulus Test. A test battery for the assessment of face memory, face and object perception, configuration processing, and facial expression recognition

There are many ways to assess face perception skills. In this study, we describe a novel task battery FEAST (Facial Expressive Action Stimulus Test) developed to test recognition of identity and expressions of human faces as well as stimulus control categories. The FEAST consists of a neutral and emotional face memory task, a face and shoe identity matching task, a face and house part-to-whole matching task, and a human and animal facial expression matching task. The identity and part-to-whole matching tasks contain both upright and inverted conditions. The results provide reference data of a healthy sample of controls in two age groups for future users of the FEAST.

Selectivity of Face Perception to Horizontal Information over Lifespan (from 6 to 74 Year Old)

Face recognition in young human adults preferentially relies on the processing of horizontally-oriented visual information. We addressed whether the horizontal tuning of face perception is modulated by the extensive experience humans acquire with faces over the lifespan, or whether it reflects an invariable processing bias for this visual category. We tested 296 subjects aged from 6 to 74 years in a face matching task. Stimuli were upright and inverted faces filtered to preserve information in the horizontal or vertical orientation, or both (HV) ranges. The reliance on face-specific processing was inferred based on the face inversion effect (FIE). FIE size increased linearly until young adulthood in the horizontal but not the vertical orientation range of face information. These findings indicate that the protracted specialization of the face processing system relies on the extensive experience humans acquire at encoding the horizontal information conveyed by upright faces.

Mother's but not father's education predicts general fluid intelligence in emerging adulthood: Behavioral and neuroanatomical evidence

Lower parental education impairs cognitive abilities of their offspring such as general fluid intelligence dependent on the prefrontal cortex (PFC), but the independent contribution of mother's and father's education is unknown. We used an individual difference approach to test whether mother's and father's education independently affected general fluid intelligence in emerging adulthood at both the behavioral and neural level. Behaviorally, mother's but not father's education accounted for unique variance in general fluid intelligence in emerging adulthood (assessed by the Raven's advanced progressive matrices). Neurally, the whole-brain correlation analysis revealed that the regional gray matter volume (rGMV) in the medial PFC was related to both mother's education and general fluid intelligence but not father's education. Furthermore, after controlling for mother's education, the association between general fluid intelligence and the rGMV in medial PFC was no longer significant, indicating that mother's education plays an important role in influencing the structure of the medial PFC associated with general fluid intelligence. Taken together, our study provides the first behavioral and neural evidence that mother's education is a more important determinant of general cognitive ability in emerging adulthood than father's education.

Neural decoding reveals impaired face configural processing in the right fusiform face area of individuals with developmental prosopagnosia

Most of human daily social interactions rely on the ability to successfully recognize faces. Yet ∼2% of the human population suffers from face blindness without any acquired brain damage [this is also known as developmental prosopagnosia (DP) or congenital prosopagnosia]). Despite the presence of severe behavioral face recognition deficits, surprisingly, a majority of DP individuals exhibit normal face selectivity in the right fusiform face area (FFA), a key brain region involved in face configural processing. This finding, together with evidence showing impairments downstream from the right FFA in DP individuals, has led some to argue that perhaps the right FFA is largely intact in DP individuals. Using fMRI multivoxel pattern analysis, here we report the discovery of a neural impairment in the right FFA of DP individuals that may play a critical role in mediating their face-processing deficits. In seven individuals with DP, we discovered that, despite the right FFA's preference for faces and it showing decoding for the different face parts, it exhibited impaired face configural decoding and did not contain distinct neural response patterns for the intact and the scrambled face configurations. This abnormality was not present throughout the ventral visual cortex, as normal neural decoding was found in an adjacent object-processing region. To our knowledge, this is the first direct neural evidence showing impaired face configural processing in the right FFA in individuals with DP. The discovery of this neural impairment provides a new clue to our understanding of the neural basis of DP.

Famous face recognition, face matching, and extraversion

It has been previously established that extraverts who are skilled at interpersonal interaction perform significantly better than introverts on a face-specific recognition memory task. In our experiment we further investigate the relationship between extraversion and face recognition, focusing on famous face recognition and face matching. Results indicate that more extraverted individuals perform significantly better on an upright famous face recognition task and show significantly larger face inversion effects. However, our results did not find an effect of extraversion on face matching or inverted famous face recognition.

About-face on face recognition ability and holistic processing

Previous work found a small but significant relationship between holistic processing measured with the composite task and face recognition ability measured by the Cambridge Face Memory Test (CFMT; Duchaine & Nakayama, 2006). Surprisingly, recent work using a different measure of holistic processing (Vanderbilt Holistic Face Processing Test [VHPT-F]; Richler, Floyd, & Gauthier, 2014) and a larger sample found no evidence for such a relationship. In Experiment 1 we replicate this unexpected result, finding no relationship between holistic processing (VHPT-F) and face recognition ability (CFMT). A key difference between the VHPT-F and other holistic processing measures is that unique face parts are used on each trial in the VHPT-F, unlike in other tasks where a small set of face parts repeat across the experiment. In Experiment 2, we test the hypothesis that correlations between the CFMT and holistic processing tasks are driven by stimulus repetition that allows for learning during the composite task. Consistent with our predictions, CFMT performance was correlated with holistic processing in the composite task when a small set of face parts repeated over trials, but not when face parts did not repeat. A meta-analysis confirms that relationships between the CFMT and holistic processing depend on stimulus repetition. These results raise important questions about what is being measured by the CFMT, and challenge current assumptions about why faces are processed holistically.

Electrical stimulation over bilateral occipito-temporal regions reduces N170 in the right hemisphere and the composite face effect

Transcranial direct current stimulation (tDCS) is a non-invasive brain stimulation technique that can modulate cortical excitability. Although the clinical value of tDCS has been advocated, the potential of tDCS in cognitive rehabilitation of face processing deficits is less understood. Face processing has been associated with the occipito-temporal cortex (OT). The present study investigated whether face processing in healthy adults can be modulated by applying tDCS over the OT. Experiment 1 investigated whether tDCS can affect N170, a face-sensitive ERP component, with a face orientation judgment task. The N170 in the right hemisphere was reduced in active stimulation conditions compared with the sham stimulation condition for both upright faces and inverted faces. Experiment 2 further demonstrated that tDCS can modulate the composite face effect, a type of holistic processing that reflects the obligatory attention to all parts of a face. The composite face effect was reduced in active stimulation conditions compared with the sham stimulation condition. Additionally, the current polarity did not modulate the effect of tDCS in the two experiments. The present study demonstrates that N170 can be causally manipulated by stimulating the OT with weak currents. Furthermore, our study provides evidence that obligatory attention to all parts of a face can be affected by the commonly used tDCS parameter setting.

Examining gray matter structures associated with individual differences in global life satisfaction in a large sample of young adults

Although much attention has been directed towards life satisfaction that refers to an individual's general cognitive evaluations of his or her life as a whole, little is known about the neural basis underlying global life satisfaction. In this study, we used voxel-based morphometry to investigate the structural neural correlates of life satisfaction in a large sample of young healthy adults (n = 299). We showed that individuals' life satisfaction was positively correlated with the regional gray matter volume (rGMV) in the right parahippocampal gyrus (PHG), and negatively correlated with the rGMV in the left precuneus and left ventromedial prefrontal cortex. This pattern of results remained significant even after controlling for the effect of general positive and negative affect, suggesting a unique structural correlates of life satisfaction. Furthermore, we found that self-esteem partially mediated the association between the PHG volume and life satisfaction as well as that between the precuneus volume and global life satisfaction. Taken together, we provide the first evidence for the structural neural basis of life satisfaction, and highlight that self-esteem might play a crucial role in cultivating an individual's life satisfaction.

A motivational determinant of facial emotion recognition: regulatory focus affects recognition of emotions in faces

Two studies examined an unexplored motivational determinant of facial emotion recognition: observer regulatory focus. It was predicted that a promotion focus would enhance facial emotion recognition relative to a prevention focus because the attentional strategies associated with promotion focus enhance performance on well-learned or innate tasks - such as facial emotion recognition. In Study 1, a promotion or a prevention focus was experimentally induced and better facial emotion recognition was observed in a promotion focus compared to a prevention focus. In Study 2, individual differences in chronic regulatory focus were assessed and attention allocation was measured using eye tracking during the facial emotion recognition task. Results indicated that the positive relation between a promotion focus and facial emotion recognition is mediated by shorter fixation duration on the face which reflects a pattern of attention allocation matched to the eager strategy in a promotion focus (i.e., striving to make hits). A prevention focus did not have an impact neither on perceptual processing nor on facial emotion recognition. Taken together, these findings demonstrate important mechanisms and consequences of observer motivational orientation for facial emotion recognition.

Same, same—but different: on the use of Navon derived measures of global/local processing in studies of face processing

Some studies have reported a significant correlation between face discrimination/recognition ability and indexes of global/local processing derived from the Navon paradigm. Other studies, however, have failed to find such a relationship. In this paper we examine three aspects related to the Navon paradigm that may have contributed to this discrepancy but which have been largely neglected: (i) the use of different types of compound stimuli across studies, (ii) differences between studies in the type of index derived from the Navon paradigm, and (iii) the reliability of these indexes. In a Navon experiment comparing performance with compound letters and compound shapes in normal participants, we find little consistency both within and across participants in how they perform with these stimulus types, despite the fact that both stimulus types give rise to the typical effects. In addition we find that many of the Navon derived indexes of global/local effects used in studies examining face processing have low reliability and do not measure the same aspects of global/local processing. Echoing the results from the normal participants, we also find little consistency in how a congenital prosopagnosic performs in the Navon paradigm. With compound letters, she responds much faster to local than to global aspects of the stimuli; a pattern not seen in a single of the normal participants. With compound shapes, however, she exhibits no such abnormality. These findings question the validity of the conclusions in studies relating Navon derived indexes of global/local processing to face processing.

Impaired holistic processing of left-right composite faces in congenital prosopagnosia

Congenital prosopagnosia (CP) refers to a lifelong impairment in face processing despite normal visual and intellectual skills. Many studies have suggested that the key underlying deficit in CP is one of a failure to engage holistic processing. Moreover, there has been some suggestion that, in normal observers, there may be greater involvement of the right than left hemisphere in holistic processing. To examine the proposed deficit in holistic processing and its potential hemispheric atypicality in CP, we compared the performance of 8 CP individuals with both matched controls and a large group of non-matched controls on a novel, vertical composite task. In this task, participants judged whether a cued half of a face (either left or right half) was the same or different at study and test, and the two face halves could be either aligned or misaligned. The standard index of holistic processing is one in which the unattended face half influences performance on the cued half and this influence is greater in the aligned than in the misaligned condition. Relative to controls, the CP participants, both at a group and at an individual level, did not show holistic processing in the vertical composite task. There was also no difference in performance as a function of hemifield of the cued face half in the CP individuals, and this was true in the control participants, as well. The findings clearly confirm the deficit in holistic processing in CP and reveal the useful application of this novel experimental paradigm to this population and potentially to others as well.

The Vanderbilt holistic face processing test: a short and reliable measure of holistic face processing

Efforts to understand individual differences in high-level vision necessitate the development of measures that have sufficient reliability, which is generally not a concern in group studies. Holistic processing is central to research on face recognition and, more recently, to the study of individual differences in this area. However, recent work has shown that the most popular measure of holistic processing, the composite task, has low reliability. This is particularly problematic for the recent surge in interest in studying individual differences in face recognition. Here, we developed and validated a new measure of holistic face processing specifically for use in individual-differences studies. It avoids some of the pitfalls of the standard composite design and capitalizes on the idea that trial variability allows for better traction on reliability. Across four experiments, we refine this test and demonstrate its reliability.

What can individual differences reveal about face processing?

Faces are probably the most widely studied visual stimulus. Most research on face processing has used a group-mean approach that averages behavioral or neural responses to faces across individuals and treats variance between individuals as noise. However, individual differences in face processing can provide valuable information that complements and extends findings from group-mean studies. Here we demonstrate that studies employing an individual differences approach—examining associations and dissociations across individuals—can answer fundamental questions about the way face processing operates. In particular these studies allow us to associate and dissociate the mechanisms involved in face processing, tie behavioral face processing mechanisms to neural mechanisms, link face processing to broader capacities and quantify developmental influences on face processing. The individual differences approach we illustrate here is a powerful method that should be further explored within the domain of face processing as well as fruitfully applied across the cognitive sciences.

Individual differences in cortical face selectivity predict behavioral performance in face recognition

In functional magnetic resonance imaging studies, object selectivity is defined as a higher neural response to an object category than other object categories. Importantly, object selectivity is widely considered as a neural signature of a functionally-specialized area in processing its preferred object category in the human brain. However, the behavioral significance of the object selectivity remains unclear. In the present study, we used the individual differences approach to correlate participants' face selectivity in the face-selective regions with their behavioral performance in face recognition measured outside the scanner in a large sample of healthy adults. Face selectivity was defined as the z score of activation with the contrast of faces vs. non-face objects, and the face recognition ability was indexed as the normalized residual of the accuracy in recognizing previously-learned faces after regressing out that for non-face objects in an old/new memory task. We found that the participants with higher face selectivity in the fusiform face area (FFA) and the occipital face area (OFA), but not in the posterior part of the superior temporal sulcus (pSTS), possessed higher face recognition ability. Importantly, the association of face selectivity in the FFA and face recognition ability cannot be accounted for by FFA response to objects or behavioral performance in object recognition, suggesting that the association is domain-specific. Finally, the association is reliable, confirmed by the replication from another independent participant group. In sum, our finding provides empirical evidence on the validity of using object selectivity as a neural signature in defining object-selective regions in the human brain.

On the facilitative effects of face motion on face recognition and its development

For the past century, researchers have extensively studied human face processing and its development. These studies have advanced our understanding of not only face processing, but also visual processing in general. However, most of what we know about face processing was investigated using static face images as stimuli. Therefore, an important question arises: to what extent does our understanding of static face processing generalize to face processing in real-life contexts in which faces are mostly moving? The present article addresses this question by examining recent studies on moving face processing to uncover the influence of facial movements on face processing and its development. First, we describe evidence on the facilitative effects of facial movements on face recognition and two related theoretical hypotheses: the supplementary information hypothesis and the representation enhancement hypothesis. We then highlight several recent studies suggesting that facial movements optimize face processing by activating specific face processing strategies that accommodate to task requirements. Lastly, we review the influence of facial movements on the development of face processing in the first year of life. We focus on infants' sensitivity to facial movements and explore the facilitative effects of facial movements on infants' face recognition performance. We conclude by outlining several future directions to investigate moving face processing and emphasize the importance of including dynamic aspects of facial information to further understand face processing in real-life contexts.

A meta-analysis and review of holistic face processing

The concept of holistic processing is a cornerstone of face recognition research, yet central questions related to holistic processing remain unanswered, and debates have thus far failed to reach a resolution despite accumulating empirical evidence. We argue that a considerable source of confusion in this literature stems from a methodological problem. Specifically, 2 measures of holistic processing based on the composite paradigm (complete design and partial design) are used in the literature, but they often lead to qualitatively different results. First, we present a comprehensive review of the work that directly compares the 2 designs, and which clearly favors the complete design over the partial design. Second, we report a meta-analysis of holistic face processing according to both designs and use this as further evidence for one design over the other. The meta-analysis effect size of holistic processing in the complete design is nearly 3 times that of the partial design. Effect sizes were not correlated between measures, consistent with the suggestion that they do not measure the same thing. Our meta-analysis also examines the correlation between conditions in the complete design of the composite task, and suggests that in an individual differences context, little is gained by including a misaligned baseline. Finally, we offer a comprehensive review of the state of knowledge about holistic processing based on evidence gathered from the measure we favor based on the 1st sections of our review-the complete design-and outline outstanding research questions in that new context.

Conscious awareness is required for holistic face processing

•

We explore unconscious holistic face processing using composite face stimulus.

•

We test influence of the invisible faces on judgments of the visible eyes.

•

We use three different sets of face stimuli and subliminal learning procedure.

•

We show that invisible faces did not influence perception of visible eyes.

•

Conscious awareness might be a prerequisite for holistic face processing.

Investigating the limits of unconscious processing is essential to understand the function of consciousness. Here, we explored whether holistic face processing, a mechanism believed to be important for face processing in general, can be accomplished unconsciously. Using a novel “eyes-face” stimulus we tested whether discrimination of pairs of eyes was influenced by the surrounding face context. While the eyes were fully visible, the faces that provided context could be rendered invisible through continuous flash suppression. Two experiments with three different sets of face stimuli and a subliminal learning procedure converged to show that invisible faces did not influence perception of visible eyes. In contrast, surrounding faces, when they were clearly visible, strongly influenced perception of the eyes. Thus, we conclude that conscious awareness might be a prerequisite for holistic face processing.

General holistic impairment in congenital prosopagnosia: evidence from Garner's speeded-classification task

Congenital prosopagnosia (CP), a lifelong impairment in face processing in the absence of brain damage, is often ascribed to impairment in holistic processing. It is still debated whether such difficulties are restricted to faces or whether they can also be observed for nonfacial stimuli. Here, we investigate this issue by examining CP individuals and their controls on two variations of the Garner speeded classification task tailored to assess holistic processing of nonfacial stimuli. In Experiment 1, participants were asked to judge the width of visually presented rectangles while ignoring their irrelevant height, or to judge changes in width while height remained constant. Critically, while controls exhibited the expected Garner interference, no such interference was observed for the CPs, indicating impaired holistic processing of integral, nonfacial shape dimensions. Experiment 2, utilized the same Garner paradigm, but here participants were asked to judge integral dimensions that are unrelated to shape (colour). Importantly, both CPs and controls exhibited the same level of Garner interference, indicating intact integral processing of colour dimensions. This dissociation between the performance on the two Garner tasks indicates that CPs do not exhibit a general local processing bias or impaired integration of any perceptual dimensions, but rather a deficit that is restricted to tasks requiring holistic integral perception of shape dimensions. Taken together, these results provide evidence for the existence of a general impairment in holistic shape perception in CP, which may be related to the mechanisms underlying this disorder.

Common polymorphism in the oxytocin receptor gene (OXTR) is associated with human social recognition skills

The neuropeptides oxytocin and vasopressin are evolutionarily conserved regulators of social perception and behavior. Evidence is building that they are critically involved in the development of social recognition skills within rodent species, primates, and humans. We investigated whether common polymorphisms in the genes encoding the oxytocin and vasopressin 1a receptors influence social memory for faces. Our sample comprised 198 families, from the United Kingdom and Finland, in whom a single child had been diagnosed with high-functioning autism. Previous research has shown that impaired social perception, characteristic of autism, extends to the first-degree relatives of autistic individuals, implying heritable risk. Assessments of face recognition memory, discrimination of facial emotions, and direction of gaze detection were standardized for age (7-60 y) and sex. A common SNP in the oxytocin receptor (rs237887) was strongly associated with recognition memory in combined probands, parents, and siblings after correction for multiple comparisons. Homozygotes for the ancestral A allele had impairments in the range -0.6 to -1.15 SD scores, irrespective of their diagnostic status. Our findings imply that a critical role for the oxytocin system in social recognition has been conserved across perceptual boundaries through evolution, from olfaction in rodents to visual memory in humans.

Autistic traits are linked to reduced adaptive coding of face identity and selectively poorer face recognition in men but not women

Our ability to discriminate and recognize thousands of faces despite their similarity as visual patterns relies on adaptive, norm-based, coding mechanisms that are continuously updated by experience. Reduced adaptive coding of face identity has been proposed as a neurocognitive endophenotype for autism, because it is found in autism and in relatives of individuals with autism. Autistic traits can also extend continuously into the general population, raising the possibility that reduced adaptive coding of face identity may be more generally associated with autistic traits. In the present study, we investigated whether adaptive coding of face identity decreases as autistic traits increase in an undergraduate population. Adaptive coding was measured using face identity aftereffects, and autistic traits were measured using the Autism-Spectrum Quotient (AQ) and its subscales. We also measured face and car recognition ability to determine whether autistic traits are selectively related to face recognition difficulties. We found that men who scored higher on levels of autistic traits related to social interaction had reduced adaptive coding of face identity. This result is consistent with the idea that atypical adaptive face-coding mechanisms are an endophenotype for autism. Autistic traits were also linked with face-selective recognition difficulties in men. However, there were some unexpected sex differences. In women, autistic traits were linked positively, rather than negatively, with adaptive coding of identity, and were unrelated to face-selective recognition difficulties. These sex differences indicate that autistic traits can have different neurocognitive correlates in men and women and raise the intriguing possibility that endophenotypes of autism can differ in males and females.

Why has research in face recognition progressed so slowly? The importance of variability

Despite many years of research, there has been surprisingly little progress in our understanding of how faces are identified. Here I argue that there are two contributory factors: (a) Our methods have obscured a critical aspect of the problem, within-person variability; and (b) research has tended to conflate familiar and unfamiliar face processing. Examples of procedures for studying variability are given, and a case is made for studying real faces, of the type people recognize every day. I argue that face recognition (specifically identification) may only be understood by adopting new techniques that acknowledge statistical patterns in the visual environment. As a consequence, some of our current methods will need to be abandoned.

New tests to measure individual differences in matching and labelling facial expressions of emotion, and their association with ability to recognise vocal emotions and facial identity

Although good tests are available for diagnosing clinical impairments in face expression processing, there is a lack of strong tests for assessing "individual differences"--that is, differences in ability between individuals within the typical, nonclinical, range. Here, we develop two new tests, one for expression perception (an odd-man-out matching task in which participants select which one of three faces displays a different expression) and one additionally requiring explicit identification of the emotion (a labelling task in which participants select one of six verbal labels). We demonstrate validity (careful check of individual items, large inversion effects, independence from nonverbal IQ, convergent validity with a previous labelling task), reliability (Cronbach's alphas of.77 and.76 respectively), and wide individual differences across the typical population. We then demonstrate the usefulness of the tests by addressing theoretical questions regarding the structure of face processing, specifically the extent to which the following processes are common or distinct: (a) perceptual matching and explicit labelling of expression (modest correlation between matching and labelling supported partial independence); (b) judgement of expressions from faces and voices (results argued labelling tasks tap into a multi-modal system, while matching tasks tap distinct perceptual processes); and (c) expression and identity processing (results argued for a common first step of perceptual processing for expression and identity).

Effects of aging on face identification and holistic face processing

Several studies have shown that face identification accuracy is lower in older than younger adults. This effect of aging might be due to age differences in holistic processing, which is thought to be an important component of human face processing. Currently, however, there is conflicting evidence as to whether holistic face processing is impaired in older adults. The current study therefore re-examined this issue by measuring response accuracy in a 1-of-4 face identification task and the composite face effect (CFE), a common index of holistic processing, in older adults. Consistent with previous reports, we found that face identification accuracy was lower in older adults than in younger adults tested in the same task. We also found a significant CFE in older adults that was similar in magnitude to the CFE measured in younger subjects with the same task. Finally, we found that there was a significant positive correlation between the CFE and face identification accuracy. This last result differs from the results obtained in a previous study that used the same tasks and which found no evidence of an association between the CFE and face identification accuracy in younger adults. Furthermore, the age difference was found with subtraction-, regression-, and ratio-based estimates of the CFE. The current findings are consistent with previous claims that older adults rely more heavily on holistic processing to identify objects in conditions of limited processing resources.

When Intuition Fails to Align with Data: A Reply to

Holistic processing, a hallmark of face perception, is often measured in the so-called composite paradigm, in which participants are asked to match part of a stimulus while ignoring another part. In prior work, we recommended against the use of one version of the composite task we call the partial design, on the basis of confounds with response biases. Rossion wrote a lengthy piece that reviews the work that he has published using this design, raising a large number of criticisms, both about an alternative measure of holistic processing that we have used and advocated (which we call the complete design) and about our work in general. In this reply, we have limited our discussion to those issues that would be relevant to a researcher looking to decide which version of this composite paradigm to use, as we doubt a comprehensive reply would be of significant interest outside a very small circle.

Facial emotion recognition in child psychiatry: a systematic review

This review focuses on facial affect (emotion) recognition in children and adolescents with psychiatric disorders other than autism. A systematic search, using PRISMA guidelines, was conducted to identify original articles published prior to October 2011 pertaining to face recognition tasks in case-control studies. Used in the qualitative synthesis were: 2 studies on schizophrenia, 18 on mood disorders, 16 on anxiety disorders, 4 on eating disorders, 14 on ADHD and 9 on conduct disorder. Our review suggests that there are abnormalities in facial emotion recognition in a wide range of child psychiatric disorders and that these are likely to have a negative effect on both family and peer relationships. Scope for further research has been identified.

Individual differences in holistic processing predict the own-race advantage in recognition memory

Individuals are consistently better at recognizing own-race faces compared to other-race faces (other-race effect, ORE). One popular hypothesis is that this recognition memory ORE is caused by differential own- and other-race holistic processing, the simultaneous integration of part and configural face information into a coherent whole. Holistic processing may create a more rich, detailed memory representation of own-race faces compared to other-race faces. Despite several studies showing that own-race faces are processed more holistically than other-race faces, studies have yet to link the holistic processing ORE and the recognition memory ORE. In the current study, we sought to use a more valid method of analyzing individual differences in holistic processing by using regression to statistically remove the influence of the control condition (part trials in the part-whole task) from the condition of interest (whole trials in the part-whole task). We also employed regression to separately examine the two components of the ORE: own-race advantage (regressing other-race from own-race performance) and other-race decrement (regressing own-race from other-race performance). First, we demonstrated that own-race faces were processed more holistically than other-race faces, particularly the eye region. Notably, using regression, we showed a significant association between the own-race advantage in recognition memory and the own-race advantage in holistic processing and that these associations were weaker when examining the other-race decrement. We also demonstrated that performance on own- and other-race faces across all of our tasks was highly correlated, suggesting that the differences we found between own- and other-race faces are quantitative rather than qualitative. Together, this suggests that own- and other-race faces recruit largely similar mechanisms, that own-race faces more thoroughly engage holistic processing, and that this greater engagement of holistic processing is significantly associated with the own-race advantage in recognition memory.