A critical review of the development of face recognition: experience is less important than previously believed

Children can discriminate the authenticity of happy but not sad or fearful facial expressions, and use an immature intensity-only strategy

Much is known about development of the ability to label facial expressions of emotion (e.g., as happy or sad), but rather less is known about the emergence of more complex emotional face processing skills. The present study investigates one such advanced skill: the ability to tell if someone is genuinely feeling an emotion or just pretending (i.e., authenticity discrimination). Previous studies have shown that children can discriminate authenticity of happy faces, using expression intensity as an important cue, but have not tested the negative emotions of sadness or fear. Here, children aged 8–12 years (n = 85) and adults (n = 57) viewed pairs of faces in which one face showed a genuinely-felt emotional expression (happy, sad, or scared) and the other face showed a pretend version. For happy faces, children discriminated authenticity above chance, although they performed more poorly than adults. For sad faces, for which our pretend and genuine images were equal in intensity, adults could discriminate authenticity, but children could not. Neither age group could discriminate authenticity of the fear faces. Results also showed that children judged authenticity based on intensity information alone for all three expressions tested, while adults used a combination of intensity and other factor/s. In addition, novel results show that individual differences in empathy (both cognitive and affective) correlated with authenticity discrimination for happy faces in adults, but not children. Overall, our results indicate late maturity of skills needed to accurately determine the authenticity of emotions from facial information alone, and raise questions about how this might affect social interactions in late childhood and the teenage years.

Face processing in autism spectrum disorders: From brain regions to brain networks

Autism spectrum disorder (ASD) is characterized by reduced attention to social stimuli including the human face. This hypo-responsiveness to stimuli that are engaging to typically developing individuals may result from dysfunctioning motivation, reward, and attention systems in the brain. Here we review an emerging neuroimaging literature that emphasizes a shift from focusing on hypo-activation of isolated brain regions such as the fusiform gyrus, amygdala, and superior temporal sulcus in ASD to a more holistic approach to understanding face perception as a process supported by distributed cortical and subcortical brain networks. We summarize evidence for atypical activation patterns within brain networks that may contribute to social deficits characteristic of the disorder. We conclude by pointing to gaps in the literature and future directions that will continue to shed light on aspects of face processing in autism that are still under-examined. In particular, we highlight the need for more developmental studies and studies examining ecologically valid and naturalistic social stimuli.

Face and body recognition show similar improvement during childhood

Adults are proficient in extracting identity cues from faces. This proficiency develops slowly during childhood, with performance not reaching adult levels until adolescence. Bodies are similar to faces in that they convey identity cues and rely on specialized perceptual mechanisms. However, it is currently unclear whether body recognition mirrors the slow development of face recognition during childhood. Recent evidence suggests that body recognition develops faster than face recognition. Here we measured body and face recognition in 6- and 10-year-old children and adults to determine whether these two skills show different amounts of improvement during childhood. We found no evidence that they do. Face and body recognition showed similar improvement with age, and children, like adults, were better at recognizing faces than bodies. These results suggest that the mechanisms of face and body memory mature at a similar rate or that improvement of more general cognitive and perceptual skills underlies improvement of both face and body recognition.

Face recognition in schizophrenia disorder: A comprehensive review of behavioral, neuroimaging and neurophysiological studies

Facial emotion processing has been extensively studied in schizophrenia patients while general face processing has received less attention. The already published reviews do not address the current scientific literature in a complete manner. Therefore, here we tried to answer some questions that remain to be clarified, particularly: are the non-emotional aspects of facial processing in fact impaired in schizophrenia patients? At the behavioral level, our key conclusions are that visual perception deficit in schizophrenia patients: are not specific to faces; are most often present when the cognitive (e.g. attention) and perceptual demands of the tasks are important; and seems to worsen with the illness chronification. Although, currently evidence suggests impaired second order configural processing, more studies are necessary to determine whether or not holistic processing is impaired in schizophrenia patients. Neural and neurophysiological evidence suggests impaired earlier levels of visual processing, which might involve the deficits in interaction of the magnocellular and parvocellular pathways impacting on further processing. These deficits seem to be present even before the disorder out-set. Although evidence suggests that this deficit may be not specific to faces, further evidence on this question is necessary, in particularly more ecological studies including context and body processing.

A lack of experience-dependent plasticity after more than a decade of recovered sight

In 2000, monocular vision was restored to M. M., who had been blind between the ages of 3 and 46 years. Tests carried out over 2 years following the surgery revealed impairments of 3-D form, object, and face processing and an absence of object- and face-selective blood-oxygen-level-dependent responses in ventral visual cortex. In the present research, we reexamined M. M. to test for experience-dependent recovery of visual function. Behaviorally, M. M. remains impaired in 3-D form, object, and face processing. Accordingly, we found little to no evidence of the category-selective organization within ventral visual cortex typically associated with face, body, scene, or object processing. We did observe remarkably normal object selectivity within lateral occipital cortex, consistent with M. M.'s previously reported shape-discrimination performance. Together, these findings provide little evidence for recovery of high-level visual function after more than a decade of visual experience in adulthood.

Development of effective connectivity in the core network for face perception

This study measured effective connectivity within the core face network in young children using a paediatric magnetoencephalograph (MEG). Dynamic casual modeling (DCM) of brain responses was performed in a group of adults (N = 14) and a group of young children aged from 3 to 6 years (N = 15). Three candidate DCM models were tested, and the fits of the MEG data to the three models were compared at both individual and group levels. The results show that the connectivity structure of the core face network differs significantly between adults and children. Further, the relative strengths of face network connections were differentially modulated by experimental conditions in the two groups. These results support the interpretation that the core face network undergoes significant structural configuration and functional specialization between four years of age and adulthood.

Body-selective areas in the visual cortex are less active in children than in adults

Our ability to read other people's non-verbal signals gets refined throughout childhood and adolescence. How this is paralleled by brain development has been investigated mainly with regards to face perception, showing a protracted functional development of the face-selective visual cortical areas. In view of the importance of whole-body expressions in interpersonal communication it is important to understand the development of brain areas sensitive to these social signals. Here we used functional magnetic resonance imaging (fMRI) to compare brain activity in a group of 24 children (age 6-11) and 26 adults while they passively watched short videos of body or object movements. We observed activity in similar regions in both groups; namely the extra-striate body area (EBA), fusiform body area (FBA), posterior superior temporal sulcus (pSTS), amygdala and premotor regions. Adults showed additional activity in the inferior frontal gyrus (IFG). Within the main body-selective regions (EBA, FBA and pSTS), the strength and spatial extent of fMRI signal change was larger in adults than in children. Multivariate Bayesian (MVB) analysis showed that the spatial pattern of neural representation within those regions did not change over age. Our results indicate, for the first time, that body perception, like face perception, is still maturing through the second decade of life.

Face processing in the brains of pre-school aged children measured with MEG

There are two competing theories concerning the development of face perception: a late maturation account and an early maturation account. Magnetoencephalography (MEG) neuroimaging holds promise for adjudicating between the two opposing accounts by providing objective neurophysiological measures of face processing, with sufficient temporal resolution to isolate face-specific brain responses from those associated with other sensory, cognitive and motor processes. The current study used a customized child MEG system to measure M100 and M170 brain responses in 15 children aged three to six years while they viewed faces, cars and their phase-scrambled counterparts. Compared to adults tested using the same stimuli in a conventional MEG system, children showed significantly larger and later M100 responses. Children's M170 responses, derived by subtracting the responses to phase-scrambled images from the corresponding images (faces or cars) were delayed in latency but otherwise resembled the adult M170. This component has not been obtained in previous studies of young children tested using conventional adult MEG systems. However children did show a markedly reduced M170 response to cars in comparison to adults. This may reflect children's lack of expertise with cars relative to faces. Taken together, these data are in accord with recent behavioural and neuroimaging data that support early maturation of the basic face processing functions.

Repetition probability effects depend on prior experiences

The magnitude of repetition suppression (RS) in the Fusiform Face Area is influenced by the probability of repetitions of faces (Summerfield et al., 2008), implying that perceptual expectations affect repetition-related processes. Surprisingly, however, macaque single-cell (Kaliukhovich and Vogels, 2011) and human fMRI (Kovács et al., 2013) studies have failed to find repetition probability [P(rep)] modulations of RS with nonface stimuli in the occipitotemporal cortex, suggesting that the effect is face specific. One possible explanation of this category selectivity is that the extensive experience humans have with faces affects the neural mechanisms of RS specifically, creating P(rep) modulatory effects. To address this question, we used fMRI to test the P(rep) effects for another well trained stimulus category, upright letters of the roman alphabet as well as for unfamiliar false fonts. We observed significant RS for both stimulus sets in the Letter Form Area as well as in the caudodorsal part of the lateral occipital complex. Interestingly, the influence of P(rep) on RS was dependent on the stimulus: while we observed P(rep) modulations for the roman letters, no such effects were found for the unfamiliar false fonts in either area. Our findings suggest that P(rep) effects on RS are manifest for nonface stimuli as well, but that they depend on the experience of the subjects with the stimulus category. This shows, for the first time, that prior experience affects the influence of contextual predictive information on RS in the human occipitotemporal cortex.

Category-specific face prototypes are emerging, but not yet mature, in 5-year-old children

Adults' expertise in face recognition has been attributed to norm-based coding. Moreover, adults possess separable norms for a variety of face categories (e.g., race, sex, age) that appear to enhance recognition by reducing redundancy in the information shared by faces and ensuring that only relevant dimensions are used to encode faces from a given category. Although 5-year-old children process own-race faces using norm-based coding, little is known about the organization and refinement of their face space. The current study investigated whether 5-year-olds rely on category-specific norms and whether experience facilitates the development of dissociable face prototypes. In Experiment 1, we examined whether Chinese 5-year-olds show race-contingent opposing aftereffects and the extent to which aftereffects transfer across face race among Caucasian and Chinese 5-year-olds. Both participant races showed partial transfer of aftereffects across face race; however, there was no evidence for race-contingent opposing aftereffects. To examine whether experience facilitates the development of category-specific prototypes, we investigated whether race-contingent aftereffects are present among Caucasian 5-year-olds with abundant exposure to Chinese faces (Experiment 2) and then tested separate groups of 5-year-olds with two other categories with which they have considerable experience: sex (male/female faces) and age (adult/child faces) (Experiment 3). Across all three categories, 5-year-olds showed no category-contingent opposing aftereffects. These results demonstrate that 5 years of age is a stage characterized by minimal separation in the norms and associated coding dimensions used for faces from different categories and suggest that refinement of the mechanisms that underlie expert face processing occurs throughout childhood.

The face inversion effect in infants is driven by high, and not low, spatial frequencies

To investigate the mechanisms underlying development of upright face preferences in infants, the current study measured inversion effects for faces that were spatial frequency (SF) filtered, into low SF and high SF, with the notion that different SFs are analyzed by different visual mechanisms. For comparison to faces, we used object stimuli that consisted of pictures of strollers. In 4 month olds, 8 month olds, and adults, we measured the strength of the selective face inversion effect (sFIE), operationally defined as an upright over inverted looking preference that is greater for faces than objects. In Study 1, we employed unfiltered stimuli, and found a clear sFIE in both infants and adults. To determine what drove this sFIE, in Study 2, the sFIE was measured for low-SF and high-SF stimuli, with all stimuli being equated for visibility. For adults, the sFIE was equally strong for low-SF and high-SF stimuli. A different pattern was seen for infants. Infants exhibited a significantly greater sFIE for high-SF, than for low-SF, stimuli (and only for high SF was the sFIE significant). In fact, the strength of infants' upright face preference for high-SF stimuli was indistinguishable from that observed for unfiltered faces, indicating that in natural (unfiltered) stimuli, high SFs are sufficient to account for infants' upright face preferences.

Children's neural response to contrast-negated faces is species specific

Face recognition abilities develop dramatically during the first year of life, but comparatively little is known about the nature of face-specific perceptual development during early childhood. Face-specific effects of image appearance on recognition, including face inversion and contrast negation, are a useful means of understanding the functional properties of face perception developmentally. Here, we examined the generality of the impact of contrast negation on face perception during early childhood using event-related potentials (ERPs). Specifically, we recorded continuous electroencephalography (EEG) while adult participants and children between 4 and 6 years of age viewed human and non-human primate faces presented in either positive or negative contrast. We examined both the P100 and N170 components to determine whether or not sensitivity to contrast polarity was evident in face-sensitive components during early childhood and also whether or not that sensitivity was specific to species category. We found evidence of a species-specific effect of contrast negation at the N170, suggesting that by early childhood some aspects of face-specific processing have been restricted to a relatively narrow class of face stimuli. However, this effect is of the opposite sign relative to adults, suggesting that there is continued maturation of face-specific processing during childhood.

Face-sensitive brain responses measured from a four-year-old child with a custom-sized child MEG system

BACKGROUND

Previous magnetoencephalography (MEG) studies have failed to find a facesensitive, brain response-M170 in children. If this is the case, this suggests that the developmental trajectory of the M170 is different from that of its electrical equivalent, the N170. We investigated the alternative possibility that the child M170 may not be detectable in conventional adult-sized MEG systems.

NEW METHOD

Brain responses to pictures of faces and well controlled stimuli were measured from the same four-year-old child with a custom child MEG system and an adult-sized MEG system.

RESULTS

The goodness of fit of the child's head was about the same over the occipital head surface in both systems, but was much worse over all other parts of the head surface in the adult MEG system compared to the child MEG system. The face-sensitive M170 was measured from the child in both MEG systems, but was larger in amplitude, clearer in morphology, and had a more accurate source localization when measured in the child MEG system.

COMPARISON WITH EXISTING METHOD

The custom-sized child MEG system is superior for measuring the face-sensitive M170 brain response in children than the conventional adult MEG system.

CONCLUSIONS

The present results show that the face-sensitive M170 brain response can be elicited in a four-year-old child. This provides new evidence for early maturation of face processing brain mechanisms in humans, and offers new opportunities for the study of neurodevelopmental disorders that show atypical face processing capabilities, such as autism spectrum disorder.

Reduced face aftereffects in autism are not due to poor attention

This study aimed to determine why face identity aftereffects are diminished in children with autism, relative to typical children. To address the possibility that reduced face aftereffects might reflect reduced attention to adapting stimuli, we investigated the consequence of controlling attention to adapting faces during a face identity aftereffect task in children with autism and typical children. We also included a size-change between adaptation and test stimuli to determine whether the reduced aftereffects reflect atypical adaptation to low- or higher-level stimulus properties. Results indicated that when attention was controlled and directed towards adapting stimuli, face identity aftereffects in children with autism were significantly reduced relative to typical children. This finding challenges the notion that atypicalities in the quality and/or quantity of children's attention during adaptation might account for group differences previously observed in this paradigm. Additionally, evidence of diminished face identity aftereffects despite a stimulus size change supports an adaptive processing atypicality in autism that extends beyond low-level, retinotopically coded stimulus properties. These findings support the notion that diminished face aftereffects in autism reflect atypicalities in adaptive norm-based coding, which could also contribute to face processing difficulties in this group.

The functional architecture for face-processing expertise: FMRI evidence of the developmental trajectory of the core and the extended face systems

Expertise in processing faces is a cornerstone of human social interaction. However, the developmental course of many key brain regions supporting face preferential processing in the human brain remains undefined. Here, we present findings from an FMRI study using a simple viewing paradigm of faces and objects in a continuous age sample covering the age range from 6 years through adulthood. These findings are the first to use such a sample paired with whole-brain FMRI analyses to investigate development within the core and extended face networks across the developmental spectrum from middle childhood to adulthood. We found evidence, albeit modest, for a developmental trend in the volume of the right fusiform face area (rFFA) but no developmental change in the intensity of activation. From a spatial perspective, the middle portion of the right fusiform gyrus most commonly found in adult studies of face processing was increasingly likely to be included in the FFA as age increased to adulthood. Outside of the FFA, the most striking finding was that children hyperactivated nearly every aspect of the extended face system relative to adults, including the amygdala, anterior temporal pole, insula, inferior frontal gyrus, anterior cingulate gyrus, and parietal cortex. Overall, the findings suggest that development is best characterized by increasing modulation of face-sensitive regions throughout the brain to engage only those systems necessary for task requirements.

Development of face discrimination abilities, and relationship to magnocellular pathway development, between childhood and adulthood

The current study tested the development of face and object processing in young children (mean age = 5.24 years), adolescents (mean age = 15.8 years), and adults (mean age = 21.1 years) using stimuli that were equated for low-level visual characteristics (luminance, contrast, and spatial frequency make-up) and methods that equate for difficulty across ages. We also tested sensitivity to luminance and chromatic contrast (i.e., thought to be mediated primarily by the subcortical Magnocellular (M) and Parvocellular (P) pathways, respectively) to determine whether age-related improvements in face or object discrimination were driven by age-related changes in the M and/or P pathways. Results showed a selective age-related improvement in face sensitivity and a relationship between age-related increases in face sensitivity and luminance contrast sensitivity. These results add to the mounting evidence that the M pathway may influence face processing.

Importance of the inverted control in measuring holistic face processing with the composite effect and part-whole effect

Holistic coding for faces is shown in several illusions that demonstrate integration of the percept across the entire face. The illusions occur upright but, crucially, not inverted. Converting the illusions into experimental tasks that measure their strength – and thus index degree of holistic coding – is often considered straightforward yet in fact relies on a hidden assumption, namely that there is no contribution to the experimental measure from secondary cognitive factors. For the composite effect, a relevant secondary factor is size of the “spotlight” of visuospatial attention. The composite task assumes this spotlight can be easily restricted to the target half (e.g., top-half) of the compound face stimulus. Yet, if this assumption were not true then a large spotlight, in the absence of holistic perception, could produce a false composite effect, present even for inverted faces and contributing partially to the score for upright faces. We review evidence that various factors can influence spotlight size: race/culture (Asians often prefer a more global distribution of attention than Caucasians); sex (females can be more global); appearance of the join or gap between face halves; and location of the eyes, which typically attract attention. Results from five experiments then show inverted faces can sometimes produce large false composite effects, and imply that whether this happens or not depends on complex interactions between causal factors. We also report, for both identity and expression, that only top-half face targets (containing eyes) produce valid composite measures. A sixth experiment demonstrates an example of a false inverted part-whole effect, where encoding-specificity is the secondary cognitive factor. We conclude the inverted face control should be tested in all composite and part-whole studies, and an effect for upright faces should be interpreted as a pure measure of holistic processing only when the experimental design produces no effect inverted.

Holistic processing for other-race faces in chinese participants occurs for upright but not inverted faces

Recent evidence suggests stronger holistic processing for own-race faces may underlie the own-race advantage in face memory. In previous studies Caucasian participants have demonstrated larger holistic processing effects for Caucasian over Asian faces. However, Asian participants have consistently shown similar sized effects for both Asian and Caucasian faces. We investigated two proposed explanations for the holistic processing of other-race faces by Asian participants: (1) greater other-race exposure, (2) a general global processing bias. Holistic processing was tested using the part-whole task. Participants were living in predominantly own-race environments and other-race contact was evaluated. Despite reporting significantly greater contact with own-race than other-race people, Chinese participants displayed strong holistic processing for both Asian and Caucasian upright faces. In addition, Chinese participants showed no evidence of holistic processing for inverted faces arguing against a general global processing bias explanation. Caucasian participants, in line with previous studies, displayed stronger holistic processing for Caucasian than Asian upright faces. For inverted faces there were no race-of-face differences. These results are used to suggest that Asians may make more general use of face-specific mechanisms than Caucasians.

Bilateral hemispheric processing of words and faces: evidence from word impairments in prosopagnosia and face impairments in pure alexia

Considerable research has supported the view that faces and words are subserved by independent neural mechanisms located in the ventral visual cortex in opposite hemispheres. On this view, right hemisphere ventral lesions that impair face recognition (prosopagnosia) should leave word recognition unaffected, and left hemisphere ventral lesions that impair word recognition (pure alexia) should leave face recognition unaffected. The current study shows that neither of these predictions was upheld. A series of experiments characterizing speed and accuracy of word and face recognition were conducted in 7 patients (4 pure alexic, 3 prosopagnosic) and matched controls. Prosopagnosic patients revealed mild but reliable word recognition deficits, and pure alexic patients demonstrated mild but reliable face recognition deficits. The apparent comingling of face and word mechanisms is unexpected from a domain-specific perspective, but follows naturally as a consequence of an interactive, learning-based account in which neural processes for both faces and words are the result of an optimization procedure embodying specific computational principles and constraints.

A Review and Clarification of the Terms "holistic," "configural," and "relational" in the Face Perception Literature

It is widely agreed that the human face is processed differently from other objects. However there is a lack of consensus on what is meant by a wide array of terms used to describe this “special” face processing (e.g., holistic and configural) and the perceptually relevant information within a face (e.g., relational properties and configuration). This paper will review existing models of holistic/configural processing, discuss how they differ from one another conceptually, and review the wide variety of measures used to tap into these concepts. In general we favor a model where holistic processing of a face includes some or all of the interrelations between features and has separate coding for features. However, some aspects of the model remain unclear. We propose the use of moving faces as a way of clarifying what types of information are included in the holistic representation of a face.

Core knowledge of object, number, and geometry: a comparative and neural approach

Studies on the ontogenetic origins of human knowledge provide evidence for a small set of separable systems of core knowledge dealing with the representation of inanimate and animate objects, number, and geometry. Because core knowledge systems are evolutionarily ancient, they can be investigated from a comparative perspective, making use of various animal models. In this review, I discuss evidence showing precocious abilities in nonhuman species to represent (a) objects that move partly or fully out of view and their basic mechanical properties such as solidity, (b) the cardinal and ordinal/sequential aspects of numerical cognition and rudimentary arithmetic with small numerosities, and (c) the geometrical relationships among extended surfaces in the surrounding layout. Controlled rearing studies suggest that the abilities associated with core knowledge systems of objects, number, and geometry are observed in animals in the absence (or with very reduced) experience, supporting a nativistic foundation of such cognitive mechanisms. Animal models also promise a fresh approach to the issue of the neurobiological and genetic mechanisms underlying the expression of core knowledge systems.