Own- and other-race categorization of faces by race, gender, and age

Event-related potential correlates of implicit processing of own- and other-race faces in children

Human adults typically experience difficulties in recognizing and discriminating individual faces belonging to racial groups other than their own. The origin of this "other-race" effect is set in infancy, but the understanding of its developmental course is fragmented. We aimed to access the mechanisms of the other-race effect in childhood by unraveling the neural time course of own- and other-race face processing during a masked priming paradigm. White 6- and 7-year-old children (N = 19) categorized fully visible Asian (other-race) or White (own-race) target faces according to gender. Target faces were preceded by masked same-identity or different-identity prime faces, matching the target for race and gender. We showed an early priming effect on the N100 component, with larger amplitude to different-face pairs than to same-face pairs, and a later race effect on the N200 component, with larger amplitude to own-race face pairs than to other-race face pairs. Critically, race did not interact with priming at any processing stage (P100, N100, P200, N200, or P300). Our results suggest that race could have a temporally limited impact on face processing and that the implicit and unconscious identity processing of own- and other-race faces could be similar in 6- and 7-year-olds, depicting an immature other-race effect during childhood.

The speed of race

When asked to categorize faces according to 'race', people typically categorize other-race faces faster than faces belonging to their own race. This 'Other Race Categorization Advantage' is thought to reflect enhanced sensitivity to early visual signals characteristic of other-race faces, and can manifest within 200 ms of face presentation. However, recent research has highlighted the importance of signal intensity in this effect, where visual-degradation of the face images significantly enhances the effect and exposes a behavioural threshold at very low levels of visual quality where other-race visual signals are able to be perceived while same-race signals are not. The current study investigated the effect of signal intensity in race categorization processes in the brain through electroencephalography and in accuracy/reaction times. While replicating the previously observed enhancement of the other-race categorization advantage, we also found enhanced sensitivity to other-race faces in early P1 peaks, as well as later N170 and N250 peaks. These effects, however, related to the varying levels of signal intensity in the face stimuli, suggesting that race categorization may involve different types of perceptual and neural processes rather than one discrete process. The speed at which race is perceived depends on the intensity of the face signal.

Faces do not guide attention in an object-based facilitation manner

Numerous studies on face processing have revealed their special ability to affect attention, but relatively little research has been done on how faces guide spatial attention allocation. To enrich this field, this study resorted to the object-based attention (OBA) effect in a modified double-rectangle paradigm where the rectangles were replaced with human faces and mosaic patterns (non-face objects). Experiment 1 replicated the typical OBA effect in the non-face objects, but this effect was absent in Asian and Caucasian faces. Experiment 2 removed the eye region from Asian faces, but still found no object-based facilitation in the faces without eyes. In Experiment 3, the OBA effect was also observed for faces when the faces disappear a short period before the responses. Overall, these results revealed that when two faces are presented together, they do not exert object-based facilitation regardless of their facial features such as race and the presence of eyes. We argue that the lack of a typical OBA effect is due to the filtering cost induced by the entire face content. This cost slows down the response when attention shifts within a face and results in the absence of object-based facilitation.

Prosopagnosia does not abolish other-race effects

Healthy observers recognize more accurately same-than other-race faces (i.e., the Same-Race Recognition Advantage - SRRA) but categorize them by race more slowly than other-race faces (i.e., the Other-Race Categorization Advantage - ORCA). Several fMRI studies reported discrepant bilateral activations in the Fusiform Face Area (FFA) and Occipital Face Area (OFA) correlating with both effects. However, due to the very nature and limits of fMRI results, whether these face-sensitive regions play an unequivocal causal role in those other-race effects remains to be clarified. To this aim, we tested PS, a well-studied pure case of acquired prosopagnosia with lesions encompassing the left FFA and the right OFA. PS, healthy age-matched and young adults performed two recognition and three categorization by race tasks, respectively using Western Caucasian and East Asian faces normalized for their low-level properties with and without-external features, as well as in naturalistic settings. As expected, PS was slower and less accurate than the controls. Crucially, however, the magnitudes of her SRRA and ORCA were comparable to the controls in all the tasks. Our data show that prosopagnosia does not abolish other-race effects, as an intact face system, the left FFA and/or right OFA are not critical for eliciting the SRRA and ORCA. Race is a strong visual and social signal that is encoded in a large neural face-sensitive network, robustly tuned for processing same-race faces.

Asymmetrical responding to male versus female other-race categories in 9- to 12-month-old infants

Faces can be categorized along various dimensions including gender or race, an ability developing in infancy. Infant categorization studies have focused on facial attributes in isolation, but the interaction between these attributes remains poorly understood. Experiment 1 examined gender categorization of other-race faces in 9- and 12-month-old White infants. Nine- and 12-month-olds were familiarized with Asian male or female faces, and tested with a novel exemplar from the familiarized category paired with a novel exemplar from a novel category. Both age groups showed novel category preferences for novel Asian female faces after familiarization with Asian male faces, but showed no novel category preference for novel Asian male faces after familiarization with Asian female faces. This categorization asymmetry was not due to a spontaneous preference hindering novel category reaction (Experiment 2), and both age groups displayed difficulty discriminating among male, but not female, other-race faces (Experiment 3). These results indicate that category formation for male other-race faces is mediated by categorical perception. Overall, the findings suggest that even by 12 months of age, infants are not fully able to form gender category representations of other-race faces, responding categorically to male, but not female, other-race faces.

Race categorization in noise

People are typically faster to categorize the race of a face if it belongs to a race different from their own. This Other Race Categorization Advantage (ORCA) is thought to reflect an enhanced sensitivity to the visual race signals of other race faces, leading to faster response times. The current study investigated this sensitivity in a cross-cultural sample of Swiss and Japanese observers with a race categorization task using faces that had been parametrically degraded of visual structure, with normalized luminance and contrast. While Swiss observers exhibited an increasingly strong ORCA in both reaction time and accuracy as the face images were visually degraded up to 20% structural coherence, the Japanese observers manifested this pattern most distinctly when the faces were fully structurally-intact. Critically, for both observer groups, there was a clear accuracy effect at the 20% structural coherence level, indicating that the enhanced sensitivity to other race visual signals persists in significantly degraded stimuli. These results suggest that different cultural groups may rely on and extract distinct types of visual race signals during categorization, which may depend on the available visual information. Nevertheless, heavily degraded stimuli specifically favor the perception of other race faces, indicating that the visual system is tuned by experience and is sensitive to the detection of unfamiliar signals.

Gene-Environment Interactions in Face Categorization: Oxytocin Receptor Genotype x Childcare Experience Shortens Reaction Time

Human faces capture attention, provide information about group belonging, and elicit automatic prepared responses. Early experiences with other-race faces play a critical role in acquiring face expertise, but the exact mechanism through which early experience exerts its influence is still to be elucidated. Genetic factors and a multi-ethnic context are likely involved, but their specific influences have not been explored. This study investigated how oxytocin receptor gene (OXTR) genotypes and childcare experience interacted to regulate face categorization in adults. Information about single nucleotide polymorphisms of OXTR (rs53576) and experiences with own- and other-race child caregivers was collected from 89 Singaporean adults, who completed a visual categorization task with own- versus other-race faces. Participants were grouped into A/A homozygotes and G carriers and assigned a score to account for their type of child caregiver experience. A multivariate linear regression model was used to estimate the effect of genetic group, child caregiver experience, and their interaction on categorization reaction time. A significant interaction of genetic group and child caregiver experience (t = 2.48, p = 0.015), as well as main effects of both genetic group (t = −2.17, p = 0.033) and child caregiver experience (t = −4.29, p < 0.001) emerged. Post-hoc analysis revealed that the correlation between categorization reaction time and child caregiver experience was significantly different between the two genetic groups. A significant gene x environment interaction on face categorization appears to represent an indirect pathway through which genes and experiences interact to shape mature social sensitivity to faces in human adults.

Rapid saccadic categorization of other-race faces

The human visual system is very fast and efficient at extracting socially relevant information from faces. Visual studies employing foveated faces have consistently reported faster categorization by race response times for other-race compared with same-race faces. However, in everyday life we typically encounter faces outside the foveated visual field. In study 1, we explored whether and how race is categorized extrafoveally in same- and other-race faces normalized for low-level properties by tracking eye movements of Western Caucasian and East Asian observers in a saccadic response task. The results show that not only are people sensitive to race in faces presented outside of central vision, but the speed advantage in categorizing other-race faces occurs astonishingly quickly in as little as 200 ms. Critically, this visual categorization process was approximately 300 ms faster than the typical button press responses on centrally presented foveated faces. Study 2 investigated the genesis of the extrafoveal saccadic response speed advantage by comparing the influences of the response modality (button presses and saccadic responses), as well as the potential contribution of the impoverished low-spatial frequency spectrum characterizing extrafoveal visual information processing. Button press race categorization was not significantly faster with reconstructed retinal-filtered low spatial frequency faces, regardless of the visual field presentation. The speed of race categorization was significantly boosted only by extrafoveal saccades and not centrally foveated faces. Race is a potent, rapid, and effective visual signal transmitted by faces used for the categorization of ingroup/outgroup members. This fast universal visual categorization can occur outside central vision, igniting a cascade of social processes.

The left-side bias is not unique to own-race face processing

Humans show a clear left-side bias in face processing. A chimeric face constructed with the left side (from the viewer's perspective) of a face and its mirror image is usually rated as more resemblant to the original face than a chimeric face constructed with the right side of the same face. Previous studies have characterized the left-side bias mainly with own-race faces, but it remains unclear whether this effect is race specific or if it reflects an universal visual expertise. One hundred and five Chinese students completed two versions of a chimeric face-identification task. The results revealed a significant left-side bias for both own-race (Chinese) and other-race (Caucasian) faces, suggesting that the left-side bias reflects an universal visual expertise in face processing.

A developmental investigation of the other-race categorization advantage in a multiracial population: Contrasting social categorization and perceptual expertise accounts

Most prior studies of the other-race categorization advantage have been conducted in predominantly monoracial societies. This limitation has left open the question of whether tendencies to more rapidly and accurately categorize other-race faces reflect social categorization (own-race vs. other-race) or perceptual expertise (frequent exposure vs. infrequent exposure). To address this question, we tested Malay and Malaysian Chinese children (9- and 10-year-olds) and adults on (a) own-race faces (i.e., Malay faces for Malay participants and Chinese faces for Malaysian Chinese participants), (b) high-frequency other-race faces (i.e., Chinese faces for Malay participants and Malay faces for Malaysian Chinese participants), and (c) low-frequency other-race faces (i.e., Caucasian faces). Whereas the other-race categorization advantage was in evidence in the accuracy data of Malay adults, other aspects of performance were supportive of either the social categorization or perceptual expertise accounts and were dependent on the race (Malay vs. Chinese) or age (child vs. adult) of the participants. Of particular significance is the finding that Malaysian Chinese children and adults categorized own-race Chinese faces more rapidly than high-frequency other-race Malay faces. Thus, in accord with a perceptual expertise account, the other-race categorization advantage seems to be more an advantage for racial categories of lesser experience regardless of whether these face categories are own-race or other-race.

Comparing race, gender, age, and career categories in recognizing and grouping tasks

The purpose of our research was to compare how participants weighed age, gender, race, and career categories in recognizing and grouping tasks. In Study 1, we used a category recognition task to compare participants' speeds in recognizing information from different categories. The results showed that participants recognized the gender information most quickly, followed by career, race, and age information. In Study 2, a categorization task was used to compare participants' category preferences. The results showed that the career category had the greatest weight, and the gender category had the lowest weight. Two targets who had different career identities were more possible considered as belonging to different groups than two targets with different gender, race or age identities. Our results have implications in understanding the weight of different categories, with gender and career category are the most important category that affects perception and evaluation.

The Other-Race and Other-Species Effect during a Sex Categorization Task: An Eye Tracker Study

Sex categorization from faces is a crucial ability for humans and non-human primates for various social and cognitive processes. In the current study, we performed two eye tracking experiments to examine the gaze behavior of participants during a sex categorization task in which participants categorize face pictures from their own-race (Caucasian), other-race (Asian) and other-species (chimpanzee). In experiment 1, we presented the faces in an upright position to 16 participants, and found a strong other-race and other-species effect. In experiment 2, the same faces were shown to 24 naïve participants in an upside-down (inverted) position, which showed that, although the other-species effect was intact, other-race effect disappeared. Moreover, eye-tracking analysis revealed that in the upright position, the eye region was the first and most widely viewed area for all face categories. However, during upside-down viewing, participants' attention directed more towards the eye region of the own-race and own-species faces, whereas the nose received more attention in other-race and other-species faces. Overall results suggest that other-race faces were processed less holistically compared to own-race faces and this could affect both participants' behavioral performance and gaze behavior during sex categorization. Finally, gaze data suggests that the gaze of participants shifts from the eye to the nose region with decreased racial and species-based familiarity.

Exposure to linguistic labels during childhood modulates the neural architecture of race categorical perception

Perceptually categorizing a face to its racial belonging may have important consequences on interacting with people. However, race categorical perception (CP) has been scarcely investigated nor its developmental pathway. In this study, we tested the neurolinguistics rewiring hypothesis, stating that language acquisition modulates the brain processing of social perceptual categories. Accordingly, we investigated the electrophysiological correlates of race CP in a group of adults and children between 3 and 5 years of age. For both groups we found a greater modulation of the N400 connected with the processing of between category boundaries (i.e., faces belonging to different race groups) than within-category boundaries (i.e., different faces belonging to the same race group). This effect was the same in both adults and children, as shown by the comparable between-group amplitude of the differential wave (DW) elicited by the between-category faces. Remarkably, this effect was positively correlated with racial-labels acquisition, but not with age, in children. Finally, brain source analysis revealed the activation of a more modularized cortical network in adults than in children, with unique activation of the left superior temporal gyrus (STG) and the inferior frontal gyrus (IFG), which are areas connected to language processing. These are the first results accounting for an effect of language in rewiring brain connectedness when processing racial categories.

The effect of ethnicity and team membership on face processing: a cultural neuroscience perspective

In-ethnicity bias, as one of the in-group biases, is widespread in different cultures, interfering with cross-ethnicity communication. Recent studies have revealed that an in-ethnicity bias can be reduced by an in-team bias caused by the membership in a mixed-ethnicity team. However, the neural correlates of different in-group biases are still not clear, especially regarding possible cultural differences. A total of 44 participants (20 Chinese and 24 Germans) were recruited and completed a social categorization fMRI-task, categorizing faces according to their ethnicity and a learned team membership. Our behavioral results revealed both in-ethnicity and in-team bias in German participants, but not in Chinese participants. Our imaging results, however, showed both biases across all participants, as reflected in increased dorsal medial frontal cortex (MFC) activation for in-ethnicity, as well as in-team categorizations, while activation in ventral MFC was higher for in-ethnicity faces in Chinese participants than in the German participants. Our results highlight the importance of the dorsal MFC for in-group categorization across cultures and suggest that cultures might modulate in-group biases.

An event-related potential investigation of age and sex in face categorization: Participant sex matters

Whether a face is categorized as male or female is influenced by the age of the face. In the present study, Event-Related Potential (ERP) measures were employed to offer insight into the neural correlates indexing the interaction between the age and sex of a face during sex categorization. Thirty-eight young adults (18 male) categorized the sex of young (18-29 years) and older (70-94 years) adult faces as ERP activity was recorded. Amplitude modulation for the P3b was observed in parietal regions. Younger female faces elicited more positive P3b amplitudes than older female faces, a difference that did not occur for male faces. Behavioral performance and P3b modulation also indicated these effects varied between male and female participants. Women responded more slowly and with less accuracy to older female faces compared to male and young female faces, a pattern of results mirrored by P3b latency. These findings indicate that later-occurring ERP components, such as the P3b, signal the intersection of multiple social categories during face processing suggesting that the evaluation of ingroup/outgroup membership related to age is enhanced for young women, but not for young men.

Face perception: A brief journey through recent discoveries and current directions

Faces are a rich source of information about the people around us. Identity, state of mind, emotions, intentions, age, gender, ethnic background, attractiveness and a host of other attributes about an individual can be gleaned from a face. When face perception fails, dramatic psycho-social consequences can follow at the individual level, as in the case of prosopagnosic parents who are unable to recognize their children at school pick-up. At the species level, social interaction patterns are shaped by human face perception abilities. The computational feat of recognizing faces and facial attributes, and the challenges overcome by the human brain to achieve this feat, have fascinated generations of vision researchers. In this paper, we present a brief overview of some of the milestones of discovery as well as outline a selected set of current directions and open questions on this topic.

Perceptual experience shapes our ability to categorize faces by national origin: A new other-race effect

People are better at recognizing own-race than other-race faces. This other-race effect has been argued to be the result of perceptual expertise, whereby face-specific perceptual mechanisms are tuned through experience. We designed new tasks to determine whether other-race effects extend to categorizing faces by national origin. We began by selecting sets of face stimuli for these tasks that are typical in appearance for each of six nations (three Caucasian, three Asian) according to people from those nations (Study 1). Caucasian and Asian participants then categorized these faces by national origin (Study 2). Own-race faces were categorized more accurately than other-race faces. In contrast, Asian American participants, with more extensive other-race experience than the first Asian group, categorized other-race faces better than own-race faces, demonstrating a reversal of the other-race effect. Therefore, other-race effects extend to the ability to categorize faces by national origin, but only if participants have greater perceptual experience with own-race, than other-race faces. Study 3 ruled out non-perceptual accounts by showing that Caucasian and Asian faces were sorted more accurately by own-race than other-race participants, even in a sorting task without any explicit labelling required. Together, our results demonstrate a new other-race effect in sensitivity to national origin of faces that is linked to perceptual expertise.

Person identification from aerial footage by a remote-controlled drone

Remote-controlled aerial drones (or unmanned aerial vehicles; UAVs) are employed for surveillance by the military and police, which suggests that drone-captured footage might provide sufficient information for person identification. This study demonstrates that person identification from drone-captured images is poor when targets are unfamiliar (Experiment 1), when targets are familiar and the number of possible identities is restricted by context (Experiment 2), and when moving footage is employed (Experiment 3). Person information such as sex, race and age is also difficult to access from drone-captured footage (Experiment 4). These findings suggest that such footage provides a particularly poor medium for person identification. This is likely to reflect the sub-optimal quality of such footage, which is subject to factors such as the height and velocity at which drones fly, viewing distance, unfavourable vantage points, and ambient conditions.

The Role of Spatial Frequency Information in Face Classification by Race

It was found that face classification by race is more quickly for other-race than own-race faces (other-race classification advantage, ORCA). Controlling the spatial frequencies of face images, the current study investigated the perceptual processing differences based on spatial frequencies between own-race and other-race faces that might account for the ORCA. Regardless of the races of the observers, the own-race faces were classified faster and more accurately for broad-band faces than for both lower and higher spatial frequency (SF) faces, whereas, although other-race faces were classified less accurately for higher SF than for either broad-band or lower SF faces, there was no difference between broad-band and lower SF conditions of other-race faces. Although it was not evident for higher SF condition, the ORCA was more evident for lower SF than that for broad-band faces. The present data indicate that global/configural information is needed for subordinate race categorization of faces and that an important source of ORCA is application of global/configural computations by default while categorizing an own-race face but not while categorizing an other-race face.

Social Categorization From Faces: Evidence From Obvious and Ambiguous Groups

People use facial features (e.g., face shape, skin color, eye structure) both in isolation and in combination to identify others as members of a variety of social categories. For some categories (e.g., age, race, and sex), the markers are obvious and people categorize their members almost perfectly. For others, however (e.g., political affiliation, religious following, and sexual orientation), the markers are ambiguous, yet people can still categorize members of these groups with better than chance accuracy and little effort or awareness. Here, we describe how people categorize others into both perceptually obvious and perceptually ambiguous social groups from their faces, discussing potential mechanisms that may underlie categorization accuracy and noting some of the social consequences that result from categorizing other people into groups.

Cognitive control, attention, and the other race effect in memory

People are better at remembering faces from their own race than other races–a phenomenon with significant societal implications. This Other Race Effect (ORE) in memory could arise from different attentional allocation to, and cognitive control over, same- and other-race faces during encoding. Deeper or more differentiated processing of same-race faces could yield more robust representations of same- vs. other-race faces that could support better recognition memory. Conversely, to the extent that other-race faces may be characterized by lower perceptual expertise, attention and cognitive control may be more important for successful encoding of robust, distinct representations of these stimuli. We tested a mechanistic model in which successful encoding of same- and other-race faces, indexed by subsequent memory performance, is differentially predicted by (a) engagement of frontoparietal networks subserving top-down attention and cognitive control, and (b) interactions between frontoparietal networks and fusiform cortex face processing. European American (EA) and African American (AA) participants underwent fMRI while intentionally encoding EA and AA faces, and ~24 hrs later performed an “old/new” recognition memory task. Univariate analyses revealed greater engagement of frontoparietal top-down attention and cognitive control networks during encoding for same- vs. other-race faces, stemming particularly from a failure to engage the cognitive control network during processing of other-race faces that were subsequently forgotten. Psychophysiological interaction (PPI) analyses further revealed that OREs were characterized by greater functional interaction between medial intraparietal sulcus, a component of the top-down attention network, and fusiform cortex during same- than other-race face encoding. Together, these results suggest that group-based face memory biases at least partially stem from differential allocation of cognitive control and top-down attention during encoding, such that same-race memory benefits from elevated top-down attentional engagement with face processing regions; conversely, reduced recruitment of cognitive control circuitry appears more predictive of memory failure when encoding out-group faces.

Why are faces denser in the visual experiences of younger than older infants?

Recent evidence from studies using head cameras suggests that the frequency of faces directly in front of infants declines over the first year and a half of life, a result that has implications for the development of and evolutionary constraints on face processing. Two experiments tested 2 opposing hypotheses about this observed age-related decline in the frequency of faces in infant views. By the people-input hypothesis, there are more faces in view for younger infants because people are more often physically in front of younger than older infants. This hypothesis predicts that not just faces but views of other body parts will decline with age. By the face-input hypothesis, the decline is strictly about faces, not people or other body parts in general. Two experiments, 1 using a time-sampling method (84 infants, 3 to 24 months in age) and the other analyses of head camera images (36 infants, 1 to 24 months) provide strong support for the face-input hypothesis. The results suggest developmental constraints on the environment that ensure faces are prevalent early in development. (PsycINFO Database Record

Interference among the Processing of Facial Emotion, Face Race, and Face Gender

People can process multiple dimensions of facial properties simultaneously. Facial processing models are based on the processing of facial properties. The current study examined the processing of facial emotion, face race, and face gender using categorization tasks. The same set of Chinese, White and Black faces, each posing a neutral, happy or angry expression, was used in three experiments. Facial emotion interacted with face race in all the tasks. The interaction of face race and face gender was found in the race and gender categorization tasks, whereas the interaction of facial emotion and face gender was significant in the emotion and gender categorization tasks. These results provided evidence for a symmetric interaction between variant facial properties (emotion) and invariant facial properties (race and gender).

The Role of Configural Processing in Face Classification by Race: An ERP Study

The current study investigated the time course of the other-race classification advantage (ORCA) in the subordinate classification of normally configured faces and distorted faces by race. Slightly distorting the face configuration delayed the categorization of own-race faces and had no conspicuous effects on other-race faces. The N170 was sensitive neither to configural distortions nor to faces' races. The P3 was enhanced for other-race than own-race faces and reduced by configural manipulation only for own-race faces. We suggest that the source of ORCA is the configural analysis applied by default while processing own-race faces.

The Faces in Infant-Perspective Scenes Change over the First Year of Life

Mature face perception has its origins in the face experiences of infants. However, little is known about the basic statistics of faces in early visual environments. We used head cameras to capture and analyze over 72,000 infant-perspective scenes from 22 infants aged 1-11 months as they engaged in daily activities. The frequency of faces in these scenes declined markedly with age: for the youngest infants, faces were present 15 minutes in every waking hour but only 5 minutes for the oldest infants. In general, the available faces were well characterized by three properties: (1) they belonged to relatively few individuals; (2) they were close and visually large; and (3) they presented views showing both eyes. These three properties most strongly characterized the face corpora of our youngest infants and constitute environmental constraints on the early development of the visual system.

Stimulus set size modulates the sex-emotion interaction in face categorization

Previous research has shown that invariant facial features-for example, sex-and variant facial features-for example, emotional expressions-interact during face categorization. The nature of this interaction is a matter of dispute, however, and has been reported as either asymmetrical, such that sex cues influence emotion perception but emotional expressions do not affect the perception of sex, or symmetrical, such that sex and emotion cues each reciprocally influence the categorization of the other. In the present research, we identified stimulus set size as the critical factor leading to this disparity. Using faces drawn from different databases, in two separate experiments we replicated the finding of a symmetrical interaction between face sex and emotional expression when larger sets of posers were used. Using a subset of four posers, in the same setups, however, did not provide evidence for a symmetrical interaction, which is also consistent with prior research. This pattern of results suggests that different strategies may be used to categorize aspects of faces that are encountered repeatedly.

The role of featural processing in other-race face classification advantage: an ERP study

The current study investigated the time course of the other-race advantage (ORCA) in the subordinate classification of faces and isolated eyes by race. A significant ORCA was found on RTs to both full faces and isolated eyes and faces were classified faster and more accurate than eyes. The ERP data showed that for both stimuli the categorization processes follow basic level classification of physiognomic stimuli, which is not influenced by the stimulus race. The most conspicuous difference between own-race and other-race stimuli as well as between faces and isolated eyes was found in the modulation of the P3 component. The overall pattern of these modulations suggests that the classification of own-race faces is delayed. Since the amplitude of the P3 is sensitive primarily to the perceptual demands of a task, these data suggest that the delay of the own-race classification is caused by an own-race specific process that precedes or interferes with the subordinate classification.

Neural Trade-Offs between Recognizing and Categorizing Own- and Other-Race Faces

Behavioral research has suggested a trade-off relationship between individual recognition and race categorization of own- and other-race faces, which is an important behavioral marker of face processing expertise. However, little is known about the neural mechanisms underlying this trade-off. Using functional magnetic resonance imaging (fMRI) methodology, we concurrently asked participants to recognize and categorize own- and other-race faces to examine the neural correlates of this trade-off relationship. We found that for other-race faces, the fusiform face area (FFA) and occipital face area (OFA) responded more to recognition than categorization, whereas for own-race faces, the responses were equal for the 2 tasks. The right superior temporal sulcus (STS) responses were the opposite to those of the FFA and OFA. Further, recognition enhanced the functional connectivity from the right FFA to the right STS, whereas categorization enhanced the functional connectivity from the right OFA to the right STS. The modulatory effects of these 2 couplings were negatively correlated. Our findings suggested that within the core face processing network, although recognizing and categorizing own- and other-race faces activated the same neural substrates, there existed neural trade-offs whereby their activations and functional connectivities were modulated by face race type and task demand due to one's differential processing expertise with own- and other-race faces.

Toward a unified model of face and object recognition in the human visual system

Our understanding of the mechanisms and neural substrates underlying visual recognition has made considerable progress over the past 30 years. During this period, accumulating evidence has led many scientists to conclude that objects and faces are recognised in fundamentally distinct ways, and in fundamentally distinct cortical areas. In the psychological literature, in particular, this dissociation has led to a palpable disconnect between theories of how we process and represent the two classes of object. This paper follows a trend in part of the recognition literature to try to reconcile what we know about these two forms of recognition by considering the effects of learning. Taking a widely accepted, self-organizing model of object recognition, this paper explains how such a system is affected by repeated exposure to specific stimulus classes. In so doing, it explains how many aspects of recognition generally regarded as unusual to faces (holistic processing, configural processing, sensitivity to inversion, the other-race effect, the prototype effect, etc.) are emergent properties of category-specific learning within such a system. Overall, the paper describes how a single model of recognition learning can and does produce the seemingly very different types of representation associated with faces and objects.

Visual search for faces by race: a cross-race study

Using a single averaged face of each race previous study indicated that the detection of one other-race face among own-race faces background was faster than vice versa (Levin, 1996, 2000). However, employing a variable mapping of face pictures one recent report found preferential detection of own-race faces vs. other-race faces (Lipp et al., 2009). Using the well-controlled design and a heterogeneous set of real face images, in the present study we explored the visual search for own and other race faces in Chinese and Caucasian participants. Across both groups, the search for a face of one race among other-race faces was serial and self-terminating. In Chinese participants, the search consistently faster for other-race than own-race faces, irrespective of upright or upside-down condition; however, this search asymmetry was not evident in Caucasian participants. These characteristics suggested that the race of a face is not a visual basic feature, and in Chinese participants the faster search for other-race than own-race faces also reflects perceptual factors. The possible mechanism underlying other-race search effects was discussed.

The role of features and configural processing in face-race classification

We explored perceptual factors that might account for the other-race classification advantage (ORCA) in classifying faces by race. Testing Chinese participants in China and Israeli participants in Israel we show that: (a) The distinction between Chinese and Israeli faces is highly accurate even on the basis of isolated eyes or faces with eyes concealed, but full faces are categorized faster. (b) The ORCA is similarly robust for full faces and for face parts. (c) The ORCA was larger when the configuration of the inner-face components was distorted, reflecting delayed categorization of own-race distorted faces relative to own-race normally configured faces but no conspicuous distortion effect on other-race faces. These data demonstrate that perceptual factors can account for the ORCA independently of social bias. We suggest that one source of the ORCA in race categorization is the configural analysis applied by default while processing own-race but not other-race faces.

The other face of the other-race effect: an fMRI investigation of the other-race face categorization advantage

The present study was the first to use the functional magnetic resonance imaging (fMRI) methodology to investigate the neural correlates of race categorization of own- and other-race faces. We found that Chinese participants categorized the race of Caucasian faces more accurately and faster than that of Chinese faces, replicating the robust effect of the other-race categorization advantage. Regions of interest (ROI) analyses revealed greater neural activations when participants were categorizing own-race faces than other-race faces in the bilateral ventral occipito-temporal cortex (VOT) such as the fusiform face areas (FFAs) and the occipital face areas (OFAs). Within the left FFA, there was also a significant negative correlation between the behavioral difference of own- and other-race face categorization accuracy and the activation difference between categorizing own- and other-race faces. Whole brain analyses showed that categorizing own-race faces induced greater activations in the right medial frontal cortex (MFC) and right inferior frontal gyrus (IFG) than categorizing other-race faces. Psychophysiological interaction (PPI) analyses revealed that the frontal cortical regions interacted more strongly with the posterior VOT during the categorization of own-race faces than that of other-race faces. Overall, our findings suggest that relative to the categorization of other-race faces, more cortical resources are engaged during the categorization of own-race faces with which we have a higher level of processing expertise. This increased involvement of cortical neural sources perhaps serves to provide more in-depth processing of own-race faces (such as individuation), which in turn paradoxically results in the behavioral other-race categorization advantage.

Face-sensitive processes one hundred milliseconds after picture onset

The human face is the most studied object category in visual neuroscience. In a quest for markers of face processing, event-related potential (ERP) studies have debated whether two peaks of activity – P1 and N170 – are category-selective. Whilst most studies have used photographs of unaltered images of faces, others have used cropped faces in an attempt to reduce the influence of features surrounding the “face–object” sensu stricto. However, results from studies comparing cropped faces with unaltered objects from other categories are inconsistent with results from studies comparing whole faces and objects. Here, we recorded ERPs elicited by full front views of faces and cars, either unaltered or cropped. We found that cropping artificially enhanced the N170 whereas it did not significantly modulate P1. In a second experiment, we compared faces and butterflies, either unaltered or cropped, matched for size and luminance across conditions, and within a narrow contrast bracket. Results of Experiment 2 replicated the main findings of Experiment 1. We then used face–car morphs in a third experiment to manipulate the perceived face-likeness of stimuli (100% face, 70% face and 30% car, 30% face and 70% car, or 100% car) and the N170 failed to differentiate between faces and cars. Critically, in all three experiments, P1 amplitude was modulated in a face-sensitive fashion independent of cropping or morphing. Therefore, P1 is a reliable event sensitive to face processing as early as 100 ms after picture onset.

Perception and Motivation in Face Recognition

Although humans possess well-developed face processing expertise, face processing is nevertheless subject to a variety of biases. Perhaps the best known of these biases is the Cross-Race Effect—the tendency to have more accurate recognition for same-race than cross-race faces. The current work reviews the evidence for and provides a critical review of theories of the Cross-Race Effect, including perceptual expertise and social cognitive accounts of the bias. The authors conclude that recent hybrid models of the Cross-Race Effect, which combine elements of both perceptual expertise and social cognitive frameworks, provide an opportunity for theoretical synthesis and advancement not afforded by independent expertise or social cognitive models. Finally, the authors suggest future research directions intended to further develop a comprehensive and integrative understanding of biases in face recognition.

Training with own-race faces can improve processing of other-race faces: evidence from developmental prosopagnosia

Faces of one's own race are discriminated and recognized more accurately than faces of an other race (other-race effect - ORE). Studies have employed several methods to enhance individuation and recognition of other-race faces and reduce the ORE, including intensive perceptual training with other-race faces and explicitly instructing participants to individuate other-race faces. Unfortunately, intensive perceptual training has shown to be specific to the race trained and the use of explicit individuation strategies, though applicable to all races, can be demanding of attention and difficult to consistently employ. It has not yet been demonstrated that a training procedure can foster the automatic individuation of all other-race faces, not just faces from the race trained. Anecdotal evidence from a training procedure used with developmental prosopagnosics (DPs) in our lab, individuals with lifelong face recognition impairments, suggests that this may be possible. To further test this idea, we had five Caucasian DPs perform ten days of configural face training (i.e. attending to small spacing differences between facial features) with own-race (Caucasian) faces to see if training would generalize to improvements with other-race (Korean) faces. To assess training effects and localize potential effects to parts-based or holistic processing, we used the part-whole task using Caucasian and Korean faces (Tanaka, J. W., Kiefer, M., & Bukach, C. M. (2004). A holistic account of the own-race effect in face recognition: evidence from a cross-cultural study. Cognition, 93(1), B1-9). Results demonstrated that after training, DPs showed a disproportionate improvement in holistic processing of other-race faces compared to own-race faces, reducing their ORE. This suggests that configural training with own-race faces boosted DPs' general configural/holistic attentional resources, which they were able to apply to other-race faces. This provides a novel method to reduce the ORE and supports more of an attentional/social-cognitive model of the ORE rather than a strictly expertise model.

Own-species bias in the representations of monkey and human face categories in the primate temporal lobe

Face categorization is fundamental for social interactions of primates and is crucial for determining conspecific groups and mate choice. Current evidence suggests that faces are processed by a set of well-defined brain areas. What is the fine structure of this representation, and how is it affected by visual experience? Here, we investigated the neural representations of human and monkey face categories using realistic three-dimensional morphed faces that spanned the continuum between the two species. We found an "own-species" bias in the categorical representation of human and monkey faces in the monkey inferior temporal cortex at the level of single neurons as well as in the population response analyzed using a pattern classifier. For monkey and human subjects, we also found consistent psychophysical evidence indicative of an own-species bias in face perception. For both behavioural and neural data, the species boundary was shifted away from the center of the morph continuum, for each species toward their own face category. This shift may reflect visual expertise for members of one's own species and be a signature of greater brain resources assigned to the processing of privileged categories. Such boundary shifts may thus serve as sensitive and robust indicators of encoding strength for categories of interest.

Young without plastic surgery: perceptual adaptation to the age of female and male faces

Adaptation influences perception not only of simple stimulus qualities such as motion or colour, but also of complex stimuli such as faces. Here we demonstrate contrasting aftereffects of adaptation to facial age. In Experiment 1, participants adapted to either young or old faces, and subsequently estimated the age of morphed test faces with interpolated ages of 30, 40, 50 or 60 years. Following adaptation to old adaptors, test faces were classified as much younger when compared to classifications of the same test faces following adaptation to young faces, which in turn caused subjective test face "aging". These aftereffects were reduced but remained clear even when facial gender changed between adaptor and test faces. In Experiment 2, we induced simultaneous opposite age aftereffects for female and male faces. Overall, these results demonstrate interactions in the perception of facial age and gender, and support dissociable neuronal coding of male and female faces.

Stimulus type, level of categorization, and spatial-frequencies utilization: implications for perceptual categorization hierarchies

The type of visual information needed for categorizing faces and nonface objects was investigated by manipulating spatial frequency scales available in the image during a category verification task addressing basic and subordinate levels. Spatial filtering had opposite effects on faces and airplanes that were modulated by categorization level. The absence of low frequencies impaired the categorization of faces similarly at both levels, whereas the absence of high frequencies was inconsequential throughout. In contrast, basic-level categorization of airplanes was equally impaired by the absence of either low or high frequencies, whereas at the subordinate level, the absence of high frequencies had more deleterious effects. These data suggest that categorization of faces either at the basic level or by race is based primarily on their global shape but also on the configuration of details. By contrast, basic-level categorization of objects is based on their global shape, whereas category-specific diagnostic details determine the information needed for their subordinate categorization. The authors conclude that the entry point in visual recognition is flexible and determined conjointly by the stimulus category and the level of categorization, which reflects the observer's recognition goal.