The other-race effect for face perception: an event-related potential study

The role of leadership level in college students' facial emotion recognition: evidence from event-related potential analysis

While the role of emotion in leadership practice is well-acknowledged, there is still a lack of clarity regarding the behavioral distinctions between individuals with varying levels of leadership and the underlying neurocognitive mechanisms at play. This study utilizes facial emotion recognition in conjunction with electroencephalograms to explore the temporal dynamics of facial emotion recognition processes among college students with high and low levels of leadership. The results showed no significant differences in the amplitude of P1 during the early stage of facial emotion recognition between the two groups. In the middle stage of facial emotion recognition, the main effect of group was significant on the N170 component, with higher N170 amplitude evoked in high-leadership students than low-leadership students. In the late stage of facial emotion recognition, low-leadership students evoked greater LPP amplitude in the temporal-parietal lobe when recognizing happy facial emotions compared to high-leadership students. In addition, time-frequency results revealed a difference in the alpha frequency band, with high-leadership students exhibiting lower alpha power than low-leadership students. The results suggest differences in the brain temporal courses of facial emotion recognition between students with different leadership levels, which are mainly manifested in the middle stage of structural encoding and the late stage of delicate emotional processing during facial emotion recognition.

Face motion form at learning influences the time course of face spatial frequency processing during test

Studies that use static faces suggest that facial processing follows a coarse-to-fine sequence; i.e., holistic precedes featural processing, due to low and high spatial frequencies (LSF, HSF) transmitting holistic/global and featural/local information respectively. Although recent studies have focused on the role of facial movement in holistic facial processing, it is unclear whether moving faces have the same processing mechanism as static ones, especially in the time course of processing. The current study uses the event-related potential technique to investigate this issue by manipulating the facial format at study and face spatial frequency during the test. ERP results showed that the P1 amplitude was increased by LSF faces relative to HSF ones, using both moving and static study faces, with the former larger than the latter. The N170 amplitude was more sensitive to HSF than LSF faces when only static study faces were used, while the P2 amplitude was more sensitive to LSF faces regardless of the facial study format. The above results were not modulated by the race of the faces. These results favor the view that regardless of face race, moving study faces promote holistic processing during the earliest stage of face recognition. Furthermore, holistic processing is observed to be the same for both static and moving study faces at a later stage associated with more in-depth processing. It is evident that facial motion should be factored into further studies of face recognition, given the distinctions between holistic and featural processing for moving and static study faces.

Beyond facial expressions: A systematic review on effects of emotional relevance of faces on the N170

The N170 is the most prominent electrophysiological signature of face processing. While facial expressions reliably modulate the N170, there is considerable variance in N170 modulations by other sources of emotional relevance. Therefore, we systematically review and discuss this research area using different methods to manipulate the emotional relevance of inherently neutral faces. These methods were categorized into (1) existing pre-experimental affective person knowledge (e.g., negative attitudes towards outgroup faces), (2) experimentally instructed affective person knowledge (e.g., negative person information), (3) contingency-based affective learning (e.g., fear-conditioning), or (4) the immediate affective context (e.g., emotional information directly preceding the face presentation). For all categories except the immediate affective context category, the majority of studies reported significantly increased N170 amplitudes depending on the emotional relevance of faces. Furthermore, the potentiated N170 was observed across different attention conditions, supporting the role of the emotional relevance of faces on the early prioritized processing of configural facial information, regardless of low-level differences. However, we identified several open research questions and suggest venues for further research.

Understanding racial bias through electroencephalography

Research on racial bias in social and cognitive psychology has focused on automatic cognitive processes such as categorisation or stereotyping. Neuroimaging has revealed differences in the neural circuit when processing social information about one's own or another's ethnicity. This review investigates the influence of racial bias on human behaviour by reviewing studies that examined changes in neural circuitry (i.e. ERP responses) during automatic and controlled processes elicited by specific tasks. This systematic analysis of specific ERP components across different studies provides a greater understanding of how social contexts are perceived and become associated with specific stereotypes and behavioural predictions. Therefore, investigating these related cognitive and neurobiological functions can further our understanding of how racial bias affects our cognition more generally and guide more effective programs and policies aimed at its mitigation.

Race and early face-sensitive event-related potentials in children and adults

Studies examining children's face perception have revealed developmental changes in early and face-sensitive event-related potential (ERP) components. Children also tend to show racial biases in their face perception and evaluation of others. The current study examined how early face-sensitive ERPs are influenced by face race in children and adults. A second objective examined face recognition proficiency and implicit racial bias in relation to ERP responses to own- and other-race faces. Electroencephalographic responses were recorded while Caucasian children and adults viewed Caucasian and East Asian faces. Participants also completed recognition tasks and an IAT with Caucasian and East Asian faces. Other-race faces elicited larger P100 amplitudes than own-race faces. Furthermore, adults with better other-race recognition proficiency showed larger P100 amplitude responses to other-race faces compared with adults with worse other-race recognition proficiency. In addition, larger implicit biases favoring own-race individuals were associated with larger P100 to N170 peak-to-peak amplitudes for other-race faces in adults. In contrast, larger implicit biases favoring own-race individuals were associated with smaller P100 to N170 peak-to-peak amplitudes for both own- and other-race faces in 8- to 10-year-olds. There was also an age-related decrease in P100 to N170 peak-to-peak amplitudes for own-race faces among 5- to 10-year-olds with better own-race recognition proficiency. The age-related decrease in N170 latency for other-race faces was also more pronounced in 5- to 10-year-olds with better other-race recognition proficiency. Thus, recognition proficiency and implicit racial bias are associated with early ERP responses in adults and children, but in different ways.

Mental health stigma and emotional face processing: An ERP study

This study takes the first step toward developing an event-related potential (ERP) measure of bias toward people with mental illnesses. We recorded participants' EEGs while they viewed happy and angry faces; they were told half of the people in the photos were mentally healthy while the other half had a diagnosis of schizophrenia, which was indicated by the color of the frame around each face. Afterward, participants rated how dangerous each face looked to them. Participants rated faces with the schizophrenia designation as more dangerous than those designated as mentally healthy. There were significant interactions between facial expression and mental health label for both the early N170 and later P3 amplitudes. Angry expressions elicited larger N170s than happy ones, but only for faces with the schizophrenia label. Thus, angry faces with the schizophrenia designation appeared to be particularly salient and automatically grabbed our participants' attention, at least initially. In contrast, happy faces with the schizophrenia label elicited larger P3s than those with the mentally healthy designation. This finding suggests that later attentional processes were recruited more when someone with a diagnosis of schizophrenia looked happy, perhaps indicating that participants found this surprising.

Similar use of shape and texture cues for own- and other-race faces during face learning and recognition

Although the other-race effect (ORE; superior recognition of own- relative to other-race faces) is well established, the mechanisms underlying it are not well understood. We examined whether the ORE is attributable to differential use of shape and texture cues for own- vs. other-race faces. Shape cues are particularly important for detecting that an own-race face is unfamiliar, whereas texture cues are more important for recognizing familiar and newly learned own-race faces. We compared the influence of shape and texture cues on Caucasian participants' recognition of Caucasian and East Asian faces using two complementary approaches. In Experiment 1, participants studied veridical, shape-caricatured, or texture-caricatured faces and then were asked to recognize them in an old/new recognition task. In Experiment 2, all study faces were veridical and we independently removed the diagnosticity of shape (or texture) cues in the test phase by replacing original shape (or texture) with average shape (or texture). Despite an overall own-race advantage, participants' use of shape and texture cues was comparable for own- and other-race faces. These results suggest that the other-race effect is not attributable to qualitative differences in the use of shape and texture cues.

Electrophysiological correlates of unconscious processes of race

The study aimed to examine the neural mechanisms underlying implicit other-race face processing by the use of the masked and unmasked priming manipulation. Two types of prime-target pairs were presented while recording Event-related potentials (ERPs): Same face pairs (prime-target were identical faces), and Different face pairs (prime-target were different faces). Prime-target pairs were half Asian (other-race) and half Caucasian (own-race) faces. The face stimuli on each pair were of the same gender and race. Participants (all Caucasians) had to decide whether the target was a male or a female face (gender task). The prime face could be unmasked or masked. On the behavioral side, our findings showed a race effect, that is slower reaction times (RTs) for other-race than own-race face stimuli, regardless of masking. On the ERPs side, our data showed a race effect across all components analyzed (P100, N100, N200, P300), under both the unmasked and masked manipulations. Besides, we found, in the unmasked condition, a priming effect as a function of race on the N100, N200, and P300 components; but, interestingly, in the masked condition, only on the P300. Overall, our findings provide evidence that race information is available very early in the brain and can strongly activate and influence people's behaviors even without conscious awareness.

Enhanced N170 to outgroup faces: Perceptual novelty or prejudice?

Habituation to ethnic ingroup members has been reported to be greater than to ethnic outgroup members. This pattern could be due to the lack of perceptive experience (familiarity) with outgroup facial morphs or, alternatively, to the prejudice held toward that outgroup. We explored this disjunctive in 71 participants, all Spanish, who were experimentally habituated to faces from their Ingroup and to faces from two unfamiliar outgroups, one for which there is low probability of prejudice in this population (Non-prejudiced Outgroup), and one for which the probability of prejudice is higher (Prejudiced Outgroup). We indexed habituation through event-related potentials, concretely as the differential amplitude of the face-sensitive N170 component from Initial to Final trials of each group. Afterward, participants completed several prejudice measures. N170 showed significant habituation to all faces, though it did not differ among groups. However, a regression analysis revealed that individual habituation to the Outgroup faces was inversely related to implicit prejudice scores. Importantly, N170 amplitudes were maximal for the Prejudiced Outgroup in both Initial and Final trials. We conclude that these effects are explained by the prejudice held toward a specific outgroup rather than perceptive experience.

Sex Differences in the Motivation for Viewing Sexually Arousing Images

Sexual motivation strongly influences mate choice and dating behavior and can be triggered by merely viewing sexually arousing visual images, such as erotic pictures and movies. Previous studies suggested that men, more than women, tend to search for sexual cues that signal promiscuity in short-term mates. However, it remains to be tested whether sex differences in the motivation to view sexual cues can be observed by using robust and well-controlled behavioral measures. To this end, we employed a pay-per-view key-pressing task. Japanese self-identified heterosexual male and female participants viewed images of men, women, or couples with two levels of sexual arousal (sexual vs. less sexual). Participants could alter the viewing time of a presented image according to their willingness to keep viewing it. Male participants were the most eager to view sexually arousing images of the opposite sex, whereas female participants were more strongly motivated to view less sexual images of couples. Such sex differences may reflect differentiated reproductive strategies between men and women in terms of men’s motivation toward promiscuity and women’s motivation toward long-term relationships.

Do perceptual expertise and implicit racial bias predict early face-sensitive ERP responses?

Studies examining the visual perception of face race have revealed mixed findings regarding the presence or direction of effects on early face-sensitive event-related potential (ERP) components. Few studies have examined how early ERP components are influenced by individual differences in bottom-up and top-down processes involved in face perception, and how such factors might interact to influence early face-sensitive ERP components has yet to be investigated. Thus, the current study examined whether P100, N170, and P200 responses can be predicted by individual differences in own- and other-race face recognition, implicit racial bias, and their interaction. Race effects were observed in the P100, N170, and P200 responses. Other-race face recognition, implicit racial biases, and their interaction explained a significant amount of unique variability in N170 responses when viewing other-race faces. Responses to own-race faces were minimally influenced with only implicit racial bias predicting a significant amount of unique variability in N170 latency when viewing own-race faces. Face recognition, implicit racial bias, or their interaction did not predict P100 responses. The current findings suggest that face recognition abilities and its interaction with implicit racial bias modulate the early stages of other-race face processing.

Explicit Categorization Goals Affect Attention-Related Processing of Race and Gender During Person Construal

Faces are categorized by gender and race very quickly, seemingly without regard to perceivers' goals or motivations, suggesting an automaticity to these judgments that has downstream consequences for evaluations, stereotypes, and social interactions. The current study investigated the extent to which early neurocognitive processes involved in the categorization of faces vary when participants' tasks goals were to categorize faces by race or by gender. In contrast to previous findings, task-related differences were found, such that differentiation in the P2 event-related potential (ERP) according to perceived gender was facilitated by having an explicit task goal of categorizing faces by gender; however, the P2 was sensitive to race regardless of task goals. Use of principal components analysis (PCA) revealed two underlying components that comprised the P2 and that were differentially sensitive to the gender and race of the faces, depending on participants' top-down task goals. Results suggest that top-down task demands facilitate discrimination of faces along the attended dimension within less than 200 ms, but that the effect of top-down task demands may not be evident when examining early ERP components that reflect more than one distinct underlying process.

Prejudice drives exogenous attention to outgroups

Exogenous attention allows the automatic detection of relevant stimuli and the reorientation of our current focus of attention towards them. Faces from an ethnic outgroup tend to capture exogenous attention to a greater extent than faces from an ethnic ingroup. We explored whether prejudice toward the outgroup, rather than lack of familiarity, is driving this effect. Participants (N = 76) performed a digit categorization task while distractor faces were presented. Faces belonged to (i) a prejudiced outgroup, (ii) a non-prejudiced outgroup and (iii) their ingroup. Half of the faces were previously habituated in order to increase their familiarity. Reaction times, accuracy and event-related potentials (ERPs) were recorded to index exogenous attention to distractor faces. Additionally, different indexes of explicit and implicit prejudice were measured, the latter being significantly greater towards prejudiced outgroup. N170 amplitude was greater to prejudiced outgroup-regardless of their habituation status-than to both non-prejudiced outgroup and ingroup faces and was associated with implicit prejudice measures. No effects were observed at the behavioral level. Our results show that implicit prejudice, rather than familiarity, is under the observed attention-related N170 effects and that this ERP component may be more sensitive to prejudice than behavioral measures under certain circumstances.

The identification of children with autism spectrum disorder by SVM approach on EEG and eye-tracking data

OBJECTIVE

To identify autistic children, we used features extracted from two modalities (EEG and eye-tracking) as input to a machine learning approach (SVM).

METHODS

A total of 97 children aged from 3 to 6 were enrolled in the present study. After resting-state EEG data recording, the children performed eye-tracking tests individually on own-race and other-race stranger faces stimuli. Power spectrum analysis was used for EEG analysis and areas of interest (AOI) were selected for face gaze analysis of eye-tracking data. The minimum redundancy maximum relevance (MRMR) feature selection method combined with SVM classifiers were used for classification of autistic versus typically developing children.

RESULTS

Results showed that classification accuracy from combining two types of data reached a maximum of 85.44%, with AUC = 0.93, when 32 features were selected.

LIMITATIONS

The sample consisted of children aged from 3 to 6, and no younger patients were included.

CONCLUSIONS

Our machine learning approach, combining EEG and eye-tracking data, may be a useful tool for the identification of children with ASD, and may help for diagnostic processes.

Learning own- and other-race facial identities: Testing implicit recognition with event-related brain potentials

Exposure to varying images of the same person can encourage the formation of a representation that is sufficiently robust to allow recognition of previously unseen images of this person. While behavioural work suggests that face identity learning is harder for other-race faces, the present experiment investigated the neural correlates underlying own- and other-race face learning. Participants sorted own- and other-race identities into separate identity clusters and were further familiarised with these identities in a matching task. Subsequently, we compared event-related brain potentials (ERPs) in an implicit recognition (butterfly detection) task for learnt and previously unseen identities. We observed better sorting and matching for own- than other-race identities, and behavioural learning effects were restricted to own-race identities. Similarly, the N170 ERP component showed clear learning effects for own-race faces only. The N250, a component more closely associated with face learning was more negative for learnt than novel identities. ERP findings thus suggests a processing advantage for own-race identities at an early perceptual level whereas later correlates of identity learning were unaffected by ethnicity. These results suggest learning advantages for own-race identities, which underscores the importance of perceptual expertise in the own-race bias.

Security priming improves attentional processing to infant emotions among insecurely attached women: The different roles of supraliminal and subliminal priming

In two ERP experiments, we examined the attention-related mechanism involved in perceiving infant emotions following exposure to security priming. Specifically, we examined how security priming affected securely and insecurely attached women. We found that both supraliminal and subliminal security priming resulted in increased attention allocation in anxiously and avoidantly attached women but had no effect on securely attached women. Moreover, we also found that supraliminal and subliminal security priming differed in their effectiveness in increasing attention allocation among anxiously and avoidantly attached women. Supraliminal security priming were more effective for anxiously attached women, whereas subliminal security priming were more effective for avoidantly attached women. The implications of these findings and directions for future research are discussed.

Grappling With Implicit Social Bias: A Perspective From Memory Research

There is now widespread consensus that social biases often influence actions independently of the actor's intention or awareness. The notion that we are sometimes blind to the origins of our thoughts, attitudes, and behaviors also features prominently in research into domain-general human memory systems, which has a long history of distinguishing between implicit and explicit repercussions of past experience. A shared challenge across these fields of study is thus to identify techniques for effectively managing the contents of our memory stores, particularly those aspects into which we have limited metacognitive insight. In the present review, we examine recent developments in the cognitive neuroscience of human memory that speak to this challenge as it applies to the social domain. One area of progress pertains to the role of individuation, the process of attending to and representing in memory unique characteristics of individuals, which can limit the influence of generalizations based on social categories. A second body of work concerns breakthroughs in understanding memory consolidation, which determines the fate of newly encoded memories. We discuss the promise of each of these developments for identifying ways to become better stewards of our social minds. More generally, we suggest that, as with other forms of learning and memory, intentional practice and rehearsal may be critical in learning to minimize unwanted biases.

Using spatial frequency scales for processing own-race and other-race faces: An ERP analysis

In the present study we examined the influence of spatial filtering on the N170 elicited by own-race and other-race faces, a relatively early face-selective ERP difference associated with face detection. It was found that BB (broad band) faces elicited larger N170 than did LSF (low spatial frequency) faces and the latter larger than HSF (high spatial frequency) condition. Faces' races significantly modulated the N170 amplitudes, showing larger N170 for other-race than own-race faces for both BB and HSF conditions but not for LSF condition. For own-race faces, the N170 did not differ between BB and LSF conditions, whereas other-race faces elicited larger N170 for BB than LSF conditions. The present data provided new electrophysiological evidence for race perception of faces.

Encoding differences affect the number and precision of own-race versus other-race faces stored in visual working memory

Other-race faces are discriminated and recognized less accurately than own-race faces. Despite a wealth of research characterizing this other-race effect (ORE), little is known about the nature of the representations of own-race versus other-race faces. This is because traditional measures of this ORE provide a binary measure of discrimination or recognition (correct/incorrect), failing to capture potential variation in the quality of face representations. We applied a novel continuous-response paradigm to independently measure the number of own-race and other-race face representations stored in visual working memory (VWM) and the precision with which they are stored. Participants reported target own-race or other-race faces on a circular face space that smoothly varied along the dimension of identity. Using probabilistic mixture modeling, we found that following ample encoding time, the ORE is attributable to differences in the probability of a face being maintained in VWM. Reducing encoding time, a manipulation that is more sensitive to encoding limitations, caused a loss of precision or an increase in variability of VWM for other-race but not own-race faces. These results suggest that the ORE is driven by the inefficiency with which other-race faces are rapidly encoded in VWM and provide novel insights about how perceptual experience influences the representation of own-race and other-race faces in VWM.

Systems Factorial Technology provides new insights on the other-race effect

The other-race effect refers to the difficulty of discriminating between faces from ethnic and racial groups other than one's own. This effect may be caused by a slow, feature-by-feature, analytic process, whereas the discrimination of own-race faces occurs faster and more holistically. However, this distinction has received inconsistent support. To provide a critical test, we employed Systems Factorial Technology (Townsend & Nozawa in Journal of Mathematical Psychology, 39, 321-359, 1995), which is a powerful tool for analyzing the organization of mental networks underlying perceptual processes. We compared Taiwanese participants' face discriminations of both own-race (Taiwanese woman) and other-race (Caucasian woman) faces according to the faces' nose-to-mouth separation and eye-to-eye separation. We found evidence for weak holistic processing (parallel processing) coupled with the strong analytic property of a self-terminating stopping rule for own-race faces, in contrast to strong analytic processing (serial self-terminating processing) for other-race faces, supporting the holistic/analytic hypothesis.

Attention and Working Memory Biases to Black and Asian Faces During Intergroup Contexts

Categorizing and individual as a racial ingroup or outgroup member results in processing and memory differences. However, despite processing differences for racial ingroups and outgroups, very little is known about processing of racial ingroup and outgroup members during intergroup contexts. Thus, the present research investigated attention and memory differences for racial ingroup and outgroup members during competition for attention (i.e., intergroup contexts). In experiment 1, event-related potentials (ERPs) were obtained while participants completed a working memory task that presented 4 faces (2 Black, 2 White) at once then, following a short delay, were probed to indicate the spatial location of one of the faces. Participants showed better location memory for Black than White faces. During encoding, ERP results revealed differences based on the race of the face in P300 amplitudes, such that there was greater motivated processing when attending to Black faces. At probe, the N170 indicated enhanced early processing of Black faces and greater LPCs were associated with better recollection of Black face location. In a follow-up study using the same task, we examined attention and working memory biases for Asian and White faces in Caucasian and Asian participants. Results for both Caucasian and Asian participants indicated better working memory for Asian relative to White faces. Together, results indicate that during intergroup contexts, racial minority faces capture attention, resulting in better memory for those faces. The study underscores that examining racial biases with single stimuli paradigms obscures important aspects of attention and memory biases during intergroup contexts.

The racially diverse affective expression (RADIATE) face stimulus set

Faces are often used in psychological and neuroimaging research to assess perceptual and emotional processes. Most available stimulus sets, however, represent minimal diversity in both race and ethnicity, which may confound understanding of these processes in diverse/racially heterogeneous samples. Having a diverse stimulus set of faces and emotional expressions could mitigate these biases and may also be useful in research that specifically examines the effects of race and ethnicity on perceptual, emotional and social processes. The racially diverse affective expression (RADIATE) face stimulus set is designed to provide an open-access set of 1,721 facial expressions of Black, White, Hispanic and Asian adult models. Moreover, the diversity of this stimulus set reflects census data showing a change in demographics in the United States from a white majority to a nonwhite majority by 2020. Psychometric results are provided describing the initial validity and reliability of the stimuli based on judgments of the emotional expressions.

Ethnic effects when facing children: An ERP study

Abundant research has highlighted a disadvantage experienced by children of ethnic minority groups in, for example, educational and health care settings. In order to understand implicit attitudes that contribute to ethnic disparities, underlying neural correlates have been widely studied. However, this has been limited to the context of adults. Using a sample of nulliparous Caucasian females (N = 46), the current study is the first to examine how early attentional and facial perceptual processing stages, assessed with event-related brain potentials (ERPs), differentiate for stimuli of young ingroup (of the same ethnicity) or outgroup (of a different ethnicity) children. Additionally, we assessed how a differentiation in ERPs may relate to subsequent adult responsiveness to children by measuring both cuteness ratings and motivation to view child faces. Similar to previous findings for adult facial stimuli, we found significant differences in attentional (N200) and facial perceptual (N170) processing when adults were faced with children of different ethnicities. Furthermore, increased differentiation in attentional processing (N200) for ingroup and outgroup children was associated with reduced cuteness ratings of outgroup children. Importantly however, participants showed no overall preference for ingroup child faces, as motivation to view child faces was even greater towards outgroup child faces. In addition, increased self-reported motivation for parental care was related to enhanced cuteness appraisals of outgroup child faces. Taken together, these findings reveal how early social categorization processes may lead to biased behavior when interacting with children of ethnic minorities.

Even subtle cultural differences affect face tuning

Culture shapes social cognition in many ways. Yet cultural impact on face tuning remains largely unclear. Here typically developing females and males from the French-speaking part of Switzerland were presented with a set of Arcimboldo-like Face-n-Food images composed of food ingredients and in different degree resembling a face. The outcome had been compared with previous findings obtained in young adults of the South-West Germany. In that study, males exhibit higher thresholds for face tuning on the Face-n-Food task than females. In Swiss participants, no gender differences exist in face tuning. Strikingly, males from the French-speaking part of Switzerland possess higher sensitivity to faces than their German peers, whereas no difference in face tuning occurs between females. The outcome indicates that even relatively subtle cultural differences as well as culture by gender interaction can modulate social cognition. Clarification of the nature of cultural impact on face tuning as well as social cognition at large is of substantial value for understanding a wide range of neuropsychiatric and neurodevelopmental conditions.

Same-gender distractors are not so easy to reject: ERP evidence of gender categorization

Social categorization appears to be an automatic process that occurs during person perception. Understanding social categorization better is important because mere categorization can lead to stereotype activation and, in turn, to discrimination. In the present study we used a novel approach to examine event-related potentials (ERPs) of gender categorization in the “Who said what?” memory paradigm, thus allowing for a more in-depth understanding of the specific mechanisms underlying identity versus categorization processing. After observing video clips showing a “discussion” among female and male targets, participants were shown individual statements, each accompanied by one of the discussants’ faces. While we measured ERPs, participants had to decide whether or not a given statement had previously been made by the person with the accompanying face. In same-person trials, statements were paired with the correct person, whereas in the distractor trials, either a same-gender or a different-gender distractor was shown. As expected, participants were able to reject different-gender distractors faster than same-gender distractors, and they were more likely to falsely choose yes for a same-gender than for a different-gender distractor. Both findings indicate gender-based categorization. ERPs, analyzed in a 300- to 400-ms time window at occipito-temporal channels, indicated more negative amplitudes for yes responses both for the same person and for same-gender distractors, relative to different-gender distractors. Overall, these results show gender-based categorization even when the task was to assess the identifying information in a gender-neutral context. These findings are interpreted as showing that gender categorization occurs automatically during person perception, but later than race- or age-based categorization.

The special status of sad infant faces: age and valence differences in adults' cortical face processing

Understanding the relative and joint prioritization of age- and valence-related face characteristics in adults’ cortical face processing remains elusive because these two characteristics have not been manipulated in a single study of neural face processing. We used electroencephalography to investigate adults’ P1, N170, P2 and LPP responses to infant and adult faces with happy and sad facial expressions. Viewing infant vs adult faces was associated with significantly larger P1, N170, P2 and LPP responses, with hemisphere and/or participant gender moderating this effect in select cases. Sad faces were associated with significantly larger N170 responses than happy faces. Sad infant faces were associated with significantly larger N170 responses in the right hemisphere than all other combinations of face age and face valence characteristics. We discuss the relative and joint neural prioritization of infant face characteristics and negative facial affect, and their biological value as distinct caregiving and social cues.

Using trial-level data and multilevel modeling to investigate within-task change in event-related potentials

EEG data, and specifically the ERP, provide psychologists with the power to examine quickly occurring cognitive processes at the native temporal resolution at which they occur. Despite the advantages conferred by ERPs to examine processes at different points in time, ERP researchers commonly ignore the trial-to-trial temporal dimension by collapsing across trials of similar types (i.e., the signal averaging approach) because of constraints imposed by repeated measures ANOVA. Here, we present the advantages of using multilevel modeling (MLM) to examine trial-level data to investigate change in neurocognitive processes across the course of an experiment. Two examples are presented to illustrate the usefulness of this technique. The first demonstrates decreasing differentiation in N170 amplitude to faces of different races across the course of a race categorization task. The second demonstrates attenuation of the ERN as participants commit more errors within a task designed to measure implicit racial bias. Although the examples presented here are within the realm of social psychology, the use of MLM to analyze trial-level EEG data has the potential to contribute to a number of different theoretical domains within psychology.

The Impact of Top-Down Prediction on Emotional Face Processing in Social Anxiety

There is evidence that people with social anxiety show abnormal processing of emotional faces. To investigate the impact of top-down prediction on emotional face processing in social anxiety, brain responses of participants with high and low social anxiety (LSA) were recorded, while they performed a variation of the emotional task, using high temporal resolution event-related potential techniques. Behaviorally, we reported an effect of prediction with higher accuracy for predictable than unpredictable faces. Furthermore, we found that participants with high social anxiety (HSA), but not with LSA, recognized angry faces more accurately than happy faces. For the P100 and P200 components, HSA participants showed enhanced brain activity for angry faces compared to happy faces, suggesting a hypervigilance to angry faces. Importantly, HSA participants exhibited larger N170 amplitudes in the right hemisphere electrodes than LSA participants when they observed unpredictable angry faces, but not when the angry faces were predictable. This probably reflects the top-down prediction improving the deficiency at building a holistic face representation in HSA participants.

Adult Attachment Styles Associated with Brain Activity in Response to Infant Faces in Nulliparous Women: An Event-Related Potentials Study

Adult attachment style is a key for understanding emotion regulation and feelings of security in human interactions as well as for the construction of the caregiving system. The caregiving system is a group of representations about affiliative behaviors, which is guided by the caregiver's sensitivity and empathy, and is mature in young adulthood. Appropriate perception and interpretation of infant emotions is a crucial component of the formation of a secure attachment relationship between infant and caregiver. As attachment styles influence the ways in which people perceive emotional information, we examined how different attachment styles associated with brain response to the perception of infant facial expressions in nulliparous females with secure, anxious, and avoidant attachment styles. The event-related potentials of 65 nulliparous females were assessed during a facial recognition task with joy, neutral, and crying infant faces. The results showed that anxiously attached females exhibited larger N170 amplitudes than those with avoidant attachment in response to all infant faces. Regarding the P300 component, securely attached females showed larger amplitudes to all infant faces in comparison with avoidantly attached females. Moreover, anxiously attached females exhibited greater amplitudes than avoidantly attached females to only crying infant faces. In conclusion, the current results provide evidence that attachment style differences are associated with brain responses to the perception of infant faces. Furthermore, these findings further separate the psychological mechanisms underlying the caregiving behavior of those with anxious and avoidant attachment from secure attachment.

The processing of body expressions during emotional scenes: the modulation role of attachment styles

There is broad evidence indicating that contextual information influence the processing of emotional stimuli. However, attachment theory suggests that attachment styles contribute to the ways in which people perceive emotional events. To shed light on whether the processing of body expressions during different emotional scenes is modulated by attachment styles, attachment-related electrophysiological differences were measured using event-related potentials. For avoidantly attached group, our results suggested that larger N170 amplitudes were educed by neutral bodies than angry bodies, which was found only in neutral scene. Moreover, significant differences were found in P300 amplitudes in response to angry bodies compared with neutral ones only during angry scene. However, securely and anxiously attached individuals were associated with larger P300 amplitudes in response to angry bodies versus neutral ones in both emotional scenes. The current study highlights the characteristics of cognitive processing of attachment styles on body expressions during different emotional scenes, with the variation of N170 and P300 amplitude in different emotional scenes as the best example.

The Effects of Face Inversion and Face Race on the P100 ERP

Research about the neural basis of face recognition has investigated the timing and anatomical substrates of different stages of face processing. Scalp-recorded ERP studies of face processing have focused on the N170, an ERP with a peak latency of ∼170 msec that has long been associated with the initial structural encoding of faces. However, several studies have reported earlier ERP differences related to faces, suggesting that face-specific processes might occur before N170. Here, we examined the influence of face inversion and face race on the timing of face-sensitive scalp-recorded ERPs by examining neural responses to upright and inverted line-drawn and luminance-matched white and black faces in a sample of white participants. We found that the P100 ERP evoked by inverted faces was significantly larger than that evoked by upright faces. Although this inversion effect was statistically significant at 100 msec, the inverted-upright ERP difference peaked at 138 msec, suggesting that it might represent an activity in neural sources that overlap with P100. Inverse modeling of the inversion effect difference waveform suggested possible neural sources in pericalcarine extrastriate visual cortex and lateral occipito-temporal cortex. We also found that the inversion effect difference wave was larger for white faces. These results are consistent with behavioral evidence that individuals process the faces of their own races more configurally than faces of other races. Taken together, the inversion and race effects observed in the current study suggest that configuration influences face processing by at least 100 msec.

ERP evidence for own-age effects on late stages of processing sad faces

Faces convey important information on interaction partners, such as their emotional state and age. Faces of the same age are, according to recent research, preferentially processed. The aim of the present study was to investigate whether the neural processes underlying this own-age effect are influenced by the emotional expression of the face, and to explore possible explanations such as the frequency or quality of contact to own-age versus other-age groups. Event-related potentials were recorded while 19 younger (18-30 years) and 19 older (64-86 years) observers watched younger and older sad and happy faces. Sad but not happy faces elicited higher late positive potential amplitudes for own-age than for other-age faces. This own-age effect was significant for older, but not for younger, observers, and correlated with the quality of contact with the own-age versus the other-age group. This pattern suggests that sad own-age faces are motivationally more relevant.

The Role of Configural Processing in Face Classification by Race: An ERP Study

The current study investigated the time course of the other-race classification advantage (ORCA) in the subordinate classification of normally configured faces and distorted faces by race. Slightly distorting the face configuration delayed the categorization of own-race faces and had no conspicuous effects on other-race faces. The N170 was sensitive neither to configural distortions nor to faces' races. The P3 was enhanced for other-race than own-race faces and reduced by configural manipulation only for own-race faces. We suggest that the source of ORCA is the configural analysis applied by default while processing own-race faces.

Neural correlates of cognitive aging during the perception of facial age: the role of relatively distant and local texture information

Previous event-related potential (ERP) research revealed that older relative to younger adults show reduced inversion effects in the N170 (with more negative amplitudes for inverted than upright faces), suggestive of impairments in face perception. However, as these studies used young to middle-aged faces only, this finding may reflect preferential processing of own- relative to other-age faces rather than age-related decline. We conducted an ERP study in which young and older participants categorized young and old upright or inverted faces by age. Stimuli were presented either unfiltered or low-pass filtered at 30, 20, or 10 cycles per image (CPI). Response times revealed larger inversion effects, with slower responses for inverted faces, for young faces in young participants. Older participants did not show a corresponding effect. ERPs yielded a trend toward reduced N170 inversion effects in older relative to younger adults independent of face age. Moreover, larger inversion effects for young relative to old faces were detected, and filtering resulted in smaller N170 amplitudes. The reduced N170 inversion effect in older adults may reflect age-related changes in neural correlates of face perception. A smaller N170 inversion effect for old faces may indicate that facial changes with age hamper early face perception stages.

Neural substrates of species-dependent visual processing of faces: use of morphed faces

Face identification and categorization are essential for social communication. The N170 event-related potential (ERP) is considered to be a biomarker of face perception. To elucidate the neural basis of species-dependent face processing, we recorded 128-ch high-density ERPs in 14 healthy adults while they viewed the images of morphed faces. The morphed stimuli contained different proportions of human and monkey faces, and the species boundary was shifted away from the center of the morph continuum. Three experiments were performed to determine how task requirement, facial orientation, and spatial frequency (SF) of visual stimuli affected ERPs. In an equal SF condition, the latency, and amplitude of the occipital P100 for upright faces were modulated in a monotonic-like fashion by the level of morphing. In contrast, the N170 latency for upright faces was modulated in a step-like fashion, showing a flexion point that may reflect species discrimination. Although N170 amplitudes for upright faces were not modulated by morph level, they were modulated in a monotonic-like fashion by inverted faces. The late positive (LP) component (350–550 msec) in the parietal region was modulated in a U-shaped function by morph level during a categorization task, but not in a simple reaction task. These results suggest that P100 reflects changes in the physical properties of faces and that N170 is involved in own-species selectivity. The LP component seems to represent species categorization that occurs 350 msec after stimulus onset.

Unconscious attention modulates the silencing effect of top-down predictions

The brain is considered to be proactive in that it continuously generates predictions about external environment stimuli. Recent Bayesian models of perception have demonstrated that prediction and attention operate synergistically to optimize stimulus processing. However, the relation between prediction and unconscious attention remains unclear given the relative neglect of unconscious attention in scholarly literatures. To investigate this issue, twenty participants (12 women) performed an orientation identification task in which a circular grating appeared either in the left or in the right visual field in a single 30-40min session, during which 64-channel EEG data were acquired. Behavioral results showed an unconscious-attended effect and a facilitated effect. Importantly, prediction-related P1 and N1 silencing effects were observed in the unconscious-attended condition, probably reflecting that unconscious attention improves the precision of top-down predictions at an early stage of processing, thereby increasing the synaptic gain of predictor neurons. Moreover, unlike the early ERP components, P3 revealed a reversed pattern of results, which displayed a silencing effect of prediction only in the unattended condition, suggesting that the influence of unconscious attention on the silencing effect may change over time.

Configural processing advantage for Mongoloid than Caucasian faces during the structure coding stage

Configural processing is considered to be the hallmark of face expertise, which has been widely investigated by face global inversion (inversion effect) and local inversion (Thatcher effect). Using a passive detection task in which face stimuli are task-irrelevant, both the face inversion effect and the Thatcher effect on race perception of faces were investigated. We found that although the N170 inversion effect (enhanced and delayed N 170 for inverted than upright condition) was similar across races of faces, Chinese participants showed a larger N 170 Thatcher effect (enhanced N 170 to Thatcherized faces than normal faces) for Mongoloid faces. The present data indicates the perceptual advantage of configural changes for in-group than out-group faces.

The effects of prediction on the perception for own-race and other-race faces

Human beings do not passively perceive important social features about others such as race and age in social interactions. Instead, it is proposed that humans might continuously generate predictions about these social features based on prior similar experiences. Pre-awareness of racial information conveyed by others' faces enables individuals to act in “culturally appropriate” ways, which is useful for interpersonal relations in different ethnicity groups. However, little is known about the effects of prediction on the perception for own-race and other-race faces. Here, we addressed this issue using high temporal resolution event-related potential techniques. In total, data from 24 participants (13 women and 11 men) were analyzed. It was found that the N170 amplitudes elicited by other-race faces, but not own-race faces, were significantly smaller in the predictable condition compared to the unpredictable condition, reflecting a switch to holistic processing of other-race faces when those faces were predictable. In this respect, top-down prediction about face race might contribute to the elimination of the other-race effect (one face recognition impairment). Furthermore, smaller P300 amplitudes were observed for the predictable than for unpredictable conditions, which suggested that the prediction of race reduced the neural responses of human brains.

The role of featural processing in other-race face classification advantage: an ERP study

The current study investigated the time course of the other-race advantage (ORCA) in the subordinate classification of faces and isolated eyes by race. A significant ORCA was found on RTs to both full faces and isolated eyes and faces were classified faster and more accurate than eyes. The ERP data showed that for both stimuli the categorization processes follow basic level classification of physiognomic stimuli, which is not influenced by the stimulus race. The most conspicuous difference between own-race and other-race stimuli as well as between faces and isolated eyes was found in the modulation of the P3 component. The overall pattern of these modulations suggests that the classification of own-race faces is delayed. Since the amplitude of the P3 is sensitive primarily to the perceptual demands of a task, these data suggest that the delay of the own-race classification is caused by an own-race specific process that precedes or interferes with the subordinate classification.

Knowledge is power: how conceptual knowledge transforms visual cognition

In this review, we synthesize the existing literature demonstrating the dynamic interplay between conceptual knowledge and visual perceptual processing. We consider two theoretical frameworks that demonstrate interactions between processes and brain areas traditionally considered perceptual or conceptual. Specifically, we discuss categorical perception, in which visual objects are represented according to category membership, and highlight studies showing that category knowledge can penetrate early stages of visual analysis. We next discuss the embodied account of conceptual knowledge, which holds that concepts are instantiated in the same neural regions required for specific types of perception and action, and discuss the limitations of this framework. We additionally consider studies showing that gaining abstract semantic knowledge about objects and faces leads to behavioral and electrophysiological changes that are indicative of more efficient stimulus processing. Finally, we consider the role that perceiver goals and motivation may play in shaping the interaction between conceptual and perceptual processing. We hope to demonstrate how pervasive such interactions between motivation, conceptual knowledge, and perceptual processing are in our understanding of the visual environment, and to demonstrate the need for future research aimed at understanding how such interactions arise in the brain.

Do neural correlates of face expertise vary with task demands? Event-related potential correlates of own- and other-race face inversion

We are typically more accurate at remembering own- than other-race faces. This “own-race bias” has been suggested to result from enhanced expertise with and more efficient perceptual processing of own-race than other-race faces. In line with this idea, the N170, an event-related potential correlate of face perception, has been repeatedly found to be larger for other-race faces. Other studies, however, found no difference in N170 amplitude for faces from diverse ethnic groups. The present study tested whether these seemingly incongruent findings can be explained by varying task demands. European participants were presented with upright and inverted European and Asian faces (as well as European and Asian houses), and asked to either indicate the ethnicity or the orientation of the stimuli. Larger N170s for other-race faces were observed in the ethnicity but not in the orientation task, suggesting that the necessity to process facial category information is a minimum prerequisite for the occurrence of the effect. In addition, N170 inversion effects, with larger amplitudes for inverted relative to upright stimuli, were more pronounced for own- relative to other-race faces in both tasks. Overall, the present findings suggest that the occurrence of ethnicity effects in N170 for upright faces depends on the amount of facial detail required for the task at hand. At the same time, the larger inversion effects for own- than other-race faces occur independent of task and may reflect the fine-tuning of perceptual processing to faces of maximum expertise.