Neural repetition suppression to identity is abolished by other-race faces

Mapping female bodily features of attractiveness

“Beauty is bought by judgment of the eye” (Shakespeare, Love’s Labour’s Lost), but the bodily features governing this critical biological choice are still debated. Eye movement studies have demonstrated that males sample coarse body regions expanding from the face, the breasts and the midriff, while making female attractiveness judgements with natural vision. However, the visual system ubiquitously extracts diagnostic extra-foveal information in natural conditions, thus the visual information actually used by men is still unknown. We thus used a parametric gaze-contingent design while males rated attractiveness of female front- and back-view bodies. Males used extra-foveal information when available. Critically, when bodily features were only visible through restricted apertures, fixations strongly shifted to the hips, to potentially extract hip-width and curvature, then the breast and face. Our hierarchical mapping suggests that the visual system primary uses hip information to compute the waist-to-hip ratio and the body mass index, the crucial factors in determining sexual attractiveness and mate selection.

The Role of Configural Processing in Face Classification by Race: An ERP Study

The current study investigated the time course of the other-race classification advantage (ORCA) in the subordinate classification of normally configured faces and distorted faces by race. Slightly distorting the face configuration delayed the categorization of own-race faces and had no conspicuous effects on other-race faces. The N170 was sensitive neither to configural distortions nor to faces' races. The P3 was enhanced for other-race than own-race faces and reduced by configural manipulation only for own-race faces. We suggest that the source of ORCA is the configural analysis applied by default while processing own-race faces.

Mortality salience enhances racial in-group bias in empathic neural responses to others' suffering

Behavioral research suggests that mortality salience (MS) leads to increased in-group identification and in-group favoritism in prosocial behavior. What remains unknown is whether and how MS influences brain activity that mediates emotional resonance with in-group and out-group members and is associated with in-group favoritism in helping behavior. The current work investigated MS effects on empathic neural responses to racial in-group and out-group members' suffering. Experiments 1 and 2 respectively recorded event related potentials (ERPs) and blood oxygen level dependent signals to pain/neutral expressions of Asian and Caucasian faces from Chinese adults who had been primed with MS or negative affect (NA). Experiment 1 found that an early frontal/central activity (P2) was more strongly modulated by pain vs. neutral expressions of Asian than Caucasian faces, but this effect was not affected by MS vs. NA priming. However, MS relative to NA priming enhanced racial in-group bias in long-latency neural response to pain expressions over the central/parietal regions (P3). Experiment 2 found that MS vs. NA priming increased racial in-group bias in empathic neural responses to pain expression in the anterior and mid-cingulate cortex. Our findings indicate that reminding mortality enhances brain activity that differentiates between racial in-group and out-group members' emotional states and suggest a neural basis of in-group favoritism under mortality threat.

An other-race effect for configural and featural processing of faces: upper and lower face regions play different roles

We examined whether Asian individuals would show differential sensitivity to configural vs. featural changes to own- and other-race faces and whether such sensitivity would depend on whether the changes occurred in the upper vs. lower regions of the faces. We systematically varied the size of key facial features (eyes and mouth) of own-race Asian faces and other-race Caucasian faces, and the configuration (spacing) between the eyes and between the nose and mouth of the two types of faces. Results revealed that the other-race effect (ORE) is more pronounced when featural and configural spacing changes are in the upper region than in the lower region of the face. These findings reveal that information from the upper vs. lower region of the face contributes differentially to the ORE in face processing, and that processing of face race is influenced more by information location (i.e., upper vs. lower) than by information type (i.e., configural vs. featural).

The effects of prediction on the perception for own-race and other-race faces

Human beings do not passively perceive important social features about others such as race and age in social interactions. Instead, it is proposed that humans might continuously generate predictions about these social features based on prior similar experiences. Pre-awareness of racial information conveyed by others' faces enables individuals to act in “culturally appropriate” ways, which is useful for interpersonal relations in different ethnicity groups. However, little is known about the effects of prediction on the perception for own-race and other-race faces. Here, we addressed this issue using high temporal resolution event-related potential techniques. In total, data from 24 participants (13 women and 11 men) were analyzed. It was found that the N170 amplitudes elicited by other-race faces, but not own-race faces, were significantly smaller in the predictable condition compared to the unpredictable condition, reflecting a switch to holistic processing of other-race faces when those faces were predictable. In this respect, top-down prediction about face race might contribute to the elimination of the other-race effect (one face recognition impairment). Furthermore, smaller P300 amplitudes were observed for the predictable than for unpredictable conditions, which suggested that the prediction of race reduced the neural responses of human brains.

A language-familiarity effect for speaker discrimination without comprehension

The influence of language familiarity upon speaker identification is well established, to such an extent that it has been argued that "Human voice recognition depends on language ability" [Perrachione TK, Del Tufo SN, Gabrieli JDE (2011) Science 333(6042):595]. However, 7-mo-old infants discriminate speakers of their mother tongue better than they do foreign speakers [Johnson EK, Westrek E, Nazzi T, Cutler A (2011) Dev Sci 14(5):1002-1011] despite their limited speech comprehension abilities, suggesting that speaker discrimination may rely on familiarity with the sound structure of one's native language rather than the ability to comprehend speech. To test this hypothesis, we asked Chinese and English adult participants to rate speaker dissimilarity in pairs of sentences in English or Mandarin that were first time-reversed to render them unintelligible. Even in these conditions a language-familiarity effect was observed: Both Chinese and English listeners rated pairs of native-language speakers as more dissimilar than foreign-language speakers, despite their inability to understand the material. Our data indicate that the language familiarity effect is not based on comprehension but rather on familiarity with the phonology of one's native language. This effect may stem from a mechanism analogous to the "other-race" effect in face recognition.

The role of featural processing in other-race face classification advantage: an ERP study

The current study investigated the time course of the other-race advantage (ORCA) in the subordinate classification of faces and isolated eyes by race. A significant ORCA was found on RTs to both full faces and isolated eyes and faces were classified faster and more accurate than eyes. The ERP data showed that for both stimuli the categorization processes follow basic level classification of physiognomic stimuli, which is not influenced by the stimulus race. The most conspicuous difference between own-race and other-race stimuli as well as between faces and isolated eyes was found in the modulation of the P3 component. The overall pattern of these modulations suggests that the classification of own-race faces is delayed. Since the amplitude of the P3 is sensitive primarily to the perceptual demands of a task, these data suggest that the delay of the own-race classification is caused by an own-race specific process that precedes or interferes with the subordinate classification.

Rapid adaptation effect of N170 for printed words

Faces and written words are two of the most familiar types of visual patterns with the brain's selective response of N170 component in early perception. Using ERP adaptation paradigms, studies have found the N170 response is reduced when there is repeated presentation of upright faces relative to a control condition. In contrast to these well-established features of the face-related N170 adaptation effect, the characteristics of the N170 adaptation effect for printed words are less clear. The goal was to investigate the ERP adaptation effects of printed language (English words and Chinese characters) in a short ISI (200 msec.) adaptation paradigm. The present study showed that both alphabetic words and non-alphabetic words could produce a rapid N170 adaptation effect. Objects of expertise (e.g. words and faces) can produce a rapid N170 adaptation effect but other objects (e.g., houses) cannot, indicating that the specific stimuli have some specific mechanisms for the rapid N170 adaptation.

Can children with autism read emotions from the eyes? The eyes test revisited

This study aimed to test two new, simplified tasks related to the eye-test, targeting children with autism spectrum disorder (ASD) and typically developing controls (TD). Test-1 assessed the recognition of emotion/mental states with displays using one word and two eye-pictures, whereas Test-2 presented displays using two words and one eye-picture. Black and white photographs of children were used as materials. A cross-cultural study (Caucasian/East-Asian) with adults was initially carried out to verify generalizability across different ethnic groups. Cross-sectional trajectory analyses were used to compare emotion recognition from the eyes in the two tests. Trajectories were constructed linking performance on both tests either to chronological age or to different measures of mental age (receptive vocabulary based on the BPVS, CARS or ASQ for the ASD group). Performance improved with chronological age in both the ASD and TD groups of children. However, performance in Test-1 was significantly superior in children with ASD, who showed delayed onset and slower rate of improvement than TD children in Test-2. In both the ASD and TD groups the lowest error rate was recorded for the item 'anger', suggesting that threat-detection cue mechanisms may be intact in autism. In general, all children showed good performance on our novel tests, thus making them good candidates for assessing younger children and those with lower general abilities.

Do neural correlates of face expertise vary with task demands? Event-related potential correlates of own- and other-race face inversion

We are typically more accurate at remembering own- than other-race faces. This “own-race bias” has been suggested to result from enhanced expertise with and more efficient perceptual processing of own-race than other-race faces. In line with this idea, the N170, an event-related potential correlate of face perception, has been repeatedly found to be larger for other-race faces. Other studies, however, found no difference in N170 amplitude for faces from diverse ethnic groups. The present study tested whether these seemingly incongruent findings can be explained by varying task demands. European participants were presented with upright and inverted European and Asian faces (as well as European and Asian houses), and asked to either indicate the ethnicity or the orientation of the stimuli. Larger N170s for other-race faces were observed in the ethnicity but not in the orientation task, suggesting that the necessity to process facial category information is a minimum prerequisite for the occurrence of the effect. In addition, N170 inversion effects, with larger amplitudes for inverted relative to upright stimuli, were more pronounced for own- relative to other-race faces in both tasks. Overall, the present findings suggest that the occurrence of ethnicity effects in N170 for upright faces depends on the amount of facial detail required for the task at hand. At the same time, the larger inversion effects for own- than other-race faces occur independent of task and may reflect the fine-tuning of perceptual processing to faces of maximum expertise.

Transcranial direct current stimulation of the dorsolateral prefrontal cortex modulates repetition suppression to unfamiliar faces: an ERP study

Repeated visual processing of an unfamiliar face suppresses neural activity in face-specific areas of the occipito-temporal cortex. This "repetition suppression" (RS) is a primitive mechanism involved in learning of unfamiliar faces, which can be detected through amplitude reduction of the N170 event-related potential (ERP). The dorsolateral prefrontal cortex (DLPFC) exerts top-down influence on early visual processing. However, its contribution to N170 RS and learning of unfamiliar faces remains unclear. Transcranial direct current stimulation (tDCS) transiently increases or decreases cortical excitability, as a function of polarity. We hypothesized that DLPFC excitability modulation by tDCS would cause polarity-dependent modulations of N170 RS during encoding of unfamiliar faces. tDCS-induced N170 RS enhancement would improve long-term recognition reaction time (RT) and/or accuracy rates, whereas N170 RS impairment would compromise recognition ability. Participants underwent three tDCS conditions in random order at ∼72 hour intervals: right anodal/left cathodal, right cathodal/left anodal and sham. Immediately following tDCS conditions, an EEG was recorded during encoding of unfamiliar faces for assessment of P100 and N170 visual ERPs. The P3a component was analyzed to detect prefrontal function modulation. Recognition tasks were administered ∼72 hours following encoding. Results indicate the right anodal/left cathodal condition facilitated N170 RS and induced larger P3a amplitudes, leading to faster recognition RT. Conversely, the right cathodal/left anodal condition caused N170 amplitude and RTs to increase, and a delay in P3a latency. These data demonstrate that DLPFC excitability modulation can influence early visual encoding of unfamiliar faces, highlighting the importance of DLPFC in basic learning mechanisms.

Time course of shape and category selectivity revealed by EEG rapid adaptation

A hallmark of human cognition is the ability to rapidly assign meaning to sensory stimuli. It has been suggested that this fast visual object categorization ability is accomplished by a feedforward processing hierarchy consisting of shape-selective neurons in occipito-temporal cortex that feed into task circuits in frontal cortex computing conceptual category membership. We performed an EEG rapid adaptation study to test this hypothesis. Participants were trained to categorize novel stimuli generated with a morphing system that precisely controlled both stimulus shape and category membership. We subsequently performed EEG recordings while participants performed a category matching task on pairs of successively presented stimuli. We used space-time cluster analysis to identify channels and latencies exhibiting selective neural responses. Neural signals before 200 msec on posterior channels demonstrated a release from adaptation for shape changes, irrespective of category membership, compatible with a shape- but not explicitly category-selective neural representation. A subsequent cluster with anterior topography appeared after 200 msec and exhibited release from adaptation consistent with explicit categorization. These signals were subsequently modulated by perceptual uncertainty starting around 300 msec. The degree of category selectivity of the anterior signals was strongly predictive of behavioral performance. We also observed a posterior category-selective signal after 300 msec exhibiting significant functional connectivity with the initial anterior category-selective signal. In summary, our study supports the proposition that perceptual categorization is accomplished by the brain within a quarter second through a largely feedforward process culminating in frontal areas, followed by later category-selective signals in posterior regions.

Putting a face in its place: in- and out-group membership alters the N170 response

Two mechanisms have been proposed to account for the difficulty in recognizing faces of other racial groups (the other-race effect; ORE): perceptual expertise and social cognitive factors. Focusing on the social cognitive factors alone, we manipulated in-group and out-group memberships based on two social categories (nationality and university affiliation), and controlled for perceptual expertise by testing Caucasian participants with Caucasian faces only. Using event-related potentials (ERPs) and focusing on the N170, a brain electrical component sensitive to faces, we provide for the first time strong support for the social cognitive influence on face processing within 200 ms. After participants learned the social categories, the N170 latency differentiated between double in-group and double out-group faces, taking longer to process the latter. In comparison, without group memberships, there was no difference in N170 latency among the faces. These results are consistent with recent findings of behavioral and imaging research, providing further support for the social cognitive model and its potential for understanding ORE.

Electrophysiological correlates of processing own- and other-race faces

Most adults have more experience in identifying faces of their own race than in identifying faces from another race, and thus may be considered as own-race face experts. This effect was investigated by recording and analyzing ERPs as well as induced gamma oscillations. The race modulation occurred post the stage of structural processing revealed by N170. Larger P2 component and induced gamma activity for own-race than other-race faces could be associated with more elaborate processing on the basis of configural computation due to more experience that we have for own-race faces.

A steady-state visual evoked potential approach to individual face perception: effect of inversion, contrast-reversal and temporal dynamics

Presentation of a face stimulus for several seconds at a periodic frequency rate leads to a right occipito-temporal evoked steady-state visual potential (SSVEP) confined to the stimulation frequency band. According to recent evidence (Rossion and Boremanse, 2011), this face-related SSVEP is largely reduced in amplitude when the exact same face is repeated at every stimulation cycle as compared to the presentation of different individual faces. Here this SSVEP individual face repetition effect was tested in 20 participants stimulated with faces at a 4 Hz rate for 84 s, in 4 conditions: faces upright or inverted, normal or contrast-reversed (2×2 design). To study the temporal dynamics of this effect, all stimulation sequences started with 15s of identical faces, after which, in half of the sequences, different faces were introduced. A larger response to different than identical faces at the fundamental (4 Hz) and second harmonic (8 Hz) components was observed for upright faces over the right occipito-temporal cortex. Weaker effects were found for inverted and contrast-reversed faces, two stimulus manipulations that are known to greatly affect the perception of facial identity. Addition of the two manipulations further decreased the effect. The phase of the fundamental frequency SSVEP response was delayed for inverted and contrast-reversed faces, to the same extent as the latency delay observed at the peak of the face-sensitive N170 component observed at stimulation sequence onset. Time-course analysis of the entire sequence of stimulation showed an immediate increase of 4Hz amplitude at the onset (16th second) of different face presentation, indicating a fast, large and frequency-specific release to individual face adaptation in the human brain. Altogether, these observations increase our understanding of the characteristics of the human steady-state face potential response and provide further support for the interest of this approach in the study of the neurofunctional mechanisms of face perception.

Relationship between neural response and adaptation selectivity to form and color: an ERP study

Adaptation is widely used as a tool for studying selectivity to visual features. In these studies it is usually assumed that the loci of feature selective neural responses and adaptation coincide. We used an adaptation paradigm to investigate the relationship between response and adaptation selectivity in event-related potentials (ERPs). ERPs were evoked by the presentation of colored Glass patterns in a form discrimination task. Response selectivities to form and, to some extent, color of the patterns were reflected in the C1 and N1 ERP components. Adaptation selectivity to color was reflected in N1 and was followed by a late (300–500 ms after stimulus onset) effect of form adaptation. Thus for form, response and adaptation selectivity were manifested in non-overlapping intervals. These results indicate that adaptation and response selectivity can be associated with different processes. Therefore, inferring selectivity from an adaptation paradigm requires analysis of both adaptation and neural response data.

Is the rapid adaptation paradigm too rapid? Implications for face and object processing

Rapid adaptation is an adaptation procedure in which adaptors and test stimuli are presented in rapid succession. The current study tested the validity of this method for early ERP components by investigating the specificity of the adaptation effect on the face-sensitive N170 ERP component across multiple test stimuli. Experiments 1 and 2 showed identical response patterns for house and upright face test stimuli using the same adaptor stimuli. The results were also identical to those reported in a previous study using inverted face test stimuli (Nemrodov and Itier, 2011). In Experiment 3 all possible adaptor-test combinations between upright face, house, chair and car stimuli were used and no interaction between adaptor and test category, expected in the case of test-specific adaptation, was found. These results demonstrate that the rapid adaptation paradigm does not produce category-specific adaptation effects around 170-200 ms following test stimulus onset, a necessary condition for the interpretation of adaptation results. These results suggest the rapid categorical adaptation paradigm does not work.

Modulation of neuromagnetic responses to face stimuli by preceding biographical information

When we encode faces in memory, we often do so in association with biographical information regarding the person. To examine the neural dynamics underlying such encoding processes, we devised a face recognition task and recorded cortical activity using magnetoencephalography. The task included two conditions. In the experimental condition, face stimuli were preceded by biographical information regarding the person whose face was to be memorized, whereas in the control condition, nonsense syllables were presented before face stimuli. Behavioral results indicated that the biographical information about a person facilitated the recognition memory of their face. Magnetoencephalography signals showed clear visually evoked magnetic fields mainly in the occipitotemporal cortex, in response to the face stimuli that were to be encoded. The phasic peak was observed at 100-200 ms after onset of a face stimulus, which was followed by late latency deflections (200-400 ms). Comparison of the signal between conditions revealed that the preceding semantic information does modulate the neuromagnetic responses to the face stimuli. This modulation occurred primarily at the late latency component in the sensors over the occipitotemporal cortex. In addition, the effects of conditions were also observed in the signals from more anterior sensors, which occurred earlier than the effects in the occipitotemporal cortex. These results provide insights into the neural dynamics underlying the encoding of faces in association with their biographical information.

The other face of the other-race effect: an fMRI investigation of the other-race face categorization advantage

The present study was the first to use the functional magnetic resonance imaging (fMRI) methodology to investigate the neural correlates of race categorization of own- and other-race faces. We found that Chinese participants categorized the race of Caucasian faces more accurately and faster than that of Chinese faces, replicating the robust effect of the other-race categorization advantage. Regions of interest (ROI) analyses revealed greater neural activations when participants were categorizing own-race faces than other-race faces in the bilateral ventral occipito-temporal cortex (VOT) such as the fusiform face areas (FFAs) and the occipital face areas (OFAs). Within the left FFA, there was also a significant negative correlation between the behavioral difference of own- and other-race face categorization accuracy and the activation difference between categorizing own- and other-race faces. Whole brain analyses showed that categorizing own-race faces induced greater activations in the right medial frontal cortex (MFC) and right inferior frontal gyrus (IFG) than categorizing other-race faces. Psychophysiological interaction (PPI) analyses revealed that the frontal cortical regions interacted more strongly with the posterior VOT during the categorization of own-race faces than that of other-race faces. Overall, our findings suggest that relative to the categorization of other-race faces, more cortical resources are engaged during the categorization of own-race faces with which we have a higher level of processing expertise. This increased involvement of cortical neural sources perhaps serves to provide more in-depth processing of own-race faces (such as individuation), which in turn paradoxically results in the behavioral other-race categorization advantage.

Modeling Single-Trial ERP Reveals Modulation of Bottom-Up Face Visual Processing by Top-Down Task Constraints (in Some Subjects)

We studied how task constraints modulate the relationship between single-trial event-related potentials (ERPs) and image noise. Thirteen subjects performed two interleaved tasks: on different blocks, they saw the same stimuli, but they discriminated either between two faces or between two colors. Stimuli were two pictures of red or green faces that contained from 10 to 80% of phase noise, with 10% increments. Behavioral accuracy followed a noise dependent sigmoid in the identity task but was high and independent of noise level in the color task. EEG data recorded concurrently were analyzed using a single-trial ANCOVA: we assessed how changes in task constraints modulated ERP noise sensitivity while regressing out the main ERP differences due to identity, color, and task. Single-trial ERP sensitivity to image phase noise started at about 95-110 ms post-stimulus onset. Group analyses showed a significant reduction in noise sensitivity in the color task compared to the identity task from about 140 ms to 300 ms post-stimulus onset. However, statistical analyses in every subject revealed different results: significant task modulation occurred in 8/13 subjects, one showing an increase and seven showing a decrease in noise sensitivity in the color task. Onsets and durations of effects also differed between group and single-trial analyses: at any time point only a maximum of four subjects (31%) showed results consistent with group analyses. We provide detailed results for all 13 subjects, including a shift function analysis that revealed asymmetric task modulations of single-trial ERP distributions. We conclude that, during face processing, bottom-up sensitivity to phase noise can be modulated by top-down task constraints, in a broad window around the P2, at least in some subjects.

Inverting faces does not abolish cultural diversity in eye movements

Face processing is widely understood to be a basic, universal visual function effortlessly achieved by people from all cultures and races. The remarkable recognition performance for faces is markedly and specifically affected by picture-plane inversion: the so-called face-inversion effect (FIE), a finding often used as evidence for face-specific mechanisms. However, it has recently been shown that culture shapes the way people deploy eye movements to extract information from faces. Interestingly, the comparable lack of experience with inverted faces across cultures offers a unique opportunity to establish the extent to which such cultural perceptual biases in eye movements are robust, but also to assess whether face-specific mechanisms are universally tuned. Here we monitored the eye movements of Western Caucasian (WC) and East Asian (EA) observers while they learned and recognised WC and EA inverted faces. Both groups of observers showed a comparable impairment in recognising inverted faces of both races. WC observers deployed a scattered inverted triangular scanpath with a bias towards the mouth, whereas EA observers uniformly extended the focus of their fixations from the centre towards the eyes. Overall, our data show that cultural perceptual differences in eye movements persist during the FIE, questioning the universality of face-processing mechanisms.