Neural repetition suppression to identity is abolished by other-race faces

The role of perceptual processing in the oddball effect revealed by the Thatcher illusion

When a novel stimulus (oddball) appears after repeated presentation of an identical stimulus, the oddball is perceived to last longer than the repeated stimuli, a phenomenon known as the oddball effect. We investigated whether the perceptual or physical differences between the repeated and oddball stimuli are more important for the oddball effect. To manipulate the perceptual difference while keeping their physical visual features constant, we used the Thatcher illusion, in which an inversion of a face hinders recognition of distortion in its facial features. We found that the Thatcherized face presented after repeated presentation of an intact face induced a stronger oddball effect when the faces were upright than when they were inverted (Experiment 1). However, the difference in the oddball effect between face orientations was not observed when the intact face was presented as the oddball after repeated presentation of a Thatcherized face (Experiment 2). These results were replicated when participants performed both the intact-repeated and Thatcherized-repeated conditions in a single experiment (Experiment 3). Two control experiments confirmed that the repeated presentation of the preceding stimuli is necessary for the difference in duration distortion to occur (Experiments 4 and 5). The results suggest the considerable role of perceptual processing in the oddball effect. We discuss the discrepancy in the results between the intact-repeated and Thatcherized-repeated conditions in terms of predictive coding.

The speed of race

When asked to categorize faces according to 'race', people typically categorize other-race faces faster than faces belonging to their own race. This 'Other Race Categorization Advantage' is thought to reflect enhanced sensitivity to early visual signals characteristic of other-race faces, and can manifest within 200 ms of face presentation. However, recent research has highlighted the importance of signal intensity in this effect, where visual-degradation of the face images significantly enhances the effect and exposes a behavioural threshold at very low levels of visual quality where other-race visual signals are able to be perceived while same-race signals are not. The current study investigated the effect of signal intensity in race categorization processes in the brain through electroencephalography and in accuracy/reaction times. While replicating the previously observed enhancement of the other-race categorization advantage, we also found enhanced sensitivity to other-race faces in early P1 peaks, as well as later N170 and N250 peaks. These effects, however, related to the varying levels of signal intensity in the face stimuli, suggesting that race categorization may involve different types of perceptual and neural processes rather than one discrete process. The speed at which race is perceived depends on the intensity of the face signal.

Face motion form at learning influences the time course of face spatial frequency processing during test

Studies that use static faces suggest that facial processing follows a coarse-to-fine sequence; i.e., holistic precedes featural processing, due to low and high spatial frequencies (LSF, HSF) transmitting holistic/global and featural/local information respectively. Although recent studies have focused on the role of facial movement in holistic facial processing, it is unclear whether moving faces have the same processing mechanism as static ones, especially in the time course of processing. The current study uses the event-related potential technique to investigate this issue by manipulating the facial format at study and face spatial frequency during the test. ERP results showed that the P1 amplitude was increased by LSF faces relative to HSF ones, using both moving and static study faces, with the former larger than the latter. The N170 amplitude was more sensitive to HSF than LSF faces when only static study faces were used, while the P2 amplitude was more sensitive to LSF faces regardless of the facial study format. The above results were not modulated by the race of the faces. These results favor the view that regardless of face race, moving study faces promote holistic processing during the earliest stage of face recognition. Furthermore, holistic processing is observed to be the same for both static and moving study faces at a later stage associated with more in-depth processing. It is evident that facial motion should be factored into further studies of face recognition, given the distinctions between holistic and featural processing for moving and static study faces.

Beyond facial expressions: A systematic review on effects of emotional relevance of faces on the N170

The N170 is the most prominent electrophysiological signature of face processing. While facial expressions reliably modulate the N170, there is considerable variance in N170 modulations by other sources of emotional relevance. Therefore, we systematically review and discuss this research area using different methods to manipulate the emotional relevance of inherently neutral faces. These methods were categorized into (1) existing pre-experimental affective person knowledge (e.g., negative attitudes towards outgroup faces), (2) experimentally instructed affective person knowledge (e.g., negative person information), (3) contingency-based affective learning (e.g., fear-conditioning), or (4) the immediate affective context (e.g., emotional information directly preceding the face presentation). For all categories except the immediate affective context category, the majority of studies reported significantly increased N170 amplitudes depending on the emotional relevance of faces. Furthermore, the potentiated N170 was observed across different attention conditions, supporting the role of the emotional relevance of faces on the early prioritized processing of configural facial information, regardless of low-level differences. However, we identified several open research questions and suggest venues for further research.

Electrophysiological, emotional and behavioural responses of female targets of sexual objectification

Sexual objectification and the interiorized objectifying gaze (self-objectification) are dangerous phenomena for women's psychological wellness. However, their specific effects on women's socio-affective reactions are still poorly understood, and their neural activity has never been explored before. In the present study, we investigated women's emotional and electrophysiological responses during simulated computer-based objectifying social interactions, and we examined consequent punishing behaviours towards the perpetrator using the ultimatum game. Behavioural results (N = 36) showed that during objectifying encounters women generally felt angrier/disgusted and tended to punish the perpetrator in later interactions. However, the more the women self-objectified, the more they felt ashamed (p = 0.011) and tended to punish the perpetrators less (p = 0.008). At a neural level (N = 32), objectifying interactions modulated female participants' neural signal elicited during the processing of the perpetrator, increasing early (N170) and later (EPN, LPP) ERP components. In addition, only the amplitude of the LPP positively correlated with shame (p = 0.006) and the level of self-objectification (p = 0.018). This finding provides first evidence for the specific time-course of sexual objectification, self-objectification and its associated shame response, and proves that emotional and social consequences of sexual objectification in women may depend on their tendency to self-objectify.

Neural timing of the other-race effect across the lifespan: A review

Face race influences the way we process faces, so that faces of a different ethnic group are processed for identity less efficiently than faces of one's ethnic group - a phenomenon known as the Other-Race Effect (ORE). Although widely replicated, the ORE is still poorly characterized in terms of its development and the underlying mechanisms. In the last two decades, the Event-Related Potential (ERP) technique has brought insight into the mechanisms underlying the ORE and has demonstrated potential to clarify its development. Here, we review the ERP evidence for a differential neural processing of own-race and other-race faces throughout the lifespan. In infants, race-related processing differences emerged at the N290 and P400 (structural encoding) stages. In children, race affected the P100 (early processing, attention) perceptual stage and was implicitly encoded at the N400 (semantic processing) stage. In adults, processing difficulties for other-race faces emerged at the N170 (structural encoding), P200 (configuration processing) and N250 (accessing individual representations) perceptual stages. Early in processing, race was implicitly encoded from other-race faces (N100, P200 attentional biases) and in-depth processing preferentially applied to own-race faces (N200 attentional bias). Encoding appeared less efficient (Dm effects) and retrieval less recollection-based (old/new effects) for other-race faces. Evidence admits the contribution of perceptual, attentional, and motivational processes to the development and functioning of the ORE, offering no conclusive support for perceptual or socio-cognitive accounts. Cross-racial and non-cross-racial studies provided convergent evidence. Future research would need to include less represented ethnic populations and the developmental population.

Understanding racial bias through electroencephalography

Research on racial bias in social and cognitive psychology has focused on automatic cognitive processes such as categorisation or stereotyping. Neuroimaging has revealed differences in the neural circuit when processing social information about one's own or another's ethnicity. This review investigates the influence of racial bias on human behaviour by reviewing studies that examined changes in neural circuitry (i.e. ERP responses) during automatic and controlled processes elicited by specific tasks. This systematic analysis of specific ERP components across different studies provides a greater understanding of how social contexts are perceived and become associated with specific stereotypes and behavioural predictions. Therefore, investigating these related cognitive and neurobiological functions can further our understanding of how racial bias affects our cognition more generally and guide more effective programs and policies aimed at its mitigation.

The role of task demands in racial face encoding

People more accurately remember faces of their own racial group compared to faces of other racial groups; this phenomenon is called the other-race effect. To date, numerous researchers have devoted themselves to exploring the reasons for this other-race effect, and they have posited several theoretical explanations. One integrated explanation is the categorization-individuation model, which addresses two primary ways (categorization and individuation) of racial face processing and emphasizes the emergence of these two ways during the encoding stage. Learning-recognition and racial categorization tasks are two classical tasks used to explore racial face processing. Event-related potentials can facilitate investigation of the encoding differences of own- and other-race faces under these two typical task demands. Unfortunately, to date, results have been mixed. In the current study, we investigated whether categorization and individuation differ for own- and other-race faces during the encoding stage by using racial categorization and learning-recognition tasks. We found that task demands not only influence the encoding of racial faces, but also have a more profound effect in the encoding stage of recognition tasks for other-race faces. More specifically, own-race faces demonstrate deeper structural encoding than other-race faces, with less attentional involvement. Moreover, recognitions tasks might ask for more individual-level encoding, requiring more attentional resources in the early stage that may be maintained until relatively late stages. Our results provide some evidence concerning task selection for future racial face studies and establish a groundwork for a unified interpretation of racial face encoding.

Changes in face category induce stronger duration distortion in the temporal oddball paradigm

A novel stimulus embedded in a sequence of repeated stimuli is often perceived to be longer in duration. Studies have indicated the involvement of repetition suppression in this duration distortion, but it remains unclear which processing stages are important. The present study examined whether high-level visual category processing contributes to the oddball's duration distortion. In Experiment 1, we presented a novel face image in either human, monkey, or cat category after a repetition of an identical human face image in the temporal oddball paradigm. We found that the duration distortion of the last stimulus increased when the face changed across different categories, than when it changed within the same category. However, the effect of category change disappeared when globally scrambled and locally scrambled face images were used in Experiments 2 and 3, respectively, suggesting that the difference in duration distortion cannot be attributed to low-level visual properties of the images. Furthermore, in Experiment 4, we again used intact face images and found that category changes can influence the duration distortion even when a series of different human faces was presented before the last stimulus. These findings indicate that high-level visual category processing plays an important role in the duration distortion of oddballs. This study supports the idea that visual processing at higher visual stages is involved in duration perception. (219 words).

Covariation in the recognition of own-race and other-race faces argues against the role of group bias in the other race effect

A dominant theory of the other race effect (ORE) is that group-bias causes us to process own-race and other-race faces using different cognitive processes. To test this theory, we measured individual differences across two face recognition tasks. Our predictions were that the magnitude and pattern of performance on own-race faces would not predict performance on other-race faces and that participants would take more time with own-race faces. In a face matching task, we found that participants were more accurate with own-race faces compared to other-race faces. However, performance on own-race faces was highly correlated with performance on other-race faces. In a face sorting task, participants made fewer piles and fewer errors (i.e. higher accuracy) with own-race faces compared to other-race faces. However, we again found that performance on own-race faces was highly correlated with performance on other-race faces. The covariation in performance between own-race and other-race faces suggests that they engage similar perceptual processes. Finally, we found that participants did not spend more time on tasks involving own-race faces suggesting that different levels of motivation do not explain the ORE. Together, these findings argue against the idea that group bias leads to different perceptual processing of own-race and other-race faces.

Neural sensitivity to faces is increased by immersion into a novel ethnic environment: Evidence from ERPs

Previous reports suggest that East-Asians may show larger face-elicited N170 components in the ERP as compared to Caucasian participants. Since the N170 can be modulated by perceptual expertise, such group differences may be accounted for by differential experience, for example, with logographic versus alphabetic scripts (script system hypothesis) or by exposure to abundant novel faces during the immersion into a new social and/or ethnic environment (social immersion hypothesis). We conducted experiments in Hong Kong and Berlin, recording ERPs in a series of one-back tasks, using same- and other-ethnicity face stimuli in upright and inverted orientation and doodle stimuli. In Hong Kong we tested local Chinese residents and foreign guest students who could not read the logographic script; in Berlin we tested German residents who could not read the logographic script and foreign Chinese visitors. In both experiments, we found significantly larger N170 amplitudes to faces, regardless of ethnicity, in the foreign than in the local groups. Moreover, this effect did not depend on stimulus orientation, suggesting that the N170 group differences do not reflect differences in configural visual processing. A group of short-term German residents in Berlin did not differ in N170 amplitude from long-term residents. Together, these findings indicate that the extensive confrontation with novel other-ethnicity faces during immersion in a foreign culture may enhance the neural response to faces, reflecting the short-term plasticity of the underlying neural system.

Race categorization in noise

People are typically faster to categorize the race of a face if it belongs to a race different from their own. This Other Race Categorization Advantage (ORCA) is thought to reflect an enhanced sensitivity to the visual race signals of other race faces, leading to faster response times. The current study investigated this sensitivity in a cross-cultural sample of Swiss and Japanese observers with a race categorization task using faces that had been parametrically degraded of visual structure, with normalized luminance and contrast. While Swiss observers exhibited an increasingly strong ORCA in both reaction time and accuracy as the face images were visually degraded up to 20% structural coherence, the Japanese observers manifested this pattern most distinctly when the faces were fully structurally-intact. Critically, for both observer groups, there was a clear accuracy effect at the 20% structural coherence level, indicating that the enhanced sensitivity to other race visual signals persists in significantly degraded stimuli. These results suggest that different cultural groups may rely on and extract distinct types of visual race signals during categorization, which may depend on the available visual information. Nevertheless, heavily degraded stimuli specifically favor the perception of other race faces, indicating that the visual system is tuned by experience and is sensitive to the detection of unfamiliar signals.

Shared Attention Amplifies the Neural Processing of Emotional Faces

Sharing an experience, without communicating, affects people's subjective perception of the experience, often by intensifying it. We investigated the neural mechanisms underlying shared attention by implementing an EEG study where participants attended to and rated the intensity of emotional faces, simultaneously or independently. Participants performed the task in three experimental conditions: (a) alone; (b) simultaneously next to each other in pairs, without receiving feedback of the other's responses (shared without feedback); and (c) simultaneously while receiving the feedback (shared with feedback). We focused on two face-sensitive ERP components: The amplitude of the N170 was greater in the "shared with feedback" condition compared to the alone condition, reflecting a top-down effect of shared attention on the structural encoding of faces, whereas the EPN was greater in both shared context conditions compared to the alone condition, reflecting an enhanced attention allocation in the processing of emotional content of faces, modulated by the social context. Taken together, these results suggest that shared attention amplifies the neural processing of faces, regardless of the valence of facial expressions.

Race and early face-sensitive event-related potentials in children and adults

Studies examining children's face perception have revealed developmental changes in early and face-sensitive event-related potential (ERP) components. Children also tend to show racial biases in their face perception and evaluation of others. The current study examined how early face-sensitive ERPs are influenced by face race in children and adults. A second objective examined face recognition proficiency and implicit racial bias in relation to ERP responses to own- and other-race faces. Electroencephalographic responses were recorded while Caucasian children and adults viewed Caucasian and East Asian faces. Participants also completed recognition tasks and an IAT with Caucasian and East Asian faces. Other-race faces elicited larger P100 amplitudes than own-race faces. Furthermore, adults with better other-race recognition proficiency showed larger P100 amplitude responses to other-race faces compared with adults with worse other-race recognition proficiency. In addition, larger implicit biases favoring own-race individuals were associated with larger P100 to N170 peak-to-peak amplitudes for other-race faces in adults. In contrast, larger implicit biases favoring own-race individuals were associated with smaller P100 to N170 peak-to-peak amplitudes for both own- and other-race faces in 8- to 10-year-olds. There was also an age-related decrease in P100 to N170 peak-to-peak amplitudes for own-race faces among 5- to 10-year-olds with better own-race recognition proficiency. The age-related decrease in N170 latency for other-race faces was also more pronounced in 5- to 10-year-olds with better other-race recognition proficiency. Thus, recognition proficiency and implicit racial bias are associated with early ERP responses in adults and children, but in different ways.

Electrophysiological correlates of perceptual prediction error are attenuated in dyslexia

A perceptual adaptation deficit often accompanies reading difficulty in dyslexia, manifesting in poor perceptual learning of consistent stimuli and reduced neurophysiological adaptation to stimulus repetition. However, it is not known how adaptation deficits relate to differences in feedforward or feedback processes in the brain. Here we used electroencephalography (EEG) to interrogate the feedforward and feedback contributions to neural adaptation as adults with and without dyslexia viewed pairs of faces and words in a paradigm that manipulated whether there was a high probability of stimulus repetition versus a high probability of stimulus change. We measured three neural dependent variables: expectation (the difference between prestimulus EEG power with and without the expectation of stimulus repetition), feedforward repetition (the difference between event-related potentials (ERPs) evoked by an expected change and an unexpected repetition), and feedback-mediated prediction error (the difference between ERPs evoked by an unexpected change and an expected repetition). Expectation significantly modulated prestimulus theta- and alpha-band EEG in both groups. Unexpected repetitions of words, but not faces, also led to significant feedforward repetition effects in the ERPs of both groups. However, neural prediction error when an unexpected change occurred instead of an expected repetition was significantly weaker in dyslexia than the control group for both faces and words. These results suggest that the neural and perceptual adaptation deficits observed in dyslexia reflect the failure to effectively integrate perceptual predictions with feedforward sensory processing. In addition to reducing perceptual efficiency, the attenuation of neural prediction error signals would also be deleterious to the wide range of perceptual and procedural learning abilities that are critical for developing accurate and fluent reading skills.

Rapid saccadic categorization of other-race faces

The human visual system is very fast and efficient at extracting socially relevant information from faces. Visual studies employing foveated faces have consistently reported faster categorization by race response times for other-race compared with same-race faces. However, in everyday life we typically encounter faces outside the foveated visual field. In study 1, we explored whether and how race is categorized extrafoveally in same- and other-race faces normalized for low-level properties by tracking eye movements of Western Caucasian and East Asian observers in a saccadic response task. The results show that not only are people sensitive to race in faces presented outside of central vision, but the speed advantage in categorizing other-race faces occurs astonishingly quickly in as little as 200 ms. Critically, this visual categorization process was approximately 300 ms faster than the typical button press responses on centrally presented foveated faces. Study 2 investigated the genesis of the extrafoveal saccadic response speed advantage by comparing the influences of the response modality (button presses and saccadic responses), as well as the potential contribution of the impoverished low-spatial frequency spectrum characterizing extrafoveal visual information processing. Button press race categorization was not significantly faster with reconstructed retinal-filtered low spatial frequency faces, regardless of the visual field presentation. The speed of race categorization was significantly boosted only by extrafoveal saccades and not centrally foveated faces. Race is a potent, rapid, and effective visual signal transmitted by faces used for the categorization of ingroup/outgroup members. This fast universal visual categorization can occur outside central vision, igniting a cascade of social processes.

Oxytocin Modulates Neural Individuation/Categorization Processing of Faces in Early Face-Selective Areas

Oxytocin (OT) is known as a neuropeptide that promotes social adaptation. Individuating racial in-group members and viewing racial out-groups in categories is an adaptive strategy that evolved to aid effective social interaction. Nevertheless, whether OT modulates the neural individuation/categorization processing of racial in-group and out-group faces remain unknown. After intranasal OT or placebo administration, 46 male participants (OT: 24, placebo: 22) were presented with face pairs with the same or different identities or races in rapid succession. The neural repetition suppression (RS) effects to identity and race were measured using functional magnetic resonance imaging (fMRI) as indices of individuation/categorization face-processing. The results showed that while OT increased the RS effect to race, it decreased the RS effect to identity in the right fusiform face area. As for the left occipital face area, OT enlarged the differential RS effects to identities of in-group and out-group faces. Additionally, OT modulated the association of interdependence self-construal and the RS effects on identity and race. These findings bring to light preliminary evidence that OT can regulate neuronal specificity of identity and race in early face-selective regions and benefit adaptive individuation/categorization face-processing.

Processing of facial expressions of same-race and other-race faces: distinct and shared neural underpinnings

People understand others’ emotions quickly from their facial expressions. However, facial expressions of ingroup and outgroup members may signal different social information and thus be mediated by distinct neural activities. We investigated whether there are distinct neuronal responses to fearful and happy expressions of same-race (SR) and other-race (OR) faces. We recorded electroencephalogram from Chinese adults when viewing an adaptor face (with fearful/neutral expressions in Experiment 1 but happy/neutral expressions in Experiment 2) and a target face (with fearful expressions in Experiment 1 but happy expressions in Experiment 2) presented in rapid succession. We found that both fearful and happy (vs neutral) adaptor faces increased the amplitude of a frontocentral positivity (P2). However, a fearful but not happy (vs neutral) adaptor face decreased the P2 amplitudes to target faces, and this repetition suppression (RS) effect occurred when adaptor and target faces were of the same race but not when of different races. RS was observed on two late parietal/central positive activities to fearful/happy target faces, which, however, occurred regardless of whether adaptor and target faces were of the same or different races. Our findings suggest that early affective processing of fearful expressions may engage distinct neural activities for SR and OR faces.

Mapping the Featural and Holistic Face Processing of Bad and Good Face Recognizers

Individual abilities in face recognition (good versus bad recognizers) were explored by means of event-related potentials (ERPs). The adaptation response profile of the N170 component to whole faces, eyes and mouths was used in order to highlight the crucial role of individual abilities in identity repetition processes for unfamiliar faces. The main point of this study is to underline the importance of characterizing the performance (bad or good) of the participants and to show that behaviorally selected groups might reveal neural differences. Good recognizers showed selective right hemisphere N170 repetition effects for whole faces and not for features. On the contrary, bad recognizers showed a general repetition effect not specifically related to faces and more pronounced processing for features. These findings suggest a different contribution of holistic and featural analysis in bad and good performers. In conclusion, we propose that the N170 might be used as a tool to tease apart face encoding processes as a function of individual differences.

Human Face-Selective Cortex Does Not Distinguish between Members of a Racial Outgroup

People often fail to individuate members of social outgroups, a phenomenon known as the outgroup homogeneity effect. Here, we used functional magnetic resonance imaging (fMRI) repetition suppression to investigate the neural representation underlying this effect. In a preregistered study, White human perceivers (N = 29) responded to pairs of faces depicting White or Black targets. In each pair, the second face depicted either the same target as the first face, a different target from the same race, or a scrambled face outline. We localized face-selective neural regions via an independent task, and demonstrated that neural activity in the fusiform face area (FFA) distinguished different faces only when targets belonged to the perceivers' racial ingroup (White). By contrast, face-selective cortex did not discriminate between other-race individuals. Moreover, across two studies (total N = 67) perceivers were slower to discriminate between different outgroup members and remembered them to a lesser extent. Together, these results suggest that the outgroup homogeneity effect arises when early-to-mid-level visual processing results in an erroneous overlap of representations of outgroup members.

Using spatial frequency scales for processing own-race and other-race faces: An ERP analysis

In the present study we examined the influence of spatial filtering on the N170 elicited by own-race and other-race faces, a relatively early face-selective ERP difference associated with face detection. It was found that BB (broad band) faces elicited larger N170 than did LSF (low spatial frequency) faces and the latter larger than HSF (high spatial frequency) condition. Faces' races significantly modulated the N170 amplitudes, showing larger N170 for other-race than own-race faces for both BB and HSF conditions but not for LSF condition. For own-race faces, the N170 did not differ between BB and LSF conditions, whereas other-race faces elicited larger N170 for BB than LSF conditions. The present data provided new electrophysiological evidence for race perception of faces.

Length of Hair Affects P1 and N170 Latencies for Perception of Women's Faces

This study investigated the relationship between length of hair in facial stimuli and latency and amplitude of the P1 and N170 components of event-related potentials during facial perception. Electroencephalography was recorded from 21 Japanese participants (four men, 17 women) who were shown pictures of faces with one of three lengths of hair: long, medium length, or short. In addition, we used both fixed-size and variable-size blocks. In fixed-size blocks, the three types of stimuli were matched to have the same overall size; in variable-size blocks, long hair stimuli were the biggest, medium length hair stimuli were medium sized, and short hair stimuli were the smallest. We analyzed P1 latency and amplitude using two-way (6 × 2) repeated-measures analysis of variance over length of hair and electrode; N170 latency and amplitude were analyzed using three-way (6 × 2 × 2) repeated-measures analysis of variance over length of hair, hemisphere, and electrode. The latency of P1 to faces with short hair in variable-size blocks was significantly longer than that to the other five stimulus types ( p < .01 for four of the other types; p = .083 for medium length hair in variable-size blocks). The latency of N170 to faces with long hair in variable-size blocks was significantly shorter than that to faces with medium length hair and short hair in variable-size blocks ( p = .026 and p = .086, respectively). These results indicate that length of hair influenced P1 and N170 latency, supporting the notion that length of hair is a significant external facial feature. Because long hair attracted participants' attention, there was early perceptual processing of this feature. In contrast, because short hair did not attract attention, perceptual processing of this feature was late.

Magnetoencephalography adaptation reveals depth-cue-invariant object representations in the visual cortex

Independent of edges and 2-D shape that can be highly informative of object identity, depth cues alone can also give rise to vivid and effective object percepts. The processing of different depth cues engages segregated cortical areas, and an efficient object representation would be one that is invariant to depth cues. Here, we investigated depth-cue invariance of object representations by measuring the category-specific response to faces-the M170 response measured with magnetoencephalography. The M170 response is strongest to faces and is sensitive to adaptation, such that repeated presentation of a face diminishes subsequent M170 responses. We used this feature of the M170 and measured the degree to which the adaptation effect is affected by variations in depth cue and 3-D object shape. Subjects viewed a rapid presentation of two stimuli-an adaptor and a test stimulus. The adaptor was either a face, a chair, or a face-like oval surface, and rendered with a single depth cue (shading, structure from motion, or texture). The test stimulus was always a shaded face of a random identity, thus completely controlling for low-level influences on the M170 response to the test stimulus. In the left fusiform face area, we found strong M170 adaptation when the adaptor was a face regardless of its depth cue. This adaptation was marginal in the right fusiform and negligible in the occipital regions. Our results support the presence of depth-cue-invariant representations in the human visual system, alongside size, position, and viewpoint invariance.

Dynamics of neural representations when searching for exemplars and categories of human and non-human faces

Face perception abilities in humans exhibit a marked expertise in distinguishing individual human faces at the expense of individual faces from other species (the other-species effect). In particular, one behavioural effect of such specialization is that human adults search for and find categories of non-human faces faster and more accurately than a specific non-human face, and vice versa for human faces. However, a recent visual search study showed that neural responses (event-related potentials, ERPs) were identical when finding either a non-human or human face. We used time-resolved multivariate pattern analysis of the EEG data from that study to investigate the dynamics of neural representations during a visual search for own-species (human) or other-species (non-human ape) faces, with greater sensitivity than traditional ERP analyses. The location of each target (i.e., right or left) could be decoded from the EEG, with similar accuracy for human and non-human faces. However, the neural patterns associated with searching for an exemplar versus a category target differed for human faces compared to non-human faces: Exemplar representations could be more reliably distinguished from category representations for human than non-human faces. These findings suggest that the other-species effect modulates the nature of representations, but preserves the attentional selection of target items based on these representations.

Affective interoceptive inference: Evidence from heart-beat evoked brain potentials

The perception of internal bodily signals (interoception) is central to many theories of emotion and embodied cognition. According to recent theoretical views, the sensory processing of visceral signals such as one's own heartbeat is determined by top-down predictions about the expected interoceptive state of the body (interoceptive inference). In this EEG study we examined neural responses to heartbeats following expected and unexpected emotional stimuli. We used a modified stimulus repetition task in which pairs of facial expressions were presented with repeating or alternating emotional content, and we manipulated the emotional valence and the likelihood of stimulus repetition. We found that affective predictions of external socially relevant information modulated the heartbeat-evoked potential, a marker of cardiac interoception. Crucially, the HEP changes highly relied on the expected emotional content of the facial expression. Thus, expected negative faces led to a decreased HEP amplitude, whereas such an effect was not observed after an expected neutral face. These results suggest that valence-specific affective predictions, and their uniquely associated predicted bodily sensory state, can reduce or amplify cardiac interoceptive responses. In addition, the affective repetition effects were dependent on repetition probability, highlighting the influence of top-down exteroceptive predictions on interoception. Our results are in line with recent models of interoception supporting the idea that predicted bodily states influence sensory processing of salient external information.

Face-to-face: Perceived personal relevance amplifies face processing

The human face conveys emotional and social information, but it is not well understood how these two aspects influence face perception. In order to model a group situation, two faces displaying happy, neutral or angry expressions were presented. Importantly, faces were either facing the observer, or they were presented in profile view directed towards, or looking away from each other. In Experiment 1 (n = 64), face pairs were rated regarding perceived relevance, wish-to-interact, and displayed interactivity, as well as valence and arousal. All variables revealed main effects of facial expression (emotional > neutral), face orientation (facing observer > towards > away) and interactions showed that evaluation of emotional faces strongly varies with their orientation. Experiment 2 (n = 33) examined the temporal dynamics of perceptual-attentional processing of these face constellations with event-related potentials. Processing of emotional and neutral faces differed significantly in N170 amplitudes, early posterior negativity (EPN), and sustained positive potentials. Importantly, selective emotional face processing varied as a function of face orientation, indicating early emotion-specific (N170, EPN) and late threat-specific effects (LPP, sustained positivity). Taken together, perceived personal relevance to the observer-conveyed by facial expression and face direction-amplifies emotional face processing within triadic group situations.

Face Recognition is Shaped by the Use of Sign Language

Previous research has suggested that early deaf signers differ in face processing. Which aspects of face processing are changed and the role that sign language may have played in that change are however unclear. Here, we compared face categorization (human/non-human) and human face recognition performance in early profoundly deaf signers, hearing signers, and hearing non-signers. In the face categorization task, the three groups performed similarly in term of both response time and accuracy. However, in the face recognition task, signers (both deaf and hearing) were slower than hearing non-signers to accurately recognize faces, but had a higher accuracy rate. We conclude that sign language experience, but not deafness, drives a speed-accuracy trade-off in face recognition (but not face categorization). This suggests strategic differences in the processing of facial identity for individuals who use a sign language, regardless of their hearing status.

Fear boosts the early neural coding of faces

The rapid extraction of facial identity and emotional expressions is critical for adapted social interactions. These biologically relevant abilities have been associated with early neural responses on the face sensitive N170 component. However, whether all facial expressions uniformly modulate the N170, and whether this effect occurs only when emotion categorization is task-relevant, is still unclear. To clarify this issue, we recorded high-resolution electrophysiological signals while 22 observers perceived the six basic expressions plus neutral. We used a repetition suppression paradigm, with an adaptor followed by a target face displaying the same identity and expression (trials of interest). We also included catch trials to which participants had to react, by varying identity (identity-task), expression (expression-task) or both (dual-task) on the target face. We extracted single-trial Repetition Suppression (stRS) responses using a data-driven spatiotemporal approach with a robust hierarchical linear model to isolate adaptation effects on the trials of interest. Regardless of the task, fear was the only expression modulating the N170, eliciting the strongest stRS responses. This observation was corroborated by distinct behavioral performance during the catch trials for this facial expression. Altogether, our data reinforce the view that fear elicits distinct neural processes in the brain, enhancing attention and facilitating the early coding of faces.

Spatiotemporal brain dynamics supporting the immediate automatization of inhibitory control by implementation intentions

While cognitive interventions aiming at reinforcing intentional executive control of unwanted response showed only modest effects on impulse control disorders, the establishment of fast automatic, stimulus-driven inhibition of responses to specific events with implementation intention self-regulation strategies has proven to be an effective remediation approach. However, the neurocognitive mechanisms underlying implementation intentions remain largely unresolved. We addressed this question by comparing electrical neuroimaging analyses of event-related potentials recorded during a Go/NoGo task between groups of healthy participants receiving either standard or implementation intentions instructions on the inhibition stimuli. Inhibition performance improvements with implementation intentions were associated with a Group by Stimulus interaction 200–250 ms post-stimulus onset driven by a selective decrease in response to the inhibition stimuli within the left superior temporal gyrus, the right precuneus and the right temporo-parietal junction. We further observed that the implementation intentions group showed already at the beginning of the task the pattern of task-related functional activity reached after practice in the group having received standard instructions. We interpret our results in terms of an immediate establishment of an automatic, bottom-up form of inhibitory control by implementation intentions, supported by stimulus-driven retrieval of verbally encoded stimulus-response mapping rules, which in turn triggered inhibitory processes.

Physical coldness enhances racial in-group bias in empathy: Electrophysiological evidence

Empathy for others' pain plays a key role in prosocial behavior and is influenced by intergroup relationships. Increasing evidence suggests greater empathy for racial in-group than out-group individuals' pain and the racial in-group bias undergoes sociocultural and biological influences. The present study further investigated whether and how physical environments influence racial in-group bias in empathy by testing the hypothesis that sensory experiences of physical coldness versus warmth enhance differential empathic neural responses to racial in-group vs. out-group individuals' suffering. We recorded event-related brain potentials to painful versus neutral expressions of same-race and other-race faces when participants held a cold or warm pack. We found that brain activity in the N2 (200-340ms) and P3 (400-600ms) time windows over the frontal/central region was positively shifted by painful (vs. neutral) expressions. Moreover, the N2/P3 empathic neural responses were significantly larger for same-race than other-race faces in the cold but not in the warm condition. Moreover, subjective ratings of different temperatures in the cold vs. warm conditions predicted larger changes of racial in-group bias in empathic neural responses in the N2 time window. Our findings suggest that sensory experiences of physical coldness can strengthen emotional resonance with same-race individuals.

Early Left Parietal Activity Elicited by Direct Gaze: A High-Density EEG Study

Gaze is one of the most important cues for human communication and social interaction. In particular, gaze contact is the most primary form of social contact and it is thought to capture attention. A very early-differentiated brain response to direct versus averted gaze has been hypothesized. Here, we used high-density electroencephalography to test this hypothesis. Topographical analysis allowed us to uncover a very early topographic modulation (40-80 ms) of event-related responses to faces with direct as compared to averted gaze. This modulation was obtained only in the condition where intact broadband faces-as opposed to high-pass or low-pas filtered faces-were presented. Source estimation indicated that this early modulation involved the posterior parietal region, encompassing the left precuneus and inferior parietal lobule. This supports the idea that it reflected an early orienting response to direct versus averted gaze. Accordingly, in a follow-up behavioural experiment, we found faster response times to the direct gaze than to the averted gaze broadband faces. In addition, classical evoked potential analysis showed that the N170 peak amplitude was larger for averted gaze than for direct gaze. Taken together, these results suggest that direct gaze may be detected at a very early processing stage, involving a parallel route to the ventral occipito-temporal route of face perceptual analysis.

Face identity is encoded in the duration of N170 adaptation

Previous studies assessing the involvement of the face-sensitive N170 component of the event-related potential (ERP) in the processing of face identity have shown controversial results when assessing N170 amplitude in repetition suppression (RS) designs. On the other hand, N170 adaptation is robustly associated with the inter-stimulus interval (ISI) between immediate face repetitions. Interestingly, interactions of face identity and ISI could provide valuable information on early encoding of face identity, but have not been investigated so far. We employed a repetition suppression paradigm using identical and non-identical repetitions as well as parametrically varied ISIs between 500 msec and 2,000 msec in 27 healthy subjects to investigate N170 adaptation effects. Both face identity and varying ISIs significantly influenced N170 adaptation effects, albeit with small effects sizes. Most importantly, however, face identity and ISIs strongly interacted with rapid N170 amplitude recovery in non-identical trials, but sustained N170 adaptation in identical trials. We excluded low-level sensory contributions to the N170 adaptation effect by analyzing the P1 component and by running an additional experiment employing different stimulus sizes. This specific result strongly argues in favor of neuronal sensitivity to face identity, which is primarily mirrored in the N170 temporal decay function that essentially differentiates identical and non-identical face trials. In general, taking advantage of the temporal dimension of adaptation processes, i.e., their decay over time, provides additional dissections of neuronal function into feature-specific selectivity versus non-selectivity.

Dissociating Attention Effects from Categorical Perception with ERP Functional Microstates

When faces appear in our visual environment we naturally attend to them, possibly to the detriment of other visual information. Evidence from behavioural studies suggests that faces capture attention because they are more salient than other types of visual stimuli, reflecting a category-dependent modulation of attention. By contrast, neuroimaging data has led to a domain-specific account of face perception that rules out the direct contribution of attention, suggesting a dedicated neural network for face perception. Here we sought to dissociate effects of attention from categorical perception using Event Related Potentials. Participants viewed physically matched face and butterfly images, with each category acting as a target stimulus during different blocks in an oddball paradigm. Using a data-driven approach based on functional microstates, we show that the locus of endogenous attention effects with ERPs occurs in the N1 time range. Earlier categorical effects were also found around the level of the P1, reflecting either an exogenous increase in attention towards face stimuli, or a putative face-selective measure. Both category and attention effects were dissociable from one another hinting at the role that faces may play in early capturing of attention before top-down control of attention is observed. Our data support the conclusion that certain object categories, in this experiment, faces, may capture attention before top-down voluntary control of attention is initiated.

Facial Cosmetics Exert a Greater Influence on Processing of the Mouth Relative to the Eyes: Evidence from the N170 Event-Related Potential Component

Cosmetic makeup significantly influences facial perception. Because faces consist of similar physical structures, cosmetic makeup is typically used to highlight individual features, particularly those of the eyes (i.e., eye shadow) and mouth (i.e., lipstick). Though event-related potentials have been utilized to study various aspects of facial processing, the influence of cosmetics on specific ERP components remains unclear. The present study aimed to investigate the relationship between the application of cosmetic makeup and the amplitudes of the P1 and N170 event-related potential components during facial perception tasks. Moreover, the influence of visual perception on N170 amplitude, was evaluated under three makeup conditions: Eye Shadow, Lipstick, and No Makeup. Electroencephalography was used to monitor 17 participants who were exposed to visual stimuli under each these three makeup conditions. The results of the present study subsequently demonstrated that the Lipstick condition elicited a significantly greater N170 amplitude than the No Makeup condition, while P1 amplitude was unaffected by any of the conditions. Such findings indicate that the application of cosmetic makeup alters general facial perception but exerts no influence on the perception of low-level visual features. Collectively, these results support the notion that the application of makeup induces subtle alterations in the processing of facial stimuli, with a particular effect on the processing of specific facial components (i.e., the mouth), as reflected by changes in N170 amplitude.

Judging Normality and Attractiveness in Faces: Direct Evidence of a More Refined Representation for Own-Race, Young Adult Faces

Young and older adults are more sensitive to deviations from normality in young than older adult faces, suggesting that the dimensions of face space are optimized for young adult faces. Here, we extend these findings to own-race faces and provide converging evidence using an attractiveness rating task. In Experiment 1, Caucasian and Chinese adults were shown own- and other-race face pairs; one member was undistorted and the other had compressed or expanded features. Participants indicated which member of each pair was more normal (a task that requires referencing a norm) and which was more expanded (a task that simply requires discrimination). Participants showed an own-race advantage in the normality task but not the discrimination task. In Experiment 2, participants rated the facial attractiveness of own- and other-race faces (Experiment 2a) or young and older adult faces (Experiment 2b). Between-rater variability in ratings of individual faces was higher for other-race and older adult faces; reduced consensus in attractiveness judgments reflects a less refined face space. Collectively, these results provide direct evidence that the dimensions of face space are optimized for own-race and young adult faces, which may underlie face race- and age-based deficits in recognition.

The Sound of Vision Project: On the Feasibility of an Audio-Haptic Representation of the Environment, for the Visually Impaired

The Sound of Vision project involves developing a sensory substitution device that is aimed at creating and conveying a rich auditory representation of the surrounding environment to the visually impaired. However, the feasibility of such an approach is strongly constrained by neural flexibility, possibilities of sensory substitution and adaptation to changed sensory input. We review evidence for such flexibility from various perspectives. We discuss neuroplasticity of the adult brain with an emphasis on functional changes in the visually impaired compared to sighted people. We discuss effects of adaptation on brain activity, in particular short-term and long-term effects of repeated exposure to particular stimuli. We then discuss evidence for sensory substitution such as Sound of Vision involves, while finally discussing evidence for adaptation to changes in the auditory environment. We conclude that sensory substitution enterprises such as Sound of Vision are quite feasible in light of the available evidence, which is encouraging regarding such projects.

Degraded perceptual and affective processing of racial out-groups: An electrophysiological approach

Human beings process perceptual and affective information of racial out-groups in a degraded manner. Relative to racial in-group members, we lack perceptual individuation of racial out-group members and empathize their pain to a less degree. To date, however, the relationship between the deficiency of individuation and the impairment of empathy in responding to racial out-groups remains elusive. By recording event-related brain potentials in response to racial in-group and out-group faces portraying pain and neutral expressions, we simultaneously measured neural activity that underpinned individuation and empathy. Deficiency in individuating members of racial out-groups, manifesting as reduced reactivity of face-sensitive N170 in the occipitotemporal region of the brain, predicted attenuation of fronto-central empathic response to the suffering of racial out-groups. Further, the individuation bias mediated the influence of racial prejudice on racial in-group bias in empathic neural responses. These findings suggest an interplay between degraded perceptual and affective processing of racial out-groups.

Super-Memorizers Are Not Super-Recognizers

Humans have a natural expertise in recognizing faces. However, the nature of the interaction between this critical visual biological skill and memory is yet unclear. Here, we had the unique opportunity to test two individuals who have had exceptional success in the World Memory Championships, including several world records in face-name association memory. We designed a range of face processing tasks to determine whether superior/expert face memory skills are associated with distinctive perceptual strategies for processing faces. Superior memorizers excelled at tasks involving associative face-name learning. Nevertheless, they were as impaired as controls in tasks probing the efficiency of the face system: face inversion and the other-race effect. Super memorizers did not show increased hippocampal volumes, and exhibited optimal generic eye movement strategies when they performed complex multi-item face-name associations. Our data show that the visual computations of the face system are not malleable and are robust to acquired expertise involving extensive training of associative memory.

Cross-cultural differences and similarities underlying other-race effects for facial identity and expression

Perceptual advantages for own-race compared to other-race faces have been demonstrated for the recognition of facial identity and expression. However, these effects have not been investigated in the same study with measures that can determine the extent of cross-cultural agreement as well as differences. To address this issue, we used a photo sorting task in which Chinese and Caucasian participants were asked to sort photographs of Chinese or Caucasian faces by identity or by expression. This paradigm matched the task demands of identity and expression recognition and avoided constrained forced-choice or verbal labelling requirements. Other-race effects of comparable magnitude were found across the identity and expression tasks. Caucasian participants made more confusion errors for the identities and expressions of Chinese than Caucasian faces, while Chinese participants made more confusion errors for the identities and expressions of Caucasian than Chinese faces. However, analyses of the patterns of responses across groups of participants revealed a considerable amount of underlying cross-cultural agreement. These findings suggest that widely repeated claims that members of other cultures "all look the same" overstate the cultural differences.