Covert recognition and the neural system for face processing

Pupil dilation reflects covert familiar face recognition under interocular suppression

In prosopagnosia, brain lesions impair overt face recognition, but not face detection, and may coexist with residual covert recognition of familiar faces. Previous studies that simulated covert recognition in healthy individuals have impaired face detection as well as recognition, thus not fully mirroring the deficits in prosopagnosia. We evaluated a model of covert recognition based on continuous flash suppression (CFS). Familiar and unfamiliar faces and houses were masked while participants performed two discrimination tasks. With increased suppression, face/house discrimination remained largely intact, but face familiarity discrimination deteriorated. Covert recognition was present across all masking levels, evinced by higher pupil dilation to familiar than unfamiliar faces. Pupil dilation was uncorrelated with overt performance across subjects. Thus, CFS can impede overt face recognition without disrupting covert recognition and face detection, mirroring critical features of prosopagnosia. CFS could be used to uncover shared neural mechanisms of covert recognition in prosopagnosic patients and neurotypicals.

Explicit face memory abilities are positively related to the non-intentional encoding of faces: Behavioral and ERP evidence

Individual differences in face memory abilities have been shown to be related to individual differences in brain activity. The present study investigated brain-behavior relationships for the N250 component in event-related brain potentials, which is taken as a neural sign of face familiarity. We used a task in which a designated, typical target face and several (high- and low-distinctive) nontarget faces had to be distinguished during multiple presentations across a session. Separately, face memory/recognition abilities were measured with easy versus difficult tasks. We replicated an increase of the N250 amplitude to the target face across the session and observed a similar increase for the non-target faces, indicating the build-up of memory representations also for these faces. On the interindividual level, larger across-session N250 amplitude increases to low-distinctive non-target faces were related to faster face recognition as measured in an easy task. These findings indicate that non-intentional encoding of non-target faces into memory is associated with the swift recognition of explicitly learned faces; that is, there is shared variance of incidental and intentional face memory.

Developing familiarity during the first eight months of knowing a person: A longitudinal EEG study on face and identity learning

It is well-established that familiar and unfamiliar faces are processed differently, but surprisingly little is known about how familiarity builds up over time and how novel faces gradually become represented in the brain. Here, we used event-related brain potentials (ERPs) in a pre-registered, longitudinal study to examine the neural processes accompanying face and identity learning during the first eight months of knowing a person. Specifically, we examined how increasing real-life familiarity affects visual recognition (N250 Familiarity Effect) and the integration of person-related knowledge (Sustained Familiarity Effect, SFE). Sixteen first-year undergraduates were tested in three sessions, approximately one, five, and eight months after the start of the academic year, with highly variable "ambient" images of a new friend they had met at university and of an unfamiliar person. We observed clear ERP familiarity effects for the new friend after one month of familiarity. While there was an increase in the N250 effect over the course of the study, no change in the SFE was observed. These results suggest that visual face representations develop faster relative to the integration of identity-specific knowledge.

Provoked overt recognition in acquired prosopagnosia using multiple different images of famous faces

Provoked overt recognition refers to the fact that patients with acquired prosopagnosia can sometimes recognize faces when presented in arrays of individuals from the same category (e.g., actors or politicians). We ask whether a prosopagnosic patient might experience recognition when presented with multiple different images of the same face simultaneously. Over two sessions, patient Herschel, a 66-year-old British man with acquired prosopagnosia, viewed face images individually or in arrays. On several occasions he failed to recognize single photos of an individual but successfully identified that person when the same photos were presented together. For example, Herschel failed to recognize any individual images of King Charles or Paul McCartney but recognised both in arrays of the same photos. Like reports based on category membership, overt recognition was transient and inconsistent. These findings are discussed in terms of models of covert recognition, alongside more recent research on within-person variability for face perception.

Electrophysiological Correlates of Romantic Love: A Review of EEG and ERP Studies with Beloved-Related Stimuli

Science is starting to unravel the neural basis of romantic love. The goal of this literature review was to identify and interpret the electrophysiological correlates of romantic love. Electroencephalography (EEG) and event-related potential (ERP) studies with a design that elicits romantic love feelings were included. The methods of previous EEG studies are too heterogeneous to draw conclusions. Multiple ERP studies, however, have shown that beloved stimuli elicit an enhanced late positive potential (LPP/P3/P300), which is not due to familiarity, positive valence, or objective beauty. This effect occurs in Western and Eastern cultures and for pictorial and verbal information, and results from bottom-up rather than top-down factors. Studies have also shown that beloved stimuli elicit an early posterior negativity (EPN), which also does not seem to be due to familiarity or positive valence. Data on earlier ERP components (P1, N1, P2, N170/VPP, N2) is scarce and mixed. Of course, the enhanced LPP and EPN are not specific to romantic love. Instead, they suggest that the beloved captures early attention, within 200–300 ms after stimulus onset that is relatively resource-independent, and subsequently receives sustained motivated attention. Future research would benefit from employing cognitive tasks and testing participants who are in love regardless of relationship status.

Visual adaptation and 7T fMRI reveal facial identity processing in the human brain under shallow interocular suppression

Face identity is represented at a high level of the visual hierarchy. Whether the human brain can process facial identity information in the absence of visual awareness remains unclear. In this study, we investigated potential face identity representation through face-identity adaptation with the adapting faces interocularly suppressed by Continuous Flash Suppression (CFS) noise, a modified binocular rivalry paradigm. The strength of interocular suppression was manipulated by varying the contrast of CFS noise. While obeservers reported the face images subjectively unperceived and the face identity objectively unrecognizable, a significant face identity aftereffect was observed under low but not high contrast CFS noise. In addition, the identity of face images under shallow interocular suppression can be decoded from multi-voxel patterns in the right fusiform face area (FFA) obtained with high-resolution 7T fMRI. Thus the comined evidence from visual adaptation and 7T fMRI suggest that face identity can be represented in the human brain without explicit perceptual recognition. The processing of interocularly suppressed faces could occur at different levels depending on how "deep" the information is suppressed.

The reliability of visual ERP components in children across the first year of school

Event-related potentials (ERPs) are increasingly used as neurophysiological markers of perceptual and cognitive processes conveying risk for psychopathology. However, little is known about the reliability of ERP components during childhood, a time of substantial brain maturation. In the present study, we examine the early visual ERP components (P1, N170, VPP), frequently examined as indicators of attentional bias, for 110 children at kindergarten (T1) and first grade (T2). Children performed a Go/Nogo task at both time points, with exact stimuli changed to reduce habituation. All components showed increases in absolute amplitude and the P1 and VPP also showed decreases in latency. Retest reliability across time was good to very good for amplitude measures (Pearson rs ranging from .54 for N170 to .69 for P1) and low to very good for latencies (rs from .34 for P1 to .60 for N170), despite the change in visual stimuli. Although there was some evidence of moderation by sex, early visual ERP components appear to be a reliable measure of individual differences in attention processing in middle childhood. This has implications for the use of early visual ERP components as trait-like markers for individual differences in perceptual processes in developmental research.

Inhibition of the occipital face area modulates the electrophysiological signals of face familiarity: A combined cTBS-EEG study

The occipital face area (OFA) is hierarchically one of the first stages of the face processing network. It has originally been thought to be involved in early, structural processing steps, but currently more and more studies challenge this view and propose that it also takes part in higher level face processing, such as identification and recognition. Here we tested whether the OFA is involved in the initial steps of recognition memory and plays a causal role in the differential processing of familiar and unfamiliar faces. We used an offline, inhibitory continuous theta-burst stimulation (cTBS) protocol over the right OFA and the vertex as control site. Electroencephalographic (EEG) recording of event-related potentials (ERPs), elicited by visually presented familiar (famous) and unfamiliar faces was performed before and after stimulation. We observed a difference in ERPs for famous and unfamiliar faces in a time-window corresponding to the N250 component. Importantly, this difference was significantly increased by cTBS of the right OFA, suggesting its causal role in the differential processing of familiar and unfamiliar faces. The enhancement occurred focally, at electrodes close to the right hemispheric cTBS site, as well as over similar occipito-temporal sites of the contralateral hemisphere. To the best of our knowledge, this is the first study showing the causal role of the rOFA in the differential processing of familiar and unfamiliar faces, using combined cTBS and EEG recording methods. These results are discussed with respect to the nature of familiar face representations, supported by an extensive, bilateral network.

Prosopagnosia and disorders of face processing

Face recognition is a form of expert visual processing. Acquired prosopagnosia is the loss of familiarity for facial identity and has several functional variants, namely apperceptive, amnestic, and associative forms. Acquired forms are usually caused by either occipitotemporal or anterior temporal lesions, right or bilateral in most cases. In addition, there is a developmental form, whose functional and structural origins are still being elucidated. Despite their difficulties with recognizing faces, some of these subjects still show signs of covert recognition, which may have a number of explanations. Other aspects of face perception can be spared in prosopagnosic subjects. Patients with other types of face processing difficulties have been described, including impaired expression processing, impaired lip-reading, false familiarity for faces, and a people-specific amnesia. Recent rehabilitative studies have shown some modest ability to improve face perception in prosopagnosic subjects through perceptual training protocols.

Nonverbal auditory communication - Evidence for integrated neural systems for voice signal production and perception

While humans have developed a sophisticated and unique system of verbal auditory communication, they also share a more common and evolutionarily important nonverbal channel of voice signaling with many other mammalian and vertebrate species. This nonverbal communication is mediated and modulated by the acoustic properties of a voice signal, and is a powerful - yet often neglected - means of sending and perceiving socially relevant information. From the viewpoint of dyadic (involving a sender and a signal receiver) voice signal communication, we discuss the integrated neural dynamics in primate nonverbal voice signal production and perception. Most previous neurobiological models of voice communication modelled these neural dynamics from the limited perspective of either voice production or perception, largely disregarding the neural and cognitive commonalities of both functions. Taking a dyadic perspective on nonverbal communication, however, it turns out that the neural systems for voice production and perception are surprisingly similar. Based on the interdependence of both production and perception functions in communication, we first propose a re-grouping of the neural mechanisms of communication into auditory, limbic, and paramotor systems, with special consideration for a subsidiary basal-ganglia-centered system. Second, we propose that the similarity in the neural systems involved in voice signal production and perception is the result of the co-evolution of nonverbal voice production and perception systems promoted by their strong interdependence in dyadic interactions.

Involvement of the primary motor cortex in the early processing stage of the affective stimulus-response compatibility effect in a manikin task

Compatible (positive approaching and negative avoiding) and incompatible (positive avoiding and negative approaching) behavior are of great significance for biological adaptation and survival. Previous research has found that reaction times of compatible behavior are shorter than the incompatible behavior, which is termed the stimulus-response compatibility (SRC) effect. However, the underlying neurophysiological mechanisms of the SRC effect applied to affective stimuli is still unclear. Here, we investigated preparatory activities in both the left and right primary motor cortex (M1) before the execution of an approaching-avoiding behavior using the right index finger in a manikin task based on self-identity. The results showed significantly shorter reaction times for compatible than incompatible behavior. Most importantly, motor-evoked potential (MEP) amplitudes from left M1 stimulation were significantly higher during compatible behavior than incompatible behavior at 150 and 200 ms after stimulus presentation, whereas the reversed was observed for right M1 stimulation with lower MEP amplitude in compatible compared to incompatible behavior at 150 ms. The current findings revealed the compatibility effect at both behavioral and neurophysiological levels, indicating that the affective SRC effect occurs early in the motor cortices during stimulus processing, and MEP modulation at this early processing stage could be a physiological marker of the affective SRC effect.

Sad expressions during encoding attenuate recognition of facial identity in visual working memory: behavioural and electrophysiological evidence

The current study investigated how sad expressions during encoding affected recognition of facial identity in visual working memory (WM) and its electrophysiological correlates. Event-related potentials were obtained from 36 individuals during a delayed face discrimination task. The hit (correctly recognising studied faces) rates, correct rejection (CR: correctly rejecting unstudied faces) rates, sensitivity d' (discrimination power of face identity recognition), and N170 (150-200 ms), the vertex positive potential (VPP; 150-200 ms), N250 (250-300 ms), P3b (350-450 ms), and late positive potential (LPP; 550-800 ms) amplitudes elicited by the neutral probe faces (previously encoded with sad and happy expressions) during hits and CR conditions were analysed. The participants showed lower hits and CRs and therefore had a lower discrimination power for facial identity preceded by sad expressions compared to happy expressions. For hits, neutral probe faces previously encoded with sad expressions exhibited increased N170, VPP, N250, P3b and LPP amplitudes compared to amplitudes following encoding with happy expressions. For correct rejections, the ERP effect of sad/happy expressions was absent. These results indicate that sad expressions during encoding attenuated the recognition of facial identity in visual WM. The reduced facial identity recognition for previously encoded sad expressions may be associated with increased early structural encoding, more late attention and perceptual resource engagement.

Age-related changes in amplitude, latency and specialization of ERP responses to faces and watches

Healthy aging is associated with impairments in face recognition. While earlier research suggests that these impairments arise during memory retrieval, more recent findings suggest that earlier mechanisms, at the perceptual stage, may also be at play. However, results are often inconsistent and very few studies have included a non-face control stimulus to facilitate interpretation of results with respect to the implication of specialized face mechanisms vs. general cognitive factors. To address these issues, P100, N170 and P200 event-related potentials (ERPs) were measured during processing of faces and watches. For faces, age-related differences were found for P100, N170 and P200 ERPs. For watches, age-related differences were found for N170 and P200 ERPs. Older adults showed less selective and less lateralized N170 responses to faces, suggesting that ERPs can detect age-related de-differentiation of specialized face networks. We conclude that age-related impairments in face recognition arise in part from difficulties in the earliest perceptual stages of visual information processing. A working model is presented based on coarse-to-fine analysis of visually similar exemplars.

Multisensory stimulation modulates perceptual and post perceptual face representations: Evidence from event-related potentials

Seeing a face being touched in spatial and temporal synchrony with the own face produces a bias in self-recognition, whereby the other face becomes more likely to be perceived as the self. The present study employed event-related potentials to explore whether this enfacement effect reflects initial face encoding, enhanced distinctiveness of the enfaced face, modified self-identity representations, or even later processing stages that are associated with the emotional processing of faces. Participants were stroked in synchrony or asynchrony with an unfamiliar face they observed on a monitor in front of them, in a situation approximating a mirror image. Subsequently, event-related potentials were recorded during the presentation of (a) a previously synchronously stimulated face, (b) an asynchronously stimulated face, (c) observers' own face, (d) filler faces, and (e) a to-be-detected target face, which required a response. Observers reported a consistent enfacement illusion after synchronous stimulation. Importantly, the synchronously stimulated face elicited more prominent N170 and P200 responses than the asynchronously stimulated face. By contrast, similar N250 and P300 responses were observed in these conditions. These results suggest that enfacement modulates early neural correlates of face encoding and facial prototypicality, rather than identity self-representations and associated emotional processes.

Learning own- and other-race facial identities: Testing implicit recognition with event-related brain potentials

Exposure to varying images of the same person can encourage the formation of a representation that is sufficiently robust to allow recognition of previously unseen images of this person. While behavioural work suggests that face identity learning is harder for other-race faces, the present experiment investigated the neural correlates underlying own- and other-race face learning. Participants sorted own- and other-race identities into separate identity clusters and were further familiarised with these identities in a matching task. Subsequently, we compared event-related brain potentials (ERPs) in an implicit recognition (butterfly detection) task for learnt and previously unseen identities. We observed better sorting and matching for own- than other-race identities, and behavioural learning effects were restricted to own-race identities. Similarly, the N170 ERP component showed clear learning effects for own-race faces only. The N250, a component more closely associated with face learning was more negative for learnt than novel identities. ERP findings thus suggests a processing advantage for own-race identities at an early perceptual level whereas later correlates of identity learning were unaffected by ethnicity. These results suggest learning advantages for own-race identities, which underscores the importance of perceptual expertise in the own-race bias.

A Robust Neural Index of High Face Familiarity

Humans are remarkably accurate at recognizing familiar faces, whereas their ability to recognize, or even match, unfamiliar faces is much poorer. However, previous research has failed to identify neural correlates of this striking behavioral difference. Here, we found a clear difference in brain potentials elicited by highly familiar faces versus unfamiliar faces. This effect starts 200 ms after stimulus onset and reaches its maximum at 400 to 600 ms. This sustained-familiarity effect was substantially larger than previous candidates for a neural familiarity marker and was detected in almost all participants, representing a reliable index of high familiarity. Whereas its scalp distribution was consistent with a generator in the ventral visual pathway, its modulation by repetition and degree of familiarity suggests an integration of affective and visual information.

Use-inspired basic research on individual differences in face identification: implications for criminal investigation and security

This journal is dedicated to "use-inspired basic research" where a problem in the world shapes the hypotheses for study in the laboratory. This review considers the role of individual variation in face identification and the challenges and opportunities this presents in security and criminal investigations. We show how theoretical work conducted on individual variation in face identification has, in part, been stimulated by situations presented in the real world. In turn, we review the contribution of theoretical work on individual variation in face processing and how this may help shape the practical identification of faces in applied situations. We consider two cases in detail. The first case is that of security officers; gatekeepers who use facial ID to grant entry or deny access. One applied example, where much research has been conducted, is passport control officers who are asked to match a person in front of them to a photograph shown on their ID. What happens if they are poor at making such face matching decisions and can they be trained to improve their performance? Second, we outline the case of "super-recognisers", people who are excellent at face recognition. Here it is interesting to consider whether these individuals can be strategically allocated to security and criminal roles, to maximise the identification of suspects. We conclude that individual differences are one of the largest documented sources of error in face matching and face recognition but more work is needed to account for these differences within theoretical models of face processing.

Individual differences in eyewitness accuracy across multiple lineups of faces

Theories of face recognition in cognitive psychology stipulate that the hallmark of accurate identification is the ability to recognize a person consistently, across different encounters. In this study, we apply this reasoning to eyewitness identification by assessing the recognition of the same target person repeatedly, over six successive lineups. Such repeat identifications are challenging and can be performed only by a proportion of individuals, both when a target exhibits limited and more substantial variability in appearance across lineups (Experiments 1 and 2). The ability to do so correlates with individual differences in identification accuracy on two established tests of unfamiliar face recognition (Experiment 3). This indicates that most observers have limited facial representations of target persons in eyewitness scenarios, which do not allow for robust identification in most individuals, partly due to limitations in their ability to recognize unfamiliar faces. In turn, these findings suggest that consistency of responses across multiple lineups of faces could be applied to assess which individuals are accurate eyewitnesses.

Early identity recognition of familiar faces is not dependent on holistic processing

It is widely accepted that holistic processing is critical for early face recognition, but recent work has suggested a larger role for feature-based processing. The earliest step in familiar face recognition is thought to be matching a perceptual representation of a familiar face to a stored representation of that face, which is thought to be indexed by the N250r event-related potential (ERP). In the current face-priming studies, we investigated whether this perceptual representation can be effectively activated by feature-based processing. In the first experiment, prime images were familiar whole faces, isolated eyes or isolated mouths. Whole faces and isolated eyes, but not isolated mouths, effectively modulated the N250r. In the second experiment, prime images were familiar whole faces presented either upright or inverted. Inverted face primes were no less effective than upright face primes in modulating the N250r. Together, the results of these studies indicate that activation of the earliest face recognition processes is not dependent on holistic processing of a typically configured face. Rather, feature-based processing can effectively activate the perceptual memory of a familiar face. However, not all features are effective primes as we found eyes, but not mouths, were effective in activating early face recognition.

Enhancement of face-sensitive ERPs in older adults induced by face recognition training

A common cognitive problem reported by older people is compromised face recognition, which is often paralleled by age-related changes in face-sensitive and memory-related components in event-related brain potentials (ERPs). We developed a new training using photorealistic caricatures based on evidence that caricatures are beneficial for people with compromised face processing. Twenty-four older participants (62-75 yrs, 13 female) completed 12 training sessions (3 per week, 60 min each) and 24 older participants (61-76 yrs, 12 female) acted as controls. Before and after training (or waiting), participants took part in a diagnostic test battery for face processing abilities, and in ERP experiments on face learning and recognition. Although performance improvements during the training provided little evidence for generalization to other face processing tasks, ERPs showed substantial training-related enhancements of face-sensitive ERPs. Specifically, we observed marked increases of the N170, P200 and N250 components, which may indicate training-induced enhancement of face detection and activation of identity-specific representations. Thus, neuronal correlates of face processing are plastic in older age, and can be modulated by caricature training.

Same-gender distractors are not so easy to reject: ERP evidence of gender categorization

Social categorization appears to be an automatic process that occurs during person perception. Understanding social categorization better is important because mere categorization can lead to stereotype activation and, in turn, to discrimination. In the present study we used a novel approach to examine event-related potentials (ERPs) of gender categorization in the “Who said what?” memory paradigm, thus allowing for a more in-depth understanding of the specific mechanisms underlying identity versus categorization processing. After observing video clips showing a “discussion” among female and male targets, participants were shown individual statements, each accompanied by one of the discussants’ faces. While we measured ERPs, participants had to decide whether or not a given statement had previously been made by the person with the accompanying face. In same-person trials, statements were paired with the correct person, whereas in the distractor trials, either a same-gender or a different-gender distractor was shown. As expected, participants were able to reject different-gender distractors faster than same-gender distractors, and they were more likely to falsely choose yes for a same-gender than for a different-gender distractor. Both findings indicate gender-based categorization. ERPs, analyzed in a 300- to 400-ms time window at occipito-temporal channels, indicated more negative amplitudes for yes responses both for the same person and for same-gender distractors, relative to different-gender distractors. Overall, these results show gender-based categorization even when the task was to assess the identifying information in a gender-neutral context. These findings are interpreted as showing that gender categorization occurs automatically during person perception, but later than race- or age-based categorization.

Source Reconstruction of Brain Potentials Using Bayesian Model Averaging to Analyze Face Intra-Domain vs. Face-Occupation Cross-Domain Processing

We investigated the neural correlates of the access to and retrieval of face structure information in contrast to those concerning the access to and retrieval of person-related verbal information, triggered by faces. We experimentally induced stimulus familiarity via a systematic learning procedure including faces with and without associated verbal information. Then, we recorded event-related potentials (ERPs) in both intra-domain (face-feature) and cross-domain (face-occupation) matching tasks while N400-like responses were elicited by incorrect eyes-eyebrows completions and occupations, respectively. A novel Bayesian source reconstruction approach plus conjunction analysis of group effects revealed that in both cases the generated N170s were of similar amplitude but had different neural origin. Thus, whereas the N170 of faces was associated predominantly to right fusiform and occipital regions (the so-called “Fusiform Face Area”, “FFA” and “Occipital Face Area”, “OFA”, respectively), the N170 of occupations was associated to a bilateral very posterior activity, suggestive of basic perceptual processes. Importantly, the right-sided perceptual P200 and the face-related N250 were evoked exclusively in the intra-domain task, with sources in OFA and extensively in the fusiform region, respectively. Regarding later latencies, the intra-domain N400 seemed to be generated in right posterior brain regions encompassing mainly OFA and, to some extent, the FFA, likely reflecting neural operations triggered by structural incongruities. In turn, the cross-domain N400 was related to more anterior left-sided fusiform and temporal inferior sources, paralleling those described previously for the classic verbal N400. These results support the existence of differentiated neural streams for face structure and person-related verbal processing triggered by faces, which can be activated differentially according to specific task demands.

Face-to-face: Perceived personal relevance amplifies face processing

The human face conveys emotional and social information, but it is not well understood how these two aspects influence face perception. In order to model a group situation, two faces displaying happy, neutral or angry expressions were presented. Importantly, faces were either facing the observer, or they were presented in profile view directed towards, or looking away from each other. In Experiment 1 (n = 64), face pairs were rated regarding perceived relevance, wish-to-interact, and displayed interactivity, as well as valence and arousal. All variables revealed main effects of facial expression (emotional > neutral), face orientation (facing observer > towards > away) and interactions showed that evaluation of emotional faces strongly varies with their orientation. Experiment 2 (n = 33) examined the temporal dynamics of perceptual-attentional processing of these face constellations with event-related potentials. Processing of emotional and neutral faces differed significantly in N170 amplitudes, early posterior negativity (EPN), and sustained positive potentials. Importantly, selective emotional face processing varied as a function of face orientation, indicating early emotion-specific (N170, EPN) and late threat-specific effects (LPP, sustained positivity). Taken together, perceived personal relevance to the observer-conveyed by facial expression and face direction-amplifies emotional face processing within triadic group situations.

Manifold decoding for neural representations of face viewpoint and gaze direction using magnetoencephalographic data

The main challenge in decoding neural representations lies in linking neural activity to representational content or abstract concepts. The transformation from a neural-based to a low-dimensional representation may hold the key to encoding perceptual processes in the human brain. In this study, we developed a novel model by which to represent two changeable features of faces: face viewpoint and gaze direction. These features are embedded in spatiotemporal brain activity derived from magnetoencephalographic data. Our decoding results demonstrate that face viewpoint and gaze direction can be represented by manifold structures constructed from brain responses in the bilateral occipital face area and right superior temporal sulcus, respectively. Our results also show that the superposition of brain activity in the manifold space reveals the viewpoints of faces as well as directions of gazes as perceived by the subject. The proposed manifold representation model provides a novel opportunity to gain further insight into the processing of information in the human brain.

Self- or familiar-face recognition advantage? New insight using ambient images

Self-face recognition has been widely explored in the past few years. Nevertheless, the current literature relies on the use of standardized photographs which do not represent daily-life face recognition. Therefore, we aim for the first time to evaluate self-face processing in healthy individuals using natural/ambient images which contain variations in the environment and in the face itself. In total, 40 undergraduate and graduate students performed a forced delayed-matching task, including images of one's own face, friend, famous and unknown individuals. For both reaction time and accuracy, results showed that participants were faster and more accurate when matching different images of their own face compared to both famous and unfamiliar faces. Nevertheless, no significant differences were found between self-face and friend-face and between friend-face and famous-face. They were also faster and more accurate when matching friend and famous faces compared to unfamiliar faces. Our results suggest that faster and more accurate responses to self-face might be better explained by a familiarity effect - that is, (1) the result of frequent exposition to one's own image through mirror and photos, (2) a more robust mental representation of one's own face and (3) strong face recognition units as for other familiar faces.

Event-related potentials reveal the development of stable face representations from natural variability

Natural variability between instances of unfamiliar faces can make it difficult to reconcile two images as the same person. Yet for familiar faces, effortless recognition occurs even with considerable variability between images. To explore how stable face representations develop, we employed incidental learning in the form of a face sorting task. In each trial, multiple images of two facial identities were sorted into two corresponding piles. Following the sort, participants showed evidence of having learnt the faces performing more accurately on a matching task with seen than with unseen identities. Furthermore, ventral temporal event-related potentials were more negative in the N250 time range for previously seen than for previously unseen identities. These effects appear to demonstrate some degree of abstraction, rather than simple picture learning, as the neurophysiological and behavioural effects were observed with novel images of the previously seen identities. The results provide evidence of the development of facial representations, allowing a window onto natural mechanisms of face learning.

Low-frequency oscillations employ a general coding of the spatio-temporal similarity of dynamic faces

Brain networks use neural oscillations as information transfer mechanisms. Although the face perception network in occipitotemporal cortex is well-studied, contributions of oscillations to face representation remain an open question. We tested for links between oscillatory responses that encode facial dimensions and the theoretical proposal that faces are encoded in similarity-based "face spaces". We quantified similarity-based encoding of dynamic faces in magnetoencephalographic sensor-level oscillatory power for identity, expression, physical and perceptual similarity of facial form and motion. Our data show that evoked responses manifest physical and perceptual form similarity that distinguishes facial identities. Low-frequency induced oscillations (< 20Hz) manifested more general similarity structure, which was not limited to identity, and spanned physical and perceived form and motion. A supplementary fMRI-constrained source reconstruction implicated fusiform gyrus and V5 in this similarity-based representation. These findings introduce a potential link between "face space" encoding and oscillatory network communication, which generates new hypotheses about the potential oscillation-mediated mechanisms that might encode facial dimensions.

Can Gaze-Contingent Mirror-Feedback from Unfamiliar Faces alter Self-Recognition?

This study focuses on learning of the self, by examining how human observers update internal representations of their own face. For this purpose, we present a novel gaze-contingent paradigm, in which an onscreen face mimics observers’ own eye-gaze behaviour (in the congruent condition), moves its eyes in different directions to that of the observers (incongruent condition), or remains static and unresponsive (neutral condition). Across three experiments, the mimicry of the onscreen face did not affect observers’ perceptual self-representations. However, this paradigm influenced observers’ reports of their own face. This effect was such that observers felt the onscreen face to be their own and that, if the onscreen gaze had moved on its own accord, observers expected their own eyes to move too. The theoretical implications of these findings are discussed.

Shared genetic influences among childhood shyness, social competences, and cortical responses to emotions

Visual event-related potentials (ERPs) evoked by facial expressions are useful to map socioemotional responses among shy children and to predict transition into social phobia. We investigated the sources of covariation among childhood shyness, social competences, and ERPs to other children's happy, neutral, and angry expressions. Electrophysiological and twin analyses examined the phenotypic and etiological association among an index of childhood shyness, an index of social competences, and ERP responses to facial expressions in 200 twins (mean age=9.23years). Multivariate twin analyses showed that the covariation among shyness, social competences, and a composite of a frontal late negative component occurring around 200-400ms in response to happy, neutral, and angry expressions could be entirely explained by shared genetic factors. A coherent causal structure links childhood shyness, social competences, and the cortical responses to facial emotions. A common genetic substrate can explain the interrelatedness of individual differences for childhood shyness, social competences, and some associated electrophysiological responses to socioemotional signals.

Elements of person knowledge: Episodic recollection helps us to identify people but not to recognize their faces

Faces automatically draw attention, allowing rapid assessments of personality and likely behaviour. How we respond to people is, however, highly dependent on whether we know who they are. According to face processing models person knowledge comes from an extended neural system that includes structures linked to episodic memory. Here we use scalp recorded brain signals to demonstrate the specific role of episodic memory processes during face processing. In two experiments we recorded Event-Related Potentials (ERPs) while participants made identify, familiar or unknown responses to famous faces. ERPs revealed neural signals previously associated with episodic recollection for identify but not familiar faces. These findings provide novel evidence suggesting that recollection is central to face processing, providing one source of person knowledge that can be used to moderate the initial impressions gleaned from the core neural system that supports face recognition.

Prosopagnosia: current perspectives

Prosopagnosia is a selective visual agnosia characterized by the inability to recognize the identity of faces. There are both acquired forms secondary to brain damage and developmental forms without obvious structural lesions. In this review, we first discuss the diagnosis of acquired and developmental prosopagnosia, and the challenges present in the latter case. Second, we discuss the evidence regarding the selectivity of the prosopagnosic defect, particularly in relation to the recognition of other objects, written words (another visual object category requiring high expertise), and voices. Third, we summarize recent findings about the structural and functional basis of prosopagnosia from studies using magnetic resonance imaging, functional magnetic resonance imaging, and event-related potentials. Finally, we discuss recent attempts at rehabilitation of face recognition in prosopagnosia.

Cortical Neural Synchronization Underlies Primary Visual Consciousness of Qualia: Evidence from Event-Related Potentials

This article reviews three experiments on event-related potentials (ERPs) testing the hypothesis that primary visual consciousness (stimulus self-report) is related to enhanced cortical neural synchronization as a function of stimulus features. ERP peak latency and sources were compared between "seen" trials and "not seen" trials, respectively related and unrelated to the primary visual consciousness. Three salient features of visual stimuli were considered (visuospatial, emotional face expression, and written words). Results showed the typical visual ERP components in both "seen" and "not seen" trials. There was no statistical difference in the ERP peak latencies between the "seen" and "not seen" trials, suggesting a similar timing of the cortical neural synchronization regardless the primary visual consciousness. In contrast, ERP sources showed differences between "seen" and "not seen" trials. For the visuospatial stimuli, the primary consciousness was related to higher activity in dorsal occipital and parietal sources at about 400 ms post-stimulus. For the emotional face expressions, there was greater activity in parietal and frontal sources at about 180 ms post-stimulus. For the written letters, there was higher activity in occipital, parietal and temporal sources at about 230 ms post-stimulus. These results hint that primary visual consciousness is associated with an enhanced cortical neural synchronization having entirely different spatiotemporal characteristics as a function of the features of the visual stimuli and possibly, the relative qualia (i.e., visuospatial, face expression, and words). In this framework, the dorsal visual stream may be synchronized in association with the primary consciousness of visuospatial and emotional face contents. Analogously, both dorsal and ventral visual streams may be synchronized in association with the primary consciousness of linguistic contents. In this line of reasoning, the ensemble of the cortical neural networks underpinning the single visual features would constitute a sort of multi-dimensional palette of colors, shapes, regions of the visual field, movements, emotional face expressions, and words. The synchronization of one or more of these cortical neural networks, each with its peculiar timing, would produce the primary consciousness of one or more of the visual features of the scene.

Gender differences in memory processing of female facial attractiveness: evidence from event-related potentials

High rates of agreement in the judgment of facial attractiveness suggest universal principles of beauty. This study investigated gender differences in recognition memory processing of female facial attractiveness. Thirty-four Chinese heterosexual participants (17 females, 17 males) aged 18-24 years (mean age 21.63 ± 1.51 years) participated in the experiment which used event-related potentials (ERPs) based on a study-test paradigm. The behavioral data results showed that both men and women had significantly higher accuracy rates for attractive faces than for unattractive faces, but men reacted faster to unattractive faces. Gender differences on ERPs showed that attractive faces elicited larger early components such as P1, N170, and P2 in men than in women. The results indicated that the effects of recognition bias during memory processing modulated by female facial attractiveness are greater for men than women. Behavioral and ERP evidences indicate that men and women differ in their attentional adhesion to attractive female faces; different mating-related motives may guide the selective processing of attractive men and women. These findings establish a contribution of gender differences on female facial attractiveness during memory processing from an evolutionary perspective.