Early electrophysiological correlates of adaptation to personally familiar and unfamiliar faces across viewpoint changes

Malleability of the sense of bodily self in early childhood: 5- and 6-year-old children show the enfacement illusion

The mechanisms underlying the developing sense of bodily self are debated. Whereas some scholars stress the role of sensory factors, others propose the importance of contextual factors. By manipulating multisensory stimulation and social familiarity with the other person, we explored two factors that are proposed to relate to young children's developing sense of bodily self. Including an adult sample allowed us to investigate age-related differences of the malleability of the bodily self. To this end, the study implemented an enfacement illusion with children (N = 64) and adults (N = 33). Participants were exposed to one trial with synchronous interpersonal multisensory stimulation and one trial with asynchronous interpersonal multisensory stimulation-either with a stranger or with the mother as the other person. A self-recognition task using morph videos of self and other and an enfacement questionnaire were implemented as dependent measures. Results revealed evidence for the presence of the enfacement effect in children in both measures. The identity of the other person had a significant effect on the self-recognition task. Contrary to our hypothesis, the effect was significantly smaller in the caregiver condition. No significant differences between children and adults emerged. Our results demonstrate the role of both multisensory stimulation and contextual-here social familiarity-factors for the construction and development of a bodily self. The study provides developmental science with a novel approach to the bodily self by showing the validity of the self-recognition task in a child sample. Overall, the study supports proposals that the sense of bodily self is malleable early in development.

The neural dynamics of familiarity-dependent face identity representation

Recognizing a face as belonging to a given identity is essential in our everyday life. Clearly, the correct identification of a face is only possible for familiar people, but 'familiarity' covers a wide range-from people we see every day to those we barely know. Although several studies have shown that the processing of familiar and unfamiliar faces is substantially different, little is known about how the degree of familiarity affects the neural dynamics of face identity processing. Here, we report the results of a multivariate EEG analysis, examining the representational dynamics of face identity across several familiarity levels. Participants viewed highly variable face images of 20 identities, including the participants' own face, personally familiar (PF), celebrity and unfamiliar faces. Linear discriminant classifiers were trained and tested on EEG patterns to discriminate pairs of identities of the same familiarity level. Time-resolved classification revealed that the neural representations of identity discrimination emerge around 100 ms post-stimulus onset, relatively independently of familiarity level. In contrast, identity decoding between 200 and 400 ms is determined to a large extent by familiarity: it can be recovered with higher accuracy and for a longer duration in the case of more familiar faces. In addition, we found no increased discriminability for faces of PF persons compared to those of highly familiar celebrities. One's own face benefits from processing advantages only in a relatively late time-window. Our findings provide new insights into how the brain represents face identity with various degrees of familiarity and show that the degree of familiarity modulates the available identity-specific information at a relatively early time window.

Detecting a viewer's familiarity with a face: Evidence from event-related brain potentials and classifier analyses

Human observers recognize the faces of people they know efficiently and without apparent effort. Consequently, recognizing a familiar face is often assumed to be an automatic process beyond voluntary control. However, there are circumstances in which a person might seek to hide their recognition of a particular face. The present study therefore used event-related potentials (ERPs) and a classifier based on logistic regression to determine if it is possible to detect whether a viewer is familiar with a particular face, regardless of whether the participant is willing to acknowledge it or not. In three experiments, participants were presented with highly variable "ambient" images of personally familiar and unfamiliar faces, while performing an incidental butterfly detection task (Experiment 1), an explicit familiarity judgment task (Experiment 2), and a concealed familiarity task in which they were asked to deny familiarity with one truly known facial identity while acknowledging familiarity with a second known identity (Experiment 3). In all three experiments, we observed substantially more negative ERP amplitudes at occipito-temporal electrodes for familiar relative to unfamiliar faces starting approximately 200 ms after stimulus onset. Both the earlier N250 familiarity effect, reflecting visual recognition of a known face, and the later sustained familiarity effect, reflecting the integration of visual with additional identity-specific information, were similar across experiments and thus independent of task demands. These results were further supported by the classifier analysis. We conclude that ERP correlates of familiar face recognition are largely independent of voluntary control and discuss potential applications in forensic settings.

The N170 is Sensitive to Long-term (Personal) Familiarity of a Face Identity

The N170 is a large deflection of the human electroencephalogram (EEG), peaking at about 170 milliseconds over the occipito-temporal cortex after the sudden onset of a face stimulus. The N170 reflects perceptual awareness of a face and its onset corresponds to the emergence of reliable face-selectivity in the human brain. However, whether sensitivity to the long-term familiarity of a face identity emerges already at this early time-point remains debated. Here we provide a brief survey of the 45 published studies comparing the N170 response to unfamiliar and familiar (famous, experimentally familiarized, personally familiar and own) faces. Even though effects of familiarity on the N170 are relatively small and inconsistent across studies, this overview indicates that face familiarity significantly increases the N170 amplitude. This effect is especially present for personally familiar faces, learned in natural conditions. In the human brain, effects linked to familiarity with specific facial identities therefore appear to emerge between 150 and 200 ms in occipito-temporal brain regions, i.e., shortly after the onset of face-selectivity but at the same time as the earliest high-level effects of immediate unfamiliar face identity repetition. This observation challenges standard neurocognitive models with a clear-cut distinction between perceptual and memory stages in human face recognition.

Learning own- and other-race facial identities: Testing implicit recognition with event-related brain potentials

Exposure to varying images of the same person can encourage the formation of a representation that is sufficiently robust to allow recognition of previously unseen images of this person. While behavioural work suggests that face identity learning is harder for other-race faces, the present experiment investigated the neural correlates underlying own- and other-race face learning. Participants sorted own- and other-race identities into separate identity clusters and were further familiarised with these identities in a matching task. Subsequently, we compared event-related brain potentials (ERPs) in an implicit recognition (butterfly detection) task for learnt and previously unseen identities. We observed better sorting and matching for own- than other-race identities, and behavioural learning effects were restricted to own-race identities. Similarly, the N170 ERP component showed clear learning effects for own-race faces only. The N250, a component more closely associated with face learning was more negative for learnt than novel identities. ERP findings thus suggests a processing advantage for own-race identities at an early perceptual level whereas later correlates of identity learning were unaffected by ethnicity. These results suggest learning advantages for own-race identities, which underscores the importance of perceptual expertise in the own-race bias.

Influence of lag length on repetition priming in emotional stimuli: ERP evidence

BACKGROUND

Previous studies have demonstrated both behavioral and neural evidence for the potential mediations of lag length and pre-existing memory representation on repetition priming. However, such mediations on emotional stimuli have not been described.

METHODS

The current experiment intended to disentangle lag length from pre-existing memory representation. A lexical decision task was performed, in which different emotional characters (either normal or transposed) were re-presented either immediately or delayed.

RESULTS

In immediate repetition, one early and two late (ie, N400 and late positive complex) repetition-related event-related potential (ERP) effects were elicited, but these were not sensitive to pre-existing memory representation. The delayed repetition case merely observed the N400.

CONCLUSION

These results suggest that the repetition-related priming effect is neutrally sensitive to lag length. Emotional information potentially exerts early and later influences in the processing underlying stimuli memory.

Early Adverse Caregiving Experiences and Preschoolers' Current Attachment Affect Brain Responses during Facial Familiarity Processing: An ERP Study

When being placed into more benign environments like foster care, children from adverse rearing backgrounds are capable of forming attachment relationships to new caregivers within the first year of placement, while certain problematic social behaviors appear to be more persistent. Assuming that early averse experiences shape neural circuits underlying social behavior, neurophysiological studies on individual differences in early social-information processing have great informative value. More precisely, ERP studies have repeatedly shown face processing to be sensitive to experience especially regarding the caregiving background. However, studies on effects of early adverse caregiving experiences are restricted to children with a history of institutionalization. Also, no study has investigated effects of attachment security as a marker of the quality of the caregiver-child relationship. Thus, the current study asks how adverse caregiving experiences and attachment security to (new) caregivers affect early- and mid-latency ERPs sensitive to facial familiarity processing. Therefore, pre-school aged foster children during their second year within the foster home were compared to an age matched control group. Attachment was assessed using the AQS and neurophysiological data was collected during a passive viewing task presenting (foster) mother and stranger faces. Foster children were comparable to the control group with regard to attachment security. On a neurophysiological level, however, the foster group showed dampened N170 amplitudes for both face types. In both foster and control children, dampened N170 amplitudes were also found for stranger as compared to (foster) mother faces, and, for insecurely attached children as compared to securely attached children. This neural pattern may be viewed as a result of poorer social interactions earlier in life. Still, there was no effect on P1 amplitudes. Indicating heightened attentional processing, Nc amplitude responses to stranger faces were found to be enhanced in foster as compared to control children. Also, insecurely attached children allocated more attentional resources for the neural processing of mother faces. The study further confirms that early brain development is highly sensitive to the quality of caregiving. The findings are also relevant from a developmental perspective as miswiring of neural circuits may possibly play a critical role in children's psycho-social adjustment.

Lag-length effect on repetition priming of famous and unfamiliar faces: evidence from N250r and N400

Previous event-related potentials research has reliably identified two repetition priming components in faces, the N250r and the N400, which are believed to reflect, respectively, the accessing to the stored structural representations and the semantic retrieval. However, the effect of lags longer than immediate repetition and shorter than 3 min on the two components has not been described as yet, and the interaction between lag length and familiarity is unclear. The current experiment aims to address these issues. In this experiment, famous and unfamiliar faces were represented after short, medium, or long lags, and participants were required to decide whether each face was known or not. The data showed that the frontal N250r, rather than the temporal counterpart, persisted to the medium lag case for famous faces; for unfamiliar faces, no N250r was observed. The frontal N400 was more regulated by lag length than the centroparietal counterpart. These results suggest that the frontal N250r and the frontal N400 are affected by the lag length; moreover, the former is more sensitive to the pre-experimental familiarity of faces.

Socially Important Faces Are Processed Preferentially to Other Familiar and Unfamiliar Faces in a Priming Task across a Range of Viewpoints

Using a priming paradigm, we investigate whether socially important faces are processed preferentially compared to other familiar and unfamiliar faces, and whether any such effects are affected by changes in viewpoint. Participants were primed with frontal images of personally familiar, famous or unfamiliar faces, and responded to target images of congruent or incongruent identity, presented in frontal, three quarter or profile views. We report that participants responded significantly faster to socially important faces (a friend's face) compared to other highly familiar (famous) faces or unfamiliar faces. Crucially, responses to famous and unfamiliar faces did not differ. This suggests that, when presented in the context of a socially important stimulus, socially unimportant familiar faces (famous faces) are treated in a similar manner to unfamiliar faces. This effect was not tied to viewpoint, and priming did not affect socially important face processing differently to other faces.

Efficient visual information for unfamiliar face matching despite viewpoint variations: It's not in the eyes!

Faces are encountered in highly diverse angles in real-world settings. Despite this considerable diversity, most individuals are able to easily recognize familiar faces. The vast majority of studies in the field of face recognition have nonetheless focused almost exclusively on frontal views of faces. Indeed, a number of authors have investigated the diagnostic facial features for the recognition of frontal views of faces previously encoded in this same view. However, the nature of the information useful for identity matching when the encoded face and test face differ in viewing angle remains mostly unexplored. The present study addresses this issue using individual differences and bubbles, a method that pinpoints the facial features effectively used in a visual categorization task. Our results indicate that the use of features located in the center of the face, the lower left portion of the nose area and the center of the mouth, are significantly associated with individual efficiency to generalize a face's identity across different viewpoints. However, as faces become more familiar, the reliance on this area decreases, while the diagnosticity of the eye region increases. This suggests that a certain distinction can be made between the visual mechanisms subtending viewpoint invariance and face recognition in the case of unfamiliar face identification. Our results further support the idea that the eye area may only come into play when the face stimulus is particularly familiar to the observer.

The Role of Familiarity on Viewpoint Adaptation for Self-Face and Other-Face Images

An adaptation method was used to investigate whether self-face processing is dissociable from general face processing. We explored the viewpoint aftereffect with face images having different degrees of familiarity (never-before-seen faces, recently familiarized faces, personally familiar faces, and the participant’s own face). A face viewpoint aftereffect occurs after prolonged viewing of a face viewed from one side, with the result that the perceived viewing direction of a subsequently presented face image shown near the frontal view is biased in a direction which is the opposite of the adapting orientation. We found that (1) the magnitude of the viewpoint aftereffect depends on the level of familiarity of the adapting and test faces, (2) a cross-identity transfer of the viewpoint aftereffect is found between all categories of faces, but not between an unfamiliar adaptor face and the self-face test, and (3) learning affects the processing of the self-face in greater measure than any other category of faces. These results highlight the importance of familiarity on the face aftereffects, but they also suggest the possibility of separate representations for the self-face, on the one side, and for highly familiar faces, on the other.

Visual adaptation provides objective electrophysiological evidence of facial identity discrimination

Discrimination of facial identities is a fundamental function of the human brain that is challenging to examine with macroscopic measurements of neural activity, such as those obtained with functional magnetic resonance imaging (fMRI) and electroencephalography (EEG). Although visual adaptation or repetition suppression (RS) stimulation paradigms have been successfully implemented to this end with such recording techniques, objective evidence of an identity-specific discrimination response due to adaptation at the level of the visual representation is lacking. Here, we addressed this issue with fast periodic visual stimulation (FPVS) and EEG recording combined with a symmetry/asymmetry adaptation paradigm. Adaptation to one facial identity is induced through repeated presentation of that identity at a rate of 6 images per second (6 Hz) over 10 sec. Subsequently, this identity is presented in alternation with another facial identity (i.e., its anti-face, both faces being equidistant from an average face), producing an identity repetition rate of 3 Hz over a 20 sec testing sequence. A clear EEG response at 3 Hz is observed over the right occipito-temporal (ROT) cortex, indexing discrimination between the two facial identities in the absence of an explicit behavioral discrimination measure. This face identity discrimination occurs immediately after adaptation and disappears rapidly within 20 sec. Importantly, this 3 Hz response is not observed in a control condition without the single-identity 10 sec adaptation period. These results indicate that visual adaptation to a given facial identity produces an objective (i.e., at a pre-defined stimulation frequency) electrophysiological index of visual discrimination between that identity and another, and provides a unique behavior-free quantification of the effect of visual adaptation.

Differential Processing of Vertical Interfeature Relations Due to Real-Life Experience with Personally Familiar Faces

Identification of personally familiar faces is possibly the most complex and likewise efficient task achieved by the human visual system, yet to date the mechanisms underlying this extreme proficiency remain largely unknown. Building on empirical evidence from unfamiliar face processing in healthy populations and neuropsychological patients, the present work aimed to determine the type of information processed differently due to repeated, real-life experience with faces. A modulatory effect of familiarity was observed for processing of vertical interfeature distances, which have been suggested to rely on holistic processing skills. Contrariwise, no such effect was found for processing of information that can be discriminated locally (ie featural cues, interocular distances). The results indicate that familiarity-related advantages in face processing may arise from more efficient, or increased, holistic processing.

Facilitated detection of social cues conveyed by familiar faces

Recognition of the identity of familiar faces in conditions with poor visibility or over large changes in head angle, lighting and partial occlusion is far more accurate than recognition of unfamiliar faces in similar conditions. Here we used a visual search paradigm to test if one class of social cues transmitted by faces—direction of another's attention as conveyed by gaze direction and head orientation—is perceived more rapidly in personally familiar faces than in unfamiliar faces. We found a strong effect of familiarity on the detection of these social cues, suggesting that the times to process these signals in familiar faces are markedly faster than the corresponding processing times for unfamiliar faces. In the light of these new data, hypotheses on the organization of the visual system for processing faces are formulated and discussed.

Source-reconstruction of event-related fields reveals hyperfunction and hypofunction of cortical circuits in antipsychotic-naive, first-episode schizophrenia patients during Mooney face processing

Schizophrenia is characterized by dysfunctions in neural circuits that can be investigated with electrophysiological methods, such as EEG and MEG. In the present human study, we examined event-related fields (ERFs), in a sample of medication-naive, first-episode schizophrenia (FE-ScZ) patients (n = 14) and healthy control participants (n = 17) during perception of Mooney faces to investigate the integrity of neuromagnetic responses and their experience-dependent modification. ERF responses were analyzed for M100, M170, and M250 components at the sensor and source levels. In addition, we analyzed peak latency and adaptation effects due to stimulus repetition. FE-ScZ patients were characterized by significantly impaired sensory processing, as indicated by a reduced discrimination index (A'). At the sensor level, M100 and M170 responses in FE-ScZ were within the normal range, whereas the M250 response was impaired. However, source localization revealed widespread elevated activity for M100 and M170 in FE-ScZ and delayed peak latencies for the M100 and M250 responses. In addition, M170 source activity in FE-ScZ was not modulated by stimulus repetitions. The present findings suggest that neural circuits in FE-ScZ may be characterized by a disturbed balance between excitation and inhibition that could lead to a failure to gate information flow and abnormal spreading of activity, which is compatible with dysfunctional glutamatergic neurotransmission.

Face Familiarity Decisions Take 200 msec in the Human Brain: Electrophysiological Evidence from a Go/No-go Speeded Task

Recognizing a familiar face rapidly is a fundamental human brain function. Here we used scalp EEG to determine the minimal time needed to classify a face as personally familiar or unfamiliar. Go (familiar) and no-go (unfamiliar) responses elicited clear differential waveforms from 210 msec onward, this difference being first observed at right occipito-temporal electrode sites. Similar but delayed (by about 40 msec) responses were observed when go response were required to the unfamiliar rather than familiar faces, in a second group of participants. In both groups, a small increase of amplitude was also observed on the right hemisphere N170 face-sensitive component for familiar faces. However, unlike the post-200 msec differential go/no-go effect, this effect was unrelated to behavior and disappeared with repetition of unfamiliar faces. These observations indicate that accumulation of evidence within the first 200 msec poststimulus onset is sufficient for the human brain to decide whether a person is familiar based on his or her face, a time frame that puts strong constraints on the time course of face processing.

Transcranial direct current stimulation of the dorsolateral prefrontal cortex modulates repetition suppression to unfamiliar faces: an ERP study

Repeated visual processing of an unfamiliar face suppresses neural activity in face-specific areas of the occipito-temporal cortex. This "repetition suppression" (RS) is a primitive mechanism involved in learning of unfamiliar faces, which can be detected through amplitude reduction of the N170 event-related potential (ERP). The dorsolateral prefrontal cortex (DLPFC) exerts top-down influence on early visual processing. However, its contribution to N170 RS and learning of unfamiliar faces remains unclear. Transcranial direct current stimulation (tDCS) transiently increases or decreases cortical excitability, as a function of polarity. We hypothesized that DLPFC excitability modulation by tDCS would cause polarity-dependent modulations of N170 RS during encoding of unfamiliar faces. tDCS-induced N170 RS enhancement would improve long-term recognition reaction time (RT) and/or accuracy rates, whereas N170 RS impairment would compromise recognition ability. Participants underwent three tDCS conditions in random order at ∼72 hour intervals: right anodal/left cathodal, right cathodal/left anodal and sham. Immediately following tDCS conditions, an EEG was recorded during encoding of unfamiliar faces for assessment of P100 and N170 visual ERPs. The P3a component was analyzed to detect prefrontal function modulation. Recognition tasks were administered ∼72 hours following encoding. Results indicate the right anodal/left cathodal condition facilitated N170 RS and induced larger P3a amplitudes, leading to faster recognition RT. Conversely, the right cathodal/left anodal condition caused N170 amplitude and RTs to increase, and a delay in P3a latency. These data demonstrate that DLPFC excitability modulation can influence early visual encoding of unfamiliar faces, highlighting the importance of DLPFC in basic learning mechanisms.

The early spatio-temporal correlates and task independence of cerebral voice processing studied with MEG

Functional magnetic resonance imaging studies have repeatedly provided evidence for temporal voice areas (TVAs) with particular sensitivity to human voices along bilateral mid/anterior superior temporal sulci and superior temporal gyri (STS/STG). In contrast, electrophysiological studies of the spatio-temporal correlates of cerebral voice processing have yielded contradictory results, finding the earliest correlates either at ∼300-400 ms, or earlier at ∼200 ms ("fronto-temporal positivity to voice", FTPV). These contradictory results are likely the consequence of different stimulus sets and attentional demands. Here, we recorded magnetoencephalography activity while participants listened to diverse types of vocal and non-vocal sounds and performed different tasks varying in attentional demands. Our results confirm the existence of an early voice-preferential magnetic response (FTPVm, the magnetic counterpart of the FTPV) peaking at about 220 ms and distinguishing between vocal and non-vocal sounds as early as 150 ms after stimulus onset. The sources underlying the FTPVm were localized along bilateral mid-STS/STG, largely overlapping with the TVAs. The FTPVm was consistently observed across different stimulus subcategories, including speech and non-speech vocal sounds, and across different tasks. These results demonstrate the early, largely automatic recruitment of focal, voice-selective cerebral mechanisms with a time-course comparable to that of face processing.

Is the rapid adaptation paradigm too rapid? Implications for face and object processing

Rapid adaptation is an adaptation procedure in which adaptors and test stimuli are presented in rapid succession. The current study tested the validity of this method for early ERP components by investigating the specificity of the adaptation effect on the face-sensitive N170 ERP component across multiple test stimuli. Experiments 1 and 2 showed identical response patterns for house and upright face test stimuli using the same adaptor stimuli. The results were also identical to those reported in a previous study using inverted face test stimuli (Nemrodov and Itier, 2011). In Experiment 3 all possible adaptor-test combinations between upright face, house, chair and car stimuli were used and no interaction between adaptor and test category, expected in the case of test-specific adaptation, was found. These results demonstrate that the rapid adaptation paradigm does not produce category-specific adaptation effects around 170-200 ms following test stimulus onset, a necessary condition for the interpretation of adaptation results. These results suggest the rapid categorical adaptation paradigm does not work.