Neural correlates of priming and adaptation in familiar face perception

Autistic and nonautistic adolescents do not differ in adaptation to gaze direction

Predictive processing accounts of autism posit that autistic individuals' perception is less biased by expectations than nonautistic individuals', perhaps through stronger precision-weighting of prediction errors. Since precision-weighting is fundamental to all information processing, under this theory, the differences between autistic and nonautistic individuals should be domain-general and observable in both behavior and brain responses. This study used EEG, behavioral responses, and eye-tracking co-registration during gaze-direction adaptation, to investigate whether increased precision-weighting of prediction errors is evident through smaller adaptation after-effects in autistic adolescents compared with nonautistic peers. Multilevel modeling showed that autistic and nonautistic adolescents' responses were consistent with behavioral adaptation, with Bayesian statistics providing extremely strong evidence for the absence of a group difference. Cluster-based permutation testing of ERP responses did not show the expected adaptation after-effect but did show habituation to repeated stimulus presentation, and no group difference was detected, a result not consistent with the theoretical account. Combined with the few other available studies, the current findings raise challenges for the theory, suggesting no fundamental difference in precision-weighting of prediction errors in autism.

Prediction error processing and sharpening of expected information across the face-processing hierarchy

The perception and neural processing of sensory information are strongly influenced by prior expectations. The integration of prior and sensory information can manifest through distinct underlying mechanisms: focusing on unexpected input, denoted as prediction error (PE) processing, or amplifying anticipated information via sharpened representation. In this study, we employed computational modeling using deep neural networks combined with representational similarity analyses of fMRI data to investigate these two processes during face perception. Participants were cued to see face images, some generated by morphing two faces, leading to ambiguity in face identity. We show that expected faces were identified faster and perception of ambiguous faces was shifted towards priors. Multivariate analyses uncovered evidence for PE processing across and beyond the face-processing hierarchy from the occipital face area (OFA), via the fusiform face area, to the anterior temporal lobe, and suggest sharpened representations in the OFA. Our findings support the proposition that the brain represents faces grounded in prior expectations.

Bridging the gap between EEG and DCNNs reveals a fatigue mechanism of facial repetition suppression

Facial repetition suppression, a well-studied phenomenon characterized by decreased neural responses to repeated faces in visual cortices, remains a subject of ongoing debate regarding its underlying neural mechanisms. Our research harnesses advanced multivariate analysis techniques and the prowess of deep convolutional neural networks (DCNNs) in face recognition to bridge the gap between human electroencephalogram (EEG) data and DCNNs, especially in the context of facial repetition suppression. Our innovative reverse engineering approach, manipulating the neuronal activity in DCNNs and conducted representational comparisons between brain activations derived from human EEG and manipulated DCNN activations, provided insights into the underlying facial repetition suppression. Significantly, our findings advocate the fatigue mechanism as the dominant force behind the facial repetition suppression effect. Broadly, this integrative framework, bridging the human brain and DCNNs, offers a promising tool for simulating brain activity and making inferences regarding the neural mechanisms underpinning complex human behaviors.

Facial first impressions are not mandatory: A priming investigation

A common assertion is that, based around prominent character traits, first impressions are spontaneously extracted from faces. Specifically, mere exposure to a person is sufficient to trigger the involuntary extraction of core personality characteristics (e.g., trustworthiness, dominance, competence), an outcome that supports a range of significant judgments (e.g., hiring, investing, electing). But is this in fact the case? Noting ambiguities in the extant literature, here we used a repetition priming procedure to probe the extent to which impressions of dominance are extracted from faces absent the instruction to evaluate the stimuli in this way. Across five experiments in which either the character trait of interest was made increasingly obvious to participants (Expts. 1-3) or attention was explicitly directed toward the faces to generate low-level/high-level judgments (Expts. 4 & 5), no evidence for the spontaneous extraction of first impressions was observed. Instead, priming only emerged when judgments of dominance were an explicit requirement of the task at hand. Thus, at least using a priming methodology, the current findings contest the notion that first impressions are a mandatory product of person perception.

Face processing and early event-related potentials: replications and novel findings

This research explores early Event-Related Potentials (ERPs) sensitivity to facial stimuli, investigating various facial features aimed to unveil underlying neural mechanisms. Two experiments, each involving 15 undergraduate students, utilized a multidimensional stimulus set incorporating race, gender, age, emotional expression, face masks, and stimulus orientation. Findings highlight significant modulations in N170 and P200 amplitudes and latencies for specific attributes, replicating prior research and revealing novel insights. Notably, age-related facial feature variations, facial inversion, and the presence of face masks significantly impact neural responses. Several speculative explanations are proposed to elucidate these results: First, the findings lend support to the idea that the increased N170 amplitude observed with facial inversion is closely tied to the activation of object-sensitive neurons. This is further bolstered by a similar amplitude increase noted when masks (effective objects) are added to faces. Second, the absence of an additional amplitude increase, when inverting face images with face masks suggests that neural populations may have reached a saturation point, limiting further enhancement. Third, the study reveals that the latency deficit in N170 induced by facial inversion is even more pronounced in the subsequent ERP component, the P200, indicating that face inversion may impact multiple stages of face processing. Lastly, the significant increase in P200 amplitude, typically associated with face typicality, for masked faces in this study aligns with previous research that demonstrated elevated P200 amplitudes for scrambled faces. This suggests that obscured faces may be processed as typical, potentially representing a default state in face processing.

Face identity and facial expression representations with adaptation paradigms: New directions for potential applications

Adaptation and aftereffect are well-known procedures for exploring our neural representation of visual stimuli. It has been reported that they occur in face identity, facial expressions, and low-level visual features. This method has two primary advantages. One is to reveal the common or shared process of faces, that is, the overlapped or discrete representation of face identities or facial expressions. The other is to investigate the coding system or theory of face processing that underlies the ability to recognize faces. This study aims to organize recent research to guide the reader into the field of face adaptation and its aftereffect and to suggest possible future expansions in the use of this paradigm. To achieve this, we reviewed the behavioral short-term aftereffect studies on face identity (i.e., who it is) and facial expressions (i.e., what expressions such as happiness and anger are expressed), and summarized their findings about the neural representation of faces. First, we summarize the basic characteristics of face aftereffects compared to simple visual features to clarify that facial aftereffects occur at a different stage and are not inherited or combinations of low-level visual features. Next, we introduce the norm-based coding hypothesis, which is one of the theories used to represent face identity and facial expressions, and adaptation is a commonly used procedure to examine this. Subsequently, we reviewed studies that applied this paradigm to immature or impaired face recognition (i.e., children and individuals with autism spectrum disorder or prosopagnosia) and examined the relationships between their poor recognition performance and representations. Moreover, we reviewed studies dealing with the representation of non-presented faces and social signals conveyed via faces and discussed that the face adaptation paradigm is also appropriate for these types of examinations. Finally, we summarize the research conducted to date and propose a new direction for the face adaptation paradigm.

Face familiarity revealed by fixational eye movements and fixation-related potentials in free viewing

Event-related potentials (ERPs) and the oculomotor inhibition (OMI) in response to visual transients are known to be sensitive to stimulus properties, attention, and expectation. We have recently found that the OMI is also sensitive to face familiarity. In natural vision, stimulation of the visual cortex is generated primarily by saccades, and it has been recently suggested that fixation-related potentials (FRPs) share similar components with the ERPs. Here, we investigated whether FRPs and microsaccade inhibition (OMI) in free viewing are sensitive to face familiarity. Observers freely watched a slideshow of seven unfamiliar and one familiar facial images presented randomly for 4-s periods, with multiple images per identity. We measured the occipital fixation-related N1 relative to the P1 magnitude as well as the associated fixation-triggered OMI. We found that the average N1-P1 was significantly smaller and the OMI was shorter for the familiar face, compared with any of the seven unfamiliar faces. Moreover, the P1 was suppressed across saccades for the familiar but not for the unfamiliar faces. Our results highlight the sensitivity of the occipital FRPs to stimulus properties such as face familiarity and advance our understanding of the integration process across successive saccades in natural vision.

Testing temporal integration of feature probability distributions using role-reversal effects in visual search

The visual system is sensitive to statistical properties of complex scenes and can encode feature probability distributions in detail. But does the brain use these statistics to build probabilistic models of the ever-changing visual input? To investigate this, we examined how observers temporally integrate two different orientation distributions from sequentially presented visual search trials. If the encoded probabilistic information is used in a Bayesian optimal way, observers should weigh more reliable information more strongly, such as feature distributions with low variance. We therefore manipulated the variance of the two feature distributions. Participants performed sequential odd-one-out visual search for an oddly oriented line among distractors. During successive learning trials, the distractor orientations were sampled from two different Gaussian distributions on alternating trials. Then, observers performed a 'test trial' where the orientations of the target and distractors were switched, allowing us to assess observer's internal representation of distractor distributions based on changes in response times. In three experiments we observed that observer's search times on test trials depended mainly on the very last learning trial, indicating a strong recency effect. Since temporal integration has been previously observed with this method, we conclude that when the input is unreliable, the visual system relies more on the most recent stimulus. This indicates that the visual system prefers to utilize sensory history when the statistical properties of the environment are relatively stable.

Holistic face processing is influenced by non-conscious visual information

Holistic face processing has been widely implicated in conscious face perception. Yet, little is known about whether holistic face processing occurs when faces are processed unconsciously. The present study used the composite face task and continuous flash suppression (CFS) to inspect whether the processing of target facial information (the top half of a face) is influenced by irrelevant information (the bottom half) that is presented unconsciously. Results of multiple experiments showed that the composite effect was observed in both monocular and CFS conditions, providing the first evidence that the processing of top facial halves is influenced by the aligned bottom halves no matter whether they are presented consciously or unconsciously. However, much of the composite effect for faces without masking was disrupted when bottom facial parts were rendered with CFS. These results suggest that holistic face processing can occur unconsciously, but also highlight the significance of holistic processing of consciously presented faces.

Face-like configurations modulate electrophysiological mismatch responses

The human face is one of the most salient stimuli in the environment. It has been suggested that even basic face-like configurations (three dots composing a downward pointing triangle) may convey salience. Interestingly, stimulus salience can be signaled by mismatch detection phenomena, characterized by greater amplitudes of event-related potentials (ERPs) in response to relevant novel stimulation as compared to non-relevant repeated events. Here, we investigate whether basic face-like stimuli are salient enough to modulate mismatch detection phenomena. ERPs are elicited by a pair of sequentially presented visual stimuli (S1-S2), delivered at a constant 1-s interval, representing either a face-like stimulus (Upright configuration) or three neutral configurations (Inverted, Leftwards, and Rightwards configurations), that are obtained by rotating the Upright configuration along the three different axes. In pairs including a canonical face-like stimulus, we observe a more effective mismatch detection mechanism, with significantly larger N270 and P300 components when S2 is different from S1 as compared to when S2 is identical to S1. This ERP modulation, not significant in pairs excluding face-like stimuli, reveals that mismatch detection phenomena are significantly affected by basic face-like configurations. Even though further experiments are needed to ascertain whether this effect is specifically elicited by face-like configuration rather than by particular orientation changes, our findings suggest that face essential, structural attributes are salient enough to affect change detection processes.

Face Adaptation and Face Priming as Tools for Getting Insights Into the Quality of Face Space

During the recognition of faces, the incoming perceptual information is matched against mental representations of familiar faces stored in memory. Face space models describe an abstract concept of face representations and their mental organization, in which facial representations are located on various characteristic dimensions, depending on their specific facial characteristics. However, these models are defined just as incompletely as the general understanding of face recognition. We took two phenomena from face processing to better understand face recognition, and so the nature of face space: face adaptation and face priming. The face literature has mainly focused on face adaptation, largely neglecting face priming when trying to integrate outcomes regarding face recognition into the face space framework. Consequently, the present paper aims to review both phenomena and their contributions to face recognition, representation, and face space.

Brief facial emotion aftereffect occurs earlier for angry than happy adaptation

Prolonged exposure to an emotional face biases our judgement of subsequent face stimulus toward the opposite emotion. This emotion aftereffect has been suggested to occur as early as 35 ms exposure duration in cartoon faces. In the current study, we are interested in investigating the time-course of brief emotional face adaptation, and the relationship between brief emotional face adaptation and prolonged emotional face adaptation. We adapted the subjects from 17 ms to 1000 ms with a happy or angry adapting face. We found that a facial emotion adaptation aftereffect started from 17 ms adapting duration for angry face adaptation, and from 50 ms for happy face adaptation. Factor analysis on the adaptation effects highlighted three different components: brief angry adaptation (17 ms, 34 ms, and 50 ms), prolonged angry adaptation (100 ms and 1000 ms), and happy face adaptation (from 17 ms to 1000 ms). We found that the brief angry face adaptation was negatively associated with the awareness of the adapting face, and the prolonged angry face adaptation was stronger in subjects who perceived the angry adapting face as more negative in valence. Together, these findings suggest that (1) facial emotion adaptation can be induced by brief (17 ms) adapting face presentation; (2) brief angry face adaptation may be related to early visual processing, whereas prolonged angry face adaptation may be related to adaptation at later and higher-level visual emotional processing; and (3) brief and prolonged adaptations may adapt different neural populations. Our findings thus shed light on the current understanding of the neural mechanisms of emotional face adaptation.

Recalibration of vocal affect by a dynamic face

Perception of vocal affect is influenced by the concurrent sight of an emotional face. We demonstrate that the sight of an emotional face also can induce recalibration of vocal affect. Participants were exposed to videos of a ‘happy’ or ‘fearful’ face in combination with a slightly incongruous sentence with ambiguous prosody. After this exposure, ambiguous test sentences were rated as more ‘happy’ when the exposure phase contained ‘happy’ instead of ‘fearful’ faces. This auditory shift likely reflects recalibration that is induced by error minimization of the inter-sensory discrepancy. In line with this view, when the prosody of the exposure sentence was non-ambiguous and congruent with the face (without audiovisual discrepancy), aftereffects went in the opposite direction, likely reflecting adaptation. Our results demonstrate, for the first time, that perception of vocal affect is flexible and can be recalibrated by slightly discrepant visual information.

Development of face recognition: Dynamic causal modelling of MEG data

Electrophysiological studies of adults indicate that brain activity is enhanced during viewing of repeated faces, at a latency of about 250 ms after the onset of the face (M250/N250). The present study aimed to determine if this effect was also present in preschool-aged children, whose brain activity was measured in a custom-sized pediatric MEG system. The results showed that, unlike adults, face repetition did not show any significant modulation of M250 amplitude in children; however children's M250 latencies were significantly faster for repeated than non-repeated faces. Dynamic causal modelling (DCM) of the M250 in both age groups tested the effects of face repetition within the core face network including the occipital face area (OFA), the fusiform face area (FFA), and the superior temporal sulcus (STS). DCM revealed that repetition of identical faces altered both forward and backward connections in children and adults; however the modulations involved inputs to both FFA and OFA in adults but only to OFA in children. These findings suggest that the amplitude-insensitivity of the immature M250 may be due to a weaker connection between the FFA and lower visual areas.

Auditory to Visual Cross-Modal Adaptation for Emotion: Psychophysical and Neural Correlates

Adaptation is fundamental in sensory processing and has been studied extensively within the same sensory modality. However, little is known about adaptation across sensory modalities, especially in the context of high-level processing, such as the perception of emotion. Previous studies have shown that prolonged exposure to a face exhibiting one emotion, such as happiness, leads to contrastive biases in the perception of subsequently presented faces toward the opposite emotion, such as sadness. Such work has shown the importance of adaptation in calibrating face perception based on prior visual exposure. In the present study, we showed for the first time that emotion-laden sounds, like laughter, adapt the visual perception of emotional faces, that is, subjects more frequently perceived faces as sad after listening to a happy sound. Furthermore, via electroencephalography recordings and event-related potential analysis, we showed that there was a neural correlate underlying the perceptual bias: There was an attenuated response occurring at ∼ 400 ms to happy test faces and a quickened response to sad test faces, after exposure to a happy sound. Our results provide the first direct evidence for a behavioral cross-modal adaptation effect on the perception of facial emotion, and its neural correlate.

Sex Differences in Categorical Adaptation for Faces and Chinese Characters during Early Perceptual Processing

Previous event-related potential studies support sex differences in the N170 response during face and word processing; however, it remains unclear whether N170 categorical adaptation for faces and words is different between women and men. Using an adaptation paradigm, in which an adaptor and subsequent test stimulus are presented during each trial, the present study investigated N170 categorical adaptation for faces and Chinese characters in both women and men. The results demonstrated that the N170 amplitude elicited by test stimuli in within-category condition was lower than in control category condition, and this was observed during both face and Chinese character processing in women and men. In addition, we found that men have greater N170 categorical adaptation for face and word processing than women. There was also a significant correlation between N170 categorical adaptation indices for face and Chinese character processing in men, which did not occur in women. These findings suggest that men and women process repeated faces or words differently.

Visual adaptation reveals an objective electrophysiological measure of high-level individual face discrimination

The ability to individualize faces is a fundamental human brain function. Following visual adaptation to one individual face, the suppressed neural response to this identity becomes discriminable from an unadapted facial identity at a neural population level. Here, we investigate a simple and objective measure of individual face discrimination with electroencephalographic (EEG) frequency tagging following adaptation. In a first condition, (1) two facial identities are presented in alternation at a rate of six images per second (6 Hz; 3 Hz identity repetition rate) for a 20 s testing sequence, following 10-s adaptation to one of the facial identities; this results in a significant identity discrimination response at 3 Hz in the frequency domain of the EEG over right occipito-temporal channels, replicating our previous findings. Such a 3 Hz response is absent for two novel conditions, in which (2) the faces are inverted and (3) an identity physically equidistant from the two faces is adapted. These results indicate that low-level visual features present in inverted or unspecific facial identities are not sufficient to produce the adaptation effect found for upright facial stimuli, which appears to truly reflect identity-specific perceptual representations in the human brain.

Visual adaptation provides objective electrophysiological evidence of facial identity discrimination

Discrimination of facial identities is a fundamental function of the human brain that is challenging to examine with macroscopic measurements of neural activity, such as those obtained with functional magnetic resonance imaging (fMRI) and electroencephalography (EEG). Although visual adaptation or repetition suppression (RS) stimulation paradigms have been successfully implemented to this end with such recording techniques, objective evidence of an identity-specific discrimination response due to adaptation at the level of the visual representation is lacking. Here, we addressed this issue with fast periodic visual stimulation (FPVS) and EEG recording combined with a symmetry/asymmetry adaptation paradigm. Adaptation to one facial identity is induced through repeated presentation of that identity at a rate of 6 images per second (6 Hz) over 10 sec. Subsequently, this identity is presented in alternation with another facial identity (i.e., its anti-face, both faces being equidistant from an average face), producing an identity repetition rate of 3 Hz over a 20 sec testing sequence. A clear EEG response at 3 Hz is observed over the right occipito-temporal (ROT) cortex, indexing discrimination between the two facial identities in the absence of an explicit behavioral discrimination measure. This face identity discrimination occurs immediately after adaptation and disappears rapidly within 20 sec. Importantly, this 3 Hz response is not observed in a control condition without the single-identity 10 sec adaptation period. These results indicate that visual adaptation to a given facial identity produces an objective (i.e., at a pre-defined stimulation frequency) electrophysiological index of visual discrimination between that identity and another, and provides a unique behavior-free quantification of the effect of visual adaptation.

Adaptation Duration Dissociates Category-, Image-, and Person-Specific Processes on Face-Evoked Event-Related Potentials

Several studies demonstrated that face perception is biased by the prior presentation of another face, a phenomenon termed as face-related after-effect (FAE). FAE is linked to a neural signal-reduction at occipito-temporal areas and it can be observed in the amplitude modulation of the early event-related potential (ERP) components. Recently, macaque single-cell recording studies suggested that manipulating the duration of the adaptor makes the selective adaptation of different visual motion processing steps possible. To date, however, only a few studies tested the effects of adaptor duration on the electrophysiological correlates of human face processing directly. The goal of the current study was to test the effect of adaptor duration on the image-, identity-, and generic category-specific face processing steps. To this end, in a two-alternative forced choice familiarity decision task we used five adaptor durations (ranging from 200-5000 ms) and four adaptor categories: adaptor and test were identical images-Repetition Suppression (RS); adaptor and test were different images of the Same Identity (SameID); adaptor and test images depicted Different Identities (DiffID); the adaptor was a Fourier phase-randomized image (No). Behaviorally, a strong priming effect was observed in both accuracy and response times for RS compared with both DiffID and No. The electrophysiological results suggest that rapid adaptation leads to a category-specific modulation of P100, N170, and N250. In addition, both identity and image-specific processes affected the N250 component during rapid adaptation. On the other hand, prolonged (5000 ms) adaptation enhanced, and extended category-specific adaptation processes over all tested ERP components. Additionally, prolonged adaptation led to the emergence of image-, and identity-specific modulations on the N170 and P2 components as well. In other words, there was a clear dissociation among category, identity-, and image-specific processing steps in the case of longer (3500 and 5000 ms) but not for shorter durations (< 3500 ms), reflected in the gradual reduction of N170 and enhancement of P2 in the No, DiffID, SameID, and RS conditions. Our findings imply that by manipulating adaptation duration one can dissociate the various steps of human face processing, reflected in the ERP response.

Perceptual adaptation to structure-from-motion depends on the size of adaptor and probe objects, but not on the similarity of their shapes

Perceptual adaptation destabilizes the phenomenal appearance of multistable visual displays. Prolonged dominance of a perceptual state fatigues the associated neural population, lowering the likelihood of renewed perception of the same appearance (Nawrot & Blake in Perception & Psychophysics, 49, 230-44, 1991). Here, we used a selective adaptation paradigm to investigate perceptual adaptation for the illusory rotation of ambiguous structure-from-motion (SFM) displays. Specifically, we generated SFM objects with different three-dimensional shapes and presented them in random order, separating successive objects by brief blank periods, which included a mask. To assess the specificity of perceptual adaptation to the shape of SFM objects, we established the probability that a perceived direction of rotation persisted between successive objects of similar or dissimilar shape. We found that the strength of negative aftereffects depended on the volume, but not the shape, of adaptor and probe objects. More voluminous objects were both more effective as adaptor objects and more sensitive as probe objects. Surprisingly, we found these volume effects to be completely independent, since any relationship between two shapes (such as overlap between volumes, similarity of shape, or similarity of velocity profiles) failed to modulate the negative aftereffect. This pattern of results was the opposite of that observed for sensory memory of SFM objects, which reflects similarity between objects, but not volume of individual objects (Pastukhov et al. in Attention, Perception & Psychophysics, 75, 1215-1229, 2013). The disparate specificities of perceptual adaptation and sensory memory for identical SFM objects suggest that the two aftereffects engage distinct neural representations, consistent with recent brain imaging results (Schwiedrzik et al. in Cerebral Cortex, 2012).

The effect of parametric stimulus size variation on individual face discrimination indexed by fast periodic visual stimulation

Background

The human brain is frequently exposed to individual faces across a wide range of different apparent sizes, often seen simultaneously (e.g., when facing a crowd). Here we used a sensitive and objective fast periodic visual stimulation approach while recording scalp electroencephalogram (EEG) to test the effect of size variation on neural responses reflecting individual face discrimination.

Methods

EEG was recorded in ten observers presented with the same face identity at a fixed rate (5.88 Hz, frequency F) and different oddball face identities appearing every five faces (F/5, i.e., 1.18 Hz). Stimulus size was either constant (6.5 × 4 degrees of visual angle) or changed randomly at each stimulation cycle, by 2:1 ratio increasing values from 10% to 80% size variation in four conditions. Absolute stimulus size remained constant across conditions.

Results

The base rate 5.88 Hz EEG response increased with image size variation, particularly over the right occipito-temporal cortex. In contrast, size variation decreased the oddball response marking individual face discrimination over the right occipito-temporal cortex. At constant stimulus size, the F/5 change of identity generated an early (about 100 ms) oddball response reflecting individual face discrimination based on image-based cues. This early component disappeared with a relatively small size variation (i.e., 20%), leaving a robust high-level index of individual face discrimination.

Conclusions

Stimulus size variation is an important manipulation to isolate the contribution of high-level visual processes to individual face discrimination. Nevertheless, even for relatively small stimuli, high-level individual face discrimination processes in the right occipito-temporal cortex remain sensitive to stimulus size variation.

Electronic supplementary material

The online version of this article (doi:10.1186/1471-2202-15-87) contains supplementary material, which is available to authorized users.

Altering second-order configurations reduces the adaptation effects on early face-sensitive event-related potential components

The spatial distances among the features of a face are commonly referred to as second-order relations, and the coding of these properties is often regarded as a cornerstone in face recognition. Previous studies have provided mixed results regarding whether the N170, a face-sensitive component of the event-related potential, is sensitive to second-order relations. Here we investigated this issue in a gender discrimination paradigm following long-term (5 s) adaptation to normal or vertically stretched male and female faces, considering that the latter manipulation substantially alters the position of the inner facial features. Gender-ambiguous faces were more likely judged to be female following adaptation to a male face and vice versa. This aftereffect was smaller but statistically significant after being adapted to vertically stretched when compared to unstretched adapters. Event-related potential recordings revealed that adaptation effects measured on the amplitude of the N170 show strong modulations by the second-order relations of the adapter: reduced N170 amplitude was observed, however, this reduction was smaller in magnitude after being adapted to stretched when compared to unstretched faces. These findings suggest early face-processing, as reflected in the N170 component, proceeds by extracting the spatial relations of inner facial features.

Decision-dependent aftereffects for faces

Adaptation-related aftereffects (AEs) have been found in the perception of face identity, in that perception of an ambiguous face is typically biased away from the identity of a preceding unambiguous adaptor face. In previous studies, we could show that both perceptual ambiguity and physical similarity play a role in determining perceived face identity AEs, Cortex 49 (2013) 1963-1977, Plos One 8 (2013) e70525. Here, we tested further the role of ambiguity by manipulating participants' task such that the very same target stimuli were either ambiguous or unambiguous regarding stimulus classification. We created two partially overlapping continua spanning three unfamiliar face identities each, by morphing identity A via B to C, and B via C to D. In a first session, participants were familiarised with faces A and C and asked to classify faces of the A-B-C continuum as either identity A or C in an AE paradigm. Following adaptation to A or C, we observed contrastive AEs for the ambiguous identity B, but not for the unambiguous identities A or C. In a second session, the same participants were familiarised with faces B and D, followed by tests of AEs for the B-C-D continuum now involving a B-D classification task. We again observed contrastive AEs but only for target identity C (ambiguous for the decision) and not for B or D (unambiguous). Our results suggest that perceptual ambiguity, as given by the task-context, determines whether or not AEs are induced.

Understanding individual face discrimination by means of fast periodic visual stimulation

This paper reviews a fast periodic visual stimulation (FPVS) approach developed recently to make significant progress in understanding visual discrimination of individual faces. Displaying pictures of faces at a periodic frequency rate leads to a high signal-to-noise ratio (SNR) response in the human electroencephalogram, at the exact frequency of stimulation, a so-called steady-state visual evoked potential (SSVEP, Regan in Electroencephalogr Clin Neurophysiol 20:238-248, 1966). For fast periodic frequency rates, i.e., between 3 and 9 Hz, this response is reduced if the exact same face identity is repeated compared to the presentation of different face identities, the largest difference being observed over the right occipito-temporal cortex. A 6-Hz stimulation rate (cycle duration of ~170 ms) provides the largest difference between different and repeated faces, as also evidenced in face-selective areas of the ventral occipito-temporal cortex in functional magnetic resonance imaging. This high-level discrimination response is reduced following inversion and contrast-reversal of the faces and can be isolated without subtraction thanks to a fast periodic oddball paradigm. Overall, FPVS provides a response that is objective (i.e., at an experimentally defined frequency), implicit, has a high SNR and is directly quantifiable in a short amount of time. Although the approach is particularly appealing for understanding face perception, it can be generalized to study visual discrimination of complex visual patterns such as objects and visual scenes. The advantages of the approach make it also particularly well-suited to investigate these functions in populations who cannot provide overt behavioral responses and can only be tested for short durations, such as infants, young children and clinical populations.

Dissociating the neural bases of repetition-priming and adaptation in the human brain for faces

The repetition of a given stimulus leads to the attenuation of the functional magnetic resonance imaging (fMRI) signal compared with unrepeated stimuli, a phenomenon called fMRI adaptation or repetition suppression (RS). Previous studies have related RS of the fMRI signal behaviorally both to improved performance for the repeated stimulus (priming) and to shifts of perception away from the first stimulus (adaptation-related aftereffects). Here we used identical task (sex discrimination), trial structure [ stimulus 1 (S1): 3,000 ms, interstimulus interval: 600 ms, stimulus 2 (S2): 300 ms], and S2 stimuli (androgynous faces) to test how RS of the face-specific areas of the occipito-temporal cortex relates to priming and aftereffects. By varying S1, we could induce priming (significantly faster reaction times when S1 and S2 were identical compared with different images) as well as sex-specific aftereffect [an increased ratio of male responses if S1 was a female face compared with ambiguous faces or to Fourier-randomized noise (FOU) images]. Presenting any face as S1 led to significant RS of the blood oxygen level-dependent signal in the fusiform and occipital face areas as well as in the lateral occipital cortex of both hemispheres compared with FOU, reflecting stimulus category-specific encoding. Additionally, while sex-specific adaptation effects were only observed in occipital face areas, primed trials led to a signal reduction in both face-selective regions. Altogether, these results suggest the differential neural mechanisms of adaptation and repetition priming.

Perceiving vocal age and gender: an adaptation approach

Aftereffects of adaptation have revealed both independent and interactive coding of facial signals including identity and expression or gender and age. By contrast, interactive processing of non-linguistic features in voices has rarely been investigated. Here we studied bidirectional cross-categorical aftereffects of adaptation to vocal age and gender. Prolonged exposure to young (~20yrs) or old (~70yrs) male or female voices biased perception of subsequent test voices away from the adapting age (Exp. 1) and the adapting gender (Exp. 2). Relative to gender-congruent adaptor-test pairings, vocal age aftereffects (VAAEs) were reduced but remained significant when voice gender changed between adaptation and test. This suggests that the VAAE relies on both gender-specific and gender-independent age representations for male and female voices. By contrast, voice gender aftereffects (VGAEs) were not modulated by age-congruency of adaptor and test voices (Exp. 2). Instead, young voice adaptors generally induced larger VGAEs than old voice adaptors. This suggests that young voices are particularly efficient gender adaptors, likely reflecting more pronounced sexual dimorphism in these voices. In sum, our findings demonstrate how high-level processing of vocal age and gender is partially intertwined.

Adaptor identity modulates adaptation effects in familiar face identification and their neural correlates

Adaptation-related aftereffects (AEs) show how face perception can be altered by recent perceptual experiences. Along with contrastive behavioural biases, modulations of the early event-related potentials (ERPs) were typically reported on categorical levels. Nevertheless, the role of the adaptor stimulus per se for face identity-specific AEs is not completely understood and was therefore investigated in the present study. Participants were adapted to faces (S1s) varying systematically on a morphing continuum between pairs of famous identities (identities A and B), or to Fourier phase-randomized faces, and had to match the subsequently presented ambiguous faces (S2s; 50/50% identity A/B) to one of the respective original faces. We found that S1s identical with or near to the original identities led to strong contrastive biases with more identity B responses following A adaptation and vice versa. In addition, the closer S1s were to the 50/50% S2 on the morphing continuum, the smaller the magnitude of the AE was. The relation between S1s and AE was, however, not linear. Additionally, stronger AEs were accompanied by faster reaction times. Analyses of the simultaneously recorded ERPs revealed categorical adaptation effects starting at 100 ms post-stimulus onset, that were most pronounced at around 125-240 ms for occipito-temporal sites over both hemispheres. S1-specific amplitude modulations were found at around 300-400 ms. Response-specific analyses of ERPs showed reduced voltages starting at around 125 ms when the S1 biased perception in a contrastive way as compared to when it did not. Our results suggest that face identity AEs do not only depend on physical differences between S1 and S2, but also on perceptual factors, such as the ambiguity of S1. Furthermore, short-term plasticity of face identity processing might work in parallel to object-category processing, and is reflected in the first 400 ms of the ERP.