Controlling for interstimulus perceptual variance abolishes N170 face selectivity

Early event-related potentials to emotional faces differ for adults with autism spectrum disorder and by serotonin transporter genotype

OBJECTIVE

To test differences in neural sensitivity to facial expressions, including expressions with open versus closed mouths, exhibited by (1) adults with autism spectrum disorder (ASD) compared to neurotypical adults, and by (2) short versus long serotonin transporter allele (SLC6A4) carriers.

METHODS

Event related potentials (ERPs) to happy, fearful, and neutral expressions were collected from neurotypical adults (n=25) and adults with ASD (n=27)-of whom 32 had short and 13 had homozygous long SLC6A4 alleles.

RESULTS

In the neurotypical group, we confirmed that the N170, VPP and EPN, but not the P1, were influenced by emotional expressions, and determined the EPN was the earliest component modulated by open mouth. Compared to the neurotypical group, individuals with ASD exhibited differences in EPN amplitude in response to open versus closed mouths and in hemispheric distribution. Across groups, short serotonin transporter allele carriers had reduced P1 amplitude compared to long allele carriers.

CONCLUSIONS

Individuals with ASD exhibited a different pattern of neural response when encoding and recognizing facial expressions at the EPN component. Across groups, SLC6A4 allele type modulated early sensory attention at the P1.

SIGNIFICANCE

These results provide insight into the nature of early responses to emotional information according to genetic variation and clinical condition.

Classifying four-category visual objects using multiple ERP components in single-trial ERP

Object categorization using single-trial electroencephalography (EEG) data measured while participants view images has been studied intensively. In previous studies, multiple event-related potential (ERP) components (e.g., P1, N1, P2, and P3) were used to improve the performance of object categorization of visual stimuli. In this study, we introduce a novel method that uses multiple-kernel support vector machine to fuse multiple ERP component features. We investigate whether fusing the potential complementary information of different ERP components (e.g., P1, N1, P2a, and P2b) can improve the performance of four-category visual object classification in single-trial EEGs. We also compare the classification accuracy of different ERP component fusion methods. Our experimental results indicate that the classification accuracy increases through multiple ERP fusion. Additional comparative analyses indicate that the multiple-kernel fusion method can achieve a mean classification accuracy higher than 72 %, which is substantially better than that achieved with any single ERP component feature (55.07 % for the best single ERP component, N1). We compare the classification results with those of other fusion methods and determine that the accuracy of the multiple-kernel fusion method is 5.47, 4.06, and 16.90 % higher than those of feature concatenation, feature extraction, and decision fusion, respectively. Our study shows that our multiple-kernel fusion method outperforms other fusion methods and thus provides a means to improve the classification performance of single-trial ERPs in brain-computer interface research.

For whom the bell tolls: Neurocognitive individual differences in the acute stress-reduction effects of an attention bias modification game for anxiety

The efficacy of attention bias modification training (ABMT) for anxiety is debated, in part because individual differences in task engagement and pre-training threat bias impact training efficacy. In the present study, an engaging, gamified ABMT mobile application, or "app," was utilized in 42 (21 females) trait-anxious adults. EEG was recorded during pre- and post-training threat bias assessment to generate scalp-recorded event-related potentials (ERPs) reflecting neurocognitive responses to threat. Following app play (ABMT versus placebo), subjective anxiety and stress responses (observed and self-reported) were measured. ABMT, versus placebo, resulted in improved behavioral performance during the stress task for females, and in potentiation of the N2 ERP to threat for males, suggesting increased attention control. Training groups did not differ in self-reported anxiety. ABMT also resulted in improved performance during the stress task among those evidencing specific pre-training ERP responses: decreased P1, suggesting less attention allocation, but potentiated N170, suggesting enhanced attention selection and discrimination. Differences in behavioral threat bias did not moderate training effects. Results suggest that efficient allocation of attention to threat combined with enhanced discrimination between threat and non-threat may facilitate stress-reduction effects of ABMT. Targeting neurocognitive responses to threat to personalize ABMT and develop more effective methods of treatment delivery, such as gamification, are discussed.

The Uncanny Valley: Existence and Explanations

More than 40 years ago, Japanese roboticist Masahiro Mori (1970/2005) proposed the “uncanny valley” hypothesis, which predicted a nonlinear relation between robots’ perceived human likeness and their likability. Although some studies have corroborated this hypothesis and proposed explanations for its existence, the evidence on both fronts has been mixed and open to debate. We first review the literature to ascertain whether the uncanny valley exists. We then try to explain the uncanny phenomenon by reviewing hypotheses derived from diverse theoretical and methodological perspectives within psychology and allied fields, including evolutionary, social, cognitive, and psychodynamic approaches. Next, we provide an evaluation and critique of these studies by focusing on their methodological limitations, leading us to question the accepted definition of the uncanny valley. We examine the definitions of human likeness and likability, and propose a statistical test to preliminarily quantify their nonlinear relation. We argue that the uncanny valley hypothesis is ultimately an engineering problem that bears on the possibility of building androids that may some day become indistinguishable from humans. In closing, we propose a dehumanization hypothesis to explain the uncanny phenomenon.

A robust and representative lower bound on object processing speed in humans

How early does the brain decode object categories? Addressing this question is critical to constrain the type of neuronal architecture supporting object categorization. In this context, much effort has been devoted to estimating face processing speed. With onsets estimated from 50 to 150 ms, the timing of the first face-sensitive responses in humans remains controversial. This controversy is due partially to the susceptibility of dynamic brain measurements to filtering distortions and analysis issues. Here, using distributions of single-trial event-related potentials (ERPs), causal filtering, statistical analyses at all electrodes and time points, and effective correction for multiple comparisons, we present evidence that the earliest categorical differences start around 90 ms following stimulus presentation. These results were obtained from a representative group of 120 participants, aged 18-81, who categorized images of faces and noise textures. The results were reliable across testing days, as determined by test-retest assessment in 74 of the participants. Furthermore, a control experiment showed similar ERP onsets for contrasts involving images of houses or white noise. Face onsets did not change with age, suggesting that face sensitivity occurs within 100 ms across the adult lifespan. Finally, the simplicity of the face-texture contrast, and the dominant midline distribution of the effects, suggest the face responses were evoked by relatively simple image properties and are not face specific. Our results provide a new lower benchmark for the earliest neuronal responses to complex objects in the human visual system.

Dynamic spatiotemporal brain analyses using high-performance electrical neuroimaging, Part II: A step-by-step tutorial

Our recently published analytic toolbox (Cacioppo et al., 2014), running under MATLAB environment and Brainstorm, offered a theoretical framework and set of validation studies for the automatic detection of event-related changes in the global pattern and global field power of electrical brain activity. Here, we provide a step-by-step tutorial of this toolbox along with a detailed description of analytical plans (aka the Chicago Electrical Neuroimaging Analytics, CENA) for the statistical analysis of brain microstate configuration and global field power in within and between-subject designs. Available CENA functions include: (1) a difference wave function; (2) a high-performance microsegmentation suite (HPMS), which consists of three specific analytic tools: (i) a root mean square error (RMSE) metric for identifying stable states and transition states across discrete event-related brain microstates; (ii) a similarity metric based on cosine distance in n dimensional sensor space to determine whether template maps for successive brain microstates differ in configuration of brain activity, and (iii) global field power (GFP) metrics for identifying changes in the overall level of activation of the brain; (3) a bootstrapping function for assessing the extent to which the solutions identified in the HPMS are robust (reliable, generalizable) and for empirically deriving additional experimental hypotheses; and (4) step-by-step procedures for performing a priori contrasts for data analysis. CENA is freely available for brain data spatiotemporal analyses at https://hpenlaboratory.uchicago.edu/page/cena, with sample data, user tutorial videos, and documentation.

Segmentation precedes face categorization under suboptimal conditions

Both categorization and segmentation processes play a crucial role in face perception. However, the functional relation between these subprocesses is currently unclear. The present study investigates the temporal relation between segmentation-related and category-selective responses in the brain, using electroencephalography (EEG). Surface segmentation and category content were both manipulated using texture-defined objects, including faces. This allowed us to study brain activity related to segmentation and to categorization. In the main experiment, participants viewed texture-defined objects for a duration of 800 ms. EEG results revealed that segmentation-related responses precede category-selective responses. Three additional experiments revealed that the presence and timing of categorization depends on stimulus properties and presentation duration. Photographic objects were presented for a long and short (92 ms) duration and evoked fast category-selective responses in both cases. On the other hand, presentation of texture-defined objects for a short duration only evoked segmentation-related but no category-selective responses. Category-selective responses were much slower when evoked by texture-defined than by photographic objects. We suggest that in case of categorization of objects under suboptimal conditions, such as when low-level stimulus properties are not sufficient for fast object categorization, segmentation facilitates the slower categorization process.

Behavioral and electrophysiological measures of the body inversion effect: the contribution of the limb configurations

Previous behavioral and electrophysiological studies examining the body inversion effect, where inversion of a body stimulus reduces its recognition, suggested that information regarding human bodies is processed configurally. However, few studies to date have examined how the magnitude of the body inversion effect may be impacted by varying degrees of configural information present in a stimulus of interest. In the current study, upright and inverted body stimuli were presented across three body posture conditions, the whole body, piecemeal body (without head and trunk), and random body posture conditions, while response times, error rates, and event-related potentials were recorded. Behavioral measures and assessment of the N170 component, particularly at occipital-temporal site, revealed a robust difference between upright and inverted postures for both the whole body and piecemeal body posture conditions, which was not observed in the random body posture condition. The behavioral measure showed less errors and faster reaction times for upright compared with inverted orientation; however, the N170 component only showed typical effect of orientation (more negative and more delayed peak in waveform for the inverted compared with upright orientation) in the left hemisphere. The magnitude and direction of these differences were comparable for whole body and piecemeal postures. Overall, these results were consistent with the notion that it is the first-order information of body posture rather than the presence of the head (and trunk) that determines the body inversion effect.

Configural and featural face processing are differently modulated by attentional resources at early stages: an event-related potential study with rapid serial visual presentation

It is widely reported that face recognition relies on two dissociable mechanisms, the featural and the configural processing. However, it is unclear whether these two processing types involve different neural mechanisms and are differently modulated by attentional resources. Using the attentional blink (AB) paradigm, we aimed to investigate the effect of attentional resources on configural and featural face processing by recording event-related potentials (ERPs). The amount of attentional resources was manipulated as deficient or sufficient by presenting the second target (T2) in or out of the AB period, respectively. We found that in addition to a traditional P3 attention effect, the amplitude of N170/VPP to the T2 stimuli was also sensitive to attentional resources, suggesting that attention affects face processing at an earlier perceptual processing stage. More importantly, configural face processing elicited a larger posterior P1 compared to featural face processing, but only when the attentional resources were sufficient. In contrast, the anterior N1 was larger for configural relative to featural face processing only when the attentional resources were deficient. These results suggest that early stages of configural and featural face processing are differently modulated by attentional resources, possibly with different underlying mechanisms.

The N170 observed 'in the wild': robust event-related potentials to faces in cluttered dynamic visual scenes

As a social species in a constantly changing environment, humans rely heavily on the informational richness and communicative capacity of the face. Thus, understanding how the brain processes information about faces in real-time is of paramount importance. The N170 is a high-temporal resolution electrophysiological index of the brain's early response to visual stimuli that is reliably elicited in carefully controlled laboratory-based studies. Although the N170 has often been reported to be of greatest amplitude to faces, there has been debate regarding whether this effect might be an artefact of certain aspects of the controlled experimental stimulation schedules and materials. To investigate whether the N170 can be identified in more realistic conditions with highly variable and cluttered visual images and accompanying auditory stimuli we recorded EEG 'in the wild', while participants watched pop videos. Scene-cuts to faces generated a clear N170 response, and this was larger than the N170 to transitions where the videos cut to non-face stimuli. Within participants, wild-type face N170 amplitudes were moderately correlated to those observed in a typical laboratory experiment. Thus, we demonstrate that the face N170 is a robust and ecologically valid phenomenon and not an artefact arising as an unintended consequence of some property of the more typical laboratory paradigm.

Dissociation between the behavioural and electrophysiological effects of the face and body composite illusions

Several studies have reported similarities between perceptual processes underlying face and body perception, particularly emphasizing the importance of configural processes. Differences between the perception of faces and the perception of bodies were observed by means of a manipulation targeting a specific subtype of configural processing: the composite illusion. The composite face illusion describes the fact that two identical top halves of a face are perceived as being different if they are presented with different bottom parts. This effect disappears, if both halves are laterally shifted. Crucially, the effect of misalignment is not observed for bodies. This study aimed to further explore differences in the time course of face and body perception by using the composite effect. The present results replicated behavioural effects illustrating that misalignment affects the perception of faces but not bodies. Thus, face but not body perception relies on holistic processing. However, differences in the time course of the processing of both stimulus categories emerged at the N170 and P200. The pattern of the behavioural data seemed to be related to the P200. Thus, the present data indicate that holistic processes associated with the effect of misalignment might occur 200 ms after stimulus onset.

Elucidating the neurophysiological underpinnings of autism spectrum disorder: new developments

The study of neurophysiological approaches together with rare and common risk factors for Autism Spectrum Disorder (ASD) allows elucidating the specific underlying neurobiology of ASD. Whereas most neurophysiologically based research in ASD to date has focussed on case-control differences based on the DSM- or ICD-based categorical ASD diagnosis, more recent studies have aimed at studying genetically and/or neurophysiologically defined homogeneous ASD subgroups for specific neuronal biomarkers. This review addresses the neurophysiological investigation of ASD by evoked and event-related potentials, by EEG/MEG connectivity measures such as coherence, and transcranial magnetic stimulation. As an example of classical neurophysiological studies in ASD, we report event-related potential studies which have illustrated which brain areas and processing stages are affected in the visual perception of socially relevant stimuli. However, a paradigm shift has taken place in recent years focussing on how these findings can be tracked down to basic neuronal functions such as deficits in cortico-cortical connectivity and the interaction between brain areas. Disconnectivity, for example, can again be related to genetically induced shifts in the excitation/inhibition balance. Genetic causes of ASD may be grouped by their effects on the brain's system level to identify ASD subgroups which respond differentially to therapeutic interventions.

Food-pics: an image database for experimental research on eating and appetite

Our current environment is characterized by the omnipresence of food cues. The sight and smell of real foods, but also graphically depictions of appetizing foods, can guide our eating behavior, for example, by eliciting food craving and influencing food choice. The relevance of visual food cues on human information processing has been demonstrated by a growing body of studies employing food images across the disciplines of psychology, medicine, and neuroscience. However, currently used food image sets vary considerably across laboratories and image characteristics (contrast, brightness, etc.) and food composition (calories, macronutrients, etc.) are often unspecified. These factors might have contributed to some of the inconsistencies of this research. To remedy this, we developed food-pics, a picture database comprising 568 food images and 315 non-food images along with detailed meta-data. A total of N = 1988 individuals with large variance in age and weight from German speaking countries and North America provided normative ratings of valence, arousal, palatability, desire to eat, recognizability and visual complexity. Furthermore, data on macronutrients (g), energy density (kcal), and physical image characteristics (color composition, contrast, brightness, size, complexity) are provided. The food-pics image database is freely available under the creative commons license with the hope that the set will facilitate standardization and comparability across studies and advance experimental research on the determinants of eating behavior.

Phase noise reveals early category-specific modulation of the event-related potentials

Previous studies have found that the amplitude of the early event-related potential (ERP) components evoked by faces, such as N170 and P2, changes systematically as a function of noise added to the stimuli. This change has been linked to an increased perceptual processing demand and to enhanced difficulty in perceptual decision making about faces. However, to date it has not yet been tested whether noise manipulation affects the neural correlates of decisions about face and non-face stimuli similarly. To this end, we measured the ERPs for faces and cars at three different phase noise levels. Subjects performed the same two-alternative age-discrimination task on stimuli chosen from young–old morphing continua that were created from faces as well as cars and were calibrated to lead to similar performances at each noise-level. Adding phase noise to the stimuli reduced performance and enhanced response latency for the two categories to the same extent. Parallel to that, phase noise reduced the amplitude and prolonged the latency of the face-specific N170 component. The amplitude of the P1 showed category-specific noise dependence: it was enhanced over the right hemisphere for cars and over the left hemisphere for faces as a result of adding phase noise to the stimuli, but remained stable across noise levels for cars over the left and for faces over the right hemisphere. Moreover, noise modulation altered the category-selectivity of the N170, while the P2 ERP component, typically associated with task decision difficulty, was larger for the more noisy stimuli regardless of stimulus category. Our results suggest that the category-specificity of noise-induced modulations of ERP responses starts at around 100 ms post-stimulus.

Compound words prompt arbitrary semantic associations in conceptual memory

Linguistic relativity theory has received empirical support in domains such as color perception and object categorization. It is unknown, however, whether relations between words idiosyncratic to language impact non-verbal representations and conceptualizations. For instance, would one consider the concepts of horse and sea as related were it not for the existence of the compound seahorse? Here, we investigated such arbitrary conceptual relationships using a non-linguistic picture relatedness task in participants undergoing event-related brain potential recordings. Picture pairs arbitrarily related because of a compound and presented in the compound order elicited N400 amplitudes similar to unrelated pairs. Surprisingly, however, pictures presented in the reverse order (as in the sequence horse–sea) reduced N400 amplitudes significantly, demonstrating the existence of a link in memory between these two concepts otherwise unrelated. These results break new ground in the domain of linguistic relativity by revealing predicted semantic associations driven by lexical relations intrinsic to language.

The neural dynamics of face detection in the wild revealed by MVPA

Previous magnetoencephalography/electroencephalography (M/EEG) studies have suggested that face processing is extremely rapid, indeed faster than any other object category. Most studies, however, have been performed using centered, cropped stimuli presented on a blank background resulting in artificially low interstimulus variability. In contrast, the aim of the present study was to assess the underlying temporal dynamics of face detection presented in complex natural scenes. We recorded EEG activity while participants performed a rapid go/no-go categorization task in which they had to detect the presence of a human face. Subjects performed at ceiling (94.8% accuracy), and traditional event-related potential analyses revealed only modest modulations of the two main components classically associated with face processing (P100 and N170). A multivariate pattern analysis conducted across all EEG channels revealed that face category could, however, be readout very early, under 100 ms poststimulus onset. Decoding was linked to reaction time as early as 125 ms. Decoding accuracy did not increase monotonically; we report an increase during an initial 95-140 ms period followed by a plateau ∼140-185 ms-perhaps reflecting a transitory stabilization of the face information available-and a strong increase afterward. Further analyses conducted on individual images confirmed these phases, further suggesting that decoding accuracy may be initially driven by low-level stimulus properties. Such latencies appear to be surprisingly short given the complexity of the natural scenes and the large intraclass variability of the face stimuli used, suggesting that the visual system is highly optimized for the processing of natural scenes.

Implicit binding of facial features during change blindness

Change blindness refers to the inability to detect visual changes if introduced together with an eye-movement, blink, flash of light, or with distracting stimuli. Evidence of implicit detection of changed visual features during change blindness has been reported in a number of studies using both behavioral and neurophysiological measurements. However, it is not known whether implicit detection occurs only at the level of single features or whether complex organizations of features can be implicitly detected as well. We tested this in adult humans using intact and scrambled versions of schematic faces as stimuli in a change blindness paradigm while recording event-related potentials (ERPs). An enlargement of the face-sensitive N170 ERP component was observed at the right temporal electrode site to changes from scrambled to intact faces, even if the participants were not consciously able to report such changes (change blindness). Similarly, the disintegration of an intact face to scrambled features resulted in attenuated N170 responses during change blindness. Other ERP deflections were modulated by changes, but unlike the N170 component, they were indifferent to the direction of the change. The bidirectional modulation of the N170 component during change blindness suggests that implicit change detection can also occur at the level of complex features in the case of facial stimuli.

Neurophysiological correlates of configural face processing in schizotypy

BACKGROUND

Face processing impairment in schizophrenia appears to be underpinned by poor configural (as opposed to feature-based) processing; however, few studies have sought to characterize this impairment electrophysiologically. Given the sensitivity of event-related potentials to antipsychotic medications, and the potential for neurophysiological abnormalities to serve as vulnerability markers for schizophrenia, a handful of studies have investigated early visual P100 and face-selective N170 in "at risk" populations. However, this is the first known neurophysiological investigation of configural face processing in a non-clinical schizotypal sample.

METHODS

Using stimuli designed to engage configural processing in face perception (upright and inverted Mooney and photographic faces), P100 and N170 components were recorded in healthy individuals characterized by high (N = 14) and low (N = 14) schizotypal traits according to the Oxford-Liverpool Inventory of Feelings and Experiences.

RESULTS

High schizotypes showed significantly reduced N170 amplitudes to inverted photographic faces. Typical N170 latency and amplitude inversion effects (delayed and enhanced N170 to inverted relative to upright photographic faces, and enhanced amplitude to upright versus inverted Mooney faces), were demonstrated by low, but not high, schizotypes. No group differences were shown for P100 analyses.

CONCLUSIONS

The findings suggest that neurophysiological deficits in processing facial configurations (N170) are apparent in schizotypy, while the early sensory processing (P100) of faces appears intact. This work adds to the mounting evidence for analogous neural processing anomalies at the healthy end of the psychosis continuum.

P1 and N170 components distinguish human-like and animal-like makeup stimuli

This study used event-related potentials to investigate the sensitivity of P1 and N170 components to human-like and animal-like makeup stimuli, which were derived from pictures of Peking opera characters. As predicted, human-like makeup stimuli elicited larger P1 and N170 amplitudes than did animal-like makeup stimuli. Interestingly, a right hemisphere advantage was observed for human-like but not for animal-like makeup stimuli. Dipole source analyses of 130-200-ms window showed that the bilateral fusiform face area may contribute to the differential sensitivity of the N170 component in response to human-like and animal-like makeup stimuli. The present study suggests that the amplitudes of both the P1 and the N170 are sensitive for the mouth component of face-like stimuli.

Children's neural response to contrast-negated faces is species specific

Face recognition abilities develop dramatically during the first year of life, but comparatively little is known about the nature of face-specific perceptual development during early childhood. Face-specific effects of image appearance on recognition, including face inversion and contrast negation, are a useful means of understanding the functional properties of face perception developmentally. Here, we examined the generality of the impact of contrast negation on face perception during early childhood using event-related potentials (ERPs). Specifically, we recorded continuous electroencephalography (EEG) while adult participants and children between 4 and 6 years of age viewed human and non-human primate faces presented in either positive or negative contrast. We examined both the P100 and N170 components to determine whether or not sensitivity to contrast polarity was evident in face-sensitive components during early childhood and also whether or not that sensitivity was specific to species category. We found evidence of a species-specific effect of contrast negation at the N170, suggesting that by early childhood some aspects of face-specific processing have been restricted to a relatively narrow class of face stimuli. However, this effect is of the opposite sign relative to adults, suggesting that there is continued maturation of face-specific processing during childhood.

The temporal dynamics of first versus second language production

In this study we explored the temporal origin of processing differences between first and second language production. Forty highly proficient bilinguals named objects of high and low lexical frequency aloud for both L1 and L2 separately while event-related brain potentials (ERPs) were recorded. The first electrophysiological differences elicited by response language occurred at the same early P2 peak (∼140-220 ms) where we observed the onset of the lexical frequency effect, but only for those bilinguals who started naming in an L1 context and afterwards switched to an L2 naming context. The bilinguals who named objects in the reverse direction did not display a language effect in the ERPs. Taken together, the data show that the L2 naming disadvantage originates during the onset of lexical access and seems to be driven by both representational strength, which is lower for L2 words, and language control demands, which are higher for L2 words.

Seeing Objects through the Language Glass

Recent streams of research support the Whorfian hypothesis according to which language affects one's perception of the world. However, studies of object categorization in different languages have heavily relied on behavioral measures that are fuzzy and inconsistent. Here, we provide the first electrophysiological evidence for unconscious effects of language terminology on object perception. Whereas English has two words for cup and mug, Spanish labels those two objects with the word “taza.” We tested native speakers of Spanish and English in an object detection task using a visual oddball paradigm, while measuring event-related brain potentials. The early deviant-related negativity elicited by deviant stimuli was greater in English than in Spanish participants. This effect, which relates to the existence of two labels in English versus one in Spanish, substantiates the neurophysiological evidence that language-specific terminology affects object categorization.

Early visual ERP sensitivity to the species and animacy of faces

Assessing the agency of potential actors in the visual world is a critically important aspect of social cognition. Adult observers are generally capable of distinguishing real faces from artificial faces (even allowing for recent advances in graphics technology and motion capture); even small deviations from real facial appearance can lead to profound effects on face recognition. Presently, we examined how early components of visual event-related potentials (ERPs) are affected by the "life" in human faces and animal faces. We presented participants with real and artificial faces of humans and dogs, and analyzed the response properties of the P100 and the N170 as a function of stimulus appearance and task (species categorization vs. animacy categorization). The P100 exhibited sensitivity to face species and animacy. We found that the N170's differential responses to human faces vs. dog faces depended on the task participants' performed. Also, the effect of species was only evident for real faces of humans and dogs, failing to obtain with artificial faces. These results suggest that face animacy does modulate early components of visual ERPs-the N170 is not merely a crude face detector, but reflects the tuning of the visual system to natural face appearance.

Adaptor identity modulates adaptation effects in familiar face identification and their neural correlates

Adaptation-related aftereffects (AEs) show how face perception can be altered by recent perceptual experiences. Along with contrastive behavioural biases, modulations of the early event-related potentials (ERPs) were typically reported on categorical levels. Nevertheless, the role of the adaptor stimulus per se for face identity-specific AEs is not completely understood and was therefore investigated in the present study. Participants were adapted to faces (S1s) varying systematically on a morphing continuum between pairs of famous identities (identities A and B), or to Fourier phase-randomized faces, and had to match the subsequently presented ambiguous faces (S2s; 50/50% identity A/B) to one of the respective original faces. We found that S1s identical with or near to the original identities led to strong contrastive biases with more identity B responses following A adaptation and vice versa. In addition, the closer S1s were to the 50/50% S2 on the morphing continuum, the smaller the magnitude of the AE was. The relation between S1s and AE was, however, not linear. Additionally, stronger AEs were accompanied by faster reaction times. Analyses of the simultaneously recorded ERPs revealed categorical adaptation effects starting at 100 ms post-stimulus onset, that were most pronounced at around 125-240 ms for occipito-temporal sites over both hemispheres. S1-specific amplitude modulations were found at around 300-400 ms. Response-specific analyses of ERPs showed reduced voltages starting at around 125 ms when the S1 biased perception in a contrastive way as compared to when it did not. Our results suggest that face identity AEs do not only depend on physical differences between S1 and S2, but also on perceptual factors, such as the ambiguity of S1. Furthermore, short-term plasticity of face identity processing might work in parallel to object-category processing, and is reflected in the first 400 ms of the ERP.

Toward a unified model of face and object recognition in the human visual system

Our understanding of the mechanisms and neural substrates underlying visual recognition has made considerable progress over the past 30 years. During this period, accumulating evidence has led many scientists to conclude that objects and faces are recognised in fundamentally distinct ways, and in fundamentally distinct cortical areas. In the psychological literature, in particular, this dissociation has led to a palpable disconnect between theories of how we process and represent the two classes of object. This paper follows a trend in part of the recognition literature to try to reconcile what we know about these two forms of recognition by considering the effects of learning. Taking a widely accepted, self-organizing model of object recognition, this paper explains how such a system is affected by repeated exposure to specific stimulus classes. In so doing, it explains how many aspects of recognition generally regarded as unusual to faces (holistic processing, configural processing, sensitivity to inversion, the other-race effect, the prototype effect, etc.) are emergent properties of category-specific learning within such a system. Overall, the paper describes how a single model of recognition learning can and does produce the seemingly very different types of representation associated with faces and objects.

Species-specific effects of pigmentation negation on the neural response to faces

Face processing is limited in scope as a function of experience - discrimination ability and face-specific behavioral effects are reduced in out-group faces. Nonetheless, other-species faces phylogenetically close to our own may be processed by similar mechanisms as human faces. Presently, we asked whether or not the well-known effect of contrast-negation on face recognition (Galper, 1970) was exclusive to human faces or generalized to monkey faces. Negation disrupts face pigmentation substantially, allowing us to examine species-specific use of surface cues as a function of expertise. We tested adult observers behaviorally and electrophysiologically: participants completed a 4AFC discrimination task subject to manipulations of face species and independent negation of image luminance and image chroma, and the same stimuli were used to collect event-related potentials in a go/no-go task. We predicted that expertise for human faces would lead to larger deleterious effects of negation for human faces in both tasks, reflected in longer RTs for correct responses in the discrimination task and species-specific modulation of the N170 and P200 by contrast-negation. Our results however, indicate that behaviorally, luminance and chroma negation affect discrimination performance in a species-independent manner, while similar effects of contrast-negation effects are evident in each species at different components of the ERP response.

Conceptual object representations in human anterior temporal cortex

Interaction with everyday objects requires the representation of conceptual object properties, such as where and how an object is used. What are the neural mechanisms that support this knowledge? While research on semantic dementia has provided evidence for a critical role of the anterior temporal lobes (ATLs) in object knowledge, fMRI studies using univariate analysis have primarily implicated regions outside the ATL. In the present human fMRI study we used multivoxel pattern analysis to test whether activity patterns in ATLs carry information about conceptual object properties. Participants viewed objects that differed on two dimensions: where the object is typically found (in the kitchen or the garage) and how the object is commonly used (with a rotate or a squeeze movement). Anatomical region-of-interest analyses covering the ventral visual stream revealed that information about the location and action dimensions increased from posterior to anterior ventral temporal cortex, peaking in the temporal pole. Whole-brain multivoxel searchlight analysis confirmed these results, revealing highly significant and regionally specific information about the location and action dimensions in the anterior temporal lobes bilaterally. In contrast to conceptual object properties, perceptual and low-level visual properties of the objects were reflected in activity patterns in posterior lateral occipitotemporal cortex and occipital cortex, respectively. These results provide fMRI evidence that object representations in the anterior temporal lobes are abstracted away from perceptual properties, categorizing objects in semantically meaningful groups to support conceptual object knowledge.

Time-course of perceptual processing of "hole" and "no-hole" figures: an ERP study

Closure or the presence of a "hole" is an emergent perceptual feature that can be extracted by the visual system early on. This feature has been shown to have perceptual advantages over openness or "no-hole". in this study, we investigated when and how the human brain differentiates between "hole" and "no-hole" figures. Event-related potentials (ERPs) were recorded during a passive observation paradigm. Two pairs of simple figures (Experiment 1) and two sets of Greek letters (Experiment 2) were used as stimuli. The ERPs of "hole" and "no-hole" figures differed ∼90 ms after stimulus onset: "hole" figures elicited smaller P1 and N1 amplitudes than "no-hole" figures. These suggest that both P1 and N1 components are sensitive to the difference between "hole" and "no-hole" figures; perception of "hole" and "no-hole" figures might be differentiated early during visual processing.

Electrophysiological evidence of facial inversion with rapid serial visual presentation

Using measurements of event-related potentials (ERPs) during a facial recognition task, we aimed to investigate the facial inversion effect and the role of time-based attention in processing upright and inverted faces. We presented upright and inverted faces at the T2 (target 2) position using a rapid serial visual presentation paradigm. Our results indicate that the N170 component shows the usual face inversion effect (FIE), in which inverted faces elicit larger N170 amplitudes and a longer elicit N170 latency. We also found that upright faces elicit larger P1 amplitudes than inverted faces over the left hemisphere. This study indicates that the N170 and P3, but not the P1, components are modulated by time-based attention. In addition, we found that the N170 amplitude was modulated by an attentional blink (AB) based on behavioral data. These results suggest that the disruption of facial configuration processing caused by inverted faces is relatively independent of attentional resources.

The early development of face processing--what makes faces special?

In the present article we review behavioral and neurophysiological studies on face processing in adults and in early development. From the existing empirical and theoretical literature we derive three aspects that distinguish face processing from the processing of other visual object categories. Each of these aspects is discussed from a developmental perspective. First, faces are recognized and represented at the individual level rather than at the basic level. Second, humans typically acquire extensive expertise in individuating faces from early on in development. And third, more than other objects, faces are processed holistically. There is a quantitative difference in the amount of visual experience for faces and other object categories in that the amount of expertise typically acquired for faces is greater than that for other object categories. In addition, we discuss possible qualitative differences in experience for faces and objects. For instance, there is evidence for a sensitive period in infancy for building up a holistic face representation and for perceptual narrowing for faces of one's own species and race. We conclude our literature review with questions for future research, for instance, regarding the exact relationship between behavioral and neuronal markers of face processing across development.

The effects of visual imagery on face identification: an ERP study

The present study tested the hypothesis that the effects of mental imagery on subsequent perception occur at a later matching stage in perceptual identification, but not in the early perceptual stage as in perceptual detection. The behavioral results suggested that the effect of visual imagery on visual identification is content-specific, i.e., imagining a congruent face facilitates face identification, whereas a mismatch between imagery and perception leads to an interference effect. More importantly, the ERP results revealed that a more negative N2 response to the subsequent visual face stimuli was elicited over fronto-central sites in the mismatch and no-imagery conditions as compared to that in the match condition, with the early P1 and N170 components independent of manipulations. The latency and distribution of the neural effects demonstrate that the matching step, but not the earlier perceptual process, is affected by the preceding visual imagery in the context of face identification. We discuss these results in a broader context that the imagery-perception interaction may depend on task demand.

Conscious intention to speak proactively facilitates lexical access during overt object naming

The present study explored when and how the top-down intention to speak influences the language production process. We did so by comparing the brain's electrical response for a variable known to affect lexical access, namely word frequency, during overt object naming and non-verbal object categorization. We found that during naming, the event-related brain potentials elicited for objects with low frequency names started to diverge from those with high frequency names as early as 152 ms after stimulus onset, while during non-verbal categorization the same frequency comparison appeared 200 ms later eliciting a qualitatively different brain response. Thus, only when participants had the conscious intention to name an object the brain rapidly engaged in lexical access. The data offer evidence that top-down intention to speak proactively facilitates the activation of words related to perceived objects.

Electrophysiological potentials reveal cortical mechanisms for mental imagery, mental simulation, and grounded (embodied) cognition

Grounded cognition theory proposes that cognition, including meaning, is grounded in sensorimotor processing. The mechanism for grounding cognition is mental simulation, which is a type of mental imagery that re-enacts modal processing. To reveal top-down, cortical mechanisms for mental simulation of shape, event-related potentials were recorded to face and object pictures preceded by mental imagery. Mental imagery of the identical face or object picture (congruous condition) facilitated not only categorical perception (VPP/N170) but also later visual knowledge [N3(00) complex] and linguistic knowledge (N400) for faces more than objects, and strategic semantic analysis (late positive complex) between 200 and 700 ms. The later effects resembled semantic congruity effects with pictures. Mental imagery also facilitated category decisions, as a P3 peaked earlier for congruous than incongruous (other category) pictures, resembling the case when identical pictures repeat immediately. Thus mental imagery mimics semantic congruity and immediate repetition priming processes with pictures. Perception control results showed the opposite for faces and were in the same direction for objects: Perceptual repetition adapts (and so impairs) processing of perceived faces from categorical perception onward, but primes processing of objects during categorical perception, visual knowledge processes, and strategic semantic analysis. For both imagery and perception, differences between faces and objects support domain-specificity and indicate that cognition is grounded in modal processing. Altogether, this direct neural evidence reveals that top-down processes of mental imagery sustain an imagistic representation that mimics perception well enough to prime subsequent perception and cognition. Findings also suggest that automatic mental simulation of the visual shape of faces and objects operates between 200 and 400 ms, and strategic mental simulation operates between 400 and 700 ms.

Neural adaptation provides evidence for categorical differences in processing of faces and Chinese characters: an ERP study of the N170

Whether face perception involves domain-specific or domain-general processing is an extensively debated issue. Relative to non-face objects and alphabetical scripts, Chinese characters provide a good contrast to faces because of their structural configuration, requirement for high level of visual expertise to literate Chinese people, and unique appearance and identity for each individual stimulus. To examine potential categorical differences in their neural processing, event-related potentials (ERPs) were recorded to blocked face and Chinese character stimuli. Fast adaptation method was applied to better control for the low-level stimulus difference between faces and Chinese characters. Participants were required to respond to the color of the outer frame in which these stimuli were presented, at either a fast (ISI 650 ms) or slow (ISI 1300 ms) rate, and with an orientation that was either the same or alternated between upright and inverted. Faces elicited a larger and later N170 relative to characters, but the N170 was more left-lateralized for characters relative to the faces. Adaptation-by-rate and adaptation-by-orientation effects were observed on the amplitude of N170, and both were more pronounced for faces relative to characters. Inverted stimuli elicited a later N170 relative to upright stimuli, without amplitude change, and this inversion effect was more pronounced for faces relative to characters. Moreover, faces elicited a larger and later P1 and a larger adaptation-by-rate effect on P1 relative to characters. The adaptation-by-orientation effect was illustrated by a larger P1 under the same relative to the alternated orientation condition. Therefore, evidence from the amplitude and the lateralization of N170, the stimulus inversion effect on N170 latency, and the neural adaptation between faces and Chinese characters on P1 and N170 components support the notion that the processing of faces and Chinese characters involve categorically different neural mechanisms.

Cortical sensitivity to contrast polarity and orientation of faces is modulated by temporal-nasal hemifield asymmetry

Behavioral studies demonstrate that the efficiency of detection of faces is dependent on configural and contrast polarity information characteristic to human faces. Stimulus inversion or contrast polarity reversal can disrupt this process. We investigated whether a face-sensitive event-related potential component, the N170, is modulated by the orientation and contrast polarity of highly degraded schematic face-like patterns (Experiment 1) in the same manner as it is for face photographs (Experiment 2). Inversion and/or contrast reversal delayed and enhanced the N170 for both kinds of stimuli, suggesting that a white oval with three black squares is sufficient to elicit face-sensitive cortical responses. In Experiment 3 we further tested whether the extrageniculate visual pathways modulate early cortical responses to faces. We found that the N170 responses to configural and contrast information are modulated by temporal-nasal visual field asymmetry under monocular viewing conditions, suggesting the involvement of subcortical, extrageniculate visual pathways in face detection. These results are consistent with the idea that an ontogenetically early and primitive bias to orient towards face-like patterns with relevant configural and contrast information influences the early stages of cortical face processing.

Stimulus dependency of object-evoked responses in human visual cortex: an inverse problem for category specificity

Many studies have linked the processing of different object categories to specific event-related potentials (ERPs) such as the face-specific N170. Despite reports showing that object-related ERPs are influenced by visual stimulus features, there is consensus that these components primarily reflect categorical aspects of the stimuli. Here, we re-investigated this idea by systematically measuring the effects of visual feature manipulations on ERP responses elicited by both structure-from-motion (SFM)-defined and luminance-defined object stimuli. SFM objects elicited a novel component at 200-250 ms (N250) over parietal and posterior temporal sites. We found, however, that the N250 amplitude was unaffected by restructuring SFM stimuli into meaningless objects based on identical visual cues. This suggests that this N250 peak was not uniquely linked to categorical aspects of the objects, but is strongly determined by visual stimulus features. We provide strong support for this hypothesis by parametrically manipulating the depth range of both SFM- and luminance-defined object stimuli and showing that the N250 evoked by SFM stimuli as well as the well-known N170 to static faces were sensitive to this manipulation. Importantly, this effect could not be attributed to compromised object categorization in low depth stimuli, confirming a strong impact of visual stimulus features on object-related ERP signals. As ERP components linked with visual categorical object perception are likely determined by multiple stimulus features, this creates an interesting inverse problem when deriving specific perceptual processes from variations in ERP components.

Early goal-directed top-down influences in the production of speech

It was recently reported that the conscious intention to produce speech affects the speed with which lexical information is retrieved upon presentation of an object (Strijkers et al., 2011). The goal of the present study was to elaborate further on the role of these top-down influences in the course of planning speech behavior. In an event-related potentials (ERP) experiment, participants were required to overtly name pictures and words in one block of trials, while categorizing the same stimuli in another block of trials. The ERPs elicited by the naming task started to diverge very early on (∼170 ms) from those elicited by the semantic categorization task. Interestingly, these early ERP differences related to task intentionality were identical for pictures and words. From these results we conclude that (a) in line with Strijkers et al. (2011), goal-directed processes play a crucial role very early on in speech production, and (b) these task-driven top-down influences function at least in a domain-general manner by modulating those networks which are always relevant for the production of language, irrespective of which cortical pathways are triggered by the input.