Parafoveal vision reveals qualitative differences between fusiform face area and parahippocampal place area

The center-periphery visual field axis guides early visual system organization with enhanced resources devoted to central vision leading to reduced peripheral performance relative to that of central vision (i.e., behavioral eccentricity effect) for many visual functions. The center-periphery organization extends to high-order visual cortex where, for example, the well-studied face-sensitive fusiform face area (FFA) shows sensitivity to central vision and the place-sensitive parahippocampal place area (PPA) shows sensitivity to peripheral vision. As we have recently found that face perception is more sensitive to eccentricity than place perception, here we examined whether these behavioral findings reflect differences in FFA's and PPA's sensitivities to eccentricity. We assumed FFA would show higher sensitivity to eccentricity than PPA would, but that both regions' modulation by eccentricity would be invariant to the viewed category. We parametrically investigated (fMRI, n = 32) how FFA's and PPA's activations are modulated by eccentricity (≤8°) and category (upright/inverted faces/houses) while keeping stimulus size constant. As expected, FFA showed an overall higher sensitivity to eccentricity than PPA. However, both regions' activation modulations by eccentricity were dependent on the viewed category. In FFA, a reduction of activation with growing eccentricity ("BOLD eccentricity effect") was found (with different amplitudes) for all categories. In PPA however, qualitatively different BOLD eccentricity effect modulations were found (e.g., at 8° mild BOLD eccentricity effect for houses but a reverse BOLD eccentricity effect for faces and no modulation for inverted faces). Our results emphasize that peripheral vision investigations are critical to further our understanding of visual processing.

Extensive Visual Training in Adulthood Reduces an Implicit Neural Marker of the Face Inversion Effect

Face identity recognition (FIR) in humans is supported by specialized neural processes whose function is spectacularly impaired when simply turning a face upside-down: the face inversion effect (FIE). While the FIE appears to have a slow developmental course, little is known about the plasticity of the neural processes involved in this effect-and in FIR in general-at adulthood. Here, we investigate whether extensive training (2 weeks, ~16 h) in young human adults discriminating a large set of unfamiliar inverted faces can reduce an implicit neural marker of the FIE for a set of entirely novel faces. In all, 28 adult observers were trained to individuate 30 inverted face identities presented under different depth-rotated views. Following training, we replicate previous behavioral reports of a significant reduction (56% relative accuracy rate) in the behavioral FIE as measured with a challenging four-alternative delayed-match-to-sample task for individual faces across depth-rotated views. Most importantly, using EEG together with a validated frequency tagging approach to isolate a neural index of FIR, we observe the same substantial (56%) reduction in the neural FIE at the expected occipito-temporal channels. The reduction in the neural FIE correlates with the reduction in the behavioral FIE at the individual participant level. Overall, we provide novel evidence suggesting a substantial degree of plasticity in processes that are key for face identity recognition in the adult human brain.

Face processing and early event-related potentials: replications and novel findings

This research explores early Event-Related Potentials (ERPs) sensitivity to facial stimuli, investigating various facial features aimed to unveil underlying neural mechanisms. Two experiments, each involving 15 undergraduate students, utilized a multidimensional stimulus set incorporating race, gender, age, emotional expression, face masks, and stimulus orientation. Findings highlight significant modulations in N170 and P200 amplitudes and latencies for specific attributes, replicating prior research and revealing novel insights. Notably, age-related facial feature variations, facial inversion, and the presence of face masks significantly impact neural responses. Several speculative explanations are proposed to elucidate these results: First, the findings lend support to the idea that the increased N170 amplitude observed with facial inversion is closely tied to the activation of object-sensitive neurons. This is further bolstered by a similar amplitude increase noted when masks (effective objects) are added to faces. Second, the absence of an additional amplitude increase, when inverting face images with face masks suggests that neural populations may have reached a saturation point, limiting further enhancement. Third, the study reveals that the latency deficit in N170 induced by facial inversion is even more pronounced in the subsequent ERP component, the P200, indicating that face inversion may impact multiple stages of face processing. Lastly, the significant increase in P200 amplitude, typically associated with face typicality, for masked faces in this study aligns with previous research that demonstrated elevated P200 amplitudes for scrambled faces. This suggests that obscured faces may be processed as typical, potentially representing a default state in face processing.

Tracking the temporal dynamics of the face-like inversion effect as revealed by Chinese characters using magnetoencephalography

The neural basis of configural processing has been extensively studied by exploiting face inversion during recognition, and growing evidence has revealed that word inversion also involves changes in configuration. However, the neural dynamics of face-like inversion effects remain unclear. Here, we tracked the temporal dynamics of neural responses that were sensitive to inversion during Chinese character recognition as they occurred during face recognition using multivariate decoding and temporal generalization analyses. We recorded magnetoencephalography while participants performed a one-back task for faces, compound characters, and simple characters with upright and inverted orientations. We showed that the inversion effect (inverted versus upright) can be decoded at occipitotemporal sensors for all stimulus types over and across time points, with a stronger impact on faces and compound characters than on simple characters. The inversion effect occurred earlier and lasted longer for faces than for characters, and the effect was also stronger for compound characters than for simple characters. Finally, we demonstrated inversion effects in the event-related field for all stimulus types and identified their sources in the ventral occipitotemporal areas. Overall, this study provides novel evidence for the temporal dynamics of the face-like inversion effect occurring during Chinese character recognition.

Effects of Natural Scene Inversion on Visual-evoked Brain Potentials and Pupillary Responses: A Matter of Effortful Processing of Unfamiliar Configurations

The inversion of a picture of a face hampers the accuracy and speed at which observers can perceptually process it. Event-related potentials and pupillary responses, successfully used as biomarkers of face inversion in the past, suggest that the perception of visual features, that are organized in an unfamiliar manner, recruits demanding additional processes. However, it remains unclear whether such inversion effects generalize beyond face stimuli and whether indeed more mental effort is needed to process inverted images. Here we aimed to study the effects of natural scene inversion on visual evoked potentials and pupil dilations. We simultaneously measured responses of 47 human participants to presentations of images showing upright or inverted natural scenes. For inverted scenes, we observed relatively stronger occipito-temporo-parietal N1 peak amplitudes and larger pupil dilations (on top of an initial orienting response) than for upright scenes. This study revealed neural and physiological markers of natural scene inversion that are in line with inversion effects of other stimulus types and demonstrates the robustness and generalizability of the phenomenon that unfamiliar configurations of visual content require increased processing effort.

Faster social attention disengagement in individuals with higher autism traits

INTRODUCTION

Atypical visual and social attention has often been associated with clinically diagnosed autism spectrum disorder (ASD), and with the broader autism phenotype. Atypical social attention is of particular research interest given the importance of facial expressions for social communication, with faces tending to attract and hold attention in neurotypical individuals. In autism, this is not necessarily so, where there is debate about the temporal differences in the ability to disengage attention from a face.

METHOD

Thus, we have used eye-tracking to record saccadic latencies as a measure of time to disengage attention from a central task-irrelevant face before orienting to a newly presented peripheral nonsocial target during a gap-overlap task. Neurotypical participants with higher or lower autism-like traits (AT) completed the task that included central stimuli with varied expressions of facial emotion as well as an inverted face.

RESULTS

High AT participants demonstrated faster saccadic responses to detect the nonsocial target than low AT participants when disengaging attention from a face. Furthermore, faster saccadic responses were recorded when comparing disengagement from upright to inverted faces in low AT but not in high AT participants.

CONCLUSIONS

Together, these results extend findings of atypical social attention disengagement in autism and highlight how differences in attention to faces in the broader autism phenotype can lead to apparently superior task performance under certain conditions. Specifically, autism traits were linked to faster attention orienting to a nonsocial target due to the reduced attentional hold of the task irrelevant face stimuli. The absence of an inversion effect in high AT participants also reinforces the suggestion that they process upright or inverted faces similarly, unlike low AT participants for whom inverted faces are thought to be less socially engaging, thus allowing faster disengagement.

The Left-Side Bias Is Reduced to Other-Race Faces in Caucasian Individuals

One stable marker of face perception appears to be left-side bias, the tendency to rely more on information conveyed by the left side of the face than the right. Previous studies have shown that left-side bias is influenced by familiarity and prior experience with face stimuli. Since other-race facial recognition is characterized by reduced familiarity, in contrast to own-race facial recognition, the phenomenon of left-side bias is expected to be weaker for other-race faces. Among Chinese participants, face inversion has been found to eliminate the left-side bias associated with own-race faces. Therefore, it is of interest to know whether face inversion influences left-side bias for non-Chinese research participants and can be generalized across own- and other-race faces. This study assessed 65 Caucasian participants using upright and inverted chimeric Caucasian and Asian faces in an identity similarity-judgment task. Although a significant left-side bias was observed for upright own-race faces, this bias was eliminated by facial inversion, indicating that such a bias depends on the applicability of configural processing strategies. For other-race faces, there was no left-side bias in the upright condition. Interestingly, the inverted presentation yielded a right-side bias. These results show that while left-side bias is affected by familiarity differences between own- and other-race faces, it is a universal phenomenon for upright faces. Inverted presentation strongly reduces left-side bias and may even cause it to revert to right-side bias, suggesting that left-side bias depends on configural face processing.

Face perception: computational insights from phylogeny

Studies of face perception in primates elucidate the psychological and neural mechanisms that support this critical and complex ability. Recent progress in characterizing face perception across species, for example in insects and reptiles, has highlighted the ubiquity over phylogeny of this key ability for social interactions and survival. Here, we review the competence in face perception across species and the types of computation that support this behavior. We conclude that the computational complexity of face perception evinced by a species is not related to phylogenetic status and is, instead, largely a product of environmental context and social and adaptive pressures. Integrating findings across evolutionary data permits the derivation of computational principles that shed further light on primate face perception.

Saccade Latency Provides Evidence for Reduced Face Inversion Effects With Higher Autism Traits

Individuals on the autism spectrum are reported to show impairments in the processing of social information, including aspects of eye-movements towards faces. Abnormalities in basic-level visual processing are also reported. In the current study, we sought to determine if the latency of saccades made towards social targets (faces) in a natural scene as opposed to inanimate targets (cars) would be related to sub-clinical autism traits (ATs) in individuals drawn from a neurotypical population. The effect of stimulus inversion was also examined given that difficulties with processing inverted faces are thought to be a function of face expertise. No group differences in saccadic latency were established for face or car targets, regardless of image orientation. However, as expected, we found that individuals with higher autism-like traits did not demonstrate a saccadic face inversion effect, but those with lower autism-like traits did. Neither group showed a car inversion effect. Thus, these results suggest that neurotypical individuals with high autism-like traits also show anomalies in detecting and orienting to faces. In particular, the reduced saccadic face inversion effect established in these participants with high ATs suggests that speed of visual processing and orienting towards faces may be associated with the social difficulties found across the broader autism spectrum.

The Influence of Face Inversion and Spatial Frequency on the Self-Positive Expression Processing Advantage

Previous research has examined the impact of late self-evaluation, ignoring the impact of the early visual coding stage and the extraction of facial identity information and expression information on the self-positive expression processing advantage. From the perspective of the processing course, this study examined the stability of the self-positive expression processing advantage and revealed its generation mechanism. In Experiment 1, inverted self-expression and others’ expressive pictures were used to influence early structural coding. In Experiments 2a and 2b, we used expression pictures of high and low spatial frequency, thereby affecting the extraction of facial identity information or expression information in the mid-term stage. The visual search paradigm was adopted in three experiments, asking subjects to respond to the target expression. We found that under the above experimental conditions, the search speed for self-faces was always faster than that for self-angry expressions and others’ faces. These results showed that, compared with others’ expressions and self-angry expressions, self-positive expressions were more prominent and more attractive. These findings suggest that self-expression recognition combines with conceptual self-knowledge to form an abstract and constant processing pattern. Therefore, the processing of self-expression recognition was not affected by the facial orientation and spatial frequencies.

Those Virtual People all Look the Same to me: Computer-Rendered Faces Elicit a Higher False Alarm Rate Than Real Human Faces in a Recognition Memory Task

Virtual as compared with real human characters can elicit a sense of uneasiness in human observers, characterized by lack of familiarity and even feelings of eeriness (the “uncanny valley” hypothesis). Here we test the possibility that this alleged lack of familiarity is literal in the sense that people have lesser perceptual expertise in processing virtual as compared with real human faces. Sixty-four participants took part in a recognition memory study in which they first learned a set of faces and were then asked to recognize them in a testing session. We used real and virtual (computer-rendered) versions of the same faces, presented in either upright or inverted orientation. Real and virtual faces were matched for low-level visual features such as global luminosity and spatial frequency contents. Our results demonstrated a higher response bias toward responding “seen before” for virtual as compared with real faces, which was further explained by a higher false alarm rate for the former. This finding resembles a similar effect for recognizing human faces from other than one's own ethnic groups (the “other race effect”). Virtual faces received clearly higher subjective eeriness ratings than real faces. Our results did not provide evidence of poorer overall recognition memory or lesser inversion effect for virtual faces, however. The higher false alarm rate finding supports the notion that lesser perceptual expertise may contribute to the lack of subjective familiarity with virtual faces. We discuss alternative interpretations and provide suggestions for future research.

Classification of Emotional Expressions Is Affected by Inversion: Behavioral and Electrophysiological Evidence

It has been shown that emotionally positive facial expressions are recognized substantially faster than emotionally negative facial expressions, the positive classification advantage (PCA). In this experiment we explored the involvement of configural computations while processing positive and negative faces in an expression categorization task using artificial faces. Analyzing the reaction times (RTs), we found that happy faces were categorized more quickly than sad faces (PCA) and this effect disappeared for inverted faces. Event-related potentials (ERPs) data showed that the face-sensitive N170 component was larger for sad than for happy faces only at upright condition and that face inversion significantly enhanced N170 amplitudes only for happy faces. Moreover, the happy faces elicited shorter N170 latency than did the sad faces, whereas for inverted condition the N170 latency did not differ between happy and sad faces. Finally, the significant positive correlation between the RTs and the latency of the N170 was not found for N170 amplitudes. Because the configural computation was task-irrelevant in the present study, these behavioral and ERP data indicated that one of the sources of PCA is the configural analysis applied by default while categorizing facial emotions.

Being BOLD: The neural dynamics of face perception

According to a non-hierarchical view of human cortical face processing, selective responses to faces may emerge in a higher-order area of the hierarchy, in the lateral part of the middle fusiform gyrus (fusiform face area [FFA]) independently from face-selective responses in the lateral inferior occipital gyrus (occipital face area [OFA]), a lower order area. Here we provide a stringent test of this hypothesis by gradually revealing segmented face stimuli throughout strict linear descrambling of phase information [Ales et al., 2012]. Using a short sampling rate (500 ms) of fMRI acquisition and single subject statistical analysis, we show a face-selective responses emerging earlier, that is, at a lower level of structural (i.e., phase) information, in the FFA compared with the OFA. In both regions, a face detection response emerging at a lower level of structural information for upright than inverted faces, both in the FFA and OFA, in line with behavioral responses and with previous findings of delayed responses to inverted faces with direct recordings of neural activity were also reported. Overall, these results support the non-hierarchical view of human cortical face processing and open new perspectives for time-resolved analysis at the single subject level of fMRI data obtained during continuously evolving visual stimulation. Hum Brain Mapp 38:120-139, 2017. © 2016 Wiley Periodicals, Inc.

The effects of facial color and inversion on the N170 event-related potential (ERP) component

Faces are important for social interaction because much can be perceived from facial details, including a person's race, age, and mood. Recent studies have shown that both configural (e.g. face shape and inversion) and surface information (e.g. surface color and reflectance properties) are important for face perception. Therefore, the present study examined the effects of facial color and inverted face properties on event-related potential (ERP) responses, particularly the N170 component. Stimuli consisted of natural and bluish-colored faces. Faces were presented in both upright and upside down orientations. An ANOVA was used to analyze N170 amplitudes and verify the effects of the main independent variables. Analysis of N170 amplitude revealed the significant interactions between stimulus orientation and color. Subsequent analysis indicated that N170 was larger for bluish-colored faces than natural-colored faces, and N170 to natural-colored faces was larger in response to inverted stimulus as compared to upright stimulus. Additionally, a multivariate pattern analysis (MVPA) investigated face-processing dynamics without any prior assumptions. Results distinguished, above chance, both facial color and orientation from single-trial electroencephalogram (EEG) signals. Decoding performance for color classification of inverted faces was significantly diminished as compared to an upright orientation. This suggests that processing orientation is predominant over facial color. Taken together, the present findings elucidate the temporal and spatial distribution of orientation and color processing during face processing.

Developmental changes in analytic and holistic processes in face perception

Although infants demonstrate sensitivity to some kinds of perceptual information in faces, many face capacities continue to develop throughout childhood. One debate is the degree to which children perceive faces analytically versus holistically and how these processes undergo developmental change. In the present study, school-aged children and adults performed a perceptual matching task with upright and inverted face and house pairs that varied in similarity of featural or 2(nd) order configural information. Holistic processing was operationalized as the degree of serial processing when discriminating faces and houses [i.e., increased reaction time (RT), as more features or spacing relations were shared between stimuli]. Analytical processing was operationalized as the degree of parallel processing (or no change in RT as a function of greater similarity of features or spatial relations). Adults showed the most evidence for holistic processing (most strongly for 2(nd) order faces) and holistic processing was weaker for inverted faces and houses. Younger children (6-8 years), in contrast, showed analytical processing across all experimental manipulations. Older children (9-11 years) showed an intermediate pattern with a trend toward holistic processing of 2(nd) order faces like adults, but parallel processing in other experimental conditions like younger children. These findings indicate that holistic face representations emerge around 10 years of age. In adults both 2(nd) order and featural information are incorporated into holistic representations, whereas older children only incorporate 2(nd) order information. Holistic processing was not evident in younger children. Hence, the development of holistic face representations relies on 2(nd) order processing initially then incorporates featural information by adulthood.

Separable effects of inversion and contrast-reversal on face detection thresholds and response functions: a sweep VEP study

The human brain rapidly detects faces in the visual environment. We recently presented a sweep visual evoked potential approach to objectively define face detection thresholds as well as suprathreshold response functions (Ales, Farzin, Rossion, & Norcia, 2012). Here we determined these parameters are affected by orientation (upright vs. inverted) and contrast polarity (positive vs. negative), two manipulations that disproportionately disrupt the perception of faces relative to other object categories. Face stimuli parametrically increased in visibility through phase-descrambling while alternating with scrambled images at a fixed presentation rate of 3 Hz (6 images/s). The power spectrum and mean luminance of all stimuli were equalized. As a face gradually emerged during a stimulation sequence, EEG responses at 3 Hz appeared at ≈35% phase coherence over right occipito-temporal channels, replicating previous observations. With inversion and contrast-reversal, the 3-Hz amplitude decreased by ≈20%-50% and the face detection threshold increased by ≈30%-60% coherence. Furthermore, while the 3-Hz response emerged abruptly and saturated quickly for normal faces, suggesting a categorical neural response, the response profile for inverted and negative polarity faces was shallower and more linear, indicating gradual and continuously increasing activation of the underlying neural population. These findings demonstrate that inversion and contrast-reversal increase the threshold and modulate the suprathreshold response function of face detection.

Spatio-temporal dynamics and laterality effects of face inversion, feature presence and configuration, and face outline

Although a crucial role of the fusiform gyrus (FG) in face processing has been demonstrated with a variety of methods, converging evidence suggests that face processing involves an interactive and overlapping processing cascade in distributed brain areas. Here we examine the spatio-temporal stages and their functional tuning to face inversion, presence and configuration of inner features, and face contour in healthy subjects during passive viewing. Anatomically-constrained magnetoencephalography (aMEG) combines high-density whole-head MEG recordings and distributed source modeling with high-resolution structural MRI. Each person's reconstructed cortical surface served to constrain noise-normalized minimum norm inverse source estimates. The earliest activity was estimated to the occipital cortex at ~100 ms after stimulus onset and was sensitive to an initial coarse level visual analysis. Activity in the right-lateralized ventral temporal area (inclusive of the FG) peaked at ~160 ms and was largest to inverted faces. Images containing facial features in the veridical and rearranged configuration irrespective of the facial outline elicited intermediate level activity. The M160 stage may provide structural representations necessary for downstream distributed areas to process identity and emotional expression. However, inverted faces additionally engaged the left ventral temporal area at ~180 ms and were uniquely subserved by bilateral processing. This observation is consistent with the dual route model and spared processing of inverted faces in prosopagnosia. The subsequent deflection, peaking at ~240 ms in the anterior temporal areas bilaterally, was largest to normal, upright faces. It may reflect initial engagement of the distributed network subserving individuation and familiarity. These results support dynamic models suggesting that processing of unfamiliar faces in the absence of a cognitive task is subserved by a distributed and interactive neural circuit.

Breaking Continuous Flash Suppression: A New Measure of Unconscious Processing during Interocular Suppression?

Until recently, it has been thought that under interocular suppression high-level visual processing is strongly inhibited if not abolished. With the development of continuous flash suppression (CFS), a variant of binocular rivalry, this notion has now been challenged by a number of reports showing that even high-level aspects of visual stimuli, such as familiarity, affect the time stimuli need to overcome CFS and emerge into awareness. In this "breaking continuous flash suppression" (b-CFS) paradigm, differential unconscious processing during suppression is inferred when (a) speeded detection responses to initially invisible stimuli differ, and (b) no comparable differences are found in non-rivalrous control conditions supposed to measure non-specific threshold differences between stimuli. The aim of the present study was to critically evaluate these assumptions. In six experiments we compared the detection of upright and inverted faces. We found that not only under CFS, but also in control conditions upright faces were detected faster and more accurately than inverted faces, although the effect was larger during CFS. However, reaction time (RT) distributions indicated critical differences between the CFS and the control condition. When RT distributions were matched, similar effect sizes were obtained in both conditions. Moreover, subjective ratings revealed that CFS and control conditions are not perceptually comparable. These findings cast doubt on the usefulness of non-rivalrous control conditions to rule out non-specific threshold differences as a cause of shorter detection latencies during CFS. Thus, at least in its present form, the b-CFS paradigm cannot provide unequivocal evidence for unconscious processing under interocular suppression. Nevertheless, our findings also demonstrate that the b-CFS paradigm can be fruitfully applied as a highly sensitive device to probe differences between stimuli in their potency to gain access to awareness.

Frontal contributions to face processing differences in autism: evidence from fMRI of inverted face processing

Functional neuroimaging studies of face processing deficits in autism have typically focused on visual processing regions, such as the fusiform face area (FFA), which have shown reduced activity in autism spectrum disorders (ASD), though inconsistently. We recently reported reduced activity in the inferior frontal region in ASD, implicating impaired mirror-neuron systems during face processing. In the present study, we used fMRI during a face processing task in which subjects had to match faces presented in the upright versus inverted position. Typically developing (TD) children showed a classic behavioral inversion effect, increased reaction time for inverted faces, while this effect was significantly reduced in ASD subjects. The fMRI data showed similar responses in the fusiform face area for ASD and TD children, with both groups demonstrating increased activation for inverted faces. However, the groups did differ in several brain regions implicated in social cognition, particularly prefrontal cortex and amygdala. These data suggest that the behavioral differences in processing upright versus inverted faces for TD children are related not to visual information processing but to the social significance of the stimuli. Our results are consistent with other recent studies implicating frontal and limbic dysfunction during face processing in autism.