Processing of configural and componential information in face-selective cortical areas

Sound-encoded faces activate the left fusiform face area in the early blind

Face perception in humans and nonhuman primates is accomplished by a patchwork of specialized cortical regions. How these regions develop has remained controversial. In sighted individuals, facial information is primarily conveyed via the visual modality. Early blind individuals, on the other hand, can recognize shapes using auditory and tactile cues. Here we demonstrate that such individuals can learn to distinguish faces from houses and other shapes by using a sensory substitution device (SSD) presenting schematic faces as sound-encoded stimuli in the auditory modality. Using functional MRI, we then asked whether a face-selective brain region like the fusiform face area (FFA) shows selectivity for faces in the same subjects, and indeed, we found evidence for preferential activation of the left FFA by sound-encoded faces. These results imply that FFA development does not depend on experience with visual faces per se but may instead depend on exposure to the geometry of facial configurations.

Prosopagnosia does not abolish other-race effects

Healthy observers recognize more accurately same-than other-race faces (i.e., the Same-Race Recognition Advantage - SRRA) but categorize them by race more slowly than other-race faces (i.e., the Other-Race Categorization Advantage - ORCA). Several fMRI studies reported discrepant bilateral activations in the Fusiform Face Area (FFA) and Occipital Face Area (OFA) correlating with both effects. However, due to the very nature and limits of fMRI results, whether these face-sensitive regions play an unequivocal causal role in those other-race effects remains to be clarified. To this aim, we tested PS, a well-studied pure case of acquired prosopagnosia with lesions encompassing the left FFA and the right OFA. PS, healthy age-matched and young adults performed two recognition and three categorization by race tasks, respectively using Western Caucasian and East Asian faces normalized for their low-level properties with and without-external features, as well as in naturalistic settings. As expected, PS was slower and less accurate than the controls. Crucially, however, the magnitudes of her SRRA and ORCA were comparable to the controls in all the tasks. Our data show that prosopagnosia does not abolish other-race effects, as an intact face system, the left FFA and/or right OFA are not critical for eliciting the SRRA and ORCA. Race is a strong visual and social signal that is encoded in a large neural face-sensitive network, robustly tuned for processing same-race faces.

The Face Module Emerged in a Deep Convolutional Neural Network Selectively Deprived of Face Experience

Can we recognize faces with zero experience on faces? This question is critical because it examines the role of experiences in the formation of domain-specific modules in the brain. Investigation with humans and non-human animals on this issue cannot easily dissociate the effect of the visual experience from that of the hardwired domain-specificity. Therefore, the present study built a model of selective deprivation of the experience on faces with a representative deep convolutional neural network, AlexNet, by removing all images containing faces from its training stimuli. This model did not show significant deficits in face categorization and discrimination, and face-selective modules automatically emerged. However, the deprivation reduced the domain-specificity of the face module. In sum, our study provides empirical evidence on the role of nature vs. nurture in developing the domain-specific modules that domain-specificity may evolve from non-specific experience without genetic predisposition, and is further fine-tuned by domain-specific experience.

The activity and connectivity of the facial emotion processing neural circuitry in bipolar disorder: a systematic review

BACKGROUND

Facial emotion processing abnormalities may be a trait feature of bipolar disorder (BD). These social cognitive impairments may be due to alterations in the neural processing of facial affective information in visual ("core"), and limbic and prefrontal ("extended") networks, however, the precise neurobiological mechanism(s) underlying these symptoms are unclear.

METHODS

We conducted a systematic review to appraise the literature on the activity and connectivity of the facial emotion processing neural circuitry in BD. Two reviewers undertook a search of the electronic databases PubMed, Scopus and PsycINFO, to identify relevant literature published since inception up until September 2019. Study eligibility criteria included; BD participants, neuroimaging, and facial emotion processing tasks.

RESULTS

Out of an initial yield of 6121 articles, 66 were eligible for inclusion in this review. We identified differences in neural activity and connectivity within and between occipitotemporal, limbic, and prefrontal regions, in response to facial affective stimuli, in BD compared to healthy controls.

LIMITATIONS

The methodologies used across studies varied considerably.

CONCLUSIONS

The findings from this review suggest abnormalities in both the activity and connectivity of facial emotion processing neural circuitry in BD. It is recommended that future research aims to further define the connectivity and spatiotemporal course of neural events within and between occipitotemporal, limbic, and prefrontal regions.

Investigating holistic face processing within and outside of face-responsive brain regions

It has been shown that human faces are processed holistically (i.e. as indecomposable wholes, rather than by their component parts) and this holistic face processing is linked to brain activity in face-responsive brain regions. Although several brain regions outside of the face-responsive network are also sensitive to relational processing and perceptual grouping, whether these non-face-responsive regions contribute to holistic processing remains unclear. Here, we investigated holistic face processing in the composite face paradigm both within and outside of face-responsive brain regions. We recorded participants' brain activity using fMRI while they performed a composite face task. Behavioural results indicate that participants tend to judge the same top face halves as different when they are aligned with different bottom face halves but not when they are misaligned, demonstrating a composite face effect. Neuroimaging results revealed significant differences in responses to aligned and misaligned faces in the lateral occipital complex (LOC), and trends in the anterior part of the fusiform face area (FFA2) and transverse occipital sulcus (TOS), suggesting that these regions are sensitive to holistic versus part-based face processing. Furthermore, the retrosplenial cortex (RSC) and the parahippocampal place area (PPA) showed a pattern of neural activity consistent with a holistic representation of face identity, which also correlated with the strength of the behavioural composite face effect. These results suggest that neural activity in brain regions both within and outside of the face-responsive network contributes to the composite-face effect.

Influence of EEG References on N170 Component in Human Facial Recognition

The choice of the reference electrode scheme is an important step in event-related potential (ERP) analysis. In order to explore the optimal electroencephalogram reference electrode scheme for the ERP signal related to facial recognition, we investigated the influence of average reference (AR), mean mastoid reference (MM), and Reference Electrode Standardization Technique (REST) on the N170 component via statistical analysis, statistical parametric scalp mappings (SPSM) and source analysis. The statistical results showed that the choice of reference electrode scheme has little effect on N170 latency (p > 0.05), but has an significant impact on N170 amplitude (p < 0.05). ANOVA results show that, for the three references scheme, there was statistically significant difference between N170 latency and amplitude induced by the unfamiliar face and that induced by the scrambled face (p < 0.05). Specifically, the SPSM results show an anterior and a temporo-occipital distribution for AR and REST, whereas just anterior distribution shown for MM. However, the circumstantial evidence provided by source analysis is more consistent with SPSM of AR and REST, compared with that of MM. These results indicate that the experimental results under the AR and REST references are more objective and appropriate. Thus, it is more appropriate to use AR and REST reference scheme settings in future facial recognition experiments.

A face is more than just the eyes, nose, and mouth: fMRI evidence that face-selective cortex represents external features

What is a face? Intuition, along with abundant behavioral and neural evidence, indicates that internal features (e.g., eyes, nose, mouth) are critical for face recognition, yet some behavioral and neural findings suggest that external features (e.g., hair, head outline, neck and shoulders) may likewise be processed as a face. Here we directly test this hypothesis by investigating how external (and internal) features are represented in the brain. Using fMRI, we found highly selective responses to external features (relative to objects and scenes) within the face processing system in particular, rivaling that observed for internal features. We then further asked how external and internal features are represented in regions of the cortical face processing system, and found a similar division of labor for both kinds of features, with the occipital face area and posterior superior temporal sulcus representing the parts of both internal and external features, and the fusiform face area representing the coherent arrangement of both internal and external features. Taken together, these results provide strong neural evidence that a "face" is composed of both internal and external features.

The Upper Eye Bias: Rotated Faces Draw Fixations to the Upper Eye

There is a consistent left-gaze bias when observers fixate upright faces, but it is unknown how this bias manifests in rotated faces, where the two eyes appear at different heights on the face. In two eye-tracking experiments, we measured participants' first and second fixations, while they judged the expressions of upright and rotated faces. We hypothesized that rotated faces might elicit a bias to fixate the upper eye. Our results strongly confirmed this hypothesis, with the upper eye bias completely dominating the left-gaze bias in ±45° faces in Experiment 1, and across a range of face orientations (±11.25°, ±22.5°, ±33.75°, ±45°, and ±90°) in Experiment 2. In addition, rotated faces elicited more overall eye-directed fixations than upright faces. We consider potential mechanisms of the upper eye bias in rotated faces and discuss some implications for research in social cognition.

Influence of task instructions and stimuli on the neural network of face processing: An ALE meta-analysis

Many neuroimaging studies have investigated the neural correlates of face processing. However, the location of face-preferential regions differs considerably between studies, possibly due to the use of different stimuli or tasks. By using Activation likelihood estimation meta-analyses, we aimed to a) delineate regions consistently involved in face processing and b) to assess the influence of stimuli and task on convergence of activation patterns. In total, we included 77 neuroimaging experiments in healthy subjects comparing face processing to a control condition. Results revealed a core face-processing network encompassing bilateral fusiform gyrus (FFG), inferior occipital (IOG) gyrus, superior temporal sulcus/middle temporal gyrus (STS/MTG), amygdala, inferior frontal junction (IFJ) and gyrus (IFG), left anterior insula as well as pre-supplementary motor area (pre-SMA). Furthermore, separate meta-analyses showed, that while significant convergence across all task and stimuli conditions was found in bilateral amygdala, right IOG, right mid-FFG, and right IFG, convergence in IFJ, STS/MTG, right posterior FFG, left FFG and pre-SMA differed between conditions. Thus, our results point to an occipito-frontal-amygdalae system that is involved regardless of stimulus and attention, whereas the remaining regions of the face-processing network are influenced by the task-dependent focus on specific facial characteristics as well as the type of stimuli processed.

Time course of gamma-band oscillation associated with face processing in the inferior occipital gyrus and fusiform gyrus: A combined fMRI and MEG study

Debate continues over whether the inferior occipital gyrus (IOG) or the fusiform gyrus (FG) represents the first stage of face processing and what role these brain regions play. We investigated this issue by combining functional magnetic resonance imaging (fMRI) and magnetoencephalography (MEG) in normal adults. Participants passively observed upright and inverted faces and houses. First, we identified the IOG and FG as face-specific regions using fMRI. We applied beamforming source reconstruction and time-frequency analysis to MEG source signals to reveal the time course of gamma-band activations in these regions. The results revealed that the right IOG showed higher gamma-band activation in response to upright faces than to upright houses at 100 ms from the stimulus onset. Subsequently, the right FG showed greater gamma-band response to upright faces versus upright houses at around 170 ms. The gamma-band activation in the right IOG and right FG was larger in response to inverted faces than to upright faces at the later time window. These results suggest that (1) the gamma-band activities occurs rapidly first in the IOG and next in the FG and (2) the gamma-band activity in the right IOG at later time stages is involved in configuration processing for faces. Hum Brain Mapp 38:2067-2079, 2017. © 2017 Wiley Periodicals, Inc.

The Face of Humanity

Across three studies, we test the hypothesis that the perceived “humanness” of a human face can have its roots, in part, in low-level, feature-integration processes typical of normal face perception—configural face processing. We provide novel evidence that perceptions of humanness/dehumanization can have perceptual roots. Relying on the well-established face inversion paradigm, we demonstrate that disruptions of configural face processing also disrupt the ability of human faces to activate concepts related to humanness (Experiment 1), disrupt categorization of human faces as human (but not animal faces as animals; Experiment 2), and reduce the levels of humanlike traits and characteristics ascribed to faces (Experiment 3). Taken together, the current findings provide a novel demonstration that dehumanized responses can arise from bottom-up perceptual cues, which suggests novel causes and consequences of dehumanizing responses.

The causal role of the occipital face area (OFA) and lateral occipital (LO) cortex in symmetry perception

Symmetry is an important cue in face and object perception. Here we used fMRI-guided transcranial magnetic stimulation (TMS) to shed light on the role of the occipital face area (OFA), a key region in face processing, and the lateral occipital (LO) cortex, a key area in object processing, in symmetry detection. In the first experiment, we applied TMS over the rightOFA, its left homolog (leftOFA), rightLO, and vertex (baseline) while participants were discriminating between symmetric and asymmetric dot patterns. Stimulation of rightOFA and rightLO impaired performance, causally implicating these two regions in detection of symmetry in low-level dot configurations. TMS over rightLO but not rightOFA also significantly impaired detection of nonsymmetric shapes defined by collinear Gabor patches, demonstrating that rightOFA responds to symmetry but not to all cues mediating figure-ground segregation. The second experiment showed a causal role for rightOFA but not rightLO in facial symmetry detection. Overall, our results demonstrate that both the rightOFA and rightLO are sensitive to symmetry in dot patterns, whereas only rightOFA is causally involved in facial symmetry detection.