The anatomic basis of the right face-selective N170 IN acquired prosopagnosia: A combined ERP/fMRI study

Pupil dilation reflects covert familiar face recognition under interocular suppression

In prosopagnosia, brain lesions impair overt face recognition, but not face detection, and may coexist with residual covert recognition of familiar faces. Previous studies that simulated covert recognition in healthy individuals have impaired face detection as well as recognition, thus not fully mirroring the deficits in prosopagnosia. We evaluated a model of covert recognition based on continuous flash suppression (CFS). Familiar and unfamiliar faces and houses were masked while participants performed two discrimination tasks. With increased suppression, face/house discrimination remained largely intact, but face familiarity discrimination deteriorated. Covert recognition was present across all masking levels, evinced by higher pupil dilation to familiar than unfamiliar faces. Pupil dilation was uncorrelated with overt performance across subjects. Thus, CFS can impede overt face recognition without disrupting covert recognition and face detection, mirroring critical features of prosopagnosia. CFS could be used to uncover shared neural mechanisms of covert recognition in prosopagnosic patients and neurotypicals.

Neural computations in prosopagnosia

We report an investigation of the neural processes involved in the processing of faces and objects of brain-lesioned patient PS, a well-documented case of pure acquired prosopagnosia. We gathered a substantial dataset of high-density electrophysiological recordings from both PS and neurotypicals. Using representational similarity analysis, we produced time-resolved brain representations in a format that facilitates direct comparisons across time points, different individuals, and computational models. To understand how the lesions in PS's ventral stream affect the temporal evolution of her brain representations, we computed the temporal generalization of her brain representations. We uncovered that PS's early brain representations exhibit an unusual similarity to later representations, implying an excessive generalization of early visual patterns. To reveal the underlying computational deficits, we correlated PS' brain representations with those of deep neural networks (DNN). We found that the computations underlying PS' brain activity bore a closer resemblance to early layers of a visual DNN than those of controls. However, the brain representations in neurotypicals became more akin to those of the later layers of the model compared to PS. We confirmed PS's deficits in high-level brain representations by demonstrating that her brain representations exhibited less similarity with those of a DNN of semantics.

Cognitive Event-Related Potentials in Young Adults With Cerebral Palsy: A Proof-of-Concept Study

Cerebral palsy (CP) is a movement and posture disorder often accompanied by cognitive difficulties which can be assessed using event-related potentials (ERPs), an often-overlooked tool in this population. Here we describe our assessment protocol, examine its feasibility, and validate the use of single-subject ERP analyses in adolescents and young adults with CP, an analysis approach which recognizes the heterogeneity of the clinical population. This study involved a final sample of 9 adolescents/young adults with CP participating in the "MyStory" study (age range 16-29 years, Mage = 25.0 years; 6 female; Gross Motor Function Classification System level I [n = 4], II [n = 2], III [n = 1], IV [n = 1], and V [n = 1]). ERP components were elicited over medial prefrontal and central cortex (error- and correct-related negativities [ERN/CRN], error-positivity [Pe], N100, P200, N200, P300), as well as those generated over occipital cortex (P100, N170). Group and single-subject ERP statistics were computed for ERPs recorded over both areas. Using recently developed data analysis methods (independent components analysis and robust bootstrapped single-subject statistics), we measured the number of participants demonstrating significant condition differences at the timing of each ERP component of interest. We demonstrate good validity for ERPs recorded during 2 of our 3 tasks eliciting frontal activation (eg, 4 of 6 participants with usable data showed a significant single-subject medial frontal negativity condition difference in a context-switching task) and good validity for ERPs derived from a task engaging occipital regions (eg, 8 of 9 participants each showed a significant N170 face-object condition effect).

Perception and Memory in the Ventral Visual Stream and Medial Temporal Lobe

Perception and memory are traditionally thought of as separate cognitive functions, supported by distinct brain regions. The canonical perspective is that perceptual processing of visual information is supported by the ventral visual stream, whereas long-term declarative memory is supported by the medial temporal lobe. However, this modular framework cannot account for the increasingly large body of evidence that reveals a role for early visual areas in long-term recognition memory and a role for medial temporal lobe structures in high-level perceptual processing. In this article, we review relevant research conducted in humans, nonhuman primates, and rodents. We conclude that the evidence is largely inconsistent with theoretical proposals that draw sharp functional boundaries between perceptual and memory systems in the brain. Instead, the weight of the empirical findings is best captured by a representational-hierarchical model that emphasizes differences in content, rather than in cognitive processes within the ventral visual stream and medial temporal lobe.

Prosopagnosia does not abolish other-race effects

Healthy observers recognize more accurately same-than other-race faces (i.e., the Same-Race Recognition Advantage - SRRA) but categorize them by race more slowly than other-race faces (i.e., the Other-Race Categorization Advantage - ORCA). Several fMRI studies reported discrepant bilateral activations in the Fusiform Face Area (FFA) and Occipital Face Area (OFA) correlating with both effects. However, due to the very nature and limits of fMRI results, whether these face-sensitive regions play an unequivocal causal role in those other-race effects remains to be clarified. To this aim, we tested PS, a well-studied pure case of acquired prosopagnosia with lesions encompassing the left FFA and the right OFA. PS, healthy age-matched and young adults performed two recognition and three categorization by race tasks, respectively using Western Caucasian and East Asian faces normalized for their low-level properties with and without-external features, as well as in naturalistic settings. As expected, PS was slower and less accurate than the controls. Crucially, however, the magnitudes of her SRRA and ORCA were comparable to the controls in all the tasks. Our data show that prosopagnosia does not abolish other-race effects, as an intact face system, the left FFA and/or right OFA are not critical for eliciting the SRRA and ORCA. Race is a strong visual and social signal that is encoded in a large neural face-sensitive network, robustly tuned for processing same-race faces.

Face yourself: The social neuroscience of mirror gazing

In philosophical and psychological accounts alike, it has been claimed that mirror gazing is like looking at ourselves as others. Social neuroscience and social psychology offer support for this view by showing that we use similar brain and cognitive mechanisms during perception of both others’ and our own face. I analyse these premises to investigate the factors affecting the perception of one’s own mirror image. I analyse mechanisms and processes involved in face perception, mimicry, and emotion recognition, and defend the following argument: because perception of others’ face is affected by our feelings toward them, it is likely that feelings toward ourselves affect our responses to the mirror image. One implication is that negative self-feelings can affect mirror gazing instantiating a vicious cycle where the negative emotional response reflects a previously acquired attitude toward oneself. I conclude by discussing implications of this view for psychology and social studies.

Mapping the perception-space of facial expressions in the era of face masks

With the advent of the severe acute respiratory syndrome-Corona Virus type 2 (SARS-CoV-2) pandemic, the theme of emotion recognition from facial expressions has become highly relevant due to the widespread use of face masks as one of the main devices imposed to counter the spread of the virus. Unsurprisingly, several studies published in the last 2 years have shown that accuracy in the recognition of basic emotions expressed by faces wearing masks is reduced. However, less is known about the impact that wearing face masks has on the ability to recognize emotions from subtle expressions. Furthermore, even less is known regarding the role of interindividual differences (such as alexithymic and autistic traits) in emotion processing. This study investigated the perception of all the six basic emotions (anger, disgust, fear, happiness, sadness, and surprise), both as a function of the face mask and as a function of the facial expressions' intensity (full vs. subtle) in terms of participants' uncertainty in their responses, misattribution errors, and perceived intensity. The experiment was conducted online on a large sample of participants (N = 129). Participants completed the 20-item Toronto Alexithymia Scale and the Autistic Spectrum Quotient and then performed an emotion-recognition task that involved face stimuli wearing a mask or not, and displaying full or subtle expressions. Each face stimulus was presented alongside the Geneva Emotion Wheel (GEW), and participants had to indicate what emotion they believed the other person was feeling and its intensity using the GEW. For each combination of our variables, we computed the indices of 'uncertainty' (i.e., the spread of responses around the correct emotion category), 'bias' (i.e., the systematic errors in recognition), and 'perceived intensity' (i.e., the distance from the center of the GEW). We found that face masks increase uncertainty for all facial expressions of emotion, except for fear when intense, and that disgust was systematically confused with anger (i.e., response bias). Furthermore, when faces were covered by the mask, all the emotions were perceived as less intense, and this was particularly evident for subtle expressions. Finally, we did not find any evidence of a relationship between these indices and alexithymic/autistic traits.

Twenty years of investigation with the case of prosopagnosia PS to understand human face identity recognition. Part II: Neural basis

Patient PS sustained her dramatic brain injury in 1992, the same year as the first report of a neuroimaging study of human face recognition. The present paper complements the review on the functional nature of PS's prosopagnosia (part I), illustrating how her case study directly, i.e., through neuroimaging investigations of her brain structure and activity, but also indirectly, through neural studies performed on other clinical cases and neurotypical individuals, inspired and constrained neural models of human face recognition. In the dominant right hemisphere for face recognition in humans, PS's main lesion concerns (inputs to) the inferior occipital gyrus (IOG), in a region where face-selective activity is typically found in normal individuals ('Occipital Face Area', OFA). Her case study initially supported the criticality of this region for face identity recognition (FIR) and provided the impetus for transcranial magnetic stimulation (TMS), intracerebral electrical stimulation, and cortical surgery studies that have generally supported this view. Despite PS's right IOG lesion, typical face-selectivity is found anteriorly in the middle portion of the fusiform gyrus, a hominoid structure (termed the right 'Fusiform Face Area', FFA) that is widely considered to be the most important region for human face recognition. This finding led to the original proposal of direct anatomico-functional connections from early visual cortices to the FFA, bypassing the IOG/OFA (lulu), a hypothesis supported by further neuroimaging studies of PS, other neurological cases and neuro-typical individuals with original visual stimulation paradigms, data recordings and analyses. The proposal of a lack of sensitivity to face identity in PS's right FFA due to defective reentrant inputs from the IOG/FFA has also been supported by other cases, functional connectivity and cortical surgery studies. Overall, neural studies of, and based on, the case of prosopagnosia PS strongly question the hierarchical organization of the human neural face recognition system, supporting a more flexible and dynamic view of this key social brain function.

Facial emotion processing and language during early-to-middle childhood development: An event related potential study

Facial emotion processing (FEP) is critical to social cognitive ability. Developmentally, FEP rapidly improves in early childhood and continues to be fine-tuned throughout middle childhood and into adolescence. Previous research has suggested that language plays a role in the development of social cognitive skills, including non-verbal emotion recognition tasks. Here we investigated whether language is associated with specific neurophysiological indicators of FEP. One hundred and fourteen children (4-12 years) completed a language assessment and a FEP task including stimuli depicting anger, happiness, fear, and neutrality. EEG was used to record key event related potentials (ERPs; P100, N170, LPP at occipital and parietal sites separately) previously shown to be sensitive to faces and facial emotion. While there were no main effects of language, the P100 latency to negative expressions appeared to increase with language, while LPP amplitude increased with language for negative and neutral expressions. These findings suggest that language is linked to some early physiological indicators of FEP, but this is dependent on the facial expression. Future studies should explore the role of language in later stages of neural processing, with a focus on processes localised to ventromedial prefrontal regions.

Face processing in the temporal lobe

Face perception is a socially important but complex process with many stages and many facets. There is substantial evidence from many sources that it involves a large extent of the temporal lobe, from the ventral occipitotemporal cortex and superior temporal sulci to anterior temporal regions. While early human neuroimaging work suggested a core face network consisting of the occipital face area, fusiform face area, and posterior superior temporal sulcus, studies in both humans and monkeys show a system of face patches stretching from posterior to anterior in both the superior temporal sulcus and inferotemporal cortex. Sophisticated techniques such as fMRI adaptation have shown that these face-activated regions show responses that have many of the attributes of human face processing. Lesions of some of these regions in humans lead to variants of prosopagnosia, the inability to recognize the identity of a face. Lesion, imaging, and electrophysiologic data all suggest that there is a segregation between identity and expression processing, though some suggest this may be better characterized as a distinction between static and dynamic facial information.

Evidence for a Third Visual Pathway Specialized for Social Perception

Existing models propose that primate visual cortex is divided into two functionally distinct pathways. The ventral pathway computes the identity of an object; the dorsal pathway computes the location of an object, and the actions related to that object. Despite remaining influential, the two visual pathways model requires revision. Both human and non-human primate studies reveal the existence of a third visual pathway on the lateral brain surface. This third pathway projects from early visual cortex, via motion-selective areas, into the superior temporal sulcus (STS). Studies demonstrating that the STS computes the actions of moving faces and bodies (e.g., expressions, eye-gaze, audio-visual integration, intention, and mood) show that the third visual pathway is specialized for the dynamic aspects of social perception.

Different and common brain signals of altered neurocognitive mechanisms for unfamiliar face processing in acquired and developmental prosopagnosia

Neuropsychological studies have shown that prosopagnosic individuals perceive face structure in an atypical way. This might preclude the formation of appropriate face representations and, consequently, hamper effective recognition. The present ERP study, in combination with Bayesian source reconstruction, investigates how information related to both external (E) and internal (I) features was processed by E.C. and I.P., suffering from acquired and developmental prosopagnosia, respectively. They carried out a face-feature matching task with new faces. E.C. showed poor performance and remarkable lack of early face-sensitive P1, N170 and P2 responses on right (damaged) posterior cortex. Although she presented the expected mismatch effect to target faces in the E-I sequence, it was of shorter duration than in Controls, and involved left parietal, right frontocentral and dorsofrontal regions, suggestive of reduced neural circuitry to process face configurations. In turn, I.P. performed efficiently but with a remarkable bias to give "match" responses. His face-sensitive potentials P1-N170 were comparable to those from Controls, however, he showed no subsequent P2 response and a mismatch effect only in the I-E sequence, reflecting activation confined to those regions that sustain typically the initial stages of face processing. Relevantly, neither of the prosopagnosics exhibited conspicuous P3 responses to features acting as primes, indicating that diagnostic information for constructing face representations could not be sufficiently attended nor deeply encoded. Our findings suggest a different locus for altered neurocognitive mechanisms in the face network in participants with different types of prosopagnosia, but common indicators of a deficient allocation of attentional resources for further recognition.

Attentional modulation differentially affects ventral and dorsal face areas in both normal participants and developmental prosopagnosics

Face-selective cortical areas that can be divided into a ventral stream and a dorsal stream. Previous findings indicate selective attention to particular aspects of faces have different effects on the two streams. To better understand the organization of the face network and whether deficits in attentional modulation contribute to developmental prosopagnosia (DP), we assessed the effect of selective attention to different face aspects across eight face-selective areas. Our results from normal participants found that ROIs in the ventral pathway (OFA, FFA) responded strongly when attention was directed to identity and expression, and ROIs in the dorsal pathway (pSTS-FA, IFG-FA) responded the most when attention was directed to facial expression. Response profiles generated by attention to different face aspects were comparable in DPs and normals. Our results demonstrate attentional modulation affects the ventral and dorsal steam face areas differently and indicate deficits in attentional modulation do not contribute to DP.

Post-Saccadic Face Processing Is Modulated by Pre-Saccadic Preview: Evidence from Fixation-Related Potentials

Humans actively sample their environment with saccadic eye movements to bring relevant information into high-acuity foveal vision. Despite being lower in resolution, peripheral information is also available before each saccade. How the pre-saccadic extrafoveal preview of a visual object influences its post-saccadic processing is still an unanswered question. The current study investigated this question by simultaneously recording behavior and fixation-related brain potentials while human subjects made saccades to face stimuli. We manipulated the relationship between pre-saccadic "previews" and post-saccadic images to explicitly isolate the influences of the former. Subjects performed a gender discrimination task on a newly foveated face under three preview conditions: scrambled face, incongruent face (different identity from the foveated face), and congruent face (same identity). As expected, reaction times were faster after a congruent-face preview compared with a scrambled-face preview. Importantly, intact face previews (either incongruent or congruent) resulted in a massive reduction of post-saccadic neural responses. Specifically, we analyzed the classic face-selective N170 component at occipitotemporal electroencephalogram electrodes, which was still present in our experiments with active looking. However, the post-saccadic N170 was strongly attenuated following intact-face previews compared with the scrambled condition. This large and long-lasting decrease in evoked activity is consistent with a trans-saccadic mechanism of prediction that influences category-specific neural processing at the start of a new fixation. These findings constrain theories of visual stability and show that the extrafoveal preview methodology can be a useful tool to investigate its underlying mechanisms.SIGNIFICANCE STATEMENT Neural correlates of object recognition have traditionally been studied by flashing stimuli to the central visual field. This procedure differs in fundamental ways from natural vision, where viewers actively sample the environment with eye movements and also obtain a low-resolution preview of soon-to-be-fixated objects. Here we show that the N170, a classic electrophysiological marker of the structural encoding of faces, also occurs during a more natural viewing condition but is strongly reduced due to extrafoveal preprocessing (preview benefit). Our results therefore highlight the importance of peripheral vision during trans-saccadic processing in building a coherent and stable representation of the world around us.

Contribution of the mandible position to the facial profile perception of a female facial profile: An eye-tracking study

INTRODUCTION

Studies concerning the visual attention of laypersons viewing the soft tissue facial profile of men and women with malocclusion are lacking. This study aimed to determine the visual attention to the facial profile of patients with different levels of mandibular protrusion and facial background attractiveness using an eye-tracking device.

METHODS

The scanning paths of 54 Chinese laypersons (50% female, 50% male, aged 18-23 years) were recorded by an eye-tracking device when they observed composite female facial profile images (n = 24), which were combinations of different degrees of mandibular protrusion (normal, slight, moderate, and severe) and different levels of facial background attractiveness (attractive, average, and unattractive). Dependent variables (fixation duration and first fixation time) were analyzed using repeated-measures factorial analysis of variance.

RESULTS

For normal mandibular profiles, the fixation duration of the eyes was significantly higher than that of other facial features (P <0.001). The lower face and nose received the least attention. As the degree of protrusion increased from slight to moderate, more attention was drawn to the lower face accompanied by less attention to eyes in the unattractive group (P <0.05). When protrusion degree increased from moderate to severe, attention shifted from nose to lower face significantly in the attractive group (P <0.05). Attention shift from eyes to lower face was also found in the average group when protrusion degree rose to moderate protrusion from normal profile (P <0.05). A significant interaction between facial attractiveness and mandibular protrusion was found in the lower face duration (P = 0.020). The threshold point (the point of mandibular protrusion degree that evoked attention to the lower face) of the attractive facial background was higher than that of the unattractive background. Once evoked, the effect of mandibular protrusion of the attractive group tended to be stronger than that of the unattractive group, though without statistical difference.

CONCLUSIONS

Eyes are the most salient area. The increasing degree of mandibular protrusion tends to draw attention to the lower face from other facial features. Background attractiveness can modify this behavior.

Higher Cortical Visual Disorders

PURPOSE OF REVIEW

This article reviews the disorders that result from disruption of extrastriate regions of the cerebral cortex responsible for higher visual processing. For each disorder, a historical perspective is offered and relevant neuroscientific studies are reviewed.

RECENT FINDINGS

Careful analysis of the consequences of lesions that disrupt visual functions such as facial recognition and written language processing has improved understanding of the role of key regions in these networks. In addition, modern imaging techniques have built upon prior lesion studies to further elucidate the functions of these cortical areas. For example, functional MRI (fMRI) has identified and characterized the response properties of ventral regions that contribute to object recognition and dorsal regions that subserve motion perception and visuospatial attention. Newer network-based functional imaging studies have shed light on the mechanisms behind various causes of spontaneous visual hallucinations.

SUMMARY

Understanding the regions and neural networks responsible for higher-order visual function helps the practicing neurologist to diagnose and manage associated disorders of visual processing and to identify and treat responsible underlying disease.

The domain-specificity of face matching impairments in 40 cases of developmental prosopagnosia

A prevailing debate in the psychological literature concerns the domain-specificity of the face recognition system, where evidence from typical and neurological participants has been interpreted as evidence that faces are "special". Although several studies have investigated the same question in cases of developmental prosopagnosia, the vast majority of this evidence has recently been discounted due to methodological concerns. This leaves an uncomfortable void in the literature, restricting our understanding of the typical and atypical development of the face recognition system. The current study addressed this issue in 40 individuals with developmental prosopagnosia, completing a sequential same/different face and biological (hands) and non-biological (houses) object matching task, with upright and inverted conditions. Findings support domain-specific accounts of face-processing for both hands and houses: while significant correlations emerged between all the object categories, no condition correlated with performance in the upright faces condition. Further, a categorical analysis demonstrated that, when face matching was impaired, object matching skills were classically dissociated in six out of 15 individuals (four for both categories). These findings provide evidence about domain-specificity in developmental disorders of face recognition, and present a theoretically-driven means of partitioning developmental prosopagnosia.

Attentional Weighting in the Face Processing Network: A Magnetic Response Image-guided Magnetoencephalography Study Using Multiple Cyclic Entrainments

We recorded magnetoencephalography using a neural entrainment paradigm with compound face stimuli that allowed for entraining the processing of various parts of a face (eyes, mouth) as well as changes in facial identity. Our magnetic response image-guided magnetoencephalography analyses revealed that different subnodes of the human face processing network were entrained differentially according to their functional specialization. Whereas the occipital face area was most responsive to the rate at which face parts (e.g., the mouth) changed, and face patches in the STS were mostly entrained by rhythmic changes in the eye region, the fusiform face area was the only subregion that was strongly entrained by the rhythmic changes in facial identity. Furthermore, top-down attention to the mouth, eyes, or identity of the face selectively modulated the neural processing in the respective area (i.e., occipital face area, STS, or fusiform face area), resembling behavioral cue validity effects observed in the participants' RT and detection rate data. Our results show the attentional weighting of the visual processing of different aspects and dimensions of a single face object, at various stages of the involved visual processing hierarchy.

Impairments in action and perception after right intraparietal damage

We examined visually-guided reaching and perception in an individual who underwent resection of a small tumor in right intraparietal sulcus (pIPS). In the first experiment, she reached to targets presented on a touch screen. Vision was occluded from reach onset on half of the trials, whereas on the other half she had vision during the entire reach. For visually-guided reaching, she demonstrated significantly more reach errors for targets left of fixation versus right of fixation. However, there were no hemispatial differences when reaching without vision. Furthermore, her performance was consistent for reaches with either hand, providing evidence that pIPS encodes location based on an eye-centered reference frame. Second, previous studies reported that optic ataxics are more accurate when reaching to remembered versus visible target locations. We repeated the first experiment, adding a five second delay between stimulus presentation and reach initiation. In contrast to prior reports, she was less accurate in delayed versus immediate reaching. Finally, we examined whether a small pIPS resection would disrupt visuospatial processing in a simple perceptual task. We presented two small circles in succession in either the same location or offset at varying distances, and asked whether the two circles were presented in the same or different position. She was significantly more impaired left of fixation compared to right of fixation, providing evidence for a perceptual deficit after a dorsal stream lesion.

Differentiation of Types of Visual Agnosia Using EEG

Visual recognition deficits are the hallmark symptom of visual agnosia, a neuropsychological disorder typically associated with damage to the visual system. Most research into visual agnosia focuses on characterizing the deficits through detailed behavioral testing, and structural and functional brain scans are used to determine the spatial extent of any cortical damage. Although the hierarchical nature of the visual system leads to clear predictions about the temporal dynamics of cortical deficits, there has been little research on the use of neuroimaging methods with high temporal resolution to characterize the temporal profile of agnosia deficits. Here, we employed high-density electroencephalography (EEG) to investigate alterations in the temporal dynamics of the visual system in two individuals with visual agnosia. In the context of a steady state visual evoked potential paradigm (SSVEP), individuals viewed pattern-reversing checkerboards of differing spatial frequency, and we assessed the responses of the visual system in the frequency and temporal domain. JW, a patient with early visual cortex damage, showed impaired SSVEP response relative to a control group and to the second patient (SM) who had right temporal lobe damage. JW also showed lower decoding accuracy for early visual responses (around 100 ms). SM, whose lesion is more anterior in the visual system, showed good decoding accuracy initially but low decoding after 500 ms. Overall, EEG and multivariate decoding methods can yield important insights into the temporal dynamics of visual responses in individuals with visual agnosia.

Estimating EEG Source Dipole Orientation Based on Singular-value Decomposition for Connectivity Analysis

In the last decade, the use of high-density electrode arrays for EEG recordings combined with the improvements of source reconstruction algorithms has allowed the investigation of brain networks dynamics at a sub-second scale. One powerful tool for investigating large-scale functional brain networks with EEG is time-varying effective connectivity applied to source signals obtained from electric source imaging. Due to computational and interpretation limitations, the brain is usually parcelled into a limited number of regions of interests (ROIs) before computing EEG connectivity. One specific need and still open problem is how to represent the time- and frequency-content carried by hundreds of dipoles with diverging orientation in each ROI with one unique representative time-series. The main aim of this paper is to provide a method to compute a signal that explains most of the variability of the data contained in each ROI before computing, for instance, time-varying connectivity. As the representative time-series for a ROI, we propose to use the first singular vector computed by a singular-value decomposition of all dipoles belonging to the same ROI. We applied this method to two real datasets (visual evoked potentials and epileptic spikes) and evaluated the time-course and the frequency content of the obtained signals. For each ROI, both the time-course and the frequency content of the proposed method reflected the expected time-course and the scalp-EEG frequency content, representing most of the variability of the sources (~ 80%) and improving connectivity results in comparison to other procedures used so far. We also confirm these results in a simulated dataset with a known ground truth.

The inferior occipital gyrus is a major cortical source of the face-evoked N170: Evidence from simultaneous scalp and intracerebral human recordings

The sudden onset of a face image leads to a prominent face-selective response in human scalp electroencephalographic (EEG) recordings, peaking 170 ms after stimulus onset at occipito-temporal (OT) scalp sites: the N170 (or M170 in magnetoencephalography). According to a widely held view, the main cortical source of the N170 lies in the fusiform gyrus (FG), whereas the posteriorly located inferior occipital gyrus (IOG) would rather generate earlier face-selective responses. Here, we report neural responses to upright and inverted faces recorded in a unique patient using multicontact intracerebral electrodes implanted in the right IOG and in the OT sulcus above the right lateral FG (LFG). Simultaneous EEG recordings on the scalp identified the N170 over the right OT scalp region. The latency and amplitude of this scalp N170 were correlated at the single-trial level with the N170 recorded in the lateral IOG, close to the scalp lateral occipital surface. In addition, a positive component maximal around the latency of the N170 (a P170) was prominent above the internal LFG, whereas this region typically generates an N170 (or "N200") over its external/ventral surface. This suggests that electrophysiological responses in the LFG manifest as an equivalent dipole oriented mostly along the vertical axis with likely minimal projection to the lateral OT scalp region. Altogether, these observations provide evidence that the IOG is a major cortical generator of the face-selective scalp N170, qualifying the potential contribution of the FG and questioning a strict serial spatiotemporal organization of the human cortical face network.

Developmental prosopagnosics have widespread selectivity reductions across category-selective visual cortex

Developmental prosopagnosia (DP) is a neurodevelopmental disorder characterized by severe deficits with facial identity recognition. It is unclear which cortical areas contribute to face processing deficits in DP, and no previous studies have investigated whether other category-selective areas function normally in DP. To address these issues, we scanned 22 DPs and 27 controls using a dynamic localizer consisting of video clips of faces, scenes, bodies, objects, and scrambled objects. We then analyzed category selectivity, a measure of the tuning of a cortical area to a particular visual category. DPs exhibited reduced face selectivity in all 12 face areas, and the reductions were significant in three posterior and two anterior areas. DPs and controls showed similar responses to faces in other category-selective areas, which suggests the DPs' behavioral deficits with faces result from problems restricted to the face network. DPs also had pronounced scene-selectivity reductions in four of six scene-selective areas and marginal body-selectivity reductions in two of four body-selective areas. Our results demonstrate that DPs have widespread deficits throughout the face network, and they are inconsistent with a leading account of DP which proposes that posterior face-selective areas are normal in DP. The selectivity reductions in other category-selective areas indicate many DPs have deficits spread across high-level visual cortex.

The Scalp Time-Varying Networks of N170: Reference, Latency, and Information Flow

Using the scalp time-varying network method, the present study is the first to investigate the temporal influence of the reference on N170, a negative event-related potential component (ERP) appeared about 170 ms that is elicited by facial recognition, in the network levels. Two kinds of scalp electroencephalogram (EEG) references, namely, AR (average of all recording channels) and reference electrode standardization technique (REST), were comparatively investigated via the time-varying processing of N170. Results showed that the latency and amplitude of N170 were significantly different between REST and AR, with the former being earlier and smaller. In particular, the information flow from right temporal-parietal P8 to left P7 in the time-varying network was earlier in REST than that in AR, and this phenomenon was reproduced by simulation, in which the performance of REST was closer to the true case at source level. These findings indicate that reference plays a crucial role in ERP data interpretation, and importantly, the newly developed approximate zero-reference REST would be a superior choice for precise evaluation of the scalp spatio-temporal changes relating to various cognitive events.

Source Reconstruction of Brain Potentials Using Bayesian Model Averaging to Analyze Face Intra-Domain vs. Face-Occupation Cross-Domain Processing

We investigated the neural correlates of the access to and retrieval of face structure information in contrast to those concerning the access to and retrieval of person-related verbal information, triggered by faces. We experimentally induced stimulus familiarity via a systematic learning procedure including faces with and without associated verbal information. Then, we recorded event-related potentials (ERPs) in both intra-domain (face-feature) and cross-domain (face-occupation) matching tasks while N400-like responses were elicited by incorrect eyes-eyebrows completions and occupations, respectively. A novel Bayesian source reconstruction approach plus conjunction analysis of group effects revealed that in both cases the generated N170s were of similar amplitude but had different neural origin. Thus, whereas the N170 of faces was associated predominantly to right fusiform and occipital regions (the so-called “Fusiform Face Area”, “FFA” and “Occipital Face Area”, “OFA”, respectively), the N170 of occupations was associated to a bilateral very posterior activity, suggestive of basic perceptual processes. Importantly, the right-sided perceptual P200 and the face-related N250 were evoked exclusively in the intra-domain task, with sources in OFA and extensively in the fusiform region, respectively. Regarding later latencies, the intra-domain N400 seemed to be generated in right posterior brain regions encompassing mainly OFA and, to some extent, the FFA, likely reflecting neural operations triggered by structural incongruities. In turn, the cross-domain N400 was related to more anterior left-sided fusiform and temporal inferior sources, paralleling those described previously for the classic verbal N400. These results support the existence of differentiated neural streams for face structure and person-related verbal processing triggered by faces, which can be activated differentially according to specific task demands.

Face Processing Systems: From Neurons to Real-World Social Perception

Primate face processing depends on a distributed network of interlinked face-selective areas composed of face-selective neurons. In both humans and macaques, the network is divided into a ventral stream and a dorsal stream, and the functional similarities of the areas in humans and macaques indicate they are homologous. Neural correlates for face detection, holistic processing, face space, and other key properties of human face processing have been identified at the single neuron level, and studies providing causal evidence have established firmly that face-selective brain areas are central to face processing. These mechanisms give rise to our highly accurate familiar face recognition but also to our error-prone performance with unfamiliar faces. This limitation of the face system has important implications for consequential situations such as eyewitness identification and policing.

Electrophysiological Correlates of Subliminal Perception of Facial Expressions in Individuals with Autistic Traits: A Backward Masking Study

People with Autism spectrum disorder (ASD) show difficulty in social communication, especially in the rapid assessment of emotion in faces. This study examined the processing of emotional faces in typically developing adults with high and low levels of autistic traits (measured using the Autism Spectrum Quotient—AQ). Event-related potentials (ERPs) were recorded during viewing of backward-masked neutral, fearful and happy faces presented under two conditions: subliminal (16 ms, below the level of visual conscious awareness) and supraliminal (166 ms, above the time required for visual conscious awareness). Individuals with low and high AQ differed in the processing of subliminal faces, with the low AQ group showing an enhanced N2 amplitude for subliminal happy faces. Some group differences were found in the condition effects, with the Low AQ showing shorter frontal P3b and N4 latencies for subliminal vs. supraliminal condition. Although results did not show any group differences on the face-specific N170 component, there were shorter N170 latencies for supraliminal vs. subliminal conditions across groups. The results observed on the N2, showing group differences in subliminal emotion processing, suggest that decreased sensitivity to the reward value of social stimuli is a common feature both of people with ASD as well as people with high autistic traits from the normal population.

Face Matching Impairment in Developmental Prosopagnosia

Developmental prosopagnosia (DP) is commonly referred to as ‘face blindness’, a term that implies a perceptual basis to the condition. However, DP presents as a deficit in face recognition and is diagnosed using memory-based tasks. Here, we test face identification ability in six people with DP, who are severely impaired on face memory tasks, using tasks that do not rely on memory. First, we compared DP to control participants on a standardized test of unfamiliar face matching using facial images taken on the same day and under standardized studio conditions ( Glasgow Face Matching Test; GFMT). Scores for DP participants did not differ from normative accuracy scores on the GFMT. Second, we tested face matching performance on a test created using images that were sourced from the Internet and so varied substantially due to changes in viewing conditions and in a person's appearance ( Local Heroes Test; LHT). DP participants showed significantly poorer matching accuracy on the LHT than control participants, for both unfamiliar and familiar face matching. Interestingly, this deficit is specific to ‘match’ trials, suggesting that people with DP may have particular difficulty in matching images of the same person that contain natural day-to-day variations in appearance. We discuss these results in the broader context of individual differences in face matching ability.

The Cognitive and Neural Basis of Developmental Prosopagnosia

Developmental prosopagnosia (DP) is a severe impairment of visual face recognition in the absence of any apparent brain damage. The factors responsible for DP have not yet been fully identified. This article provides a selective review of recent studies investigating cognitive and neural processes that may contribute to the face recognition deficits in DP, focusing primarily on event-related brain potential (ERP) measures of face perception and recognition. Studies that measured the face-sensitive N170 component as a marker of perceptual face processing have shown that the perceptual discrimination between faces and non-face objects is intact in DP. Other N170 studies suggest that faces are not represented in the typical fashion in DP. Individuals with DP appear to have specific difficulties in processing spatial and contrast deviations from canonical upright visual–perceptual face templates. The rapid detection of emotional facial expressions appears to be unaffected in DP. ERP studies of the activation of visual memory for individual faces and of the explicit identification of particular individuals have revealed differences between DPs and controls in the timing of these processes and in the links between visual face memory and explicit face recognition. These observations suggest that the speed and efficiency of information propagation through the cortical face network is altered in DP. The nature of the perceptual impairments in DP suggests that atypical visual experience with the eye region of faces over development may be an important contributing factor to DP.

The Superior Temporal Sulcus Is Causally Connected to the Amygdala: A Combined TBS-fMRI Study

Nonhuman primate neuroanatomical studies have identified a cortical pathway from the superior temporal sulcus (STS) projecting into dorsal subregions of the amygdala, but whether this same pathway exists in humans is unknown. Here, we addressed this question by combining theta burst transcranial magnetic stimulation (TBS) with fMRI to test the prediction that the STS and amygdala are functionally connected during face perception. Human participants (N = 17) were scanned, over two sessions, while viewing 3 s video clips of moving faces, bodies, and objects. During these sessions, TBS was delivered over the face-selective right posterior STS (rpSTS) or over the vertex control site. A region-of-interest analysis revealed results consistent with our hypothesis. Namely, TBS delivered over the rpSTS reduced the neural response to faces (but not to bodies or objects) in the rpSTS, right anterior STS (raSTS), and right amygdala, compared with TBS delivered over the vertex. By contrast, TBS delivered over the rpSTS did not significantly reduce the neural response to faces in the right fusiform face area or right occipital face area. This pattern of results is consistent with the existence of a cortico-amygdala pathway in humans for processing face information projecting from the rpSTS, via the raSTS, into the amygdala. This conclusion is consistent with nonhuman primate neuroanatomy and with existing face perception models.

SIGNIFICANCE STATEMENT

Neuroimaging studies have identified multiple face-selective regions in the brain, but the functional connections between these regions are unknown. In the present study, participants were scanned with fMRI while viewing movie clips of faces, bodies, and objects before and after transient disruption of the face-selective right posterior superior temporal sulcus (rpSTS). Results showed that TBS disruption reduced the neural response to faces, but not to bodies or objects, in the rpSTS, right anterior STS (raSTS), and right amygdala. These results are consistent with the existence of a cortico-amygdala pathway in humans for processing face information projecting from the rpSTS, via the raSTS, into the amygdala. This conclusion is consistent with nonhuman primate neuroanatomy and with existing face perception models.

Spatio-temporal reconstruction of brain dynamics from EEG with a Markov prior

Electroencephalography (EEG) can capture brain dynamics in high temporal resolution. By projecting the scalp EEG signal back to its origin in the brain also high spatial resolution can be achieved. Source localized EEG therefore has potential to be a very powerful tool for understanding the functional dynamics of the brain. Solving the inverse problem of EEG is however highly ill-posed as there are many more potential locations of the EEG generators than EEG measurement points. Several well-known properties of brain dynamics can be exploited to alleviate this problem. More short ranging connections exist in the brain than long ranging, arguing for spatially focal sources. Additionally, recent work (Delorme et al., 2012) argues that EEG can be decomposed into components having sparse source distributions. On the temporal side both short and long term stationarity of brain activation are seen. We summarize these insights in an inverse solver, the so-called "Variational Garrote" (Kappen and Gómez, 2013). Using a Markov prior we can incorporate flexible degrees of temporal stationarity. Through spatial basis functions spatially smooth distributions are obtained. Sparsity of these are inherent to the Variational Garrote solver. We name our method the MarkoVG and demonstrate its ability to adapt to the temporal smoothness and spatial sparsity in simulated EEG data. Finally a benchmark EEG dataset is used to demonstrate MarkoVG's ability to recover non-stationary brain dynamics.

Prosopagnosia: current perspectives

Prosopagnosia is a selective visual agnosia characterized by the inability to recognize the identity of faces. There are both acquired forms secondary to brain damage and developmental forms without obvious structural lesions. In this review, we first discuss the diagnosis of acquired and developmental prosopagnosia, and the challenges present in the latter case. Second, we discuss the evidence regarding the selectivity of the prosopagnosic defect, particularly in relation to the recognition of other objects, written words (another visual object category requiring high expertise), and voices. Third, we summarize recent findings about the structural and functional basis of prosopagnosia from studies using magnetic resonance imaging, functional magnetic resonance imaging, and event-related potentials. Finally, we discuss recent attempts at rehabilitation of face recognition in prosopagnosia.

The Deceptively Simple N170 Reflects Network Information Processing Mechanisms Involving Visual Feature Coding and Transfer Across Hemispheres

A key to understanding visual cognition is to determine “where”, “when”, and “how” brain responses reflect the processing of the specific visual features that modulate categorization behavior—the “what”. The N170 is the earliest Event-Related Potential (ERP) that preferentially responds to faces. Here, we demonstrate that a paradigmatic shift is necessary to interpret the N170 as the product of an information processing network that dynamically codes and transfers face features across hemispheres, rather than as a local stimulus-driven event. Reverse-correlation methods coupled with information-theoretic analyses revealed that visibility of the eyes influences face detection behavior. The N170 initially reflects coding of the behaviorally relevant eye contralateral to the sensor, followed by a causal communication of the other eye from the other hemisphere. These findings demonstrate that the deceptively simple N170 ERP hides a complex network information processing mechanism involving initial coding and subsequent cross-hemispheric transfer of visual features.

Effective Connectivity from Early Visual Cortex to Posterior Occipitotemporal Face Areas Supports Face Selectivity and Predicts Developmental Prosopagnosia

Face processing is mediated by interactions between functional areas in the occipital and temporal lobe, and the fusiform face area (FFA) and anterior temporal lobe play key roles in the recognition of facial identity. Individuals with developmental prosopagnosia (DP), a lifelong face recognition impairment, have been shown to have structural and functional neuronal alterations in these areas. The present study investigated how face selectivity is generated in participants with normal face processing, and how functional abnormalities associated with DP, arise as a function of network connectivity. Using functional magnetic resonance imaging and dynamic causal modeling, we examined effective connectivity in normal participants by assessing network models that include early visual cortex (EVC) and face-selective areas and then investigated the integrity of this connectivity in participants with DP. Results showed that a feedforward architecture from EVC to the occipital face area, EVC to FFA, and EVC to posterior superior temporal sulcus (pSTS) best explained how face selectivity arises in both controls and participants with DP. In this architecture, the DP group showed reduced connection strengths on feedforward connections carrying face information from EVC to FFA and EVC to pSTS. These altered network dynamics in DP contribute to the diminished face selectivity in the posterior occipitotemporal areas affected in DP. These findings suggest a novel view on the relevance of feedforward projection from EVC to posterior occipitotemporal face areas in generating cortical face selectivity and differences in face recognition ability.

SIGNIFICANCE STATEMENT

Areas of the human brain showing enhanced activation to faces compared to other objects or places have been extensively studied. However, the factors leading to this face selectively have remained mostly unknown. We show that effective connectivity from early visual cortex to posterior occipitotemporal face areas gives rise to face selectivity. Furthermore, people with developmental prosopagnosia, a lifelong face recognition impairment, have reduced face selectivity in the posterior occipitotemporal face areas and left anterior temporal lobe. We show that this reduced face selectivity can be predicted by effective connectivity from early visual cortex to posterior occipitotemporal face areas. This study presents the first network-based account of how face selectivity arises in the human brain.

Perceptual and memorial contributions to developmental prosopagnosia

Developmental prosopagnosia (DP) is commonly associated with the failure to properly perceive individuating facial properties, notably those conveying configural or holistic content. While this may indicate that the primary impairment is perceptual, it is conceivable that some cases of DP are instead caused by a memory impairment, with any perceptual complaint merely allied rather than causal. To investigate this possibility, we administered a battery of face perception tasks to 11 individuals who reported that their face recognition difficulties disrupt daily activity and who also performed poorly on two formal tests of face recognition. Group statistics identified, relative to age- and gender-matched controls, difficulties in apprehending global-local relations and the holistic properties of faces, and in matching across viewpoints, but these were mild in nature and were not consistently evident at the level of individual participants. Six of the 11 individuals failed to show any evidence of perceptual impairment. In the remaining five individuals, no single perceptual deficit, or combination of deficits, was necessary or sufficient for poor recognition performance. These data suggest that some cases of DP are better explained by a memorial rather than perceptual deficit, and highlight the relevance of the apperceptive/associative distinction more commonly applied to the allied syndrome of acquired prosopagnosia.

Enhanced Neural Processing of Goal-directed Actions After Active Training in 4-Month-Old Infants

The current study explores the neural correlates of action perception and its relation to infants' active experience performing goal-directed actions. Study 1 provided active training with sticky mittens that enables grasping and object manipulation in prereaching 4-month-olds. After training, EEG was recorded while infants observed images of hands grasping toward (congruent) or away from (incongruent) objects. We demonstrate that brief active training facilitates social perception as indexed by larger amplitude of the P400 ERP component to congruent compared with incongruent trials. Study 2 presented 4-month-old infants with passive training in which they observed an experimenter perform goal-directed reaching actions, followed by an identical ERP session to that used in Study 1. The second study did not demonstrate any differentiation between congruent and incongruent trials. These results suggest that (1) active experience alters the brains' response to goal-directed actions performed by others and (2) visual exposure alone is not sufficient in developing the neural networks subserving goal processing during action observation in infancy.

A Revised Neural Framework for Face Processing

Face perception relies on computations carried out in face-selective cortical areas. These areas have been intensively investigated for two decades, and this work has been guided by an influential neural model suggested by Haxby and colleagues in 2000. Here, we review new findings about face-selective areas that suggest the need for modifications and additions to the Haxby model. We suggest a revised framework based on (a) evidence for multiple routes from early visual areas into the face-processing system, (b) information about the temporal characteristics of these areas, (c) indications that the fusiform face area contributes to the perception of changeable aspects of faces, (d) the greatly elevated responses to dynamic compared with static faces in dorsal face-selective brain areas, and (e) the identification of three new anterior face-selective areas. Together, these findings lead us to suggest that face perception depends on two separate pathways: a ventral stream that represents form information and a dorsal stream driven by motion and form information.