Covert matching of unfamiliar faces in a case of prosopagnosia: an ERP study

Pupil dilation reflects covert familiar face recognition under interocular suppression

In prosopagnosia, brain lesions impair overt face recognition, but not face detection, and may coexist with residual covert recognition of familiar faces. Previous studies that simulated covert recognition in healthy individuals have impaired face detection as well as recognition, thus not fully mirroring the deficits in prosopagnosia. We evaluated a model of covert recognition based on continuous flash suppression (CFS). Familiar and unfamiliar faces and houses were masked while participants performed two discrimination tasks. With increased suppression, face/house discrimination remained largely intact, but face familiarity discrimination deteriorated. Covert recognition was present across all masking levels, evinced by higher pupil dilation to familiar than unfamiliar faces. Pupil dilation was uncorrelated with overt performance across subjects. Thus, CFS can impede overt face recognition without disrupting covert recognition and face detection, mirroring critical features of prosopagnosia. CFS could be used to uncover shared neural mechanisms of covert recognition in prosopagnosic patients and neurotypicals.

Neural computations in prosopagnosia

We report an investigation of the neural processes involved in the processing of faces and objects of brain-lesioned patient PS, a well-documented case of pure acquired prosopagnosia. We gathered a substantial dataset of high-density electrophysiological recordings from both PS and neurotypicals. Using representational similarity analysis, we produced time-resolved brain representations in a format that facilitates direct comparisons across time points, different individuals, and computational models. To understand how the lesions in PS's ventral stream affect the temporal evolution of her brain representations, we computed the temporal generalization of her brain representations. We uncovered that PS's early brain representations exhibit an unusual similarity to later representations, implying an excessive generalization of early visual patterns. To reveal the underlying computational deficits, we correlated PS' brain representations with those of deep neural networks (DNN). We found that the computations underlying PS' brain activity bore a closer resemblance to early layers of a visual DNN than those of controls. However, the brain representations in neurotypicals became more akin to those of the later layers of the model compared to PS. We confirmed PS's deficits in high-level brain representations by demonstrating that her brain representations exhibited less similarity with those of a DNN of semantics.

Binocular rivalry reveals differential face processing in congenital prosopagnosia

Congenital Prosopagnosia (CP) is an innate impairment in face perception with heterogeneous characteristics. It is still unclear if and to what degree holistic processing of faces is disrupted in CP. Such disruption would be expected to lead to a focus on local features of the face. In this study, we used binocular rivalry (BR) to implicitly measure face perception in conditions that favour holistic or local processing. The underlying assumption is that if stimulus saliency affects the perceptual dominance of a given stimulus in BR, one can deduce how salient a stimulus is for a given group (here: participants with and without CP) based on the measured perceptual dominance. A further open question is whether the deficit in face processing in CP extends to the processing of the facial display of emotions. In experiment 1, we compared predominance of upright and inverted faces displaying different emotions (fearful, happy, neutral) vs. houses between participants with CP (N = 21) and with normal face perception (N = 21). The results suggest that CP observers process emotions in faces automatically but rely more on local features than controls. The inversion of faces, which is supposed to disturb holistic processing, affected controls in a more pronounced way than participants with CP. In experiment 2, we introduced the Thatcher effect in BR by inverting the eye and mouth regions of the presented faces in the hope of further increasing the effect of face inversion. However, our expectations were not borne out by the results. Critically, both experiments showed that inversion effects were more pronounced in controls than in CP, suggesting that holistic face processing is less relevant in CP. We find BR to be a useful implicit test for assessing visual processing specificities in neurological participants.

Provoked overt recognition in acquired prosopagnosia using multiple different images of famous faces

Provoked overt recognition refers to the fact that patients with acquired prosopagnosia can sometimes recognize faces when presented in arrays of individuals from the same category (e.g., actors or politicians). We ask whether a prosopagnosic patient might experience recognition when presented with multiple different images of the same face simultaneously. Over two sessions, patient Herschel, a 66-year-old British man with acquired prosopagnosia, viewed face images individually or in arrays. On several occasions he failed to recognize single photos of an individual but successfully identified that person when the same photos were presented together. For example, Herschel failed to recognize any individual images of King Charles or Paul McCartney but recognised both in arrays of the same photos. Like reports based on category membership, overt recognition was transient and inconsistent. These findings are discussed in terms of models of covert recognition, alongside more recent research on within-person variability for face perception.

Face Recognition Deficits in a Patient With Alzheimer's Disease: Amnesia or Agnosia? The Importance of Electrophysiological Markers for Differential Diagnosis

Face recognition deficits are frequently reported in Alzheimer's disease (AD) and often attributed to memory impairment. However, it has been hypothesized that failure in identifying familiar people could also be due to deficits in higher-level perceptual processes, since there is evidence showing a reduced inversion effect for faces but not for cars in AD. To address the involvement of these higher processes, we investigated event-related potential (ERP) neural correlates of faces in a patient with AD showing a face recognition deficit. Eight healthy participants were tested as a control group. Participants performed different tasks following the stimulus presentation. In experiment 1, they should indicate whether the stimulus was either a face or a house or a scrambled image. In experiments 2 and 3, they should discriminate between upright and inverted faces (in experiment 2, stimuli were faces with neutral or fearful expressions, while in experiment 3, stimuli were famous or unfamiliar faces). Electrophysiological results reveal that the typical face-specific modulation of the N170 component, which is thought to reflect the structural encoding of faces, was not present in patient MCG, despite being affected by the emotional content of the face implicitly processed by MCG. Conversely, the N400 component, which is thought to reflect the recruitment of the memory trace of the face identity, was found to be implicitly modulated in MCG. These results may identify a possible role for gnosic processes in face recognition deficits in AD and suggest the importance of adopting an integrated approach to the AD diagnosis while considering electrophysiological markers.

Cognitive world: Neuropsychology of individual differences

It is proposed that depending upon the specific pattern of cognitive abilities, each individual lives in an idiosyncratic "cognitive world." Brain pathology can be associated with some disturbed abilities, and frequently experiential changes (i.e., how the world is understood) are observed. Because these patients often are aware of their intellectual changes, they may represent excellent models to illustrate the diversity of cognitive interpretations an individual can have about the surrounding environmental conditions. Four neuropsychology cases are presented to illustrate this point: (a) prosopagnosia associated with spatial agnosia; (b) Gerstmann's syndrome; (c) dysexecutive syndrome due to a head injury; and, (d) patient with Capgras' syndrome associated with a left temporal cyst. It is further emphasized that non-brain damaged people present an enormous-but usually overlooked-dispersion in different cognitive domains, resulting in specific and idiosyncratic patterns of cognitive abilities. It is concluded that the concept of "cognitive world" in neuropsychology can parallel the concept of "perceptual world" introduced by von Uexküll in biology, which assumes that different animal species live in idiosyncratic perceptual worlds, available and knowable by the differences in their sensory system abilities. That is, different individuals live in idiosyncratic cognitive worlds, owing to their differences in cognitive abilities.

Early (n170/m170) face-sensitivity despite right lateral occipital brain damage in acquired prosopagnosia

Compared to objects, pictures of faces elicit a larger early electromagnetic response at occipito-temporal sites on the human scalp, with an onset of 130 ms and a peak at about 170 ms. This N170 face effect is larger in the right than the left hemisphere and has been associated with the early categorization of the stimulus as a face. Here we tested whether this effect can be observed in the absence of some of the visual areas showing a preferential response to faces as typically identified in neuroimaging. Event-related potentials were recorded in response to faces, cars, and their phase-scrambled versions in a well-known brain-damaged case of prosopagnosia (PS). Despite the patient’s right inferior occipital gyrus lesion encompassing the most posterior cortical area showing preferential response to faces (“occipital face area”), we identified an early face-sensitive component over the right occipito-temporal hemisphere of the patient that was identified as the N170. A second experiment supported this conclusion, showing the typical N170 increase of latency and amplitude in response to inverted faces. In contrast, there was no N170 in the left hemisphere, where PS has a lesion to the middle fusiform gyrus and shows no evidence of face-preferential response in neuroimaging (no left “fusiform face area”). These results were replicated by a magnetoencephalographic investigation of the patient, disclosing a M170 component only in the right hemisphere. These observations indicate that face-preferential activation in the inferior occipital cortex is not necessary to elicit early visual responses associated with face perception (N170/M170) on the human scalp. These results further suggest that when the right inferior occipital cortex is damaged, the integrity of the middle fusiform gyrus and/or the superior temporal sulcus – two areas showing face-preferential responses in the patient’s right hemisphere – might be necessary to generate the N170 effect.

Implicit attitudes in prosopagnosia

We studied a male with acquired prosopagnosia using a battery of Implicit Association Tests (IATs) to investigate whether observing faces varying by social category would activate the patient's implicit social biases. We also asked him to categorize faces explicitly by race, gender, and political party. The patient, G.B., was marginally slower to categorize black compared to white faces. He showed congruency effects in the race and celebrity IATs, but not in the gender or political IATs. These results indicate that G.B. possesses an implicit social sensitivity to certain facial stimuli despite an inability to overtly recognize familiar faces. The results demonstrate that social biases can be retrieved based on facial stimuli via pathways bypassing the fusiform gyri. Thus the IAT effect can be added to the list of covert recognition effects found in prosopagnosia.

Deficits in long-term recognition memory reveal dissociated subtypes in congenital prosopagnosia

The study investigates long-term recognition memory in congenital prosopagnosia (CP), a lifelong impairment in face identification that is present from birth. Previous investigations of processing deficits in CP have mostly relied on short-term recognition tests to estimate the scope and severity of individual deficits. We firstly report on a controlled test of long-term (one year) recognition memory for faces and objects conducted with a large group of participants with CP. Long-term recognition memory is significantly impaired in eight CP participants (CPs). In all but one case, this deficit was selective to faces and didn't extend to intra-class recognition of object stimuli. In a test of famous face recognition, long-term recognition deficits were less pronounced, even after accounting for differences in media consumption between controls and CPs. Secondly, we combined test results on long-term and short-term recognition of faces and objects, and found a large heterogeneity in severity and scope of individual deficits. Analysis of the observed heterogeneity revealed a dissociation of CP into subtypes with a homogeneous phenotypical profile. Thirdly, we found that among CPs self-assessment of real-life difficulties, based on a standardized questionnaire, and experimentally assessed face recognition deficits are strongly correlated. Our results demonstrate that controlled tests of long-term recognition memory are needed to fully assess face recognition deficits in CP. Based on controlled and comprehensive experimental testing, CP can be dissociated into subtypes with a homogeneous phenotypical profile. The CP subtypes identified align with those found in prosopagnosia caused by cortical lesions; they can be interpreted with respect to a hierarchical neural system for face perception.

Holistic perception of the individual face is specific and necessary: evidence from an extensive case study of acquired prosopagnosia

We present an extensive investigation (24 experiments) of a new case of prosopagnosia following right unilateral damage, GG, with the aim of addressing two classical issues: (1) Can a visual recognition impairment truly be specific to faces? (2) What is the nature of acquired prosopagnosia? We show that GG recognizes nonface objects perfectly and quickly, even when it requires fine-grained analysis to individualize these objects. He is also capable of perceiving objects and faces as integrated wholes, as indicated by normal Navon effect, 3D-figures perception and perception of Mooney and Arcimboldo face stimuli. However, the patient could not perceive individual faces holistically, showing no inversion, composite, or whole-part advantage effects for faces. We conclude that an occipito-temporal right hemisphere lesion may lead to a specific impairment of holistic perception of individual items, a function that appears critical for normal face recognition but not for object recognition.

Rapid categorization of faces and objects in a patient with impaired object recognition

We tested rapid-categorization in a patient who was impaired in face and object recognition. Photographs of natural scenes were displayed for 100 ms. Participants had to press a key when they saw an animal among various objects as distractors or human faces among animal faces as distractors. Though the patient was impaired at figure/ground segregation, recognized very few objects and faces, she categorized animals and faces with a performance ranging between 70 and 86% correct. Displaying pictures in isolation did not improve performance. The results suggest that rapid categorization can be accomplished on the basis of coarse information without overt recognition.

Surface area and cortical thickness descriptors reveal different attributes of the structural human brain networks

Recently, a related morphometry-based connection concept has been introduced using local mean cortical thickness and volume to study the underlying complex architecture of the brain networks. In this article, the surface area is employed as a morphometric descriptor to study the concurrent changes between brain structures and to build binarized connectivity graphs. The statistical similarity in surface area between pair of regions was measured by computing the partial correlation coefficient across 186 normal subjects of the Cuban Human Brain Mapping Project. We demonstrated that connectivity matrices obtained follow a small-world behavior for two different parcellations of the brain gray matter. The properties of the connectivity matrices were compared to the matrices obtained using the mean cortical thickness for the same cortical parcellations. The topology of the cortical thickness and surface area networks were statistically different, demonstrating that both capture distinct properties of the interaction or different aspects of the same interaction (mechanical, anatomical, chemical, etc.) between brain structures. This finding could be explained by the fact that each descriptor is driven by distinct cellular mechanisms as result of a distinct genetic origin. To our knowledge, this is the first time that surface area is used to study the morphological connectivity of brain networks.

In what sense 'familiar'? Examining experiential differences within pathologies of facial recognition

Explanations of Capgras delusion and prosopagnosia typically incorporate a dual-route approach to facial recognition in which a deficit in overt or covert processing in one condition is mirror-reversed in the other. Despite this double dissociation, experiences of either patient-group are often reported in the same way--as lacking a sense of familiarity toward familiar faces. In this paper, deficits in the facial processing of these patients are compared to other facial recognition pathologies, and their experiential characteristics mapped onto the dual-route model in order to provide a less ambiguous link between facial processing and experiential content. The paper concludes that the experiential states of Capgras delusion, prosopagnosia, and related facial pathologies are quite distinct, and that this descriptive distinctiveness finds explanatory equivalence at the level of anatomical and functional disruption within the face recognition system. The role of skin conductance response (SCR) as a measure of 'familiarity' is also clarified.

Structure and function in acquired prosopagnosia: lessons from a series of 10 patients with brain damage

Acquired prosopagnosia varies in both behavioural manifestations and the location and extent of underlying lesions. We studied 10 patients with adult-onset lesions on a battery of face-processing tests. Using signal detection methods, we found that discriminative power for the familiarity of famous faces was most reduced by bilateral occipitotemporal lesions that involved the fusiform gyri, and better preserved with unilateral right-sided lesions. Tests of perception of facial structural configuration showed severe deficits with lesions that included the right fusiform gyrus, whether unilateral or bilateral. This deficit was most consistent for eye configuration, with some patients performing normally for mouth configuration. Patients with anterior temporal lesions had better configuration perception, though at least one patient showed a more subtle failure to integrate configural data from different facial regions. Facial imagery, an index of facial memories, was severely impaired by bilateral lesions that included the right anterior temporal lobe and marginally impaired by fusiform lesions alone; unilateral right fusiform lesions tended to spare imagery for facial features. These findings suggest that (I) prosopagnosia is more severe with bilateral than unilateral lesions, indicating a minor contribution of the left hemisphere to face recognition, (2) perception of facial configuration critically involves the right fusiform gyrus and (3) access to facial memories is most disrupted by bilateral lesions that also include the right anterior temporal lobe. This supports assertions that more apperceptive variants of prosopagnosia are linked to fusiform damage, whereas more associative variants are linked to anterior temporal damage. Next, we found that behavioural indices of covert recognition correlated with measures of overt familiarity, consistent with theories that covert behaviour emerges from the output of damaged neural networks, rather than alternative pathways. Finally, to probe the face specificity of the prosopagnosic defect, we tested recognition of fruits and vegetables: While face specificity was not found in most of our patients, the data of one patient suggested that this may be possible with more focal lesions of the right fusiform gyrus.

Implicit familiarity processing in congenital prosopagnosia

A particularly interesting and somewhat puzzling finding in the face-processing literature is that, despite the absence of overt recognition of most faces, many patients with acquired prosopagnosia (AP) exhibit evidence of intact covert face recognition of the very same faces. This phenomenon has important implications for the understanding of the mechanism underlying AP and, by extension, the mechanism underlying normal face processing. Here, we set out to examine whether individuals with congenital prosopagnosia (CP) exhibit a similar dissociation between overt and covert face recognition. We first confirmed that all six of our CP individuals were significantly impaired in face recognition in comparison with controls. Participants then completed a matching task with both famous and unknown faces in which they decided whether two consecutive images have the same identity or not. Critically, the level of face familiarity was orthogonal to the task at hand and this enabled us to examine whether the familiarity of a face enhanced identity matching, a finding which would implicate implicit face processing. As expected, the CP individuals were slower and less accurate than the control participants. More importantly, like the controls, the CP individuals were faster and more accurate at matching famous compared with unknown faces. Also, for both groups, matching performance on unrecognized famous faces fell at an intermediate level between performance on explicitly recognized famous faces and faces which are unknown. These results provide the first solid evidence for the existence of implicit familiarity processing in CP and suggest that, despite the marked impairment in explicit face recognition, these individuals still have some familiarity representation which manifests in the form of covert recognition. We discuss possible models to account for the apparent dissociation of overt and covert face processing in CPR.

Too Many Trees to See the Forest: Performance, Event-related Potential, and Functional Magnetic Resonance Imaging Manifestations of Integrative Congenital Prosopagnosia

Neuropsychological, event-related potential (ERP), and functional magnetic resonance imaging (fMRI) methods were combined to provide a comprehensive description of performance and neurobiological profiles for K.W., a case of congenital prosopagnosia. We demonstrate that K.W.'s visual perception is characterized by almost unprecedented inability to identify faces, a large bias toward local features, and an extreme deficit in global/configural processing that is not confined to faces. This pattern could be appropriately labeled congenital integrative prosopagnosia, and accounts for some, albeit not all, cases of face recognition impairments without identifiable brain lesions. Absence of face selectivity is evident in both biological markers of face processing, fMRI (the fusiform face area [FFA]), and ERPs (N170). Nevertheless, these two neural signatures probably manifest different perceptual mechanisms. Whereas the N170 is triggered by the occurrence of physiognomic stimuli in the visual field, the deficient face-selective fMRI activation in the caudal brain correlates with the severity of global processing deficits. This correlation suggests that the FFA might be associated with global/configural computation, a crucial part of face identification.

Better the devil you know? Nonconscious processing of identity and affect of famous faces

The nonconscious recognition of facial identity was investigated in two experiments featuring brief (17-msec) masked stimulus presentation to prevent conscious recognition. Faces were presented in simultaneous pairs of one famous face and one unfamiliar face, and participants attempted to select the famous face. Subsequently, participants rated the famous persons as "good" or "evil" (Experiment 1) or liked or disliked (Experiment 2). In Experiments 1 and 2, responses were less accurate to faces of persons rated evil/disliked than to faces of persons rated good/liked, and faces of persons rated evil/disliked were selected significantly below chance. Experiment 2 showed the effect in a within-items analysis: A famous face was selected less often by participants who disliked the person than by participants who liked the person, and the former were selected below chance accuracy. The within-items analysis rules out possible confounding factors based on variations in physical characteristics of the stimulus faces and confirms that the effects are due to participants' attitudes toward the famous persons. The results suggest that facial identity is recognized preconsciously, and that responses may be based on affect rather than familiarity.

Visual agnosia

The visual agnosias are an intriguing class of clinical phenomena that have important implications for current theories of high-level vision. Visual agnosia is defined as impaired object recognition that cannot be attributed to visual loss, language impairment, or a general mental decline. At least in some instances, agnostic patients generate an adequate internal representation of the stimulus but fail to recognize it. In this review, we begin by describing the classic works related to the visual agnosias, followed by a description of the major clinical variants and their occurrence in degenerative disorders. In keeping with the theme of this issue, we then discuss recent contributions to this domain. Finally, we present evidence from functional imaging studies to support the clinical distinction between the various types of visual agnosias.

Covert recognition and the neural system for face processing

In this viewpoint, we discuss the new evidence on covert face recognition in prosopagnosia presented by Bobes et al. (2003, this issue) and by Sperber and Spinnler (2003, this issue). Contrary to earlier hypotheses, both papers agree that covert and overt face recognition are based on the same mechanism. In line with this suggestion, an analysis of reported cases with prosopagnosia indicates that a degree of successful encoding of facial representations is a prerequisite for covert recognition to occur. While we agree with this general conclusion as far as Bobes et al.'s and Sperber and Spinnler's data are concerned, we also discuss evidence for a dissociation between different measures of covert recognition. Specifically, studies in patients with Capgras delusion and patients with prosopagnosia suggest that skin conductance and behavioural indexes of covert face recognition are mediated by partially different mechanisms. We also discuss implications of the new data for models of normal face recognition that have been successful in simulating covert recognition phenomena (e.g., Young and Burton, 1999, and O'Reilly et al., 1999). Finally, in reviewing recent neurophysiological and brain imaging evidence concerning the neural system for face processing, we argue that the relationship between ERP components (specifically, N170, N250r, and N400) and different cognitive processes in face recognition is beginning to emerge.

Perspectives on prosopagnosia and models of face recognition

The two papers by Bobes et al. (2003, this issue) and by Sperber and Spinnler (2003, this issue) add to the large body of literature demonstrating covert face recognition in prosopagnosia. This viewpoint will offer some perspectives on this interesting phenomenon. First, a re-analysis of the empirical literature will indicate an important misconception concerning the preserved abilities of prosopagnosics. The second section will briefly assess the contribution of Bobes et al. (2003, this issue) and Sperber and Spinnler (2003, this issue) to the debate about the locus, in cognitive terms, of the underlying causal deficit in prosopagnosia with covert face recognition. Both papers make reference to the two main models seeking to explain this phenomenon: the model proposed by Burton and colleagues (Burton et al., 1991; Burton and Young, 1999; Young and Burton, 1999) and that proposed by Farah and colleagues (Farah et al., 1993; O'Reilly and Farah, 1999). Finally, an observation will be offered concerning representations of faces in the Burton et al. (1991) model.