Covert recognition and the neural system for face processing

Normalizing psychotic symptoms

Individuals in random community samples not diagnosed as mentally ill report a variety of mental states along a continuum from 'normalcy' to psychosis. The existence of this continuum suggests that in addition to hallucinations and delusions, other more subtle reflections of psychotic thought processes might occur in ordinary mental life. Five transient disruptions of ordinary mental life which may mirror the cognitive processes underlying psychosis are identified. Thought experiments designed to heighten awareness of each of these states are described. The thought experiments aim at helping clinicians 'normalize' psychotic symptoms by locating analogies to psychosis in their own mental life. In addition, a questionnaire was administered to subjects in a random community sample to assess the frequency of the transient disruptions explored in the exercises in the general population. These disruptions appear to be quite common. This would suggest that at least some psychotic symptoms are a pathological expression of psychological processes latent in and widely distributed throughout the general population

A reevaluation of the electrophysiological correlates of expert object processing

Subordinate-level object processing is regarded as a hallmark of perceptual expertise. However, the relative contribution of subordinate- and basic-level category experience in the acquisition of perceptual expertise has not been clearly delineated. In this study, participants learned to classify wading birds and owls at either the basic (e.g., wading bird, owl) or the subordinate (e.g., egret, snowy owl) level. After 6 days of training, behavioral results showed that subordinate-level but not basic-level training improved subordinate discrimination of trained exemplars, novel exemplars, and exemplars from novel species. Event-related potentials indicated that both basic- and subordinate-level training enhanced the early N170 component, but only subordinate-level training amplified the later N250 component. These results are consistent with models positing separate basic and subordinate learning mechanisms, and, contrary to perspectives attempting to explain visual expertise solely in terms of subordinate-level processing, suggest that expertise enhances neural responses of both basic and subordinate processing.

Do I know you? Insights into memory for faces from brain potentials

The recognition of faces is central to human social interaction. Recordings of event-related potentials (ERPs) from the brain can shed light on the various processes that occur when a face is recognized and when knowledge related to a specific person is retrieved. ERP contrasts between processing familiar and processing novel faces offer a gateway into investigations of semantic memory for familiar persons. In particular, activity of face recognition units and semantic information units--memory representations of faces and person-related knowledge, respectively--can be indexed by specific ERPs. These potentials thus provide valuable tools for studying the cognitive and neurobiological architecture of person recognition. ERPs have also been found useful for investigating other types of memory for faces. Specifically, important insights have been derived from the study of a category of memory phenomena known as priming. Priming can be revealed in special tests when face recognition is facilitated based on prior experience. Describing the neural processes associated with memory for faces is an exciting focus of research, and future results from this line of inquiry promise to provide further knowledge about face recognition and the various types of memory that can be provoked by a human face.

Masked and unmasked electrophysiological repetition effects of famous faces

We investigated immediate repetition effects of sequentially presented famous face pairs. The first face (F1) was presented masked or unmasked and preceded the second face (F2) with different SOAs (84 ms vs. 500 ms). Participants judged F2 with regard to either semantic category (actor vs. singer; indirect task) or perceptual match with F1 (same vs. different; direct task). Repetition shortened RT for unmasked but not for masked F1 conditions. In event-related brain potentials (ERPs), unmasked repetition effects were influenced by task and SOA and consisted a modulation of an occipitotemporal N170, an inferior temporal N250r (200-300 ms), a central-parietal N400 (300-500 ms), and a parietal P600 (500-800 ms). An early occipital negativity (onset approximately 100 ms) was present at the 84-ms SOA but diminished in the 500-ms SOA condition, probably reflecting a fast decaying iconic memory trace. Masked repetition effects in the indirect task were limited to a significant early (100-150 ms) prefrontal/lateral frontal and central-parietal modulation, and a strong trend for a reduced N170 amplitude. This suggests that masked repetition modulated early visual processing but did not influence processes beyond approximately 200 ms that reflect the access to facial representations and semantic information for people.

How Berlusconi keeps his face: a neuropsychological study in a case of semantic dementia

A patient (V.Z.) is described as being affected by progressive bilateral atrophy of the mesial temporal lobes resulting in semantic dementia. Vis-a-vis virtually nil recognition of even the most familiar faces (including those of her closest relatives) as well as of objects and animals, V.Z. could nevertheless consistently recognize and name the face of Silvio Berlusconi, the mass media tycoon and current Italian Prime Minister. The experimental investigation led to the conclusion that Mr Berlusconi's face was seen as an icon rather than as a face. This telling effect of Mr Berlusconi's pervasive propaganda constitutes an unprecedented case in the neuropsychological literature.

Cortical mechanisms of person representation: Recognition of famous and personally familiar names

Personally familiar people are likely to be represented more richly in episodic, emotional, and behavioral contexts than famous people, who are usually represented predominantly in semantic context. To reveal cortical mechanisms supporting this differential person representation, we compared cortical activation during name recognition tasks between personally familiar and famous names, using an event-related functional magnetic resonance imaging (fMRI). Normal subjects performed familiar- or unfamiliar-name detection tasks during visual presentation of personally familiar (Personal), famous (Famous), and unfamiliar (Unfamiliar) names. The bilateral temporal poles and anterolateral temporal cortices, as well as the left temporoparietal junction, were activated in the contrasts Personal-Unfamiliar and Famous-Unfamiliar to a similar extent. The bilateral occipitotemporoparietal junctions, precuneus, and posterior cingulate cortex showed activation in the contrasts Personal-Unfamiliar and Personal-Famous. Together with previous findings, differential activation in the occipitotemporoparietal junction, precuneus, and posterior cingulate cortex between personally familiar and famous names is considered to reflect differential person representation. The similar extent of activation for personally familiar and famous names in the temporal pole and anterolateral temporal cortex is consistent with the associative role of the anterior temporal cortex in person identification, which has been conceptualized as a person identity node in many models of person identification. The left temporoparietal junction was considered to process familiar written names. The results illustrated the neural correlates of the person representation as a network of discrete regions in the bilateral posterior cortices, with the anterior temporal cortices having a unique associative role.

Hemodynamic and electrophysiological relationship involved in human face processing: Evidence from a combined fMRI–ERP study

Functional magnetic resonance imaging (fMRI) and event-related potential (ERP) experiments were conducted in the same group of subjects and with an identical task paradigm to investigate a possible relationship between hemodynamic and electrophysiological responses within the brain. The subjects were instructed to judge whether visually presented stimuli were faces or houses and then press the corresponding button. Functional MRI identified face- and house-related regions in the lateral and medial part of the fusiform gyrus, respectively, while ERP showed significantly greater N170 negativity for face than for house stimuli in the temporo-occipital electrodes. Correlation analysis between the BOLD signal in the fusiform gyrus and ERP parameters demonstrated a close relationship between the signal and both latency and amplitude of N170 across the subjects. These correlations may indicate that the variation in cognitive demand and hemodynamic responses during the face/house discrimination task is coupled with the variation of N170 peak latency/amplitude across the subjects. Thus, integrative analysis of spatial and temporal information obtained from the two experimental modalities may help in studying neural correlates involved in a particular cognitive task.

Neural correlates of perceptual contributions to nondeclarative memory for faces

Face priming is a nondeclarative memory phenomenon that can be observed when recognition is facilitated for a recently encountered face. This data-driven form of priming is distinct from conceptually driven priming. Moreover, it includes two dissociable components, the facilitated access to pre-existing representations and facilitation in perceptual processing of faces. In the present study, we measured neural correlates of perceptual contributions to face priming with event-related brain potentials. Faces appeared two times (separated by 7-17 s), while participants discriminated familiar from unfamiliar faces. Half of the initial face stimuli were inverted, thereby disrupting perceptual face processing and making possible an assessment of perceptual contributions to face priming. Whereas none of the brain waves previously linked to perceptual processing of faces showed indications of priming, such effects were observed between 200 and 600 ms at left occipito-parieto-temporal recording sites. This electrical activity was present for both unfamiliar and familiar faces. The scalp topography of this effect was consistent with sources within the temporal and occipital cortices of the left hemisphere (based on a LORETA source localization). These findings suggest that priming of perceptual face processing is subserved by prolonged neural activity from 200 to 600 ms primarily in the left hemisphere. We propose that this priming reflects facilitated selection based on second-order relations among facial features.

Neural correlates of intentional and incidental recognition of famous faces

Event-related potentials (ERPs) were used to study the relationship between intentional and incidental recognition of famous faces. Intentional and incidental recognition were operationally defined as repeated presentations of targets and nontargets within a modified Sternberg task. These repetitions elicited temporally and topographically distinct ERP modulations. A repetition effect around 300 ms (ERE/N250r) and a preceding modulation did not differ between intentional and incidental recognition, whereas a following repetition effect (LRE/N400) around 500 ms showed differences between incidental and intentional recognition. These results show that during the first few hundred milliseconds intentional and incidental face recognition relate to similar processing, indicating that familiar faces are recognized even when their identification is not required.

Event-Related Potential Correlates of Long-Term Memory for Briefly Presented Faces

Electrophysiological studies have investigated the nature of face recognition in a variety of paradigms; some have contrasted famous and novel faces in explicit memory paradigms, others have repeated faces to examine implicit memory/ priming. If the general finding that implicit memory can last for up to several months also holds for novel faces, a reliable measure of it could have practical application for eyewitness testimony, given that explicit measures of eyewitness memory have at times proven fallible. The current study aimed to determine whether indirect behavioral and electrophysiological measures might yield reliable estimates of face memory over longer intervals than have typically been obtained with priming manipulations. Participants were shown 192 faces and then tested for recognition at four test delays ranging from immediately up to 1 week later. Three event-related brain potential components (e.g., N250r, N400f, and LPC) varied with memory measures although only the N250r varied regardless of explicit recognition, that is, with both repetition and recognition.

The Thatcher illusion seen by the brain: an event-related brain potentials study

In "Thatcherized" faces, the eyes and mouth regions are turned upside-down. Only when presented upright they are perceived as severely distorted. Common theories explain this effect by the loss of configural information for inverted faces. We investigated neural correlates of Thatcherization using event related potentials (ERPs). Sixteen right-handed participants performed identity classifications on Thatcherized or original familiar faces, presented either for 34 ms or 200 ms at an orientation of either 0 degrees, 90 degrees or 180 degrees. For the occipito-temporal N170, we found (1) strong non-linear effects of orientation and (2) interactions between Thatcherization and orientation: Thatcherization resulted in larger N170 for upright faces, but smaller N170 for inverted faces. The novel finding of N170 effects of Thatcherization in inverted faces suggests differences in the neural encoding of Thatcherized and original inverted faces, even though Thatcherization escapes subjective perception in inverted faces.

Interaction of Face and Voice Areas during Speaker Recognition

Face and voice processing contribute to person recognition, but it remains unclear how the segregated specialized cortical modules interact. Using functional neuroimaging, we observed cross-modal responses to voices of familiar persons in the fusiform face area, as localized separately using visual stimuli. Voices of familiar persons only activated the face area during a task that emphasized speaker recognition over recognition of verbal content. Analyses of functional connectivity between cortical territories show that the fusiform face region is coupled with the superior temporal sulcus voice region during familiar speaker recognition, but not with any of the other cortical regions normally active in person recognition or in other tasks involving voices. These findings are relevant for models of the cognitive processes and neural circuitry involved in speaker recognition. They reveal that in the context of speaker recognition, the assessment of person familiarity does not necessarily engage supra-modal cortical substrates but can result from the direct sharing of information between auditory voice and visual face regions.

Priming emotional facial expressions as evidenced by event-related brain potentials

As human faces are important social signals in everyday life, processing of facial affect has recently entered into the focus of neuroscientific research. In the present study, priming of faces showing the same emotional expression was measured with the help of event-related potentials (ERPs) in order to investigate the temporal characteristics of processing facial expressions. Participants classified portraits of unfamiliar persons according to their emotional expression (happy or angry). The portraits were either preceded by the face of a different person expressing the same affect (primed) or the opposite affect (unprimed). ERPs revealed both early and late priming effects, independent of stimulus valence. The early priming effect was characterized by attenuated frontal ERP amplitudes between 100 and 200 ms in response to primed targets. Its dipole sources were localised in the inferior occipitotemporal cortex, possibly related to the detection of expression-specific facial configurations, and in the insular cortex, considered to be involved in affective processes. The late priming effect, an enhancement of the late positive potential (LPP) following unprimed targets, may evidence greater relevance attributed to a change of emotional expressions. Our results (i) point to the view that a change of affect-related facial configuration can be detected very early during face perception and (ii) support previous findings on the amplitude of the late positive potential being rather related to arousal than to the specific valence of an emotional signal.

N250r: a face-selective brain response to stimulus repetitions

We investigated event-related brain potentials elicited by repetitions of cars, ape faces, and upright and inverted human faces. A face-selective N250r response to repetitions emerged over right temporal regions, consistent with a source in the fusiform gyrus. N250r was largest for human faces, clear for ape faces, non-significant for inverted faces, and completely absent for cars. Our results suggest that face-selective neural activity starting at 200 ms and peaking at 250-300 ms is sensitive to repetition and relates to individual recognition.

Mapping the time course of nonconscious and conscious perception of fear: an integration of central and peripheral measures

Neuroimaging studies using backward masking suggest that conscious and nonconscious responses to complex signals of fear (facial expressions) occur via parallel cortical and subcortical circuits. Little is known, however, about the temporal differentiation of these responses. Psychophysics procedures were first used to determine objective thresholds for both nonconscious detection (face vs. blank screen) and discrimination (fear vs. neutral face) in a backward masking paradigm. Event-related potentials (ERPs) were then recorded (n = 20) using these thresholds. Ten blocks of masked fear and neutral faces were presented under each threshold condition. Simultaneously recorded skin conductance responses (SCRs) provided an independent index of stimulus perception. It was found that Fear stimuli evoked faster SCR rise times than did neutral stimuli across all conditions, indicating that emotional content influenced responses, regardless of awareness. In the first 400 msec of processing, ERPs dissociated the time course of conscious (enhanced N4 component) from nonconscious (enhanced N2 component) perception of fear, relative to neutral. Nonconscious detection of fear also elicited relatively faster P1 responses within 100 msec post-stimulus. The N2 may provide a temporal correlate of the initial sensory processing of salient facial configurations, which is enhanced when top-down cortical feedback is precluded. By contrast, the N4 may index the conscious integration of emotion stimuli in working memory, subserved by greater cortical engagement. Hum. Brain Mapping 21:64-74, 2004.

Event-related potentials reflect impaired face recognition in patients with congenital prosopagnosia

Event-related brain potentials (ERPs) to faces have been shown to be altered in patients suffering from prosopagnosia. In this report we present ERP findings from two patients suffering from a congenital form of prosopagnosia, with other visual and cognitive functions being spared and without any structural abnormalities as assessed by anatomical brain imaging. Subjects were presented with photographs of faces and houses, and they had to respond to photographs of hands. Both patients did not show a difference in N170 amplitude to faces compared to houses, whereas there was a significant N170 difference of these two stimulus classes in healthy control subjects.