Fast and Famous: Looking for the Fastest Speed at Which a Face Can be Recognized

Intracerebral electrical stimulation of the right anterior fusiform gyrus impairs human face identity recognition

Brain regions located between the right fusiform face area (FFA) in the middle fusiform gyrus and the temporal pole may play a critical role in human face identity recognition but their investigation is limited by a large signal drop-out in functional magnetic resonance imaging (fMRI). Here we report an original case who is suddenly unable to recognize the identity of faces when electrically stimulated on a focal location inside this intermediate region of the right anterior fusiform gyrus. The reliable transient identity recognition deficit occurs without any change of percept, even during nonverbal face tasks (i.e., pointing out the famous face picture among three options; matching pictures of unfamiliar or familiar faces for their identities), and without difficulty at recognizing visual objects or famous written names. The effective contact is associated with the largest frequency-tagged electrophysiological signals of face-selectivity and of familiar and unfamiliar face identity recognition. This extensive multimodal investigation points to the right anterior fusiform gyrus as a critical hub of the human cortical face network, between posterior ventral occipito-temporal face-selective regions directly connected to low-level visual cortex, the medial temporal lobe involved in generic memory encoding, and ventral anterior temporal lobe regions holding semantic associations to people's identity.

Critical information thresholds underlying generic and familiar face categorisation at the same face encounter

Seeing a face in the real world provokes a host of automatic categorisations related to sex, emotion, identity, and more. Such individual facets of human face recognition have been extensively examined using overt categorisation judgements, yet their relative informational dependencies during the same face encounter are comparatively unknown. Here we used EEG to assess how increasing access to sensory input governs two ecologically relevant brain functions elicited by seeing a face: Distinguishing faces and nonfaces, and recognising people we know. Observers viewed a large set of natural images that progressively increased in either image duration (experiment 1) or spatial frequency content (experiment 2). We show that in the absence of an explicit categorisation task, the human brain requires less sensory input to categorise a stimulus as a face than it does to recognise whether that face is familiar. Moreover, where sensory thresholds for distinguishing faces/nonfaces were remarkably consistent across observers, there was high inter-individual variability in the lower informational bound for familiar face recognition, underscoring the neurofunctional distinction between these categorisation functions. By i) indexing a form of face recognition that goes beyond simple low-level differences between categories, and ii) tapping multiple recognition functions elicited by the same face encounters, the information minima we report bear high relevance to real-world face encounters, where the same stimulus is categorised along multiple dimensions at once. Thus, our finding of lower informational requirements for generic vs. familiar face recognition constitutes some of the strongest evidence to date for the intuitive notion that sensory input demands should be lower for recognising face category than face identity.

The occipital face area is causally involved in identity-related visual-semantic associations

Faces are processed in a network of areas within regions of the ventral visual stream. However, familiar faces typically are characterized by additional associated information, such as episodic memories or semantic biographical information as well. The acquisition of such non-sensory, identity-specific knowledge plays a crucial role in our ability to recognize and identify someone we know. The occipital face area (OFA), an early part of the core face-processing network, is recently found to be involved in the formation of identity-specific memory traces but it is currently unclear if this role is limited to unimodal visual information. The current experiments used transcranial magnetic stimulation (TMS) to test whether the OFA is involved in the association of a face with identity-specific semantic information, such as the name or job title of a person. We applied an identity-learning task where unfamiliar faces were presented together with a name and a job title in the first encoding phase. Simultaneously, TMS pulses were applied either to the left or right OFA or to Cz, as a control. In the subsequent retrieval phase, the previously seen faces were presented either with two names or with two job titles and the task of the participants was to select the semantic information previously learned. We found that the stimulation of the right or left OFA reduced subsequent retrieval performance for the face-associated job titles. This suggests a causal role of the OFA in the association of faces and related semantic information. Furthermore, in contrast to prior findings, we did not observe hemispherical differences of the TMS intervention, suggesting a similar role of the left and right OFAs in the formation of the visual-semantic associations. Our results suggest the necessity to reconsider the hierarchical face-perception models and support the distributed and recurrent models.

A Fast Visual Recognition Memory System in Humans Identified Using Intracerebral ERP

One key item of information retrieved when surveying our visual world is whether or not objects are familiar. However, there is no consensus on the respective roles of medial temporal lobe structures, particularly the perirhinal cortex (PRC) and hippocampus. We considered whether the PRC could support a fast recognition memory system independently from the hippocampus. We recorded the intracerebral electroencephalograph activity of epileptic patients while they were performing a fast visual recognition memory task, constraining them to use their quickest strategy. We performed event-related potential (ERP) and classification analyses. The PRC was, by far, the earliest region involved in recognition memory. This activity occurred before the first behavioral responses and was found to be related to reaction times, unlike the hippocampus. Single-trial analyses showed that decoding power was equivalent in the PRC and hippocampus but occurred much earlier in the PRC. A critical finding was that recognition memory-related activity occurred in different frontal and parietal regions, including the supplementary motor area, before the hippocampus. These results, based on ERP analyses, suggest that the human brain is equipped with a fast recognition memory system, which may bypass the hippocampus and in which the PRC plays a critical role.

An objective, sensitive and ecologically valid neural measure of rapid human individual face recognition

Humans may be the only species able to rapidly and automatically recognize a familiar face identity in a crowd of unfamiliar faces, an important social skill. Here, by combining electroencephalography (EEG) and fast periodic visual stimulation (FPVS), we introduce an ecologically valid, objective and sensitive neural measure of this human individual face recognition function. Natural images of various unfamiliar faces are presented at a fast rate of 6 Hz, allowing one fixation per face, with variable natural images of a highly familiar face identity, a celebrity, appearing every seven images (0.86 Hz). Following a few minutes of stimulation, a high signal-to-noise ratio neural response reflecting the generalized discrimination of the familiar face identity from unfamiliar faces is observed over the occipito-temporal cortex at 0.86 Hz and harmonics. When face images are presented upside-down, the individual familiar face recognition response is negligible, being reduced by a factor of 5 over occipito-temporal regions. Differences in the magnitude of the individual face recognition response across different familiar face identities suggest that factors such as exposure, within-person variability and distinctiveness mediate this response. Our findings of a biological marker for fast and automatic recognition of individual familiar faces with ecological stimuli open an avenue for understanding this function, its development and neural basis in neurotypical individual brains along with its pathology. This should also have implications for the use of facial recognition measures in forensic science.

Superior explicit memory despite severe developmental amnesia: In-depth case study and neural correlates

The acquisition of new semantic memories is sometimes preserved in patients with hippocampal amnesia. Robust evidence for this comes from case reports of developmental amnesia suggesting that low-to-normal levels of semantic knowledge can be achieved despite compromised episodic learning. However, it is unclear whether this relative preservation of semantic memory results from normal acquisition and retrieval or from residual episodic memory, combined with effortful repetition. Furthermore, lesion studies have mainly focused on the hippocampus itself, and have seldom reported the state of structures in the extended hippocampal system. Preserved components of this system may therefore mediate residual episodic abilities, contributing to the apparent semantic preservation. We report an in-depth study of Patient KA, a 27-year-old man who had severe hypoxia at birth, in which we carefully explored his residual episodic learning abilities. We used novel speeded recognition paradigms to assess whether KA could explicitly acquire and retrieve new context-free memories. Despite a pattern of very severe amnesia, with a 44-point discrepancy between his intelligence and memory quotients, KA exhibited normal-to-superior levels of knowledge, even under strict time constraints. He also exhibited normal-to-superior recognition memory for new material, again under strict time constraints. Multimodal neuroimaging revealed an unusual pattern of selective atrophy within each component of the extended hippocampal system, contrasting with the preservation of anterior subhippocampal cortices. A cortical thickness analysis yielded a pattern of thinner but also thicker regional cortices, pointing toward specific temporal lobe reorganization following early injury. We thus report the first case of superior explicit learning and memory in a severe case of amnesia, raising important questions about how such knowledge can be acquired.

Spatiotemporal dynamics of similarity-based neural representations of facial identity

Humans' remarkable ability to quickly and accurately discriminate among thousands of highly similar complex objects demands rapid and precise neural computations. To elucidate the process by which this is achieved, we used magnetoencephalography to measure spatiotemporal patterns of neural activity with high temporal resolution during visual discrimination among a large and carefully controlled set of faces. We also compared these neural data to lower level "image-based" and higher level "identity-based" model-based representations of our stimuli and to behavioral similarity judgments of our stimuli. Between ∼50 and 400 ms after stimulus onset, face-selective sources in right lateral occipital cortex and right fusiform gyrus and sources in a control region (left V1) yielded successful classification of facial identity. In all regions, early responses were more similar to the image-based representation than to the identity-based representation. In the face-selective regions only, responses were more similar to the identity-based representation at several time points after 200 ms. Behavioral responses were more similar to the identity-based representation than to the image-based representation, and their structure was predicted by responses in the face-selective regions. These results provide a temporally precise description of the transformation from low- to high-level representations of facial identity in human face-selective cortex and demonstrate that face-selective cortical regions represent multiple distinct types of information about face identity at different times over the first 500 ms after stimulus onset. These results have important implications for understanding the rapid emergence of fine-grained, high-level representations of object identity, a computation essential to human visual expertise.

Representational Dynamics of Facial Viewpoint Encoding

Faces provide a wealth of information, including the identity of the seen person and social cues, such as the direction of gaze. Crucially, different aspects of face processing require distinct forms of information encoding. Another person's attentional focus can be derived based on a view-dependent code. In contrast, identification benefits from invariance across all viewpoints. Different cortical areas have been suggested to subserve these distinct functions. However, little is known about the temporal aspects of differential viewpoint encoding in the human brain. Here, we combine EEG with multivariate data analyses to resolve the dynamics of face processing with high temporal resolution. This revealed a distinct sequence of viewpoint encoding. Head orientations were encoded first, starting after around 60 msec of processing. Shortly afterward, peaking around 115 msec after stimulus onset, a different encoding scheme emerged. At this latency, mirror-symmetric viewing angles elicited highly similar cortical responses. Finally, about 280 msec after visual onset, EEG response patterns demonstrated a considerable degree of viewpoint invariance across all viewpoints tested, with the noteworthy exception of the front-facing view. Taken together, our results indicate that the processing of facial viewpoints follows a temporal sequence of encoding schemes, potentially mirroring different levels of computational complexity.

Electrophysiological correlates of face-evoked person knowledge

Face recognition includes identifying a face as perceptually familiar and recollecting biographical information, or person-knowledge, associated with the face. The majority of studies examining the neural basis of face recognition have confounded these stages by comparing brain responses evoked by novel and perceptually familiar famous faces. Here, we recorded EEG in two tasks in which subjects viewed two sets of faces that were equally perceptually familiar, but which had differing levels of associated person-knowledge. Our results dissociated the effects of person-knowledge from perceptual familiarity. Faces with associated biographical information elicited a larger ∼600ms centroparietal positivity in both a passive viewing task in which subjects viewed faces without explicitly responding, and an active question-answering task in which subjects indicated whether or not they knew particular facts about the faces. In the question task only, person-knowledge was associated with a negative ERP difference over right posterior scalp over the 170-450ms interval which appeared again at long latency (>900ms).

Object and proper name retrieval in temporal lobe epilepsy: a study of difficulties and latencies

PURPOSE

Retrieving a specific name is sometimes difficult and can be even harder when pathology affects the temporal lobes. Word finding difficulties have been well documented in temporal lobe epilepsy (TLE) but analyses have mostly concentrated on the study of accuracy. Our aim here was to go beyond simple accuracy and to provide both a quantitative and a qualitative assessment of naming difficulties and latencies in patients with TLE.

METHODS

Thirty-two patients with temporal lobe epilepsy (16 with epilepsy affecting the cerebral hemisphere dominant for language (D-TLE) and 16 with epilepsy affecting the cerebral hemisphere non-dominant for language (ND-TLE)) and 34 healthy matched control subjects were included in the study. The experiment involved naming 70 photographs of objects and 70 photographs of celebrities as fast as possible. Accuracy and naming reaction times were recorded. Following each trial, a questionnaire was used to determine the specific nature of each subject's difficulty in retrieving the name (e.g., no difficulty, paraphasia, tip of the tongue, feeling of knowing the name, etc). Reaction times were analysed both across subjects and across trials.

KEY FINDINGS

D-TLE patients showed consistent and quasi-systematic impairment compared to matched control subjects on both object and famous people naming. This impairment was characterized not only by lower accuracy but also by more qualitative errors and tip of the tongue phenomena. Furthermore, minimum reaction times were slowed down by about 70 ms for objects and 150 ms for famous people naming. In contrast, patients with ND-TLE were less impaired, and their impairment was limited to object naming.

SIGNIFICANCE

These results suggest that patients with TLE, in particular D-TLE, show a general impairment of lexical access. Furthermore, there was evidence of subtle difficulties (increased reaction times) in patients with TLE.

The neural dynamics of face detection in the wild revealed by MVPA

Previous magnetoencephalography/electroencephalography (M/EEG) studies have suggested that face processing is extremely rapid, indeed faster than any other object category. Most studies, however, have been performed using centered, cropped stimuli presented on a blank background resulting in artificially low interstimulus variability. In contrast, the aim of the present study was to assess the underlying temporal dynamics of face detection presented in complex natural scenes. We recorded EEG activity while participants performed a rapid go/no-go categorization task in which they had to detect the presence of a human face. Subjects performed at ceiling (94.8% accuracy), and traditional event-related potential analyses revealed only modest modulations of the two main components classically associated with face processing (P100 and N170). A multivariate pattern analysis conducted across all EEG channels revealed that face category could, however, be readout very early, under 100 ms poststimulus onset. Decoding was linked to reaction time as early as 125 ms. Decoding accuracy did not increase monotonically; we report an increase during an initial 95-140 ms period followed by a plateau ∼140-185 ms-perhaps reflecting a transitory stabilization of the face information available-and a strong increase afterward. Further analyses conducted on individual images confirmed these phases, further suggesting that decoding accuracy may be initially driven by low-level stimulus properties. Such latencies appear to be surprisingly short given the complexity of the natural scenes and the large intraclass variability of the face stimuli used, suggesting that the visual system is highly optimized for the processing of natural scenes.

Local feature suppression effect in face and non-face stimuli

There is evidence that the cognitive system processes human faces faster and more precisely than other stimuli. Also, faces summon visual attention in an automatic manner, as evidenced by efficient, 'pop-out' search for face targets amongst homogeneous non-face distractors. Pop-out for faces implies that faces are processed as a basic visual 'feature' by specialized face-tuned detectors, similar to the coding of other features (e.g., color, orientation, motion, etc.). However, it is unclear whether such face detectors encode only the global face configuration or both global and local face features. If the former were correct, the face detectors should be unable to support search for a local face feature, rendering search slower relative to non-face stimuli; that is, there would be local feature suppression (LFS) for faces. If the latter was the case, there should be no difference in the processing of local and, respectively, global face features. In two experiments, participants discerned the presence (vs. absence) of a local target defined as a part of either a normal or a scrambled (schematic or realistic) face or of a non-face (Kanizsa diamond or realistic house) configuration. The results consistently showed a robust LFS effect in both reaction times and error rates for face stimuli, and either no difference or even a local feature enhancement effect for the control stimuli. Taken together, these findings indicate that faces are encoded as a basic visual feature by means of globally tuned face detectors.

Face Familiarity Decisions Take 200 msec in the Human Brain: Electrophysiological Evidence from a Go/No-go Speeded Task

Recognizing a familiar face rapidly is a fundamental human brain function. Here we used scalp EEG to determine the minimal time needed to classify a face as personally familiar or unfamiliar. Go (familiar) and no-go (unfamiliar) responses elicited clear differential waveforms from 210 msec onward, this difference being first observed at right occipito-temporal electrode sites. Similar but delayed (by about 40 msec) responses were observed when go response were required to the unfamiliar rather than familiar faces, in a second group of participants. In both groups, a small increase of amplitude was also observed on the right hemisphere N170 face-sensitive component for familiar faces. However, unlike the post-200 msec differential go/no-go effect, this effect was unrelated to behavior and disappeared with repetition of unfamiliar faces. These observations indicate that accumulation of evidence within the first 200 msec poststimulus onset is sufficient for the human brain to decide whether a person is familiar based on his or her face, a time frame that puts strong constraints on the time course of face processing.

Prioritized Detection of Personally Familiar Faces

We investigated whether personally familiar faces are preferentially processed in conditions of reduced attentional resources and in the absence of conscious awareness. In the first experiment, we used Rapid Serial Visual Presentation (RSVP) to test the susceptibility of familiar faces and faces of strangers to the attentional blink. In the second experiment, we used continuous flash interocular suppression to render stimuli invisible and measured face detection time for personally familiar faces as compared to faces of strangers. In both experiments we found an advantage for detection of personally familiar faces as compared to faces of strangers. Our data suggest that the identity of faces is processed with reduced attentional resources and even in the absence of awareness. Our results show that this facilitated processing of familiar faces cannot be attributed to detection of low-level visual features and that a learned unique configuration of facial features can influence preconscious perceptual processing.