Recognition memory of newly learned faces

Face learning via brief real-world social interactions includes changes in face-selective brain areas and hippocampus

Making new acquaintances requires learning to recognise previously unfamiliar faces. In the current study, we investigated this process by staging real-world social interactions between actors and the participants. Participants completed a face-matching behavioural task in which they matched photographs of the actors (whom they had yet to meet), or faces similar to the actors (henceforth called foils). Participants were then scanned using functional magnetic resonance imaging (fMRI) while viewing photographs of actors and foils. Immediately after exiting the scanner, participants met the actors for the first time and interacted with them for 10 min. On subsequent days, participants completed a second behavioural experiment and then a second fMRI scan. Prior to each session, actors again interacted with the participants for 10 min. Behavioural results showed that social interactions improved performance accuracy when matching actor photographs, but not foil photographs. The fMRI analysis revealed a difference in the neural response to actor photographs and foil photographs across all regions of interest (ROIs) only after social interactions had occurred. Our results demonstrate that short social interactions were sufficient to learn and discriminate previously unfamiliar individuals. Moreover, these learning effects were present in brain areas involved in face processing and memory.

The involvement of monocular channels in the face pareidolia effect

Studies examining the neural mechanisms of face perception in humans have mainly focused on cortical networks of face-selective regions. However, subcortical regions are known to play a significant role in face perception as well. For instance, upon presenting pairs of faces sequentially to the same eye or to different eyes, superior performance is observed in the former condition. This superiority was explained by monocular, pre-striate processing of face stimuli. One of the intriguing face-related effects is the face pareidolia phenomenon, wherein observers perceive faces in inanimate objects. In this study, we examined whether face pareidolia involves similar low-level neural substrates to those that are involved in face perception. We presented participants with pairs of houses or face-like houses using a stereoscope to manipulate the information presented to each eye and asked them to determine whether the stimuli were similar or different. We managed to examine the contribution of monocular channels (mostly subcortical) in processing face-like stimuli. We hypothesized that besides their involvement in actual face perception, subcortical structures are engaged in face pareidolia as well. To test our hypothesis, we conducted three experiments to replicate and strengthen the reliability of our results and rule out alternative explanations. We demonstrated a perceptual benefit when presenting similar face-like houses to the same eye in comparison to their presentation to different eyes. This finding matches previous results found for images of real faces and indicates subcortical involvement not only in face perception but also in processing face-like objects.

Neural mechanisms of face perception, their emergence over development, and their breakdown

Face perception is probably the most developed visual perceptual skill in humans, most likely as a result of its unique evolutionary and social significance. Much recent research has converged to identify a host of relevant psychological mechanisms that support face recognition. In parallel, there has been substantial progress in uncovering the neural mechanisms that mediate rapid and accurate face perception, with specific emphasis on a broadly distributed neural circuit, comprised of multiple nodes whose joint activity supports face perception. This article focuses specifically on the neural underpinnings of face recognition, and reviews recent structural and functional imaging studies that elucidate the neural basis of this ability. In addition, the article covers some of the recent investigations that characterize the emergence of the neural basis of face recognition over the course of development, and explores the relationship between these changes and increasing behavioural competence. This paper also describes studies that characterize the nature of the breakdown of face recognition in individuals who are impaired in face recognition, either as a result of brain damage acquired at some point or as a result of the failure to master face recognition over the course of development. Finally, information regarding similarities between the neural circuits for face perception in humans and in nonhuman primates is briefly covered, as is the contribution of subcortical regions to face perception. WIREs Cogn Sci 2016, 7:247-263. doi: 10.1002/wcs.1388 For further resources related to this article, please visit the WIREs website.

Face repetition detection and social interest: An ERP study in adults with and without Williams syndrome

The present study examined possible neural mechanisms underlying increased social interest in persons with Williams syndrome (WS). Visual event-related potentials (ERPs) during passive viewing were used to compare incidental memory traces for repeated vs. single presentations of previously unfamiliar social (faces) and nonsocial (houses) images in 26 adults with WS and 26 typical adults. Results indicated that participants with WS developed familiarity with the repeated faces and houses (frontal N400 response), but only typical adults evidenced the parietal old/new effect (previously associated with stimulus recollection) for the repeated faces. There was also no evidence of exceptional salience of social information in WS, as ERP markers of memory for repeated faces vs. houses were not significantly different. Thus, while persons with WS exhibit behavioral evidence of increased social interest, their processing of social information in the absence of specific instructions may be relatively superficial. The ERP evidence of face repetition detection in WS was independent of IQ and the earlier perceptual differentiation of social vs. nonsocial stimuli. Large individual differences in ERPs of participants with WS may provide valuable information for understanding the WS phenotype and have relevance for educational and treatment purposes.

Neural microgenesis of personally familiar face recognition

Despite a wealth of information provided by neuroimaging research, the neural basis of familiar face recognition in humans remains largely unknown. Here, we isolated the discriminative neural responses to unfamiliar and familiar faces by slowly increasing visual information (i.e., high-spatial frequencies) to progressively reveal faces of unfamiliar or personally familiar individuals. Activation in ventral occipitotemporal face-preferential regions increased with visual information, independently of long-term face familiarity. In contrast, medial temporal lobe structures (perirhinal cortex, amygdala, hippocampus) and anterior inferior temporal cortex responded abruptly when sufficient information for familiar face recognition was accumulated. These observations suggest that following detailed analysis of individual faces in core posterior areas of the face-processing network, familiar face recognition emerges categorically in medial temporal and anterior regions of the extended cortical face network.

Faces in the dark: interactive effects of darkness and anxiety on the memory for threatening faces

In the current research, we extend past work on the effects of ambient darkness and threat to the domain of memory for expressive faces. In one study, we examined the effects of ambient darkness and individual differences in state anxiety on memory of unfamiliar expressive faces. Here, participants were seated in either a dark or light room and encoded a set of unfamiliar faces with angry, happy, and neutral facial expressions. A subsequent recognition task revealed an interactive effect of ambient darkness, anxiety, and target expression. Highly anxious participants in ambient darkness had worse memory for angry faces than did low-anxiety participants. On the other hand, the recognition performance for happy faces was affected neither by the darkness nor state anxiety. The results suggest not only that ambient darkness has its strongest effect on anxious perceivers, but also that person × situation effects should be considered in face recognition research.

Early visual deprivation from congenital cataracts disrupts activity and functional connectivity in the face network

The development of the face-processing network has been examined with functional neuroimaging, but the effect of visual deprivation early in life on this network is not known. We examined this question in a group of young adults who had been born with dense, central cataracts in both eyes that blocked all visual input to the retina until the cataracts were removed during infancy. We used functional magnetic resonance imaging to examine regions in the "core" and "extended" face networks as participants viewed faces and other objects, and performed a face discrimination task. This task required matching faces on the basis of facial features or on the spacing between the facial features. The Cataract group (a) had reduced discrimination performance on the Spacing task relative to Controls; (b) used the same brain regions as Controls when passively viewing faces or making judgments about faces, but showed reduced activation during passive viewing of faces, especially in extended face-network regions; and (c) unlike Controls, showed activation in face-network regions for objects. In addition, the functional connections of the fusiform gyri with the rest of the face network were altered, and these brain changes were related to Cataract participants' performance on the face discrimination task. These results provide evidence that early visual input is necessary to set up or preserve activity and functional connectivity in the face-processing network that will later mediate expert face processing.

Monocular advantage for face perception implicates subcortical mechanisms in adult humans

The ability to recognize faces accurately and rapidly is an evolutionarily adaptive process. Most studies examining the neural correlates of face perception in adult humans have focused on a distributed cortical network of face-selective regions. There is, however, robust evidence from phylogenetic and ontogenetic studies that implicates subcortical structures, and recently, some investigations in adult humans indicate subcortical correlates of face perception as well. The questions addressed here are whether low-level subcortical mechanisms for face perception (in the absence of changes in expression) are conserved in human adults, and if so, what is the nature of these subcortical representations. In a series of four experiments, we presented pairs of images to the same or different eyes. Participants' performance demonstrated that subcortical mechanisms, indexed by monocular portions of the visual system, play a functional role in face perception. These mechanisms are sensitive to face-like configurations and afford a coarse representation of a face, comprised of primarily low spatial frequency information, which suffices for matching faces but not for more complex aspects of face perception such as sex differentiation. Importantly, these subcortical mechanisms are not implicated in the perception of other visual stimuli, such as cars or letter strings. These findings suggest a conservation of phylogenetically and ontogenetically lower-order systems in adult human face perception. The involvement of subcortical structures in face recognition provokes a reconsideration of current theories of face perception, which are reliant on cortical level processing, inasmuch as it bolsters the cross-species continuity of the biological system for face recognition.

Changes in brain anatomy during the course of posttraumatic stress disorder

The goal of this study was to determine whether posttraumatic stress disorder (PTSD) was associated with an increase in time-related decline in macrostructural brain volume and whether these changes were associated with accelerated cognitive decline. To quantify brain structure, three-dimensional T1-weighted MRI scans were performed at baseline and again after a minimum of 24months in 25 patients with PTSD (PTSD+) and 22 controls (PTSD-). Longitudinal changes in brain volume were measured using deformation morphometry. For the group as a whole, PTSD+ patients did not show significant ongoing brain atrophy compared to PTSD-. PTSD+ patients were then subgrouped into those with decreasing or increasing symptoms. We found little evidence for brain markers of accelerated atrophy in PTSD+ veterans whose symptoms improved over time, with only a small left parietal region showing greater ongoing tissue loss than PTSD-. PTSD patients whose symptoms increased over time showed accelerated atrophy throughout the brain, particularly brainstem and frontal and temporal lobes. Lastly, for the sample as a whole, greater rates of brain atrophy were associated with greater rates of decline in verbal memory and delayed facial recognition.

The development of face recognition; hippocampal and frontal lobe contributions determined with MEG

Face recognition skills improve steadily across childhood, yet few studies have investigated the development of the neural sources underlying these processes. We investigated the developmental changes in brain activity related specifically to face recognition, using magnetoencephalography (MEG). We studied 70 children (6-19 years) and 20 young adults. Photographs of 240 neutral faces were used in two blocks of 1-back recognition tasks; one block contained faces upright and in the other block, faces were presented inverted. MEG activity was recorded on a 151 sensor CTF/MISL system. A structural MRI was acquired for all subjects. We focussed on the repetition effects of the faces, in a 280-680 ms window, contrasting the repeated faces with the first presentation of the faces. The analyses showed reliable right hippocampal activation across all age groups, and a right inferior frontal activation that emerged for repeated, recognised faces at 10-11 years of age. The hippocampi are implicated in memory function and we demonstrate that the right hippocampus is specifically involved for face recognition. Further, we determined that this comes on-line by early school age, which is consistent with the known early maturation of the hippocampi. In contrast, we show that the right inferior frontal areas do not come on-line until later in childhood, consistent with the protracted development of the frontal cortices. These data support the hypothesis that different age groups use different strategies and neural structures for face recognition.

Brain responses differ to faces of mothers and fathers

We encounter many faces each day but relatively few are personally familiar. Once faces are familiar, they evoke semantic and social information known about the person. Neuroimaging studies demonstrate differential brain activity to familiar and non-familiar faces; however, brain responses related to personally familiar faces have been more rarely studied. We examined brain activity with fMRI in adults in response to faces of their mothers and fathers compared to faces of celebrities and strangers. Overall, faces of mothers elicited more activity in core and extended brain regions associated with face processing, compared to fathers, celebrity or stranger faces. Fathers' faces elicited activity in the caudate, a deep brain structure associated with feelings of love. These new findings of differential brain responses elicited by faces of mothers and fathers are consistent with psychological research on attachment, evident even during adulthood.

Emotional perception: meta-analyses of face and natural scene processing

Functional imaging studies of emotional processing typically contain neutral control conditions that serve to remove simple effects of visual perception, thus revealing the additional emotional process. Here we seek to identify similarities and differences across 100 studies of emotional face processing and 57 studies of emotional scene processing, using a coordinate-based meta-analysis technique. The overlay of significant meta-analyses resulted in extensive overlap in clusters, coupled with offset and unique clusters of reliable activity. The area of greatest overlap is the amygdala, followed by regions of medial prefrontal cortex, inferior frontal/orbitofrontal cortex, inferior temporal cortex, and extrastriate occipital cortex. Emotional face-specific clusters were identified in regions known to be involved in face processing, including anterior fusiform gyrus and middle temporal gyrus, and emotional scene studies were uniquely associated with lateral occipital cortex, as well as pulvinar and the medial dorsal nucleus of the thalamus. One global result of the meta-analysis reveals that a class of visual stimuli (faces vs. scenes) has a considerable impact on the resulting emotion effects, even after removing the basic visual perception effects through subtractive contrasts. Pure effects of emotion may thus be difficult to remove for the particular class of stimuli employed in an experimental paradigm. Whether a researcher chooses to tightly control the various elements of the emotional stimuli, as with posed face photographs, or allow variety and environmental realism into their evocative stimuli, as with natural scenes, will depend on the desired generalizability of their results.

Frontolimbic responses to emotional face memory: the neural correlates of first impressions

First impressions, especially of emotional faces, may critically impact later evaluation of social interactions. Activity in limbic regions, including the amygdala and ventral striatum, has previously been shown to correlate with identification of emotional content in faces; however, little work has been done describing how these signals may influence emotional face memory. We report an event-related functional magnetic resonance imaging study in 21 healthy adults where subjects attempted to recognize a neutral face that was previously viewed with a threatening (angry or fearful) or nonthreatening (happy or sad) affect. In a hypothesis-driven region of interest analysis, we found that neutral faces previously presented with a threatening affect recruited the left amygdala. In contrast, faces previously presented with a nonthreatening affect activated the left ventral striatum. A whole-brain analysis revealed increased response in the right orbitofrontal cortex to faces previously seen with threatening affect. These effects of prior emotion were independent of task performance, with differences being seen in the amygdala and ventral striatum even if only incorrect trials were considered. The results indicate that a network of frontolimbic regions may provide emotional bias signals during facial recognition.

The effect of Neuregulin 1 on neural correlates of episodic memory encoding and retrieval

Neuregulin 1 (NRG1) has been found to be associated with schizophrenia. Impaired performance in episodic memory tasks is an often replicated finding in this disorder. In functional neuroimaging studies, this dysfunction has been linked to signal changes in prefrontal and medial temporal areas. Therefore, it is of interest whether genes associated with the disorder, such as NRG1, modulate episodic memory performance and its neural correlates. Ninety-four healthy individuals performed an episodic memory encoding and a retrieval task while brain activation was measured with functional MRI. All subjects were genotyped for the single nucleotide polymorphism (SNP) rs35753505 in the NRG1 gene. The effect of genotype on brain activation was assessed with fMRI during the two tasks. While there were no differences in performance, brain activation in the cingulate gyrus (BA 24), the left middle frontal gyrus (BA 9), the bilateral fusiform gyrus and the left middle occipital gyrus (BA 19) was positively correlated with the number of risk alleles in NRG1 during encoding. During retrieval brain activation was positively correlated with the number of risk alleles in the left middle occipital gyrus (BA 19). NRG1 genotype does modulate brain activation during episodic memory processing in key areas for memory encoding and retrieval. The results suggest that subjects with risk alleles show hyperactivations in areas associated with elaborate encoding strategies.

Neural correlates of personally familiar faces: parents, partner and own faces

Investigations of the neural correlates of face recognition have typically used old/new paradigms where subjects learn to recognize new faces or identify famous faces. Familiar faces, however, include one's own face, partner's and parents' faces. Using event-related fMRI, we examined the neural correlates of these personally familiar faces. Ten participants were presented with photographs of own, partner, parents, famous and unfamiliar faces and responded to a distinct target. Whole brain, two regions of interest (fusiform gyrus and cingulate gyrus), and multiple linear regression analyses were conducted. Compared with baseline, all familiar faces activated the fusiform gyrus; own faces also activated occipital regions and the precuneus; partner faces activated similar areas, but in addition, the parahippocampal gyrus, middle superior temporal gyri and middle frontal gyrus. Compared with unfamiliar faces, only personally familiar faces activated the cingulate gyrus and the extent of activation varied with face category. Partner faces also activated the insula, amygdala and thalamus. Regions of interest analyses and laterality indices showed anatomical distinctions of processing the personally familiar faces within the fusiform and cingulate gyri. Famous faces were right lateralized whereas personally familiar faces, particularly partner and own faces, elicited bilateral activations. Regression analyses show experiential predictors modulated with neural activity related to own and partner faces. Thus, personally familiar faces activated the core visual areas and extended frontal regions, related to semantic and person knowledge and the extent and areas of activation varied with face type.

Neural substrates for visual pattern recognition learning in Igo

Different contexts require different visual pattern recognitions even for identical retinal inputs, and acquiring expertise in various visual-cognitive skills requires long-term training to become capable of recognizing relevant visual patterns in otherwise ambiguous stimuli. This 3-Tesla fMRI experiment exploited shikatsu-mondai (life-or-death problems) in the Oriental board game of Igo (Go) to identify the neural substrates supporting this gradual and adaptive learning. In shikatsu-mondai, the player adds stones to the board with the objective of making, or preventing the opponent from making nigan (two eyes), or the topology of figure of eight, with these stones. Without learning the game, passive viewing of shikatsu-mondai activated the occipito-temporal cortices, reflecting visual processing without the recognition of nigan. Several days after two-hour training, passive viewing of the same stimuli additionally activated the premotor area, intraparietal sulcus, and a visual area near the junction of the (left) intraparietal and transverse occipital sulci, demonstrating plastic changes in neuronal responsivity to the stimuli that contained indications of nigan. Behavioral tests confirmed that the participants had successfully learned to recognize nigan and solve the problems. In the newly activated regions, the level of neural activity while viewing the problems correlated positively with the level of achievement in learning. These results conformed to the hypothesis that recognition of a newly learned visual pattern is supported by the activities of fronto-parietal and visual cortical neurons that interact via newly formed functional connections among these regions. These connections would provide the medium by which the fronto-parietal system modulates visual cortical activity to attain behaviorally relevant perceptions.

Recollection- and familiarity-based decisions reflect memory strength

We used event-related fMRI to investigate whether recollection- and familiarity-based memory judgments are modulated by the degree of visual similarity between old and new art paintings. Subjects performed a flower detection task, followed by a Remember/Know/New surprise memory test. The old paintings were randomly presented with new paintings, which were either visually similar or visually different. Consistent with our prediction, subjects were significantly faster and more accurate to reject new, visually different paintings than new, visually similar ones. The proportion of false alarms, namely remember and know responses to new paintings, was significantly reduced with decreased visual similarity. The retrieval task evoked activation in multiple visual, parietal and prefrontal regions, within which remember judgments elicited stronger activation than know judgments. New, visually different paintings evoked weaker activation than new, visually similar items in the intraparietal sulcus. Contrasting recollection with familiarity revealed activation predominantly within the precuneus, where the BOLD response elicited by recollection peaked significantly earlier than the BOLD response evoked by familiarity judgments. These findings suggest that successful memory retrieval of pictures is mediated by activation in a distributed cortical network, where memory strength is manifested by differential hemodynamic profiles. Recollection- and familiarity-based memory decisions may therefore reflect strong memories and weak memories, respectively.

Spatio temporal dynamics of face recognition

To better understand face recognition, it is necessary to identify not only which brain structures are implicated but also the dynamics of the neuronal activity in these structures. Latencies can then be compared to unravel the temporal dynamics of information processing at the distributed network level. To achieve high spatial and temporal resolution, we used intracerebral recordings in epileptic subjects while they performed a famous/unfamiliar face recognition task. The first components peaked at 110 ms in the fusiform gyrus (FG) and simultaneously in the inferior frontal gyrus, suggesting the early establishment of a large-scale network. This was followed by components peaking at 160 ms in 2 areas along the FG. Important stages of distributed parallel processes ensued at 240 and 360 ms involving up to 6 regions along the ventral visual pathway. The final components peaked at 480 ms in the hippocampus. These stages largely overlapped. Importantly, event-related potentials to famous faces differed from unfamiliar faces and control stimuli in all medial temporal lobe structures. The network was bilateral but more right sided. Thus, recognition of famous faces takes place through the establishment of a complex set of local and distributed processes that interact dynamically and may be an emergent property of these interactions.