Voice Recognition in Face-Blind Patients

Perceptual and semantic deficits in face recognition in semantic dementia

State of the art

Semantic dementia (SD) patients including semantic variant primary progressive aphasia (svPPA) and semantic behavioral variant frontotemporal dementia (sbvFTD) patients show semantic difficulties identifying faces and known people related to right anterior temporal lobe (ATL) atrophy. However, it remains unclear whether they also have perceptual deficits in face recognition.

Methodology

We selected 74 SD patients (54 with svPPA and predominant left ATL atrophy and 20 with sbvFTD and predominant right ATL atrophy) and 36 cognitively healthy controls (HC) from UCSF Memory and Aging Center. They underwent a perceptual face processing test (Benton facial recognition test-short version; BFRT-S), and semantic face processing tests (UCSF Famous people battery - Recognition, Naming, Semantic associations - pictures and words subtests), as well as structural magnetic resonance imaging (MRI). Neural correlates with the task's performance were conducted with a Voxel-based morphometry approach using CAT12.

Results

svPPA and sbvFTD patients were impaired on all semantic face processing tests, with sbvFTD patients performing significantly lower on the famous faces' recognition task in comparison to svPPA, and svPPA performing significantly lower on the naming task in comparison to sbvFTD. These tasks predominantly correlated with gray matter (GM) volumes in the right and left ATL, respectively. Compared to HC, both svPPA and sbvFTD patients showed preserved performance on the perceptual face processing test (BFRT-S), and performance on the BFRT-S negatively correlated with GM volume in the right posterior superior temporal sulcus (pSTS).

Conclusion

Our results suggest that early in the disease, with the atrophy mostly restricted to the anterior temporal regions, SD patients do not present with perceptual deficits. However, more severe SD cases with atrophy in right posterior temporal regions might show lower performance on face perception tests, in addition to the semantic face processing deficits. Early sparing of face perceptual deficits in SD patients, regardless of hemispheric lateralization, furthers our understanding of clinical phenomenology and therapeutical approaches of this complex disease.

The anterior fusiform gyrus: The ghost in the cortical face machine

Face-selective regions in the human ventral occipito-temporal cortex (VOTC) have been defined for decades mainly with functional magnetic resonance imaging. This face-selective VOTC network is traditionally divided in a posterior 'core' system thought to subtend face perception, and regions of the anterior temporal lobe as a semantic memory component of an extended general system. In between these two putative systems lies the anterior fusiform gyrus and surrounding sulci, affected by magnetic susceptibility artifacts. Here we suggest that this methodological gap overlaps with and contributes to a conceptual gap between (visual) perception and semantic memory for faces. Filling this gap with intracerebral recordings and direct electrical stimulation reveals robust face-selectivity in the anterior fusiform gyrus and a crucial role of this region, especially in the right hemisphere, in identity recognition for both familiar and unfamiliar faces. Based on these observations, we propose an integrated theoretical framework for human face (identity) recognition according to which face-selective regions in the anterior fusiform gyrus join the dots between posterior and anterior cortical face memories.

Apperceptive and Associative Forms of Phonagnosia

PURPOSE OF REVIEW

Pronagnosia is a rare acquired or developmental pathological condition that consists of a selective difficulty to recognize familiar people by their voices. It can be distinguished into two different categories: apperceptive phonagnosia, which denotes a purely perceptual form of voice recognition disorder; and associative phonagnosia, in which patients have no perceptual defects, but cannot evaluate if the voice of a known person is or not familiar. The neural substrate of these two forms of voice recognition is still controversial, but it could concern different components of the core temporal voice areas and of extratemporal voice processing areas. This article reviews recent research on the neuropsychological and anatomo-clinical aspects of this condition.

RECENT FINDINGS

Data obtained in group studies or single case reports of phonagnosic patients suggest that apperceptive phonagnosia might be due to disruption of the core temporal voice areas, bilaterally located in the posterior parts of the superior temporal gyrus, whereas associative phonagnosia might result from impaired access to structures where voice representations are stored, due to a disconnection of these areas from structures of the voice extended system. Although these results must be confirmed by further investigations, they represent an important step toward understanding the nature and neural substrate of apperceptive and associative forms of phonagnosia.

Neural Correlates of Voice Learning with Distinctive and Non-Distinctive Faces

Recognizing people from their voices may be facilitated by a voice's distinctiveness, in a manner similar to that which has been reported for faces. However, little is known about the neural time-course of voice learning and the role of facial information in voice learning. Based on evidence for audiovisual integration in the recognition of familiar people, we studied the behavioral and electrophysiological correlates of voice learning associated with distinctive or non-distinctive faces. We repeated twelve unfamiliar voices uttering short sentences, together with either distinctive or non-distinctive faces (depicted before and during voice presentation) in six learning-test cycles. During learning, distinctive faces increased early visually-evoked (N170, P200, N250) potentials relative to non-distinctive faces, and face distinctiveness modulated voice-elicited slow EEG activity at the occipito-temporal and fronto-central electrodes. At the test, unimodally-presented voices previously learned with distinctive faces were classified more quickly than were voices learned with non-distinctive faces, and also more quickly than novel voices. Moreover, voices previously learned with faces elicited an N250-like component that was similar in topography to that typically observed for facial stimuli. The preliminary source localization of this voice-induced N250 was compatible with a source in the fusiform gyrus. Taken together, our findings provide support for a theory of early interaction between voice and face processing areas during both learning and voice recognition.

Which components of famous people recognition are lateralized? A study of face, voice and name recognition disorders in patients with neoplastic or degenerative damage of the right or left anterior temporal lobes

We administered to large groups of patients with neoplastic or degenerative damage affecting the right or left ATL, the 'Famous People Recognition Battery' (FPRB), in which subjects are required to recognize the same 40 famous people through their faces, voices and names, to clarify which components of famous people recognition are lateralized. At the familiarity level, we found, as expected, a dissociation between a greater impairment of patients with right ATL lesions on the non-verbal (face and voice) recognition modalities and of those with left ATL lesions on name familiarity. Equally expected were results obtained at the naming level, because the worse naming scores for faces and voices were observed in left-sided patients. Less foregone were, for two reasons, results obtained at the semantic level. First, no difference was found between the two hemispheric groups when scores obtained on the verbal (name) and non-verbal (face and voice) recognition modalities were account for. Second, the face and voice recognition modalities showed a different degree of right lateralization. All groups of patients showed, indeed, both at the familiarity and at the semantic level, a greater difficulty in the recognition of voices regarding faces, but this difference reached significance only in patients with right ATL lesions, suggesting a greater right lateralization of the more complex task of voice recognition. A model aiming to explain the greater right lateralization of the more perceptually demanding voice modality of person recognition is proposed.

Music perception in acquired prosopagnosia

BACKGROUND

Acquired prosopagnosia is often associated with other deficits such as dyschromatopsia and topographagnosia, from damage to adjacent perceptual networks. A recent study showed that some subjects with developmental prosopagnosia also have congenital amusia, but problems with music perception have not been described with the acquired variant.

OBJECTIVE

Our goal was to determine if music perception was also impaired in subjects with acquired prosopagnosia, and if so, its anatomic correlate.

METHOD

We studied eight subjects with acquired prosopagnosia, all of whom had extensive neuropsychological and neuroimaging testing. They performed a battery of tests evaluating pitch and rhythm processing, including the Montréal Battery for the Evaluation of Amusia.

RESULTS

At the group level, subjects with anterior temporal lesions were impaired in pitch perception relative to the control group, but not those with occipitotemporal lesions. Three of eight subjects with acquired prosopagnosia had impaired musical pitch perception while rhythm perception was spared. Two of the three also showed reduced musical memory. These three reported alterations in their emotional experience of music: one reported music anhedonia and aversion, while the remaining two had changes consistent with musicophilia. The lesions of these three subjects affected the right or bilateral temporal poles as well as the right amygdala and insula. None of the three prosopagnosic subjects with lesions limited to the inferior occipitotemporal cortex exhibited impaired pitch perception or musical memory, or reported changes in music appreciation.

CONCLUSION

Together with the results of our previous studies of voice recognition, these findings indicate an anterior ventral syndrome that can include the amnestic variant of prosopagnosia, phonagnosia, and various alterations in music perception, including acquired amusia, reduced musical memory, and subjective reports of altered emotional experience of music.

Persistent prosopagnosia following COVID-19

COVID-19 can cause psychological problems including loss of smell and taste, long-lasting memory, speech, and language impairments, and psychosis. Here, we provide the first report of prosopagnosia following symptoms consistent with COVID-19. Annie is a 28-year-old woman who had normal face recognition prior to contracting COVID-19 in March 2020. Two months later, she noticed face recognition difficulties while experiencing symptom relapses and her deficits with faces have persisted. On two tests of familiar face recognition and two tests of unfamiliar face recognition, Annie showed clear impairments. In contrast, she scored normally on tests assessing face detection, face identity perception, object recognition, scene recognition, and non-visual memory. Navigational deficits frequently co-occur with prosopagnosia, and Annie reports that her navigational abilities are substantially worse than before she became ill. Self-report survey data from 54 respondents with long COVID showed that a majority reported reductions in visual recognition and navigation abilities. In summary, Annie's results indicate that COVID-19 can produce severe and selective neuropsychological impairment similar to deficits seen following brain damage, and it appears that high-level visual impairments are not uncommon in people with long COVID.

Effects of Voice and Biographic Data on Face Encoding

There are various perceptual and informational cues for recognizing people. How these interact in the recognition process is of interest. Our goal was to determine if the encoding of faces was enhanced by the concurrent presence of a voice, biographic data, or both. Using a between-subject design, four groups of 10 subjects learned the identities of 24 faces seen in video-clips. Half of the faces were seen only with their names, while the other half had additional information. For the first group this was the person's voice, for the second, it was biographic data, and for the third, both voice and biographic data. In a fourth control group, the additional information was the voice of a generic narrator relating non-biographic information. In the retrieval phase, subjects performed a familiarity task and then a face-to-name identification task with dynamic faces alone. Our results consistently showed no benefit to face encoding with additional information, for either the familiarity or identification task. Tests for equivalency indicated that facilitative effects of a voice or biographic data on face encoding were not likely to exceed 3% in accuracy. We conclude that face encoding is minimally influenced by cross-modal information from voices or biographic data.

The impact of low vision on social function: The potential importance of lost visual social cues

Visual cues usually play a vital role in social interaction. As well as being the primary cue for identifying other people, visual cues also provide crucial non-verbal social information via both facial expressions and body language. One consequence of vision loss is the need to rely on non-visual cues during social interaction. Although verbal cues can carry a significant amount of information, this information is often not available to an untrained listener. Here, we review the current literature examining potential ways that the loss of social information due to vision loss might impact social functioning. A large number of studies suggest that low vision and blindness is a risk factor for anxiety and depression. This relationship has been attributed to multiple factors, including anxiety about disease progression, and impairments to quality of life that include difficulties reading, and a lack of access to work and social activities. However, our review suggests a potential additional contributing factor to reduced quality of life that has been hitherto overlooked: blindness may make it more difficult to effectively engage in social interactions, due to a loss of visual information. The current literature suggests it might be worth considering training in voice discrimination and/or recognition when carrying out rehabilitative training in late blind individuals.

Effects of Faces and Voices on the Encoding of Biographic Information

There are multiple forms of knowledge about people. Whether diverse person-related data interact is of interest regarding the more general issue of integration of multi-source information about the world. Our goal was to examine whether perception of a person's face or voice enhanced the encoding of their biographic data. We performed three experiments. In the first experiment, subjects learned the biographic data of a character with or without a video clip of their face. In the second experiment, they learned the character's data with an audio clip of either a generic narrator's voice or the character's voice relating the same biographic information. In the third experiment, an audiovisual clip of both the face and voice of either a generic narrator or the character accompanied the learning of biographic data. After learning, a test phase presented biographic data alone, and subjects were tested first for familiarity and second for matching of biographic data to the name. The results showed equivalent learning of biographic data across all three experiments, and none showed evidence that a character's face or voice enhanced the learning of biographic information. We conclude that the simultaneous processing of perceptual representations of people may not modulate the encoding of biographic data.

Cerebral Visual Loss

Cerebral visual disorders include a range of common and rare deficits. They can be divided into effects on low-, intermediate-, and high-level forms of visual processing. Low-level deficits are various forms of homonymous hemifield scotomata, which affect all types of vision within their borders. Intermediate-level deficits refer to impairments of colour or motion perception, which affect either one hemifield or the entire field when lesions are bilateral. High-level deficits are divided into those of the ventral (occipitotemporal) or dorsal (occipitoparietal) stream. Occipitotemporal lesions affect various aspects of object recognition, ranging from general visual agnosia to selective agnosias, such as prosopagnosia or topographagnosia from right or bilateral lesions, and pure alexia from left-sided lesions. Occipitoparietal lesions cause the various components of Bálint syndrome, namely, simultanagnosia, optic ataxia, and ocular motor apraxia. They can also cause other impairments of visuospatial or visuotemporal processing, such as astereopsis and sequence-agnosia. Because of anatomic proximity, certain deficits cluster together to form a number of cerebral visual syndromes. Treatment of these disorders remains challenging, with frequent reliance on strategic substitutions rather than restorative approaches.

Atypical prosopagnosia following right hemispheric stroke: A 23-year follow-up study with M.T

Most findings on prosopagnosia to date suggest preserved voice recognition in prosopagnosia (except in cases with bilateral lesions). Here we report a follow-up examination on M.T., suffering from acquired prosopagnosia following a large unilateral right-hemispheric lesion in frontal, parietal, and anterior temporal areas excluding core ventral occipitotemporal face areas. Twenty-three years after initial testing we reassessed face and object recognition skills [Henke, K., Schweinberger, S. R., Grigo, A., Klos, T., & Sommer, W. (1998). Specificity of face recognition: Recognition of exemplars of non-face objects in prosopagnosia. Cortex, 34(2), 289-296]; [Schweinberger, S. R., Klos, T., & Sommer, W. (1995). Covert face recognition in prosopagnosia - A dissociable function? Cortex, 31(3), 517-529] and additionally studied voice recognition. Confirming the persistence of deficits, M.T. exhibited substantial impairments in famous face recognition and memory for learned faces, but preserved face matching and object recognition skills. Critically, he showed substantially impaired voice recognition skills. These findings are congruent with the ideas that (i) prosopagnosia after right anterior temporal lesions can persist over long periods > 20 years, and that (ii) such lesions can be associated with both facial and vocal deficits in person recognition.

Face processing in the temporal lobe

Face perception is a socially important but complex process with many stages and many facets. There is substantial evidence from many sources that it involves a large extent of the temporal lobe, from the ventral occipitotemporal cortex and superior temporal sulci to anterior temporal regions. While early human neuroimaging work suggested a core face network consisting of the occipital face area, fusiform face area, and posterior superior temporal sulcus, studies in both humans and monkeys show a system of face patches stretching from posterior to anterior in both the superior temporal sulcus and inferotemporal cortex. Sophisticated techniques such as fMRI adaptation have shown that these face-activated regions show responses that have many of the attributes of human face processing. Lesions of some of these regions in humans lead to variants of prosopagnosia, the inability to recognize the identity of a face. Lesion, imaging, and electrophysiologic data all suggest that there is a segregation between identity and expression processing, though some suggest this may be better characterized as a distinction between static and dynamic facial information.

Prosopagnosia and disorders of face processing

Face recognition is a form of expert visual processing. Acquired prosopagnosia is the loss of familiarity for facial identity and has several functional variants, namely apperceptive, amnestic, and associative forms. Acquired forms are usually caused by either occipitotemporal or anterior temporal lesions, right or bilateral in most cases. In addition, there is a developmental form, whose functional and structural origins are still being elucidated. Despite their difficulties with recognizing faces, some of these subjects still show signs of covert recognition, which may have a number of explanations. Other aspects of face perception can be spared in prosopagnosic subjects. Patients with other types of face processing difficulties have been described, including impaired expression processing, impaired lip-reading, false familiarity for faces, and a people-specific amnesia. Recent rehabilitative studies have shown some modest ability to improve face perception in prosopagnosic subjects through perceptual training protocols.

Normal recognition of famous voices in developmental prosopagnosia

Developmental prosopagnosia (DP) is a condition characterised by lifelong face recognition difficulties. Recent neuroimaging findings suggest that DP may be associated with aberrant structure and function in multimodal regions of cortex implicated in the processing of both facial and vocal identity. These findings suggest that both facial and vocal recognition may be impaired in DP. To test this possibility, we compared the performance of 22 DPs and a group of typical controls, on closely matched tasks that assessed famous face and famous voice recognition ability. As expected, the DPs showed severe impairment on the face recognition task, relative to typical controls. In contrast, however, the DPs and controls identified a similar number of voices. Despite evidence of interactions between facial and vocal processing, these findings suggest some degree of dissociation between the two processing pathways, whereby one can be impaired while the other develops typically. A possible explanation for this dissociation in DP could be that the deficit originates in the early perceptual encoding of face structure, rather than at later, post-perceptual stages of face identity processing, which may be more likely to involve interactions with other modalities.

The Scanpaths of Subjects with Developmental Prosopagnosia during a Face Memory Task

The scanpaths of healthy subjects show biases towards the upper face, the eyes and the center of the face, which suggests that their fixations are guided by a feature hierarchy towards the regions most informative for face identification. However, subjects with developmental prosopagnosia have a lifelong impairment in face processing. Whether this is reflected in the loss of normal face-scanning strategies is not known. The goal of this study was to determine if subjects with developmental prosopagnosia showed anomalous scanning biases as they processed the identity of faces. We recorded the fixations of 10 subjects with developmental prosopagnosia as they performed a face memorization and recognition task, for comparison with 8 subjects with acquired prosopagnosia (four with anterior temporal lesions and four with occipitotemporal lesions) and 20 control subjects. The scanning of healthy subjects confirmed a bias to fixate the upper over the lower face, the eyes over the mouth, and the central over the peripheral face. Subjects with acquired prosopagnosia from occipitotemporal lesions had more dispersed fixations and a trend to fixate less informative facial regions. Subjects with developmental prosopagnosia did not differ from the controls. At a single-subject level, some developmental subjects performed abnormally, but none consistently across all metrics. Scanning distributions were not related to scores on perceptual or memory tests for faces. We conclude that despite lifelong difficulty with faces, subjects with developmental prosopagnosia still have an internal facial schema that guides their scanning behavior.

Object recognition in acquired and developmental prosopagnosia

Whether face and object recognition are dissociated in prosopagnosia continues to be debated: a recent review highlighted deficiencies in prior studies regarding the evidence for such a dissociation. Our goal was to study cohorts with acquired and developmental prosopagnosia with a complementary battery of tests of object recognition that address prior limitations, as well as evaluating for residual effects of object expertise. We studied 15 subjects with acquired and 12 subjects with developmental prosopagnosia on three tests: the Old/New Tests, the Cambridge Bicycle Memory Test, and the Expertise-adjusted Test of Car Recognition. Most subjects with developmental prosopagnosia were normal on the Old/New Tests: for acquired prosopagnosia, subjects with occipitotemporal lesions often showed impairments while those with anterior temporal lesions did not. Ten subjects showed a putative classical dissociation between the Cambridge Face and Bicycle Memory Tests, seven of whom had normal reaction times. Both developmental and acquired groups showed reduced car recognition on the expertise-adjusted test, though residual effects of expertise were still evident. Two subjects with developmental prosopagnosia met criteria for normal object recognition across all tests. We conclude that strong evidence for intact object recognition can be found in a few subjects but the majority show deficits, particularly those with the acquired form. Both acquired and developmental forms show residual but reduced object expertise effects.

Perception of musical pitch in developmental prosopagnosia

Studies of developmental prosopagnosia have often shown that developmental prosopagnosia differentially affects human face processing over non-face object processing. However, little consideration has been given to whether this condition is associated with perceptual or sensorimotor impairments in other modalities. Comorbidities have played a role in theories of other developmental disorders such as dyslexia, but studies of developmental prosopagnosia have often focused on the nature of the visual recognition impairment despite evidence for widespread neural anomalies that might affect other sensorimotor systems. We studied 12 subjects with developmental prosopagnosia with a battery of auditory tests evaluating pitch and rhythm processing as well as voice perception and recognition. Overall, three subjects were impaired in fine pitch discrimination, a prevalence of 25% that is higher than the estimated 4% prevalence of congenital amusia in the general population. This was a selective deficit, as rhythm perception was unaffected in all 12 subjects. Furthermore, two of the three prosopagnosic subjects who were impaired in pitch discrimination had intact voice perception and recognition, while two of the remaining nine subjects had impaired voice recognition but intact pitch perception. These results indicate that, in some subjects with developmental prosopagnosia, the face recognition deficit is not an isolated impairment but is associated with deficits in other domains, such as auditory perception. These deficits may form part of a broader syndrome which could be due to distributed microstructural anomalies in various brain networks, possibly with a common theme of right hemispheric predominance.

The effect of occipital nerve field stimulation on the descending pain pathway in patients with fibromyalgia: a water PET and EEG imaging study

Background

Fibromyalgia is a chronic disorder characterized by widespread musculoskeletal pain accompanied by fatigue, sleep, memory, and mood problems. Recently, occipital nerve field stimulation (ONS) has been proposed as an effective potential treatment for fibromyalgia-related pain. The aim of this study is to unravel the neural mechanism behind occipital nerve stimulation’s ability to suppress pain in fibromyalgia patients.

Materials and methods

Seven patients implanted with subcutaneous electrodes in the C2 dermatoma were enrolled for a Positron Emission Tomography (PET) H₂¹⁵O activation study. These seven patients were selected from a cohort of 40 patients who were part of a double blind, placebo-controlled study followed by an open label follow up at six months. The H₂¹⁵O PET scans were taken during both the “ON” (active stimulation) and “OFF” (stimulating device turned off) conditions. Electroencephalogram (EEG) data were also recorded for the implanted fibromyalgia patients during both the “ON” and “OFF” conditions.

Results

Relative to the “OFF” condition, ONS stimulation resulted in activation in the dorsal lateral prefrontal cortex, comprising the medial pain pathway, the ventral medial prefrontal cortex, and the bilateral anterior cingulate cortex as well as parahippocampal area, the latter two of which comprise the descending pain pathway. Relative deactivation was observed in the left somatosensory cortex, constituting the lateral pain pathway as well as other sensory areas such as the visual and auditory cortex. The EEG results also showed increased activity in the descending pain pathway. The pregenual anterior cingulate cortex extending into the ventral medial prefrontal cortex displayed this increase in the theta, alpha1, alpha2, beta1, and beta2 frequency bands.

Conclusion

PET shows that ONS exerts its effect via activation of the descending pain inhibitory pathway and the lateral pain pathway in fibromyalgia, while EEG shows activation of those cortical areas that could be responsible for descending inhibition system recruitment.

Trial Registration

This study is registered with ClinicalTrials.gov, number NCT00917176 (June 10, 2009).

Tests of whole upright face processing in prosopagnosia: A literature review

Prosopagnosia refers to an acquired or developmental deficit in face recognition. This neuropsychological impairment has received increasing attention over the last decade, in particular because of an increased scientific interest in developmental prosopagnosia. Studies investigating prosopagnosia have used a variety of different clinical and experimental tests to assess face processing abilities. With such a large variety of assessment methods available, test selection can be challenging. Some previous works have aimed to provide an overview of tests used to diagnose prosopagnosia. However, no overview that is based on a structured review of the literature is available. We review the literature to identify tests that have been used to assess the processing of whole upright faces in acquired and developmental prosopagnosia over the last five years (2013-2017). We not only review tests that have been used for diagnostic purposes, but also tests that have been used for experimental purposes. Tests are categorised according to i) their experimental designs and, ii) the stage of face processing that they assess. On this basis, we discuss considerations regarding test designs for future studies. A visual illustration providing a structured overview of paradigms available for testing the processing of whole upright faces is provided. This visual illustration can be used to inform test selection when designing a study and to apply a structured approach to interpreting findings from the literature. The different approaches to assessment of face processing in prosopagnosia have been necessary and fruitful in generating data and hypotheses about the cause of face processing deficits. However, impairments at different levels of face processing have often been interpreted as reflecting a deficit in the recognition stage of face processing. Based on the data now available on prosopagnosia, we advocate for a more structured approach to assessment, which may facilitate a better understanding of the key deficits in prosopagnosia and of the level(s) of face processing that are impaired.

Hierarchical Brain Network for Face and Voice Integration of Emotion Expression

The brain has separate specialized computational units to process faces and voices located in occipital and temporal cortices. However, humans seamlessly integrate signals from the faces and voices of others for optimal social interaction. How are emotional expressions, when delivered by different sensory modalities (faces and voices), integrated in the brain? In this study, we characterized the brains’ response to faces, voices, and combined face–voice information (congruent, incongruent), which varied in expression (neutral, fearful). Using a whole-brain approach, we found that only the right posterior superior temporal sulcus (rpSTS) responded more to bimodal stimuli than to face or voice alone but only when the stimuli contained emotional expression. Face- and voice-selective regions of interest, extracted from independent functional localizers, similarly revealed multisensory integration in the face-selective rpSTS only; further, this was the only face-selective region that also responded significantly to voices. Dynamic causal modeling revealed that the rpSTS receives unidirectional information from the face-selective fusiform face area, and voice-selective temporal voice area, with emotional expression affecting the connection strength. Our study promotes a hierarchical model of face and voice integration, with convergence in the rpSTS, and that such integration depends on the (emotional) salience of the stimuli.

Diagnosing Prosopagnosia: The Utility of Visual Noise in the Cambridge Face Recognition Test

Adding visual noise to facial images has been used to increase reliance on configural processing. Whether this enhances the ability of tests to diagnose prosopagnosia is not known. We examined 15 subjects with developmental prosopagnosia, 13 subjects with acquired prosopagnosia, and 38 control subjects with the Cambridge Face Memory Test. We compared their performance on the second phase, without visual noise, and on the third phase, which adds visual noise. We analyzed the results with signal detection theory methods. The performance of controls worsened more than did that of prosopagnosic subjects when noise was added. The second phase showed better ability to discriminate between prosopagnosic and control subjects than did the third phase. For developmental prosopagnosia, a test using only the 48 trials of the first and second phases yielded sensitivity of 88% and specificity of 91% with a criterion of 33/48 correct, performance characteristics that are similar for a criterion of 43/72 for the whole test. We conclude that a shortened Cambridge Face Memory Test without the noisy images may be a quicker yet equally effective instrument for diagnosing prosopagnosia. The theoretical advantage of noisy images is outweighed by the poorer performance of control subjects with visual noise.

Faces, people and the brain: The 45th Sir Frederic Bartlett Lecture

The fact that the face is a source of diverse social signals allows us to use face and person perception as a model system for asking important psychological questions about how our brains are organised. A key issue concerns whether we rely primarily on some form of generic representation of the common physical source of these social signals (the face) to interpret them, or instead create multiple representations by assigning different aspects of the task to different specialist components. Variants of the specialist components hypothesis have formed the dominant theoretical perspective on face perception for more than three decades, but despite this dominance of formally and informally expressed theories, the underlying principles and extent of any division of labour remain uncertain. Here, I discuss three important sources of constraint: first, the evolved structure of the brain; second, the need to optimise responses to different everyday tasks; and third, the statistical structure of faces in the perceiver’s environment. I show how these constraints interact to determine the underlying functional organisation of face and person perception.

Face perception in pure alexia: Complementary contributions of the left fusiform gyrus to facial identity and facial speech processing

Recent concepts of cerebral visual processing predict from overlapping patterns of face and word activation in cortex that left fusiform lesions will not only cause pure alexia but also lead to mild impairments of face processing. Our goal was to determine if alexic subjects had deficits in facial identity processing similar to those seen after right fusiform lesions, or complementary deficits affecting different aspects of face processing. We studied four alexic patients whose lesions involved the left fusiform gyrus and one prosopagnosic subject with a right fusiform lesion, on standard tests of face perception and recognition. We evaluated their ability first to process faces in linear contour images, and second to detect, discriminate, identify and integrate facial speech patterns into perception. We found that all five patients were impaired in face matching across viewpoint, but the alexic subjects performed worse with line-drawn faces, while the prosopagnosic subject did not. Alexic subjects could detect facial speech patterns but had trouble identifying them and did not integrate facial speech patterns with speech sounds, whereas identification and integration was intact in the prosopagnosic subject. We conclude that, in addition to their role in reading, the left-sided regions damaged in alexic subjects participate in the perception of facial identity but in a non-redundant fashion, focusing on the information in linear contours at higher spatial frequencies. In addition they have a dominant role in processing facial speech patterns, another visual aspect of language processing.

Drawing a distinction between familiar and unfamiliar voice processing: A review of neuropsychological, clinical and empirical findings

Thirty years on from their initial observation that familiar voice recognition is not the same as unfamiliar voice discrimination (van Lancker and Kreiman, 1987), the current paper reviews available evidence in support of a distinction between familiar and unfamiliar voice processing. Here, an extensive review of the literature is provided, drawing on evidence from four domains of interest: the neuropsychological study of healthy individuals, neuropsychological investigation of brain-damaged individuals, the exploration of voice recognition deficits in less commonly studied clinical conditions, and finally empirical data from healthy individuals. All evidence is assessed in terms of its contribution to the question of interest - is familiar voice processing distinct from unfamiliar voice processing. In this regard, the evidence provides compelling support for van Lancker and Kreiman's early observation. Two considerations result: First, the limits of research based on one or other type of voice stimulus are more clearly appreciated. Second, given the demonstration of a distinction between unfamiliar and familiar voice processing, a new wave of research is encouraged which examines the transition involved as a voice is learned.

Executive Dysfunction in Obsessive-Compulsive Disorder and Anterior Cingulate-Based Resting State Functional Connectivity

OBJECTIVE

Executive dysfunction might be an important determinant for response to pharmacotherapy in obsessive-compulsive disorder (OCD), and could be sustained independently of symptom relief. The anterior cingulate cortex (ACC) has been indicated as a potential neural correlate of executive functioning in OCD. The present study examined the brain-executive function relationships in OCD from the ACC-based resting state functional connectivity networks (rs-FCNs), which reflect information processing mechanisms during task performance.

METHODS

For a total of 58 subjects [OCD, n=24; healthy controls (HCs), n=34], four subdomains of executive functioning were measured using the Rey-Osterrieth Complex Figure Test (RCFT), the Stroop Color-Word Test (SCWT), the Wisconsin Card Sorting Test (WCST), and the Trail Making Test part B (TMT-B). To probe for differential patterns of the brain-cognition relationship in OCD compared to HC, the ACC-centered rs-FCN were calculated using five seed regions systemically placed throughout the ACC.

RESULTS

Significant differences between the OCD group and the HCs with respect to the WCST perseverative errors, SCWT interference scores, and TMT-B reaction times (p<0.05) were observed. Moreover, significant interactions between diagnosis×dorsal ACC [S3]-based rs-FCN strength in the right dorsolateral prefrontal cortex for RCFT organization summary scores as well as between diagnosis×perigenual ACC [S7]-based rs-FCN strength in the left frontal eye field for SCWT color-word interference scores were unveiled.

CONCLUSION

These network-based neural foundations for executive dysfunction in OCD could become a potential target of future treatment, which could improve global domains of functioning broader than symptomatic relief.

Dynamic neural architecture for social knowledge retrieval

Social behavior is often shaped by the rich storehouse of biographical information that we hold for other people. In our daily life, we rapidly and flexibly retrieve a host of biographical details about individuals in our social network, which often guide our decisions as we navigate complex social interactions. Even abstract traits associated with an individual, such as their political affiliation, can cue a rich cascade of person-specific knowledge. Here, we asked whether the anterior temporal lobe (ATL) serves as a hub for a distributed neural circuit that represents person knowledge. Fifty participants across two studies learned biographical information about fictitious people in a 2-d training paradigm. On day 3, they retrieved this biographical information while undergoing an fMRI scan. A series of multivariate and connectivity analyses suggest that the ATL stores abstract person identity representations. Moreover, this region coordinates interactions with a distributed network to support the flexible retrieval of person attributes. Together, our results suggest that the ATL is a central hub for representing and retrieving person knowledge.

Perceptual Learning of Faces: A Rehabilitative Study of Acquired Prosopagnosia

Despite many studies of acquired prosopagnosia, there have been only a few attempts at its rehabilitation, all in single cases, with a variety of mnemonic or perceptual approaches, and of variable efficacy. In a cohort with acquired prosopagnosia, we evaluated a perceptual learning program that incorporated variations in view and expression, which was aimed at training perceptual stages of face processing with an emphasis on ecological validity. Ten patients undertook an 11-week face training program and an 11-week control task. Training required shape discrimination between morphed facial images, whose similarity was manipulated by a staircase procedure to keep training near a perceptual threshold. Training progressed from blocks of neutral faces in frontal view through increasing variations in view and expression. Whereas the control task did not change perception, training improved perceptual sensitivity for the trained faces and generalized to new untrained expressions and views of those faces. There was also a significant transfer to new faces. Benefits were maintained over a 3-month period. Training efficacy was greater for those with more perceptual deficits at baseline. We conclude that perceptual learning can lead to persistent improvements in face discrimination in acquired prosopagnosia. This reflects both acquisition of new skills that can be applied to new faces as well as a degree of overlearning of the stimulus set at the level of 3-D expression-invariant representations.

Prosopagnosia: current perspectives

Prosopagnosia is a selective visual agnosia characterized by the inability to recognize the identity of faces. There are both acquired forms secondary to brain damage and developmental forms without obvious structural lesions. In this review, we first discuss the diagnosis of acquired and developmental prosopagnosia, and the challenges present in the latter case. Second, we discuss the evidence regarding the selectivity of the prosopagnosic defect, particularly in relation to the recognition of other objects, written words (another visual object category requiring high expertise), and voices. Third, we summarize recent findings about the structural and functional basis of prosopagnosia from studies using magnetic resonance imaging, functional magnetic resonance imaging, and event-related potentials. Finally, we discuss recent attempts at rehabilitation of face recognition in prosopagnosia.

Impairments in the Face-Processing Network in Developmental Prosopagnosia and Semantic Dementia

BACKGROUND

Developmental prosopagnosia (DP) and semantic dementia (SD) may be the two most common neurologic disorders of face processing, but their main clinical and pathophysiologic differences have not been established. To identify those features, we compared patients with DP and SD.

METHODS

Five patients with DP, five with right temporal-predominant SD, and ten normal controls underwent cognitive, visual perceptual, and face-processing tasks.

RESULTS

Although the patients with SD were more cognitively impaired than those with DP, the two groups did not differ statistically on the visual perceptual tests. On the face-processing tasks, the DP group had difficulty with configural analysis and they reported relying on serial, feature-by-feature analysis or awareness of salient features to recognize faces. By contrast, the SD group had problems with person knowledge and made semantically related errors. The SD group had better face familiarity scores, suggesting a potentially useful clinical test for distinguishing SD from DP.

CONCLUSIONS

These two disorders of face processing represent clinically distinguishable disturbances along a right hemisphere face-processing network: DP, characterized by early configural agnosia for faces, and SD, characterized primarily by a multimodal person knowledge disorder. We discuss these preliminary findings in the context of the current literature on the face-processing network; recent studies suggest an additional right anterior temporal, unimodal face familiarity-memory deficit consistent with an "associative prosopagnosia."

Localization and patterns of Cerebral dyschromatopsia: A study of subjects with prospagnosia

OBJECTIVE

Cerebral dyschromatopsia is sometimes associated with acquired prosopagnosia. Given the variability in structural lesions that cause acquired prosopagnosia, this study aimed to investigate the structural correlates of prosopagnosia-associated dyschromatopsia, and to determine if such colour processing deficits could also accompany developmental prosopagnosia. In addition, we studied whether cerebral dyschromatopsia is typified by a consistent pattern of hue impairments.

METHODS

We investigated hue discrimination in a cohort of 12 subjects with acquired prosopagnosia and 9 with developmental prosopagnosia, along with 42 matched controls, using the Farnsworth-Munsell 100-hue test.

RESULTS

We found impaired hue discrimination in six subjects with acquired prosopagnosia, five with bilateral and one with a unilateral occipitotemporal lesion. Structural MRI analysis showed maximum overlap of lesions in the right and left lingual and fusiform gyri. Fourier analysis of their error scores showed tritanopic-like deficits and blue-green impairments, similar to tendencies displayed by the healthy controls. Three subjects also showed a novel fourth Fourier component, indicating additional peak deficits in purple and green-yellow regions. No subject with developmental prosopagnosia had impaired hue discrimination.

CONCLUSIONS

In our subjects with prosopagnosia, dyschromatopsia occurred in those with acquired lesions of the fusiform gyri, usually bilateral but sometimes unilateral. The dyschromatopsic deficit shows mainly an accentuation of normal tritatanopic-like tendencies. These are sometimes accompanied by additional deficits, although these could represent artifacts of the testing procedure.

Seeing the eyes in acquired prosopagnosia

Case reports have suggested that perception of the eye region may be impaired more than that of other facial regions in acquired prosopagnosia. However, it is unclear how frequently this occurs, whether such impairments are specific to a certain anatomic subtype of prosopagnosia, and whether these impairments are related to changes in the scanning of faces. We studied a large cohort of 11 subjects with this rare disorder, who had a variety of occipitotemporal or anterior temporal lesions, both unilateral and bilateral. Lesions were characterized by functional and structural imaging. Subjects performed a perceptual discrimination test in which they had to discriminate changes in feature position, shape, or external contour. Test conditions were manipulated to stress focused or divided attention across the whole face. In a second experiment we recorded eye movements while subjects performed a face memory task. We found that greater impairment for eye processing was more typical of subjects with occipitotemporal lesions than those with anterior temporal lesions. This eye selectivity was evident for both eye position and shape, with no evidence of an upper/lower difference for external contour. A greater impairment for eye processing was more apparent under attentionally more demanding conditions. Despite these perceptual deficits, most subjects showed a normal tendency to scan the eyes more than the mouth. We conclude that occipitotemporal lesions are associated with a partially selective processing loss for eye information and that this deficit may be linked to loss of the right fusiform face area, which has been shown to have activity patterns that emphasize the eye region.

Getting lost: Topographic skills in acquired and developmental prosopagnosia

Previous studies report that acquired prosopagnosia is frequently associated with topographic disorientation. Whether this is associated with a specific anatomic subtype of prosopagnosia, how frequently it is seen with the developmental variant, and what specific topographic function is impaired to account for this problem are not known. We studied ten subjects with acquired prosopagnosia from either occipitotemporal or anterior temporal (AT) lesions and seven with developmental prosopagnosia. Subjects were given a battery of topographic tests, including house and scene recognition, the road map test, a test of cognitive map formation, and a standardized self-report questionnaire. House and/or scene recognition were frequently impaired after either occipitotemporal or AT lesions in acquired prosopagnosia. Subjects with occipitotemporal lesions were also impaired in cognitive map formation: an overlap analysis identified right fusiform and parahippocampal gyri as a likely correlate. Only one subject with acquired prosopagnosia had mild difficulty with directional orientation on the road map test. Only one subject with developmental prosopagnosia had difficulty with cognitive map formation, and none were impaired on the other tests. Scores for house and scene recognition correlated most strongly with the results of the questionnaire. We conclude that topographic disorientation in acquired prosopagnosia reflects impaired place recognition, with a contribution from poor cognitive map formation when there is occipitotemporal damage. Topographic impairments are less frequent in developmental prosopagnosia.

Recognizing and identifying people: A neuropsychological review

Recognizing people is a classic example of a cognitive function that involves multiple processing stages and parallel routes of information. Neuropsychological data have provided important evidence for models of this process, particularly from case reports; however, the quality and extent of the data varies widely between studies. In this review we first discuss the requirements and logical basis of the types of neuropsychological evidence to support conclusions about the modules in this process. We then survey the adequacy of the current body of reports to address two key issues. First is the question of which cognitive operation generates a sense of familiarity: the current debate revolves around whether familiarity arises in modality-specific recognition units or later amodal processes. Key evidence on this point comes from the search for dissociations between familiarity for faces, voices and names. The second question is whether lesions can differentially affect the abilities to link diverse sources of person information (e.g., face, voice, name, biographic data). Dissociations of these linkages may favor a 'distributed-only' model of the organization of semantic knowledge, whereas a 'person-hub' model would predict uniform impairments of all linkages. While we conclude that there is reasonable evidence for dissociations in name, voice and face familiarity in regards to the first question, the evidence for or against dissociated linkages between information stores in regards to the second question is tenuous at best. We identify deficiencies in the current literature that should motivate and inform the design of future studies.

The processing of voice identity in developmental prosopagnosia

BACKGROUND

Developmental prosopagnosia is a disorder of face recognition that is believed to reflect impairments of visual mechanisms. However, voice recognition has rarely been evaluated in developmental prosopagnosia to clarify if it is modality-specific or part of a multi-modal person recognition syndrome.

OBJECTIVE

Our goal was to examine whether voice discrimination and/or recognition are impaired in subjects with developmental prosopagnosia.

DESIGN/METHODS

73 healthy controls and 12 subjects with developmental prosopagnosia performed a match-to-sample test of voice discrimination and a test of short-term voice familiarity, as well as a questionnaire about face and voice identification in daily life.

RESULTS

Eleven subjects with developmental prosopagnosia scored within the normal range for voice discrimination and voice recognition. One was impaired on discrimination and borderline for recognition, with equivalent scores for face and voice recognition, despite being unaware of voice processing problems.

CONCLUSIONS

Most subjects with developmental prosopagnosia are not impaired in short-term voice familiarity, providing evidence that developmental prosopagnosia is usually a modality-specific disorder of face recognition. However, there may be heterogeneity, with a minority having additional voice processing deficits. Objective tests of voice recognition should be integrated into the diagnostic evaluation of this disorder to distinguish it from a multi-modal person recognition syndrome.