Impaired perception of facial emotion in developmental prosopagnosia

Disentangling developmental prosopagnosia: A scoping review of terms, tools and topics

The goal of this preregistered scoping review is to create an overview of the research on developmental prosopagnosia (DP). Through analysis of all empirical studies of DP in adults, we investigate 1) how DP is conceptualized and defined, 2) how individuals are classified with DP and 3) which aspects of DP are investigated in the literature. We reviewed 224 peer-reviewed studies of DP. Our analysis of the literature reveals that while DP is predominantly defined as a lifelong face recognition impairment in the absence of acquired brain injury and intellectual/cognitive problems, there is far from consensus on the specifics of the definition with some studies emphasizing e.g., deficits in face perception, discrimination and/or matching as core characteristics of DP. These differences in DP definitions is further reflected in the vast heterogeneity in classification procedures. Only about half of the included studies explicitly state how they classify individuals with DP, and these studies adopt 40 different assessment tools. The two most frequently studied aspects of DP are the role of holistic processing and the specificity of face processing, and alongside a substantial body of neuroimaging studies of DP, this paints a picture of a research field whose scientific interests and aims are rooted in cognitive neuropsychology and neuroscience. We argue that these roots - alongside the heterogeneity in DP definition and classification - may have limited the scope and interest of DP research unnecessarily, and we point to new avenues of research for the field.

Binocular rivalry reveals differential face processing in congenital prosopagnosia

Congenital Prosopagnosia (CP) is an innate impairment in face perception with heterogeneous characteristics. It is still unclear if and to what degree holistic processing of faces is disrupted in CP. Such disruption would be expected to lead to a focus on local features of the face. In this study, we used binocular rivalry (BR) to implicitly measure face perception in conditions that favour holistic or local processing. The underlying assumption is that if stimulus saliency affects the perceptual dominance of a given stimulus in BR, one can deduce how salient a stimulus is for a given group (here: participants with and without CP) based on the measured perceptual dominance. A further open question is whether the deficit in face processing in CP extends to the processing of the facial display of emotions. In experiment 1, we compared predominance of upright and inverted faces displaying different emotions (fearful, happy, neutral) vs. houses between participants with CP (N = 21) and with normal face perception (N = 21). The results suggest that CP observers process emotions in faces automatically but rely more on local features than controls. The inversion of faces, which is supposed to disturb holistic processing, affected controls in a more pronounced way than participants with CP. In experiment 2, we introduced the Thatcher effect in BR by inverting the eye and mouth regions of the presented faces in the hope of further increasing the effect of face inversion. However, our expectations were not borne out by the results. Critically, both experiments showed that inversion effects were more pronounced in controls than in CP, suggesting that holistic face processing is less relevant in CP. We find BR to be a useful implicit test for assessing visual processing specificities in neurological participants.

Both identity and non-identity face perception tasks predict developmental prosopagnosia and face recognition ability

Developmental prosopagnosia (DP) is characterised by deficits in face identification. However, there is debate about whether these deficits are primarily perceptual, and whether they extend to other face processing tasks (e.g., identifying emotion, age, and gender; detecting faces in scenes). In this study, 30 participants with DP and 75 controls completed a battery of eight tasks assessing four domains of face perception (identity; emotion; age and gender; face detection). The DP group performed worse than the control group on both identity perception tasks, and one task from each other domain. Both identity perception tests uniquely predicted DP/control group membership, and performance on two measures of face memory. These findings suggest that deficits in DP may arise from issues with face perception. Some non-identity tasks also predicted DP/control group membership and face memory, even when face identity perception was accounted for. Gender perception and speed of face detection consistently predicted unique variance in group membership and face memory; several other tasks were only associated with some measures of face recognition ability. These findings indicate that face perception deficits in DP may extend beyond identity perception. However, the associations between tasks may also reflect subtle aspects of task demands or stimuli.

A new way of classifying developmental prosopagnosia: Balanced Integration Score

Despite severe everyday problems recognising faces, some individuals with developmental prosopagnosia (DP) can achieve typical accuracy scores on laboratory face recognition tests. To address this, studies sometimes also examine response times (RTs), which tend to be longer in DPs relative to control participants. In the present study, 24 potential (according to self-report) DPs and 110 age-matched controls completed the Cambridge Face and Bicycle Memory Tests, old new faces task, and a famous faces test. We used accuracy and the Balanced Integration Score (BIS), a measure that adjusts accuracy for RTs, to classify our sample at the group and individual levels. Subjective face recognition ability was assessed using the PI20 questionnaire and semi structured interviews. Fifteen DPs showed a major impairment using BIS compared with only five using accuracy alone. Logistic regression showed that a model incorporating the BIS measures was the most sensitive for classifying DP and showed highest area under the curve (AUC). Furthermore, larger between-group effect sizes were observed for a derived global (averaged) memory measure calculated using BIS versus accuracy alone. BIS is thus an extremely sensitive novel measure for attenuating speed-accuracy trade-offs that can otherwise mask impairment measured only by accuracy in DP.

Social Cognition and Mild Cognitive Impairment in Mid-Stage Parkinson's Disease

Mild cognitive impairment (MCI) is a relevant non-motor feature in Parkinson's disease (PD). Social cognition (SC) is a cognitive domain that refers to the ability to decode others' intentions and to guide behavior in social contexts. We aimed to compare SC performance in mid-stage PD patients compared to a healthy population and according to their cognitive state. Fifty-two PD patients were classified as being cognitively normal (PD-CN) or having mild cognitive impairment (PD-MCI) following the Movement Disorder Society (MDS) Level II criteria. SC assessment included facial emotion recognition (FER), affective and cognitive theory of mind (ToM), and self-monitoring (RSMS test). Twenty-seven age-matched healthy controls (HC) were enrolled. PD-MCI patients scored worse than HC on affective and cognitive ToM task scores. Only cognitive ToM scores were significantly lower when compared with the PD-MCI and PD-CN groups. We found no differences in FER or self-monitoring performance. There were significant correlations between cognitive ToM and executive functions, memory, language, and attention, whereas FER and affective ToM correlated with memory. Our findings indicates that SC is normal in cognitively unimpaired and non-depressed mid-stage PD patients, whereas a decline in affective and cognitive ToM is linked to the presence of MCI.

Familial Transmission of Developmental Prosopagnosia: New Case Reports from an Extended Family and Identical Twins

Existing evidence suggests that developmental prosopagnosia (DP) is a surprisingly prevalent condition, with some individuals describing lifelong difficulties with facial identity recognition. Together with case reports of multiple family members with the condition, this evidence suggests that DP is inherited in at least some instances. Here, we offer some novel case series that further support the heritability of the condition. First, we describe five adult siblings who presented to our lab with symptoms of DP. Second, for the first known time in the literature, we describe a pair of adult identical twins who contacted us in the belief that they both experience DP. The condition was confirmed in three of the five siblings (with minor symptoms observed in the remaining two) and in both twins. Supplementary assessments suggested that all individuals also experienced some degree of difficulty with facial identity perception, but that object recognition was preserved. These findings bolster the evidence supporting the heritability of DP and suggest that it can be a specific impairment in some cases.

Investigating the Influence of Autism Spectrum Traits on Face Processing Mechanisms in Developmental Prosopagnosia

Autism traits are common exclusionary criteria in developmental prosopagnosia (DP) studies. We investigated whether autism traits produce qualitatively different face processing in 43 DPs with high vs. low autism quotient (AQ) scores. Compared to controls (n = 27), face memory and perception were similarly deficient in the high- and low-AQ DPs, with the high-AQ DP group additionally showing deficient face emotion recognition. Task-based fMRI revealed reduced occipito-temporal face selectivity in both groups, with high-AQ DPs additionally demonstrating decreased posterior superior temporal sulcus selectivity. Resting-state fMRI showed similar reduced face-selective network connectivity in both DP groups compared with controls. Together, this demonstrates that high- and low-AQ DP groups have very similar face processing deficits, with additional facial emotion deficits in high-AQ DPs.

A new approach to diagnosing and researching developmental prosopagnosia: Excluded cases are impaired too

Developmental prosopagnosia is characterized by severe, lifelong difficulties when recognizing facial identity. Unfortunately, the most common diagnostic assessment (Cambridge Face Memory Test) misses 50-65% of individuals who believe that they have this condition. This results in such excluded cases' absence from scientific knowledge, effect sizes of impairment potentially overestimated, treatment efficacy underrated, and may elicit in them a negative experience of research. To estimate their symptomology and group-level impairments in face processing, we recruited a large cohort who believes that they have prosopagnosia. Matching prior reports, 56% did not meet criteria on the Cambridge Face Memory Test. However, the severity of their prosopagnosia symptoms and holistic perception deficits were comparable to those who did meet criteria. Excluded cases also exhibited face perception and memory impairments that were roughly one standard deviation below neurotypical norms, indicating the presence of objective problems. As the prosopagnosia index correctly classified virtually every case, we propose it should be the primary method for providing a diagnosis, prior to subtype categorization. We present researchers with a plan on how they can analyze these excluded prosopagnosia cases in their future work without negatively impacting their traditional findings. We anticipate such inclusion will enhance scientific knowledge, more accurately estimate effect sizes of impairments and treatments, and identify commonalities and distinctions between these different forms of prosopagnosia. Owing to their atypicalities in visual perception, we recommend that the prosopagnosia index should be used to screen out potential prosopagnosia cases from broader vision research.

Seeing emotions in the eyes: a validated test to study individual differences in the perception of basic emotions

People are able to perceive emotions in the eyes of others and can therefore see emotions when individuals wear face masks. Research has been hampered by the lack of a good test to measure basic emotions in the eyes. In two studies respectively with 358 and 200 participants, we developed a test to see anger, disgust, fear, happiness, sadness and surprise in images of eyes. Each emotion is measured with 8 stimuli (4 male actors and 4 female actors), matched in terms of difficulty and item discrimination. Participants reliably differed in their performance on the Seeing Emotions in the Eyes test (SEE-48). The test correlated well not only with Reading the Mind in the Eyes Test (RMET) but also with the Situational Test of Emotion Understanding (STEU), indicating that the SEE-48 not only measures low-level perceptual skills but also broader skills of emotion perception and emotional intelligence. The test is freely available for research and clinical purposes.

The development of upright face perception depends on evolved orientation-specific mechanisms and experience

Here we examine whether our impressive ability to perceive upright faces arises from evolved orientation-specific mechanisms, our extensive experience with upright faces, or both factors. To do so, we tested Claudio, a man with a congenital joint disorder causing his head to be rotated back so that it is positioned between his shoulder blades. As a result, Claudio has seen more faces reversed in orientation to his own face than matched to it. Controls exhibited large inversion effects on all tasks, but Claudio performed similarly with upright and inverted faces in both detection and identity-matching tasks, indicating these abilities are the product of evolved mechanisms and experience. In contrast, he showed clear upright superiority when detecting "Thatcherized" faces (faces with vertically flipped features), suggesting experience plays a greater role in this judgment. Together, these findings indicate that both evolved orientation-specific mechanisms and experience contribute to our proficiency with upright faces.

Dissociations between face identity and face expression processing in developmental prosopagnosia

Individuals with developmental prosopagnosia (DPs) experience severe and lifelong deficits recognising faces, but whether their deficits are selective to the processing of face identity or extend to the processing of face expression remains unclear. Clarifying this issue is important for understanding DP impairments and advancing theories of face processing. We compared identity and expression processing in a large sample of DPs (N = 124) using three different matching tasks that each assessed identity and expression processing with identical experimental formats. We ran each task in upright and inverted orientations and we measured inversion effects to assess the integrity of upright-specific face processes. We report three main results. First, DPs showed large deficits at discriminating identity but only subtle deficits at discriminating expression. Second, DPs showed a reduced inversion effect for identity but a normal inversion effect for expression. Third, DPs' performance on the expression tasks were linked to autism traits, but their performance on the identity tasks were not. These results constitute several dissociations between identity and expression processing in DP, and they are consistent with the view that the core impairment in DP is highly selective to identity.

Alcohol Use Predicts Face Perception Impairments and Difficulties in Face Recognition

Background: Risky alcohol use is related to a variety of cognitive impairments, including memory and visuo-perceptual difficulties. Remarkably, no prior work has assessed whether usage of alcohol can predict difficulties perceiving facial identity. Objectives: Therefore, this study aimed to investigate whether riskier alcohol consumption predicted impairments in face perception and self-reported difficulties in face recognition. Results: Participants (N = 239, male = 77) were over 18 years old and had normal or corrected-to-normal vision. Alcohol use was assessed using the Alcohol Use Disorder Identification Test (AUDIT), while face recognition difficulties were determined by the 20-item Prosopagnosia Index questionnaire (PI20). A subsample of participants (N = 126, male = 51) completed the Cambridge Face Perception task (CFPT) to assess their face perception ability. Multiple linear regressions showed significant models of prediction on both face perception and face recognition when considering AUDIT score and age as predictors. Conclusion: This study suggested, for the first time, that risky alcohol use predicts both poorer visuo-perceptual processing for faces and self-reported difficulties in face recognition.

What is the prevalence of developmental prosopagnosia? An empirical assessment of different diagnostic cutoffs

The prevalence of developmental prosopagnosia (DP), lifelong face recognition deficits, is widely reported to be 2-2.5%. However, DP has been diagnosed in different ways across studies, resulting in differing prevalence rates. In the current investigation, we estimated the range of DP prevalence by administering well-validated objective and subjective face recognition measures to an unselected web-based sample of 3116 18-55 year-olds and applying DP diagnostic cutoffs from the last 14 years. We found estimated prevalence rates ranged from .64-5.42% when using a z-score approach and .13-2.95% when using a percentile approach, with the most commonly used cutoffs by researchers having a prevalence rate of .93% (z-score, .45% when using percentiles). We next used multiple cluster analyses to examine whether there was a natural grouping of poorer face recognizers but failed to find consistent grouping beyond those with generally above versus below average face recognition. Lastly, we investigated whether DP studies with more relaxed diagnostic cutoffs were associated with better performance on the Cambridge Face Perception Test. In a sample of 43 studies, there was a weak nonsignificant association between greater diagnostic strictness and better DP face perception accuracy (Kendall's tau-b correlation, τb =.18 z-score; τb = .11 percentiles). Together, these results suggest that researchers have used more conservative DP diagnostic cutoffs than the widely reported 2-2.5% prevalence. We discuss the strengths and weaknesses of using more inclusive cutoffs, such as identifying mild and major forms of DP based on DSM-5.

The Danish Version of the 20-Item Prosopagnosia Index (PI20): Translation, Validation and a Link to Face Perception

Developmental prosopagnosia (DP) is a neurodevelopmental condition characterized by face recognition problems. Psychometrically sound self-report measures of face recognition problems are important tools in classification of DP. A widely used measure of such problems is the 20-item prosopagnosia index (PI20). Here, we present a Danish translation of the PI20 (PI20_DK). We administered the PI20_DK alongside three objective measures of face and object processing performance to 119 participants to validate the PI20_DK. Further, we assess the underlying factor structure of the PI20_DK. Finally, as the first study in the field, we investigate the association between self-reported face recognition ability and face perception performance. The project was preregistered prior to data collection. The results suggest excellent convergent validity, discriminant validity and internal consistency for the PI20_DK. A confirmatory factor analysis, however, indicates a suboptimal fit of the PI20_DK to a one factor solution. An investigation of the association between the PI20_DK and face perception suggests that the poor fit may reflect that the PI20_DK measures problems with face recognition in general and not specifically face memory problems.

Contextualising facial expressions: The effect of temporal context and individual differences on classification

The influence of context on facial expression classification is most often investigated using simple cues in static faces portraying basic expressions with a fixed emotional intensity. We examined (1) whether a perceptually rich, dynamic audiovisual context, presented in the form of movie clips (to achieve closer resemblance to real life), affected the subsequent classification of dynamic basic (happy) and non-basic (sarcastic) facial expressions and (2) whether people's susceptibility to contextual cues was related to their ability to classify facial expressions viewed in isolation. Participants classified facial expressions-gradually progressing from neutral to happy/sarcastic in increasing intensity-that followed movie clips. Classification was relatively more accurate and faster when the preceding context predicted the upcoming expression, compared with when the context did not. Speeded classifications suggested that predictive contexts reduced the emotional intensity required to be accurately classified. More importantly, we show for the first time that participants' accuracy in classifying expressions without an informative context correlated with the magnitude of the contextual effects experienced by them-poor classifiers of isolated expressions were more susceptible to a predictive context. Our findings support the emerging view that contextual cues and individual differences must be considered when explaining mechanisms underlying facial expression classification.

Face specific inversion effects provide evidence for two subtypes of developmental prosopagnosia

Many studies have attempted to identify the perceptual underpinnings of developmental prosopagnosia (DP). The majority have focused on whether holistic and configural processing mechanisms are impaired in DP. However, previous work suggests that there is substantial heterogeneity in holistic and configural processing within the DP population; further, there is disagreement as to whether any deficits are face-specific or reflect a broader perceptual deficit. This study used a data-driven approach to examine whether there are systematic patterns of variability in DP that reflect different underpinning perceptual deficits. A group of individuals with DP (N = 37) completed a cognitive battery measuring holistic/configural and featural processing in faces and non-face objects. A two-stage cluster analysis on data from the Cambridge Face Perception Test identified two subgroups of DPs. Across several tasks, the first subgroup (N = 21) showed typical patterns of holistic/configural processing (measured via inversion effects); the second (N = 16) was characterised by reduced or abolished inversion effects compared to age-matched control participants (N = 91). The subgroups did not differ on tasks measuring upright face matching, object matching, non-face holistic processing, or composite effects. These findings indicate two separable pathways to face recognition impairment, one characterised by impaired configural processing and the other potentially by impaired featural processing. Comparisons to control participants provide some preliminary evidence that the deficit in featural processing may extend to some non-face stimuli. Our results demonstrate the utility of examining both the variability between and consistency across individuals with DP as a means of illuminating our understanding of face recognition in typical and atypical populations.

New evidence of impaired expression recognition in developmental prosopagnosia

Developmental prosopagnosia (DP) is a neurodevelopmental condition characterized by lifelong face recognition difficulties. To date, it remains unclear whether or not individuals with DP experience impaired recognition of facial expressions. It has been proposed that DPs may have sufficient perceptual ability to correctly interpret facial expressions when tasks are relatively easy (e.g., the stimuli are unambiguous and viewing conditions are optimal), but exhibit subtle impairments when tested under more challenging conditions. In the present study, we sought to take advantage of the COVID-19 pandemic to test this view. It is well-established that the surgical-type masks worn during the pandemic hinder the recognition and interpretation of facial emotion in typical participants. Relative to typical participants, we hypothesized that DPs may be disproportionately impaired when asked to interpret the facial emotion of people wearing face masks. We compared the ability of 34 DPs and 60 age-matched typical controls to recognize facial emotions i) when the whole face is visible, and ii) when the lower portion of the face is covered with a surgical mask. When expression stimuli were viewed without a mask, the DPs and typical controls exhibited similar levels of performance. However, when expression stimuli were shown with a mask, the DPs showed signs of subtle expression recognition deficits. The DPs were particularly prone to mislabeling masked expressions of happiness as emotion neutral. These results add to a growing body of evidence that under some conditions, DPs do exhibit subtle deficits of expression recognition.

The Twenty Item Prosopagnosia Index (PI20) provides meaningful evidence of face recognition impairment

The Twenty Item Prosopagnosia Index (PI20) is a self-report questionnaire used for quantifying prosopagnosic traits. This scale is intended to help researchers identify cases of developmental prosopagnosia by providing standardized self-report evidence to complement diagnostic evidence obtained from objective computer-based tasks. In order to respond appropriately to items, prosopagnosics must have some insight that their face recognition is well below average, while non-prosopagnosics need to understand that their relative face recognition ability falls within the typical range. There has been considerable debate about whether participants have the necessary insight into their face recognition abilities to respond appropriately. In the present study, we sought to determine whether the PI20 provides meaningful evidence of face recognition impairment. In keeping with the intended use of the instrument, we used PI20 scores to identify two groups: high-PI20 scorers (those with self-reported face recognition difficulties) and low-PI20 scorers (those with no self-reported face recognition difficulties). We found that participant groups distinguished on the basis of PI20 scores clearly differed in terms of their mean performance on objective measures of face recognition ability. We also found that high-PI20 scorers were more likely to achieve levels of face recognition accuracy associated with developmental prosopagnosia.

Face processing predicts reading ability: Evidence from prosopagnosia

There is considerable interest in whether face and word processing are reliant upon shared or dissociable processes. Developmental prosopagnosia is associated with lifelong face processing deficits, with these cases providing strong support for a dissociation between face and word recognition in three recent papers (Burns et al., 2017; Rubino et al., 2016; Starrfelt et al., 2018). However, the sample sizes in each of these studies may have been too small to detect significant effects. We therefore combined their data to increase power and reassessed their results. While only a non-significant trend for reading impairments was found in prosopagnosia using a one-sample t-test, poorer face memory performance was correlated with slower reading speeds across prosopagnosia and control participants. Surprisingly, poorer face perception skills in prosopagnosia were associated with smaller word length effects. This suggests that while mild reading impairments exist in developmental prosopagnosia, there may be a trade-off between their residual face perception abilities and reading skill. A reanalysis of Hills and colleagues' (2015) acquired prosopagnosia data also revealed a positive relationship between words and faces: severe impairments in face recognition were related to poorer word processing. In summary, the developmental and acquired prosopagnosia literature supports models of visual perception that posit face and word processing are reliant upon broadly shared processes.

Why is the literature on first impressions so focused on White faces?

We spontaneously attribute to strangers a wide variety of character traits based on their facial appearance. While these first impressions have little or no basis in reality, they exert a strong influence over our behaviour. Cognitive scientists have revealed a great deal about first impressions from faces including their factor structure, the cues on which they are based, the neurocognitive mechanisms responsible, and their developmental trajectory. In this field, authors frequently strive to remove as much ethnic variability from stimulus sets as possible. Typically, this convention means that participants are asked to judge the likely traits of White faces only. In the present article, we consider four possible reasons for the lack of facial diversity in this literature and find that it is unjustified. Next, we illustrate how the focus on White faces has undermined scientific efforts to understand first impressions from faces and argue that it reinforces socially regressive ideas about 'race' and status. We go on to articulate our concern that opportunities may be lost to leverage the knowledge derived from the study of first impressions against the dire consequences of prejudice and discrimination. Finally, we highlight some promising developments in the field.

Normal colour perception in developmental prosopagnosia

Developmental prosopagnosia (DP) is a selective neurodevelopmental condition defined by lifelong impairments in face recognition. Despite much research, the extent to which DP is associated with broader visual deficits beyond face processing is unclear. Here we investigate whether DP is accompanied by deficits in colour perception. We tested a large sample of 92 DP individuals and 92 sex/age-matched controls using the well-validated Ishihara and Farnsworth–Munsell 100-Hue tests to assess red–green colour deficiencies and hue discrimination abilities. Group-level analyses show comparable performance between DP and control individuals across both tests, and single-case analyses indicate that the prevalence of colour deficits is low and comparable to that in the general population. Our study clarifies that DP is not linked to colour perception deficits and constrains theories of DP that seek to account for a larger range of visual deficits beyond face recognition.

The effect of face masks and sunglasses on identity and expression recognition with super-recognizers and typical observers

Face masks present a new challenge to face identification (here matching) and emotion recognition in Western cultures. Here, we present the results of three experiments that test the effect of masks, and also the effect of sunglasses (an occlusion that individuals tend to have more experienced with) on (i) familiar face matching, (ii) unfamiliar face matching and (iii) emotion categorization. Occlusion reduced accuracy in all three tasks, with most errors in the mask condition; however, there was little difference in performance for faces in masks compared with faces in sunglasses. Super-recognizers, people who are highly skilled at matching unconcealed faces, were impaired by occlusion, but at the group level, performed with higher accuracy than controls on all tasks. Results inform psychology theory with implications for everyday interactions, security and policing in a mask-wearing society.

Prosopagnosia and disorders of face processing

Face recognition is a form of expert visual processing. Acquired prosopagnosia is the loss of familiarity for facial identity and has several functional variants, namely apperceptive, amnestic, and associative forms. Acquired forms are usually caused by either occipitotemporal or anterior temporal lesions, right or bilateral in most cases. In addition, there is a developmental form, whose functional and structural origins are still being elucidated. Despite their difficulties with recognizing faces, some of these subjects still show signs of covert recognition, which may have a number of explanations. Other aspects of face perception can be spared in prosopagnosic subjects. Patients with other types of face processing difficulties have been described, including impaired expression processing, impaired lip-reading, false familiarity for faces, and a people-specific amnesia. Recent rehabilitative studies have shown some modest ability to improve face perception in prosopagnosic subjects through perceptual training protocols.

Normal recognition of famous voices in developmental prosopagnosia

Developmental prosopagnosia (DP) is a condition characterised by lifelong face recognition difficulties. Recent neuroimaging findings suggest that DP may be associated with aberrant structure and function in multimodal regions of cortex implicated in the processing of both facial and vocal identity. These findings suggest that both facial and vocal recognition may be impaired in DP. To test this possibility, we compared the performance of 22 DPs and a group of typical controls, on closely matched tasks that assessed famous face and famous voice recognition ability. As expected, the DPs showed severe impairment on the face recognition task, relative to typical controls. In contrast, however, the DPs and controls identified a similar number of voices. Despite evidence of interactions between facial and vocal processing, these findings suggest some degree of dissociation between the two processing pathways, whereby one can be impaired while the other develops typically. A possible explanation for this dissociation in DP could be that the deficit originates in the early perceptual encoding of face structure, rather than at later, post-perceptual stages of face identity processing, which may be more likely to involve interactions with other modalities.

Face individual identity recognition: a potential endophenotype in autism

BACKGROUND

Face individual identity recognition skill is heritable and independent of intellectual ability. Difficulties in face individual identity recognition are present in autistic individuals and their family members and are possibly linked to oxytocin polymorphisms in families with an autistic child. While it is reported that developmental prosopagnosia (i.e., impaired face identity recognition) occurs in 2-3% of the general population, no prosopagnosia prevalence estimate is available for autism. Furthermore, an autism within-group approach has not been reported towards characterizing impaired face memory and to investigate its possible links to social and communication difficulties.

METHODS

The present study estimated the prevalence of prosopagnosia in 80 autistic adults with no intellectual disability, investigated its cognitive characteristics and links to autism symptoms' severity, personality traits, and mental state understanding from the eye region by using standardized tests and questionnaires.

RESULTS

More than one third of autistic participants showed prosopagnosia. Their face memory skill was not associated with their symptom's severity, empathy, alexithymia, or general intelligence. Face identity recognition was instead linked to mental state recognition from the eye region only in autistic individuals who had prosopagnosia, and this relationship did not depend on participants' basic face perception skills. Importantly, we found that autistic participants were not aware of their face memory skills.

LIMITATIONS

We did not test an epidemiological sample, and additional work is necessary to establish whether these results generalize to the entire autism spectrum.

CONCLUSIONS

Impaired face individual identity recognition meets the criteria to be a potential endophenotype in autism. In the future, testing for face memory could be used to stratify autistic individuals into genetically meaningful subgroups and be translatable to autism animal models.

Developmental Prosopagnosia and Elastic Versus Static Face Recognition in an Incidental Learning Task

Previous research on the beneficial effect of motion has postulated that learning a face in motion provides additional cues to recognition. Surprisingly, however, few studies have examined the beneficial effect of motion in an incidental learning task and developmental prosopagnosia (DP) even though such studies could provide more valuable information about everyday face recognition compared to the perception of static faces. In the current study, 18 young adults (Experiment 1) and five DPs and 10 age-matched controls (Experiment 2) participated in an incidental learning task during which both static and elastically moving unfamiliar faces were sequentially presented and were to be recognized in a delayed visual search task during which the faces could either keep their original presentation or switch (from static to elastically moving or vice versa). In Experiment 1, performance in the elastic-elastic condition reached a significant improvement relative to the elastic-static and static-elastic condition, however, no significant difference could be detected relative to the static-static condition. Except for higher scores in the elastic-elastic compared to the static-elastic condition in the age-matched group, no other significant differences were detected between conditions for both the DPs and the age-matched controls. The current study could not provide compelling evidence for a general beneficial effect of motion. Age-matched controls performed generally worse than DPs, which may potentially be explained by their higher rates of false alarms. Factors that could have influenced the results are discussed.

Holistic processing of facial identity in developmental prosopagnosia

The nature of the perceptual deficit seen in developmental prosopagnosia remains poorly understood. One possibility is that these individuals experience face recognition difficulties because they fail to process faces holistically; they may be less able to analyze distal regions in parallel and therefore struggle to integrate information from different regions into a unified perceptual whole. Consequently, developmental prosopagnosics may be forced to base perceptual decisions on a slow, effortful piecemeal analysis of local facial features. In the present study, we sought to test this view by comparing the face recognition of developmental prosopagnosics and typical observers under two viewing conditions: when target faces were briefly presented in their entirety, and when they were inspected region-by-region through a dynamic aperture. If developmental prosopagnosics are forced to base perceptual decisions on information accumulated from a serial piecemeal analysis, one would expect little if any decrement in performance when target faces are viewed through apertures. Contrary to this prediction, however, developmental prosopagnosics showed strong aperture effects comparable with typical observers; their perceptual decisions were more accurate in the whole-face condition than when targets were viewed through the aperture. As expected, the developmental prosopagnosics were less accurate than typical controls when judging briefly presented faces shown in their entirety. Strikingly, however, they were also less able to accumulate perceptual evidence from a serial region-by-region analysis, than typical observers. Our results suggest that the perceptual problems seen in this population arise from imprecise descriptions of local regions, not aberrant holistic processing.

Attentional modulation differentially affects ventral and dorsal face areas in both normal participants and developmental prosopagnosics

Face-selective cortical areas that can be divided into a ventral stream and a dorsal stream. Previous findings indicate selective attention to particular aspects of faces have different effects on the two streams. To better understand the organization of the face network and whether deficits in attentional modulation contribute to developmental prosopagnosia (DP), we assessed the effect of selective attention to different face aspects across eight face-selective areas. Our results from normal participants found that ROIs in the ventral pathway (OFA, FFA) responded strongly when attention was directed to identity and expression, and ROIs in the dorsal pathway (pSTS-FA, IFG-FA) responded the most when attention was directed to facial expression. Response profiles generated by attention to different face aspects were comparable in DPs and normals. Our results demonstrate attentional modulation affects the ventral and dorsal steam face areas differently and indicate deficits in attentional modulation do not contribute to DP.

Atypical holistic processing of facial identity and expression in a case of acquired prosopagnosia

Typical face perception is mediated by holistic processing (i.e., the simultaneous integration of face parts into a whole representation). People with Acquired Prosopagnosia (AP), who have lost the ability to recognise faces after a brain lesion, should thus show atypical holistic coding. Our aim is to use the composite-face effect (CFE) as a measure of holistic processing in ST, a 48-year-old woman with AP but normal recognition of facial expressions of emotions, and matched healthy control participants. Two experiments examining the CFE for identity (Experiment 1) and for expression of emotions (Experiment 2) were conducted. Contrary to controls, in both experiments, ST showed an atypical (i.e., reversed) CFE, thus suggesting altered holistic mechanisms affecting both components of perceptual judgement. Results also suggest that normal facial expression recognition is achievable even with holistic processing difficulties, possibly through compensatory, part-based, mechanisms.

Search for Face Identity or Expression: Set Size Effects in Developmental Prosopagnosia

The set size effect during visual search indexes the effects of processing load and thus the efficiency of perceptual mechanisms. Our goal was to investigate whether individuals with developmental prosopagnosia show increased set size effects when searching faces for face identity and how this compares to search for face expression. We tested 29 healthy individuals and 13 individuals with developmental prosopagnosia. Participants were shown sets of three to seven faces to judge whether the identities or expressions of the faces were the same across all stimuli or if one differed. The set size effect was the slope of the linear regression between the number of faces in the array and the response time. Accuracy was similar in both controls and prosopagnosic participants. Developmental prosopagnosic participants displayed increased set size effects in face identity search but not in expression search. Single-participant analyses reveal that 11 developmental prosopagnosic participants showed a putative classical dissociation, with impairments in identity but not expression search. Signal detection theory analysis showed that identity set size effects were highly reliable in discriminating prosopagnosic participants from controls. Finally, the set size ratios of same to different trials were consistent with the predictions of self-terminated serial search models for control participants and prosopagnosic participants engaged in expression search but deviated from those predictions for identity search by the prosopagnosic cohort. We conclude that the face set size effect reveals a highly prevalent and selective perceptual inefficiency for processing face identity in developmental prosopagnosia.

The discrimination of facial sex in developmental prosopagnosia

Developmental prosopagnosia (DP) is a neurodevelopmental condition characterised by difficulties recognising and discriminating faces. It is currently unclear whether the perceptual impairments seen in DP are restricted to identity information, or also affect the perception of other facial characteristics. To address this question, we compared the performance of 17 DPs and matched controls on two sensitive sex categorisation tasks. First, in a morph categorisation task, participants made binary decisions about faces drawn from a morph continuum that blended incrementally an average male face and an average female face. We found that judgement precision was significantly lower in the DPs than in the typical controls. Second, we used a sex discrimination task, where female or male facial identities were blended with an androgynous average face. We manipulated the relative weighting of each facial identity and the androgynous average to create four levels of signal strength. We found that DPs were significantly less sensitive than controls at each level of difficulty. Together, these results suggest that the visual processing difficulties in DP extend beyond the extraction of facial identity and affects the extraction of other facial characteristics. Deficits of facial sex categorisation accord with an apperceptive characterisation of DP.

No effect of age on emotion recognition after accounting for cognitive factors and depression

A decline in emotion recognition ability across the lifespan has been well documented. However, whether age predicts emotion recognition difficulties after accounting for potentially confounding factors which covary with age remains unclear. Although previous research suggested that age-related decline in emotion recognition ability may be partly a consequence of cognitive (fluid intelligence, processing speed) and affective (e.g., depression) factors, recent theories highlight a potential role for alexithymia (difficulty identifying and describing one’s emotions) and interoception (perception of the body’s internal state). This study therefore aimed to examine the recognition of anger and disgust across the adult lifespan in a group of 140 20–90-year-olds to see whether an effect of age would remain after controlling for a number of cognitive and affective factors potentially impacted by age. In addition, using an identity recognition control task, the study aimed to determine whether the factors accounting for the effects of age on emotion discrimination also contribute towards generalised face processing difficulties. Results revealed that discrimination of disgust and anger across the lifespan was predicted by processing speed and fluid intelligence, and negatively by depression. No effect of age was found after these factors were accounted for. Importantly, these effects were specific to emotion discrimination; only crystallised intelligence accounted for unique variance in identity discrimination. Contrary to expectations, although interoception and alexithymia were correlated with emotion discrimination abilities, these factors did not explain unique variance after accounting for other variables.

Does developmental prosopagnosia impair identification of other-ethnicity faces?

Current approaches to the diagnosis of developmental prosopagnosia emphasise the perception and identification of same-ethnicity faces. This convention ensures that perceptual impairment arising from developmental prosopagnosia can be distinguished from problems arising from a lack of visual experience with particular facial ethnicities - the so-called 'Other-Ethnicity Effect'. The present study sought to determine whether the perceptual difficulties seen in developmental prosopagnosia - diagnosed using same-ethnicity faces - extend to other-ethnicity faces. First, we sought to determine whether a group of Caucasian developmental prosopagnosics (N = 15) and typical Caucasian controls (N = 30) had similar experience with same- and other-ethnicity faces during development. All participants therefore completed a contact questionnaire that enquired about their experience of Caucasian, Black, and East Asian faces, at different developmental stages. Importantly, the two groups described very similar levels of visual experience with other-ethnicity faces. Second, we administered a sequential matching task to measure participants' ability to discriminate same- (Caucasian) and other-ethnicity (Black, East Asian) faces. Relative to the experience-matched controls, the prosopagnosics were less accurate at discriminating both same- and other-ethnicity faces, and we found no evidence of disproportionate impairment for same-ethnicity faces. Given that the prosopagnosics and controls had similar opportunity to develop visual expertise for other-ethnicity faces, these results indicate that developmental prosopagnosia impairs recognition of both same- and other-ethnicity faces. The fact that developmental prosopagnosia affects the perception of both same- and other-ethnicity faces suggests that different facial ethnicities engage similar visual processing mechanisms. Our findings support the view that susceptibility to developmental prosopagnosia, and a lack of contact with other-ethnicity faces, contribute independently to the poor recognition of other-ethnicity faces.

Object recognition in acquired and developmental prosopagnosia

Whether face and object recognition are dissociated in prosopagnosia continues to be debated: a recent review highlighted deficiencies in prior studies regarding the evidence for such a dissociation. Our goal was to study cohorts with acquired and developmental prosopagnosia with a complementary battery of tests of object recognition that address prior limitations, as well as evaluating for residual effects of object expertise. We studied 15 subjects with acquired and 12 subjects with developmental prosopagnosia on three tests: the Old/New Tests, the Cambridge Bicycle Memory Test, and the Expertise-adjusted Test of Car Recognition. Most subjects with developmental prosopagnosia were normal on the Old/New Tests: for acquired prosopagnosia, subjects with occipitotemporal lesions often showed impairments while those with anterior temporal lesions did not. Ten subjects showed a putative classical dissociation between the Cambridge Face and Bicycle Memory Tests, seven of whom had normal reaction times. Both developmental and acquired groups showed reduced car recognition on the expertise-adjusted test, though residual effects of expertise were still evident. Two subjects with developmental prosopagnosia met criteria for normal object recognition across all tests. We conclude that strong evidence for intact object recognition can be found in a few subjects but the majority show deficits, particularly those with the acquired form. Both acquired and developmental forms show residual but reduced object expertise effects.

Tests of whole upright face processing in prosopagnosia: A literature review

Prosopagnosia refers to an acquired or developmental deficit in face recognition. This neuropsychological impairment has received increasing attention over the last decade, in particular because of an increased scientific interest in developmental prosopagnosia. Studies investigating prosopagnosia have used a variety of different clinical and experimental tests to assess face processing abilities. With such a large variety of assessment methods available, test selection can be challenging. Some previous works have aimed to provide an overview of tests used to diagnose prosopagnosia. However, no overview that is based on a structured review of the literature is available. We review the literature to identify tests that have been used to assess the processing of whole upright faces in acquired and developmental prosopagnosia over the last five years (2013-2017). We not only review tests that have been used for diagnostic purposes, but also tests that have been used for experimental purposes. Tests are categorised according to i) their experimental designs and, ii) the stage of face processing that they assess. On this basis, we discuss considerations regarding test designs for future studies. A visual illustration providing a structured overview of paradigms available for testing the processing of whole upright faces is provided. This visual illustration can be used to inform test selection when designing a study and to apply a structured approach to interpreting findings from the literature. The different approaches to assessment of face processing in prosopagnosia have been necessary and fruitful in generating data and hypotheses about the cause of face processing deficits. However, impairments at different levels of face processing have often been interpreted as reflecting a deficit in the recognition stage of face processing. Based on the data now available on prosopagnosia, we advocate for a more structured approach to assessment, which may facilitate a better understanding of the key deficits in prosopagnosia and of the level(s) of face processing that are impaired.

Measuring facial identity and emotion integration using the redundancy gain paradigm

Early theories on face perception posit that invariant (i.e., identity) and changeable (i.e., expression) facial aspects are processed separately. However, many researchers have countered the hypothesis of parallel processes with findings of interactions between identity and emotion perception. The majority of tasks measuring interactions between identity and emotion employ a selective attention design, in which participants are instructed to attend to one dimension (e.g., identity) while the other dimension varies orthogonally (e.g., emotion), but is task irrelevant. Recently, a divided attention design (i.e., the redundancy gain paradigm) in which both identity and emotion are task relevant was employed to assess the interaction between identity and emotion. A redundancy gain is calculated by a drop in reaction time in trials in which a target from both dimensions is present in the stimulus face (e.g., “sad Person A”), compared with trials with only a single target present (e.g., “sad” or “Person A”). Redundancy gains are hypothesized to point to an interactive activation of both dimensions, and as such, could complement designs adopting a selective attention task. The initial aim of the current study was to reproduce the earlier findings with this paradigm on identity and emotion perception (Yankouskaya, Booth, & Humphreys, Attention, Perception, & Psychophysics, 74(8), 1692–1711, 2012), but our study failed to replicate the results. In a series of subtasks, multiple aspects of the design were manipulated separately in our goal to shed light on the factors that influence the redundancy gain effect in faces. A redundancy gain was eventually obtained after controlling for contingencies and stimulus presentation time.

Anterior Temporal Lobectomy Impairs Neural Classification of Body Emotions in Right Superior Temporal Sulcus and Reduces Emotional Enhancement in Distributed Brain Areas without Affecting Behavioral Classification

Humans with amygdalar lesions show proportional reductions of the emotional response to facial expressions in the fusiform face area as well as deficits in emotion recognition from facial expressions. While processing of bodily expressions shares many similarities with facial expressions, there is no substantial evidence that lesions of the amygdala result in similar behavioral and neural sequelae. We combined behavioral assessment with functional neuroimaging in a group of male and female humans with unilateral anterior temporal lobe (ATL) resections, including the amygdala (right: n = 10; left: n = 10) and 12 matched controls. The objective was to assess whether the amygdala is crucial for the recognition of body expressions and for modulatory effects on distant areas during perception of body expressions. The behavioral results revealed normal performance in both patient groups on emotion categorization of body expressions. The neuroimaging results showed that ATL patients displayed no enhanced activations in right fusiform body area and left extrastriate body area and that left ATL patients additionally displayed no enhanced activations in right posterior superior temporal sulcus and right extrastriate body area, respectively. Multivoxel pattern analysis revealed altered categorization capacity between emotional and neutral stimuli in right posterior superior temporal sulcus in right ATL patients. In addition, we also found emotional enhancement in frontal, parietal, occipital, and cingulate regions in controls. Together, our data show that the amygdala and ATLs are not necessary for recognition of dynamic body expressions, but suggest that amygdala lesions affect body emotion processing in distant brain areas.SIGNIFICANCE STATEMENT For humans, information from emotional expressions of others is crucial to support social interactions. The majority of emotion studies has focused on facial expressions; however, in daily life, we also use information from body postures and body movement. Visual processing of body expressions relies on a brain network, including body-specific visual areas and visuomotor areas. Even though the importance of the amygdala and its modulatory effects on distant brain regions have been documented, it remains unclear whether the amygdala plays a crucial role in emotional body processing. By combining behavioral and neuroimaging data in patients with amygdalar lesions, we provide further evidence for its modulatory effect on distant areas during the perception of body expressions.

Ensemble coding of face identity is present but weaker in congenital prosopagnosia

Individuals with congenital prosopagnosia (CP) are impaired at identifying individual faces but do not appear to show impairments in extracting the average identity from a group of faces (known as ensemble coding). However, possible deficits in ensemble coding in a previous study (CPs n = 4) may have been masked because CPs relied on pictorial (image) cues rather than identity cues. Here we asked whether a larger sample of CPs (n = 11) would show intact ensemble coding of identity when availability of image cues was minimised. Participants viewed a "set" of four faces and then judged whether a subsequent individual test face, either an exemplar or a "set average", was in the preceding set. Ensemble coding occurred when matching (vs. mismatching) averages were mistakenly endorsed as set members. We assessed both image- and identity-based ensemble coding, by varying whether test faces were either the same or different images of the identities in the set. CPs showed significant ensemble coding in both tasks, indicating that their performance was independent of image cues. As a group, CPs' ensemble coding was weaker than controls in both tasks, consistent with evidence that perceptual processing of face identity is disrupted in CP. This effect was driven by CPs (n= 3) who, in addition to having impaired face memory, also performed particularly poorly on a measure of face perception (CFPT). Future research, using larger samples, should examine whether deficits in ensemble coding may be restricted to CPs who also have substantial face perception deficits.