Super-recognizers: From the lab to the world and back again

Improving the DSM-5 approach to cognitive impairment: Developmental prosopagnosia reveals the need for tailored diagnoses

The Diagnostic Statistical Manual of Mental Disorders (DSM-5) recommends diagnosing neurocognitive disorders (i.e., cognitive impairment) when a patient scores beyond - 1 SD below neurotypical norms on two tests. I review how this approach will fail due to cognitive tests' power limitations, validity issues, imperfect reliabilities, and biases, before summarizing their resulting negative consequences. As a proof of concept, I use developmental prosopagnosia, a condition characterized by difficulties recognizing faces, to show the DSM-5 only diagnoses 62-70% (n1 = 61, n2 = 165) versus 100% (n1 = 61) through symptoms alone. Pooling the DSM-5 missed cases confirmed the presence of group-level impairments on objective tests, which were further evidenced through meta-analyses, thus validating their highly atypical symptoms. These findings support a paradigm shift towards bespoke diagnostic approaches for distinct cognitive impairments, including a symptom-based method when validated effective. I reject dogmatic adherence to the DSM-5 approach to neurocognitive disorders, and underscore the importance of a data driven, transdiagnostic approach to understanding patients' subjective cognitive impairments. This will ultimately benefit patients, their families, clinicians, and scientific progress.

Investigating people's metacognitive insight into their own face abilities

Within the domain of face processing, researchers have been interested in quantifying the relationship between objective (i.e., performance on laboratory tests of recognition and matching) and subjective measures of ability (typically, self-report questionnaires). Put simply, do people show high levels of metacognitive insight into their own abilities with faces? Although several studies have suggested that the association between these two types of measures may only be moderate, there remain several important issues that require consideration before this question can be sensibly investigated. First, specificity is needed regarding both objective and subjective measurements because both tend to span a wide range of potentially separable abilities. Second, experimental tasks appear to focus on different contexts to those tapped in self-report questionnaire items. Third, recent issues with statistical approaches and visualisation can result in numerical artefacts and misinterpretations. Finally, the sizes of population-level insights suggested by recent work provide only limited information regarding individuals within these populations, and so researchers aiming to identify people at the extremes of ability must be careful when drawing conclusions. Taken together, we argue that more attention to these issues is needed when attempting to investigate metacognitive insight within this domain.

Super recognizers: Increased sensitivity or reduced biases? Insights from serial dependence

Super recognizers (SRs) are people that exhibit a naturally occurring superiority for processing facial identity. Despite the increase of SR research, the mechanisms underlying their exceptional abilities remain unclear. Here, we investigated whether the enhanced facial identity processing of SRs could be attributed to the lack of sequential effects, such as serial dependence. In serial dependence, perception of stimulus features is assimilated toward stimuli presented in previous trials. This constant error in visual perception has been proposed as a mechanism that promotes perceptual stability in everyday life. We hypothesized that an absence of this constant source of error in SRs could account for their superior processing-potentially in a domain-general fashion. We tested SRs (n = 17) identified via a recently proposed diagnostic framework (Ramon, 2021) and age-matched controls (n = 20) with two experiments probing serial dependence in the face and shape domains. In each experiment, observers were presented with randomly morphed face identities or shapes and were asked to adjust a face's identity or a shape to match the stimulus they saw. We found serial dependence in controls and SRs alike, with no difference in its magnitude across groups. Interestingly, we found that serial dependence impacted the performance of SRs more than that of controls. Taken together, our results show that enhanced face identity processing skills in SRs cannot be attributed to the lack of serial dependence. Rather, serial dependence, a beneficial nested error in our visual system, may in fact further stabilize the perception of SRs and thus enhance their visual processing proficiency.

Face identification proficiency test designed using item response theory

Measures of face-identification proficiency are essential to ensure accurate and consistent performance by professional forensic face examiners and others who perform face-identification tasks in applied scenarios. Current proficiency tests rely on static sets of stimulus items and so cannot be administered validly to the same individual multiple times. To create a proficiency test, a large number of items of "known" difficulty must be assembled. Multiple tests of equal difficulty can be constructed then using subsets of items. We introduce the Triad Identity Matching (TIM) test and evaluate it using item response theory (IRT). Participants view face-image "triads" (N = 225) (two images of one identity, one image of a different identity) and select the different identity. In Experiment 3, university students (N = 197) showed wide-ranging accuracy on the TIM test, and IRT modeling demonstrated that the TIM items span various difficulty levels. In Experiment 3, we used IRT-based item metrics to partition the test into subsets of specific difficulties. Simulations showed that subsets of the TIM items yielded reliable estimates of subject ability. In Experiments 3a and b, we found that the student-derived IRT model reliably evaluated the ability of non-student participants and that ability generalized across different test sessions. In Experiment 3c, we show that TIM test performance correlates with other common face-recognition tests. In summary, the TIM test provides a starting point for developing a framework that is flexible and calibrated to measure proficiency across various ability levels (e.g., professionals or populations with face-processing deficits).

Determinants of Face Recognition: The Role of Target Prevalence and Similarity

Studies of facial identity processing typically assess perception (via matching) and/or memory (via recognition), with experimental designs differing with respect to one important aspect: Target Prevalence. Some designs include "target absent" (TA) among "target present" (TP) trials. In visual search tasks, TA trials shift an observer's decisional criterion towards a stricter one, increasing misses. However, decisional biases will differ between individuals and across an individual's decisions as well. In this way, excluding TA trials ensures comparable levels of expectation and thus a more controlled decisional bias both within and between observers by not considering correct rejections and false alarms. However, TA trials may occur, e.g., in police line-ups, where it is important to consider observers' face recognition ability net of the potential biases introduced by TA and TP trials. And, while these have been investigated in numerous other stimulus domains, their effects have not yet been extended to face recognition. We therefore sought to fill this void by testing different versions of the previously established Models Memory Test, which measures old/new recognition of experimentally learned facial identities. Our study found significant expectation effects, driven by target prevalence that persist even given prevalence changes. This implies that face recognition - even measured with naturalistic changes - is influenced by prior perceptual decisions.

AI Hyperrealism: Why AI Faces Are Perceived as More Real Than Human Ones

Recent evidence shows that AI-generated faces are now indistinguishable from human faces. However, algorithms are trained disproportionately on White faces, and thus White AI faces may appear especially realistic. In Experiment 1 (N = 124 adults), alongside our reanalysis of previously published data, we showed that White AI faces are judged as human more often than actual human faces-a phenomenon we term AI hyperrealism. Paradoxically, people who made the most errors in this task were the most confident (a Dunning-Kruger effect). In Experiment 2 (N = 610 adults), we used face-space theory and participant qualitative reports to identify key facial attributes that distinguish AI from human faces but were misinterpreted by participants, leading to AI hyperrealism. However, the attributes permitted high accuracy using machine learning. These findings illustrate how psychological theory can inform understanding of AI outputs and provide direction for debiasing AI algorithms, thereby promoting the ethical use of AI.

A new approach to diagnosing and researching developmental prosopagnosia: Excluded cases are impaired too

Developmental prosopagnosia is characterized by severe, lifelong difficulties when recognizing facial identity. Unfortunately, the most common diagnostic assessment (Cambridge Face Memory Test) misses 50-65% of individuals who believe that they have this condition. This results in such excluded cases' absence from scientific knowledge, effect sizes of impairment potentially overestimated, treatment efficacy underrated, and may elicit in them a negative experience of research. To estimate their symptomology and group-level impairments in face processing, we recruited a large cohort who believes that they have prosopagnosia. Matching prior reports, 56% did not meet criteria on the Cambridge Face Memory Test. However, the severity of their prosopagnosia symptoms and holistic perception deficits were comparable to those who did meet criteria. Excluded cases also exhibited face perception and memory impairments that were roughly one standard deviation below neurotypical norms, indicating the presence of objective problems. As the prosopagnosia index correctly classified virtually every case, we propose it should be the primary method for providing a diagnosis, prior to subtype categorization. We present researchers with a plan on how they can analyze these excluded prosopagnosia cases in their future work without negatively impacting their traditional findings. We anticipate such inclusion will enhance scientific knowledge, more accurately estimate effect sizes of impairments and treatments, and identify commonalities and distinctions between these different forms of prosopagnosia. Owing to their atypicalities in visual perception, we recommend that the prosopagnosia index should be used to screen out potential prosopagnosia cases from broader vision research.

Differences between high and low performers in face recognition in electrophysiological correlates of face familiarity and distance-to-norm

Valentine's influential norm-based multidimensional face-space model (nMDFS) predicts that perceived distinctiveness of a face increases with its distance to the norm. Occipito-temporal event-related potentials (ERPs) have been recently shown to respond selectively to variations in distance-to-norm (P200) or familiarity (N250, late negativity), respectively (Wuttke & Schweinberger, 2019). Despite growing evidence on interindividual differences in face perception skills at the behavioral level, little research has focused on their electrophysiological correlates. To reveal potential interindividual differences in face spaces, we contrasted high and low performers in face recognition in regards to distance-to-norm (P200) and familiarity (N250). We replicated both the P200 distance-to-norm and the N250 familiarity effect. Importantly, we observed: i) reduced responses in low compared to high performers of face recognition, especially in terms of smaller distance-to-norm effects in the P200, possibly indicating less 'expanded' face spaces in low compared to high performers; ii) increased N250 responses to familiar original faces in high performers, suggesting more robust face identity representations. In summary, these findings suggest the contribution of both early norm-based face coding and robust face representations to individual face recognition skills, and indicate that ERPs can offer a promising route to understand individual differences in face perception and their neurocognitive correlates.

Diverse types of expertise in facial recognition

Facial recognition errors can jeopardize national security, criminal justice, public safety and civil rights. Here, we compare the most accurate humans and facial recognition technology in a detailed lab-based evaluation and international proficiency test for forensic scientists involving 27 forensic departments from 14 countries. We find striking cognitive and perceptual diversity between naturally skilled super-recognizers, trained forensic examiners and deep neural networks, despite them achieving equivalent accuracy. Clear differences emerged in super-recognizers' and forensic examiners' perceptual processing, errors, and response patterns: super-recognizers were fast, biased to respond 'same person' and misidentified people with extreme confidence, whereas forensic examiners were slow, unbiased and strategically avoided misidentification errors. Further, these human experts and deep neural networks disagreed on the similarity of faces, pointing to differences in their representations of faces. Our findings therefore reveal multiple types of facial recognition expertise, with each type lending itself to particular facial recognition roles in operational settings. Finally, we show that harnessing the diversity between individual experts provides a robust method of maximizing facial recognition accuracy. This can be achieved either via collaboration between experts in forensic laboratories, or most promisingly, by statistical fusion of match scores provided by different types of expert.

Selecting police super-recognisers

People vary in their ability to recognise faces. These individual differences are consistent over time, heritable and associated with brain anatomy. This implies that face identity processing can be improved in applied settings by selecting high performers-'super-recognisers' (SRs)-but these selection processes are rarely available for scientific scrutiny. Here we report an 'end-to-end' selection process used to establish an SR 'unit' in a large police force. Australian police officers (n = 1600) completed 3 standardised face identification tests and we recruited 38 SRs from this cohort to complete 10 follow-up tests. As a group, SRs were 20% better than controls in lab-based tests of face memory and matching, and equalled or surpassed accuracy of forensic specialists that currently perform face identification tasks for police. Individually, SR accuracy was variable but this problem was mitigated by adopting strict selection criteria. SRs' superior abilities transferred only partially to body identity decisions where the face was not visible, and they were no better than controls at deciding which visual scene that faces had initially been encountered in. Notwithstanding these important qualifications, we conclude that super-recognisers are an effective solution to improving face identity processing in applied settings.

Improving forensic perpetrator identification with Super-Recognizers

About a decade ago, Super-Recognizers (SRs) were first described as individuals with exceptional face identity processing abilities. Since then, various tests have been developed or adapted to assess individuals' abilities and identify SRs. The extant literature suggests that SRs may be beneficial in police tasks requiring individual identification. However, in reality, the performance of SRs has never been examined using authentic forensic material. This not only limits the external validity of test procedures used to identify SRs, but also claims concerning their deployment in policing. Here, we report the first-ever investigation of SRs' ability to identify perpetrators using authentic case material. We report the data of 73 SRs and 45 control participants. These include (a) performance on three challenging tests of face identity processing recommended by Ramon (2021) for SR identification; (b) performance for perpetrator identification using four CCTV sequences depicting five perpetrators and police line-ups created for criminal investigation purposes. Our findings demonstrate that the face identity processing tests used here are valid in measuring such abilities and identifying SRs. Moreover, SRs excel at perpetrator identification relative to control participants, with more correct perpetrator identifications, the better their performance across lab tests. These results provide external validity for the recently proposed diagnostic framework and its tests used for SR identification (Ramon, 2021). This study provides the first empirical evidence that SRs identified using these measures can be beneficial for forensic perpetrator identification. We discuss theoretical and practical implications for law enforcement, whose procedures can be improved via a human-centric approach centered around individuals with superior abilities.

Stable individual differences in unfamiliar face identification: Evidence from simultaneous and sequential matching tasks

Matching identity in images of unfamiliar faces is difficult: Images of the same person can look different and images of different people can look similar. Recent studies have capitalized on individual differences in the ability to distinguish match (same ID) vs. mismatch (different IDs) face pairs to inform models of face recognition. We addressed two significant gaps in the literature by examining the stability of individual differences in both sensitivity to identity and response bias. In Study 1, 210 participants completed a battery of four tasks in each of two sessions separated by one week. Tasks varied in protocol (same/different, lineup, sorting) and stimulus characteristics (low vs. high within-person variability in appearance). In Study 2, 148 participants completed a battery of three tasks in a single session. Stimuli were presented simultaneously on some trials and sequentially on others, introducing short-term memory demands. Principal components analysis revealed two components that were stable across time and tasks: sensitivity to identity and bias. Analyses of response times suggest that individual differences in bias reflect decision-making processes. We discuss the implications of our findings in applied settings and for models of face recognition.

Intracerebral Electrophysiological Recordings to Understand the Neural Basis of Human Face Recognition

Understanding how the human brain recognizes faces is a primary scientific goal in cognitive neuroscience. Given the limitations of the monkey model of human face recognition, a key approach in this endeavor is the recording of electrophysiological activity with electrodes implanted inside the brain of human epileptic patients. However, this approach faces a number of challenges that must be overcome for meaningful scientific knowledge to emerge. Here we synthesize a 10 year research program combining the recording of intracerebral activity (StereoElectroEncephaloGraphy, SEEG) in the ventral occipito-temporal cortex (VOTC) of large samples of participants and fast periodic visual stimulation (FPVS), to objectively define, quantify, and characterize the neural basis of human face recognition. These large-scale studies reconcile the wide distribution of neural face recognition activity with its (right) hemispheric and regional specialization and extend face-selectivity to anterior regions of the VOTC, including the ventral anterior temporal lobe (VATL) typically affected by magnetic susceptibility artifacts in functional magnetic resonance imaging (fMRI). Clear spatial dissociations in category-selectivity between faces and other meaningful stimuli such as landmarks (houses, medial VOTC regions) or written words (left lateralized VOTC) are found, confirming and extending neuroimaging observations while supporting the validity of the clinical population tested to inform about normal brain function. The recognition of face identity - arguably the ultimate form of recognition for the human brain - beyond mere differences in physical features is essentially supported by selective populations of neurons in the right inferior occipital gyrus and the lateral portion of the middle and anterior fusiform gyrus. In addition, low-frequency and high-frequency broadband iEEG signals of face recognition appear to be largely concordant in the human association cortex. We conclude by outlining the challenges of this research program to understand the neural basis of human face recognition in the next 10 years.

Two face masks are better than one: congruency effects in face matching

Although the positive effects of congruency between stimuli are well replicated in face memory paradigms, mixed findings have been found in face matching. Due to the current COVID-19 pandemic, face masks are now very common during daily life outdoor activities. Thus, the present study aims to further explore congruency effects in matching faces partially occluded by surgical masks. Observers performed a face matching task consisting of pairs of faces presented in full view (i.e., full-view condition), pairs of faces in which only one of the faces had a mask (i.e., one-mask condition), and pairs of faces in which both faces had a mask (i.e., two-mask condition). Although face masks disrupted performance in identity match and identity mismatch trials, in match trials, we found better performance in the two-mask condition compared to the one-mask condition. This finding highlights the importance of congruency between stimuli on face matching when telling faces together.

Behavioral and neural markers of visual configural processing in social scene perception

Research on face perception has revealed highly specialized visual mechanisms such as configural processing, and provided markers of interindividual differences -including disease risks and alterations- in visuo-perceptual abilities that traffic in social cognition. Is face perception unique in degree or kind of mechanisms, and in its relevance for social cognition? Combining functional MRI and behavioral methods, we address the processing of an uncharted class of socially relevant stimuli: minimal social scenes involving configurations of two bodies spatially close and face-to-face as if interacting (hereafter, facing dyads). We report category-specific activity for facing (vs. non-facing) dyads in visual cortex. That activity shows face-like signatures of configural processing -i.e., stronger response to facing (vs. non-facing) dyads, and greater susceptibility to stimulus inversion for facing (vs. non-facing) dyads-, and is predicted by performance-based measures of configural processing in visual perception of body dyads. Moreover, we observe that the individual performance in body-dyad perception is reliable, stable-over-time and correlated with the individual social sensitivity, coarsely captured by the Autism-Spectrum Quotient. Further analyses clarify the relationship between single-body and body-dyad perception. We propose that facing dyads are processed through highly specialized mechanisms -and brain areas-, analogously to other biologically and socially relevant stimuli such as faces. Like face perception, facing-dyad perception can reveal basic (visual) processes that lay the foundations for understanding others, their relationships and interactions.

Characteristic fixation biases in Super-Recognizers

Neurotypical observers show large and reliable individual differences in gaze behavior along several semantic object dimensions. Individual gaze behavior toward faces has been linked to face identity processing, including that of neurotypical observers. Here, we investigated potential gaze biases in Super-Recognizers (SRs), individuals with exceptional face identity processing skills. Ten SRs, identified with a novel conservative diagnostic framework, and 43 controls freely viewed 700 complex scenes depicting more than 5000 objects. First, we tested whether SRs and controls differ in fixation biases along four semantic dimensions: faces, text, objects being touched, and bodies. Second, we tested potential group differences in fixation biases toward eyes and mouths. Finally, we tested whether SRs fixate closer to the theoretical optimal fixation point for face identification. SRs showed a stronger gaze bias toward faces and away from text and touched objects, starting from the first fixation onward. Further, SRs spent a significantly smaller proportion of first fixations and dwell time toward faces on mouths but did not differ in dwell time or first fixations devoted to eyes. Face fixation of SRs also fell significantly closer to the theoretical optimal fixation point for identification, just below the eyes. Our findings suggest that reliable superiority for face identity processing is accompanied by early fixation biases toward faces and preferred saccadic landing positions close to the theoretical optimum for face identification. We discuss future directions to investigate the functional basis of individual fixation behavior and face identity processing ability.

Face Memory and Face Matching

Abstract. The Cambridge Face Memory Test Long (CFMT+) and the Glasgow Face Matching Test Short (GFMT-S) are frequently used tests in face recognition research. No test-retest results in conjunction with internal consistency, mean inter-item correlations (MICs), and pre-post mean differences have been reported. The internal consistency and the MICs provide insights into the homogeneity of items. In an online study ( N = 72), we investigated the test-retest reliability, Cronbach’s α, split-half reliability, MICs, and retest mean differences for the CFMT+ and the GFMT-S. The CFMT+ showed satisfactory reliability coefficients above .88, whereas the coefficients of the GFMT-S were mainly dissatisfactory and below .75. We argue that task characteristics like heterogeneous stimulus material might lower MICs, response behavior might enhance reliability, and practice effects might increase the means of the CFMT+ in repeated measurements. Therefore, an integrative evaluation of different psychometric parameters helps explaining variations of reliability in face recognition tests.

Match me if you can: Evidence for a domain-general visual comparison ability

Visual comparison-comparing visual stimuli (e.g., fingerprints) side by side and determining whether they originate from the same or different source (i.e., "match")-is a complex discrimination task involving many cognitive and perceptual processes. Despite the real-world consequences of this task, which is often conducted by forensic scientists, little is understood about the psychological processes underpinning this ability. There are substantial individual differences in visual comparison accuracy amongst both professionals and novices. The source of this variation is unknown, but may reflect a domain-general and naturally varying perceptual ability. Here, we investigate this by comparing individual differences (N = 248 across two studies) in four visual comparison domains: faces, fingerprints, firearms, and artificial prints. Accuracy on all comparison tasks was significantly correlated and accounted for a substantial portion of variance (e.g., 42% in Exp. 1) in performance across all tasks. Importantly, this relationship cannot be attributed to participants' intrinsic motivation or skill in other visual-perceptual tasks (visual search and visual statistical learning). This paper provides novel evidence of a reliable, domain-general visual comparison ability.

Forensic facial examiners versus super-recognizers: Evaluating behavior beyond accuracy

We evaluated the detailed, behavioral properties of face matching performance in two specialist groups: forensic facial examiners and super-recognizers. Both groups compare faces to determine identity with high accuracy and outperform the general population. Typically, facial examiners are highly trained; super-recognizers rely on natural ability. We found distinct behaviors between these two groups. Examiners used the full 7-point identity judgment scale (-3: "different"; +3: "same"). Super-recognizers' judgments clustered toward highly confident decisions. Examiners' judgments for same- and different-identities were symmetric across the scale midpoint (0); super-recognizers' judgments were not. Examiners showed higher identity judgment agreement than super-recognizers. Despite these qualitative differences, both groups showed insight into their own accuracy: more confident people and those who rated the task to be easier tended to be more accurate. Altogether, we show to better understand and interpret judgments according to the nature of someone's facial expertise, evaluations should assess more than accuracy.

Accurate but inefficient: Standard face identity matching tests fail to identify prosopagnosia

In recent years, the number of face identity matching tests in circulation has grown considerably and these are being increasingly utilized to study individual differences in face cognition. Although many of these tests were designed for testing typical observers, recent studies have begun to utilize general-purpose tests for studying specific, atypical populations (e.g., super-recognizers and individuals with prosopagnosia). In this study, we examined the capacity of four tests requiring binary face-matching decisions to study individual differences between healthy observers. Uniquely, we used performance of the patient PS (Rossion, 2018), a well-documented case of acquired prosopagnosia (AP), as a benchmark. Two main findings emerged: (i) PS could exhibit typical rates of accuracy in all tests; (ii) compared to age-matched controls and when considering both accuracy and speed to account for potential trade-offs, only the KFMT - but not the EFCT, PICT or GFMT - was able to detect PS's severe impairment. These findings reflect the importance of considering both accuracy and response times to measure individual differences in face matching, and the need for comparing tests in terms of their sensitivity, when used as a measure of human cognition and brain functioning.

When two fields collide: Identifying "super-recognisers" for neuropsychological and forensic face recognition research

In the last decade, a novel individual differences approach has emerged across the face recognition literature. While the field has long been concerned with prosopagnosia (the inability to recognise facial identity), it has more recently become clear that there are vast differences in face recognition ability within the typical population. "Super-recognisers" are those individuals purported to reside at the very top of this spectrum. On one hand, these people are of interest to cognitive neuropsychologists who are motivated to explore the commonality of the face recognition continuum, whereas on the other hand, researchers from the forensic face matching field evaluate the implementation of super-recognisers into real-world police and security settings. These two rather different approaches have led to discrepancies in the definition of super-recognisers, and perhaps more fundamentally, the approach to identifying them, resulting in a lack of consistency that prohibits theoretical progress. Here, we review the protocols used in published work to identify super-recognisers, and propose a common definition and screening recommendations that can be adhered to across fields.

Avatars with faces of real people: A construction method for scientific experiments in virtual reality

Experimental psychology research typically employs methods that greatly simplify the real-world conditions within which cognition occurs. This approach has been successful for isolating cognitive processes, but cannot adequately capture how perception operates in complex environments. In turn, real-world environments rarely afford the access and control required for rigorous scientific experimentation. In recent years, technology has advanced to provide a solution to these problems, through the development of affordable high-capability virtual reality (VR) equipment. The application of VR is now increasing rapidly in psychology, but the realism of its avatars, and the extent to which they visually represent real people, is captured poorly in current VR experiments. Here, we demonstrate a user-friendly method for creating photo-realistic avatars of real people and provide a series of studies to demonstrate their psychological characteristics. We show that avatar faces of familiar people are recognised with high accuracy (Study 1), replicate the familiarity advantage typically observed in real-world face matching (Study 2), and show that these avatars produce a similarity-space that corresponds closely with real photographs of the same faces (Study 3). These studies open the way to conducting psychological experiments on visual perception and social cognition with increased realism in VR.

An international survey of applied face-matching training courses

Face matching decisions in applied settings are typically carried out by trained face-matching professionals, known as facial reviewers and facial examiners. Recent research has demonstrated that short professional face-matching training courses are limited in improving face-matching accuracy, however, despite the existence of high-level training guidelines produced by the practitioner community the content, duration and delivery of training for facial reviewers and facial examiners are not widely understood in the academic research community. The current study aimed to address this gap in the scientific literature to better understand how different agencies train facial reviewers and facial examiners, using results collected from an international survey. The survey included questions on the duration, delivery and content of an agencies face-matching training. 24 face-matching agencies from five continents took part in the survey. A quantitative analysis of the survey results revealed that at the group level facial examiners received longer durations of training, covering more topics than reviewers and more frequently included one-to-one mentoring. However, the survey revealed large differences in the duration, delivery methods and content of training by individual agencies at both the facial review and facial examiner level and low inclusion of evidence-based training practices. These results should help researchers to better understand the diversity in training practices and durations of training between different agencies and may help explain the individual differences observed in the performance of face matching professionals in the literature.

Face processing in police service: the relationship between laboratory-based assessment of face processing abilities and performance in a real-world identity matching task

In the present study, we investigated whether police officers’ performance in searching for unfamiliar faces in a video-based real-world task is predicted by laboratory-based face processing tests that are typically used to assess individual differences in face processing abilities. Specifically, perceptual performance in the field was operationalized via the identification of target individuals in self-made close-circuit television (CCTV) video tapes. Police officers’ abilities in the laboratory were measured by the Cambridge Face Memory Test long form (CFMT+). We hypothesized that the CFMT+ predicts individual differences in the CCTV task performance. A total of N = 186 police officers of the Rhineland-Palatinate State Police participated in the study (i.e., N = 139 novice and advanced cadets with either 3 months, 15 months or 24 months of pre-service experience; N = 47 experienced police officers with three years of pre-service experience and at least two years of full-service experience, who participated in the assessment center of the special police forces, specifically the surveillance and technical unit). Results revealed that the CFMT+ explained variance in the CCTV task. In sample 1, CFMT+ scores predicted hits, but not false alarms. In contrast, in sample 2, CFMT+ scores were correlated with both hits and false alarms. From a theoretical perspective, we discuss factors that might explain CCTV task performance. From a practical perspective, we recommend that personnel selection processes investigating individual differences of police officers’ face processing abilities should comprise of two steps. At first, laboratory-based tests of face processing abilities should be applied. Subsequently, to validate laboratory-based individual differences in face processing abilities, we recommend that work samples such as CCTV tasks from the field should be added.

Super-Recognizers - a novel diagnostic framework, 70 cases, and guidelines for future work

When you hear the word Super-Recognizer, you may think of comic-book-hero-esque agents searching the underground to find people who went missing decades ago. Compared to this fantasy, the reality seems somewhat less exciting. Super-Recognizers (SRs) were initially reported a decade ago as a collateral while developing tests for developmental prosopagnosia. Today, the topic of SRs sparks interest from groups seeking to enhance scientific knowledge, public safety, or their monetary gain. With no immediate consequences of erroneous SR identification, there has been no pressure to establish a clear SR definition. This promotes heterogenous empirical evidence and the proliferation of unsupported claims in the media. Not only is this status quo unfortunate, it stands in opposition to the potential of special populations - both for science and application. SRs are a special population with imminent real-world value that can advance our understanding of brain functioning. To exploit their potential, I propose a needed formal framework for SR diagnosis, and introduce 70 cases identified based hereupon. These cases represent the core of a growing SR cohort, studied in my lab in the course of a long-term, multi-methodological research agenda involving academic and government collaborators. Finally, I provide recommendations for those interested in SR work, and highlight current caveats and future challenges.

Developmental prosopagnosics and super recognizers rely on the same facial features used by individuals with normal face recognition abilities for face identification

Face recognition depends on the ability of the face processing system to extract facial features that define the identity of a face. In a recent study we discovered that altering a subset of facial features changed the identity of the face, indicating that they are critical for face identification. Changing another set of features did not change the identity of a face, indicating that they are not critical for face identification. In the current study, we assessed whether developmental prosopagnosics (DPs) and super recognizers (SRs) also rely more heavily on these critical features than non-critical features for face identification. To that end, we presented to DPs and SRs faces in which either the critical or the non-critical features were manipulated. In Study 1, we presented SRs with a famous face recognition task. We found that overall SRs recognized famous faces that differ in either critical or non-critical features better than controls. Similar to controls, changes in critical features had a larger effect on SRs' face recognition than changes in non-critical features. In Study 2, we presented an identity matching task to DPs and SRs. Similar to controls, DPs and SRs perceived faces that differed in critical features as more different than faces that differed in non-critical features. Taken together, our results indicate that SRs and DPs use the same critical features for face identification as normal individuals. These findings emphasize the fundamental role of this subset of features for face identification.

Psychophysical profiles in super-recognizers

Facial identity matching ability varies widely, ranging from prosopagnosic individuals (who exhibit profound impairments in face cognition/processing) to so-called super-recognizers (SRs), possessing exceptional capacities. Yet, despite the often consequential nature of face matching decisions—such as identity verification in security critical settings—ability assessments tendentially rely on simple performance metrics on a handful of heterogeneously related subprocesses, or in some cases only a single measured subprocess. Unfortunately, methodologies of this ilk leave contributions of stimulus information to observed variations in ability largely un(der)specified. Moreover, they are inadequate for addressing the qualitative or quantitative nature of differences between SRs’ abilities and those of the general population. Here, therefore, we sought to investigate individual differences—among SRs identified using a novel conservative diagnostic framework, and neurotypical controls—by systematically varying retinal availability, bandwidth, and orientation of faces’ spatial frequency content in two face matching experiments. Psychophysical evaluations of these parameters’ contributions to ability reveal that SRs more consistently exploit the same spatial frequency information, rather than suggesting qualitatively different profiles between control observers and SRs. These findings stress the importance of optimizing procedures for SR identification, for example by including measures quantifying the consistency of individuals’ behavior.

GFMT2: A psychometric measure of face matching ability

We present an expanded version of a widely used measure of unfamiliar face matching ability, the Glasgow Face Matching Test (GFMT). The GFMT2 is created using the same source database as the original test but makes five key improvements. First, the test items include variation in head angle, pose, expression and subject-to-camera distance, making the new test more difficult and more representative of challenges in everyday face identification tasks. Second, short and long versions of the test each contain two forms that are calibrated to be of equal difficulty, allowing repeat tests to be performed to examine effects of training interventions. Third, the short-form tests contain no repeating face identities, thereby removing any confounding effects of familiarity that may have been present in the original test. Fourth, separate short versions are created to target exceptionally high performing or exceptionally low performing individuals using established psychometric principles. Fifth, all tests are implemented in an executable program, allowing them to be administered automatically. All tests are available free for scientific use via www.gfmt2.org .

When experience does not promote expertise: security professionals fail to detect low prevalence fake IDs

Professional screeners frequently verify photograph IDs in such industries as professional security, bar tending, and sales of age-restricted materials. Moreover, security screening is a vital tool for law enforcement in the search for missing or wanted persons. Nevertheless, previous research demonstrates that novice participants fail to spot fake IDs when they are rare (i.e., the low prevalence effect; LPE). To address whether this phenomenon also occurs with professional screeners, we conducted three experiments. Experiment 1 compared security professional and non-professionals. Experiment 2 compared bar-security professionals, access-security professionals, and non-professionals. Finally, Experiment 3 added a newly created Professional Identity Training Questionnaire to determine whether and how aspects of professionals’ employment predict ID-matching accuracy. Across all three experiments, all participants were susceptible to the LPE regardless of professional status. Neither length/type of professional experience nor length/type of training experience affected ID verification performance. We discuss task performance and survey responses with aims to acknowledge and address this potential problem in real-world screening scenarios.

The effect of face masks and sunglasses on identity and expression recognition with super-recognizers and typical observers

Face masks present a new challenge to face identification (here matching) and emotion recognition in Western cultures. Here, we present the results of three experiments that test the effect of masks, and also the effect of sunglasses (an occlusion that individuals tend to have more experienced with) on (i) familiar face matching, (ii) unfamiliar face matching and (iii) emotion categorization. Occlusion reduced accuracy in all three tasks, with most errors in the mask condition; however, there was little difference in performance for faces in masks compared with faces in sunglasses. Super-recognizers, people who are highly skilled at matching unconcealed faces, were impaired by occlusion, but at the group level, performed with higher accuracy than controls on all tasks. Results inform psychology theory with implications for everyday interactions, security and policing in a mask-wearing society.

Associations between self-reported and objective face recognition abilities are only evident in above- and below-average recognisers

The 20-Item Prosopagnosia Items (PI-20) was recently introduced as a self-report measure of face recognition abilities and as an instrument to help the diagnosis of prosopagnosia. In general, studies using this questionnaire have shown that observers have moderate to strong insights into their face recognition abilities. However, it remains unknown whether these insights are equivalent for the whole range of face recognition abilities. The present study investigates this issue using the Mandarin version of the PI-20 and the Cambridge Face Memory Test Chinese (CFMT-Chinese). Our results showed a moderate negative association between the PI-20 and the CFMT-Chinese. However, this association was driven by people with low and high face recognition ability, but absent in people within the typical range of face recognition performance. The implications of these results for the study of individual differences and the diagnosis of prosopagnosia are discussed.

Individual differences in emotion regulation and face recognition

Face recognition ability is highly variable among neurologically intact populations. Across three experiments, this study examined for the first time associations between individual differences in a range of adaptive versus maladaptive emotion regulation strategies and face recognition. Using an immediate face-memory paradigm, in which observers had to identify a self-paced learned unfamiliar face from a 10-face target-present/ target-absent line-up, Experiment 1 (N = 42) found high levels of expressive suppression (the ongoing efforts to inhibit emotion-expressive behaviors), but not cognitive reappraisal (the cognitive re-evaluation of emotional events to change their emotional consequences), were associated with a lower level of overall face-memory accuracy and higher rates of misidentifications and false positives. Experiment 2 (N = 53) replicated these finding using a range of face-matching tasks, where observers were asked to match pairs of same-race or different-race face images taken on the same day or during different times. Once again, high levels of expressive suppression were associated with a lower level of overall face-matching performance and higher rates of false positives, but cognitive reappraisal did not correlate with any face-matching measure. Finally, Experiment 3 (N = 52) revealed that the higher use of maladaptive cognitive emotion regulation strategies, especially catastrophizing, was associated with lower levels of overall face-matching performances and higher rates of false positives. All told, the current research provides new evidence concerning the important associations between emotion and cognition.

UNSW Face Test: A screening tool for super-recognizers

We present a new test-the UNSW Face Test (www.unswfacetest.com)-that has been specifically designed to screen for super-recognizers in large online cohorts and is available free for scientific use. Super-recognizers are people that demonstrate sustained performance in the very top percentiles in tests of face identification ability. Because they represent a small proportion of the population, screening large online cohorts is an important step in their initial recruitment, before confirmatory testing via standardized measures and more detailed cognitive testing. We provide normative data on the UNSW Face Test from 3 cohorts tested via the internet (combined n = 23,902) and 2 cohorts tested in our lab (combined n = 182). The UNSW Face Test: (i) captures both identification memory and perceptual matching, as confirmed by correlations with existing tests of these abilities; (ii) captures face-specific perceptual and memorial abilities, as confirmed by non-significant correlations with non-face object processing tasks; (iii) enables researchers to apply stricter selection criteria than other available tests, which boosts the average accuracy of the individuals selected in subsequent testing. Together, these properties make the test uniquely suited to screening for super-recognizers in large online cohorts.

Body Language Influences on Facial Identification at Passport Control: An Exploration in Virtual Reality

Person identification at airports requires the matching of a passport photograph to its bearer. One aim of this process is to find identity impostors, who use valid identity documents of similar-looking people to avoid detection. In psychology, this process has been studied extensively with static pairs of face photographs that require identity match (same person shown) versus mismatch (two different people) decisions. However, this approach provides a limited proxy for studying how other factors, such as nonverbal behaviour, affect this task. The current study investigated the influence of body language on facial identity matching within a virtual reality airport environment, by manipulating activity levels of person avatars queueing at passport control. In a series of six experiments, detection of identity mismatches was unaffected when observers were not instructed to utilise body language. By contrast, under explicit instruction to look out for unusual body language, these cues enhanced detection of mismatches but also increased false classification of matches. This effect was driven by increased activity levels rather than body language that simply differed from the behaviour of the majority of passengers. The implications and limitations of these findings are discussed.

Differences between and within individuals, and subprocesses of face cognition: implications for theory, research and personnel selection

Recent investigations of individual differences have demonstrated striking variability in performance both within the same subprocess in face cognition (e.g. face perception), but also between two different subprocesses (i.e. face perception versus face recognition) that are assessed using different tasks (face matching versus face memory). Such differences between and within individuals between and within laboratory tests raise practical challenges. This applies in particular to the development of screening tests for the selection of personnel in real-world settings where faces are routinely processed, such as at passport control. The aim of this study, therefore, was to examine the performance profiles of individuals within and across two different subprocesses of face cognition: face perception and face recognition. To this end, 146 individuals completed four different tests of face matching-one novel tool for assessing proficiency in face perception, as well as three established measures-and two benchmark tests of face memory probing face recognition. In addition to correlational analyses, we further scrutinized individual performance profiles of the highest and lowest performing observers identified per test, as well as across all tests. Overall, a number of correlations emerged between tests. However, there was limited evidence at the individual level to suggest that high proficiency in one test generalized to other tests measuring the same subprocess, as well as those that measured a different subprocess. Beyond emphasizing the need to honour inter-individual differences through careful multivariate assessment in the laboratory, our findings have real-world implications: combinations of tests that most accurately map the task(s) and processes of interest are required for personnel selection.

Human factors in forensic science: The cognitive mechanisms that underlie forensic feature-comparison expertise

After a decade of critique from leading scientific bodies, forensic science research is at a crossroads. Whilst emerging research has shown that some forensic feature-comparison disciplines are not foundationally valid, others are moving towards establishing reliability and validity. Forensic examiners in fingerprint, face and handwriting comparison disciplines have skills and knowledge that distinguish them from novices. Yet our understanding of the basis of this expertise is only beginning to emerge. In this paper, we review evidence on the psychological mechanisms contributing to forensic feature-comparison expertise, with a focus on one mechanism: statistical learning, or the ability to learn how often things occur in the environment. Research is beginning to emphasise the importance of statistical learning in forensic feature-comparison expertise. Ultimately, this research and broader cognitive science research has an important role to play in informing the development of training programs and selection tools for forensic feature-comparison examiners.

Normative data for two challenging tests of face matching under ecological conditions

Background

Unfamiliar face processing is an ability that varies considerably between individuals. Numerous studies have aimed to identify its underlying determinants using controlled experimental procedures. While such tests can isolate variables that influence face processing, they usually involve somewhat unrealistic situations and optimized face images as stimulus material. As a consequence, the extent to which the performance observed under laboratory settings is informative for predicting real-life proficiency remains unclear.

Results

We present normative data for two ecologically valid but underused tests of face matching: the Yearbook Test (YBT) and the Facial Identity Card Sorting Test (FICST). The YBT (n = 252) measures identity matching across substantial age-related changes in facial appearance, while the FICST (n = 218) assesses the ability to process unfamiliar facial identity despite superficial image variations. To determine the predictive value of both tests, a subsample of our cohort (n = 181) also completed a commonly used test of face recognition and two tests of face perception (the long form of the Cambridge Face Memory Test (CFMT+), the Expertise in Facial Comparison Test (EFCT) and the Person Identification Challenge Test (PICT)).

Conclusions

Focusing on the top performers identified independently per test, we made two important observations: 1) YBT and FICST performance can predict CFMT+ scores and vice versa; and 2) EFCT and PICT scores neither reliably predict superior performance in ecologically meaningful and challenging tests of face matching, nor in the most commonly used test of face recognition. These findings emphasize the necessity for using challenging and ecologically relevant, and thus highly sensitive, tasks of unfamiliar face processing to identify high-performing individuals in the normal population.

Interpol review of imaging and video 2016–2019

This review paper covers the forensic-relevant literature in imaging and video analysis from 2016 to 2019 as a part of the 19th Interpol International Forensic Science Managers Symposium. The review papers are also available at the Interpol website at: https://www.interpol.int/content/download/14458/file/Interpol%20Review%20Papers%202019.pdf.

Looking beyond the face area: lesion network mapping of prosopagnosia

Damage to the right fusiform face area can disrupt the ability to recognize faces, a classic example of how damage to a specialized brain region can disrupt a specialized brain function. However, similar symptoms can arise from damage to other brain regions, and face recognition is now thought to depend on a distributed brain network. The extent of this network and which regions are critical for facial recognition remains unclear. Here, we derive this network empirically based on lesion locations causing clinically significant impairments in facial recognition. Cases of acquired prosopagnosia were identified through a systematic literature search and lesion locations were mapped to a common brain atlas. The network of brain regions connected to each lesion location was identified using resting state functional connectivity from healthy participants (n = 1000), a technique termed lesion network mapping. Lesion networks were overlapped to identify connections common to lesions causing prosopagnosia. Reproducibility was assessed using split-half replication. Specificity was assessed through comparison with non-specific control lesions (n = 135) and with control lesions associated with symptoms other than prosopagnosia (n = 155). Finally, we tested whether our facial recognition network derived from clinically evident cases of prosopagnosia could predict subclinical facial agnosia in an independent lesion cohort (n = 31). Our systematic literature search identified 44 lesions causing prosopagnosia, only 29 of which intersected the right fusiform face area. However, all 44 lesion locations fell within a single brain network defined by connectivity to the right fusiform face area. Less consistent connectivity was found to other face-selective regions. Surprisingly, all 44 lesion locations were also functionally connected, through negative correlation, with regions in the left frontal cortex. This connectivity pattern was highly reproducible and specific to lesions causing prosopagnosia. Positive connectivity to the right fusiform face area and negative connectivity to left frontal regions were independent predictors of prosopagnosia and predicted subclinical facial agnosia in an independent lesion cohort. We conclude that lesions causing prosopagnosia localize to a single functionally connected brain network defined by connectivity to the right fusiform face area and to left frontal regions. Implications of these findings for models of facial recognition deficits are discussed.

Towards a 'manifesto' for super-recognizer research

This article provides a response to five excellent commentaries on our article 'Super-recognizers: From the lab to the world and back again'. Specifically, the response summarizes commonalities between these commentaries. Based on this consensus, we propose a flexible framework for the assessment of superior face recognition and outline guiding principles to advance future work in the field.