The other-race effect does not rely on memory: Evidence from a matching task

Ensemble coding of facial identity is robust, but may not contribute to face learning

Ensemble coding - the rapid extraction of a perceptual average - has been proposed as a potential mechanism underlying face learning. We tested this proposal across five pre-registered experiments in which four ambient images of an identity were presented in the study phase. In Experiments 1 and 2a-c, participants were asked whether a test image was in the study array; these experiments examined the robustness of ensemble coding. Experiment 1 replicated ensemble coding in an online sample; participants recognize images from the study array and the average of those images. Experiments 2a-c provide evidence that ensemble coding meets several criteria of a possible learning mechanism: It is robust to changes in head orientation (± 60o), survives a short (30s) delay, and persists when images of two identities are interleaved during the study phase. Experiment 3 examined whether ensemble coding is sufficient for face learning (i.e., facilitates recognition of novel images of a target identity). Each study array comprised four ambient images (variability + average), a single image, or an average of four images (average only). Participants were asked whether a novel test image showed the identity from a study array. Performance was best in the four-image condition, with no difference between the single-image and average-only conditions. We conclude that ensemble coding of facial identity is robust but that the perceptual average per se is not sufficient for face learning.

The role of inversion and face masks on simultaneous and delayed face matching tasks

Although it is generally accepted that face recognition relies on holistic processing, it has been suggested that the simultaneous face matching task may depend on a more analytical or featural processing approach. However, empirical evidence supporting this claim is limited. In two experiments, we further explored the role of holistic and featural processing on simultaneous face matching by manipulating holistic processing through inversion and presenting faces with or without face masks. The results from Experiment 1 revealed that both inversion and face masks impaired matching performance. However, while the inversion effect was evident in both full-view and masked faces, the mask effect was only found in upright, but not inverted, faces. These results were replicated in Experiment 2 but, the inversion and mask effects were stronger in delayed face matching than in simultaneous face matching. Our findings suggest that simultaneous face matching relies on holistic processing, but to a smaller extent compared to higher memory-demanding identification tasks.

Improving forensic perpetrator identification with Super-Recognizers

About a decade ago, Super-Recognizers (SRs) were first described as individuals with exceptional face identity processing abilities. Since then, various tests have been developed or adapted to assess individuals' abilities and identify SRs. The extant literature suggests that SRs may be beneficial in police tasks requiring individual identification. However, in reality, the performance of SRs has never been examined using authentic forensic material. This not only limits the external validity of test procedures used to identify SRs, but also claims concerning their deployment in policing. Here, we report the first-ever investigation of SRs' ability to identify perpetrators using authentic case material. We report the data of 73 SRs and 45 control participants. These include (a) performance on three challenging tests of face identity processing recommended by Ramon (2021) for SR identification; (b) performance for perpetrator identification using four CCTV sequences depicting five perpetrators and police line-ups created for criminal investigation purposes. Our findings demonstrate that the face identity processing tests used here are valid in measuring such abilities and identifying SRs. Moreover, SRs excel at perpetrator identification relative to control participants, with more correct perpetrator identifications, the better their performance across lab tests. These results provide external validity for the recently proposed diagnostic framework and its tests used for SR identification (Ramon, 2021). This study provides the first empirical evidence that SRs identified using these measures can be beneficial for forensic perpetrator identification. We discuss theoretical and practical implications for law enforcement, whose procedures can be improved via a human-centric approach centered around individuals with superior abilities.

Understanding face matching

Many security settings rely on the identity matching of unfamiliar people, which has led this task to be studied extensively in Cognitive Psychology. In these experiments, observers typically decide whether pairs of faces depict one person (an identity match) or two different people (an identity mismatch). The visual similarity of the to-be-compared faces must play a primary role in how observers accurately resolve this task, but the nature of this similarity-accuracy relationship is unclear. The current study investigated the association between accuracy and facial similarity at the level of individual items (Experiments 1 and 2) and facial features (Experiments 3 and 4). All experiments demonstrate a strong link between similarity and matching accuracy, indicating that this forms the basis of identification decisions. At a feature level, however, similarity exhibited distinct relationships with match and mismatch accuracy. In matches, similarity information was generally shared across the features of a face pair under comparison, with greater similarity linked to higher accuracy. Conversely, features within mismatching face pairs exhibited greater variation in similarity information. This indicates that identity matches and mismatches are characterised by different similarity profiles, which present distinct challenges to the cognitive system. We propose that these identification decisions can be resolved through the accumulation of convergent featural information in matches and the evaluation of divergent featural information in mismatches.

Two face masks are better than one: congruency effects in face matching

Although the positive effects of congruency between stimuli are well replicated in face memory paradigms, mixed findings have been found in face matching. Due to the current COVID-19 pandemic, face masks are now very common during daily life outdoor activities. Thus, the present study aims to further explore congruency effects in matching faces partially occluded by surgical masks. Observers performed a face matching task consisting of pairs of faces presented in full view (i.e., full-view condition), pairs of faces in which only one of the faces had a mask (i.e., one-mask condition), and pairs of faces in which both faces had a mask (i.e., two-mask condition). Although face masks disrupted performance in identity match and identity mismatch trials, in match trials, we found better performance in the two-mask condition compared to the one-mask condition. This finding highlights the importance of congruency between stimuli on face matching when telling faces together.

Covariation in the recognition of own-race and other-race faces argues against the role of group bias in the other race effect

A dominant theory of the other race effect (ORE) is that group-bias causes us to process own-race and other-race faces using different cognitive processes. To test this theory, we measured individual differences across two face recognition tasks. Our predictions were that the magnitude and pattern of performance on own-race faces would not predict performance on other-race faces and that participants would take more time with own-race faces. In a face matching task, we found that participants were more accurate with own-race faces compared to other-race faces. However, performance on own-race faces was highly correlated with performance on other-race faces. In a face sorting task, participants made fewer piles and fewer errors (i.e. higher accuracy) with own-race faces compared to other-race faces. However, we again found that performance on own-race faces was highly correlated with performance on other-race faces. The covariation in performance between own-race and other-race faces suggests that they engage similar perceptual processes. Finally, we found that participants did not spend more time on tasks involving own-race faces suggesting that different levels of motivation do not explain the ORE. Together, these findings argue against the idea that group bias leads to different perceptual processing of own-race and other-race faces.

Multiple latent variables but functionally dependent output mappings underlying the recognition of own- and other-race faces for Chinese individuals: Evidence from state-trace analysis

To explore the number of latent variables underlying recognition of own- and other-race faces for Chinese observers, we conducted a study-recognition task where orientation, stimuli type, and duration were manipulated in the study phase and applied state trace analysis as a statistic method. Results showed that each state trace plot on each pair of stimuli types matched a single monotonic curve when stimuli type was set to state factor, but separate curves between face and non-face showed up when the state factor was orientation. The results implied that at least two latent variables affected recognition performance in the inversion paradigm. Besides, the unidimensional structure between own- and other-race faces regardless of the state factor suggested that Chinese participants used the same recognition mechanism for unfamiliar own- and other-race faces in the inversion paradigm.

Serial dependence of facial identity for own- and other-race faces

It is well established that individuals are better at recognising faces of their own-race compared with other-races; however, there is ongoing debate regarding the perceptual mechanisms that may be involved and therefore sensitive to face-race. Here, we ask whether serial dependence of facial identity, a bias where the perception of a face's identity is biased towards a previously presented face, shows an other-race effect. Serial dependence is associated with face recognition ability and appears to operate on high-level, face-selective representations, like other candidate mechanisms (e.g., holistic processing). We therefore expected to find an other-race effect for serial dependence for our Caucasian and Asian participants. While participants showed robust effects of serial dependence for all faces, only Caucasian participants showed stronger serial dependence for own-race faces. Intriguingly, we found that individual variation in own-race, but not other-race, serial dependence was significantly associated with face recognition abilities. Preliminary evidence also suggested that other-race contact is associated with other-race serial dependence. In conclusion, though we did not find an overall difference in serial dependence for own- versus other-race faces in both participant groups, our results highlight that this bias may be functionally different for own- versus other-race faces and sensitive to racial experience.

The Importance of Internal and External Features in Matching Own and Other Race Faces

Research has shown that we are better at discriminating between faces that are our own race, and much less accurate with faces of another race. When the external features of faces were removed, this reduced the accuracy for recognizing other-races faces, more than own-race faces, suggesting that the external features (hair, face shape) are especially important for the recognition of other-race faces. The aim of the current study was to determine whether external features were more useful in matching other-race faces, and whether this was the case for Western and Eastern viewers. The current study employed a face matching task with Caucasian (U.K.) and Asian (Chinese) participants and found that responses were more accurate for own-race faces, and for whole faces when compared with faces where the internal or external features had been removed. Removing the external features of other-race faces increased the own-race bias for Chinese and U.K. participants, demonstrating the importance of viewing whole faces, including the external features when matching other-race faces.

Individual differences in emotion regulation and face recognition

Face recognition ability is highly variable among neurologically intact populations. Across three experiments, this study examined for the first time associations between individual differences in a range of adaptive versus maladaptive emotion regulation strategies and face recognition. Using an immediate face-memory paradigm, in which observers had to identify a self-paced learned unfamiliar face from a 10-face target-present/ target-absent line-up, Experiment 1 (N = 42) found high levels of expressive suppression (the ongoing efforts to inhibit emotion-expressive behaviors), but not cognitive reappraisal (the cognitive re-evaluation of emotional events to change their emotional consequences), were associated with a lower level of overall face-memory accuracy and higher rates of misidentifications and false positives. Experiment 2 (N = 53) replicated these finding using a range of face-matching tasks, where observers were asked to match pairs of same-race or different-race face images taken on the same day or during different times. Once again, high levels of expressive suppression were associated with a lower level of overall face-matching performance and higher rates of false positives, but cognitive reappraisal did not correlate with any face-matching measure. Finally, Experiment 3 (N = 52) revealed that the higher use of maladaptive cognitive emotion regulation strategies, especially catastrophizing, was associated with lower levels of overall face-matching performances and higher rates of false positives. All told, the current research provides new evidence concerning the important associations between emotion and cognition.

More human than human: a Turing test for photographed faces

Background

Recent experimental work has shown that hyper-realistic face masks can pass for real faces during live viewing. However, live viewing embeds the perceptual task (mask detection) in a powerful social context that may influence respondents’ behaviour. To remove this social context, we assessed viewers’ ability to distinguish photos of hyper-realistic masks from photos of real faces in a computerised two-alternative forced choice (2AFC) procedure.

Results

In experiment 1 (N = 120), we observed an error rate of 33% when viewing time was restricted to 500 ms. In experiment 2 (N = 120), we observed an error rate of 20% when viewing time was unlimited. In both experiments we saw a significant performance cost for other-race comparisons relative to own-race comparisons.

Conclusions

We conclude that viewers could not reliably distinguish hyper-realistic face masks from real faces in photographic presentations. As well as its theoretical interest, failure to detect synthetic faces has important implications for security and crime prevention, which often rely on facial appearance and personal identity being related.

Learning own- and other-race facial identities: Testing implicit recognition with event-related brain potentials

Exposure to varying images of the same person can encourage the formation of a representation that is sufficiently robust to allow recognition of previously unseen images of this person. While behavioural work suggests that face identity learning is harder for other-race faces, the present experiment investigated the neural correlates underlying own- and other-race face learning. Participants sorted own- and other-race identities into separate identity clusters and were further familiarised with these identities in a matching task. Subsequently, we compared event-related brain potentials (ERPs) in an implicit recognition (butterfly detection) task for learnt and previously unseen identities. We observed better sorting and matching for own- than other-race identities, and behavioural learning effects were restricted to own-race identities. Similarly, the N170 ERP component showed clear learning effects for own-race faces only. The N250, a component more closely associated with face learning was more negative for learnt than novel identities. ERP findings thus suggests a processing advantage for own-race identities at an early perceptual level whereas later correlates of identity learning were unaffected by ethnicity. These results suggest learning advantages for own-race identities, which underscores the importance of perceptual expertise in the own-race bias.

Learning own- and other-race facial identities from natural variability

Exposure to multiple varying face images of the same person encourages the formation of identity representations which are sufficiently robust to allow subsequent recognition from new, never-before seen images. While recent studies suggest that identity information is initially harder to perceive in images of other- relative to own-race identities, it remains unclear whether these difficulties propagate to face learning, that is, to the formation of robust face representations. We report two experiments in which Caucasian and East Asian participants sorted multiple images of own- and other-race persons according to identity in an implicit learning task and subsequently either matched novel images of learnt and previously unseen faces for identity (Experiment 1) or made old/new decisions for new images of learnt and unfamiliar identities (Experiment 2). Caucasian participants demonstrated own-race advantages during sorting, matching, and old/new recognition, while corresponding effects were absent in East Asian participants with substantial other-race expertise. Surprisingly, East Asian participants showed enhanced learning for other-race identities during matching in Experiment 1, which may reflect their increased motivation to individuate other-race faces. Thus, our results highlight the importance of perceptual expertise for own- and other-race processing, but may also lend support to recent suggestions on how expertise and socio-cognitive factors can interact.

Effects of Changes in Background Colour on the Identification of Own- and Other-Race Faces

The current study investigated whether small differences in the background colours between the lineup members would influence identification accuracy of own-race and other-race faces. Using the well-established 1-in-10 paradigm, half of the array faces had exactly the same backgrounds, and half were on backgrounds of slightly different hues of green. For target present arrays, participants were more accurate at identifying own-race faces when compared with the other-race faces when all backgrounds were the same. However, when backgrounds had slightly different hues, there was no difference in how accurate people were at identifying faces from both races. For target absent arrays, participants were more likely to incorrectly choose a face if the backgrounds were not all the same, regardless of the race of faces. Real-world implications from these findings are that using lineups where the backgrounds are slightly different hues may increase the likelihood of the false identification of innocent suspects.

Unfamiliar Face Matching With Driving Licence and Passport Photographs

Matching two different images of an unfamiliar face is difficult, although we rely on this process every day when proving our identity. Although previous work with laboratory photosets has shown that performance is error-prone, few studies have focussed on how accurately people carry out this matching task using photographs taken from official forms of identification. In Experiment 1, participants matched high-resolution, colour face photos with current UK driving licence photos of the same group of people in a sorting task. Averaging 19 mistaken pairings out of 30, our results showed that this task was both difficult and error-prone. In Experiment 2, high-resolution photographs were paired with either driving licence or passport photographs in a typical pairwise matching paradigm. We found no difference in performance levels for the two types of ID image, with both producing unacceptable levels of accuracy (around 75%-79% correct). The current work benefits from increased ecological validity and provides a clear demonstration that these forms of official identification are ineffective and alternatives should be considered.

Use-inspired basic research on individual differences in face identification: implications for criminal investigation and security

This journal is dedicated to "use-inspired basic research" where a problem in the world shapes the hypotheses for study in the laboratory. This review considers the role of individual variation in face identification and the challenges and opportunities this presents in security and criminal investigations. We show how theoretical work conducted on individual variation in face identification has, in part, been stimulated by situations presented in the real world. In turn, we review the contribution of theoretical work on individual variation in face processing and how this may help shape the practical identification of faces in applied situations. We consider two cases in detail. The first case is that of security officers; gatekeepers who use facial ID to grant entry or deny access. One applied example, where much research has been conducted, is passport control officers who are asked to match a person in front of them to a photograph shown on their ID. What happens if they are poor at making such face matching decisions and can they be trained to improve their performance? Second, we outline the case of "super-recognisers", people who are excellent at face recognition. Here it is interesting to consider whether these individuals can be strategically allocated to security and criminal roles, to maximise the identification of suspects. We conclude that individual differences are one of the largest documented sources of error in face matching and face recognition but more work is needed to account for these differences within theoretical models of face processing.

Unfamiliar face matching with photographs of infants and children

BACKGROUND

Infants and children travel using passports that are typically valid for five years (e.g. Canada, United Kingdom, United States and Australia). These individuals may also need to be identified using images taken from videos and other sources in forensic situations including child exploitation cases. However, few researchers have examined how useful these images are as a means of identification.

METHODS

We investigated the effectiveness of photo identification for infants and children using a face matching task, where participants were presented with two images simultaneously and asked whether the images depicted the same child or two different children. In Experiment 1, both images showed an infant (<1 year old), whereas in Experiment 2, one image again showed an infant but the second image of the child was taken at 4-5 years of age. In Experiments 3a and 3b, we asked participants to complete shortened versions of both these tasks (selecting the most difficult trials) as well as the short version Glasgow face matching test. Finally, in Experiment 4, we investigated whether information regarding the sex of the infants and children could be accurately perceived from the images.

RESULTS

In Experiment 1, we found low levels of performance (72% accuracy) for matching two infant photos. For Experiment 2, performance was lower still (64% accuracy) when infant and child images were presented, given the significant changes in appearance that occur over the first five years of life. In Experiments 3a and 3b, when participants completed both these tasks, as well as a measure of adult face matching ability, we found lowest performance for the two infant tasks, along with mixed evidence of within-person correlations in sensitivities across all three tasks. The use of only same-sex pairings on mismatch trials, in comparison with random pairings, had little effect on performance measures. In Experiment 4, accuracy when judging the sex of infants was at chance levels for one image set and above chance (although still low) for the other set. As expected, participants were able to judge the sex of children (aged 4-5) from their faces.

DISCUSSION

Identity matching with infant and child images resulted in low levels of performance, which were significantly worse than for an adult face matching task. Taken together, the results of the experiments presented here provide evidence that child facial photographs are ineffective for use in real-world identification.

Personal Identification of Deceased Persons: An Overview of the Current Methods Based on Physical Appearance

The use of the physical appearance of the deceased has become more important because the available antemortem information for comparisons may consist only of a physical description and photographs. Twenty-one articles dealing with the identification based on the physiognomic features of the human body were selected for review and were divided into four sections: (i) visual recognition, (ii) specific facial/body areas, (iii) biometrics, and (iv) dental superimposition. While opinions about the reliability of the visual recognition differ, the search showed that it has been used in mass disasters, even without testing its objectivity and reliability. Specific facial areas being explored for the identification of dead; however, their practical use is questioned, similarly to soft biometrics. The emerging dental superimposition seems to be the only standardized and successfully applied method for identification so far. More research is needed into a potential use of the individualizing features, considering that postmortem changes and technical difficulties may affect the identification.

Investigating the other-race effect in working memory

People have difficulties in remembering other-race faces; this so-called other-race effect (ORE) has been frequently observed in long-term recognition memory (LTM). Several theories argue that the ORE in LTM is caused by differences in earlier processing stages, such as encoding of ingroup and outgroup faces. We test this hypothesis by exploring whether the ORE can already be observed in visual working memory (VWM)-an intermediate system located between encoding processes and LTM storage. In four independent experiments, we observed decreased performance for outgroup faces compared to ingroup faces using three different VWM tasks: an adaptive N-back task, a self-ordered pointing task, and a change detection task. Also, we found that the number of items stored in VWM is smaller for outgroup faces than for ingroup faces. Further, we explored whether performance differences in the change detection task are related to the classic ORE in recognition memory. Our results provide further evidence that the ORE originates during earlier stages of cognitive processing. We discuss that (how) future ORE research may benefit from considering theories and evidence from the VWM literature.

Cross-race correlations in the abilities to match unfamiliar faces

The other-race effect in face identification has been documented widely in memory tasks, but it persists also in identity-matching tasks, in which memory contributions are minimized. Whereas this points to a perceptual locus for this effect, it remains unresolved whether matching performance with same- and other-race faces is driven by shared cognitive mechanisms. To examine this question, this study compared Arab and Caucasian observers' ability to match faces of their own race with their ability to match faces of another race using one-to-one (Experiment 1) and one-to-many (Experiment 2) identification tasks. Across both experiments, Arab and Caucasian observers demonstrated reliable other-race effects at a group level. At an individual level, substantial variation in accuracy was found, but performance with same-race and other-race faces correlated consistently and strongly. This indicates that the abilities to match same- and other-race faces share a common cognitive mechanism.

Feature instructions improve face-matching accuracy

Identity comparisons of photographs of unfamiliar faces are prone to error but important for applied settings, such as person identification at passport control. Finding techniques to improve face-matching accuracy is therefore an important contemporary research topic. This study investigated whether matching accuracy can be improved by instruction to attend to specific facial features. Experiment 1 showed that instruction to attend to the eyebrows enhanced matching accuracy for optimized same-day same-race face pairs but not for other-race faces. By contrast, accuracy was unaffected by instruction to attend to the eyes, and declined with instruction to attend to ears. Experiment 2 replicated the eyebrow-instruction improvement with a different set of same-race faces, comprising both optimized same-day and more challenging different-day face pairs. These findings suggest that instruction to attend to specific features can enhance face-matching accuracy, but feature selection is crucial and generalization across face sets may be limited.

Feature-by-feature comparison and holistic processing in unfamiliar face matching

Identity comparisons of photographs of unfamiliar faces are prone to error but imperative for security settings, such as the verification of face identities at passport control. Therefore, finding techniques to improve face-matching accuracy is an important contemporary research topic. This study investigates whether matching accuracy can be enhanced by verbal instructions that address feature comparisons or holistic processing. Findings demonstrate that feature-by-feature comparison strategy had no effect on face matching. In contrast, verbal instructions focused on holistic processing made face matching faster, but they impaired accuracy. Given the recent evidence for the heredity of face perception and the previously reported small or no improvements of face-matching ability, it seems reasonable to suggest that improving unfamiliar face matching is not an easy task, but it is presumably worthwhile to explore new methods for improvement nonetheless.

Unfamiliar Face Matching With Frontal and Profile Views

Research has systematically examined how laboratory participants and real-world practitioners decide whether two face photographs show the same person or not using frontal images. In contrast, research has not examined face matching using profile images. In Experiment 1, we ask whether matching unfamiliar faces is easier with frontal compared with profile views. Participants completed the original, frontal version of the Glasgow Face Matching Test, and also an adapted version where all face pairs were presented in profile. There was no difference in performance across the two tasks, suggesting that both views were similarly useful for face matching. Experiments 2 and 3 examined whether matching unfamiliar faces is improved when both frontal and profile views are provided. We compared face matching accuracy when both a frontal and a profile image of each face were presented, with accuracy using each view alone. Surprisingly, we found no benefit when both views were presented together in either experiment. Overall, these results suggest that either frontal or profile views provide substantially overlapping information regarding identity or participants are unable to utilise both sources of information when making decisions. Each of these conclusions has important implications for face matching research and real-world identification development.

Hyper-realistic face masks: a new challenge in person identification

We often identify people using face images. This is true in occupational settings such as passport control as well as in everyday social environments. Mapping between images and identities assumes that facial appearance is stable within certain bounds. For example, a person’s apparent age, gender and ethnicity change slowly, if at all. It also assumes that deliberate changes beyond these bounds (i.e., disguises) would be easy to spot. Hyper-realistic face masks overturn these assumptions by allowing the wearer to look like an entirely different person. If unnoticed, these masks break the link between facial appearance and personal identity, with clear implications for applied face recognition. However, to date, no one has assessed the realism of these masks, or specified conditions under which they may be accepted as real faces. Herein, we examined incidental detection of unexpected but attended hyper-realistic masks in both photographic and live presentations. Experiment 1 (UK; n = 60) revealed no evidence for overt detection of hyper-realistic masks among real face photos, and little evidence of covert detection. Experiment 2 (Japan; n = 60) extended these findings to different masks, mask-wearers and participant pools. In Experiment 3 (UK and Japan; n = 407), passers-by failed to notice that a live confederate was wearing a hyper-realistic mask and showed limited evidence of covert detection, even at close viewing distance (5 vs. 20 m). Across all of these studies, viewers accepted hyper-realistic masks as real faces. Specific countermeasures will be required if detection rates are to be improved.

The other-race effect in face learning: Using naturalistic images to investigate face ethnicity effects in a learning paradigm

The other-race effect in face identification has been reported in many situations and by many different ethnicities, yet it remains poorly understood. One reason for this lack of clarity may be a limitation in the methodologies that have been used to test it. Experiments typically use an old-new recognition task to demonstrate the existence of the other-race effect, but such tasks are susceptible to different social and perceptual influences, particularly in terms of the extent to which all faces are equally individuated at study. In this paper we report an experiment in which we used a face learning methodology to measure the other-race effect. We obtained naturalistic photographs of Chinese and Caucasian individuals, which allowed us to test the ability of participants to generalize their learning to new ecologically valid exemplars of a face identity. We show a strong own-race advantage in face learning, such that participants required many fewer trials to learn names of own-race individuals than those of other-race individuals and were better able to identify learned own-race individuals in novel naturalistic stimuli. Since our methodology requires individuation of all faces, and generalization over large image changes, our finding of an other-race effect can be attributed to a specific deficit in the sensitivity of perceptual and memory processes to other-race faces.

Cross-cultural differences and similarities underlying other-race effects for facial identity and expression

Perceptual advantages for own-race compared to other-race faces have been demonstrated for the recognition of facial identity and expression. However, these effects have not been investigated in the same study with measures that can determine the extent of cross-cultural agreement as well as differences. To address this issue, we used a photo sorting task in which Chinese and Caucasian participants were asked to sort photographs of Chinese or Caucasian faces by identity or by expression. This paradigm matched the task demands of identity and expression recognition and avoided constrained forced-choice or verbal labelling requirements. Other-race effects of comparable magnitude were found across the identity and expression tasks. Caucasian participants made more confusion errors for the identities and expressions of Chinese than Caucasian faces, while Chinese participants made more confusion errors for the identities and expressions of Caucasian than Chinese faces. However, analyses of the patterns of responses across groups of participants revealed a considerable amount of underlying cross-cultural agreement. These findings suggest that widely repeated claims that members of other cultures "all look the same" overstate the cultural differences.

Solving the Border Control Problem: Evidence of Enhanced Face Matching in Individuals with Extraordinary Face Recognition Skills

Photographic identity documents (IDs) are commonly used despite clear evidence that unfamiliar face matching is a difficult and error-prone task. The current study set out to examine the performance of seven individuals with extraordinary face recognition memory, so called “super recognisers” (SRs), on two face matching tasks resembling border control identity checks. In Experiment 1, the SRs as a group outperformed control participants on the “Glasgow Face Matching Test”, and some case-by-case comparisons also reached significance. In Experiment 2, a perceptually difficult face matching task was used: the “Models Face Matching Test”. Once again, SRs outperformed controls both on group and mostly in case-by-case analyses. These findings suggest that SRs are considerably better at face matching than typical perceivers, and would make proficient personnel for border control agencies.

How Well Do Computer-Generated Faces Tap Face Expertise?

The use of computer-generated (CG) stimuli in face processing research is proliferating due to the ease with which faces can be generated, standardised and manipulated. However there has been surprisingly little research into whether CG faces are processed in the same way as photographs of real faces. The present study assessed how well CG faces tap face identity expertise by investigating whether two indicators of face expertise are reduced for CG faces when compared to face photographs. These indicators were accuracy for identification of own-race faces and the other-race effect (ORE)-the well-established finding that own-race faces are recognised more accurately than other-race faces. In Experiment 1 Caucasian and Asian participants completed a recognition memory task for own- and other-race real and CG faces. Overall accuracy for own-race faces was dramatically reduced for CG compared to real faces and the ORE was significantly and substantially attenuated for CG faces. Experiment 2 investigated perceptual discrimination for own- and other-race real and CG faces with Caucasian and Asian participants. Here again, accuracy for own-race faces was significantly reduced for CG compared to real faces. However the ORE was not affected by format. Together these results signal that CG faces of the type tested here do not fully tap face expertise. Technological advancement may, in the future, produce CG faces that are equivalent to real photographs. Until then caution is advised when interpreting results obtained using CG faces.

Error Rates in Users of Automatic Face Recognition Software

In recent years, wide deployment of automatic face recognition systems has been accompanied by substantial gains in algorithm performance. However, benchmarking tests designed to evaluate these systems do not account for the errors of human operators, who are often an integral part of face recognition solutions in forensic and security settings. This causes a mismatch between evaluation tests and operational accuracy. We address this by measuring user performance in a face recognition system used to screen passport applications for identity fraud. Experiment 1 measured target detection accuracy in algorithm-generated 'candidate lists' selected from a large database of passport images. Accuracy was notably poorer than in previous studies of unfamiliar face matching: participants made over 50% errors for adult target faces, and over 60% when matching images of children. Experiment 2 then compared performance of student participants to trained passport officers-who use the system in their daily work-and found equivalent performance in these groups. Encouragingly, a group of highly trained and experienced "facial examiners" outperformed these groups by 20 percentage points. We conclude that human performance curtails accuracy of face recognition systems-potentially reducing benchmark estimates by 50% in operational settings. Mere practise does not attenuate these limits, but superior performance of trained examiners suggests that recruitment and selection of human operators, in combination with effective training and mentorship, can improve the operational accuracy of face recognition systems.

Identity-level representations affect unfamiliar face matching performance in sequential but not simultaneous tasks

According to cognitive and neurological models of the face-processing system, faces are represented at two levels of abstraction. First, image-based pictorial representations code a particular instance of a face and include information that is unrelated to identity—such as lighting, pose, and expression. Second, at a more abstract level, identity-specific representations combine information from various encounters with a single face. Here we tested whether identity-level representations mediate unfamiliar face matching performance. Across three experiments we manipulated identity attributions to pairs of target images and measured the effect on subsequent identification decisions. Participants were instructed that target images were either two photos of the same person (1ID condition) or photos of two different people (2ID condition). This manipulation consistently affected performance in sequential matching: 1ID instructions improved accuracy on “match” trials and caused participants to adopt a more liberal response bias than the 2ID condition. However, this manipulation did not affect performance in simultaneous matching. We conclude that identity-level representations, generated in working memory, influence the amount of variation tolerated between images, when making identity judgements in sequential face matching.

Developmental Improvement and Age-Related Decline in Unfamiliar Face Matching

Age-related changes have been documented widely in studies of face recognition and eyewitness identification. However, it is not clear whether these changes arise from general developmental differences in memory or occur specifically during the perceptual processing of faces. We report two experiments to track such perceptual changes using a 1-in-10 (experiment 1) and 1-in-1 (experiment 2) matching task for unfamiliar faces. Both experiments showed improvements in face matching during childhood and adult-like accuracy levels by adolescence. In addition, face-matching performance declined in adults of the age of 65 years. These findings indicate that developmental improvements and aging-related differences in face processing arise from changes in the perceptual encoding of faces. A clear face inversion effect was also present in all age groups. This indicates that those age-related changes in face matching reflect a quantitative effect, whereby typical face processes are engaged but do not operate at the best-possible level. These data suggest that part of the problem of eyewitness identification in children and elderly persons might reflect impairments in the perceptual processing of unfamiliar faces.

Generalization across view in face memory and face matching

While a change in view is considered to be one of the most damaging manipulations for facial identification, this phenomenon has been measured traditionally with tasks that confound perceptual processes with recognition memory. This study explored facial identification with a pairwise matching task to determine whether view generalization is possible when memory factors are minimised. Experiment 1 showed that the detrimental view effect in recognition memory is attenuated in face matching. Moreover, analysis of individual differences revealed that some observers can identify faces across view with perfect accuracy. This was replicated in Experiment 2, which also showed that view generalization is unaffected when only the internal facial features are shown. These results indicate that the view effect in recognition memory does not arise from data limits, whereby faces contain insufficient visual information to allow identification across views. Instead, these findings point to resource limits, within observers, that hamper such person identification in recognition memory.

Feedback training for facial image comparison

People are typically poor at matching the identity of unfamiliar faces from photographs. This observation has broad implications for face matching in operational settings (e.g., border control). Here, we report significant improvements in face matching ability following feedback training. In Experiment 1, we show cumulative improvement in performance on a standard test of face matching ability when participants were provided with trial-by-trial feedback. More important, Experiment 2 shows that training benefits can generalize to novel, widely varying, unfamiliar face images for which no feedback is provided. The transfer effect specifically benefited participants who had performed poorly on an initial screening test. These findings are discussed in the context of existing literature on unfamiliar face matching and perceptual training. Given the reliability of the performance enhancement and its generalization to diverse image sets, we suggest that feedback training may be useful for face matching in occupational settings.