Recognizing the same face in different contexts: Testing within-person face recognition in typical development and in autism

Ensemble coding of facial identity is robust, but may not contribute to face learning

Ensemble coding - the rapid extraction of a perceptual average - has been proposed as a potential mechanism underlying face learning. We tested this proposal across five pre-registered experiments in which four ambient images of an identity were presented in the study phase. In Experiments 1 and 2a-c, participants were asked whether a test image was in the study array; these experiments examined the robustness of ensemble coding. Experiment 1 replicated ensemble coding in an online sample; participants recognize images from the study array and the average of those images. Experiments 2a-c provide evidence that ensemble coding meets several criteria of a possible learning mechanism: It is robust to changes in head orientation (± 60o), survives a short (30s) delay, and persists when images of two identities are interleaved during the study phase. Experiment 3 examined whether ensemble coding is sufficient for face learning (i.e., facilitates recognition of novel images of a target identity). Each study array comprised four ambient images (variability + average), a single image, or an average of four images (average only). Participants were asked whether a novel test image showed the identity from a study array. Performance was best in the four-image condition, with no difference between the single-image and average-only conditions. We conclude that ensemble coding of facial identity is robust but that the perceptual average per se is not sufficient for face learning.

Stable individual differences in unfamiliar face identification: Evidence from simultaneous and sequential matching tasks

Matching identity in images of unfamiliar faces is difficult: Images of the same person can look different and images of different people can look similar. Recent studies have capitalized on individual differences in the ability to distinguish match (same ID) vs. mismatch (different IDs) face pairs to inform models of face recognition. We addressed two significant gaps in the literature by examining the stability of individual differences in both sensitivity to identity and response bias. In Study 1, 210 participants completed a battery of four tasks in each of two sessions separated by one week. Tasks varied in protocol (same/different, lineup, sorting) and stimulus characteristics (low vs. high within-person variability in appearance). In Study 2, 148 participants completed a battery of three tasks in a single session. Stimuli were presented simultaneously on some trials and sequentially on others, introducing short-term memory demands. Principal components analysis revealed two components that were stable across time and tasks: sensitivity to identity and bias. Analyses of response times suggest that individual differences in bias reflect decision-making processes. We discuss the implications of our findings in applied settings and for models of face recognition.

Children's ability to recognize their parent's face improves with age

Adults are experts at recognizing familiar faces across images that incorporate natural within-person variability in appearance (i.e., ambient images). Little is known about children's ability to do so. In the current study, we investigated whether 4- to 7-year-olds (n = 56) could recognize images of their own parent-a person with whom children have had abundant exposure in a variety of different contexts. Children were asked to identify images of their parent that were intermixed with images of other people. We included images of each parent taken both before and after their child was born to manipulate how close the images were to the child's own experience. When viewing before-birth images, 4- and 5-year-olds were less sensitive to identity than were older children; sensitivity did not differ when viewing images taken after the child was born. These findings suggest that with even the most familiar face, 4- and 5-year-olds have difficulty recognizing instances that go beyond their direct experience. We discuss two factors that may contribute to the prolonged development of familiar face recognition.

Learning faces from variability: Four- and five-year-olds differ from older children and adults

Children under 6 years of age have difficulty recognizing a familiar face across changes in appearance and telling the face apart from similar-looking people. Understanding the process by which newly encountered faces become familiar can provide insights into these difficulties. Exposure to the ways in which a person varies in appearance is one mechanism by which adults and older children (≥6 years) learn new faces. We provide the first investigation of whether this mechanism for face learning functions in younger children. Children aged 4 and 5 years were read two storybooks featuring an unfamiliar character. Participants viewed six images of the character in one story and one image of the character in the other story. After each story, children were asked to identify novel images of the character that were intermixed with images of a similar-looking distractor. Like older children, 4- and 5-year-olds were more sensitive to identity in the 6-image condition, but they also adapted a less conservative criterion. Young children identified more images of the character after viewing six images versus one image. However, many also incorrectly identified more images of the distractor after viewing six images versus one image, an effect not previously found for older children and adults. These results suggest that this mechanism for face learning is not fully refined before 6 years of age.

A quantitative meta-analysis of face recognition deficits in autism: 40 years of research

The ability to recognize an individual face is essential to human social interaction. Even subtle errors in this process can have huge implications for the way we relate to social partners. Because autism spectrum disorder (ASD) is characterized by deficits in social interaction, researchers have theorized about the potential role of atypical face identity processing to the symptom profile of ASD for more than 40 years. We conducted an empirical meta-analysis of this large literature to determine whether and to what extent face identity processing is atypical in ASD compared to typically developing (TD) individuals. We also tested the hypotheses that the deficit is selective to face identity recognition, not perception, and that methodological variation across studies moderates the magnitude of the estimated deficit. We identified 112 studies (5,390 participants) that generated 172 effect sizes from both recognition (k = 119) and discrimination (k = 53) paradigms. We used state-of-the-art approaches for assessing the validity and robustness of the analyses. We found comparable and large deficits in ASD for both face identity recognition (Hedge's g = -0.86) and discrimination (Hedge's g = -0.82). This means that the score of an average ASD individual is nearly 1 SD below the average TD individual on tasks assessing both aspects of face identity processing. These deficits generalize across age groups, sex, IQ scores, and task paradigms. These findings suggest that deficits in face identity processing may represent a core deficit in ASD. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

Facial emotion recognition in autistic adult females correlates with alexithymia, not autism

Research on predominantly male autistic samples has indicated that impairments in facial emotion recognition typically associated with autism spectrum conditions are instead due to co-occurring alexithymia. However, whether this could be demonstrated using more realistic facial emotion recognition stimuli and applied to autistic females was unclear. In all, 83 females diagnosed with autism spectrum condition completed online self-report measures of autism spectrum condition severity and alexithymia, and afacial emotion recognition deficit that assessed their ability to identify multimodal displays of complex emotions. Higher levels of alexithymia, but not autism spectrum condition severity, were associated with less accurate facial emotion recognition. Difficulty identifying one’s own feelings and externally oriented thinking were the components of alexithymia that were specifically related to facial emotion recognition accuracy. However, alexithymia (and autism spectrum condition severity) was not associated with speed of emotion processing. The findings are primarily discussed with the theoretical view that perceiving and experiencing emotions share the same neural networks, thus being able to recognise one’s own emotions may facilitate the ability to recognise others’. This study is in line with previous similar research on autistic males and suggests impairments in facial emotion recognition in autistic females should be attributed to co-occurring alexithymia.

More human than human: a Turing test for photographed faces

Background

Recent experimental work has shown that hyper-realistic face masks can pass for real faces during live viewing. However, live viewing embeds the perceptual task (mask detection) in a powerful social context that may influence respondents’ behaviour. To remove this social context, we assessed viewers’ ability to distinguish photos of hyper-realistic masks from photos of real faces in a computerised two-alternative forced choice (2AFC) procedure.

Results

In experiment 1 (N = 120), we observed an error rate of 33% when viewing time was restricted to 500 ms. In experiment 2 (N = 120), we observed an error rate of 20% when viewing time was unlimited. In both experiments we saw a significant performance cost for other-race comparisons relative to own-race comparisons.

Conclusions

We conclude that viewers could not reliably distinguish hyper-realistic face masks from real faces in photographic presentations. As well as its theoretical interest, failure to detect synthetic faces has important implications for security and crime prevention, which often rely on facial appearance and personal identity being related.

Four Social Brain Regions, Their Dysfunctions, and Sequelae, Extensively Explain Autism Spectrum Disorder Symptomatology

Autism spectrum disorder (ASD) is a challenging neurodevelopmental disorder with symptoms in social, language, sensory, motor, cognitive, emotional, repetitive behavior, and self-sufficient living domains. The important research question examined is the elucidation of the pathogenic neurocircuitry that underlies ASD symptomatology in all its richness and heterogeneity. The presented model builds on earlier social brain research, and hypothesizes that four social brain regions largely drive ASD symptomatology: amygdala, orbitofrontal cortex (OFC), temporoparietal cortex (TPC), and insula. The amygdala's contributions to ASD largely derive from its major involvement in fine-grained intangible knowledge representations and high-level guidance of gaze. In addition, disrupted brain regions can drive disturbance of strongly interconnected brain regions to produce further symptoms. These and related effects are proposed to underlie abnormalities of the visual cortex, inferior frontal gyrus (IFG), caudate nucleus, and hippocampus as well as associated symptoms. The model is supported by neuroimaging, neuropsychological, neuroanatomical, cellular, physiological, and behavioral evidence. Collectively, the model proposes a novel, parsimonious, and empirically testable account of the pathogenic neurocircuitry of ASD, an extensive account of its symptomatology, a novel physiological biomarker with potential for earlier diagnosis, and novel experiments to further elucidate the mechanisms of brain abnormalities and symptomatology in ASD.

Face perception: A brief journey through recent discoveries and current directions

Faces are a rich source of information about the people around us. Identity, state of mind, emotions, intentions, age, gender, ethnic background, attractiveness and a host of other attributes about an individual can be gleaned from a face. When face perception fails, dramatic psycho-social consequences can follow at the individual level, as in the case of prosopagnosic parents who are unable to recognize their children at school pick-up. At the species level, social interaction patterns are shaped by human face perception abilities. The computational feat of recognizing faces and facial attributes, and the challenges overcome by the human brain to achieve this feat, have fascinated generations of vision researchers. In this paper, we present a brief overview of some of the milestones of discovery as well as outline a selected set of current directions and open questions on this topic.

Age-related increase of image-invariance in the fusiform face area

•

Image invariance in the FFA increases from age seven to adulthood.

•

These results are confirmed by two independent ROI analyses.

•

Adaptation in the FFA relates to the ability to recognize a face in multiple images.

Face recognition undergoes prolonged development from childhood to adulthood, thereby raising the question which neural underpinnings are driving this development. Here, we address the development of the neural foundation of the ability to recognize a face across naturally varying images. Fourteen children (ages, 7–10) and 14 adults (ages, 20–23) watched images of either the same or different faces in a functional magnetic resonance imaging adaptation paradigm. The same face was either presented in exact image repetitions or in varying images. Additionally, a subset of participants completed a behavioral task, in which they decided if the face in consecutively presented images belonged to the same person. Results revealed age-related increases in neural sensitivity to face identity in the fusiform face area. Importantly, ventral temporal face-selective regions exhibited more image-invariance – as indicated by stronger adaptation for different images of the same person – in adults compared to children. Crucially, the amount of adaptation to face identity across varying images was correlated with the ability to recognize individual faces in different images. These results suggest that the increase of image-invariance in face-selective regions might be related to the development of face recognition skills.

Expressive Faces Confuse Identity

We used highly variable, so-called 'ambient' images to test whether expressions affect the identity recognition of real-world facial images. Using movie segments of two actors unknown to our participants, we created image pairs - each image within a pair being captured from the same film segment. This ensured that, within pairs, variables such as lighting were constant whilst expressiveness differed. We created two packs of cards, one containing neutral face images, the other, their expressive counterparts. Participants sorted the card packs into piles, one for each perceived identity. As with previous studies, the perceived number of identities was higher than the veridical number of two. Interestingly, when looking within piles, we found a strong difference between the expressive and neutral sorting tasks. With expressive faces, identity piles were significantly more likely to contain cards of both identities. This finding demonstrates that, over and above other image variables, expressiveness variability can cause identity confusion; evidently, expression is not disregarded or factored out when we classify facial identity in real-world images. Our results provide clear support for a face processing architecture in which both invariant and changeable facial information may be drawn upon to drive our decisions of identity.