The automaticity of face perception is influenced by familiarity

Does the right hemisphere retain functional characteristics typical of the emotional adaptive system? An evolutionary approach to the problem of brain asymmetries

The right and left hemispheres host two complementary adaptive systems with a right-sided prevalence of automatic and unconscious processing modes, typical of the 'emotional system', and a left-sided prevalence of propositional and conscious processing modes typical of the 'cognitive system' The principal right hemispheric syndromes (and the functioning modes typical of this hemisphere) are, indeed, characterized by automatic and unconscious processing modalities. Thus, the unilateral neglect syndrome discloses a defective automatic (and spared intentional) spatial orienting of attention; face and voice recognition disorders are due to disruption of mechanisms that automatically generate familiarity feelings and anosognosia seems due to the unconscious loss of personal significance attributed by the patient to the pathological event. Since emotions were the only adaptive system existing before the development of language (which is provided of a strong capacity to develop and shape cognition), the persistence in the right hemisphere of mechanisms typical of the emotional system strongly supports an evolutionary model of brain laterality. (160 words).

The generality of the attentional boost effect for famous, unfamiliar, and inverted faces

Familiarity and face inversion not only affect face recognition and memory but also influence attention. Face processing is less attention-demanding for familiar than for unfamiliar faces and for upright than for inverted faces. The automaticity raises the question of how face processing interacts with an increase in attention. Using a dual-task paradigm, we tested the interaction between attention and face familiarity and orientation. Participants encoded a series of faces to memory while simultaneously monitoring a stream of colored squares, pressing the space bar for target-colored squares and making no response to distractor-colored squares. Replicating previous findings of the attentional boost effect (ABE), we found that faces encoded with target squares were better remembered than faces encoded with distractor squares. If the automatic nature of familiar (or upright) face processing makes attention unnecessary, then the attentional boost should be attenuated for familiar relative to unfamiliar faces and for upright relative to inverted faces. Data from three experiments showed, however, that the ABE was the same for all types of faces. These results suggest that target detection did not simply elevate attention in an early encoding phase. Rather, selecting targets and rejecting distractors in the color task may have led to yoked temporal selection of target-concurrent faces for entry into memory.

Distinct patterns of neural response to faces from different races in humans and deep networks

Social categories such as the race or ethnicity of an individual are typically conveyed by the visual appearance of the face. The aim of this study was to explore how these differences in facial appearance are represented in human and artificial neural networks. First, we compared the similarity of faces from different races using a neural network trained to discriminate identity. We found that the differences between races were most evident in the fully connected layers of the network. Although these layers were also able to predict behavioural judgements of face identity from human participants, performance was biased toward White faces. Next, we measured the neural response in face-selective regions of the human brain to faces from different races in Asian and White participants. We found distinct patterns of response to faces from different races in face-selective regions. We also found that the spatial pattern of response was more consistent across participants for own-race compared to other-race faces. Together, these findings show that faces from different races elicit different patterns of response in human and artificial neural networks. These differences may underlie the ability to make categorical judgements and explain the behavioural advantage for the recognition of own-race faces.

Catching wanted people at the border: prospective person memory and face matching in border control decisions

Border control officers may be on the lookout for wanted people while they verify that travellers match their passport photos. We developed a novel experimental paradigm to investigate whether people are more likely to report that someone is wanted if they also believe that person is using a fraudulent passport. In two experiments, undergraduate students assumed the role of a border control officer and completed multiple "shifts" of a face matching task designed to simulate a passport verification check. Before each shift participants viewed posters of wanted people and were instructed to report any sightings if a wanted person appeared in any of the images during the passport check. Participants were more likely to say an individual was wanted if they also believed the person did not match their passport image. In addition, the accuracy of wanted person sightings was reduced for trials with nonmatching passports compared to trials with matching passports. This suggests wanted people with matching passports were easier to spot because participants had an additional image to compare with their memory of the person in the wanted poster.

High familiar faces have both eye recognition and holistic processing advantages

People recognize familiar faces better than unfamiliar faces. However, it remains unknown whether familiarity affects part-based and/or holistic processing. Wang et al., Frontiers in Psychology, 6, 559 (2015), Vision Research, 157, 89-96 (2019) found both enhanced part-based and holistic processing in eye relative to mouth regions (i.e., in a region-selective manner) for own-race and own-species faces, i.e., faces with more experience. Here, we examined the role of face familiarity in eyes (part-based, region-selective) and holistic processing. Face familiarity was tested at three levels: high-familiar (faces of students from the same department and the same class who attended almost all courses together), low-familiar (faces of students from the same department but different classes who attended some courses together), and unfamiliar (faces of schoolmates from different departments who seldom attended the same courses). Using the old/new task in Experiment 1, we found that participants recognized eyes of high-familiar faces better than low-familiar and unfamiliar ones, while similar performance was observed for mouths, indicating a region-selective, eyes familiarity effect. Using the "Perceptual field" paradigm in Experiment 2, we observed a stronger inversion effect for high-familiar faces, a weaker inversion effect for low-familiar faces, but a non-significant inversion effect for unfamiliar faces, indicating that face familiarity plays a role in holistic processing. Taken together, our results suggest that familiarity, like other experience-based variables (e.g., race and species), can improve both eye processing and holistic processing.

Looking at faces in the wild

Faces are key to everyday social interactions, but our understanding of social attention is based on experiments that present images of faces on computer screens. Advances in wearable eye-tracking devices now enable studies in unconstrained natural settings but this approach has been limited by manual coding of fixations. Here we introduce an automatic 'dynamic region of interest' approach that registers eye-fixations to bodies and faces seen while a participant moves through the environment. We show that just 14% of fixations are to faces of passersby, contrasting with prior screen-based studies that suggest faces automatically capture visual attention. We also demonstrate the potential for this new tool to help understand differences in individuals' social attention, and the content of their perceptual exposure to other people. Together, this can form the basis of a new paradigm for studying social attention 'in the wild' that opens new avenues for theoretical, applied and clinical research.

Characterizing the shared signals of face familiarity: Long-term acquaintance, voluntary control, and concealed knowledge

In a recent study using cross-experiment multivariate classification of EEG patterns, we found evidence for a shared familiarity signal for faces, patterns of neural activity that successfully separate trials for familiar and unfamiliar faces across participants and modes of familiarization. Here, our aim was to expand upon this research to further characterize the spatio-temporal properties of this signal. By utilizing the information content present for incidental exposure to personally familiar and unfamiliar faces, we tested how the information content in the neural signal unfolds over time under different task demands - giving truthful or deceptive responses to photographs of genuinely familiar and unfamiliar individuals. For this goal, we re-analyzed data from two previously published experiments using within-experiment leave-one-subject-out and cross-experiment classification of face familiarity. We observed that the general face familiarity signal, consistent with its previously described spatio-temporal properties, is present for long-term personally familiar faces under passive viewing, as well as for acknowledged and concealed familiarity responses. Also, central-posterior regions contain information related to deception. We propose that signals in the 200-400 ms window are modulated by top-down task-related anticipation, while the patterns in the 400-600 ms window are influenced by conscious effort to deceive. To our knowledge, this is the first report describing the representational dynamics of concealed knowledge for faces, using time-resolved multivariate classification.

Superior neural individuation of mother's than stranger's faces by five months of age

Human adults are better at recognizing different views of a given face as belonging to the same person when that person is familiar rather than unfamiliar. To clarify the developmental origin of this well-established phenomenon, one group of five-month-olds (N = 22) was presented with pictures of four different unfamiliar female faces at a fixed rate (6 Hz, 166 msec stimulus onset asynchrony), interrupted every 5th stimulus (1.2 Hz) by either their mother's face (mother oddball condition) or, in different stimulation sequences, a stranger's face (stranger oddball condition). In another group of five-month-olds (N = 17), stimulation sequences were reversed such that their mothers' or a given stranger's face were repeated at 6 Hz and interrupted every 5 stimuli by pictures of different female faces (mother standard, stranger standard conditions, respectively). Twelve variable images of each identity served as stimulus material. Besides clear frequency-tagged EEG responses at the 6 Hz stimulation rate over the medial occipital region in all conditions, significant activity at 1.2 Hz and harmonics (2.4 Hz, etc.) was observed in this region, reflecting selective responses to facial identity across changes of views. This effect was strongest when the mother's face was immediately repeated at every stimulation cycle (mother standard). Overall, these observations point to an early developmental advantage of identifying a familiar face presented from different views during immediate stimulus repetition.

A Novel Method of Exploring the Uncanny Valley in Avatar Gender(Sex) and Realism Using Electromyography

Despite the variety of applications that use avatars (virtual humans), how end-users perceive avatars are not fully understood, and accurately measuring these perceptions remains a challenge. To measure end-user responses more accurately to avatars, this pilot study uses a novel methodology which aims to examine and categorize end-user facial electromyography (f-EMG) responses. These responses (n = 92) can be categorized as pleasant, unpleasant, and neutral using control images sourced from the International Affective Picture System (IAPS). This methodology can also account for variability between participant responses to avatars. The novel methodology taken here can assist in the comparisons of avatars, such as gender(sex)-based differences. To examine these gender(sex) differences, participant responses to an avatar can be categorized as either pleasant, unpleasant, neutral or a combination. Although other factors such as age may unconsciously affect the participant responses, age was not directly considered in this work. This method may allow avatar developers to better understand how end-users objectively perceive an avatar. The recommendation of this methodology is to aim for an avatar that returns a pleasant, neutral, or pleasant-neutral response, unless an unpleasant response is the intended. This methodology demonstrates a novel and useful way forward to address some of the known variability issues found in f-EMG responses, and responses to avatar realism and uncanniness that can be used to examine gender(sex) perceptions.

Is There a Causal Link between the Left Lateralization of Language and Other Brain Asymmetries? A Review of Data Gathered in Patients with Focal Brain Lesions

This review evaluated if the hypothesis of a causal link between the left lateralization of language and other brain asymmetries could be supported by a careful review of data gathered in patients with unilateral brain lesions. In a short introduction a distinction was made between brain activities that could: (a) benefit from the shaping influences of language (such as the capacity to solve non-verbal cognitive tasks and the increased levels of consciousness and of intentionality); (b) be incompatible with the properties and the shaping activities of language (e.g., the relations between language and the automatic orienting of visual-spatial attention or between cognition and emotion) and (c) be more represented on the right hemisphere due to competition for cortical space. The correspondence between predictions based on the theoretical impact of language on other brain functions and data obtained in patients with lesions of the right and left hemisphere was then assessed. The reviewed data suggest that different kinds of hemispheric asymmetries observed in patients with unilateral brain lesions could be subsumed by common mechanisms, more or less directly linked to the left lateralization of language.

Music Does Not Facilitate Lexical Tone Normalization: A Speech-Specific Perceptual Process

Listeners utilize the immediate contexts to efficiently normalize variable vocal streams into standard phonology units. However, researchers debated whether non-speech contexts can also serve as valid clues for speech normalization. Supporters of the two sides proposed a general-auditory hypothesis and a speech-specific hypothesis to explain the underlying mechanisms. A possible confounding factor of this inconsistency is the listeners' perceptual familiarity of the contexts, as the non-speech contexts were perceptually unfamiliar to listeners. In this study, we examined this confounding factor by recruiting a group of native Cantonese speakers with sufficient musical training experience and a control group with minimal musical training. Participants performed lexical tone judgment tasks in three contextual conditions, i.e., speech, non-speech, and music context conditions. Both groups were familiar with the speech context and not familiar with the non-speech context. The musician group was more familiar with the music context than the non-musician group. The results evidenced the lexical tone normalization process in speech context but not non-speech nor music contexts. More importantly, musicians did not outperform non-musicians on any contextual conditions even if the musicians were experienced at pitch perception, indicating that there is no noticeable transfer in pitch perception from the music domain to the linguistic domain for tonal language speakers. The findings showed that even high familiarity with a non-linguistic context cannot elicit an effective lexical tone normalization process, supporting the speech-specific basis of the perceptual normalization process.

Evidence for a General Neural Signature of Face Familiarity

We explored the neural signatures of face familiarity using cross-participant and cross-experiment decoding of event-related potentials, evoked by unknown and experimentally familiarized faces from a set of experiments with different participants, stimuli, and familiarization-types. Human participants of both sexes were either familiarized perceptually, via media exposure, or by personal interaction. We observed significant cross-experiment familiarity decoding involving all three experiments, predominantly over posterior and central regions of the right hemisphere in the 270-630 ms time window. This shared face familiarity effect was most prominent across the Media and the Personal, as well as between the Perceptual and Personal experiments. Cross-experiment decodability makes this signal a strong candidate for a general neural indicator of face familiarity, independent of familiarization methods, participants, and stimuli. Furthermore, the sustained pattern of temporal generalization suggests that it reflects a single automatic processing cascade that is maintained over time.

Detecting a viewer's familiarity with a face: Evidence from event-related brain potentials and classifier analyses

Human observers recognize the faces of people they know efficiently and without apparent effort. Consequently, recognizing a familiar face is often assumed to be an automatic process beyond voluntary control. However, there are circumstances in which a person might seek to hide their recognition of a particular face. The present study therefore used event-related potentials (ERPs) and a classifier based on logistic regression to determine if it is possible to detect whether a viewer is familiar with a particular face, regardless of whether the participant is willing to acknowledge it or not. In three experiments, participants were presented with highly variable "ambient" images of personally familiar and unfamiliar faces, while performing an incidental butterfly detection task (Experiment 1), an explicit familiarity judgment task (Experiment 2), and a concealed familiarity task in which they were asked to deny familiarity with one truly known facial identity while acknowledging familiarity with a second known identity (Experiment 3). In all three experiments, we observed substantially more negative ERP amplitudes at occipito-temporal electrodes for familiar relative to unfamiliar faces starting approximately 200 ms after stimulus onset. Both the earlier N250 familiarity effect, reflecting visual recognition of a known face, and the later sustained familiarity effect, reflecting the integration of visual with additional identity-specific information, were similar across experiments and thus independent of task demands. These results were further supported by the classifier analysis. We conclude that ERP correlates of familiar face recognition are largely independent of voluntary control and discuss potential applications in forensic settings.

Coarse-to-Fine(r) Automatic Familiar Face Recognition in the Human Brain

At what level of spatial resolution can the human brain recognize a familiar face in a crowd of strangers? Does it depend on whether one approaches or rather moves back from the crowd? To answer these questions, 16 observers viewed different unsegmented images of unfamiliar faces alternating at 6 Hz, with spatial frequency (SF) content progressively increasing (i.e., coarse-to-fine) or decreasing (fine-to-coarse) in different sequences. Variable natural images of celebrity faces every sixth stimulus generated an objective neural index of single-glanced automatic familiar face recognition (FFR) at 1 Hz in participants' electroencephalogram (EEG). For blurry images increasing in spatial resolution, the neural FFR response over occipitotemporal regions emerged abruptly with additional cues at about 6.3-8.7 cycles/head width, immediately reaching amplitude saturation. When the same images progressively decreased in resolution, the FFR response disappeared already below 12 cycles/head width, thus providing no support for a predictive coding hypothesis. Overall, these observations indicate that rapid automatic recognition of heterogenous natural views of familiar faces is achieved from coarser visual inputs than generally thought, and support a coarse-to-fine FFR dynamics in the human brain.

Faces are not always special for attention: Effects of response-relevance and identity

Research over the past 25 years indicates that stimulus processing is diminished when attention is engaged in a perceptually demanding task of high 'perceptual load'. These results have generalized across a variety of stimulus categories, but a controversy evolved over the question of whether perception of distractor faces (or other categories of perceptual expertise) can proceed irrespective of the level of perceptual load in the attended task. Here we identify task-relevance, and in particular identity-relevance, as a potentially important factor in explaining prior inconsistencies. In four experiments, we tested whether perceptual load in an attended letter or word task modulates the processing of famous face distractors, while varying their task-relevance. Distractor interference effects on task RTs was reduced by perceptual load not only when the faces were entirely task-irrelevant, but also when the face gender was task relevant, within a name gender classification response-competition task, using famous female or male distractor faces. However, when the identity associated with the famous faces was primed by the task using their names, as in prior demonstrations that face distractors are immune to the effects of perceptual load, we were able to replicate these prior findings. Our findings demonstrate a role for identity-priming by the relevant task in determining attentional capture by faces under high perceptual load. Our results also highlight the importance of considering even relatively subtle forms of task-relevance in selective attention research.

Gendered Perceptions of Odd and Even Numbers: An Implicit Association Study From Arabic Culture

Previous studies conducted in the United States indicate that people associate numbers with gender, such that odd numbers are more likely to be considered male and even numbers considered female. It has been argued that this number gendering phenomenon is acquired through social learning and conditioning, and that male-odd/female-even associations reflect a general, cross-cultural human consensus on gender roles relating to agency and communion. However, the incidence and pattern of number gendering in cultures outside the United States remains to be established. Against this background, the purpose of this study was to determine whether people from a culture and country very different from the United States (specifically, native Arabic citizens living in the Arabic culture of the United Arab Emirates) also associate numbers with gender, and, if they do, whether the pattern of these associations is the male-odd/female-even associations previously observed. To investigate this issue, we adopted the Implicit Association Test used frequently in previous research, where associations between numbers (odd and even) and gender (male and female faces) were examined using male and female Arabic participants native to, and resident in, the United Arab Emirates. The findings indicated that the association of numbers with gender does occur in Arabic culture. But while Arabic females associated odd numbers with male faces and even numbers with female faces (the pattern of previous findings in the United States), Arabic males showed the reversed pattern of gender associations, associating even numbers with male faces and odd numbers with female faces. These findings support the view that number gendering is indeed a cross-cultural phenomenon and show that the phenomenon occurs across very different countries and cultures. But the findings also suggest that the pattern with which numbers are associated with gender is not universal and, instead, reflects culture-specific views on gender roles which may change across cultures and gender. Further implications for understanding the association of numbers with gender across human societies are discussed.

Older Adults' Emotion Recognition Ability Is Unaffected by Stereotype Threat

Eliciting negative stereotypes about ageing commonly results in worse performance on many physical, memory, and cognitive tasks in adults aged over 65. The current studies explored the potential effect of this “stereotype threat” phenomenon on older adults’ emotion recognition, a cognitive ability that has been demonstrated to decline with age. In Study 1, stereotypes about emotion recognition ability across the lifespan were established. In Study 2, these stereotypes were utilised in a stereotype threat manipulation that framed an emotion recognition task as assessing either cognitive ability (stereotypically believed to worsen with age), social ability (believed to be stable across lifespan), or general abilities (control). Participants then completed an emotion recognition task in which they labelled dynamic expressions of negative and positive emotions. Self-reported threat concerns were also measured. Framing an emotion recognition task as assessing cognitive ability significantly heightened older adults’ (but not younger adults’) reports of stereotype threat concerns. Despite this, older adults’ emotion recognition performance was unaffected. Unlike other cognitive abilities, recognising facially expressed emotions may be unaffected by stereotype threat, possibly because emotion recognition is automatic, making it less susceptible to the cognitive load that stereotype threat produces.

The Effects of Facial Attractiveness and Familiarity on Facial Expression Recognition

The classic theory of face perception holds that the invariant (e.g., identity and race) and variant (e.g., expression) dimensions of face information are independent of one another. Two separate neural systems are involved in face processing. However, the dynamic theory of face perception indicates that these two neural systems interact bidirectionally. Accordingly, by using the emotion categorization task and morph movies task, we investigated the influence of facial attractiveness on facial expression recognition and provided further evidence supporting the dynamic theory of face perception in both the static and dynamic contexts. In addition, this research used familiar celebrities (including actors, television personalities, politicians, and comedians) and explored the role of familiarity in face perception. In two experiments, the participants were asked to assess the expressions of faces with different levels of attractiveness and different levels of familiarity. We found that regardless of being in a static or dynamic face situation, happy expressions on attractive faces can be recognized more quickly, highlighting the advantage of happy expression recognition. Moreover, in static and dynamic familiar face situations, familiarity has a greater impact on expression recognition, and the influence of attraction on expression recognition may be weakened or even unaffected. Our results show that facial attractiveness influences the recognition of facial expressions in both static and dynamic contexts and highlight the importance of familiarity in face perception.

Brain lesion scores obtained using a simple semi-quantitative scale from MR imaging are associated with motor function, communication and cognition in dyskinetic cerebral palsy

Purpose

To characterise brain lesions in dyskinetic cerebral palsy (DCP) using the semi-quantitative scale for structural MRI (sqMRI) and to investigate their relationship with motor, communication and cognitive function.

Materials and methods

Thirty-nine participants (19 females, median age 21y) with DCP were assessed in terms of motor function, communication and a variety of cognitive domains. Whole-head magnetic resonance imaging (MRI) was performed including T1-MPRAGE, T2 turbo spin echo (axial plane), and fluid attenuated inversion recovery images (FLAIR). A child neurologist visually assessed images for brain lesions and scored these using the sqMRI. Ordinal, Poisson and binomial negative regression models identified which brain lesions accounted for clinical outcomes.

Results

Brain lesions were most frequently located in the ventral posterior lateral thalamus and the frontal lobe. Gross (B = 0.180, p < .001; B = 0.658, p < .001) and fine (B = 0.136, p = .003; B = 0.540, p < .001) motor function were associated with global sqMRI score and parietal involvement. Communication functioning was associated with putamen involvement (B = 0.747, p < .028). Intellectual functioning was associated with global sqMRI score and posterior thalamus involvement (B = -0.018, p < .001; B = -0.192, p < .001). Selective attention was associated with global sqMRI score (B = -0.035, p < .001), parietal (B = -0.063, p = .023), and corpus callosum involvement (B = -0.448, p < .001). Visuospatial and visuoperceptive abilities were associated with global sqMRI score (B = -0.078, p = .007) and medial dorsal thalamus involvement (B = -0.139, p < .012), respectively.

Conclusions

Key clinical outcomes in DCP are associated with specific observable brain lesions as indexed by a simple lesion scoring system that relies only on standard clinical MRI.

Glued to Which Face? Attentional Priority Effect of Female Babyface and Male Mature Face

A more babyfaced individual is perceived as more child-like and this impression from babyface, as known as babyface effect, has an impact on social life among various age groups. In this study, the influence of babyfaces on visual selective attention was tested by cognitive task, demonstrating that the female babyface and male mature face would draw participants’ attention so that they take their eyes off more slowly. In Experiment 1, a detection task was applied to test the influence of babyfaces on visual selective attention. In this experiment, a babyface and a mature face with the same gender were presented simultaneously with a letter on one of them. The reaction time was shorter when the target letter was overlaid with a female babyface or male mature face, suggesting an attention capture effect. To explore how this competition influenced by attentional resources, we conducted Experiment 2 with a spatial cueing paradigm and controlled the attentional resources by cueing validity and inter-stimulus interval. In this task, the female babyface and male mature face prolonged responses to the spatially separated targets under the condition of an invalid and long interval pre-cue. This observation replicated the result of Experiment 1. This indicates that the female babyface and male mature face glued visual selective attention once attentional resources were directed to them. To further investigate the subliminal influence from a babyface, we used continuous flash suppression paradigm in Experiment 3. The results, again, showed the advantage of the female babyfaces and male mature faces: they broke the suppression faster than other faces. Our results provide primary evidence that the female babyfaces and male mature faces can reliably glue the visual selective attention, both supra- and sub-liminally.

Faces, people and the brain: The 45th Sir Frederic Bartlett Lecture

The fact that the face is a source of diverse social signals allows us to use face and person perception as a model system for asking important psychological questions about how our brains are organised. A key issue concerns whether we rely primarily on some form of generic representation of the common physical source of these social signals (the face) to interpret them, or instead create multiple representations by assigning different aspects of the task to different specialist components. Variants of the specialist components hypothesis have formed the dominant theoretical perspective on face perception for more than three decades, but despite this dominance of formally and informally expressed theories, the underlying principles and extent of any division of labour remain uncertain. Here, I discuss three important sources of constraint: first, the evolved structure of the brain; second, the need to optimise responses to different everyday tasks; and third, the statistical structure of faces in the perceiver's environment. I show how these constraints interact to determine the underlying functional organisation of face and person perception.