The MR2: A multi-racial, mega-resolution database of facial stimuli

Diverse Face Images (DFI): Validated for racial representation and eye gaze

Face processing is a central component of human communication and social engagement. The present investigation introduces a set of racially and ethnically inclusive faces created for researchers interested in perceptual and socio-cognitive processes linked to human faces. The Diverse Face Images (DFI) stimulus set includes high-quality still images of female faces that are racially and ethnically representative, include multiple images of direct and indirect gaze for each model and control for low-level perceptual variance between images. The DFI stimuli will support researchers interested in studying face processing throughout the lifespan as well as other questions that require a diversity of faces or gazes. This report includes a detailed description of stimuli development and norming data for each model. Adults completed a questionnaire rating each image in the DFI stimuli set on three major qualities relevant to face processing: (1) strength of race/ethnicity group associations, (2) strength of eye gaze orientation, and (3) strength of emotion expression. These validation data highlight the presence of rater variability within and between individual model images as well as within and between race and ethnicity groups.

The self can be associated with novel faces of in-group and out-group members: A cross-cultural study

The self can be associated with arbitrary images, such as geometric figures or unknown faces. By adopting a cross-cultural perspective, we explored in two experiments whether the self can be associated with faces of unknown people from different ethnic groups. In Experiment 1, Asian Japanese participants completed a perceptual matching task, associating Asian or White faces with themselves. The same task was used in Experiment 2 with White Italians. Both experiments showed a reliable association between the self and facial stimuli. Importantly, this association was similar for both Asian and White faces. Additionally, no correlations were found between the strength of this association and an index of implicit bias towards Asian and White individuals. These results suggest that the self is malleable and can incorporate social stimuli from different groups.

Different features for different races: Tracking the eyes of Asian, Black, and White participants viewing Asian, Black, and White Faces

The own-race bias (ORB) is an effect in which humans remember faces from their own race better than faces from another race. Where people look when processing faces of different races plays a role in this effect, but the exact relationship between looking and the ORB is debated. One perspective is that the same facial features are important for memory for faces of all races and the ORB emerges when people look longer at the useful features for own- than other-race faces. Another perspective is that different facial features are useful for faces of different races and the ORB emerges when people look longer at features that are useful for their own race than at features that are useful for other-race faces. The present study aimed to discriminate these perspectives by examining looking patterns in Asian, Black, and White participants while they learned and later recognized Asian, Black, and White faces. Regardless of their race, participants looked at different facial features depending on the race of the face. In addition, different features were useful for memory depending on the race of the face. As such, results are in line with the perspective that different facial features are useful for different race faces.

A scoping review and index of body stimuli in psychological science

Naturalistic body stimuli are necessary for understanding many aspects of human psychology, yet there are no centralized databases of body stimuli. Furthermore, there are a high number of independently developed stimulus sets lacking in standardization and reproducibility potential, and a general lack of organization, contributing to issues of both replicability and generalizability in body-related research. We conducted a comprehensive scoping review to index and explore existing naturalistic whole-body stimuli. Our research questions were as follows: (1) What sets of naturalistic human whole-body stimuli are present in the literature? And (2) On what factors (e.g., demographics, emotion expression) do these stimuli vary? To be included, stimulus sets had to (1) include human bodies as stimuli; (2) be photographs, videos, or other depictions of real human bodies (not computer generated, drawn, etc.); (3) include the whole body (defined as torso, arms, and legs); and (4) could include edited images, but still had to be recognizable as human bodies. We identified a relatively large number of existing stimulus sets (N = 79) which offered relative variability in terms of main manipulated factors and the degree of visual information included (i.e., inclusion of heads and/or faces). However, stimulus sets were demographically homogenous, skewed towards White, young adult, and female bodies. We identified significant issues in reporting and availability practices, posing a challenge to the generalizability, reliability, and reproducibility of body-related research. Accordingly, we urge researchers to adopt transparent and accessible practices and to take steps to diversify body stimuli.

Implicit bias and experience influence overall but not relative trustworthiness judgment of other-race faces

Impressions of trustworthiness are formed quickly from faces. To what extent are these impressions shared among observers of the same or different races? Although high consensus of trustworthiness evaluation has been consistently reported, recent studies suggested substantial individual differences. For instance, negative implicit racial bias and low contact experience towards individuals of the other race have been shown to be related to low trustworthiness judgments for other-race faces. This pre-registered study further examined the effects of implicit social bias and experience on trustworthiness judgments of other-race faces. A relatively large sample of White (N = 338) and Black (N = 299) participants completed three tasks: a trustworthiness rating task of faces, a race implicit association test, and a questionnaire of experience. Each participant rated trustworthiness of 100 White faces and 100 Black faces. We found that the overall trustworthiness ratings for other-race faces were influenced by both implicit bias and experience with individuals of the other-race. Nonetheless, when comparing to the own-race baseline ratings, high correlations were observed for the relative differences in trustworthiness ratings of other-race faces for participants with varied levels of implicit bias and experience. These results suggest differential impact of social concepts (e.g., implicit bias, experience) vs. instinct (e.g., decision of approach-vs-avoid) on trustworthiness impressions, as revealed by overall vs. relative ratings on other-race faces.

Testing the effects of gaze distractors with invariant spatial direction on attention cueing

In four experiments, we tested the boundary conditions of gaze cueing with reference to the resistance to suppression criterion of automaticity. Participants were asked to respond to peripheral targets preceded by a central gaze stimulus. Under one condition, gaze direction was random and uninformative with respect to target location (intermixed condition), as in the typical paradigm. Under another condition, gaze direction was uninformative and, crucially, it was also kept constant throughout the sequence of trials (blocked condition). In so doing, we aimed at maximally reducing the informative value of the gaze stimulus because gaze would not only be task-irrelevant but would also provide no sudden and unpredictable information. Across the four experiments, the results showed a strong gaze-cueing effect. More specifically, a comparable gaze cueing emerged under the blocked and intermixed conditions. These findings are consistent with the idea that gaze cueing is resistant to suppression and are discussed in relation to current views of the automaticity of gaze cueing.

Interactive effects of participant and stimulus race on cognitive performance in youth: Insights from the ABCD study

An extensive literature shows that race information can impact cognitive performance. Two key findings include an attentional bias to Black racial cues in U.S. samples and diminished recognition of other-race faces compared to same-race faces in predominantly White adult samples. Yet face stimuli are increasingly used in psychological research often unrelated to race (Conley et al., 2018) or without consideration for how race information may influence cognitive performance, especially among developmental participants from different racial groups. In the current study we used open-access data from the Adolescent Brain Cognitive DevelopmentSM (ABCD) Study® 4.0.1 release to test for developmentally similar other- and same-race effects of Black and White face stimuli on attention, working memory, and recognition memory in 9- and 10-year-old Black and White children (n=5,659) living in the U.S. Black and White children showed better performance when attending to Black versus White faces. We also show an advantage in recognition memory of same-race compared to other-race faces in White children that did not generalize to Black children. Together the findings highlight how race information, even when irrelevant to an experiment, may indirectly lead to misinterpretation of group differences in cognitive performance in children of different racial backgrounds.

Defining Ideal Double Eyelids With a Morphometric Analysis in Asians

BACKGROUND

Double eyelids are always considered crucial aesthetic symbols. Despite numerous studies conducted on the attractiveness of double eyelids, there remains a dearth of research on quantitative and morphological evaluation of ideal double eyelids.

OBJECTIVES

In this we study aimed to investigate the optimal height and morphological characteristics of ideal double eyelids.

METHODS

Participants were presented with a total of 9 images, consisting of 1 single eyelid image and 8 double eyelid images, featuring 2 distinct shapes and 4 varied pretarsal shows. Respondents were instructed to assign scores ranging from 1 (least attractive) to 5 (most attractive) for each image. Subsequently, the scores for each image were analyzed based on population demographics, followed by the calculation of aesthetic metrics.

RESULTS

The whole cohort deemed images with a 2-mm fold to be more attractive than 1 mm (P < .001), followed by 3 mm and 0 mm (single eyelid), and finally, 4 mm. Morphologically, significant differences were found between images with the same pretarsal shows of 3 mm (P < .001) and 4 mm (P = .026). Most subgroup analysis results were aligned with those of the cohort, with gender being the most significant factor in distinguishing double eyelid aesthetics. Additionally, aesthetic characteristics of 2-mm folds were found to be comparable to appealing double eyelids in previous studies.

CONCLUSIONS

In this study we validated the optimal heights and morphology of double eyelids, thereby addressing the existing gap in aesthetic studies on double eyelids. These findings hold significant implications for surgical planning, effect assessment, and other periocular procedures related to upper blepharoplasty.

LEVEL OF EVIDENCE: 4

Vienna Talking Faces (ViTaFa): A multimodal person database with synchronized videos, images, and voices

Social perception relies on different sensory channels, including vision and audition, which are specifically important for judgements of appearance. Therefore, to understand multimodal integration in person perception, it is important to study both face and voice in a synchronized form. We introduce the Vienna Talking Faces (ViTaFa) database, a high-quality audiovisual database focused on multimodal research of social perception. ViTaFa includes different stimulus modalities: audiovisual dynamic, visual dynamic, visual static, and auditory dynamic. Stimuli were recorded and edited under highly standardized conditions and were collected from 40 real individuals, and the sample matches typical student samples in psychological research (young individuals aged 18 to 45). Stimuli include sequences of various types of spoken content from each person, including German sentences, words, reading passages, vowels, and language-unrelated pseudo-words. Recordings were made with different emotional expressions (neutral, happy, angry, sad, and flirtatious). ViTaFa is freely accessible for academic non-profit research after signing a confidentiality agreement form via https://osf.io/9jtzx/ and stands out from other databases due to its multimodal format, high quality, and comprehensive quantification of stimulus features and human judgements related to attractiveness. Additionally, over 200 human raters validated emotion expression of the stimuli. In summary, ViTaFa provides a valuable resource for investigating audiovisual signals of social perception.

The pictorial set of Emotional Social Interactive Scenarios between Chinese Adults (ESISCA): Development and validation

Affective picture databases with a single facial expression or body posture in one image have been widely applied to investigate emotion. However, to date, there was no standardized database containing the stimuli which involve multiple emotional signals in social interactive scenarios. The current study thus developed a pictorial set comprising 274 images depicting two Chinese adults' interactive scenarios conveying emotions of happiness, anger, sadness, fear, disgust, and neutral. The data of the valence and arousal ratings of the scenes and the emotional categories of the scenes and the faces in the images were provided in the present study. Analyses of the data collected from 70 undergraduate students suggested high reliabilities of the valence and arousal ratings of the scenes and high judgmental agreements in categorizing the scene and facial emotions. The findings suggested that the present dataset is well constructed and could be useful for future studies to investigate the emotion recognition or empathy in social interactions in both healthy and clinical (e.g., ASD) populations.

Rapid, concerted switching of the neural code in inferotemporal cortex

A fundamental paradigm in neuroscience is the concept of neural coding through tuning functions 1 . According to this idea, neurons encode stimuli through fixed mappings of stimulus features to firing rates. Here, we report that the tuning of visual neurons can rapidly and coherently change across a population to attend to a whole and its parts. We set out to investigate a longstanding debate concerning whether inferotemporal (IT) cortex uses a specialized code for representing specific types of objects or whether it uses a general code that applies to any object. We found that face cells in macaque IT cortex initially adopted a general code optimized for face detection. But following a rapid, concerted population event lasting < 20 ms, the neural code transformed into a face-specific one with two striking properties: (i) response gradients to principal detection-related dimensions reversed direction, and (ii) new tuning developed to multiple higher feature space dimensions supporting fine face discrimination. These dynamics were face specific and did not occur in response to objects. Overall, these results show that, for faces, face cells shift from detection to discrimination by switching from an object-general code to a face-specific code. More broadly, our results suggest a novel mechanism for neural representation: concerted, stimulus-dependent switching of the neural code used by a cortical area.

The role of fear of evaluation in group perception

Social anxiety disorder (SAD) is associated with interpersonal impairment. One possible reason for this dysfunction is that people with SAD evaluate others differently on dimensions of warmth and dominance compared to individuals without the disorder. In the current study, we examined whether two core constructs of SAD, fear of negative evaluation and fear of positive evaluation, affect the judgments that people make about groups based on warmth and dominance. We also investigated whether racial similarity (i.e., whether someone is the same race as those they're interacting with) and ethnic identity (i.e., one's sense of belonging to a particular social group) played a role in the types of evaluations people made. We created vignettes about groups varying in warmth and dominance, as well as photos varying in racial makeup. We presented photo-vignette pairs to participants and asked them to rate their desire to interact with the groups depicted in the photo-vignette. Participants in general reported greater desire to interact with warmer and less dominant groups. People with higher fear of negative evaluation reported higher desire for interaction with warmer groups, and those with higher fear of positive evaluation reported higher desire to interact with less dominant groups. We did not find any support for our hypothesis that people with stronger ethnic identity would show greater desire to interact with groups that were more similar to their race. Implications for treatment and directions for further research are discussed.

Are eyes special? Gaze, but not pointing gestures, elicits a reversed congruency effect in a spatial Stroop task

Gaze stimuli can shape attention in a peculiar way as compared to non-social stimuli. For instance, in a spatial Stroop task, gaze stimuli elicit a reversed congruency effect (i.e., faster responses on incongruent than on congruent trials) as compared to arrows, for which a standard congruency effect emerges. Here, we tested whether the reversed congruency effect observed for gaze can emerge for other social signals such as pointing gestures. Participants discriminated the direction (left or right) indicated by gaze and pointing finger stimuli that appeared leftwards or rightwards with respect to a central fixation spot. Arrows were also employed as control non-social stimuli. A reversed congruency effect emerged for the gaze, whereas a standard congruency effect emerged for both the pointing finger and the arrows. This suggests that the reversed congruency effect is specific to gaze stimuli and does not embrace all social signals conveying spatial information.

Linguistic identity as a modulator of gaze cueing of attention

Eye-gaze stimuli can elicit orienting of attention in an observer, a phenomenon known as gaze cueing of attention. Here, we explored whether gaze cueing can be shaped by the linguistic identity of the cueing face. In two experiments, participants were first familiarized with different faces together with auditory sentences. Half of the sentences were associated with the native language of the participants (Italian) and the other half with an unknown language (Albanian and Basque, in Experiments 1 and 2, respectively). In a second phase, participants performed a gaze-cueing task. In a third recognition phase, the auditory sentences were presented again, and participants were required to decide which face uttered each sentence. Results indicated that participants were more likely to confuse faces from the same language category than from the other language category. Results of the gaze-cueing task revealed a greater gaze-cueing effect for faces associated with the native vs. unknown language. Critically, this difference emerged only in Experiment 1, which may reflect differences in social status between the two language groups. Our findings revealed the impact of language as a social cue on the gaze-cueing effect, suggesting that social attention is sensitive to the language of our interlocutors.

Prefrontal cortex state representations shape human credit assignment

People learn adaptively from feedback, but the rate of such learning differs drastically across individuals and contexts. Here, we examine whether this variability reflects differences in what is learned. Leveraging a neurocomputational approach that merges fMRI and an iterative reward learning task, we link the specificity of credit assignment-how well people are able to appropriately attribute outcomes to their causes-to the precision of neural codes in the prefrontal cortex (PFC). Participants credit task-relevant cues more precisely in social compared vto nonsocial contexts, a process that is mediated by high-fidelity (i.e., distinct and consistent) state representations in the PFC. Specifically, the medial PFC and orbitofrontal cortex work in concert to match the neural codes from feedback to those at choice, and the strength of these common neural codes predicts credit assignment precision. Together this work provides a window into how neural representations drive adaptive learning.

Can masked gaze and arrow stimuli elicit overt orienting of attention? A registered report

Viewing an averted gaze can elicit saccades towards the corresponding location. Here, the automaticity of this gaze-following behaviour phenomenon was further tested by exploring whether such an effect can be detected in response to briefly-presented masked averted gazes. Participants completed an oculomotor interference task consisting of making leftward/rightward saccades according to a symbolic instruction cue. Crucially, either a task-irrelevant averted-gaze face or an arrow (i.e., a non-social control stimulus) was also presented in different blocks of trials. Faces and arrows were presented for either 1000 ms, or 8 ms and then backward-masked, to reduce the likelihood of conscious processing. Worse oculomotor performance emerged when the saccade direction did not match (vs match) that suggested by the task-irrelevant gaze/arrow stimuli in the unmasked condition. However, in the masked condition, no oculomotor interference occurred for any task-irrelevant stimulus. Results enrich knowledge about boundary conditions for gaze/arrow-driven orienting using ecological attention measures.

When interlocutor's face-language matching alters: An ERP study on face contexts and bilingual language control in mixed-language picture naming

The present study used event-related potentials (ERP) to examine Chinese-English bilinguals' reactive and proactive language control as they performed mixed-language picture naming with face cues. All participants named pictures in Chinese (first language, L1) and English (second language, L2) across three sessions: a 25% face-language matched session, a baseline session without face cues, and a 75% face-language matched session. Behavioral analyses for reactive language control showed that the asymmetrical switch cost was larger for L2 than L1 in the 25% session and for L1 than L2 in the 75% session. ERP results revealed more negative N2 and LPC during L1 switching in 25% session but enhanced N2 during L2 switching in 75% session. Similar N2 and LPC effect was found during L1 and L2 switching in the baseline context. For proactive language control, the reversed language dominance and enhanced LPC amplitudes during L2 naming were consistent across the three sessions. Our findings suggest that reactive but not proactive language control is modulated by the ever-changing face contexts, which highlights the highly flexible bilingual control systems subserving nonlinguistic cues.

Capacity limits in face detection

Face detection is a prerequisite for further face processing, such as extracting identity or semantic information. Those later processes appear to be subject to strict capacity limits, but the location of the bottleneck is unclear. In particular, it is not known whether the bottleneck occurs before or after face detection. Here we present a novel test of capacity limits in face detection. Across four behavioural experiments, we assessed detection of multiple faces via observers' ability to differentiate between two types of display. Fixed displays comprised items of the same type (all faces or all non-faces). Mixed displays combined faces and non-faces. Critically, a 'fixed' response requires all items to be processed. We found that additional faces could be detected with no cost to efficiency, and that this capacity-free performance was contingent on visual context. The observed pattern was not specific to faces, but detection was more efficient for faces overall. Our findings suggest that strict capacity limits in face perception occur after the detection step.

Cross-cultural evidence of a space-ethnicity association in face categorisation

According to a space-valence association, individuals tend to relate negatively- and positively-connoted stimuli with the left and right side of space, respectively. So far, only a few studies have explored whether this phenomenon can also emerge for social dimensions associated with facial stimuli. Here, we adopted a cross-cultural approach and conducted two experiments with the main aim to test whether a left–right space-valence association can also emerge for other- vs. own-race faces. Asian Japanese (Experiment 1) and White Italian (Experiment 2) participants engaged in a speeded binary classification task in which a central placed face had to be classified as either Asian or White. Manual responses were provided through a left- vs. right-side button. In both experiments, other-race faces elicited faster responses than own-race faces, in line with the well-documented other-race categorisation advantage. Moreover, evidence of an association between space and ethnic membership also arose and, interestingly, was similar in both groups. Indeed, Asian faces were responded to faster with the right-side key than with the left-side key, whereas response side had no effect for White faces. These results are discussed with regard to possible cross-cultural differences in group perception.

The Face Image Meta-Database (fIMDb) & ChatLab Facial Anomaly Database (CFAD): Tools for research on face perception and social stigma

Investigators increasingly need high quality face photographs that they can use in service of their scholarly pursuits-whether serving as experimental stimuli or to benchmark face recognition algorithms. Up to now, an index of known face databases, their features, and how to access them has not been available. This absence has had at least two negative repercussions: First, without alternatives, some researchers may have used face databases that are widely known but not optimal for their research. Second, a reliance on databases comprised only of young white faces will lead to science that isn't representative of all the people whose tax contributions, in many cases, make that research possible. The "Face Image Meta-Database" (fIMDb) provides researchers with the tools to find the face images best suited to their research, with filters to locate databases with people of a varied racial and ethnic backgrounds and ages. Problems of representation in face databases are not restricted to race and ethnicity or age - there is a dearth of databases with faces that have visible differences (e.g., scars, port wine stains, and cleft lip and palate). A well-characterized database is needed to support programmatic research into perceivers' attitudes, behaviors, and neural responses to anomalous faces. The "ChatLab Facial Anomaly Database" (CFAD) was constructed to fill this gap, with photographs of faces with visible differences of various types, etiologies, sizes, locations, and that depict individuals from various ethnic backgrounds and age groups. Both the fIMDb and CFAD are available from: https://cliffordworkman.com/resources/.

Increased gaze cueing of attention during COVID-19 lockdown

Affiliation with others is a basic human need. The lockdown implemented for counteracting the COVID-19 pandemic has determined an unprecedented situation of social deprivation, forcing individuals to dramatically reduce face-to-face interactions. This, in turn, has caused relevant consequences on psychological well-being. However, the impact of lockdown-related social isolation on basic cognitive processes is still largely unknown. Here, we focus on social attention and address gaze cueing, namely the ability to shift attention in response to the gaze of others. This is a hard-wired cognitive mechanism critically supporting the establishment of social interactions and pervasive relationships among individuals. Our results show a stronger gaze-cueing effect during, rather than after, the lockdown, whose magnitude was positively correlated with social isolation distress. These findings indicate that, in a condition of prolonged social deprivation, orienting of attention may be shaped by hypersensitivity to social cues, likely due to the strive to reconnect with others.

•

The impact of COVID-19 lockdown on cognitive processes is still largely unexplored

•

We focus on gaze cueing of attention as a building block of social interaction

•

Gaze cueing was larger during the lockdown than after the lockdown

•

Social deprivation is associated with increased sensitivity to the eyes of others

Unsupervised deep learning identifies semantic disentanglement in single inferotemporal face patch neurons

In order to better understand how the brain perceives faces, it is important to know what objective drives learning in the ventral visual stream. To answer this question, we model neural responses to faces in the macaque inferotemporal (IT) cortex with a deep self-supervised generative model, β-VAE, which disentangles sensory data into interpretable latent factors, such as gender or age. Our results demonstrate a strong correspondence between the generative factors discovered by β-VAE and those coded by single IT neurons, beyond that found for the baselines, including the handcrafted state-of-the-art model of face perception, the Active Appearance Model, and deep classifiers. Moreover, β-VAE is able to reconstruct novel face images using signals from just a handful of cells. Together our results imply that optimising the disentangling objective leads to representations that closely resemble those in the IT at the single unit level. This points at disentangling as a plausible learning objective for the visual brain.

Little is known about the brain’s computations that enable the recognition of faces. Here, the authors use unsupervised deep learning to show that the brain disentangles faces into semantically meaningful factors, like age or the presence of a smile, at the single neuron level.

Face Masks Do Not Alter Gaze Cueing of Attention: Evidence From the COVID-19 Pandemic

Interacting with others wearing a face mask has become a regular worldwide practice since the beginning of the COVID-19 pandemic. However, the impact of face masks on cognitive mechanisms supporting social interaction is still largely unexplored. In the present work, we focused on gaze cueing of attention, a phenomenon tapping the essential ability which allows individuals to orient their attentional resources in response to eye gaze signals coming from others. Participants from both a European (i.e., Italy; Experiment 1) and an Asian (i.e., China; Experiment 2) country were involved, namely two countries in which the daily use of face masks before COVID-19 pandemic was either extremely uncommon or frequently adopted, respectively. Both samples completed a task in which a peripheral target had to be discriminated while a task irrelevant averted gaze face, wearing a mask or not, acted as a central cueing stimulus. Overall, a reliable and comparable gaze cueing emerged in both experiments, independent of the mask condition. These findings suggest that gaze cueing of attention is preserved even when the person perceived is wearing a face mask.

Line Drawings for Face Portraits From Photos Using Global and Local Structure Based GANs

Despite significant effort and notable success of neural style transfer, it remains challenging for highly abstract styles, in particular line drawings. In this paper, we propose APDrawingGAN++, a generative adversarial network (GAN) for transforming face photos to artistic portrait drawings (APDrawings), which addresses substantial challenges including highly abstract style, different drawing techniques for different facial features, and high perceptual sensitivity to artifacts. To address these, we propose a composite GAN architecture that consists of local networks (to learn effective representations for specific facial features) and a global network (to capture the overall content). We provide a theoretical explanation for the necessity of this composite GAN structure by proving that any GAN with a single generator cannot generate artistic styles like APDrawings. We further introduce a classification-and-synthesis approach for lips and hair where different drawing styles are used by artists, which applies suitable styles for a given input. To capture the highly abstract art form inherent in APDrawings, we address two challenging operations-(1) coping with lines with small misalignments while penalizing large discrepancy and (2) generating more continuous lines-by introducing two novel loss terms: one is a novel distance transform loss with nonlinear mapping and the other is a novel line continuity loss, both of which improve the line quality. We also develop dedicated data augmentation and pre-training to further improve results. Extensive experiments, including a user study, show that our method outperforms state-of-the-art methods, both qualitatively and quantitatively.

Why is the literature on first impressions so focused on White faces?

We spontaneously attribute to strangers a wide variety of character traits based on their facial appearance. While these first impressions have little or no basis in reality, they exert a strong influence over our behaviour. Cognitive scientists have revealed a great deal about first impressions from faces including their factor structure, the cues on which they are based, the neurocognitive mechanisms responsible, and their developmental trajectory. In this field, authors frequently strive to remove as much ethnic variability from stimulus sets as possible. Typically, this convention means that participants are asked to judge the likely traits of White faces only. In the present article, we consider four possible reasons for the lack of facial diversity in this literature and find that it is unjustified. Next, we illustrate how the focus on White faces has undermined scientific efforts to understand first impressions from faces and argue that it reinforces socially regressive ideas about 'race' and status. We go on to articulate our concern that opportunities may be lost to leverage the knowledge derived from the study of first impressions against the dire consequences of prejudice and discrimination. Finally, we highlight some promising developments in the field.

Inferences on a multidimensional social hierarchy use a grid-like code

Generalizing experiences to guide decision-making in novel situations is a hallmark of flexible behavior. Cognitive maps of an environment or task can theoretically afford such flexibility, but direct evidence has proven elusive. In this study, we found that discretely sampled abstract relationships between entities in an unseen two-dimensional social hierarchy are reconstructed into a unitary two-dimensional cognitive map in the hippocampus and entorhinal cortex. We further show that humans use a grid-like code in entorhinal cortex and medial prefrontal cortex for inferred direct trajectories between entities in the reconstructed abstract space during discrete decisions. These grid-like representations in the entorhinal cortex are associated with decision value computations in the medial prefrontal cortex and temporoparietal junction. Collectively, these findings show that grid-like representations are used by the human brain to infer novel solutions, even in abstract and discrete problems, and suggest a general mechanism underpinning flexible decision-making and generalization.

Conducting decoded neurofeedback studies

Closed-loop neurofeedback has sparked great interest since its inception in the late 1960s. However, the field has historically faced various methodological challenges. Decoded fMRI neurofeedback may provide solutions to some of these problems. Notably, thanks to the recent advancements of machine learning approaches, it is now possible to target unconscious occurrences of specific multivoxel representations. In this tools of the trade paper, we discuss how to implement these interventions in rigorous double-blind placebo-controlled experiments. We aim to provide a step-by-step guide to address some of the most common methodological and analytical considerations. We also discuss tools that can be used to facilitate the implementation of new experiments. We hope that this will encourage more researchers to try out this powerful new intervention method.

Are You Able to Trust Me? Analysis of the Relationships Between Personality Traits and the Assessment of Attractiveness and Trust

Behavioral and neuroimaging studies show that people trust and collaborate with others based on a quick assessment of the facial appearance. Based on the morphological characteristics of the face, i.e., features, shape, or color, it is possible to determine health, attractiveness, trust, and some personality traits. The study attempts to indicate the features influencing the perception of attractiveness and trust. In order to select individual factors, a model of backward stepwise logistic regression was used, analyzing the results of the psychological tests and the attractiveness and trust survey. Statistical analysis made it possible to select the most important personality traits related to attractiveness and trust assessments.

Non-phase-locked alpha oscillations are involved in spontaneous racial categorization of faces

Racial categorization of faces has a notable impact on human behavior, but its neural underpinnings remain unresolved. Previous electroencephalography (EEG) research focused on contributions of phase-locked neural activities to racial categorization of faces. We investigated functional roles of non-phase-locked neural oscillations in spontaneous racial categorization of faces by recording EEG from Chinese adults who performed an individuation task on Asian/White faces in Experiment 1 and on Asian/Black faces in Experiment 2. We quantified neural processes involved in spontaneous racial categorization of faces by examining repetition suppression of non-phase-locked neural oscillations when participants viewed faces of one race presented repeatedly in the same block of trials (repetition condition), or faces of two races presented alternately in the same block of trials (alternating condition). We found decreased power of alpha (9-13 Hz) oscillations in the repetition than alternating conditions at 80-240 ms over frontal-central electrodes induced by White/Black (but not Asian) faces. Moreover, larger repetition suppression of alpha oscillations in response to White/Black (vs. Asian) faces predicted greater implicit negative attitudes toward White/Black faces across individuals. Our findings suggest that non-phase-locked alpha oscillations are engaged in spontaneous racial categorization of faces and are associated with implicit negative attitudes toward other-race faces.

Explaining face representation in the primate brain using different computational models

Understanding how the brain represents the identity of complex objects is a central challenge of visual neuroscience. The principles governing object processing have been extensively studied in the macaque face patch system, a sub-network of inferotemporal (IT) cortex specialized for face processing. A previous study reported that single face patch neurons encode axes of a generative model called the "active appearance" model, which transforms 50D feature vectors separately representing facial shape and facial texture into facial images. However, a systematic investigation comparing this model to other computational models, especially convolutional neural network models that have shown success in explaining neural responses in the ventral visual stream, has been lacking. Here, we recorded responses of cells in the most anterior face patch anterior medial (AM) to a large set of real face images and compared a large number of models for explaining neural responses. We found that the active appearance model better explained responses than any other model except CORnet-Z, a feedforward deep neural network trained on general object classification to classify non-face images, whose performance it tied on some face image sets and exceeded on others. Surprisingly, deep neural networks trained specifically on facial identification did not explain neural responses well. A major reason is that units in the network, unlike neurons, are less modulated by face-related factors unrelated to facial identification, such as illumination.

Complementary Structure-Learning Neural Networks for Relational Reasoning

The neural mechanisms supporting flexible relational inferences, especially in novel situations, are a major focus of current research. In the complementary learning systems framework, pattern separation in the hippocampus allows rapid learning in novel environments, while slower learning in neocortex accumulates small weight changes to extract systematic structure from well-learned environments. In this work, we adapt this framework to a task from a recent fMRI experiment where novel transitive inferences must be made according to implicit relational structure. We show that computational models capturing the basic cognitive properties of these two systems can explain relational transitive inferences in both familiar and novel environments, and reproduce key phenomena observed in the fMRI experiment.

Protocol for building a cognitive map of structural knowledge in humans by integrating abstract relationships from separate experiences

Humans are adept at learning the latent structure of the relationship between abstract concepts and can build a cognitive map from limited experiences. However, examining internal representations of the cognitive map is challenging because they are unobservable and differ across individuals. Here, we introduce a behavioral training protocol designed for human participants to implicitly build a map of two-dimensional social hierarchies while making a series of binary choices and analytic tools for measuring the internal representation of this structural knowledge. For complete details on the use and execution of this protocol, please refer to Park et al. (2020a, 2020b).

Perceptual and computational detection of face morphing

A relatively new type of identity theft uses morphed facial images in identification documents in which images of two individuals are digitally blended to create an image that maintains a likeness to each of the original identities. We created a set of high-quality digital morphs from passport-style photos for a diverse set of people across gender, race, and age. We then examine people's ability to detect facial morphing both in terms of determining if two side-by-side faces are of the same individual or not and in terms of identifying if a face is the result of digital morphing. We show that human participants struggle at both tasks. Even modern machine-learning-based facial recognition struggles to distinguish between an individual and their morphed version. We conclude with a hopeful note, describing a computational technique that holds some promise in recognizing that one facial image is a morphed version of another.

Transforming faces to mimic natural kin: A comparison of different paradigms

The ability to detect phenotypic similarity or kinship in third-parties' faces is not perfect, but better than chance. Still, some humans are better than others at this task. Yet researchers in kinship detection have difficulties in building up large and diverse datasets of high-quality pictures of related persons. The current experiments tested a novel method for circumventing this difficulty by using morphing techniques in order to generate a wide array of stimuli derived from a limited number of individual pictures. Six experiments tested various stimuli (standard protocol, mirrored face, other-sex face, other-ethnicity face, other-expression face and antiface). Our benchmarks are the similarity or kinship scores achieved by participants when faced with pictures of real siblings. We show that all stimuli, except the antiface, elicit detection scores similar to those elicited by real pictures of actual siblings. In addition, by exploring different experiment parameters (simultaneous or sequential task, kinship or similarity task) and some individual characteristics, these experiments provide a better understanding of kinship detection in third parties. The validation of our new method will allow widening the range of available stimuli to the research community, and even to develop new ecologically relevant experimental protocols that are hardly or not feasible with veridical images.

Broadening the stimulus set: Introducing the American Multiracial Faces Database

Face-based perceptions form the basis for how people behave towards each other and, hence, are central to understanding human interaction. Studying face perception requires a large and diverse set of stimuli in order to make ecologically valid, generalizable conclusions. To date, there are no publicly available databases with a substantial number of Multiracial or racially ambiguous faces. Our systematic review of the literature on Multiracial person perception documented that published studies have relied on computer-generated faces (84% of stimuli), Black-White faces (74%), and male faces (63%). We sought to address these issues, and to broaden the diversity of available face stimuli, by creating the American Multiracial Faces Database (AMFD). The AMFD is a novel collection of 110 faces with mixed-race heritage and accompanying ratings of those faces by naive observers that are freely available to academic researchers. The faces (smiling and neutral expression poses) were rated on attractiveness, emotional expression, racial ambiguity, masculinity, racial group membership(s), gender group membership(s), warmth, competence, dominance, and trustworthiness. The large majority of the AMFD faces are racially ambiguous and can pass into at least two different racial categories. These faces will be useful to researchers seeking to study Multiracial person perception as well as those looking for racially ambiguous faces in order to study categorization processes in general. Consequently, the AMFD will be useful to a broad group of researchers who are studying face perception.

The Expressive Triad: Structure, Color, and Texture Similarity of Emotion Expressions Predict Impressions of Neutral Faces

Previous research has demonstrated how emotion resembling cues in the face help shape impression formation (i. e., emotion overgeneralization). Perhaps most notable in the literature to date, has been work suggesting that gender-related appearance cues are visually confounded with certain stereotypic expressive cues (see Adams et al., 2015 for review). Only a couple studies to date have used computer vision to directly map out and test facial structural resemblance to emotion expressions using facial landmark coordinates to estimate face shape. In one study using a Bayesian network classifier trained to detect emotional expressions structural resemblance to a specific expression on a non-expressive (i.e., neutral) face was found to influence trait impressions of others (Said et al., 2009). In another study, a connectionist model trained to detect emotional expressions found different emotion-resembling cues in male vs. female faces (Zebrowitz et al., 2010). Despite this seminal work, direct evidence confirming the theoretical assertion that humans likewise utilize these emotion-resembling cues when forming impressions has been lacking. Across four studies, we replicate and extend these prior findings using new advances in computer vision to examine gender-related, emotion-resembling structure, color, and texture (as well as their weighted combination) and their impact on gender-stereotypic impression formation. We show that all three (plus their combination) are meaningfully related to human impressions of emotionally neutral faces. Further when applying the computer vision algorithms to experimentally manipulate faces, we show that humans derive similar impressions from them as did the computer.

Recognizing Human Races through Machine Learning—A Multi-Network, Multi-Features Study

The human face holds a privileged position in multi-disciplinary research as it conveys much information—demographical attributes (age, race, gender, ethnicity), social signals, emotion expression, and so forth. Studies have shown that due to the distribution of ethnicity/race in training datasets, biometric algorithms suffer from “cross race effect”—their performance is better on subjects closer to the “country of origin” of the algorithm. The contributions of this paper are two-fold: (a) first, we gathered, annotated and made public a large-scale database of (over 175,000) facial images by automatically crawling the Internet for celebrities’ images belonging to various ethnicity/races, and (b) we trained and compared four state of the art convolutional neural networks on the problem of race and ethnicity classification. To the best of our knowledge, this is the largest, data-balanced, publicly-available face database annotated with race and ethnicity information. We also studied the impact of various face traits and image characteristics on the race/ethnicity deep learning classification methods and compared the obtained results with the ones extracted from psychological studies and anthropomorphic studies. Extensive tests were performed in order to determine the facial features to which the networks are sensitive to. These tests and a recognition rate of 96.64% on the problem of human race classification demonstrate the effectiveness of the proposed solution.

Map Making: Constructing, Combining, and Inferring on Abstract Cognitive Maps

Cognitive maps enable efficient inferences from limited experience that can guide novel decisions. We tested whether the hippocampus (HC), entorhinal cortex (EC), and ventromedial prefrontal cortex (vmPFC)/medial orbitofrontal cortex (mOFC) organize abstract and discrete relational information into a cognitive map to guide novel inferences. Subjects learned the status of people in two unseen 2D social hierarchies, with each dimension learned on a separate day. Although one dimension was behaviorally relevant, multivariate activity patterns in HC, EC, and vmPFC/mOFC were linearly related to the Euclidean distance between people in the mentally reconstructed 2D space. Hubs created unique comparisons between the hierarchies, enabling inferences between novel pairs. We found that both behavior and neural activity in EC and vmPFC/mOFC reflected the Euclidean distance to the retrieved hub, which was reinstated in HC. These findings reveal how abstract and discrete relational structures are represented, are combined, and enable novel inferences in the human brain.

Early Child Development Outcomes of a Randomized Trial Providing 1 Egg Per Day to Children Age 6 to 15 Months in Malawi

BACKGROUND

Eggs are a rich source of nutrients important for brain development, including choline, riboflavin, vitamins B-6 and B-12, folate, zinc, protein, and DHA.

OBJECTIVE

Our objective was to evaluate the effect of the consumption of 1 egg per day over a 6-mo period on child development.

METHODS

In the Mazira Project randomized controlled trial, 660 children aged 6-9 mo were randomly allocated into an intervention or control group. Eggs were provided to intervention households during twice-weekly home visits for 6 mo. Control households were visited at the same frequency. At enrollment, blinded assessors administered the Malawi Developmental Assessment Tool (MDAT), and 2 eye-tracking tasks using a Tobii-Pro X2-60 eye tracker: a visual paired comparison memory task and an Infant Orienting with Attention task. At endline, 6-mo later, blinded assessors administered the MDAT and eye-tracking tasks plus an additional elicited imitation memory task.

RESULTS

At endline, intervention and control groups did not significantly differ in any developmental score, with the exception that a smaller percentage of children were delayed in fine motor development in the intervention group (10.6%) compared with the control group (16.5%; prevalence ratio: 0.59, 95% CI: 0.38-0.91). Among 10 prespecified effect modifiers for the 8 primary developmental outcomes, we found 7 significant interactions demonstrating a consistent pattern that children who were less vulnerable, for example, those with higher household wealth and maternal education, showed positive effects of the intervention. Given multiple hypothesis testing, some findings may have been due to chance.

CONCLUSION

The provision of 1 egg per day had no overall effect on child development in this population of children, however, some benefits may be seen among children in less vulnerable circumstances. This trial was registered at clinicaltrials.gov as NCT03385252.

Darwin and the Situation of Emotion Research

This article demonstrates how researchers from both the sciences and the humanities can learn from Charles Darwin’s mixed methodology. We identify two basic challenges that face emotion research in the sciences, namely a mismatch between experiment design and the complexity of life that we aim to explain, and problematic efforts to bridge the gap, including invalid inferences from constrained study designs, and equivocal use of terms like “sympathy” and “empathy” that poorly reflect such methodological constraints. We argue that Darwin’s mixed methodology is a model for addressing these challenges even in laboratory work on emotion, because it shows how close observation of emotional phenomena makes sense only within broader historical contexts. The article concludes with 5 practical research recommendations.

FaReT: A free and open-source toolkit of three-dimensional models and software to study face perception

A problem in the study of face perception is that results can be confounded by poor stimulus control. Ideally, experiments should precisely manipulate facial features under study and tightly control irrelevant features. Software for 3D face modeling provides such control, but there is a lack of free and open source alternatives specifically created for face perception research. Here, we provide such tools by expanding the open-source software MakeHuman. We present a database of 27 identity models and six expression pose models (sadness, anger, happiness, disgust, fear, and surprise), together with software to manipulate the models in ways that are common in the face perception literature, allowing researchers to: (1) create a sequence of renders from interpolations between two or more 3D models (differing in identity, expression, and/or pose), resulting in a "morphing" sequence; (2) create renders by extrapolation in a direction of face space, obtaining 3D "anti-faces" and caricatures; (3) obtain videos of dynamic faces from rendered images; (4) obtain average face models; (5) standardize a set of models so that they differ only in selected facial shape features, and (6) communicate with experiment software (e.g., PsychoPy) to render faces dynamically online. These tools vastly improve both the speed at which face stimuli can be produced and the level of control that researchers have over face stimuli. We validate the face model database and software tools through a small study on human perceptual judgments of stimuli produced with the toolkit.

The Development of Intersectional Social Prototypes

Race and gender information overlap to shape adults’ representations of social categories. This overlap may contribute to the psychological “invisibility” of people whose race and gender identities are perceived to have conflicting stereotypes. The present research (N = 249) examined when race begins to bias representations of gender across development. Children and adults engaged in a speeded task in which they categorized photographs of faces of women and men from three racial categories: Asian, Black, and White (four photographs per gender and racial group). In Study 1, participants were slower to categorize photographs of Black women as women than photographs of White and Asian women as women and Black men as men. They also were more likely to miscategorize photographs of Black women as men and less likely to stereotype Black women as feminine. Study 2 replicated these findings and provided evidence of a developmental shift in categorization speed. An omnibus analysis provided a high-powered test of this developmental hypothesis, revealing that target race begins biasing children’s gender categorization around age 5. Implications for the development of social-category representation are discussed.

Faces under continuous flash suppression capture attention faster than objects, but without a face-evoked steady-state visual potential: Is curvilinearity responsible for the behavioral effect?

Face perception is a vital part of human social interactions. The social value of faces makes their efficient detection evolutionarily advantageous. It has been suggested that this might occur nonconsciously, but experimental results are equivocal thus far. Here, we probe nonconscious face perception using a novel combination of binocular rivalry with continuous flash suppression and steady-state visually evoked potentials. In the first two experiments, participants viewed either non-face objects, neutral faces (Study 1), or fearful faces (Study 2). Consistent with the hypothesis that faces are processed nonconsciously, we found that faces broke through suppression faster than objects. We did not, however, observe a concomitant face-selective steady-state visually evoked potential. Study 3 was run to reconcile this paradox. We hypothesized that the faster breakthrough time was due to a mid-level visual feature, curvilinearity, rather than high-level category membership, which would explain the behavioral difference without neural evidence of face-selective processing. We tested this hypothesis by presenting participants with four different groups of stimuli outside of conscious awareness: rectilinear objects (e.g., chessboard), curvilinear objects (e.g., dartboard), faces, and objects that were not dominantly curvilinear or rectilinear. We found that faces and curvilinear objects broke through suppression faster than objects and rectilinear objects. Moreover, there was no difference between faces and curvilinear objects. These results support our hypothesis that the observed behavioral advantage for faces is due to their curvilinearity, rather than category membership.

The Moral Psychology of Raceless, Genderless Strangers

Moral psychology uses tightly controlled scenarios in which the identities of the characters are either unspecified or vague. Studies with raceless, genderless strangers help to highlight the important structural elements of moral acts (e.g., intention, causation, harm) but may not generalize to real-world judgments. As researchers have long shown, social judgments hinge on the identities (e.g., race, gender, age, religion, group affiliation) of both target and perceiver. Asking whether people generally condemn “shooting someone” is very different from asking whether liberals as opposed to conservatives condemn “a White police officer shooting a Black suspect.” We argue for the importance of incorporating identity into moral psychology. We briefly outline the central role of identity in social judgments before reviewing current theories in moral psychology. We then advocate an expanded person-centered morality—synthesizing moral psychology with social cognition—to better capture everyday moral judgments.

Crowdsourcing punishment: Individuals reference group preferences to inform their own punitive decisions

Justice systems delegate punishment decisions to groups in the belief that the aggregation of individuals' preferences facilitates judiciousness. However, group dynamics may also lead individuals to relinquish moral responsibility by conforming to the majority's preference for punishment. Across five experiments (N = 399), we find Victims and Jurors tasked with restoring justice become increasingly punitive (by as much as 40%) as groups express a desire to punish, with every additional punisher augmenting an individual's punishment rates. This influence is so potent that knowing about a past group's preference continues swaying decisions even when they cannot affect present outcomes. Using computational models of decision-making, we test long-standing theories of how groups influence choice. We find groups induce conformity by making individuals less cautious and more impulsive, and by amplifying the value of punishment. However, compared to Victims, Jurors are more sensitive to moral violation severity and less readily swayed by the group. Conformity to a group's punitive preference also extends to weightier moral violations such as assault and theft. Our results demonstrate that groups can powerfully shift an individual's punitive preference across a variety of contexts, while additionally revealing the cognitive mechanisms by which social influence alters moral values.