Contributions of individual face features to face discrimination

A novel, rapid, quantitative method for face discrimination

Face discrimination ability has been widely studied in psychology, however a self-administered, adaptive method has not yet been developed. In this series of studies, we utilize Foraging Interactive D-prime (FInD) in conjunction with the Basel Face Model to quantify thresholds of face discrimination ability both in-lab and remotely. In Experiment 1, we measured sensitivity to changes for all 199 structural Principal Components of the Basel Face Model and found observers were most sensitive to the first 10 components, so we focused on these for the remaining studies. In Experiment 2, we remotely investigated how thresholds varied when one component changed, compared to when two components changed in combination. Thresholds measured remotely were not significantly different from those measured in-lab (t(14) = 0.23, p = .821), and thresholds were significantly lower for components in combination than alone (t(7) = 2.90, p = .023), consistent with probability summation and Euclidean distance between faces, but not superadditivity. In Experiment 3, we replicated Experiment 2 with slight rotation to the faces to prevent pointwise comparisons. Thresholds were higher with rotation (t(30) = 4.32, p < .001) and for single than combined components, but did not reach significance (t(7) = 2.24, p = .061). Charts were measured in approximately 25.90 ± 8.10 seconds.

The impact of the use of masks on trait judgments and face recognition

Although effective in reducing virus transmission, face masks might compromise face recognition and trait judgments. With this study, we aimed to observe the influence of masks on face recognition and trait judgments-more specifically, in trustworthiness, dominance, and distinctiveness judgments. Also, we wanted to observe the possible influence of trait judgments on facial recognition for masked and unmasked faces, which has never been done before. For that, we conducted an online study where 140 participants observed and made trait judgments of masked and unmasked faces in a within-subjects design. After a distractive task, participants performed a recognition memory test. As expected, we observed a better recognition of faces shown without a mask during the study phase, which allowed the holistic processing of the faces. The worst performance was found for faces encoded with a mask but tested without it, occurring simultaneity disruption in holistic face processing and the violation of the encoding specificity principle. Regarding the trait judgments, unmasked faces were considered more distinctive, and masked faces were considered more trustworthy. More interestingly, we can conclude that facial distinctiveness predicts face recognition, regardless of mask use. In contrast, dominance judgments only predicted face recognition when faces were presented without a mask. When faces were exposed with masks, trustworthiness overrides dominance, becoming more critical to recognizing faces. We can interpret these results from an evolutionary perspective.

Regression analysis of nasal shape from juvenile to adult ages for forensic facial reconstruction

The nose is a prominent feature for facial recognition and reconstruction. To investigate the relationship of the nasal shape with the piriform aperture in Korean adults and juveniles, we performed regression analysis. By regression analysis, prediction equations for nasal shape were obtained in relation to the shape of the piriform aperture considering sex and age groups. Three-dimensional skull and face models, rendered from computed tomography images, were assessed (331 males and 334 females). Juveniles (<20 years) were divided into three age groups according to the development of the dentition. Adults were divided into three age groups of two decades each, according to their age. To measure the nasal area, nine landmarks and nine measurements were chosen, while seven landmarks and five measurements were selected to measure the piriform aperture area. Four measurements were defined to explain the direct relationship between the nasal aperture and nasal shape. First, descriptive statistical analyses were performed according to sex and age groups. Subsequently, the correlation of nasal soft tissue measurements with piriform measurements was analyzed. Last, we performed a linear regression analysis of the measurements with higher correlations, considering sex and age groups as variables. Prediction equations were used to estimate the nasal bridge length, height, protrusion, and width. Equations considering sex and age groups showed better explanation ability. Measurements related to the height of the nasal bridge presented improvement. This study may assist in the more accurate approximation of nasal shape in facial reconstruction.

The effect of surgical masks on identification decisions from masked and unmasked lineups

While research has shown that wearing a disguise hinders lineup identifications, less is known about how to conduct lineups in cases of disguised perpetrators. We examined the influence of surgical masks, worn during a crime event (encoding) and within lineups (retrieval), on eyewitness identification accuracy. In our experiment, 452 participants watched a mock-crime video and identified the perpetrator from either a target-present or a target-absent simultaneous lineup. Contrary to expectations based on the encoding specificity principle, we did not find that matching the presence of masks in the lineup to the encoding condition increased identification accuracy. Instead, compared to the condition with no masks at encoding and retrieval, the presence of masks at either stage negatively affected discriminability and undermined the predictive utility of confidence and decision time. Our findings indicate that when a witness has encountered a masked perpetrator, presenting them with a masked lineup may not be necessary.

The impact of COVID-19 on memory: Recognition for masked and unmasked faces

Considering the current state of the worldwide pandemic, it is still common to encounter people wearing face protection masks. Although a safety measure against COVID-19, face masks might be compromising our capacity for face recognition. We conducted an online study where 140 participants observed masked and unmasked faces in a within-subjects design and then performed a recognition memory task. The best performance was found when there were no masks either at study and test phase, i.e., at the congruent unmasked condition. The worst performance was found for faces encoded with a mask but tested without it (i.e., masked-unmasked incongruent condition), which can be explained by the disruption in holistic face processing and the violation of the encoding specificity principle. Interestingly, considering the unmasked-masked incongruent condition, performance was probably affected by the violation of the encoding specificity principle but protected by holistic processing that occurred during encoding.

Healthy aging impairs face discrimination ability

Face images enable individual identities to be discriminated from one another. We aimed to quantify age-related changes in different aspects of face identity discrimination. Face discrimination sensitivity was measured with a memory-free "odd-one-out" task. Five age groups (N = 15) of healthy adults with normal vision were tested: 20, 50-59, 60-69, 70-79, and 80-89. Sensitivity was measured for full-face images (all features visible), external features (head-shape, hairline), internal features (nose, mouth, eyes, and eyebrows) and closed-contour shapes (control object). Sensitivity to full-faces continuously declined by approximately 13% per decade, after 50 years of age. When age-related differences in visual acuity were controlled, the effect of age on face discrimination sensitivity remained. Sensitivity to face features also deteriorated with age. Although the effect for external features was similar to full-faces, the rate of decline was considerably steeper (approximately 3.7 times) for internal, relative to external, features. In contrast, there was no effect of age on sensitivity to shapes. All age groups demonstrated the same overall pattern of sensitivity to different types of face information. Healthy aging was associated with a continuous decline in sensitivity to both full-faces and face features, although encoding of internal features was disproportionately impaired. This age-related deficit was independent of differences in low-level vision. That sensitivity to shapes was unaffected by age suggests these results cannot be explained by general cognitive decline or lower-level visual deficits. Instead, healthy aging is associated with a specific decline in the mechanisms that underlie face discrimination.

Peripheral facial features guiding eye movements and reducing fixational variability

Face processing is a fast and efficient process due to its evolutionary and social importance. A majority of people direct their first eye movement to a featureless point just below the eyes that maximizes accuracy in recognizing a person's identity and gender. Yet, the exact properties or features of the face that guide the first eye movements and reduce fixational variability are unknown. Here, we manipulated the presence of the facial features and the spatial configuration of features to investigate their effect on the location and variability of first and second fixations to peripherally presented faces. Our results showed that observers can utilize the face outline, individual facial features, and feature spatial configuration to guide the first eye movements to their preferred point of fixation. The eyes have a preferential role in guiding the first eye movements and reducing fixation variability. Eliminating the eyes or altering their position had the greatest influence on the location and variability of fixations and resulted in the largest detriment to face identification performance. The other internal features (nose and mouth) also contribute to reducing fixation variability. A subsequent experiment measuring detection of single features showed that the eyes have the highest detectability (relative to other features) in the visual periphery providing a strong sensory signal to guide the oculomotor system. Together, the results suggest a flexible multiple-cue approach that might be a robust solution to cope with how the varying eccentricities in the real world influence the ability to resolve individual feature properties and the preferential role of the eyes.

The impact of facemasks on emotion recognition, trust attribution and re-identification

Covid-19 pandemics has fostered a pervasive use of facemasks all around the world. While they help in preventing infection, there are concerns related to the possible impact of facemasks on social communication. The present study investigates how emotion recognition, trust attribution and re-identification of faces differ when faces are seen without mask, with a standard medical facemask, and with a transparent facemask restoring visual access to the mouth region. Our results show that, in contrast to standard medical facemasks, transparent masks significantly spare the capability to recognize emotional expressions. Moreover, transparent masks spare the capability to infer trustworthiness from faces with respect to standard medical facemasks which, in turn, dampen the perceived untrustworthiness of faces. Remarkably, while transparent masks (unlike standard masks) do not impair emotion recognition and trust attribution, they seemingly do impair the subsequent re-identification of the same, unmasked, face (like standard masks). Taken together, this evidence supports a dissociation between mechanisms sustaining emotion and identity processing. This study represents a pivotal step in the much-needed analysis of face reading when the lower portion of the face is occluded by a facemask.

Close facial emotions enhance physiological responses and facilitate perceptual discrimination

Accumulating evidence indicates that the peripersonal space (PPS) constitutes a privileged area for efficient processing of proximal stimuli, allowing to flexibly adapt our behavior both to the physical and social environment. Whether and how behavioral and physiological signatures of PPS relate to each other in emotional contexts remains, though, elusive. Here, we addressed this question by having participants to discriminate male from female faces depicting different emotions (happiness, anger or neutral) and presented at different distances (50 cm-300 cm) while we measured the reaction time and accuracy of their responses, as well as pupillary diameter, heart rate and heart rate variability. Results showed facilitation of participants' performances (i.e., faster response time) when faces were presented close compared to far from the participants, even when controlling for retinal size across distances. These behavioral effects were accompanied by significant modulation of participants' physiological indexes when faces were presented in PPS. Interestingly, both PPS representation and physiological signals were affected by features of the seen faces such as the emotional valence, its sex and the participants' sex, revealing the profound impact of social context onto the autonomic state and behavior within PPS. Together, these findings suggest that both external and internal signals contribute in shaping PPS representation.

The Effect of Age-Related Macular Degeneration on Components of Face Perception

Purpose

Patients with age-related macular degeneration (AMD) experience difficulty with discriminating between faces. We aimed to use a new clinical test to quantify the impact of AMD on face perception and to determine the specific aspects that are affected.

Methods

The Caledonian face test uses an adaptive procedure to measure face discrimination thresholds: the minimum difference required between faces for reliable discrimination. Discrimination thresholds were measured for full-faces, external features (head-shape and hairline), internal features (nose, mouth, eyes, and eyebrows) and shapes (non-face task). Participants were 20 patients with dry AMD (logMAR VA = 0.14 to 0.62), 20 patients with wet AMD (0.10 to 0.60), and 20 age-matched control subjects (−0.18 to +0.06).

Results

Relative to controls, full-face discrimination thresholds were, on average, 1.76 and 1.73 times poorer in participants with dry and wet AMD, respectively. AMD also reduced sensitivity to face features, but discrimination of the internal, relative to external, features was disproportionately impaired. Both distance VA and contrast sensitivity were significant independent predictors of full-face discrimination thresholds (R² = 0.66). Sensitivity to full-faces declined by a factor of approximately 1.19 per 0.1 logMAR reduction in VA.

Conclusions

Both dry and wet AMD significantly reduce sensitivity to full-faces and their component parts to similar extents. Distance VA and contrast sensitivity are closely associated with face discrimination sensitivity. These results quantify the extent of sensitivity impairment in patients with AMD and predict particular difficulty in everyday tasks that rely on internal feature information, including recognition of familiar faces and facial expressions.

Human Face Recognition in Horses: Data in Favor of a Holistic Process

Recent studies have demonstrated that horses can recognize humans based simply on visual information. However, none of these studies have investigated whether this involves the recognition of the face itself, or simply identifying people from non-complex external clues, such as hair color. To go beyond this we wanted to know whether certain features of the face were indispensable for this recognition (e.g., colors, hair or eyes). The 11 horses in this study had previously learned to identify four unfamiliar faces (portrait view and in color) presented repeatedly on a screen. We thus assessed whether they were able to identify these same faces spontaneously when they were presented in four other conditions: profile view, black and white, eyes hidden, changed hairstyle. The horses’ performances remained higher than chance level for all the conditions. In a choice test under real conditions, they then approached the people whose face they had learned more often than unknown people. In conclusion, when considering all the individuals studied, no single facial element that we tested appears to be essential for recognition, suggesting holistic processing in face recognition. That means horses do not base their recognition solely on an easy clue such as hair color. They can also link faces from photographs with people in real life, indicating that horses do not process images of faces as simple abstract shapes.

The Influence of Each Facial Feature on How We Perceive and Interpret Human Faces

Facial information is processed by our brain in such a way that we immediately make judgments about, for example, attractiveness or masculinity or interpret personality traits or moods of other people. The appearance of each facial feature has an effect on our perception of facial traits. This research addresses the problem of measuring the size of these effects for five facial features (eyes, eyebrows, nose, mouth, and jaw). Our proposal is a mixed feature-based and image-based approach that allows judgments to be made on complete real faces in the categorization tasks, more than on synthetic, noisy, or partial faces that can influence the assessment. Each facial feature of the faces is automatically classified considering their global appearance using principal component analysis. Using this procedure, we establish a reduced set of relevant specific attributes (each one describing a complete facial feature) to characterize faces. In this way, a more direct link can be established between perceived facial traits and what people intuitively consider an eye, an eyebrow, a nose, a mouth, or a jaw. A set of 92 male faces were classified using this procedure, and the results were related to their scores in 15 perceived facial traits. We show that the relevant features greatly depend on what we are trying to judge. Globally, the eyes have the greatest effect. However, other facial features are more relevant for some judgments like the mouth for happiness and femininity or the nose for dominance.

Age-related changes in amplitude, latency and specialization of ERP responses to faces and watches

Healthy aging is associated with impairments in face recognition. While earlier research suggests that these impairments arise during memory retrieval, more recent findings suggest that earlier mechanisms, at the perceptual stage, may also be at play. However, results are often inconsistent and very few studies have included a non-face control stimulus to facilitate interpretation of results with respect to the implication of specialized face mechanisms vs. general cognitive factors. To address these issues, P100, N170 and P200 event-related potentials (ERPs) were measured during processing of faces and watches. For faces, age-related differences were found for P100, N170 and P200 ERPs. For watches, age-related differences were found for N170 and P200 ERPs. Older adults showed less selective and less lateralized N170 responses to faces, suggesting that ERPs can detect age-related de-differentiation of specialized face networks. We conclude that age-related impairments in face recognition arise in part from difficulties in the earliest perceptual stages of visual information processing. A working model is presented based on coarse-to-fine analysis of visually similar exemplars.

Facial perception, self-esteem and psychosocial well-being in patients after nasal surgery due to trauma, cancer and aesthetic needs (cluster analysis of multiple interrelations)

Background: Facial anthropometric measurements in relation to self-esteem and self-perception have become a very popular topic, not only in anthropological and psychological research, but also in plastic reconstructive surgery.Aim: To compare the interrelations between facial perception, self-esteem and psychosocial well-being in patients after nasal surgery due to trauma, cancer and aesthetic needs.Subjects and methods: In total, ninety patients after nasal surgery (due to trauma, cancer and aesthetic reasons), and thirty control persons underwent facial anthropometry and answered questions related to facial perception (FP), self-esteem (SE) and psychosocial well-being (PW). Cluster analysis was performed.Results: Facial measurements were not related to the perception of the whole face in all investigated persons. The whole face and nasal perception were interrelated in the majority of male groups and in the control female group. SE in females from the control and cancer groups was not related to real facial parameters or FP, however, in females after aesthetic surgery it was related to nasal tip protrusion. SE in females after nasal surgery due to trauma was strongly related to FP. SE in almost all groups of males was related to real facial parameters, and in males after aesthetic surgery it was related to FP. PW was mostly linked to SE in males and females after aesthetic surgery, in other groups it was related to FP.Conclusions: FP was most frequently not related to real facial measurements; however, it was related to PW. Patients after aesthetic nasal surgery had specific relations between FP, SE and PW.

Assessment of nasal profiles for forensic facial approximation in a modern Korean population of known age and sex

The nose is a valuable facial feature for facial recognition and approximation. We propose the use of regression functions to predict nasal profiles comprising the structures around the piriform aperture using CT-based 3D models. We examined craniofacial reconstruction models acquired from computed tomographic images of Korean adults (188 males and 201 females). Eighteen measurements using 16 craniometric landmarks were measured on 3D craniofacial models. We conducted a descriptive analysis with comparisons according to sex, and simple linear regression analyses to obtain regression functions. Using multiple regression analyses with sex and age as independent variables, multiple regression equations were developed with coefficient of determination R² ranging from 0.314 to 0.724, meaning that the equations for known sex and age were better for the prediction of nasal profiles than equations that assumed only known sex. These equations are useful and practical for reconstructing nasal profiles in forensic analyses.

From individual features to full faces: Combining aspects of face information

We investigated how information from face features is combined by comparing sensitivity to individual features with that for external (head shape, hairline) and internal (nose, mouth, eyes, eyebrows) feature compounds. Discrimination thresholds were measured for synthetic faces under the following conditions: (a) full-faces; (b) individual features (e.g., nose); and (c) feature compounds (either external or internal). Individual features and feature compounds were presented both in isolation and embedded within a fixed, task irrelevant face context. Relative to the full-face baseline, threshold elevations for the internal feature compound (2.41x) were comparable to those for the most sensitive individual feature (nose = 2.12x). External features demonstrated the same pattern. A model that incorporated all available feature information within a single channel in an efficient way overestimated sensitivity to feature compounds. Embedding individual features within a task-irrelevant context reduced discrimination sensitivity, relative to isolated presentation. Sensitivity to feature compounds, however, was unaffected by embedding. A loss of sensitivity when embedding features within a fixed-face context is consistent with holistic processing, which limits access to information about individual features. However, holistic combination of information across face features is not efficient: Sensitivity to feature compounds is no better than sensitivity to the best individual feature. No effect of embedding internal feature compounds within task-irrelevant external face features (or vice versa) suggests that external and internal features are processed independently.

Integration of facial features under memory load

Simple visual items and complex real-world objects are stored into visual working memory as a collection of independent features, not as whole or integrated objects. Storing faces into memory might differ, however, since previous studies have reported perceptual and memory advantage for whole faces compared to other objects. We investigated whether facial features can be integrated in a statistically optimal fashion and whether memory maintenance disrupts this integration. The observers adjusted a probe – either a whole face or isolated features (eyes or mouth region) – to match the identity of a target while viewing both stimuli simultaneously or after a 1.5 second retention period. Precision was better for the whole face compared to the isolated features. Perceptual precision was higher than memory precision, as expected, and memory precision further declined as the number of memorized items was increased from one to four. Interestingly, the whole-face precision was better predicted by models assuming injection of memory noise followed by integration of features than by models assuming integration of features followed by the memory noise. The results suggest equally weighted or optimal integration of facial features and indicate that feature information is preserved in visual working memory while remembering faces.