Faces are "spatial"--holistic face perception is supported by low spatial frequencies

Autistic traits specific to communication ability are associated with performance on a Mooney face detection task

Difficulties in global face processing have been associated with autism. However, autism is heterogenous, and it is not known which dimensions of autistic traits are implicated in face-processing difficulties. To address this gap in knowledge, we conducted two experiments to examine how identification of Mooney face stimuli (stylized, black-and-white images of faces without details) related to the six subscales of the Comprehensive Autistic Trait Inventory in young adults. In Experiment 1, regression analyses indicated that participants with poorer communication skills had lower task sensitivity when discriminating between face-present and face-absent images, whilst other autistic traits had no unique predictive value. Experiment 2 replicated these findings and additionally showed that autistic traits were linked to a reduced face inversion effect. Taken together, these results indicate autistic traits, especially communication difficulties, are associated with reduced configural processing of face stimuli. It follows that both reduced sensitivity for identifying upright faces amongst similar-looking distractors and reduced susceptibility to face inversion effects may be linked to relatively decreased reliance on configural processing of faces in autism. This study also reinforces the need to consider the different facets of autism independently.

Looming Angry Faces: Preliminary Evidence of Differential Electrophysiological Dynamics for Filtered Stimuli via Low and High Spatial Frequencies

Looming motion interacts with threatening emotional cues in the initial stages of visual processing. However, the underlying neural networks are unclear. The current study investigated if the interactive effect of threat elicited by angry and looming faces is favoured by rapid, magnocellular neural pathways and if exogenous or endogenous attention influences such processing. Here, EEG/ERP techniques were used to explore the early ERP responses to moving emotional faces filtered for high spatial frequencies (HSF) and low spatial frequencies (LSF). Experiment 1 applied a passive-viewing paradigm, presenting filtered angry and neutral faces in static, approaching, or receding motions on a depth-cued background. In the second experiment, broadband faces (BSF) were included, and endogenous attention was directed to the expression of faces. Our main results showed that regardless of attentional control, P1 was enhanced by BSF angry faces, but neither HSF nor LSF faces drove the effect of facial expressions. Such findings indicate that looming motion and threatening expressions are integrated rapidly at the P1 level but that this processing relies neither on LSF nor on HSF information in isolation. The N170 was enhanced for BSF angry faces regardless of attention but was enhanced for LSF angry faces during passive viewing. These results suggest the involvement of a neural pathway reliant on LSF information at the N170 level. Taken together with previous reports from the literature, this may indicate the involvement of multiple parallel neural pathways during early visual processing of approaching emotional faces.

High familiar faces have both eye recognition and holistic processing advantages

People recognize familiar faces better than unfamiliar faces. However, it remains unknown whether familiarity affects part-based and/or holistic processing. Wang et al., Frontiers in Psychology, 6, 559 (2015), Vision Research, 157, 89-96 (2019) found both enhanced part-based and holistic processing in eye relative to mouth regions (i.e., in a region-selective manner) for own-race and own-species faces, i.e., faces with more experience. Here, we examined the role of face familiarity in eyes (part-based, region-selective) and holistic processing. Face familiarity was tested at three levels: high-familiar (faces of students from the same department and the same class who attended almost all courses together), low-familiar (faces of students from the same department but different classes who attended some courses together), and unfamiliar (faces of schoolmates from different departments who seldom attended the same courses). Using the old/new task in Experiment 1, we found that participants recognized eyes of high-familiar faces better than low-familiar and unfamiliar ones, while similar performance was observed for mouths, indicating a region-selective, eyes familiarity effect. Using the "Perceptual field" paradigm in Experiment 2, we observed a stronger inversion effect for high-familiar faces, a weaker inversion effect for low-familiar faces, but a non-significant inversion effect for unfamiliar faces, indicating that face familiarity plays a role in holistic processing. Taken together, our results suggest that familiarity, like other experience-based variables (e.g., race and species), can improve both eye processing and holistic processing.

Improved modeling of human vision by incorporating robustness to blur in convolutional neural networks

Whenever a visual scene is cast onto the retina, much of it will appear degraded due to poor resolution in the periphery; moreover, optical defocus can cause blur in central vision. However, the pervasiveness of blurry or degraded input is typically overlooked in the training of convolutional neural networks (CNNs). We hypothesized that the absence of blurry training inputs may cause CNNs to rely excessively on high spatial frequency information for object recognition, thereby causing systematic deviations from biological vision. We evaluated this hypothesis by comparing standard CNNs with CNNs trained on a combination of clear and blurry images. We show that blur-trained CNNs outperform standard CNNs at predicting neural responses to objects across a variety of viewing conditions. Moreover, blur-trained CNNs acquire increased sensitivity to shape information and greater robustness to multiple forms of visual noise, leading to improved correspondence with human perception. Our results provide novel neurocomputational evidence that blurry visual experiences are very important for conferring robustness to biological visual systems.

Literacy acquisition facilitates inversion effects for faces with full-, low-, and high-spatial frequency: evidence from illiterate and literate adults

Previous studies have found that literacy acquisition modulates configural face processing (i.e., holistic and second-order configural processing). However, it remains unclear how literacy acquisition impacts the configural processing indexed by the inversion effect of normal or filtered faces. We asked Chinese illiterate and literate adults to judge whether two sequentially-presented stimuli, including faces, houses (experiment 1), and high- or low-pass filtered faces (experiment 2) were identical. Literate adults outperformed illiterate controls in the upright face and house conditions (experiment 1) and the upright high- and low-pass filtered conditions (experiment 2) but not in the inverted conditions. Notably, the size of an inversion effect (i.e., subtracting inverted accuracy from upright accuracy) was greater among literate adults than that among illiterate adults in both experiments. These findings support that literacy acquisition promotes configural face processing.

Spatial Frequency Tuning of Body Inversion Effects

Body inversion effects (BIEs) reflect the deployment of the configural processing of body stimuli. BIE modulates the activity of body-selective areas within both the dorsal and the ventral streams, which are tuned to low (LSF) or high spatial frequencies (HSF), respectively. The specific contribution of different bands to the configural processing of bodies along gender and posture dimensions, however, is still unclear. Seventy-two participants performed a delayed matching-to-sample paradigm in which upright and inverted bodies, differing for gender or posture, could be presented in their original intact form or in the LSF- or HSF-filtered version. In the gender discrimination task, participants' performance was enhanced by the presentation of HSF images. Conversely, for the posture discrimination task, a better performance was shown for either HSF or LSF images. Importantly, comparing the amount of BIE across spatial-frequency conditions, we found greater BIEs for HSF than LSF images in both tasks, indicating that configural body processing may be better supported by HSF information, which will bias processing in the ventral stream areas. Finally, the exploitation of HSF information for the configural processing of body postures was lower in individuals with higher autistic traits, likely reflecting a stronger reliance on the local processing of body-part details.

Contributions of low- and high-level contextual mechanisms to human face perception

Contextual modulations at primary stages of visual processing depend on the strength of local input. Contextual modulations at high-level stages of (face) processing show a similar dependence to local input strength. Namely, the discriminability of a facial feature determines the amount of influence of the face context on that feature. How high-level contextual modulations emerge from primary mechanisms is unclear due to the scarcity of empirical research systematically addressing the functional link between the two. We tested (62) young adults' ability to process local input independent of the context using contrast detection and (upright and inverted) morphed facial feature matching tasks. We first investigated contextual modulation magnitudes across tasks to address their shared variance. A second analysis focused on the profile of performance across contextual conditions. In upright eye matching and contrast detection tasks, contextual modulations only correlated at the level of their profile (averaged Fisher-Z transformed r = 1.18, BF10 > 100), but not magnitude (r = .15, BF10 = .61), suggesting the functional independence but similar working principles of the mechanisms involved. Both the profile (averaged Fisher-Z transformed r = .32, BF10 = 9.7) and magnitude (r = .28, BF10 = 4.58) of the contextual modulations correlated between inverted eye matching and contrast detection tasks. Our results suggest that non-face-specialized high-level contextual mechanisms (inverted faces) work in connection to primary contextual mechanisms, but that the engagement of face-specialized mechanisms for upright faces obscures this connection. Such combined study of low- and high-level contextual modulations sheds new light on the functional relationship between different levels of the visual processing hierarchy, and thus on its functional organization.

The relation between holistic processing as measured by three composite tasks and face processing: A latent variable modeling approach

We investigated the relationship between holistic processing and face processing using a latent variables approach. Three versions of the composite paradigm were used to measure holistic processing: Vanderbilt Holistic Face Processing Test, a sequential composite matching task, and a simultaneous composite matching task. Three tasks were used to measure face perception and face memory abilities respectively. We had three pairs of tasks such that within each pair (of memory and perception task), the stimuli involved, the requirement for matching across viewpoints, etc., are the same, such that the only difference is whether perception or memory is taxed. There were no significant correlations between the different versions of the composite task. We discovered no evidence to support a distinction between face perception and face memory, suggesting the existence of a general face processing factor. Finally, there was no evidence that holistic processing (as captured by either of the three composite tasks) is predictive of better face processing per se, casting doubts on the role of holistic processing in differentiating different levels of efficiency in face processing.

Change detection vs. change localization for own-race and other-race faces

The other-race effect (ORE) is a well-known phenomenon in which people discriminate and recognize faces from their ethnic group more accurately than faces from other ethnic groups. Holistic processing, or the mandatory tendency to process all parts of an object together, has been proposed as an explanation for the ORE. According to the holistic perspective of the ORE, other-race faces might be subject to weaker holistic processing than own-race faces. However, evidence for this hypothesis is inconsistent. Although it is generally assumed that holistic processing helps the individuation of objects, holistic processing may also come at a cost. Specifically, holistic processing may reduce the capacity to localize changes in the constituent parts of an object, but not in detecting changes to an object as a whole. In the present study, we examined change detection and change localization accuracy for Caucasian and African faces, and houses. Performance was better for change detection than change localization for Caucasian faces. While clear costs of holistic processing for Caucasian faces were thus found, the difference between change localization and change detection was not obvious for African faces. However, childhood exposure to other-race people correlated with change detection for African faces, but not with change localization for African faces. Our results thus show that holistic processing of other-race faces may depend on early contact with other-race people.

The Predictive Role of Low Spatial Frequencies in Automatic Face Processing: A Visual Mismatch Negativity Investigation

Visual processing is thought to function in a coarse-to-fine manner. Low spatial frequencies (LSF), conveying coarse information, would be processed early to generate predictions. These LSF-based predictions would facilitate the further integration of high spatial frequencies (HSF), conveying fine details. The predictive role of LSF might be crucial in automatic face processing, where high performance could be explained by an accurate selection of clues in early processing. In the present study, we used a visual Mismatch Negativity (vMMN) paradigm by presenting an unfiltered face as standard stimulus, and the same face filtered in LSF or HSF as deviant, to investigate the predictive role of LSF vs. HSF during automatic face processing. If LSF are critical for predictions, we hypothesize that LSF deviants would elicit less prediction error (i.e., reduced mismatch responses) than HSF deviants. Results show that both LSF and HSF deviants elicited a mismatch response compared with their equivalent in an equiprobable sequence. However, in line with our hypothesis, LSF deviants evoke significantly reduced mismatch responses compared to HSF deviants, particularly at later stages. The difference in mismatch between HSF and LSF conditions involves posterior areas and right fusiform gyrus. Overall, our findings suggest a predictive role of LSF during automatic face processing and a critical involvement of HSF in the fusiform during the conscious detection of changes in faces.

Faces and words are both associated and dissociated as evidenced by visual problems in dyslexia

Faces and words are traditionally assumed to be independently processed. Dyslexia is also traditionally thought to be a non-visual deficit. Counter to both ideas, face perception deficits in dyslexia have been reported. Others report no such deficits. We sought to resolve this discrepancy. 60 adults participated in the study (24 dyslexic, 36 typical readers). Feature-based processing and configural or global form processing of faces was measured with a face matching task. Opposite laterality effects in these tasks, dependent on left-right orientation of faces, supported that they tapped into separable visual mechanisms. Dyslexic readers tended to be poorer than typical readers at feature-based face matching while no differences were found for global form face matching. We conclude that word and face perception are associated when the latter requires the processing of visual features of a face, while processing the global form of faces apparently shares minimal-if any-resources with visual word processing. The current results indicate that visual word and face processing are both associated and dissociated-but this depends on what visual mechanisms are task-relevant. We suggest that reading deficits could stem from multiple factors, and that one such factor is a problem with feature-based processing of visual objects.

Convolutional neural networks trained with a developmental sequence of blurry to clear images reveal core differences between face and object processing

Although convolutional neural networks (CNNs) provide a promising model for understanding human vision, most CNNs lack robustness to challenging viewing conditions, such as image blur, whereas human vision is much more reliable. Might robustness to blur be attributable to vision during infancy, given that acuity is initially poor but improves considerably over the first several months of life? Here, we evaluated the potential consequences of such early experiences by training CNN models on face and object recognition tasks while gradually reducing the amount of blur applied to the training images. For CNNs trained on blurry to clear faces, we observed sustained robustness to blur, consistent with a recent report by Vogelsang and colleagues (2018). By contrast, CNNs trained with blurry to clear objects failed to retain robustness to blur. Further analyses revealed that the spatial frequency tuning of the two CNNs was profoundly different. The blurry to clear face-trained network successfully retained a preference for low spatial frequencies, whereas the blurry to clear object-trained CNN exhibited a progressive shift toward higher spatial frequencies. Our findings provide novel computational evidence showing how face recognition, unlike object recognition, allows for more holistic processing. Moreover, our results suggest that blurry vision during infancy is insufficient to account for the robustness of adult vision to blurry objects.

Non-invasive neurostimulation modulates processing of spatial frequency information in rapid perception of faces

This study used high-frequency transcranial random noise stimulation (tRNS) to examine how low and high spatial frequency filtered faces are processed. Response times were measured in a task where healthy young adults categorised spatially filtered hybrid faces, presented at foveal and peripheral blocks, while sham and high-frequency random noise was applied to a lateral occipito-temporal location on their scalp. Both the Frequentist and Bayesian approaches show that in contrast to sham, active stimulation significantly reduced response times to peripherally presented low spatial frequency information. This finding points to a possible plasticity in targeted regions induced by non-invasive neuromodulation of spatial frequency information in rapid perception of faces.

Implicit evidence on the dissociation of identity and emotion recognition

Recognition of identity and of emotional facial expressions of individuals are both based on processing of the human face. While most studies show these abilities to be dissociated, some others find evidence of a connection. One possible explanation for these contradictory results comes from neurological evidence, which points to identity recognition being mostly based on holistic processing, while emotion recognition seems to be based on both an explicit, fine-grained process, and an implicit, mostly-holistic one. Our main hypothesis, that would explain the contradictory findings, is that holistic implicit emotion recognition, specifically, would be related to identity recognition, while explicit emotion recognition would be a process separate to identity recognition. To test this hypothesis, we employed an experimental paradigm in which spatial frequencies of visual stimuli are manipulated so that automatic, holistic-based, implicit emotion recognition influences perceived friendliness of unfamiliar faces. We predicted the effect to be related to identity recognition ability, since they both require holistic face processing. After a successful replication study, we employed the paradigm with 140 participants, measuring also identity recognition ability and explicit emotion recognition ability. Results showed that the effect is not moderated by these two variables (p = .807 and .373, respectively), suggesting that the independence of identity and emotion recognition holds even when considering, specifically, implicit emotion recognition.

Influence of Perceptual Discriminability and Spatial Distance on Holistic Processing of Faces

Background: Holistic processing is defined as the perceptual integration of facial features, and plays an important role in face recognition. While researchers recognize the crucial role played by holistic processing in face perception, a complete delineation of the underlying mechanisms is impending. Very few studies have examined the effects of perceptual discrimination and spatial perception on holistic processing. Hence, the present study aimed to examine the influence of perceptual discrimination and spatial perception on face recognition.

Methods: We conducted two experiments by manipulating the perceptual discriminability of the target (the top-half faces) and non-target face (the bottom-half faces) parts in the composite-face task and examined how perceptual discriminability may affect holistic processing of faces.

Results: The results of Experiment 1 illustrated that holistic processing was modulated by the perceptual discriminability of the face. Furthermore, differential patterns of perceptual discriminability with the target and non-target parts suggested that different mechanisms may be responsible for the influence of target and non-target parts on face perception. The results of Experiment 2 illustrated that holistic processing was modulated by spatial distance between two faces, implicating that feature-by-feature strategy might decrease the magnitude of holistic processing.

Conclusion: The results of the present study suggest that holistic processing may lead to augmented perception effect exaggerating the differences between the two faces and may also be affected by the feature-by-feature strategy.

Spatial frequency and valence interact in complex emotion perception

Research on spatial frequency contributions to facial emotion identification has largely focused on basic emotions. The present experiment characterised spatial frequency contributions to decoding complex emotions, which can be less visible and intense than basic emotions. We investigated the effects of spatial frequency, expression valence and perceptually available features (full face or eyes only) on decoding accuracy. We observed main effects of all factors, with better performance for high (relative to low) spatial frequency, for positive (relative to negative) emotions and for full face (relative to eyes only) conditions. We also observed an interaction of all factors. The high spatial frequency advantage in decoding accuracy was eliminated only for full faces expressing more positive complex emotions. These findings suggest advantages from high spatial frequency content in accurately decoding complex emotions may attenuate when positive complex emotions are decoded from the spatial frequency content of a broader constellation of features.

Coarse-to-Fine(r) Automatic Familiar Face Recognition in the Human Brain

At what level of spatial resolution can the human brain recognize a familiar face in a crowd of strangers? Does it depend on whether one approaches or rather moves back from the crowd? To answer these questions, 16 observers viewed different unsegmented images of unfamiliar faces alternating at 6 Hz, with spatial frequency (SF) content progressively increasing (i.e., coarse-to-fine) or decreasing (fine-to-coarse) in different sequences. Variable natural images of celebrity faces every sixth stimulus generated an objective neural index of single-glanced automatic familiar face recognition (FFR) at 1 Hz in participants' electroencephalogram (EEG). For blurry images increasing in spatial resolution, the neural FFR response over occipitotemporal regions emerged abruptly with additional cues at about 6.3-8.7 cycles/head width, immediately reaching amplitude saturation. When the same images progressively decreased in resolution, the FFR response disappeared already below 12 cycles/head width, thus providing no support for a predictive coding hypothesis. Overall, these observations indicate that rapid automatic recognition of heterogenous natural views of familiar faces is achieved from coarser visual inputs than generally thought, and support a coarse-to-fine FFR dynamics in the human brain.

The Efficiency of Demography in Face Perception

When we look at a face, we cannot help but "read" it: Beyond simply processing its identity, we also form robust impressions of both transient psychological states (e.g., surprise) and stable character traits (e.g., trustworthiness). But perhaps the most fundamental traits we extract from faces are their social demographics, for example, race, age, and gender. How much exposure is required to extract such properties? Curiously, despite extensive work on the temporal efficiency of extracting both higher-level social properties (such as competence and dominance) and more basic characteristics (such as identity and familiarity), this question remains largely unexplored for demography. We correlated observers' percepts of the race/age/gender of unfamiliar faces viewed at several brief durations (and then masked) with their judgments after unlimited exposure. Performance reached asymptote by 100 ms, was above chance by only 33.33 ms, and had a similar temporal profile to detecting faces in the first place. This was true even when the property to be reported wasn't revealed until after the face had disappeared, and when the faces were matched for several lower-level visual properties. Collectively, these results demonstrate that the extraction of demographic features from faces is highly efficient, and can truly be done at a glance.

The role of spatial frequencies for facial pain categorization

Studies on low-level visual information underlying pain categorization have led to inconsistent findings. Some show an advantage for low spatial frequency information (SFs) and others a preponderance of mid SFs. This study aims to clarify this gap in knowledge since these results have different theoretical and practical implications, such as how far away an observer can be in order to categorize pain. This study addresses this question by using two complementary methods: a data-driven method without a priori expectations about the most useful SFs for pain recognition and a more ecological method that simulates the distance of stimuli presentation. We reveal a broad range of important SFs for pain recognition starting from low to relatively high SFs and showed that performance is optimal in a short to medium distance (1.2-4.8 m) but declines significantly when mid SFs are no longer available. This study reconciles previous results that show an advantage of LSFs over HSFs when using arbitrary cutoffs, but above all reveal the prominent role of mid-SFs for pain recognition across two complementary experimental tasks.

Holistic face processing is influenced by non-conscious visual information

Holistic face processing has been widely implicated in conscious face perception. Yet, little is known about whether holistic face processing occurs when faces are processed unconsciously. The present study used the composite face task and continuous flash suppression (CFS) to inspect whether the processing of target facial information (the top half of a face) is influenced by irrelevant information (the bottom half) that is presented unconsciously. Results of multiple experiments showed that the composite effect was observed in both monocular and CFS conditions, providing the first evidence that the processing of top facial halves is influenced by the aligned bottom halves no matter whether they are presented consciously or unconsciously. However, much of the composite effect for faces without masking was disrupted when bottom facial parts were rendered with CFS. These results suggest that holistic face processing can occur unconsciously, but also highlight the significance of holistic processing of consciously presented faces.

Exploring emotional face processing in 5-month-olds: The relation with quality of parent-child interaction and spatial frequencies

It is unclear whether infants differentially process emotional faces in the brain at 5 months of age. Contradictory findings of previous research indicate that additional factors play a role in this process. The current study investigated whether five-month-old infants show differential brain activity between emotional faces. Furthermore, we explored the relation between emotional face processing and (I) stimulus characteristics, specifically the spatial frequency content, and (II) parent, child, and dyadic qualities of interaction characteristics. Face-sensitive components (i.e., N290, P400, Nc) in response to neutral and fearful faces that contained only lower or higher spatial frequencies were assessed. Quality of parent-child interaction was assessed with the Manchester Assessment of Caregiver Infant Interaction (MACI). The results show that, as a full group, none of the components differed between emotional expressions. However, when splitting the group based on median MACI scores, infants who showed high quality of interaction (i.e., more attentiveness to caregiver, positive and negative affect, and liveliness) processed emotions differently, whereas infants who showed low quality did not. These results indicate that a sub-group of infants show differential emotional face processing at 5 months of age, which seem to relate to quality of their behavior during the parent-child interaction.

Isolated face features are sufficient to elicit ultra-rapid and involuntary orienting responses toward faces

Previous studies have shown that face stimuli influence the programming of eye movements by eliciting involuntary and extremely fast saccades toward them. The present study examined whether holistic processing of faces mediates these effects. We used a saccadic choice task in which participants were presented simultaneously with two images and had to perform a saccade toward the one containing a target stimulus (e.g., a face). Across three experiments, stimuli were altered via upside-down inversion (Experiment 1) or scrambling of thumbnails within the images (Experiments 2 and 3) in order to disrupt holistic processing. We found that disruption of holistic processing only had a limited impact on the latency of saccades toward face targets, which remained extremely short (minimum saccadic reaction times of only ∼120–130 ms), and did not affect the proportion of error saccades toward face distractors that captured attention more than other distractor categories. It, however, resulted in increasing error rate of saccades toward face targets. These results suggest that the processing of isolated face features is sufficient to elicit extremely fast and involuntary saccadic responses toward them. Holistic representations of faces may, however, be used as a search template to accurately detect faces.

Flexibility of emerging face categorization at different levels of abstraction

Categorization of visual stimuli at different levels of abstraction relies on the encoding of relevant diagnostic features present at different spatial scales. We used the Eidolon Factory, an image-manipulation algorithm that introduces random disarray fields across spatial scales, to study how such a process flexibly combines perceptual information to perform successful categorization depending on task demands. Images of animal faces, human faces, and everyday objects were disarrayed coherently (random fields correlated) or incoherently (random fields randomized) to create a family of 50 eidolons per stimulus image with increasing disarray. Participants (N = 243) viewed each family of eidolons in a smooth sequence from maximum disarray to no disarray and performed a category verification task either at the superordinate (any face type) or basic (human face only) levels at two levels of uncertainty: participants in one group used their gut feeling to respond, whereas another group had to be sure of their decision. When participants used their gut feeling to respond, we observed a superordinate-level advantage. When they were sure of their response, we observed a basic-level advantage. Coherently disarrayed sequences impaired target detection compared to incoherently disarrayed sequences for both levels of response certainty. Furthermore, participants' sensitivity in the Any Face condition increased when they observed coherently disarrayed sequences and had to be sure of their response. These results suggest that the visual system does not strictly adhere to feedforward processing but flexibly adjusts to the relevant perceptual information depending on task context.

Chinese Aesthetic Mask: Three Forehead and Five Eyes-Holistic Processing and Facial Attractiveness

Human face processing has been attributed to holistic processing. Here, we ask whether humans are sensitive to configural information when perceiving facial attractiveness. By referring to a traditional Chinese aesthetic theory-Three Forehead and Five Eyes-we generated a series of faces that differed in spacing between facial features. We adopted a two-alternative forced-choice task in Experiment 1 and a rating task in Experiment 2 to assess attractiveness. Both tasks showed a consistent result: The faces which fit the Chinese aesthetic theory were chosen or rated as most attractive. This effect of configural information on facial attractiveness was larger for faces with highly attractive features than for faces with low attractive features. These findings provide experimental evidence for the traditional Chinese aesthetic theory. This issue can be further explored from the perspective of culture in the future.

Is It Fear? Similar Brain Responses to Fearful and Neutral Faces in Infants with a Heightened Likelihood for Autism Spectrum Disorder

Individuals with autism spectrum disorder (ASD) show atypical processing of facial expressions. Research with autistic toddlers suggests that abnormalities in processing of spatial frequencies (SFs) contribute to such differences. The current event-related-potential (ERP) study investigated differences between 10-month-old infants with high- and low-likelihood for ASD in SF processing and in discrimination of fearful and neutral faces, filtered to contain specific SF. Results indicate no group differences in general processing of higher (HSF, detailed) and lower-SF (LSF, global) information. However, unlike low-likelihood infants, high-likelihood infants do not discriminate between facial expressions when either the LSF or HSF information is available. Combined with previous findings in toddlers, the current results indicate a developmental delay in efficient processing of facial expressions in ASD.

Word and Face Recognition Processing Based on Response Times and Ex-Gaussian Components

The face is a fundamental feature of our identity. In humans, the existence of specialized processing modules for faces is now widely accepted. However, identifying the processes involved for proper names is more problematic. The aim of the present study is to examine which of the two treatments is produced earlier and whether the social abilities are influent. We selected 100 university students divided into two groups: Spanish and USA students. They had to recognize famous faces or names by using a masked priming task. An analysis of variance about the reaction times (RT) was used to determine whether significant differences could be observed in word or face recognition and between the Spanish or USA group. Additionally, and to examine the role of outliers, the Gaussian distribution has been modified exponentially. Famous faces were recognized faster than names, and differences were observed between Spanish and North American participants, but not for unknown distracting faces. The current results suggest that response times to face processing might be faster than name recognition, which supports the idea of differences in processing nature.

The composite face effect is robust against perceptual misfit

The composite face effect—the failure of selective attention toward a target face half—is frequently used to study mechanisms of feature integration in faces. Here we studied how this effect depends on the perceptual fit between attended and unattended halves. We used composite faces that were rated by trained observers as either a seamless fit (i.e., close to a natural and homogeneous face) or as a deliberately bad quality of fit (i.e., unnatural, strongly segregated face halves). In addition, composites created by combining face halves randomly were tested. The composite face effect was measured as the alignment × congruency interaction (Gauthier and Bukach Cognition, 103, 322–330 2007), but also with alternative data analysis procedures (Rossion and Boremanse Journal of Vision, 8, 1–13 2008). We found strong but identical composite effects in all fit conditions. Fit quality neither increased the composite face effect nor was it attenuated by bad or random fit quality. The implications for a Gestalt account of holistic face processing are discussed.

The image features of emotional faces that predict the initial eye movement to a face

Emotional facial expressions are important visual communication signals that indicate a sender's intent and emotional state to an observer. As such, it is not surprising that reactions to different expressions are thought to be automatic and independent of awareness. What is surprising, is that studies show inconsistent results concerning such automatic reactions, particularly when using different face stimuli. We argue that automatic reactions to facial expressions can be better explained, and better understood, in terms of quantitative descriptions of their low-level image features rather than in terms of the emotional content (e.g. angry) of the expressions. Here, we focused on overall spatial frequency (SF) and localized Histograms of Oriented Gradients (HOG) features. We used machine learning classification to reveal the SF and HOG features that are sufficient for classification of the initial eye movement towards one out of two simultaneously presented faces. Interestingly, the identified features serve as better predictors than the emotional content of the expressions. We therefore propose that our modelling approach can further specify which visual features drive these and other behavioural effects related to emotional expressions, which can help solve the inconsistencies found in this line of research.

The Effect of Age-Related Macular Degeneration on Components of Face Perception

Purpose

Patients with age-related macular degeneration (AMD) experience difficulty with discriminating between faces. We aimed to use a new clinical test to quantify the impact of AMD on face perception and to determine the specific aspects that are affected.

Methods

The Caledonian face test uses an adaptive procedure to measure face discrimination thresholds: the minimum difference required between faces for reliable discrimination. Discrimination thresholds were measured for full-faces, external features (head-shape and hairline), internal features (nose, mouth, eyes, and eyebrows) and shapes (non-face task). Participants were 20 patients with dry AMD (logMAR VA = 0.14 to 0.62), 20 patients with wet AMD (0.10 to 0.60), and 20 age-matched control subjects (−0.18 to +0.06).

Results

Relative to controls, full-face discrimination thresholds were, on average, 1.76 and 1.73 times poorer in participants with dry and wet AMD, respectively. AMD also reduced sensitivity to face features, but discrimination of the internal, relative to external, features was disproportionately impaired. Both distance VA and contrast sensitivity were significant independent predictors of full-face discrimination thresholds (R² = 0.66). Sensitivity to full-faces declined by a factor of approximately 1.19 per 0.1 logMAR reduction in VA.

Conclusions

Both dry and wet AMD significantly reduce sensitivity to full-faces and their component parts to similar extents. Distance VA and contrast sensitivity are closely associated with face discrimination sensitivity. These results quantify the extent of sensitivity impairment in patients with AMD and predict particular difficulty in everyday tasks that rely on internal feature information, including recognition of familiar faces and facial expressions.

The Brain’s Asymmetric Frequency Tuning: Asymmetric Behavior Originates from Asymmetric Perception

To construct a coherent multi-modal percept, vertebrate brains extract low-level features (such as spatial and temporal frequencies) from incoming sensory signals. However, because frequency processing is lateralized with the right hemisphere favouring low frequencies while the left favours higher frequencies, this introduces asymmetries between the hemispheres. Here, we describe how this lateralization shapes the development of several cognitive domains, ranging from visuo-spatial and numerical cognition to language, social cognition, and even aesthetic appreciation, and leads to the emergence of asymmetries in behaviour. We discuss the neuropsychological and educational implications of these emergent asymmetries and suggest future research approaches.

Pinpointing the optimal spatial frequency range for automatic neural facial fear processing

Faces convey an assortment of emotional information via low and high spatial frequencies (LSFs and HSFs). However, there is no consensus on the role of particular spatial frequency (SF) information during facial fear processing. Comparison across studies is hampered by the high variability in cut-off values for demarcating the SF spectrum and by differences in task demands. We investigated which SF information is minimally required to rapidly detect briefly presented fearful faces in an implicit and automatic manner, by sweeping through an entire SF range without constraints of predefined cut-offs for LSFs and HSFs. We combined fast periodic visual stimulation with electroencephalography. We presented neutral faces at 6 ​Hz, periodically interleaved every 5th image with a fearful face, allowing us to quantify an objective neural index of fear discrimination at exactly 1.2 ​Hz. We started from a stimulus containing either only very low or very high SFs and gradually increased the SF content by adding higher or lower SF information, respectively, to reach the full SF spectrum over the course of 70 ​s. We found that faces require at least SF information higher than 5.93 cycles per image (cpi) to implicitly differentiate fearful from neutral faces. However, exclusive HSF faces, even in a restricted SF range between 94.82 and 189.63 cpi already carry the critical information to extract the emotional expression of the faces.

Flexible face processing: Holistic processing of facial identity is modulated by task-irrelevant facial expression

Holistic processing is a hallmark of face perception and has been observed separately for facial identity and expression. While the identity of a face remains constant regardless of any changes in facial expressions, to what extent is holistic processing of facial identity affected by task-irrelevant facial expressions? If holistic processing is flexible and integrates both identity and expression information, the magnitude of holistic processing of facial identity may be systematically modulated by different facial expressions, due to either visual or emotional differences among the expressions. In Experiment 1, participants matched the identities of target halves of two sequentially presented face composites, with both composites showing either positive (happy) or negative (angry) expressions. The presentation duration for the test composite was either short (200 ms) or long (until a response). With a short presentation duration, the magnitude of holistic processing of identity for happy and angry composites was comparable. In contrast, with a long presentation duration, holistic processing of identity was reduced for angry compared with happy face composites. Experiment 2 replicated the results and showed reduced holistic processing of identity for face composites with either angry or neutral expressions, compared with happy expressions, given a long presentation duration. Because the modulation of facial expressions on holistic processing of facial identity was observed with long, but not short, presentation durations, these results suggest that such influence is unlikely solely due to visual differences, but may instead arise from cognitive evaluation of the emotions conveyed by facial expressions.

Implicit race attitudes modulate visual information extraction for trustworthiness judgments

Black people are still considered to be one of the most stigmatized groups and have to face multiple prejudices that undermine their well-being. Assumptions and beliefs about other racial groups are quite pervasive and have been shown to impact basic social tasks such as face processing. For example, individuals with high racial prejudice conceptualize other-race faces as less trustworthy and more criminal. However, it is unknown if implicit racial bias could modulate even low-level perceptual mechanisms such as spatial frequency (SF) extraction when judging the level of trustworthiness of other-race faces. The present study showed that although similar facial features are used to judge the trustworthiness of White and Black faces, own-race faces are processed in lower SF (i.e. coarse information such as the contour of the face and blurred shapes as opposed to high SF representing fine-grained information such as eyelashes or fine wrinkles). This pattern was modulated by implicit race biases: higher implicit biases are associated with a significantly higher reliance on low SF with White than with Black faces.

Profiles on the Orientation Discrimination Processing of Human Faces

Face recognition is a crucial subject for public health, as socialization is one of the main characteristics for full citizenship. However, good recognizers would be distinguished, not only by the number of faces they discriminate but also by the number of rejected stimuli as unfamiliar. When it comes to face recognition, it is important to remember that position, to some extent, would not entail a high cognitive cost, unlike other processes in similar areas of the brain. The aim of this paper was to examine participant’s recognition profiles according to face position. For this reason, a recognition task was carried out by employing the Karolinska Directed Emotional Faces. Reaction times and accuracy were employed as dependent variables and a cluster analysis was carried out. A total of two profiles were identified in participants’ performance, which differ in position in terms of reaction times but not accuracy. The results can be described as follows: first, it is possible to identify performance profiles in visual recognition of faces that differ in position in terms of reaction times, not accuracy; secondly, results suggest a bias towards the left. At the applied level, this could be of interest with a view to conducting training programs in face recognition.

Low Spatial Frequency Sensitivity and Emotional Face Processing in Adolescents: An Event-related Potential Study

Slow maturation of visual pathways transmitting low spatial frequency (LSF) information may contribute to inaccurate facial emotion recognition in adolescence. We recorded ERPs from adolescents and adults to upright and inverted happy faces, fearful faces, and chairs, which were unfiltered, contained only LSFs, or only high spatial frequencies. P100s and N170s were larger for adolescents than adults, with the greatest effect size for LSF stimuli. For LSFs only, adolescents showed a larger N170 inversion effect for happy than for fearful faces, but adults showed the opposite response. Thus, immaturities in LSF pathways appear to impact facial expression processing in adolescents.

Assessing the presence of face biases by means of anorthoscopic perception

Anorthoscopy is a presentation mode in which an image is shown sliding behind a slit-shaped aperture, so that it is visible only part by part and never in its entirety. With the aims to assess (1) whether the processing of complex stimuli (faces) correctly occurs in anorthoscopy, and (2) whether the Own-Gender Bias (OGB: the better recognition of stimuli belonging to the same gender of the observer: faster and more accurate) and the Left-Face Bias (LFB: the preference to analyze the left half of the face) occur in such a part by part presentation, we presented female and male faces as whole stimuli (Experiment 1) and in anorthoscopy (Experiments 2 and 3), as well as female/male chimeric faces (Experiment 4), during a gender categorization task. Experiment 1 confirmed that participants correctly categorized the gender of faces, but the OGB was not found. In Experiments 2 and 3 we manipulated the direction (Experiment 2: upward/downward; Experiment 3: leftward/rightward), the speed (slow and fast) of the sliding faces, and the width of the aperture (small and large). Both tasks revealed that facial gender was correctly categorized in anorthoscopy. The OGB was found, but only for males/females in Experiments 2/3, respectively. In Experiment 4 the LFB emerged only in the tachistoscopic session, suggesting that this perceptual bias does not extend to anorthoscopy.

Age Differences in Face Processing: The Role of Perceptual Degradation and Holistic Processing

OBJECTIVES

We simultaneously investigated the role of three hypotheses regarding age-related differences in face processing: perceptual degradation, impaired holistic processing, and an interaction between the two.

METHODS

Young adults (YA) aged 20-33-year olds, middle-age adults (MA) aged 50-64-year olds, and older adults (OA) aged 65-82-year olds were tested on the context congruency paradigm, which allows measurement of face-specific holistic processing across the life span (Meinhardt-Injac, Persike & Meinhardt, 2014. Acta Psychologica, 151, 155-163). Perceptual degradation was examined by measuring performance with faces that were not filtered (FSF), with faces filtered to preserve low spatial frequencies (LSF), and with faces filtered to preserve high spatial frequencies (HSF).

RESULTS

We found that reducing perceptual signal strength had a greater impact on MA and OA for HSF faces, but not LSF faces. Context congruency effects were significant and of comparable magnitude across ages for FSF, LSF, and HSF faces. By using watches as control objects, we show that these holistic effects reflect face-specific mechanisms in all age groups.

DISCUSSION

Our results support the perceptual degradation hypothesis for faces containing only HSF and suggest that holistic processing is preserved in aging even under conditions of reduced signal strength.

Assessing the Big Five personality traits using real-life static facial images

There is ample evidence that morphological and social cues in a human face provide signals of human personality and behaviour. Previous studies have discovered associations between the features of artificial composite facial images and attributions of personality traits by human experts. We present new findings demonstrating the statistically significant prediction of a wider set of personality features (all the Big Five personality traits) for both men and women using real-life static facial images. Volunteer participants (N = 12,447) provided their face photographs (31,367 images) and completed a self-report measure of the Big Five traits. We trained a cascade of artificial neural networks (ANNs) on a large labelled dataset to predict self-reported Big Five scores. The highest correlations between observed and predicted personality scores were found for conscientiousness (0.360 for men and 0.335 for women) and the mean effect size was 0.243, exceeding the results obtained in prior studies using ‘selfies’. The findings strongly support the possibility of predicting multidimensional personality profiles from static facial images using ANNs trained on large labelled datasets. Future research could investigate the relative contribution of morphological features of the face and other characteristics of facial images to predicting personality.

Large EEG amplitude effects are highly similar across Necker cube, smiley, and abstract stimuli

The information available through our senses is noisy, incomplete, and ambiguous. Our perceptual systems have to resolve this ambiguity to construct stable and reliable percepts. Previous EEG studies found large amplitude differences in two event-related potential (ERP) components 200 and 400 ms after stimulus onset when comparing ambiguous with disambiguated visual information ("ERP Ambiguity Effects"). These effects so far generalized across classical ambiguous figures from different visual categories at lower (geometry, motion) and intermediate (Gestalt perception) levels. The present study aimed to examine whether these ERP Effects are restricted to ambiguous figures or whether they also occur for different degrees of visibility. Smiley faces with low and high visibility of emotional expressions, as well as abstract figures with low and high visibility of a target curvature were presented. We thus compared ambiguity effects in geometric cube stimuli with visibility in emotional faces, and with visibility in abstract figures. ERP Effects were replicated for the geometric stimuli and very similar ERP Effects were found for stimuli with emotional face expressions but also for abstract figures. Conclusively, the ERP amplitude effects generalize across fundamentally different stimulus categories and show highly similar effects for different degrees of stimulus ambiguity and stimulus visibility. We postulate the existence of a high-level/meta-perceptual evaluation instance, beyond sensory details, that estimates the certainty of a perceptual decision. The ERP Effects may reflect differences in evaluation results.

Testing the effects of transcranial direct current stimulation (tDCS) on the face inversion effect and the N170 event-related potentials (ERPs) component

The following study investigates the effects of tDCS on face recognition skills indexed by the face inversion effect (better recognition performance for upright vs. inverted faces). We combined tDCS and EEG simultaneously to examine the effects of tDCS on the face inversion effect behaviourally and on the N170 ERPs component. The results from two experiments (overall N = 112) show that anodal tDCS delivered at Fp3 site for 10 min at 1.5 mA (double-blind and between-subjects) can reduce behaviourally the face inversion effect compared to sham (control) stimulation. The ERP results provide some evidence for tDCS being able to influence the face inversion effect on the N170. Specifically, we find a dissociation of the tDCS-induced effects where for the N170 latencies the tDCS reduces the usual face inversion effect (delayed N170 in response to inverted vs. upright faces) compared to sham. Contrarily, the same tDCS procedure on the same participants increased the inversion effect seen in the N170 amplitudes by making the negative deflection for the inverted faces that much greater than that for upright faces. We interpret our results in the context of the literature on the face inversion effect and the N170 peak component. In doing so, we extend our results to previous studies investigating the effects of tDCS on perceptual learning and face recognition.

Filtered beauty in Oslo and Tokyo: A spatial frequency analysis of facial attractiveness

Images of European female and male faces were digitally processed to generate spatial frequency (SF) filtered images containing only a narrow band of visual information within the Fourier spectrum. The original unfiltered images and four SF filtered images (low, medium-low, medium-high and high) were then paired in trials that kept constant SF band and face gender and participants made a forced-choice decision about the more attractive among the two faces. In this way, we aimed at identifying those specific SF bands where forced-choice preferences corresponded best to forced-choice judgements made when viewing the natural, broadband, facial images. We found that aesthetic preferences dissociated across SFs and face gender, but similarly for participants from Asia (Japan) and Europe (Norway). Specifically, preferences when viewing SF filtered images were best related to the preference with the broadband face images when viewing the highest filtering band for the female faces (about 48-77 cycles per face). In contrast, for the male faces, the medium-low SF band (about 11-19 cpf) related best to choices made with the natural facial images. Eye tracking provided converging evidence for the above, gender-related, SF dissociations. We suggest greater aesthetic relevance of the mobile and communicative parts for the female face and, conversely, of the rigid, structural, parts for the male face for facial aesthetics.

Artificial Faces Predict Gaze Allocation in Complex Dynamic Scenes

Both low-level physical saliency and social information, as presented by human heads or bodies, are known to drive gaze behavior in free-viewing tasks. Researchers have previously made use of a great variety of face stimuli, ranging from photographs of real humans to schematic faces, frequently without systematically differentiating between the two. In the current study, we used a Generalized Linear Mixed Model (GLMM) approach to investigate to what extent schematic artificial faces can predict gaze when they are presented alone or in competition with real human faces. Relative differences in predictive power became apparent, while GLMMs suggest substantial effects for real and artificial faces in all conditions. Artificial faces were accordingly less predictive than real human faces but still contributed significantly to gaze allocation. These results help to further our understanding of how social information guides gaze in complex naturalistic scenes.

Face recognition and memory in congenital amusia

Congenital amusia, commonly known as tone deafness, is a lifelong impairment of music perception and production. It remains a question of debate whether the impairments in musical domain observed in congenital amusia are paralleled in other non-musical perceptual abilities. Using behavioral measures in two experiments, the current study explored face perception and memory in congenital amusics. Both congenital amusics and matched controls performed a face perception task (Experiment 1) and an old/novel object memory task (for both faces and houses, Experiment 2). The results showed that the congenital amusic group had significantly slower reaction times than that in matched control group when identifying whether two faces presented together were the same or different. For different face-pairs, the deficit was greater for upright faces compared with inverted faces. For object memory task, the congenital amusic group also showed worse memory performance than the control group. The results of the present study suggest that the impairment attributed to congenital amusia is not only limited to music, but also extends to visual perception and visual memory domain.