The composite face illusion

Autistic adults exhibit typical sensitivity to changes in interpersonal distance

The visual processing differences seen in autism often impede individuals' visual perception of the social world. In particular, many autistic people exhibit poor face recognition. Here, we sought to determine whether autistic adults also show impaired perception of dyadic social interactions-a class of stimulus thought to engage face-like visual processing. Our focus was the perception of interpersonal distance. Participants completed distance change detection tasks, in which they had to make perceptual decisions about the distance between two actors. On half of the trials, participants judged whether the actors moved closer together; on the other half, whether they moved further apart. In a nonsocial control task, participants made similar judgments about two grandfather clocks. We also assessed participants' face recognition ability using standardized measures. The autistic and nonautistic observers showed similar levels of perceptual sensitivity to changes in interpersonal distance when viewing social interactions. As expected, however, the autistic observers showed clear signs of impaired face recognition. Despite putative similarities between the visual processing of faces and dyadic social interactions, our results suggest that these two facets of social vision may dissociate.

Understanding of facial features in face perception: insights from deep convolutional neural networks

Introduction

Face recognition has been a longstanding subject of interest in the fields of cognitive neuroscience and computer vision research. One key focus has been to understand the relative importance of different facial features in identifying individuals. Previous studies in humans have demonstrated the crucial role of eyebrows in face recognition, potentially even surpassing the importance of the eyes. However, eyebrows are not only vital for face recognition but also play a significant role in recognizing facial expressions and intentions, which might occur simultaneously and influence the face recognition process.

Methods

To address these challenges, our current study aimed to leverage the power of deep convolutional neural networks (DCNNs), an artificial face recognition system, which can be specifically tailored for face recognition tasks. In this study, we investigated the relative importance of various facial features in face recognition by selectively blocking feature information from the input to the DCNN. Additionally, we conducted experiments in which we systematically blurred the information related to eyebrows to varying degrees.

Results

Our findings aligned with previous human research, revealing that eyebrows are the most critical feature for face recognition, followed by eyes, mouth, and nose, in that order. The results demonstrated that the presence of eyebrows was more crucial than their specific high-frequency details, such as edges and textures, compared to other facial features, where the details also played a significant role. Furthermore, our results revealed that, unlike other facial features, the activation map indicated that the significance of eyebrows areas could not be readily adjusted to compensate for the absence of eyebrow information. This finding explains why masking eyebrows led to more significant deficits in face recognition performance. Additionally, we observed a synergistic relationship among facial features, providing evidence for holistic processing of faces within the DCNN.

Discussion

Overall, our study sheds light on the underlying mechanisms of face recognition and underscores the potential of using DCNNs as valuable tools for further exploration in this field.

Opposite size illusions for inverted faces and letters

Words are the primary means by which we communicate meaning and ideas, while faces provide important social cues. Studying visual illusions involving faces and words can elucidate the hierarchical processing of information as different regions of the brain are specialised for face recognition and word processing. A size illusion has previously been demonstrated for faces, whereby an inverted face is perceived as larger than the same stimulus upright. Here, two experiments replicate the face size illusion, and investigate whether the illusion is also present for individual letters (Experiment 1), and visual words and pseudowords (Experiment 2). Results confirm a robust size Illusion for faces. Letters, words and pseudowords and unfamiliar letters all show a reverse size illusion, as we previously demonstrated for human bodies. Overall, results indicate the illusion occurs in early perceptual stages upstream of semantic processing. Results are consistent with the idea of a general-purpose mechanism that encodes curvilinear shapes found in both scripts and our environment. Word and face perception rely on specialised, independent cognitive processes. The underestimation of the size of upright stimuli is specific to faces. Opposite size illusions may reflect differences in how size information is encoded and represented in stimulus-specialised neural networks, resulting in contrasting perceptual effects. Though words and faces differ visually, there is both symmetry and asymmetry in how the brain 'reads' them.

Binocular rivalry reveals differential face processing in congenital prosopagnosia

Congenital Prosopagnosia (CP) is an innate impairment in face perception with heterogeneous characteristics. It is still unclear if and to what degree holistic processing of faces is disrupted in CP. Such disruption would be expected to lead to a focus on local features of the face. In this study, we used binocular rivalry (BR) to implicitly measure face perception in conditions that favour holistic or local processing. The underlying assumption is that if stimulus saliency affects the perceptual dominance of a given stimulus in BR, one can deduce how salient a stimulus is for a given group (here: participants with and without CP) based on the measured perceptual dominance. A further open question is whether the deficit in face processing in CP extends to the processing of the facial display of emotions. In experiment 1, we compared predominance of upright and inverted faces displaying different emotions (fearful, happy, neutral) vs. houses between participants with CP (N = 21) and with normal face perception (N = 21). The results suggest that CP observers process emotions in faces automatically but rely more on local features than controls. The inversion of faces, which is supposed to disturb holistic processing, affected controls in a more pronounced way than participants with CP. In experiment 2, we introduced the Thatcher effect in BR by inverting the eye and mouth regions of the presented faces in the hope of further increasing the effect of face inversion. However, our expectations were not borne out by the results. Critically, both experiments showed that inversion effects were more pronounced in controls than in CP, suggesting that holistic face processing is less relevant in CP. We find BR to be a useful implicit test for assessing visual processing specificities in neurological participants.

A hierarchy of visual processing deficits in body dysmorphic disorder: a conceptual review and empirical investigation

OBJECTIVE

Abnormal visual processing has been proposed as a mechanism underlying excessive focus on minor appearance flaws in body dysmorphic disorder (BDD). Existing BDD research has not differentiated the various stages of face processing (featural, first-order configural, holistic and second-order configural) that are required for higher-order processes such as emotion recognition. This study investigated a hierarchical visual processing model to examine the nature of abnormalities in face processing in BDD.

METHOD

Thirty BDD participants and 27 healthy controls completed the Navon task, a featural and configural face processing task and a facial emotion labelling task.

RESULTS

BDD participants performed similarly to controls when processing global and local non-face stimuli on the Navon task, when detecting subtle changes in the features and spacing of a target face, and when labelling emotional faces. However, BDD participants displayed poorer performance when viewing inverted faces, indicating difficulties in configural processing.

CONCLUSIONS

The findings only partially support prior work. However, synthesis of results with previous findings indicates that heterogenous task methodologies may contribute to inconsistent findings. Recommendations are provided regarding the task parameters that appear most sensitive to abnormalities in BDD.

Sound-encoded faces activate the left fusiform face area in the early blind

Face perception in humans and nonhuman primates is accomplished by a patchwork of specialized cortical regions. How these regions develop has remained controversial. In sighted individuals, facial information is primarily conveyed via the visual modality. Early blind individuals, on the other hand, can recognize shapes using auditory and tactile cues. Here we demonstrate that such individuals can learn to distinguish faces from houses and other shapes by using a sensory substitution device (SSD) presenting schematic faces as sound-encoded stimuli in the auditory modality. Using functional MRI, we then asked whether a face-selective brain region like the fusiform face area (FFA) shows selectivity for faces in the same subjects, and indeed, we found evidence for preferential activation of the left FFA by sound-encoded faces. These results imply that FFA development does not depend on experience with visual faces per se but may instead depend on exposure to the geometry of facial configurations.

Robust holistic face processing in early childhood during the COVID-19 pandemic

The timing of the developmental emergence of holistic face processing and its sensitivity to experience in early childhood are somewhat controversial topics. To investigate holistic face perception in early childhood, we used an online testing platform and administered a two-alternative forced-choice task to 4-, 5-, and 6-year-old children. The children saw pairs of composite faces and needed to decide whether the faces were the same or different. To determine whether experience with masked faces may have negatively affected holistic processing, we also administered a parental questionnaire to assess the children's exposure to masked faces during the COVID-19 pandemic. We found that all three age groups performed holistic face processing when the faces were upright (Experiment 1) but not when the faces were inverted (Experiment 2), that response accuracy increased with age, and that response accuracy was not related to degree of exposure to masked faces. These results indicate that holistic face processing is relatively robust in early childhood and that short-term exposure to partially visible faces does not negatively affect young children's holistic face perception.

Learning facilitates dual-process face recognition regardless of holistic processing

Much evidence suggests that faces are recognized based on their global familiarity in a signal-detection manner. However, experiments drawing this conclusion typically present study lists of faces only once or twice, and the nature of face recognition at higher levels of learning remains unclear. Here, three experiments are reported in which participants studied some faces eight times and others twice and then took a recognition test containing previously viewed faces, entirely new faces, and faces which recombined the parts of previously viewed faces. Three measures converged to suggest that study list repetition increased the likelihood of participants rejecting recombined faces as new by recollecting that their parts were studied but in a different combination, and that manipulating holistic or Gestalt-like processing-a hallmark of face perception-qualitatively preserved its effect on how memory judgments are made. This suggests that face learning causes a shift from the use of a signal-detection strategy to the use of a dual-process strategy of face recognition regardless of holistic processing.

Faces, English words and Chinese characters: a study of dual-task interference in mono-and bilingual speakers

The many-to-many hypothesis suggests that face and visual-word processing tasks share neural resources in the brain, even though they show opposing hemispheric asymmetries in neuroimaging and neuropsychologic studies. Recently it has been suggested that both stimulus and task effects need to be incorporated into the hypothesis. A recent study found dual-task interference between face and text functions that lateralized to the same hemisphere, but not when they lateralized to different hemispheres. However, it is not clear whether a lack of interference between word and face recognition would occur for other languages, particularly those with a morpho-syllabic script, like Chinese, for which there is some evidence of greater right hemispheric involvement. Here, we used the same technique to probe for dual-task interference between English text, Chinese characters and face recognition. We tested 20 subjects monolingual for English and 20 subjects bilingual for Chinese and English. We replicated the prior result for English text and showed similar results for Chinese text with no evidence of interference with faces. We also did not find interference between Chinese and English text. The results support a view in which reading English words, reading Chinese characters and face identification have minimal sharing of neural resources.

Holistic processing and visual characteristics of regulated and spontaneous expressions

The rapid and efficient recognition of facial expressions is crucial for adaptive behaviors, and holistic processing is one of the critical processing methods to achieve this adaptation. Therefore, this study integrated the effects and attentional characteristics of the authenticity of facial expressions on holistic processing. The results show that both regulated and spontaneous expressions were processed holistically. However, the spontaneous expression details did not indicate typical holistic processing, with the congruency effect observed equally for aligned and misaligned conditions. No significant difference between the two expressions was observed in terms of reaction times and eye movement characteristics (i.e., total fixation duration, fixation counts, and first fixation duration). These findings suggest that holistic processing strategies differ between the two expressions. Nevertheless, the difference was not reflected in attentional engagement.

Looking at the upper facial half enlarges the range of holistic face processing

Previous studies suggested that upper and lower facial halves might be involved in the human holistic face processing differently. In this study, we replicated and extended the finding above. In Experiment 1, we used the standard composite-face task to measure holistic face processing when participants made judgements on the upper and lower facial halves separately. Results showed that the composite-face effect was stronger for the upper facial half compared to the lower half. In Experiment 2, we investigated how facial information was integrated when participants focused on different features, using the perceptual field paradigm. Results showed that: (1) more "peripheral faces" were chosen when participants fixated at the eyes than when they fixated at the mouth; (2) less "peripheral faces" were chosen for inverted faces regardless of the fixated features. Findings from both experiments together indicate that more peripheral facial information were integrated when participants focused on the upper facial half, highlighting the significance of focusing on the upper facial half in face processing.

Do chimpanzees see a face on Mars? A search for face pareidolia in chimpanzees

We sometimes perceive meaningful patterns or images in random arrangements of colors and shapes. This phenomenon is called pareidolia and has recently been studied intensively, especially face pareidolia. In contrast, there are few comparative-cognitive studies on face pareidolia with nonhuman primates. This study explored behavioral evidence for face pareidolia in chimpanzees using visual search and matching tasks. Faces are processed in a configural manner, and their perception and recognition are hampered by inversion and misalignment of top and bottom parts. We investigated whether the same effect occurs in a visual search for face-like objects. The results showed an effect of misalignment. On the other hand, consistent results were not obtained with the photographs of fruits. When only the top or bottom half of the face-like object was presented, chimpanzees showed better performance for the top-half condition, suggesting the importance of the eye area in face pareidolia. In the positive-control experiments, chimpanzees received the same experiment using human faces and human participants with face-like objects and fruits. As a result, chimpanzees showed an inefficient search for inverted and misaligned faces and humans for manipulated face-like objects. Finally, to examine the role of face awareness, we tested matching a human face to a face-like object in chimpanzees but obtained no substantial evidence that they saw the face-like object as a "face." Based on these results, we discussed the extents and limits of face pareidolia in chimpanzees.

What is So Special About Contemporary CG Faces? Semiotics of MetaHumans

This paper analyses the features of the 2021 software for the creation of ultrarealistic digital characters "MetaHuman Creator" and reflects on the causes of such perceived effect of realism to understand if the faces produced with such software represent an actual novelty from an academic standpoint. Such realism is first of all defined as the result of semio-cognitive processes which trigger interpretative habits specifically related to faces. These habits are then related to the main properties of any realistic face: being face-looking, face-meaning and face-acting. These properties, in turn, are put in relation with our interactions with faces in terms of face detection, face recognition, face reading and face agency. Within this theoretical framework, we relate the characteristics of these artificial faces with such interpretative habits. To do so, we first of all make an examination of the technological features behind both the software and the digital faces it produces. This analysis highlights four main points of interest: the mathematical accuracy, the scanned database, the high level of details and the transformative capacities of these artificial faces. We then relate these characteristics with the cultural and cognitive aspects involved in recognizing and granting meaning to faces. This reveals how metahuman faces differs from previous artificial faces in terms of indexicality, intersubjectivity, informativity and irreducibility. But it also reveals some limits of such effect of reality in terms of intentionality and historical context. This examination consequently brings us to conclude that metahuman faces are qualitatively different from previous artificial faces and, in the light of their potentials and limits, to highlight four main lines of future research based on our findings.

The relation between holistic processing as measured by three composite tasks and face processing: A latent variable modeling approach

We investigated the relationship between holistic processing and face processing using a latent variables approach. Three versions of the composite paradigm were used to measure holistic processing: Vanderbilt Holistic Face Processing Test, a sequential composite matching task, and a simultaneous composite matching task. Three tasks were used to measure face perception and face memory abilities respectively. We had three pairs of tasks such that within each pair (of memory and perception task), the stimuli involved, the requirement for matching across viewpoints, etc., are the same, such that the only difference is whether perception or memory is taxed. There were no significant correlations between the different versions of the composite task. We discovered no evidence to support a distinction between face perception and face memory, suggesting the existence of a general face processing factor. Finally, there was no evidence that holistic processing (as captured by either of the three composite tasks) is predictive of better face processing per se, casting doubts on the role of holistic processing in differentiating different levels of efficiency in face processing.

Body Processing in Children and Adolescents with Traumatic Brain Injury: An Exploratory Study

Dysfunctions in body processing have been documented in adults with brain damage, while limited information is available for children. This study aimed to investigate body processing in children and adolescents with traumatic brain injury (TBI) (N = 33), compared to peers with typical development. Two well-known computerized body-representation paradigms, namely Visual Body Recognition and Visuo-spatial Imagery, were administered. Through the first paradigm, the body inversion and composite illusion effects were tested with a matching to sample task as measures of configural and holistic processing of others’ bodies, respectively. The second paradigm investigated with a laterality judgement task the ability to perform first-person and object-based mental spatial transformations of own body and external objects, respectively. Body stimuli did not convey any emotional contents or symbolic meanings. Patients with TBI had difficulties with mental transformations of both body and object stimuli, displaying deficits in motor and visual imagery abilities, not limited to body processing. Therefore, cognitive rehabilitation of body processing in TBI might benefit from the inclusion of both general training on visuo-spatial abilities and specific exercises aimed at boosting visual body perception and motor imagery.

Face specific inversion effects provide evidence for two subtypes of developmental prosopagnosia

Many studies have attempted to identify the perceptual underpinnings of developmental prosopagnosia (DP). The majority have focused on whether holistic and configural processing mechanisms are impaired in DP. However, previous work suggests that there is substantial heterogeneity in holistic and configural processing within the DP population; further, there is disagreement as to whether any deficits are face-specific or reflect a broader perceptual deficit. This study used a data-driven approach to examine whether there are systematic patterns of variability in DP that reflect different underpinning perceptual deficits. A group of individuals with DP (N = 37) completed a cognitive battery measuring holistic/configural and featural processing in faces and non-face objects. A two-stage cluster analysis on data from the Cambridge Face Perception Test identified two subgroups of DPs. Across several tasks, the first subgroup (N = 21) showed typical patterns of holistic/configural processing (measured via inversion effects); the second (N = 16) was characterised by reduced or abolished inversion effects compared to age-matched control participants (N = 91). The subgroups did not differ on tasks measuring upright face matching, object matching, non-face holistic processing, or composite effects. These findings indicate two separable pathways to face recognition impairment, one characterised by impaired configural processing and the other potentially by impaired featural processing. Comparisons to control participants provide some preliminary evidence that the deficit in featural processing may extend to some non-face stimuli. Our results demonstrate the utility of examining both the variability between and consistency across individuals with DP as a means of illuminating our understanding of face recognition in typical and atypical populations.

The relationships between reading fluency and different measures of holistic word processing

Recently, paradigms in the face recognition literature have been adopted to reveal holistic processing in word recognition. It is unknown, however, whether different measures of holistic word processing share similar underlying mechanisms, and whether fluent word reading relies on holistic word processing. We measured holistic processing effects in three paradigms (composite, configural sensitivity, part-whole) as well as in reading fluency (3DM task: reading aloud high- and low-frequency words and pseudowords). Bin scores were used to combine accuracy and response time variables in the quest for a more comprehensive, reliable, and valid measure of holistic processing. Weak correlations were found between the different holistic processing measures, with only a significant correlation between the configural sensitivity effect and part-whole effect (r = .32) and a trend of a positive correlation between the word composite effect and configural sensitivity effect (r = .21). Of the three holistic processing measures, only one (part-whole effect) correlated with a lexical access measure of 3DM (r = .23). We also performed a principal component analysis (PCA) of performance in the three lists of 3DM, with the second most probably reflecting lexical access processes. There was a tendency for a positive correlation between part-whole bin measure and Component 2 of PCA. We also found a positive correlation between composite aligned in accuracy and Component 2 of PCA.Our results show that different measures of holistic word processing reflect predominantly different mechanisms, and that differences among normal readers in word reading do not seem to depend highly on holistic processing.

The inversion effect in word recognition: the effect of language familiarity and handwriting

Humans have expertise with visual words and faces. One marker of this expertise is the inversion effect. This is attributed to experience with those objects being biased towards a canonical orientation, rather than some inherent property of object structure or perceptual anisotropy. To confirm the role of experience, we measured inversion effects in word matching for familiar and unfamiliar languages. Second, we examined whether there may be more demands on reading expertise with handwritten stimuli rather than computer font, given the greater variability and irregularities in the former, with the prediction of larger inversion effects for handwriting. We recruited two cohorts of subjects, one fluent in Farsi and the other in Punjabi, neither of whom were able to read the other's language. Subjects performed a match-to-sample task with words in either computer fonts or handwritings. Subjects were more accurate and faster with their familiar language, even when it was inverted. Inversion effects were present for the familiar but not the unfamiliar language. The inversion effect in accuracy for handwriting was larger than that for computer fonts in the familiar language. We conclude that the word inversion effect is generated solely by orientation-biased experience, and that demands on this expertise are greater with handwriting than computer font.

Congenitally blind adults can learn to identify face-shapes via auditory sensory substitution and successfully generalize some of the learned features

Unlike sighted individuals, congenitally blind individuals have little to no experience with face shapes. Instead, they rely on non-shape cues, such as voices, to perform character identification. The extent to which face-shape perception can be learned in adulthood via a different sensory modality (i.e., not vision) remains poorly explored. We used a visual-to-auditory Sensory Substitution Device (SSD) that enables conversion of visual images to the auditory modality while preserving their visual characteristics. Expert SSD users were systematically taught to identify cartoon faces via audition. Following a tailored training program lasting ~ 12 h, congenitally blind participants successfully identified six trained faces with high accuracy. Furthermore, they effectively generalized their identification to the untrained, inverted orientation of the learned faces. Finally, after completing the extensive 12-h training program, participants learned six new faces within 2 additional hours of training, suggesting internalization of face-identification processes. Our results document for the first time that facial features can be processed through audition, even in the absence of visual experience across the lifespan. Overall, these findings have important implications for both non-visual object recognition and visual rehabilitation practices and prompt the study of the neural processes underlying auditory face perception in the absence of vision.

The Effect of Surgical Masks on the Featural and Configural Processing of Emotions

From the start of the COVID-19 pandemic, the use of surgical masks became widespread. However, they occlude an important part of the face and make it difficult to decode and interpret other people's emotions. To clarify the effect of surgical masks on configural and featural processing, participants completed a facial emotion recognition task to discriminate between happy, sad, angry, and neutral faces. Stimuli included fully visible faces, masked faces, and a cropped photo of the eyes or mouth region. Occlusion due to the surgical mask affects emotion recognition for sadness, anger, and neutral faces, although no significative differences were found in happiness recognition. Our findings suggest that happiness is recognized predominantly via featural processing.

Face processing in the temporal lobe

Face perception is a socially important but complex process with many stages and many facets. There is substantial evidence from many sources that it involves a large extent of the temporal lobe, from the ventral occipitotemporal cortex and superior temporal sulci to anterior temporal regions. While early human neuroimaging work suggested a core face network consisting of the occipital face area, fusiform face area, and posterior superior temporal sulcus, studies in both humans and monkeys show a system of face patches stretching from posterior to anterior in both the superior temporal sulcus and inferotemporal cortex. Sophisticated techniques such as fMRI adaptation have shown that these face-activated regions show responses that have many of the attributes of human face processing. Lesions of some of these regions in humans lead to variants of prosopagnosia, the inability to recognize the identity of a face. Lesion, imaging, and electrophysiologic data all suggest that there is a segregation between identity and expression processing, though some suggest this may be better characterized as a distinction between static and dynamic facial information.

Distinct neural-behavioral correspondence within face processing and attention networks for the composite face effect

The composite face effect (CFE) is recognized as a hallmark for holistic face processing, but our knowledge remains sparse about its cognitive and neural loci. Using functional magnetic resonance imaging with independent localizer and complete composite face task, we here investigated its neural-behavioral correspondence within face processing and attention networks. Complementing classical comparisons, we adopted a dimensional reduction approach to explore the core cognitive constructs of the behavioral CFE measurement. Our univariate analyses found an alignment effect in regions associated with both the extended face processing network and attention networks. Further representational similarity analyses based on the Euclidian distances among all experimental conditions were used to identify cortical regions with reliable neural-behavioral correspondences. Multidimensional scaling and hierarchical clustering analyses for neural-behavioral correspondence data revealed two principal components underlying the behavioral CFE effect, which fit best to the neural responses in the bilateral insula and medial frontal gyrus. These findings highlight the distinct neurocognitive contributions of both face processing and attentional networks to the behavioral CFE outcome, which bridge the gaps between face recognition and attentional control models.

Whole-object effects in visual word processing: Parallels with and differences from face recognition

Visual words and faces differ in their structural properties, but both are objects of high expertise. Holistic processing is said to characterize expert face recognition, but the extent to which whole-word processes contribute to word recognition is unclear, particularly as word recognition is thought to proceed by a component-based process. We review the evidence for experimental effects in word recognition that parallel those used to support holistic face processing, namely inversion effects, the part-whole task, and composite effects, as well as the status of whole-word processing in pure alexia and developmental dyslexia, contrasts between familiar and unfamiliar languages, and the differences between handwriting and typeset font. The observations support some parallels in whole-object influences between face and visual word recognition, but do not necessarily imply similar expert mechanisms. It remains to be determined whether and how the relative balance between part-based and whole-object processing differs for visual words and faces.

Children process faces holistically with the same efficiency as adults

Previous studies had reported qualitatively identical holistic face processing (using the composite task) already in 6-year-olds. In the present study, we evaluated these processes quantitatively by evaluating whether children are less efficient in dealing with and encoding faces. Thus, in the present study we explored the time course of holistic processing in children and adults by manipulating stimulus presentation time. The study composite task was presented for 800 ms. The test composite face was presented either for 183 ms or 800 ms. Our youngest participants, 6-year-olds, process faces holistically with the same efficiency as typical adults.

Limited Shared Variance among Measures of Cognitive Performance Used in Nutrition Research: The Need to Prioritize Construct Validity and Biological Mechanisms in Choice of Measures

BACKGROUND

The literature on correlates of nutrition has seen an increase in studies focused on functional consequences at the levels of neural, perceptual, and cognitive functioning. A range of measurement methodologies have been used in these studies, and investigators and funding agencies have raised the questions of how and if these various methodologies are at all comparable.

OBJECTIVE

The aim was to determine the extent to which 3 different sets of cognitive measures provide comparable information across 2 subsamples that shared culture and language but differed in terms of socioeconomic status (SES) and academic preparation.

METHODS

A total of 216 participants were recruited at 2 US universities. Each participant completed 3 sets of cognitive measures: 1 custom-designed set based on well-understood laboratory measures of cognition [cognitive task battery (COGTASKS)] and 2 normed batteries [Cambridge Neuropsychological Test Automated Battery (CANTAB), Weschler Adult Intelligence Scale, fourth edition (WAIS-IV)] designed for assessing general cognitive function.

RESULTS

The 3 sets differed with respect to the extent to which SES and educational preparation affected the results, with COGTASKS showing no differences due to testing location and WAIS-IV showing substantial differences. There were, at best, weak correlations among tasks sharing the same name or claiming to measure the same construct.

CONCLUSIONS

Comparability of measures of cognition cannot be assumed, even if measures have the same name or claim to assess the same construct. In selecting and evaluating different measures, construct validity and underlying biological mechanisms need to be at least as important as population norms and the ability to connect with existing literatures.

The effect of face masks and sunglasses on identity and expression recognition with super-recognizers and typical observers

Face masks present a new challenge to face identification (here matching) and emotion recognition in Western cultures. Here, we present the results of three experiments that test the effect of masks, and also the effect of sunglasses (an occlusion that individuals tend to have more experienced with) on (i) familiar face matching, (ii) unfamiliar face matching and (iii) emotion categorization. Occlusion reduced accuracy in all three tasks, with most errors in the mask condition; however, there was little difference in performance for faces in masks compared with faces in sunglasses. Super-recognizers, people who are highly skilled at matching unconcealed faces, were impaired by occlusion, but at the group level, performed with higher accuracy than controls on all tasks. Results inform psychology theory with implications for everyday interactions, security and policing in a mask-wearing society.

Holistic processing of Chinese characters in college students with dyslexia

Expert face recognition has long been marked by holistic processing. Hence, due to the many visual properties shared between face perception and Chinese characters, it has been suggested that Chinese character recognition may induce stronger holistic processing in expert readers than in novices. However, there have been different viewpoints presented about Chinese character recognition, one of which suggests that expertise in this skill involved reduced holistic processing which may be modulated by writing experiences/performances. In this study we examined holistic processing in Chinese character recognition in adults with and without dyslexia, using the complete composite paradigm. Our results showed that the adults with dyslexia recognized Chinese characters with a stronger holistic processing effect than the typical controls. It seems that those with dyslexia relied overly on the visual spatial information of characters and showed deficits in attending selectively to their components when processing Chinese characters, which hindered the development of expert reading and writing skills. This effect was in contrast to previous perceptual expertise studies in which reduced holistic processing marked deficits in face/visual object recognition. This study is also the first to show that Chinese adults with dyslexia had persistent below average performances in Chinese literacy.

Visual search for facing and non-facing people: The effect of actor inversion

In recent years, there has been growing interest in how human observers perceive, attend to, and recall, social interactions viewed from third-person perspectives. One of the interesting findings to emerge from this new literature is the search advantage for facing dyads. When hidden amongst pairs of individuals facing in the same direction, pairs of individuals arranged front-to-front are found faster in visual search tasks than pairs of individuals arranged back-to-back. Interestingly, the search advantage for facing dyads appears to be sensitive to the orientation of the people depicted. While front-to-front target pairs are found faster than back-to-back targets when target and distractor pairings are shown upright, front-to-front and back-to-back targets are found equally quickly when pairings are shown upside-down. In the present study, we sought to better understand why the search advantage for facing dyads is sensitive to the orientation of the people depicted. To begin, we show that the orientation sensitivity of the search advantage is seen with dyads constructed from faces only, and from bodies with the head and face occluded. We replicate these effects using two different visual search paradigms. We go on to show that individual faces and bodies, viewed in profile, produce strong attentional cueing effects when shown upright, but not when presented upside-down. Together with recent evidence that arrows arranged front-to-front also produce the search advantage for facing dyads, these findings support the view that the search advantage is a by-product of the ability of constituent elements to direct observers' visuo-spatial attention.

Human Face Recognition in Horses: Data in Favor of a Holistic Process

Recent studies have demonstrated that horses can recognize humans based simply on visual information. However, none of these studies have investigated whether this involves the recognition of the face itself, or simply identifying people from non-complex external clues, such as hair color. To go beyond this we wanted to know whether certain features of the face were indispensable for this recognition (e.g., colors, hair or eyes). The 11 horses in this study had previously learned to identify four unfamiliar faces (portrait view and in color) presented repeatedly on a screen. We thus assessed whether they were able to identify these same faces spontaneously when they were presented in four other conditions: profile view, black and white, eyes hidden, changed hairstyle. The horses’ performances remained higher than chance level for all the conditions. In a choice test under real conditions, they then approached the people whose face they had learned more often than unknown people. In conclusion, when considering all the individuals studied, no single facial element that we tested appears to be essential for recognition, suggesting holistic processing in face recognition. That means horses do not base their recognition solely on an easy clue such as hair color. They can also link faces from photographs with people in real life, indicating that horses do not process images of faces as simple abstract shapes.

Children's use of local and global visual features for material perception

Adults can rapidly recognize material properties in natural images, and children's performance in material categorization tasks suggests that this ability develops slowly during childhood. In the current study, we further examined the information children use to recognize materials during development by asking how the use of local versus global visual features for material perception changes in middle childhood. We recruited adults and 5- to 10-year-old children for three experiments that required participants to distinguish between shape-matched images of real and artificial food. Accurate performance in this task requires participants to distinguish between a wide range of material properties characteristic of each category, thus testing material perception abilities broadly. In two tasks, we applied distinct methods of image scrambling (block scrambling and diffeomorphic scrambling) to parametrically disrupt global appearance while preserving features in small spatial neighborhoods. In the third task, we used image blurring to parametrically disrupt local feature visibility. Our key question was whether or not participant age affected performance differently when local versus global appearance was disrupted. We found that although image blur led to disproportionately poorer performance in young children, this effect was reduced or absent when diffeomorphic scrambling was used. We interpret this outcome as evidence that the ability to recruit large-scale visual features for material perception may develop slowly during middle childhood.

Are the facial gender and facial age variants of the composite face illusion products of a common mechanism?

When the upper half of one face (‘target region’) is spatially aligned with the lower half of another (‘distractor region’), the two halves appear to fuse together perceptually, changing observers’ subjective perception of the target region. This ‘composite face illusion’ is regarded as a key hallmark of holistic face processing. Importantly, distractor regions bias observers’ subjective perception of target regions in systematic, predictable ways. For example, male and female distractor regions make target regions appear masculine and feminine; young and old distractor regions make target regions appear younger and older. In the present study, we first describe a novel psychophysical paradigm that yields precise reliable estimates of these perceptual biases. Next, we use this novel procedure to establish a clear relationship between observers’ susceptibility to the age and gender biases induced by the composite face illusion. This relationship is seen in a lab-based sample (N = 100) and is replicated in an independent sample tested online (N = 121). Our findings suggest that age and gender variants of the composite illusion may be different measures of a common structural binding process, with an origin early in the face-processing stream.

Holistic processing of facial identity in developmental prosopagnosia

The nature of the perceptual deficit seen in developmental prosopagnosia remains poorly understood. One possibility is that these individuals experience face recognition difficulties because they fail to process faces holistically; they may be less able to analyze distal regions in parallel and therefore struggle to integrate information from different regions into a unified perceptual whole. Consequently, developmental prosopagnosics may be forced to base perceptual decisions on a slow, effortful piecemeal analysis of local facial features. In the present study, we sought to test this view by comparing the face recognition of developmental prosopagnosics and typical observers under two viewing conditions: when target faces were briefly presented in their entirety, and when they were inspected region-by-region through a dynamic aperture. If developmental prosopagnosics are forced to base perceptual decisions on information accumulated from a serial piecemeal analysis, one would expect little if any decrement in performance when target faces are viewed through apertures. Contrary to this prediction, however, developmental prosopagnosics showed strong aperture effects comparable with typical observers; their perceptual decisions were more accurate in the whole-face condition than when targets were viewed through the aperture. As expected, the developmental prosopagnosics were less accurate than typical controls when judging briefly presented faces shown in their entirety. Strikingly, however, they were also less able to accumulate perceptual evidence from a serial region-by-region analysis, than typical observers. Our results suggest that the perceptual problems seen in this population arise from imprecise descriptions of local regions, not aberrant holistic processing.

Testing the effects of transcranial direct current stimulation (tDCS) on the face inversion effect and the N170 event-related potentials (ERPs) component

The following study investigates the effects of tDCS on face recognition skills indexed by the face inversion effect (better recognition performance for upright vs. inverted faces). We combined tDCS and EEG simultaneously to examine the effects of tDCS on the face inversion effect behaviourally and on the N170 ERPs component. The results from two experiments (overall N = 112) show that anodal tDCS delivered at Fp3 site for 10 min at 1.5 mA (double-blind and between-subjects) can reduce behaviourally the face inversion effect compared to sham (control) stimulation. The ERP results provide some evidence for tDCS being able to influence the face inversion effect on the N170. Specifically, we find a dissociation of the tDCS-induced effects where for the N170 latencies the tDCS reduces the usual face inversion effect (delayed N170 in response to inverted vs. upright faces) compared to sham. Contrarily, the same tDCS procedure on the same participants increased the inversion effect seen in the N170 amplitudes by making the negative deflection for the inverted faces that much greater than that for upright faces. We interpret our results in the context of the literature on the face inversion effect and the N170 peak component. In doing so, we extend our results to previous studies investigating the effects of tDCS on perceptual learning and face recognition.

Perceptual integration and the composite face effect

The composite face paradigm is widely used to investigate holistic perception of faces. In the paradigm, parts from different faces (usually the top and bottom halves) are recombined. The principal criterion for holistic perception is that responses involving the component parts of composites in which the parts are aligned into a face-like configuration are disrupted compared with the same parts in a misaligned (not face-like) format. This is often taken as evidence that seeing a whole face in the aligned condition interferes with perceiving its separate parts, but the extent to which the effect is perceptually driven remains unclear. We used salient perceptual categories of gender (male or female) and race (Asian or Caucasian appearance) to create composite stimuli from parts of faces that varied orthogonally on these characteristics. In Experiment 1, participants categorised the gender of the parts of aligned composite and misaligned images created from parts with the same (congruent) or different (incongruent) gender and the same (congruent) or different (incongruent) race. In Experiment 2, the same stimuli were used but the task changed to categorising race. In both experiments, there was a strong influence of the task-relevant manipulation on the composite effect, with slower responses to aligned stimuli with incongruent gender in Experiment 1 and incongruent race in Experiment 2. In contrast, the task-irrelevant variable (race in Experiment 1, gender in Experiment 2) did not exert much influence on the composite effect in either experiment. These findings show that although holistic integration of salient visual properties makes a strong contribution to the composite face effect, it clearly also involves targeted processing of an attended visual characteristic.

Holistic word context does not influence holistic processing of artificial objects in an interleaved composite task

Holistic processing, a hallmark of expert processing, has been shown for written words, signaled by the word composite effect, similar to the face composite effect: fluent readers find it difficult to focus on just one half of a written word while ignoring the other half, especially when the two word halves are aligned rather than misaligned. This effect is signaled by a significant interaction between alignment and congruency of the two word parts. Face and visual word recognition, however, involve different neural mechanisms with an opposite hemispheric lateralization. It is then possible that faces and words can both involve holistic processing in their own separate face and word processing systems, but by using different mechanisms. In the present study, we replicated with words a previous study done with faces (Richler, Bukach, & Gauthier, 2009, Experiment 3). In a first experiment we showed that in a composite task with aligned artificial objects, no congruency effects are found. In a second experiment, using an interleaved task, a congruency effect for Ziggerins was induced in trials in which a word was first encoded, but more strongly when it was aligned. However, in a stricter test, we found no differences between the congruency effect for Ziggerins induced by aligned words versus pseudowords. Our results demonstrate that different mechanisms can underlie holistic processing in different expertise domains.

Face perception in autism spectrum disorder: Modulation of holistic processing by facial emotion

Individuals with Autism Spectrum Disorder (ASD; autistic individuals) may exhibit atypical face perception because they fail to process faces holistically. In the context of this hypothesis, it is critical to determine whether autistic individuals exhibit diminished susceptibility to the composite face illusion, widely regarded as a key marker of holistic face processing. To date, however, previous studies have yielded inconsistent findings. In light of recent evidence suggesting that facial emotion cues increase the strength of the composite face illusion in typical individuals, the present study sought to determine whether the presence of facial emotion also modulates the strength of the composite face illusion in autistic individuals, many of whom experience difficulties recognizing facial expressions. We therefore measured composite face effects in a sample of autistic individuals (N = 20) and matched typical controls (N = 29) using an incidental emotion procedure in which distractor regions varied systematically in their emotion strength. As expected, the presence of facial emotion in the distractor regions of composite face arrangements increased the strength of the illusory distortion induced. The extent of the modulation by facial emotion was similar in the two groups. The composite effects seen in the ASD group were qualitatively and quantitatively similar to those seen in the typical group, suggestive of intact holistic processing in this population.

Neural Sensitivity to Mutual Information in Intermediate-Complexity Face Features Changes during Childhood

One way in which face recognition develops during infancy and childhood is with regard to the visual information that contributes most to recognition judgments. Adult face recognition depends on critical features spanning a hierarchy of complexity, including low-level, intermediate, and high-level visual information. To date, the development of adult-like information biases for face recognition has focused on low-level features, which are computationally well-defined but low in complexity, and high-level features, which are high in complexity, but not defined precisely. To complement this existing literature, we examined the development of children's neural responses to intermediate-level face features characterized using mutual information. Specifically, we examined children's and adults' sensitivity to varying levels of category diagnosticity at the P100 and N170 components. We found that during middle childhood, sensitivity to mutual information shifts from early components to later ones, which may indicate a critical restructuring of face recognition mechanisms that takes place over several years. This approach provides a useful bridge between the study of low- and high-level visual features for face recognition and suggests many intriguing questions for further investigation.

Face recognition ability does not predict person identification performance: using individual data in the interpretation of group results

There are large individual differences in people's face recognition ability. These individual differences provide an opportunity to recruit the best face-recognisers into jobs that require accurate person identification, through the implementation of ability-screening tasks. To date, screening has focused exclusively on face recognition ability; however real-world identifications can involve the use of other person-recognition cues. Here we incorporate body and biological motion recognition as relevant skills for person identification. We test whether performance on a standardised face-matching task (the Glasgow Face Matching Test) predicts performance on three other identity-matching tasks, based on faces, bodies, and biological motion. We examine the results from group versus individual analyses. We found stark differences between the conclusions one would make from group analyses versus analyses that retain information about individual differences. Specifically, tests of correlation and analysis of variance suggested that face recognition ability was related to performance for all person identification tasks. These analyses were strikingly inconsistent with the individual differences data, which suggested that the screening task was related only to performance on the face task. This study highlights the importance of individual data in the interpretation of results of person identification ability.

Perceived Race Affects Configural Processing but Not Holistic Processing in the Composite-Face Task

One explanation for the own-race bias in face recognition is the loss of holistic processing for other-race faces. The composite-face task (involving matching the top halves of faces when the bottom halves are either changed or the same) tests holistic processing but it has been inconsistent in revealing other-race effects. Two composite-face experiments are reported using pairs of faces that have common internal features but can be perceived as either being racially Black or White depending on their external features. In Experiment 1 (matching the top halves of faces) holistic processing was found for both face races for White participants (shown by both a mis-alignment advantage when bottom halves were different and also by a congruence-by-alignment interaction in discrimination). Bayesian analysis supported there being no effect of race. However, the size of the simple congruence effect was larger for own- than for other-race faces. Experiment 2 found that this race-by-congruence interaction was not present when matching the bottom halves of faces. The results are interpreted in of terms of the perceived race affecting the processing of second-order relational information rather than holistic processing.

Modulation of the composite face effect by unintended emotion cues

When upper and lower regions from different emotionless faces are aligned to form a facial composite, observers 'fuse' the two halves together, perceptually. The illusory distortion induced by task-irrelevant ('distractor') halves hinders participants' judgements about task-relevant ('target') halves. This composite-face effect reveals a tendency to integrate feature information from disparate regions of intact upright faces, consistent with theories of holistic face processing. However, observers frequently perceive emotion in ostensibly neutral faces, contrary to the intentions of experimenters. This study sought to determine whether this 'perceived emotion' influences the composite-face effect. In our first experiment, we confirmed that the composite effect grows stronger as the strength of distractor emotion increased. Critically, effects of distractor emotion were induced by weak emotion intensities, and were incidental insofar as emotion cues hindered image matching, not emotion labelling per se. In Experiment 2, we found a correlation between the presence of perceived emotion in a set of ostensibly neutral distractor regions sourced from commonly used face databases, and the strength of illusory distortion they induced. In Experiment 3, participants completed a sequential matching composite task in which half of the distractor regions were rated high and low for perceived emotion, respectively. Significantly stronger composite effects were induced by the high-emotion distractor halves. These convergent results suggest that perceived emotion increases the strength of the composite-face effect induced by supposedly emotionless faces. These findings have important implications for the study of holistic face processing in typical and atypical populations.