Perceptual efficiency and the inversion effect for faces, words and houses

Autistic traits specific to communication ability are associated with performance on a Mooney face detection task

Difficulties in global face processing have been associated with autism. However, autism is heterogenous, and it is not known which dimensions of autistic traits are implicated in face-processing difficulties. To address this gap in knowledge, we conducted two experiments to examine how identification of Mooney face stimuli (stylized, black-and-white images of faces without details) related to the six subscales of the Comprehensive Autistic Trait Inventory in young adults. In Experiment 1, regression analyses indicated that participants with poorer communication skills had lower task sensitivity when discriminating between face-present and face-absent images, whilst other autistic traits had no unique predictive value. Experiment 2 replicated these findings and additionally showed that autistic traits were linked to a reduced face inversion effect. Taken together, these results indicate autistic traits, especially communication difficulties, are associated with reduced configural processing of face stimuli. It follows that both reduced sensitivity for identifying upright faces amongst similar-looking distractors and reduced susceptibility to face inversion effects may be linked to relatively decreased reliance on configural processing of faces in autism. This study also reinforces the need to consider the different facets of autism independently.

Developmental emergence of holistic processing in word recognition

Holistic processing (HP) of faces refers to the obligatory, simultaneous processing of the parts and their relations, and it emerges over the course of development. HP is manifest in a decrement in the perception of inverted versus upright faces and a reduction in face processing ability when the relations between parts are perturbed. Here, adopting the HP framework for faces, we examined the developmental emergence of HP in another domain for which human adults have expertise, namely, visual word processing. Children, adolescents, and adults performed a lexical decision task and we used two established signatures of HP for faces: the advantage in perception of upright over inverted words and nonwords and the reduced sensitivity to increasing parts (word length). Relative to the other groups, children showed less of an advantage for upright versus inverted trials and lexical decision was more affected by increasing word length. Performance on these HP indices was strongly associated with age and with reading proficiency. Also, the emergence of HP for word perception was not simply a result of improved visual perception over the course of development as no group differences were observed on an object decision task. These results reveal the developmental emergence of HP for orthographic input, and reflect a further instance of experience-dependent tuning of visual perception. These results also add to existing findings on the commonalities of mechanisms of word and face recognition. RESEARCH HIGHLIGHTS: Children showed less of an advantage for upright versus inverted trials compared to adolescents and adults. Relative to the other groups, lexical decision in children was more affected by increasing word length. Performance on holistic processing (HP) indices was strongly associated with age and with reading proficiency. HP emergence for word perception was not due to improved visual perception over development as there were no group differences on an object decision task.

Pareidolic faces receive prioritized attention in the dot-probe task

Face pareidolia occurs when random or ambiguous inanimate objects are perceived as faces. While real faces automatically receive prioritized attention compared with nonface objects, it is unclear whether pareidolic faces similarly receive special attention. We hypothesized that, given the evolutionary importance of broadly detecting animacy, pareidolic faces may have enough faceness to activate a broad face template, triggering prioritized attention. To test this hypothesis, and to explore where along the faceness continuum pareidolic faces fall, we conducted a series of dot-probe experiments in which we paired pareidolic faces with other images directly competing for attention: objects, animal faces, and human faces. We found that pareidolic faces elicited more prioritized attention than objects, a process that was disrupted by inversion, suggesting this prioritized attention was unlikely to be driven by low-level features. However, unexpectedly, pareidolic faces received more privileged attention compared with animal faces and showed similar prioritized attention to human faces. This attentional efficiency may be due to pareidolic faces being perceived as not only face-like, but also as human-like, and having larger facial features-eyes and mouths-compared with real faces. Together, our findings suggest that pareidolic faces appear automatically attentionally privileged, similar to human faces. Our findings are consistent with the proposal of a highly sensitive broad face detection system that is activated by pareidolic faces, triggering false alarms (i.e., illusory faces), which, evolutionarily, are less detrimental relative to missing potentially relevant signals (e.g., conspecific or heterospecific threats). In sum, pareidolic faces appear "special" in attracting attention.

The face inversion effect or the face upright effect?

The face inversion effect (FIE) refers to the observation that presenting stimuli upside-down impairs the processing of faces disproportionally more than other mono-oriented objects. This has been taken as evidence that processing of faces and objects differ qualitatively. However, nearly all FIE studies are based on comparing individuation of upright faces, which most people are rather good at, with individuation of objects most people are much less familiar with individuating (e.g., radios and airplanes). Consequently, the FIE may mainly reflect differences between categories in how they are processed prior to inversion, with within-category discrimination of upright faces being a much more familiar task than within-category discrimination among members belonging to other object classes. We tested this hypothesis by comparing inversion effects for faces and objects using object recognition tasks that do not require within-category discrimination (object decision and old/new recognition memory tasks). In all tasks (seven with objects and two with faces) we find credible inversion effects, but in no instance were these effects significantly larger for faces than for objects. This suggests that the FIE can be a product of familiarity with the type of identification process required in the upright conditions rather than some process that is selectively affected for faces when stimuli are inverted.

Face pareidolia in male schizophrenia

Faces are valuable signals for efficient social interaction. Yet, social cognition including the sensitivity to a coarse face scheme may be deviant in schizophrenia (SZ). Tuning to faces in non-face images such as shadows, grilled toasts, or ink blots is termed face pareidolia. This phenomenon is poorly investigated in SZ. Here face tuning was assessed in 44 male participants with SZ and person-by-person matched controls by using recently created Face-n-Thing images (photographs of non-face objects to a varying degree resembling a face). The advantage of these images is that single components do not automatically trigger face processing. Participants were administered a set of images with upright and inverted (180° in the image plane) orientation. In a two-alternative forced-choice paradigm, they had to indicate whether an image resembled a face. The findings showed that: (i) With upright orientation, SZ patients exhibited deficits in face tuning: they provided much fewer face responses than controls. (ii) Inversion generally hindered face pareidolia. However, while in neurotypical males, inversion led to a drastic drop in face impression, in SZ, the impact of orientation was reduced. (iii) Finally, in accord with the signal detection theory analysis, the sensitivity index (d-prime) was lower in SZ, whereas no difference occurred in decision criterion. The outcome suggests altered face pareidolia in SZ is caused by lower face sensitivity rather than by alterations in cognitive bias. Comparison of these findings with earlier evidence confirms that tuning to social signals is lower in SZ, and warrants tailored brain imaging research.

The mechanisms supporting holistic perception of words and faces are not independent

The question of whether word and face recognition rely on overlapping or dissociable neural and cognitive mechanisms received considerable attention in the literature. In the present work, we presented words (aligned or misaligned) superimposed on faces (aligned or misaligned) and tested the interference from the unattended stimulus category on holistic processing of the attended category. In Experiment 1, we found that holistic face processing is reduced when a face was overlaid with an unattended, aligned word (processed holistically). In Experiment 2, we found a similar reduction of holistic processing for words when a word was superimposed on an unattended, aligned face (processed holistically). This reciprocal interference effect indicates a trade-off in holistic processing of the two stimuli, consistent with the idea that word and face recognition may rely on non-independent, overlapping mechanisms.

The inversion effect in word recognition: the effect of language familiarity and handwriting

Humans have expertise with visual words and faces. One marker of this expertise is the inversion effect. This is attributed to experience with those objects being biased towards a canonical orientation, rather than some inherent property of object structure or perceptual anisotropy. To confirm the role of experience, we measured inversion effects in word matching for familiar and unfamiliar languages. Second, we examined whether there may be more demands on reading expertise with handwritten stimuli rather than computer font, given the greater variability and irregularities in the former, with the prediction of larger inversion effects for handwriting. We recruited two cohorts of subjects, one fluent in Farsi and the other in Punjabi, neither of whom were able to read the other's language. Subjects performed a match-to-sample task with words in either computer fonts or handwritings. Subjects were more accurate and faster with their familiar language, even when it was inverted. Inversion effects were present for the familiar but not the unfamiliar language. The inversion effect in accuracy for handwriting was larger than that for computer fonts in the familiar language. We conclude that the word inversion effect is generated solely by orientation-biased experience, and that demands on this expertise are greater with handwriting than computer font.

Metacognitive asymmetries in visual perception

Representing the absence of objects is psychologically demanding. People are slower, less confident and show lower metacognitive sensitivity (the alignment between subjective confidence and objective accuracy) when reporting the absence compared with presence of visual stimuli. However, what counts as a stimulus absence remains only loosely defined. In this Registered Report, we ask whether such processing asymmetries extend beyond the absence of whole objects to absences defined by stimulus features or expectation violations. Our pre-registered prediction was that differences in the processing of presence and absence reflect a default mode of reasoning: we assume an absence unless evidence is available to the contrary. We predicted asymmetries in response time, confidence, and metacognitive sensitivity in discriminating between stimulus categories that vary in the presence or absence of a distinguishing feature, or in their compliance with an expected default state. Using six pairs of stimuli in six experiments, we find evidence that the absence of local and global stimulus features gives rise to slower, less confident responses, similar to absences of entire stimuli. Contrary to our hypothesis, however, the presence or absence of a local feature has no effect on metacognitive sensitivity. Our results weigh against a proposal of a link between the detection metacognitive asymmetry and default reasoning, and are instead consistent with a low-level visual origin of metacognitive asymmetries for presence and absence.

Whole-object effects in visual word processing: Parallels with and differences from face recognition

Visual words and faces differ in their structural properties, but both are objects of high expertise. Holistic processing is said to characterize expert face recognition, but the extent to which whole-word processes contribute to word recognition is unclear, particularly as word recognition is thought to proceed by a component-based process. We review the evidence for experimental effects in word recognition that parallel those used to support holistic face processing, namely inversion effects, the part-whole task, and composite effects, as well as the status of whole-word processing in pure alexia and developmental dyslexia, contrasts between familiar and unfamiliar languages, and the differences between handwriting and typeset font. The observations support some parallels in whole-object influences between face and visual word recognition, but do not necessarily imply similar expert mechanisms. It remains to be determined whether and how the relative balance between part-based and whole-object processing differs for visual words and faces.

Face pareidolia in the brain: Impact of gender and orientation

Research on face sensitivity is of particular relevance during the rapidly evolving Covid-19 pandemic leading to social isolation, but also calling for intact interaction and sharing. Humans possess high sensitivity even to a coarse face scheme, seeing faces in non-face images where real faces do not exist. The advantage of non-face images is that single components do not trigger face processing. Here by implementing a novel set of Face-n-Thing images, we examined (i) how face tuning alters with changing display orientation, and (ii) whether it is affected by observers’ gender. Young females and males were presented with a set of Face-n-Thing images either with canonical upright orientation or inverted 180° in the image plane. Face impression was substantially impeded by display inversion. Furthermore, whereas with upright display orientation, no gender differences were found, with inversion, Face-n-Thing images elicited face impression in females significantly more often. The outcome sheds light on the origins of the face inversion effect in general. Moreover, the findings open a way for examination of face sensitivity and underwriting brain networks in neuropsychiatric conditions related to the current pandemic (such as depression and anxiety), most of which are gender/sex-specific.

Search for Face Identity or Expression: Set Size Effects in Developmental Prosopagnosia

The set size effect during visual search indexes the effects of processing load and thus the efficiency of perceptual mechanisms. Our goal was to investigate whether individuals with developmental prosopagnosia show increased set size effects when searching faces for face identity and how this compares to search for face expression. We tested 29 healthy individuals and 13 individuals with developmental prosopagnosia. Participants were shown sets of three to seven faces to judge whether the identities or expressions of the faces were the same across all stimuli or if one differed. The set size effect was the slope of the linear regression between the number of faces in the array and the response time. Accuracy was similar in both controls and prosopagnosic participants. Developmental prosopagnosic participants displayed increased set size effects in face identity search but not in expression search. Single-participant analyses reveal that 11 developmental prosopagnosic participants showed a putative classical dissociation, with impairments in identity but not expression search. Signal detection theory analysis showed that identity set size effects were highly reliable in discriminating prosopagnosic participants from controls. Finally, the set size ratios of same to different trials were consistent with the predictions of self-terminated serial search models for control participants and prosopagnosic participants engaged in expression search but deviated from those predictions for identity search by the prosopagnosic cohort. We conclude that the face set size effect reveals a highly prevalent and selective perceptual inefficiency for processing face identity in developmental prosopagnosia.

Visual search for complex objects: Set-size effects for faces, words and cars

To compare visual processing for different object types, we developed visual search tests that generated accuracy and response time parameters, including an object set-size effect that indexes perceptual processing load. Our goal was to compare visual search for two expert object types, faces and visual words, as well as a less expert type, cars. We first asked if faces and words showed greater inversion effects in search. Second, we determined whether search with upright stimuli correlated with other perceptual indices. Last we assessed for correlations between tests within a single orientation, and between orientations for a single object type. Object set-size effects were smaller for faces and words than cars. All accuracy and temporal measures showed an inversion effect for faces and words, but not cars. Face-search accuracy measures correlated with accuracy on the Cambridge Face Memory Test and word-search temporal measures correlated with single-word reading times, but car search did not correlate with semantic car knowledge. There were cross-orientation correlations for all object types, as well as cross-object correlations in the inverted orientation, while in the upright orientation face search did not correlate with word or car search. We conclude that object search shows effects of expertise. Compared to cars, words and faces showed smaller object set-size effects, greater inversion effects, and their search results correlated with other indices of perceptual expertise. The correlation analyses provide preliminary evidence supporting contributions from common processes in the case of inverted stimuli, object-specific processes that operate in both orientations, and distinct processing for upright faces.