Neural mechanisms underlying visual pareidolia processing: An fMRI study

Dynamic brain communication underwriting face pareidolia

Face pareidolia is a tendency to seeing faces in nonface images that reflects high tuning to a face scheme. Yet, studies of the brain networks underwriting face pareidolia are scarce. Here, we examined the time course and dynamic topography of gamma oscillatory neuromagnetic activity while administering a task with nonface images resembling a face. Images were presented either with canonical orientation or with display inversion that heavily impedes face pareidolia. At early processing stages, the peaks in gamma activity (40 to 45 Hz) to images either triggering or not face pareidolia originate mainly from the right medioventral and lateral occipital cortices, rostral and caudal cuneus gyri, and medial superior occipital gyrus. Yet, the difference occurred at later processing stages in the high-frequency range of 80 to 85 Hz over a set of the areas constituting the social brain. The findings speak rather for a relatively late neural network playing a key role in face pareidolia. Strikingly, a cutting-edge analysis of brain connectivity unfolding over time reveals mutual feedforward and feedback intra- and interhemispheric communication not only within the social brain but also within the extended large-scale network of down- and upstream regions. In particular, the superior temporal sulcus and insula strongly engage in communication with other brain regions either as signal transmitters or recipients throughout the whole processing of face-pareidolia images.

A limited visual search advantage for illusory faces

The human visual system is very sensitive to the presence of faces in the environment, so much so that it can produce the perception of illusory faces in everyday objects. Growing research suggests that illusory faces and real faces are processed by similar perceptual and neural mechanisms, but whether this similarity extends to visual attention is less clear. A visual search study showed that illusory faces have a search advantage over objects when the types of objects vary to match the objects in the illusory faces (e.g., chair, pepper, clock) (Keys et al., 2021). Here, we examine whether the search advantage for illusory faces over objects remains when compared against objects that belong to a single category (flowers). In three experiments, we compared visual search of illusory faces, real faces, variable objects, and uniform objects (flowers). Search for real faces was best compared with all other types of targets. In contrast, search for illusory faces was only better than search for variable objects, not uniform objects. This result shows a limited visual search advantage for illusory faces and suggests that illusory faces may not be processed like real faces in visual attention.

When the whole is only the parts: non-holistic object parts predominate face-cell responses to illusory faces

Humans are inclined to perceive faces in everyday objects with a face-like configuration. This illusion, known as face pareidolia, is often attributed to a specialized network of 'face cells' in primates. We found that face cells in macaque inferotemporal cortex responded selectively to pareidolia images, but this selectivity did not require a holistic, face-like configuration, nor did it encode human faceness ratings. Instead, it was driven mostly by isolated object parts that are perceived as eyes only within a face-like context. These object parts lack usual characteristics of primate eyes, pointing to the role of lower-level features. Our results suggest that face-cell responses are dominated by local, generic features, unlike primate visual perception, which requires holistic information. These findings caution against interpreting neural activity through the lens of human perception. Doing so could impose human perceptual biases, like seeing faces where none exist, onto our understanding of neural activity.

Face pareidolia is enhanced by 40 Hz transcranial alternating current stimulation (tACS) of the face perception network

Pareidolia refers to the perception of ambiguous sensory patterns as carrying a specific meaning. In its most common form, pareidolia involves human-like facial features, where random objects or patterns are illusionary recognized as faces. The current study investigated the neurophysiological correlates of face pareidolia via transcranial alternating current stimulation (tACS). tACS was delivered at gamma (40 Hz) frequency over critical nodes of the "face perception" network (i.e., right lateral occipito-temporal and left prefrontal cortex) of 75 healthy participants while completing four face perception tasks ('Mooney test' for faces, 'Toast test', 'Noise pareidolia test', 'Pareidolia task') and an object perception task ('Mooney test' for objects). In this single-blind, sham-controlled between-subjects study, participants received 35 min of either Sham, Online, (40Hz-tACS_ON), or Offline (40Hz-tACS_PRE) stimulation. Results showed that face pareidolia was causally enhanced by 40Hz-tACS_PRE in the Mooney test for faces in which, as compared to sham, participants more often misperceived scrambled stimuli as faces. In addition, as compared to sham, participants receiving 40Hz-tACS_PRE showed similar reaction times (RTs) when perceiving illusory faces and correctly recognizing noise stimuli in the Toast test, thus not exhibiting hesitancy in identifying faces where there were none. Also, 40Hz-tACS_ON induced slower rejections of face pareidolia responses in the Noise pareidolia test. The current study indicates that 40 Hz tACS can enhance pareidolic illusions in healthy individuals and, thus, that high frequency (i.e., gamma band) oscillations are critical in forming coherent and meaningful visual perception.

Face pareidolia in male schizophrenia

Faces are valuable signals for efficient social interaction. Yet, social cognition including the sensitivity to a coarse face scheme may be deviant in schizophrenia (SZ). Tuning to faces in non-face images such as shadows, grilled toasts, or ink blots is termed face pareidolia. This phenomenon is poorly investigated in SZ. Here face tuning was assessed in 44 male participants with SZ and person-by-person matched controls by using recently created Face-n-Thing images (photographs of non-face objects to a varying degree resembling a face). The advantage of these images is that single components do not automatically trigger face processing. Participants were administered a set of images with upright and inverted (180° in the image plane) orientation. In a two-alternative forced-choice paradigm, they had to indicate whether an image resembled a face. The findings showed that: (i) With upright orientation, SZ patients exhibited deficits in face tuning: they provided much fewer face responses than controls. (ii) Inversion generally hindered face pareidolia. However, while in neurotypical males, inversion led to a drastic drop in face impression, in SZ, the impact of orientation was reduced. (iii) Finally, in accord with the signal detection theory analysis, the sensitivity index (d-prime) was lower in SZ, whereas no difference occurred in decision criterion. The outcome suggests altered face pareidolia in SZ is caused by lower face sensitivity rather than by alterations in cognitive bias. Comparison of these findings with earlier evidence confirms that tuning to social signals is lower in SZ, and warrants tailored brain imaging research.

Staring death in the face: chimpanzees' attention towards conspecific skulls and the implications of a face module guiding their behaviour

Chimpanzees exhibit a variety of behaviours surrounding their dead, although much less is known about how they respond towards conspecific skeletons. We tested chimpanzees' visual attention to images of conspecific and non-conspecific stimuli (cat/chimp/dog/rat), shown simultaneously in four corners of a screen in distinct orientations (frontal/diagonal/lateral) of either one of three types (faces/skulls/skull-shaped stones). Additionally, we compared their visual attention towards chimpanzee-only stimuli (faces/skulls/skull-shaped stones). Lastly, we tested their attention towards specific regions of chimpanzee skulls. We theorized that chimpanzee skulls retaining face-like features would be perceived similarly to chimpanzee faces and thus be subjected to similar biases. Overall, supporting our hypotheses, the chimpanzees preferred conspecific-related stimuli. The results showed that chimpanzees attended: (i) significantly longer towards conspecific skulls than other species skulls (particularly in forward-facing and to a lesser extent diagonal orientations); (ii) significantly longer towards conspecific faces than other species faces at forward-facing and diagonal orientations; (iii) longer towards chimpanzee faces compared with chimpanzee skulls and skull-shaped stones, and (iv) attended significantly longer to the teeth, similar to findings for elephants. We suggest that chimpanzee skulls retain relevant, face-like features that arguably activate a domain-specific face module in chimpanzees' brains, guiding their attention.

Face Perception and Pareidolia Production in Patients With Parkinson's Disease

In Parkinson's disease (PD) patients, visual misperceptions are a major problem within the non-motor symptoms. Pareidolia, i.e., the tendency to perceive a specific, meaningful image in an ambiguous visual pattern, is a phenomenon that occurs also in healthy subjects. Literature suggests that the perception of face pareidolia may be increased in patients with neurodegenerative diseases. We aimed to examine, within the same experiment, face perception and the production of face pareidolia in PD patients and healthy controls (HC). Thirty participants (15 PD patients and 15 HC) were presented with 47 naturalistic photographs in which faces were embedded or not. The likelihood to perceive the embedded faces was modified by manipulating their transparency. Participants were asked to decide for each photograph whether a face was embedded or not. We found that PD patients were significantly less likely to recognize embedded faces than controls. However, PD patients also perceived faces significantly more often in locations where none were actually present than controls. Linear regression analyses showed that gender, age, hallucinations, and Multiple-Choice Vocabulary Intelligence Test (MWT) score were significant predictors of face pareidolia production in PD patients. Montreal Cognitive Assessment (MoCA) was a significant predictor for pareidolia production in PD patients in trials in which a face was embedded in another region [F _{(1, 13)} = 24.4, p = <0.001]. We conclude that our new embedded faces paradigm is a useful tool to distinguish face perception performance between HC and PD patients. Furthermore, we speculate that our results observed in PD patients rely on disturbed interactions between the Dorsal (DAN) and Ventral Attention Networks (VAN). In photographs in which a face is present, the VAN may detect this as a behaviourally relevant stimulus. However, due to the deficient communication with the DAN in PD patients, the DAN would not direct attention to the correct location, identifying a face at a location where actually none is present.

Face pareidolia is associated with right striatal dysfunction in drug-naïve patients with Parkinson's disease

BACKGROUND AND AIM

Some patients with Parkinson's disease (PD) present with pareidolia, an illusion of a meaningless stimulus as a familiar object known to the observer. Since the striatum is associated with processing of visual information, we investigated correlations of pareidolia with motor symptoms and striatal dopaminergic function.

METHOD

A noise pareidolia test, assessment of motor symptoms using MDS-UPDRS and ¹²³I-Ioflupane SPECT were performed in 58 drug-naïve PD patients. A number of images in which a participant noticed an illusory face (number of illusory responses) were compared with motor assessment scores and uptake of ¹²³I-ioflupane in the striatum.

RESULTS

Of the 58 participants, 22 had at least one illusory response. Mean scores for MDS-UPDRS part III (p<0.05), rigidity (p<0.05), and rigidity on the left side of the body (p<0.01) in patients with pareidolia were significantly higher than those in patients without pareidolia. Uptake of ¹²³I-ioflupane in the right caudate nucleus (p<0.05), anterior putamen (p<0.01), and posterior putamen (p<0.01) in patients with pareidolia was significantly lower than in patients without pareidolia. In the 22 patients with pareidolia, the number of illusory responses was significantly correlated with total scores for MDS-UPDRS part III (r=0.443, p<0.05) and subscores for bradykinesia (r=0.440, p<0.05) and bradykinesia on the left side of the body (r=0.564, p<0.01). The prevalence of pareidolia in left-dominant parkinsonism (16/30 patients) was higher than that in right-dominant parkinsonism (6/28 patients) (p<0.05 by chi-square test).

CONCLUSION

Pareidolia in PD patients is associated with dysfunction in the right striatum.

Face Tuning in Depression

The latest COVID-19 pandemic reveals that unexpected changes elevate depression bringing people apart, but also calling for social sharing. Yet the impact of depression on social cognition and functioning is not well understood. Assessment of social cognition is crucial not only for a better understanding of major depressive disorder (MDD), but also for screening, intervention, and remediation. Here by applying a novel experimental tool, a Face-n-Food task comprising a set of images bordering on the Giuseppe Arcimboldo style, we assessed the face tuning in patients with MDD and person-by-person matched controls. The key benefit of these images is that single components do not trigger face processing. Contrary to common beliefs, the outcome indicates that individuals with depression express intact face responsiveness. Yet, while in depression face sensitivity is tied with perceptual organization, in typical development, it is knotted with social cognition capabilities. Face tuning in depression, therefore, may rely upon altered behavioral strategies and underwriting brain mechanisms. To exclude a possible camouflaging effect of female social skills, we examined gender impact. Neither in depression nor in typical individuals had females excelled in face tuning. The outcome sheds light on the origins of the face sensitivity and alterations in social functioning in depression and mental well-being at large. Aberrant social functioning in depression is likely to be the result of deeply-rooted maladaptive strategies rather than of poor sensitivity to social signals. This has implications for mental well-being under the current pandemic conditions.

Pareidolia in Schizophrenia and Bipolar Disorder

While there are many studies on pareidolia in healthy individuals and patients with schizophrenia, to our knowledge, there are no prior studies on pareidolia in patients with bipolar disorder. Accordingly, in this study, we, for the first time, measured pareidolia in patients with bipolar disorder (N = 50), and compared that to patients with schizophrenia (N = 50) and healthy controls (N = 50). We have used (a) the scene test, which consists of 10 blurred images of natural scenes that was previously found to produce illusory face responses and (b) the noise test which had 32 black and white images consisting of visual noise and 8 images depicting human faces; participants indicated whether a face was present on these images and to point to the location where they saw the face. Illusory responses were defined as answers when observers falsely identified objects that were not on the images in the scene task (maximum illusory score: 10), and the number of noise images in which they reported the presence of a face (maximum illusory score: 32). Further, we also calculated the total pareidolia score for each task (the sum number of images with illusory responses in the scene and noise tests). The responses were scored by two independent raters with an excellent congruence (kappa > 0.9). Our results show that schizophrenia patients scored higher on pareidolia measures than both healthy controls and patients with bipolar disorder. Our findings are agreement with prior findings on more impaired cognitive processes in schizophrenia than in bipolar patients.

Face pareidolia in the brain: Impact of gender and orientation

Research on face sensitivity is of particular relevance during the rapidly evolving Covid-19 pandemic leading to social isolation, but also calling for intact interaction and sharing. Humans possess high sensitivity even to a coarse face scheme, seeing faces in non-face images where real faces do not exist. The advantage of non-face images is that single components do not trigger face processing. Here by implementing a novel set of Face-n-Thing images, we examined (i) how face tuning alters with changing display orientation, and (ii) whether it is affected by observers’ gender. Young females and males were presented with a set of Face-n-Thing images either with canonical upright orientation or inverted 180° in the image plane. Face impression was substantially impeded by display inversion. Furthermore, whereas with upright display orientation, no gender differences were found, with inversion, Face-n-Thing images elicited face impression in females significantly more often. The outcome sheds light on the origins of the face inversion effect in general. Moreover, the findings open a way for examination of face sensitivity and underwriting brain networks in neuropsychiatric conditions related to the current pandemic (such as depression and anxiety), most of which are gender/sex-specific.

Event-Related Potentials Elicited by Face and Face Pareidolia in Parkinson's Disease

Background

Parkinson's disease is associated with impaired ability to recognize emotional facial expressions. In addition to a visual processing disorder, a visual recognition disorder may be involved in these patients. Pareidolia is a type of complex visual illusion that permits the interpretation of a vague stimulus as something known to the observer. Parkinson's patients experience pareidolic illusions. N170 and N250 waveforms are two event-related potentials (ERPs) involved in emotional facial expression recognition.

Objective

In this study, we investigated how Parkinson's patients process face and face-pareidolia stimuli at the neural level using N170, vertex positive potential (VPP), and N250 components of event-related potentials.

Methods

To examine the response of face and face-pareidolia processing in Parkinson's patients, we measured the N170, VPP, and N250 components of the event-related brain potentials in a group of 21 participants with Parkinson's disease and 26 control participants.

Results

We found that the latencies of N170 and VPP responses to both face and face-pareidolia stimuli were increased along with their amplitudes, and the amplitude of N250 responses decreased in Parkinson's patients compared to the control group. In both control and Parkinson's patients, face stimuli generated greater ERP amplitude and shorter latency in responses than did face-pareidolia stimuli.

Conclusion

The results of our study showed that ERPs associated with face and also face-pareidolia stimuli processing are changed in early-stage neurophysiological activity in the temporoparietal cortex of Parkinson's patients.

Face pareidolia in schizophrenia

BACKGROUND

Faces convey valuable daily life social signals. As in most psychiatric conditions, non-verbal social cognition or its components including face processing may be aberrant in schizophrenia (SZ). Social participation of individuals with SZ is vital for their quality of life, and remediation of social abilities in this population is of high relevance both for society and clinical care.

METHOD

Tuning to faces in non-face images such as shadows, grilled toasts, or ink blots is called face pareidolia. Humans possess high sensitivity to facial signals: even fetuses and infants are well tuned to coarse face cues. Here we assessed face tuning in individuals with SZ and person-by-person matched controls by using a new experimental tool, a set of food-plate images bordering on the Giuseppe Arcimboldo style. The key benefit of these images is that single components do not trigger face processing.

RESULTS AND CONCLUSIONS

The outcome indicates that individuals with SZ exhibit aberrant face tuning in face-like non-face images (χ²(1) = 17.44, p = 0.0001) that can hamper adaptive interaction with peers and social participation hindering, in turn, clinical remediation. Face response rate in SZ patients was related to the scores on the event arrangement task tapping social cognition (Pearson product-moment correlation, r = 0.602, p = 0.01) and on picture completion task assessing visual perceptual organization (Spearman's rho = 0.614, p = 0.009). Therefore, poor performance on the face tuning task is unlikely to be accounted for by deviant general cognitive abilities, but rather by impairments in perceptual integration and social cognition. Comparison of these findings with data in autism and other neuropsychiatric conditions provides novel insights on the origins of face tuning in SZ and triggers brain imaging research.