Factors underlying visual illusions are illusion-specific but not feature-specific

Investigating the relationship between subjective perception and unconscious feature integration

Visual features need to be temporally integrated to detect motion signals and solve the many ill-posed problems of vision. It has previously been shown that such integration occurs in windows of unconscious processing of up to 450 milliseconds. However, whether features are integrated should be governed by perceptually meaningful mechanisms. Here, we expand on previous findings suggesting that subjective perception and integration may be linked. Specifically, different observers were found to group elements differently and to exhibit corresponding feature integration behavior. If the former were to influence the latter, perception would appear to not only be the outcome of integration but to potentially also be part of it. To test any such linkages more systematically, we here examined the role of one of the key perceptual grouping cues, color similarity, in the Sequential Metacontrast Paradigm (SQM). In the SQM, participants are presented with two streams of lines that are expanding from the center outwards. If several lines in the attended motion stream are offset, offsets integrate unconsciously and mandatorily for periods of up to 450 milliseconds. Across three experiments, we presented lines of varied colors. Our results reveal that individuals who perceive differently colored lines as "popping out" from the motion stream do not exhibit mandatory integration but that individuals who perceive such lines as part of an integrated motion stream do show offset integration behavior across the entire stream. These results attest to the proposed linkage between subjective perception and integration behavior in the SQM.

Ebbinghaus, Müller-Lyer, and Ponzo: Three examples of bidirectional space-time interference

Previous studies have shown interference between illusory size and perceived duration. The present study replicated this space-time interference in three classic visual-spatial illusions, the Ebbinghaus, the Müller-Lyer, and the Ponzo illusion. The results showed bidirectional interference between illusory size and duration for all three illusions. That is, subjectively larger stimuli were judged to be presented longer, and stimuli that were presented longer were judged to be larger. Thus, cross-dimensional interference between illusory size and duration appears to be a robust phenomenon and to generalize across a wide range of visual size illusions. This space-time interference most likely arises at the memory level and supports the theoretical notion of a common representational metric for space and time.

Age-related changes in the susceptibility to visual illusions of size

As the global population ages, understanding of the effect of aging on visual perception is of growing importance. This study investigates age-related changes in adulthood along size perception through the lens of three visual illusions: the Ponzo, Ebbinghaus, and Height-width illusions. Utilizing the Bayesian conceptualization of the aging brain, which posits increased reliance on prior knowledge with age, we explored potential differences in the susceptibility to visual illusions across different age groups in adults (ages 20-85 years). To this end, we used the BTPI (Ben-Gurion University Test for Perceptual Illusions), an online validated battery of visual illusions developed in our lab. The findings revealed distinct patterns of age-related changes for each of the illusions, challenging the idea of a generalized increase in reliance on prior knowledge with age. Specifically, we observed a systematic reduction in susceptibility to the Ebbinghaus illusion with age, while susceptibility to the Height-width illusion increased with age. As for the Ponzo illusion, there were no significant changes with age. These results underscore the complexity of age-related changes in visual perception and converge with previous findings to support the idea that different visual illusions of size are mediated by distinct perceptual mechanisms.

Revisiting the effect of visual illusions on grasping in left and right handers

Visual illusions have provided compelling evidence for a dissociation between perception and action. For example, when two different-sized objects are placed on opposite ends of the Ponzo illusion, people erroneously perceive the physically smaller object to be bigger than the physically larger one, but when they pick up the objects, their grip aperture reflects the real difference in size between the objects. This and similar findings have been demonstrated almost entirely for the right hand in right handers. The scarce research that has examined right and left-handed subjects in this context, has typically used only small samples. Here, we extended this research with a larger sample size (more than 50 in each group) in a version of the Ponzo illusion that allowed us to disentangle the effects of real and illusory size on action and perception in much more powerful way. We also collected a wide range of kinematic measures to assess possible differences in visuomotor control in left and right handers. The results showed that the dissociation between perception and action persisted for both hands in right handers, but only for the right hand in left handers. The left hand of left handers was sensitive to the illusion. Left handers also showed more variable and slower movements, as well as larger safety margins in both hands. These findings suggest that grasping in left handers may require more cognitive supervision, which could lead to greater sensitivity to visual context , particularly with their dominant left hand.

Weak correlations between visual abilities in healthy older adults, despite long-term performance stability

Using batteries of visual tests, most studies have found that there are only weak correlations between the performance levels of the tests. Factor analysis has confirmed these results. This means that a participant excelling in one test may rank low in another test. Hence, there is very little evidence for a common factor in vision. In visual aging research, cross-sectional studies have repeatedly found that healthy older adults' performance is strongly deteriorated in most visual tests compared to young adults. However, also within the healthy older population, there is no evidence for a visual common factor. To investigate whether the weak between-tests correlations are due to fluctuations in individual performance throughout time, we conducted a longitudinal study. Healthy older adults performed a battery of eight visual tests, with two re-tests after approximately four and seven years. Pearson's, Spearman's and intraclass correlations of most visual tests were significant across the three testing, indicating that the tests are reliable and individual differences are stable across years. Yet, we found low between-tests correlations at each visit, which is consistent with previous studies finding no evidence for a visual common factor. Our results exclude the possibility that the weak correlations between tests are due to high within-individual variance across time.

The BTPI: An online battery for measuring susceptibility to visual illusions

Visual illusions provide a powerful tool for probing the mechanisms that underlie perception. While most previous studies of visual illusions focused on average group-level performance, less attention has been devoted to individual differences in susceptibility to illusions. Unlike in other perceptual domains, in which there are established, validated tools to measure individual differences, such tools are not yet available in the domain of visual illusions. Here, we describe the development and validation of the BTPI (Ben-Gurion University Test for Perceptual Illusions), a new online battery designed to measure susceptibility to the influence of three prominent size illusions: the Ebbinghaus, the Ponzo, and the height-width illusions. The BTPI also measures perceptual resolution, reflected by the just noticeable difference (JND), to detect size differences in the context of each illusion. In Experiment 1 (N = 143), we examined performance in typical self-paced tasks, whereas in Experiment 2 (N = 69), we employed a fixed presentation duration paradigm. High test-retest reliability scores were found for all illusions, with little evidence for intercorrelations between different illusions. In addition, lower perceptual resolution (larger JND) was associated with a larger susceptibility to the illusory effect. The computerized task battery and analysis codes are freely available online.

Exploring the extent to which shared mechanisms contribute to motion-position illusions

Motion-position illusions (MPIs) are visual motion illusions in which motion signals bias the perceived position of an object. Due to phenomenological similarities between these illusions, previous research has assumed that some are caused by common mechanisms. However, this assumption has yet to be directly tested. This study investigates this assumption by exploiting between-participant variations in illusion magnitude. During two sessions, 106 participants viewed the flash-lag effect, luminance flash-lag effect, Fröhlich effect, flash-drag effect, flash-grab effect, motion-induced position shift, twinkle-goes effect, and the flash-jump effect. For each effect, the magnitude of the illusion was reliable within participants, strongly correlating between sessions. When the pairwise correlations of averaged illusions magnitudes were explored, two clusters of statistically significant positively correlated illusions were identified. The first cluster comprised the flash-grab effect, motion-induced position shift, and twinkle-goes effect. The second cluster comprised the Fröhlich and flash-drag effect. The fact that within each of these two clusters, individual differences in illusion magnitude were correlated suggests that these clusters may reflect shared underlying mechanisms. An exploratory factor analysis provided additional evidence that these correlated clusters shared an underlying factor, with each cluster loading onto their own factor. Overall, our results reveal that, contrary to the prevailing perspective in the literature, while some motion-position illusions share processes, most of these illusions are unlikely to reflect any shared processes, instead implicating unique mechanisms.

A novel visual illusion paradigm provides evidence for a general factor of illusion sensitivity and personality correlates

Visual illusions are a gateway to understand how we construct our experience of reality. Unfortunately, important questions remain open, such as the hypothesis of a common factor underlying the sensitivity to different types of illusions, as well as of personality correlates of illusion sensitivity. In this study, we used a novel parametric framework for visual illusions to generate 10 different classic illusions (Delboeuf, Ebbinghaus, Rod and Frame, Vertical-Horizontal, Zöllner, White, Müller-Lyer, Ponzo, Poggendorff, Contrast) varying in strength, embedded in a perceptual discrimination task. We tested the objective effect of the illusions on errors and response times, and extracted participant-level performance scores (n=250) for each illusion. Our results provide evidence in favour of a general factor underlying the sensitivity to different illusions (labelled Factor i). Moreover, we report a positive link between illusion sensitivity and personality traits such as Agreeableness, Honesty-Humility, and negative relationships with Psychoticism, Antagonism, Disinhibition, and Negative Affect.

Individual differences in computational psychiatry: a review of current challenges

Bringing precision to the understanding and treatment of mental disorders requires instruments for studying clinically relevant individual differences. One promising approach is the development of computational assays: integrating computational models with cognitive tasks to infer latent patient-specific disease processes in brain computations. While recent years have seen many methodological advancements in computational modelling and many cross-sectional patient studies, much less attention has been paid to basic psychometric properties (reliability and construct validity) of the computational measures provided by the assays. In this review, we assess the extent of this issue by examining emerging empirical evidence. We find that many computational measures suffer from poor psychometric properties, which poses a risk of invalidating previous findings and undermining ongoing research efforts using computational assays to study individual (and even group) differences. We provide recommendations for how to address these problems and, crucially, embed them within a broader perspective on key developments that are needed for translating computational assays to clinical practice.

Do we really measure what we think we are measuring?

Tests used in the empirical sciences are often (implicitly) assumed to be representative of a given research question in the sense that similar tests should lead to similar results. Here, we show that this assumption is not always valid. We illustrate our argument with the example of resting-state electroencephalogram (EEG). We used multiple analysis methods, contrary to typical EEG studies where one analysis method is used. We found, first, that many EEG features correlated significantly with cognitive tasks. However, these EEG features correlated weakly with each other. Similarly, in a second analysis, we found that many EEG features were significantly different in older compared to younger participants. When we compared these EEG features pairwise, we did not find strong correlations. In addition, EEG features predicted cognitive tasks poorly as shown by cross-validated regression analysis. We discuss several explanations of these results.

No common factor for illusory percepts, but a link between pareidolia and delusion tendency: A test of predictive coding theory

Predictive coding theory is an influential view of perception and cognition. It proposes that subjective experience of the sensory information results from a comparison between the sensory input and the top-down prediction about this input, the latter being critical for shaping the final perceptual outcome. The theory is able to explain a wide range of phenomena extending from sensory experiences such as visual illusions to complex pathological states such as hallucinations and psychosis. In the current study we aimed at testing the proposed connection between different phenomena explained by the predictive coding theory by measuring the manifestation of top-down predictions at progressing levels of complexity, starting from bistable visual illusions (alternating subjective experience of the same sensory input) and pareidolias (alternative meaningful interpretation of the sensory input) to self-reports of hallucinations and delusional ideations in everyday life. Examining the correlation structure of these measures in 82 adult healthy subjects revealed a positive association between pareidolia proneness and a tendency for delusional ideations, yet without any relationship to bistable illusions. These results show that only a subset of the phenomena that are explained by the predictive coding theory can be attributed to one common underlying factor. Our findings thus support the hierarchical view of predictive processing with independent top-down effects at the sensory and cognitive levels.

Study of Geometric Illusory Visual Perception – A New Perspective in the Functional Evaluation of Children With Strabismus

Despite the various perceptual-motor deficits documented in strabismus, there is a paucity of studies evaluating visual illusions in patients with strabismus. The aim of this study was to examine how the illusionary perception occurs in children/adolescents (10–15 years old) with strabismus with referral for surgery to correct ocular deviations. A controlled cross-sectional study was carried out in which 45 participants with strabismus and 62 healthy volunteers aged 10–15 years were evaluated. The behavioral response to three geometric illusions [Vertical-Horizontal illusion, Müller-Lyer illusion (Bretano version) and Ponzo illusion] and respective neutral stimuli (non-illusory images) regarding the estimation of image size and response time were measured using the Method of Adjustment. To analyze the influence of secondary factors: type of ocular deviation (convergent, divergent or associated with vertical deviation); amount of eye deviation; presence of amblyopia and stereopsis, a one-way ANOVA was performed. Among the tested illusions, children with strabismus showed greater susceptibility (p = 0.006) and response time (p = 0.004) to Ponzo’s illusory images. Children with strabismus and preserved stereopsis, on the other hand, showed similar susceptibility and response time to control group patients to the Ponzo illusion (p < 0.005). Patients with amblyopia showed overcorrection in the estimate of non-illusory Ponzo images (p = 0.046). Children with horizontal ocular deviation (esotropia or exotropia) associated with vertical deviation (hypertropia, DVD and/or alphabetical anisotropy) showed higher susceptibility to vertical adjustment images for the Müller-Lyer illusion (Brentano version) (p = 0.017). Individuals with strabismus tended to overcorrect the length of the straight-line segment adjusted for non-illusory images when testing non-illusory images in the Müller-Lyer test (Brentano version) (p = 0.009), as well as for the neutral images in the Vertical-Horizontal test (p = 0.000). The findings indicated impairment in the perception of geometric illusions and neutral figures, especially for the Ponzo illusion test by children with strabismus. As the behavioral response to illusory images may indirectly reflect the visual and morphofunctional alterations present in these individuals, we suggest that the investigation of visual illusory perception can be used as a new research strategy in the field of investigating the visual function in strabismus.

A Parametric Framework to Generate Visual Illusions Using Python

Visual illusions are fascinating phenomena that have been used and studied by artists and scientists for centuries, leading to important discoveries about the neurocognitive underpinnings of perception, consciousness, and neuropsychiatric disorders such as schizophrenia or autism. Surprisingly, despite their historical and theoretical importance as psychological stimuli, there is no dedicated software, nor consistent approach, to generate illusions in a systematic fashion. Instead, scientists have to craft them by hand in an idiosyncratic fashion, or use pre-made images not tailored for the specific needs of their studies. This, in turn, hinders the reproducibility of illusion-based research, narrowing possibilities for scientific breakthroughs and their applications. With the aim of addressing this gap, Pyllusion is a Python-based open-source software (freely available at https://github.com/RealityBending/Pyllusion), that offers a framework to manipulate and generate illusions in a systematic way, compatible with different output formats such as image files (.png, .jpg, .tiff, etc.) or experimental software (such as PsychoPy).

A review on various explanations of Ponzo-like illusions

This article reviews theoretical and empirical arguments for and against various theories that explain the classic Ponzo illusion and its variants from two different viewpoints concerning the role of perceived depth in size distortions. The first viewpoint argues that all Ponzo-like illusions are driven by perceived depth. The second viewpoint argues that the classic Ponzo illusion is unrelated to depth perception. This review will give special focus to the first viewpoint and consists of three sections. In the first section, the role of the number of pictorial depth cues and previous experience in the strength of all Ponzo-like illusions are discussed. In the second section, we contrast the first viewpoint against the theories that explain the classic Ponzo illusion with mechanisms that are unrelated to depth perception. In the last section, we propose a Bayesian-motivated reconceptualization of Richard Gregory's misapplied size constancy theory that explains Ponzo-variant illusions in terms of prior information and prediction errors. The new account explains why some studies have provided inconsistent evidence for misapplied size constancy theory.

A comparative biology approach to DNN modeling of vision: A focus on differences, not similarities

Deep neural networks (DNNs) have revolutionized computer science and are now widely used for neuroscientific research. A hot debate has ensued about the usefulness of DNNs as neuroscientific models of the human visual system; the debate centers on to what extent certain shortcomings of DNNs are real failures and to what extent they are redeemable. Here, we argue that the main problem is that we often do not understand which human functions need to be modeled and, thus, what counts as a falsification. Hence, not only is there a problem on the DNN side, but there is also one on the brain side (i.e., with the explanandum-the thing to be explained). For example, should DNNs reproduce illusions? We posit that we can make better use of DNNs by adopting an approach of comparative biology by focusing on the differences, rather than the similarities, between DNNs and humans to improve our understanding of visual information processing in general.

How do visual skills relate to action video game performance?

It has been claimed that video gamers possess increased perceptual and cognitive skills compared to non-video gamers. Here, we examined to which extent gaming performance in CS:GO (Counter-Strike: Global Offensive) correlates with visual performance. We tested 94 players ranging from beginners to experts with a battery of visual paradigms, such as visual acuity and contrast detection. In addition, we assessed performance in specific gaming skills, such as shooting and tracking, and administered personality traits. All measures together explained about 70% of the variance of the players’ rank. In particular, regression models showed that a few visual abilities, such as visual acuity in the periphery and the susceptibility to the Honeycomb illusion, were strongly associated with the players’ rank. Although the causality of the effect remains unknown, our results show that high-rank players perform better in certain visual skills compared to low-rank players.

Individual differences in the perception of visual illusions are stable across eyes, time, and measurement methods

Vision scientists have tried to classify illusions for more than a century. For example, some studies suggested that there is a unique common factor for all visual illusions. Other studies proposed that there are several subclasses of illusions, such as illusions of linear extent or distortions. We previously observed strong within-illusion correlations but only weak between-illusion correlations, arguing in favor of an even higher multifactorial space with-more or less-each illusion making up its own factor. These mixed results are surprising. Here, we examined to what extent individual differences in the perception of visual illusions are stable across eyes, time, and measurement methods. First, we did not find any significant differences in the magnitudes of the seven illusions tested with monocular or binocular viewing conditions. In addition, illusion magnitudes were not significantly predicted by visual acuity. Second, we observed stable individual differences over time. Last, we compared two illusion measurements, namely an adjustment procedure and a method of constant stimuli, which both led to similar individual differences. Hence, it is unlikely that the individual differences in the perception of visual illusions arise from instability across eyes, time, and measurement methods.

The conceptual understanding of depth rather than the low-level processing of spatial frequencies drives the corridor illusion

Our objective was to determine how different spatial frequencies affect the perceptual size rescaling of stimuli in the corridor illusion. Two experiments were performed using the method of constant stimuli. In experiment 1, the task required participants to compare the size of comparison and standard rings displayed over the same background image. ANOVA on the points of subject equality (PSEs) revealed that the perceived size of the top and bottom standard rings changed as a function of the availability of the high, medium, and low spatial frequency information. In experiment 2, the task required participants to compare the size of a comparison ring presented outside of the background image with a standard ring presented inside it. ANOVA on the PSEs revealed that the apparent size of the top and not the bottom standard ring changed depending on the availability of medium spatial frequency information. Eye-tracking revealed that the spatial frequency range of the background image in the periphery affected participants' eye positioning, which may explain why the effects of different spatial frequencies fluctuated across experiments. Nonetheless, when we consider these findings together, we propose that the conceptual understanding of depth plays a more important role in explaining the corridor illusion than the low-level processing of depth information extracted from different spatial frequencies along separate channels.

Heightened perception of illusory motion is associated with symptom severity in schizophrenia patients

Abnormal perceptual processing in schizophrenia may contribute to the development of positive symptoms such as hallucinations. Experimental findings suggest that such abnormalities result from impaired processing of local signals into complex cortical representations. Because complex processing is needed to generate the perception of illusory motion from local signals, deteriorated perception of illusory motion would be expected in schizophrenia. However, findings are mixed, and the relationship between complex motion processing and symptoms is unclear. Illusions with multiple flow components (e.g. rotation/expansion) are known to strongly engage specialized complex processing mechanisms that may be abnormal in schizophrenia, but have not yet been investigated. We used a recently constructed paradigm based on the Pinna-Brelstaff illusion to manipulate complex-flow illusory perception in a quantitative manner and probe associations with dimensional symptoms. In 102 patients and 90 controls, perceived speed and perceptual variability for the PBF were measured across a range of parameters. Meanwhile, eye movement was recorded and gaze parameters were analysed to examine effects on illusory perception. Our results showed that patients experienced faster illusory rotation than controls, while they made fewer eye fixations. This heightened illusory perception was significantly correlated with positive and general, but not negative, symptom scores. Our results indicate that unusual processing of complex-flow motion in patients may be specifically related to dimensional symptoms, which could provide a promising strategy for parsing heterogeneity in the schizophrenia syndrome. This further highlights the role of motion perception abnormalities in the pathophysiology of schizophrenia, thus encouraging future investigation into visual remediation therapeutics.

Interocular transfer effects of linear perspective cues and texture gradients in the perceptual rescaling of size

Our objective was to determine whether the influence of linear perspective cues and texture gradients in the perceptual rescaling of stimulus size transfers from one eye to the other. In experiment 1, we systematically added linear perspective cues and texture gradients in a background image of the corridor illusion. To determine whether perceptual size rescaling takes place at earlier or later stages, we tested how the perceived size of top and bottom rings changed under binocular (rings and background presented to both eyes), monocular (rings and background presented to the dominant eye only), and dichoptic (rings and background presented separately to the dominant and nondominant eyes, respectively) viewing conditions. We found differences between viewing conditions in the perceived size of the rings when linear perspective cues, but not texture gradients, were presented. Specifically, linear perspective cues produced a stronger illusion under the monocular compared to the dichoptic viewing condition. Hence, there was partial interocular transfer from the linear perspective cues, suggesting a dominant role of monocular neural populations in mediating the corridor illusion. In experiment 2, we repeated similar procedures with a more traditional Ponzo illusion background. Contrary to findings from experiment 1, there was a full interocular transfer with the presence of the converging lines, suggesting a dominant role of binocular neural populations. We conclude that higher order visual areas, which contain binocular neural populations, are more involved in the perceptual rescaling of size evoked by linear perspective cues in the Ponzo compared to the corridor illusion.

Perceptual grouping leads to objecthood effects in the Ebbinghaus illusion

The Ebbinghaus illusion is argued to be a product of low-level contour interactions or a higher cognitive comparison process. We examined the effect of grouping on the illusion by manipulating objecthood, i.e., the degree to which an object is a cohesive perceptual entity. We hypothesized that reduced objecthood would decrease the illusion magnitude, because the objects become less efficient in the comparison process. To test this hypothesis, we used a version of the illusion where the target and flanking objects were squares that were composed from their corners or sides. Degree of objecthood was manipulated by changing the gap size or rotation angle of the elements constructing the objects, so that larger gaps and angles produced less cohesive objects than smaller. Participants performed an adjustment procedure on the test target to match a control target in size. In addition, subjective reports of the objects' shape were collected as a measure of perceived shape. Our results show decreased illusion magnitude with increasing gap size and rotation angle. Surprisingly, the perceived shape of the objects did not correlate with illusion magnitude. These results provide novel evidence of the role of mid-level processes in the Ebbinghaus illusion and point to a dissociation between subjective and objective measures of objecthood.

When illusions merge

We recently found only weak correlations between the susceptibility to various visual illusions. However, we observed strong correlations among different variants of an illusion, suggesting that the visual space of illusions includes several illusion-specific factors. Here, we specifically examined how factors for the vertical-horizontal, Müller-Lyer, and Ponzo illusions relate to each other. We measured the susceptibility to each illusion separately and to combinations of two illusions, which we refer to as a merged illusion; for example, we tested the Müller-Lyer illusion and the vertical-horizontal illusion, as well as a merged version of both illusions. We used an adjustment procedure in two experiments with 306 and 98 participants, respectively. Using path analyses, correlations, and exploratory factor analyses, we found that the susceptibility to a merged illusion is well predicted from the susceptibilities to the individual illusions. We suggest that there are illusion-specific factors that, by independent combinations, represent the whole visual structure underlying illusions.

Individual differences in the Müller-Lyer and Ponzo illusions are stable across different contexts

Vision scientists have attempted to classify visual illusions according to certain aspects, such as brightness or spatial features. For example, Piaget proposed that visual illusion magnitudes either decrease or increase with age. Subsequently, it was suggested that illusions are segregated according to their context: real-world contexts enhance and abstract contexts inhibit illusion magnitudes with age. We tested the effects of context on the Müller-Lyer and Ponzo illusions with a standard condition (no additional context), a line-drawing perspective condition, and a real-world perspective condition. A mixed-effects model analysis, based on data from 76 observers with ages ranging from 6 to 66 years, did not reveal any significant interaction between context and age. Although we found strong intra-illusion correlations for both illusions, we found only weak inter-illusion correlations, suggesting that the structure underlying these two spatial illusions includes several specific factors.