Cortical idiosyncrasies predict the perception of object size

How is visual separation assessed? By counting distance units

How does the human visual system assess the separation between pairs of stimuli in a frontal plane? According to the direct (or subtractive) view the system finds the difference between the positions of the stimuli in a localization system. According to the indirect (or additive) view the system finds the number of instances of a distance unit lying between representations of the stimuli. Critically, position is explicitly represented under the direct view, with separation being derived from position. Position is not explicitly represented under the indirect view; separation is consequently inferred by counting an internal unit of distance. Recent results favor the indirect over the direct view of separation assessment. Dissociations between assessments of separation and position, various context effects in the assessment of separation, and suggestions that position information is not cleanly accessed argue against the direct view. At the same time, various context effects in separation assessment argue for the indirect view. Recent findings regarding the brain bases of vision are consistent with the indirect view. In short, recent results suggest that assessing the separation between two frontal stimuli involves integrating distance units between representations of the stimuli.

Individual differences in internal models explain idiosyncrasies in scene perception

According to predictive processing theories, vision is facilitated by predictions derived from our internal models of what the world should look like. However, the contents of these models and how they vary across people remains unclear. Here, we use drawing as a behavioral readout of the contents of the internal models in individual participants. Participants were first asked to draw typical versions of scene categories, as descriptors of their internal models. These drawings were converted into standardized 3d renders, which we used as stimuli in subsequent scene categorization experiments. Across two experiments, participants' scene categorization was more accurate for renders tailored to their own drawings compared to renders based on others' drawings or copies of scene photographs, suggesting that scene perception is determined by a match with idiosyncratic internal models. Using a deep neural network to computationally evaluate similarities between scene renders, we further demonstrate that graded similarity to the render based on participants' own typical drawings (and thus to their internal model) predicts categorization performance across a range of candidate scenes. Together, our results showcase the potential of a new method for understanding individual differences - starting from participants' personal expectations about the structure of real-world scenes.

Opposite size illusions for inverted faces and letters

Words are the primary means by which we communicate meaning and ideas, while faces provide important social cues. Studying visual illusions involving faces and words can elucidate the hierarchical processing of information as different regions of the brain are specialised for face recognition and word processing. A size illusion has previously been demonstrated for faces, whereby an inverted face is perceived as larger than the same stimulus upright. Here, two experiments replicate the face size illusion, and investigate whether the illusion is also present for individual letters (Experiment 1), and visual words and pseudowords (Experiment 2). Results confirm a robust size Illusion for faces. Letters, words and pseudowords and unfamiliar letters all show a reverse size illusion, as we previously demonstrated for human bodies. Overall, results indicate the illusion occurs in early perceptual stages upstream of semantic processing. Results are consistent with the idea of a general-purpose mechanism that encodes curvilinear shapes found in both scripts and our environment. Word and face perception rely on specialised, independent cognitive processes. The underestimation of the size of upright stimuli is specific to faces. Opposite size illusions may reflect differences in how size information is encoded and represented in stimulus-specialised neural networks, resulting in contrasting perceptual effects. Though words and faces differ visually, there is both symmetry and asymmetry in how the brain 'reads' them.

Individual differences in human gaze behavior generalize from faces to objects

Individuals differ in where they fixate on a face, with some looking closer to the eyes while others prefer the mouth region. These individual biases are highly robust, generalize from the lab to the outside world, and have been associated with social cognition and associated disorders. However, it is unclear, whether these biases are specific to faces or influenced by domain-general mechanisms of vision. Here, we juxtaposed these hypotheses by testing whether individual face fixation biases generalize to inanimate objects. We analyzed >1.8 million fixations toward faces and objects in complex natural scenes from 405 participants tested in multiple labs. Consistent interindividual differences in fixation positions were highly inter-correlated across faces and objects in all samples. Observers who fixated closer to the eye region also fixated higher on inanimate objects and vice versa. Furthermore, the inter-individual spread of fixation positions scaled with target size in precisely the same, non-linear manner for faces and objects. These findings contradict a purely domain-specific account of individual face gaze. Instead, they suggest significant domain-general contributions to the individual way we look at faces, a finding with potential relevance for basic vision, face perception, social cognition, and associated clinical conditions.

Bounded contribution of human early visual cortex to the topographic anisotropy in spatial extent perception

To interact successfully with objects, it is crucial to accurately perceive their spatial extent, an enclosed region they occupy in space. Although the topographic representation of space in the early visual cortex (EVC) has been favored as a neural correlate of spatial extent perception, its exact nature and contribution to perception remain unclear. Here, we inspect the topographic representations of human individuals' EVC and perception in terms of how much their anisotropy is influenced by the orientation (co-axiality) and radial position (radiality) of stimuli. We report that while the anisotropy is influenced by both factors, its direction is primarily determined by radiality in EVC but by co-axiality in perception. Despite this mismatch, the individual differences in both radial and co-axial anisotropy are substantially shared between EVC and perception. Our findings suggest that spatial extent perception builds on EVC's spatial representation but requires an additional mechanism to transform its topographic bias.

No influence of emotional expression on size underestimation of upright faces

Faces are a primary means of conveying social information between humans. One important factor modulating the perception of human faces is emotional expression. Face inversion also affects perception, including judgments of emotional expression, possibly through the disruption of configural processing. One intriguing inversion effect is an illusion whereby faces appear to be physically smaller when upright than when inverted. This illusion appears to be highly selective for faces. In this study, we investigated whether the emotional expression of a face (neutral, happy, afraid, and angry) modulates the magnitude of this size illusion. Results showed that for all four expressions, there was a clear bias for inverted stimuli to be judged as larger than upright ones. This demonstrates that there is no influence of emotional expression on the size underestimation of upright faces, a surprising result given that recognition of different emotional expressions is known to be affected unevenly by inversion. Results are discussed considering recent neuroimaging research which used population receptive field (pRF) mapping to investigate the neural mechanisms underlying face perception features and which may provide an explanation for how an upright face appears smaller than an inverted one. Elucidation of this effect would lead to a greater understanding of how humans communicate.

Network dynamics underlying alterations in apparent object size

A target circle surrounded by small circles looks larger than an identical circle surrounded by large circles (termed as the Ebbinghaus illusion). While previous research has shown that both early and high-level visual regions are involved in the generation of the illusion, it remains unclear how these regions work together to modulate the illusion effect. Here, we used functional MRI and dynamic causal modelling to investigate the neural networks underlying the illusion in conditions where the focus of attention was manipulated via participants directing their attention to and maintain fixation on only one of the two illusory configurations at a time. Behavioural findings confirmed the presence of the illusion. Accordingly, functional MRI activity in the extrastriate cortex accounted for the illusory effects: apparently larger circles elicited greater activation than apparently smaller circles. Interestingly, this spread of activity for size overestimation was accompanied by a decrease in the inhibitory self-connection in the extrastriate region, and an increase in the feedback connectivity from the precuneus to the extrastriate region. These findings demonstrate that the representation of apparent object size relies on feedback projections from higher- to lower-level visual areas, highlighting the crucial role of top-down signals in conscious visual perception.

Behavioral examination of the role of the primary visual cortex in the perceived size representation

Previous research has shown that neural activity in the primary visual cortex (V1) and V1 surface area may be linked with subjective experience of size illusions. Here, we behaviorally measured the hallway illusion with experimental manipulations as a proxy of V1's influence on size perception. We first tested whether the hallway illusion can persist without further recurrent processing by using backward masking. Next, we examined relations among the hallway illusion magnitude and other perceptual measures that have been suggested to be correlated with V1 surface area. In Experiment 1, the magnitude of the hallway illusion was not affected by the stimulus duration and visual masking when the hallway context was previewed (i.e., complex depth information is already processed). It suggests that V1 activity could support the size illusion to some extent even when recurrent processing between V1 and higher areas is disturbed. In Experiment 2, the hallway illusion magnitude was correlated with the Vernier acuity threshold, but not with physical size discriminability. Our results provide converging evidence with the previous findings in that neural activity in V1 may contribute to size illusions and that V1 surface area is not the sole factor that mediates size perception and visual precision.

Retinotopic connectivity maps of human visual cortex with unconstrained eye movements

Human visual cortex contains topographic visual field maps whose organization can be revealed with retinotopic mapping. Unfortunately, constraints posed by standard mapping hinder its use in patients, atypical subject groups, and individuals at either end of the lifespan. This severely limits the conclusions we can draw about visual processing in such individuals. Here, we present a novel data-driven method to estimate connective fields, resulting in fine-grained maps of the functional connectivity between brain areas. We find that inhibitory connectivity fields accompany, and often surround facilitatory fields. The visual field extent of these inhibitory subfields falls off with cortical magnification. We further show that our method is robust to large eye movements and myopic defocus. Importantly, freed from the controlled stimulus conditions in standard mapping experiments, using entertaining stimuli and unconstrained eye movements our approach can generate retinotopic maps, including the periphery visual field hitherto only possible to map with special stimulus displays. Generally, our results show that the connective field method can gain knowledge about retinotopic architecture of visual cortex in patients and participants where this is at best difficult and confounded, if not impossible, with current methods.

Human perception of spatial frequency varies with stimulus orientation and location in the visual field

Neuroanatomical variations across the visual field of human observers go along with corresponding variations of the perceived coarseness of visual stimuli. Here we show that horizontal gratings are perceived as having lower spatial frequency than vertical gratings when occurring along the horizontal meridian of the visual field, whereas gratings occurring along the vertical meridian show the exact opposite effect. This finding indicates a new peculiarity of processes operating along the cardinal axes of the visual field.

Spatial variability in localization biases predicts crowding performance

Visual processing varies substantially across individuals, and prior work has shown significant individual differences in fundamental processes such as spatial localization. For example, when asked to report the location of a briefly flashed target in the periphery, different observers systematically misperceive its location in an idiosyncratic manner, showing different patterns of reproduction error across visual field locations. In this study, we tested whether these individual differences may propagate to other stages of visual processing, affecting the strength of visual crowding, which depends on the spacing between objects in the periphery. We, therefore, investigated the relationship between observers' idiosyncratic biases in localization and the strength of crowding to determine whether these spatial biases limit peripheral object recognition. To examine this relationship, we measured the strength of crowding at 12 locations at 8° eccentricity, in addition to the perceived spacing between pairs of Gaussian patches at these same locations. These measurements show an association between variability in crowding strength and perceived spacing at the same visual field locations: at locations where a participant experienced stronger crowding, their perceived spacing was smaller, and vice versa. We demonstrate that spatial heterogeneity in perceived spacing affects observers' ability to recognize objects in the periphery. Our results support the idea that variability in both spatial sensitivity and bias contribute to variability in the strength of crowding and bolster the account that variability in spatial coding may propagate across multiple stages of visual processing.

Radial bias in face identification

Human vision in the periphery is most accurate for stimuli that point towards the fovea. This so-called radial bias has been linked with the organization and spatial selectivity of neurons at the lowest levels of the visual system, from retinal ganglion cells onwards. Despite evidence that the human visual system is radially biased, it is not yet known whether this bias persists at higher levels of processing, or whether high-level representations are invariant to this low-level orientation bias. We used the case of face identity recognition to address this question. The specialized high-level mechanisms that support efficient face recognition are highly dependent on horizontally oriented information, which convey the most useful identity cues in the fovea. We show that face selective mechanisms are more sensitive on the horizontal meridian (to the left and right of fixation) compared to the vertical meridian (above and below fixation), suggesting that the horizontal cues in the face are better extracted on the horizontal meridian, where they align with the radial bias. The results demonstrate that the radial bias is maintained at high-level recognition stages and emphasize the importance of accounting for the radial bias in future investigation of visual recognition processes in peripheral vision.

Effects of cortical distance on the Ebbinghaus and Delboeuf illusions

The Ebbinghaus and Delboeuf illusions affect the perceived size of a target circle depending on the size and proximity of circular inducers or a ring. Converging evidence suggests that these illusions are driven by interactions between contours mediated by their cortical distance in primary visual cortex. We tested the effect of cortical distance on these illusions using two methods: First, we manipulated retinal distance between target and inducers in a two-interval forced choice design, finding that targets appeared larger with a closer surround. Next, we predicted that targets presented peripherally should appear larger due to cortical magnification. Hence, we tested the illusion strength when positioning the stimuli at various eccentricities, with results supporting this hypothesis. We calculated estimated cortical distances between illusion elements in each experiment and used these estimates to compare the relationship between cortical distance and illusion strength across our experiments. In a final experiment, we modified the Delboeuf illusion to test whether the influence of the inducers/annuli in this illusion is influenced by an inhibitory surround. We found evidence that an additional outer ring makes targets appear smaller compared to a single-ring condition, suggesting that near and distal contours have antagonistic effects on perceived target size.

Polar angle asymmetries in visual perception and neural architecture

Human visual performance changes with visual field location. It is best at the center of gaze and declines with eccentricity, and also varies markedly with polar angle. These perceptual polar angle asymmetries are linked to asymmetries in the organization of the visual system. We review and integrate research quantifying how performance changes with visual field location and how this relates to neural organization at multiple stages of the visual system. We first briefly review how performance varies with eccentricity and the neural foundations of this effect. We then focus on perceptual polar angle asymmetries and their neural foundations. Characterizing perceptual and neural variations across and around the visual field contributes to our understanding of how the brain translates visual signals into neural representations which form the basis of visual perception.

Comparing retinotopic maps of children and adults reveals a late-stage change in how V1 samples the visual field

Adult visual performance differs with angular location -it is better for stimuli along the horizontal than vertical, and lower than upper vertical meridian of the visual field. These perceptual asymmetries are paralleled by asymmetries in cortical surface area in primary visual cortex (V1). Children, unlike adults, have similar visual performance at the lower and upper vertical meridian. Do children have similar V1 surface area representing the upper and lower vertical meridian? Using MRI, we measure the surface area of retinotopic maps (V1-V3) in children and adults. Many features of the maps are similar between groups, including greater V1 surface area for the horizontal than vertical meridian. However, unlike adults, children have a similar amount of V1 surface area representing the lower and upper vertical meridian. These data reveal a late-stage change in V1 organization that may relate to the emergence of the visual performance asymmetry along the vertical meridian by adulthood.

Object Image Size Is a Fundamental Coding Dimension in Human Vision: New Insights and Model

In previous psychophysical work we found that luminance contrast is integrated over retinal area subject to contrast gain control. If different mechanisms perform this operation for a range of superimposed retinal regions of different sizes, this could provide the basis for size-coding. To test this idea we included two novel features in a standard adaptation paradigm to discount more pedestrian accounts of repulsive size-aftereffects. First, we used spatially jittering luminance-contrast adaptors to avoid simple contour displacement aftereffects. Second, we decoupled adaptor and target spatial frequency to avoid the well-known spatial frequency shift aftereffect. Empirical results indicated strong evidence of a bidirectional size adaptation aftereffect. We show that the textbook population model is inappropriate for our results, and develop our existing model of contrast perception to include multiple size mechanisms with divisive surround-suppression from the largest mechanism. For a given stimulus patch, this delivers a blurred step-function of responses across the population, with contrast and size encoded by the height and lateral position of the step. Unlike for textbook population coding schemes, our human results (N = 4 male, N = 4 female) displayed two asymmetries: (i) size aftereffects were greatest for targets smaller than the adaptor, and (ii) on that side of the function, results did not return to baseline, even when targets were 25% of adaptor diameter. Our results and emergent model properties provide evidence for a novel dimension of visual coding (size) and a novel strategy for that coding, consistent with previous results on contrast detection and discrimination for various stimulus sizes.

Different attentional focus sizes modulate the size-eccentricity effect

The size-eccentricity effect is a perceptual distortion phenomenon in which a peripherally located object is perceived to be smaller than a centrally located object. Although the increase in apparent object size caused by attention has been documented, little is known about the effect of different sizes of attentional focus on object appearance. The present study investigated how different sizes of attentional focus affect the size-eccentricity effect using a spatial pre-cueing paradigm. Additionally, we examined the influence of different task types on size perception. A peripheral object following a small attentional focus appeared larger, without observation of the size-eccentricity effect. In contrast, a peripheral object appeared smaller following a large attentional focus in both larger and smaller judgement tasks. These results suggest that the relative size of the attentional focus has opposite effects on the perception of object size, independent of task type. Furthermore, in addition to the structural properties of the retina and the locus of attention, the size of attentional focus determines the extent to which an object appears smaller in the periphery. The present study complements the attentional attraction field model of the size and density of population receptive fields in V1 and further explains how the effect of attention is restricted by retinal structure.

Highly accurate retinotopic maps of the physiological blind spot in human visual cortex

The physiological blind spot is a naturally occurring scotoma corresponding with the optic disc in the retina of each eye. Even during monocular viewing, observers are usually oblivious to the scotoma, in part because the visual system extrapolates information from the surrounding area. Unfortunately, studying this visual field region with neuroimaging has proven difficult, as it occupies only a small part of retinotopic cortex. Here, we used functional magnetic resonance imaging and a novel data-driven method for mapping the retinotopic organization in and around the blind spot representation in V1. Our approach allowed for highly accurate reconstructions of the extent of an observer's blind spot, and out-performed conventional model-based analyses. This method opens exciting opportunities to study the plasticity of receptive fields after visual field loss, and our data add to evidence suggesting that the neural circuitry responsible for impressions of perceptual completion across the physiological blind spot most likely involves regions of extrastriate cortex-beyond V1.

Linking individual differences in human primary visual cortex to contrast sensitivity around the visual field

A central question in neuroscience is how the organization of cortical maps relates to perception, for which human primary visual cortex (V1) is an ideal model system. V1 nonuniformly samples the retinal image, with greater cortical magnification (surface area per degree of visual field) at the fovea than periphery and at the horizontal than vertical meridian. Moreover, the size and cortical magnification of V1 varies greatly across individuals. Here, we used fMRI and psychophysics in the same observers to quantify individual differences in V1 cortical magnification and contrast sensitivity at the four polar angle meridians. Across observers, the overall size of V1 and localized cortical magnification positively correlated with contrast sensitivity. Moreover, greater cortical magnification and higher contrast sensitivity at the horizontal than the vertical meridian were strongly correlated. These data reveal a link between cortical anatomy and visual perception at the level of individual observer and stimulus location.

Activity in perirhinal and entorhinal cortex predicts perceived visual similarities among category exemplars with highest precision

Vision neuroscience has made great strides in understanding the hierarchical organization of object representations along the ventral visual stream (VVS). How VVS representations capture fine-grained visual similarities between objects that observers subjectively perceive has received limited examination so far. In the current study, we addressed this question by focussing on perceived visual similarities among subordinate exemplars of real-world categories. We hypothesized that these perceived similarities are reflected with highest fidelity in neural activity patterns downstream from inferotemporal regions, namely in perirhinal (PrC) and anterolateral entorhinal cortex (alErC) in the medial temporal lobe. To address this issue with functional magnetic resonance imaging (fMRI), we administered a modified 1-back task that required discrimination between category exemplars as well as categorization. Further, we obtained observer-specific ratings of perceived visual similarities, which predicted behavioural discrimination performance during scanning. As anticipated, we found that activity patterns in PrC and alErC predicted the structure of perceived visual similarity relationships among category exemplars, including its observer-specific component, with higher precision than any other VVS region. Our findings provide new evidence that subjective aspects of object perception that rely on fine-grained visual differentiation are reflected with highest fidelity in the medial temporal lobe.

Mapping spatial frequency preferences across human primary visual cortex

Neurons in primate visual cortex (area V1) are tuned for spatial frequency, in a manner that depends on their position in the visual field. Several studies have examined this dependency using functional magnetic resonance imaging (fMRI), reporting preferred spatial frequencies (tuning curve peaks) of V1 voxels as a function of eccentricity, but their results differ by as much as two octaves, presumably owing to differences in stimuli, measurements, and analysis methodology. Here, we characterize spatial frequency tuning at a millimeter resolution within the human primary visual cortex, across stimulus orientation and visual field locations. We measured fMRI responses to a novel set of stimuli, constructed as sinusoidal gratings in log-polar coordinates, which include circular, radial, and spiral geometries. For each individual stimulus, the local spatial frequency varies inversely with eccentricity, and for any given location in the visual field, the full set of stimuli span a broad range of spatial frequencies and orientations. Over the measured range of eccentricities, the preferred spatial frequency is well-fit by a function that varies as the inverse of the eccentricity plus a small constant. We also find small but systematic effects of local stimulus orientation, defined in both absolute coordinates and relative to visual field location. Specifically, peak spatial frequency is higher for pinwheel than annular stimuli and for horizontal than vertical stimuli.

The human primary visual cortex (V1) encodes the perceived position of static but not moving objects

Brain activity in retinotopic cortex reflects illusory changes in stimulus position. Is this neural signature a general code for apparent position? Here we show that responses in primary visual cortex (V1) are consistent with perception of the Muller-Lyer illusion; however, we found no such signature for another striking illusion, the curveball effect. This demonstrates that V1 does not encode apparent position per se.

Perception of the ambiguous motion quartet: A stimulus-observer interaction approach

Visual perception is the result of a highly complex process depending on both stimulus and observer characteristics and, importantly, their interactions. Generating robust theories and making precise predictions in light of this complexity can be challenging, and the interaction of stimulus- and observer-related effects is often neglected or understated. In the current study, we examined inter- and intra-individual differences and the effects of a wide range of three stimulus characteristics (i.e., spatial distance, temporal distance, and spatial location). Our results indicate that not all individuals show the same group average stimulus-driven effects on the perception of a motion quartet and that these effects are not always equal across the entire stimulus range. Moreover, we observed that there are clear individual differences in spontaneous perceptual dynamics and that these can be overridden by some but not all stimulus manipulations. We conclude that considering different stimulus manipulations, different observers, and their interactions can provide a more nuanced and informative view on the processes governing visual perception. This study examines the effect of spatial distance, spatiotemporal distance, spatial location, and individual differences on the perception of the ambiguous motion quartet.

Contrasting effects of exogenous and endogenous attention on size perception

Although neuroimaging studies have shown that exogenous and endogenous attention are dissociable, only a few behavioural studies have explored their differential effects on visual sensitivity, and none have directly focused on visual appearance. Here, we show that exogenous and endogenous attention produces contrasting effects on apparent size. Participants performed a spatial pre-cueing comparative judgement task that had been frequently used to test the attentional effects on visual perception. The results showed that a smaller stimulus within the focus of exogenous attention was perceived to be equal in size as a larger unattended stimulus, whereas a larger stimulus within the focus of endogenous attention was perceived to be equal in size as a smaller unattended stimulus. In other words, exogenous attention increased the perceived size while endogenous attention decreased the perceived size. The contrasting effects may be attributed to the mechanism that exogenous attention favours parvocellular processing for which more neurons with smaller receptive fields (RFs) are activated for a given size, whereas endogenous attention favours magnocellular processing for which fewer neurons with larger RFs are activated. This finding shows that exogenous and endogenous attention acts differentially on size perception, and provides supportive evidence for the distinct mechanisms underlying the two types of attentional processing.

On the origin of the Ebbinghaus illusion: The role of figural extent and spatial frequency of stimuli

An object is perceived as larger when it is surrounded by smaller context objects than when it is surrounded by larger context objects. The origin of this well-known phenomenon, called as Ebbinghaus or Titchener circles illusion, is still puzzling. Here we introduce a basic explanation of how this illusion could emerge and provide some preliminary empirical support for this idea. In essence, we suggest that changes in the figural extent and in the spatial frequency of the stimulus pattern entail adjustments of the size and resolution of the attentional field, which are accompanied by changes in spatial coding. This approach is consistent with previous observations and can enable a deeper understanding of geometric illusions.

Response Bias Reflects Individual Differences in Sensory Encoding

Humans exhibit substantial biases in their decision making even in simple two-choice tasks, but the origin of these biases remains unclear. I hypothesized that one source of bias could be individual differences in sensory encoding. Specifically, if one stimulus category gives rise to an internal-evidence distribution with higher variability, then responses should optimally be biased against that stimulus category. Therefore, response bias may reflect a previously unappreciated subject-to-subject difference in the variance of the internal-evidence distributions. I tested this possibility by analyzing data from three different two-choice tasks (ns = 443, 443, and 498). For all three tasks, response bias moved in the direction of the optimal criterion determined by each subject's idiosyncratic internal-evidence variability. These results demonstrate that seemingly random variations in response bias can be driven by individual differences in sensory encoding and are thus partly explained by normative strategies.

Heritable functional architecture in human visual cortex

•

We analyzed retinotopic maps from monozygotic and dizygotic twin pairs.

•

Visual field maps in V1-V3 are more similar in monozygotic twins.

•

Heritability is greater in V1 and V3 for polar angle and population receptive field sizes.

•

Eccentricity maps show lesser degree of heritability.

•

Further evidence for link between cortical morphology and topology of retinotopic maps.

How much of the functional organization of our visual system is inherited? Here we tested the heritability of retinotopic maps in human visual cortex using functional magnetic resonance imaging. We demonstrate that retinotopic organization shows a closer correspondence in monozygotic (MZ) compared to dizygotic (DZ) twin pairs, suggesting a partial genetic determination. Using population receptive field (pRF) analysis to examine the preferred spatial location and selectivity of these neuronal populations, we estimate a heritability around 10–20% for polar angle preferences and spatial selectivity, as quantified by pRF size, in extrastriate areas V2 and V3. Our findings are consistent with heritability in both the macroscopic arrangement of visual regions and stimulus tuning properties of visual cortex. This could constitute a neural substrate for variations in a range of perceptual effects, which themselves have been found to be at least partially genetically determined. These findings also add convergent evidence for the hypothesis that functional map topology is linked with cortical morphology.

Spatial Heterogeneity in Bistable Figure-Ground Perception

The appearance of visual objects varies substantially across the visual field. Could such spatial heterogeneity be due to undersampling of the visual field by neurons selective for stimulus categories? Here, we show that which parts of a bistable vase-face image observers perceive as figure and ground depends on the retinal location where the image appears. The spatial patterns of these perceptual biases were similar regardless of whether the images were upright or inverted. Undersampling by neurons tuned to an object class (e.g., faces) or variability in general local versus global processing cannot readily explain this spatial heterogeneity. Rather, these biases could result from idiosyncrasies in low-level sensitivity across the visual field.

Learning to see the Ebbinghaus illusion in the periphery reveals a top-down stabilization of size perception across the visual field

Our conscious visual perception relies on predictive signals, notably in the periphery where sensory uncertainty is high. We investigated how such signals could support perceptual stability of objects' size across the visual field. When attended carefully, the same object appears slightly smaller in the periphery compared to the fovea. Could this perceptual difference be encoded as a strong prior to predict the peripheral perceived size relative to the fovea? Recent studies emphasized the role of foveal information in defining peripheral size percepts. However, they could not disentangle bottom-up from top-down mechanisms. Here, we revealed a pure top-down contribution to the perceptual size difference between periphery and fovea. First, we discovered a novel Ebbinghaus illusion effect, inducing a typical reduction of foveal perceived size, but a reversed increase effect in the periphery. The resulting illusory size percept was similar at both locations, deviating from the classic perceptual difference. Then through an updating process of successive peripheral-foveal viewing, the unusual peripheral perceived size decreased. The classic perceptual eccentricity difference was restored and the peripheral illusion effect changed into a fovea-like reduction. Therefore, we report the existence of a prior that actively shapes peripheral size perception and stabilizes it relative to the fovea.

Idiosyncratic perception: a link between acuity, perceived position and apparent size

Perceiving the positions of objects is a prerequisite for most other visual and visuomotor functions, but human perception of object position varies from one individual to the next. The source of these individual differences in perceived position and their perceptual consequences are unknown. Here, we tested whether idiosyncratic biases in the underlying representation of visual space propagate across different levels of visual processing. In Experiment 1, using a position matching task, we found stable, observer-specific compressions and expansions within local regions throughout the visual field. We then measured Vernier acuity (Experiment 2) and perceived size of objects (Experiment 3) across the visual field and found that individualized spatial distortions were closely associated with variations in both visual acuity and apparent object size. Our results reveal idiosyncratic biases in perceived position and size, originating from a heterogeneous spatial resolution that carries across the visual hierarchy.

Topographic signatures of global object perception in human visual cortex

Our visual system readily groups dynamic fragmented input into global objects. How the brain represents global object perception remains however unclear. To address this question, we recorded brain responses using functional magnetic resonance imaging whilst observers viewed a dynamic bistable stimulus that could either be perceived globally (i.e., as a grouped and coherently moving shape) or locally (i.e., as ungrouped and incoherently moving elements). We further estimated population receptive fields and used these to back-project the brain activity measured during stimulus perception into visual space via a searchlight procedure. Global perception resulted in universal suppression of responses in lower visual cortex accompanied by wide-spread enhancement in higher object-sensitive cortex. However, follow-up experiments indicated that higher object-sensitive cortex is suppressed if global perception lacks shape grouping, and that grouping-related suppression can be diffusely confined to stimulated sites and accompanied by background enhancement once stimulus size is reduced. These results speak to a non-generic involvement of higher object-sensitive cortex in perceptual grouping and point to an enhancement-suppression mechanism mediating the perception of figure and ground.

•

Lower visual cortex activity to grouped vs ungrouped dynamic stimuli is suppressed.

•

When grouping a shape, activity in higher object-sensitive cortex is enhanced.

•

Without shape grouping, activity in higher object-sensitive cortex is suppressed.

•

Grouping-related suppression can be diffusely confined to stimulated cortical sites.

Mapping sequences can bias population receptive field estimates

Population receptive field (pRF) modelling is a common technique for estimating the stimulus-selectivity of populations of neurons using neuroimaging. Here, we aimed to address if pRF properties estimated with this method depend on the spatio-temporal structure and the predictability of the mapping stimulus. We mapped the polar angle preference and tuning width of voxels in visual cortex (V1-V4) of healthy, adult volunteers. We compared sequences sweeping orderly through the visual field or jumping from location to location employing stimuli of different width (45° vs 6°) and cycles of variable duration (8s vs 60s). While we did not observe any systematic influence of stimulus predictability, the temporal structure of the sequences significantly affected tuning width estimates. Ordered designs with large wedges and short cycles produced systematically smaller estimates than random sequences. Interestingly, when we used small wedges and long cycles, we obtained larger tuning width estimates for ordered than random sequences. We suggest that ordered and random mapping protocols show different susceptibility to other design choices such as stimulus type and duration of the mapping cycle and can produce significantly different pRF results.

On Why Objects Appear Smaller in the Visual Periphery

An object appears smaller in the periphery than in the center of the visual field. In two experiments ( N = 24), we demonstrated that visuospatial attention contributes substantially to this perceptual distortion. Participants judged the size of central and peripheral target objects after a transient, exogenous cue directed their attention to either the central or the peripheral location. Peripheral target objects were judged to be smaller following a central cue, whereas this effect disappeared completely when the peripheral target was cued. This outcome suggests that objects appear smaller in the visual periphery not only because of the structural properties of the visual system but also because of a lack of spatial attention.

The contribution of linear perspective cues and texture gradients in the perceptual rescaling of stimuli inside a Ponzo illusion corridor

We examined the influence of linear perspective cues and texture gradients in the perceptual rescaling of stimuli over a highly-salient Ponzo illusion of a corridor. We performed two experiments using the Method of Constant Stimuli where participants judged the size of one of two rings. In experiment 1, one ring was presented in the upper visual-field at the end of the corridor and the other in the lower visual-field at the front of the corridor. The perceived size of the top and bottom rings changed as a function of the availability of linear perspective and textures. In experiment 2, only one ring was presented either at the top or the bottom of the image. The perceived size of the top but not the bottom ring changed as a function of the availability of linear perspective and textures. In both experiments, the effects of the cues were additive. Perceptual rescaling was also stronger for the top compared to the bottom ring. Additional eye-tracking revealed that participants tended to gaze more in the upper than the lower visual-field. These findings indicate that top-down mechanisms provide an important contribution to the Ponzo illusion. Nonetheless, additional maximum likelihood estimation analyses revealed that linear perspective fulfilled a greater contribution in experiment 2, which is suggestive of a bottom-up mechanism. We conclude that both top-down and bottom-up mechanisms play important roles. However, the former seems to fulfil a more prominent role when both stimuli are presented in the image.

Comparison of human population receptive field estimates between scanners and the effect of temporal filtering

Background: Population receptive field (pRF) analysis with functional magnetic resonance imaging (fMRI) is an increasingly popular method for mapping visual field representations and estimating the spatial selectivity of voxels in human visual cortex. However, the multitude of experimental setups and processing methods used makes comparisons of results between studies difficult. Methods: Here, we compared pRF maps acquired in the same three individuals using comparable scanning parameters on a 1.5 and a 3 Tesla scanner located in two different countries. We also tested the effect of low-pass filtering of the time series on pRF estimates. Results: As expected, the signal-to-noise ratio for the 3 Tesla data was superior; critically, however, estimates of pRF size and cortical magnification did not reveal any systematic differences between the sites. Unsurprisingly, low-pass filtering enhanced goodness-of-fit, presumably by removing high-frequency noise. However, there was no substantial increase in the number of voxels containing meaningful retinotopic signals after low-pass filtering. Importantly, filtering also increased estimates of pRF size in the early visual areas which could substantially skew interpretations of spatial tuning properties. Conclusion: Our results therefore suggest that pRF estimates are generally comparable between scanners of different field strengths, but temporal filtering should be used with caution.

Comparison of human population receptive field estimates between scanners and the effect of temporal filtering

Background: Population receptive field (pRF) analysis with functional magnetic resonance imaging (fMRI) is an increasingly popular method for mapping visual field representations and estimating the spatial selectivity of voxels in human visual cortex. However, the multitude of experimental setups and processing methods used makes comparisons of results between studies difficult. Methods: Here, we compared pRF maps acquired in the same three individuals using comparable scanning parameters on a 1.5 and a 3 Tesla scanner located in two different countries. We also tested the effect of low-pass filtering of the time series on pRF estimates. Results: As expected, the signal-to-noise ratio for the 3 Tesla data was superior; critically, however, estimates of pRF size and cortical magnification did not reveal any systematic differences between the sites. Unsurprisingly, low-pass filtering enhanced goodness-of-fit, presumably by removing high-frequency noise. However, there was no substantial increase in the number of voxels containing meaningful retinotopic signals after low-pass filtering. Importantly, filtering also increased estimates of pRF size in the early visual areas which could substantially skew interpretations of spatial tuning properties. Conclusion: Our results therefore suggest that pRF estimates are generally comparable between scanners of different field strengths, but temporal filtering should be used with caution.

Size Perception Biases Are Temporally Stable and Vary Consistently Between Visual Field Meridians

The apparent size of visual stimuli depends on where in the visual field they appear. We recently presented a model of how size perception could be biased by stimulus encoding in retinotopic cortex. However, it remains unclear if such perceptual biases are instead trivially related to discrimination ability and if they are temporally stable. An independent test of the model is also still outstanding. Here, I show that perceptual biases are stable across stimulus durations between 50 and 1,000 milliseconds, even though discrimination ability unsurprisingly improves with duration. Furthermore, perceptual biases are stronger along the vertical than the horizontal meridian, which mirrors reported differences in spatial vision and the positional selectivity of early visual cortex. Taken together, these findings support our model of how size is inferred from cortical responses.

Probing the role of perception in fear generalization

Behavior in novel situations is guided by similarities to previous experiences, a phenomenon known as generalization. Despite the widespread influence of generalization on healthy and pathological behavior, insight into the underlying mechanisms is lacking. It remains unclear whether a failure to notice situational changes contributes to the generalization of learned behavior. We combined a fear conditioning and generalization procedure with a perceptual decision task in humans and found that a failure to perceive a novel stimulus as different from the initial fear-evoking stimulus was associated with increased conditioned responding. These findings demonstrate the potential of a perception-centered approach to better understand (pathological) behavior and its underlying mechanism and are a promising avenue for the development of refined generalization protocols.

Population receptive field estimates for motion-defined stimuli

The processing of motion changes throughout the visual hierarchy, from spatially restricted ‘local motion’ in early visual cortex to more complex large-field ‘global motion’ at later stages. Here we used functional magnetic resonance imaging (fMRI) to examine spatially selective responses in these areas related to the processing of random-dot stimuli defined by differences in motion. We used population receptive field (pRF) analyses to map retinotopic cortex using bar stimuli comprising coherently moving dots. In the first experiment, we used three separate background conditions: no background dots (dot-defined bar-only), dots moving coherently in the opposite direction to the bar (kinetic boundary) and dots moving incoherently in random directions (global motion). Clear retinotopic maps were obtained for the bar-only and kinetic-boundary conditions across visual areas V1–V3 and in higher dorsal areas. For the global-motion condition, retinotopic maps were much weaker in early areas and became clear only in higher areas, consistent with the emergence of global-motion processing throughout the visual hierarchy. However, in a second experiment we demonstrate that this pattern is not specific to motion-defined stimuli, with very similar results for a transparent-motion stimulus and a bar defined by a static low-level property (dot size) that should have driven responses particularly in V1. We further exclude explanations based on stimulus visibility by demonstrating that the observed differences in pRF properties do not follow the ability of observers to localise or attend to these bar elements. Rather, our findings indicate that dorsal extrastriate retinotopic maps may primarily be determined by the visibility of the neural responses to the bar relative to the background response (i.e. neural signal-to-noise ratios) and suggests that claims about stimulus selectivity from pRF experiments must be interpreted with caution.

Repeatedly Flashed Luminance Noise Can Make Objects Look Further Apart

Luminance noise is widely used as mask in Experimental Psychology. But can luminance noise also affect where we perceive an object or change the perceived distance between objects? In this study, I investigated the effect of a repeatedly flashed luminance noise pattern on the perceived separation between two bars. Indeed, compared to conditions without dynamic luminance noise, the spacing between the bars was overestimated when the pattern flashed on-and-off in the background. The cause for this remarkably stable effect remains unknown. Potential relations to apparent motion, masking, attentional biases, and other visual illusions are discussed.

Direct and indirect effects of perception on generalization gradients

For more than a century, researchers have attempted to understand why organisms behave similarly across situations. Despite the robust character of generalization, considerable variation in conditioned responding both between and within humans remains a challenge for contemporary generalization models. The current study aims to investigate the extent to which variation in behavior in a context of generalization can be attributed to differences in perception. We combined a fear conditioning and generalization procedure with a perceptual decision task in humans. We found that the failure to perceive a novel stimulus as different from the trained fear-evoking stimulus led to increased conditioned responding. Furthermore, perceptual errors yielded perceived stimulus-outcome contingencies that differed substantially from the objective contingencies. Final, the impact of a perceptual error was dependent upon these perceived contingencies. These findings suggest that generalization across a perceptual dimension is to a large extent driven by perceptual errors that directly affect behavior but also indirectly as they yield different learning experiences between individuals.

How to Enhance the Power to Detect Brain-Behavior Correlations With Limited Resources

Neuroscience has been diagnosed with a pervasive lack of statistical power and, in turn, reliability. One remedy proposed is a massive increase of typical sample sizes. Parts of the neuroimaging community have embraced this recommendation and actively push for a reallocation of resources toward fewer but larger studies. This is especially true for neuroimaging studies focusing on individual differences to test brain-behavior correlations. Here, I argue for a more efficient solution. Ad hoc simulations show that statistical power crucially depends on the choice of behavioral and neural measures, as well as on sampling strategy. Specifically, behavioral prescreening and the selection of extreme groups can ascertain a high degree of robust in-sample variance. Due to the low cost of behavioral testing compared to neuroimaging, this is a more efficient way of increasing power. For example, prescreening can achieve the power boost afforded by an increase of sample sizes from n = 30 to n = 100 at ∼5% of the cost. This perspective article briefly presents simulations yielding these results, discusses the strengths and limitations of prescreening and addresses some potential counter-arguments. Researchers can use the accompanying online code to simulate the expected power boost of prescreening for their own studies.

Unexplained Progressive Visual Field Loss in the Presence of Normal Retinotopic Maps

Lesions of primary visual cortex or its primary inputs typically result in retinotopically localized scotomas. Here we present an individual with unexplained visual field loss and deficits in visual perception in the absence of structural damage to the early visual pathway or lesions in visual cortex. The subject, monocular from an early age, underwent repeated perimetry tests over 8 years demonstrating severe anopia of the lower hemifield, and a clockwise progression of the loss through her upper left visual field. Her visual impairment was evident in a number of standardized tests and psychophysics, especially in tasks assessing spatial integration using illusory contours. However, her intellectual ability was intact and her performance in some other tasks assessing color vision or object detection in scenes was normal. We employed functional magnetic resonance imaging (fMRI), electroretinography and visually evoked potentials. Surprisingly, in contrast to the participant's severe anopia, we found no evidence of abnormal function of her early visual pathways. Specifically, we performed retinotopic mapping using population receptive field (pRF) analysis to map the functional organization of visual cortex in the anopic participant and three control participants on two occasions three and a half years apart. Despite the behavioral visual field loss, her retinotopic maps and pRF parameters in visual areas V1-V3 were qualitatively normal. Further behavioral experiments confirmed that this discrepancy was not trivially explained by the difference between stimuli used for retinotopic mapping and perimetry. Structural T1 scans were normal at both time points, and volumetric analysis of white and gray matter tissue on the segmented T1 volumes did not reveal any abnormalities or deterioration over time. Our findings suggest that normal functional organization of early visual cortex without evident structural damage to the early visual pathway as disclosed by the techniques employed in this study does not necessarily guarantee conscious perception across the visual field.

The optimal experimental design for multiple alternatives perceptual search

Perceptual bias is inherent to all our senses, particularly in the form of visual illusions and aftereffects. However, many experiments measuring perceptual biases may be susceptible to nonperceptual factors, such as response bias and decision criteria. Here, we quantify how robust multiple alternative perceptual search (MAPS) is for disentangling estimates of perceptual biases from these confounding factors. First, our results show that while there are considerable response biases in our four-alternative forced-choice design, these are unrelated to perceptual biases estimates, and these response biases are not produced by the response modality (keyboard vs. mouse). We also show that perceptual bias estimates are reduced when feedback is given on each trial, likely due to feedback enabling observers to partially (and actively) correct for perceptual biases. However, this does not impact the reliability with which MAPS detects the presence of perceptual biases. Finally, our results show that MAPS can detect actual perceptual biases and is not a decisional bias towards choosing the target in the middle of the candidate stimulus distribution. In summary, researchers conducting a MAPS experiment should use a constant reference stimulus, but consider varying the mean of the candidate distribution. Ideally, they should not employ trial-wise feedback if the magnitude of perceptual biases is of interest.

Perception of contextual size illusions by honeybees in restricted and unrestricted viewing conditions

How different visual systems process images and make perceptual errors can inform us about cognitive and visual processes. One of the strongest geometric errors in perception is a misperception of size depending on the size of surrounding objects, known as the Ebbinghaus or Titchener illusion. The ability to perceive the Ebbinghaus illusion appears to vary dramatically among vertebrate species, and even populations, but this may depend on whether the viewing distance is restricted. We tested whether honeybees perceive contextual size illusions, and whether errors in perception of size differed under restricted and unrestricted viewing conditions. When the viewing distance was unrestricted, there was an effect of context on size perception and thus, similar to humans, honeybees perceived contrast size illusions. However, when the viewing distance was restricted, bees were able to judge absolute size accurately and did not succumb to visual illusions, despite differing contextual information. Our results show that accurate size perception depends on viewing conditions, and thus may explain the wide variation in previously reported findings across species. These results provide insight into the evolution of visual mechanisms across vertebrate and invertebrate taxa, and suggest convergent evolution of a visual processing solution.

Is the Ebbinghaus illusion a size contrast illusion?

The Ebbinghaus illusion, in which a central target surrounded by larger context figures looks smaller than when surrounded by smaller context figures, is usually classified as a size contrast illusion. Thus "size contrast" is the dominant account of this effect. However, according to an alternative "contour interaction" account this phenomenon has little to do with size contrast but is rather caused by distance-dependent attractive and repulsive interactions between neural representation of contours. Here evidence is presented against the size contrast account and consistent with the contour interaction account. Experiment 1 was a control study confirming that the illusion can be obtained using displays consisting only of squares, which are more convenient to manipulate than the standardly used circles. In Experiment 2, the standard configuration involving small context figures surrounding the target was compared to a novel configuration, which involved many "spread" small context figures. The illusory effect of the standard context was stronger than the illusory effect of the spread context, in accord with the prediction of the contour interaction account, and contrary to the prediction of the size contrast account. In Experiment 3 two novel configurations were used, based on standard and spread contexts. The results were in accord with the prediction of the contour interaction account, whereas the size contrast account had no prediction because the stimuli did not involve conventional size contrast. Additional aspects of the stimuli and an account of the illusion based on a perspective interpretation are also discussed.