Feature representation under crowding in macaque V1 and V4 neuronal populations

Spatial context non-uniformly modulates inter-laminar information flow in the primary visual cortex

Our visual experience is a result of the concerted activity of neuronal ensembles in the sensory hierarchy. Yet, how the spatial organization of objects influences this activity remains poorly understood. We investigate how inter-laminar information flow within the primary visual cortex (V1) is affected by visual stimuli in isolation or with flankers at spatial configurations that are known to cause non-uniform degradation of perception. By employing dimensionality reduction approaches to simultaneous, layer-specific population recordings, we establish that information propagation between cortical layers occurs along a structurally stable communication subspace. The spatial configuration of contextual stimuli differentially modulates inter-laminar communication efficacy, the balance of feedforward and effective feedback signaling, and contextual signaling in the superficial layers. Remarkably, these modulations mirror the spatially non-uniform aspects of perceptual degradation. Our results suggest a model of retinotopically non-uniform cortical connectivity in the output layers of V1 that influences information flow in the sensory hierarchy.

The Graded Incomplete Letters Test (GILT): a rapid test to detect cortical visual loss, with UK Biobank implementation

Impairments of object recognition are core features of neurodegenerative syndromes, in particular posterior cortical atrophy (PCA; the 'visual-variant Alzheimer's disease'). These impairments arise from damage to higher-level cortical visual regions and are often missed or misattributed to common ophthalmological conditions. Consequently, diagnosis can be delayed for years with considerable implications for patients. We report a new test for the rapid measurement of cortical visual loss - the Graded Incomplete Letters Test (GILT). The GILT is an optimised psychophysical variation of a test used to diagnose cortical visual impairment, which measures thresholds for recognising letters under levels of increasing visual degradation (decreasing "completeness") in a similar fashion to ophthalmic tests. The GILT was administered to UK Biobank participants (total n=2,359) and participants with neurodegenerative conditions characterised by initial cortical visual (PCA, n=18) or memory loss (typical Alzheimer's disease, n=9). UK Biobank participants, including both typical adults and those with ophthalmological conditions, were able to recognise letters under low levels of completeness. In contrast, participants with PCA consistently made errors with only modest decreases in completeness. GILT sensitivity to PCA was 83.3% for participants reaching the 80% accuracy cut-off, increasing to 88.9% using alternative cut-offs (60% or 100% accuracy). Specificity values were consistently over 94% when compared to UK Biobank participants without or with documented visual conditions, regardless of accuracy cut-off. These first-release UK Biobank and clinical verification data suggest the GILT has utility in both rapidly detecting visual perceptual losses following posterior cortical damage and differentiating perceptual losses from common eye-related conditions.

Human V4 size predicts crowding distance

Visual recognition is limited by both object size (acuity) and spacing. The spacing limit, called "crowding", is the failure to recognize an object in the presence of other objects. Here, we take advantage of individual differences in crowding behavior to investigate its biological basis. Crowding distance, the minimum object spacing needed for recognition, varies 2-fold among healthy adults. We test the conjecture that this variation in psychophysical crowding distance is due to variation in cortical map size. To test this, we made paired measurements of brain and behavior in 50 observers. We used psychophysics to measure crowding distance and calculate λ, the number of letters that fit into each observer's visual field without crowding. In the same observers, we used fMRI to measure the surface area A (mm^2) of retinotopic maps V1, V2, V3, and V4. Across observers, λ is proportional to the surface area of V4 but is uncorrelated with the surface area of V1 to V3. The proportional relationship of λ to area of V4 indicates conservation of cortical crowding distance across individuals: letters can be recognized if they are spaced by at least 1.4 mm on the V4 map, irrespective of map size and psychophysical crowding distance. We conclude that the size of V4 predicts the spacing limit of visual perception.

Coordinated Response Modulations Enable Flexible Use of Visual Information

We use sensory information in remarkably flexible ways. We can generalize by ignoring task-irrelevant features, report different features of a stimulus, and use different actions to report a perceptual judgment. These forms of flexible behavior are associated with small modulations of the responses of sensory neurons. While the existence of these response modulations is indisputable, efforts to understand their function have been largely relegated to theory, where they have been posited to change information coding or enable downstream neurons to read out different visual and cognitive information using flexible weights. Here, we tested these ideas using a rich, flexible behavioral paradigm, multi-neuron, multi-area recordings in primary visual cortex (V1) and mid-level visual area V4. We discovered that those response modulations in V4 (but not V1) contain the ingredients necessary to enable flexible behavior, but not via those previously hypothesized mechanisms. Instead, we demonstrated that these response modulations are precisely coordinated across the population such that downstream neurons have ready access to the correct information to flexibly guide behavior without making changes to information coding or synapses. Our results suggest a novel computational role for task-dependent response modulations: they enable flexible behavior by changing the information that gets out of a sensory area, not by changing information coding within it.

Neural Correlates of Crowding in Macaque Area V4

Visual crowding refers to the phenomenon where a target object that is easily identifiable in isolation becomes difficult to recognize when surrounded by other stimuli (distractors). Many psychophysical studies have investigated this phenomenon and proposed alternative models for the underlying mechanisms. One prominent hypothesis, albeit with mixed psychophysical support, posits that crowding arises from the loss of information due to pooled encoding of features from target and distractor stimuli in the early stages of cortical visual processing. However, neurophysiological studies have not rigorously tested this hypothesis. We studied the responses of single neurons in macaque (one male, one female) area V4, an intermediate stage of the object-processing pathway, to parametrically designed crowded displays and texture statistics-matched metameric counterparts. Our investigations reveal striking parallels between how crowding parameters-number, distance, and position of distractors-influence human psychophysical performance and V4 shape selectivity. Importantly, we also found that enhancing the salience of a target stimulus could alleviate crowding effects in highly cluttered scenes, and this could be temporally protracted reflecting a dynamical process. Thus, a pooled encoding of nearby stimuli cannot explain the observed responses, and we propose an alternative model where V4 neurons preferentially encode salient stimuli in crowded displays. Overall, we conclude that the magnitude of crowding effects is determined not just by the number of distractors and target-distractor separation but also by the relative salience of targets versus distractors based on their feature attributes-the similarity of distractors and the contrast between target and distractor stimuli.

Response sub-additivity and variability quenching in visual cortex

Sub-additivity and variability are ubiquitous response motifs in the primary visual cortex (V1). Response sub-additivity enables the construction of useful interpretations of the visual environment, whereas response variability indicates the factors that limit the precision with which the brain can do this. There is increasing evidence that experimental manipulations that elicit response sub-additivity often also quench response variability. Here, we provide an overview of these phenomena and suggest that they may have common origins. We discuss empirical findings and recent model-based insights into the functional operations, computational objectives and circuit mechanisms underlying V1 activity. These different modelling approaches all predict that response sub-additivity and variability quenching often co-occur. The phenomenology of these two response motifs, as well as many of the insights obtained about them in V1, generalize to other cortical areas. Thus, the connection between response sub-additivity and variability quenching may be a canonical motif across the cortex.

Non-uniform contextual interactions in the visual cortex place fundamental limits on spatial vision

A prevailing assumption in our understanding of how neurons in the primary visual cortex (V1) integrate contextual information is that such processes are spatially uniform. Conversely, perceptual phenomena such as visual crowding, the impaired ability to accurately recognize a target stimulus among distractors, suggest that interactions among stimuli are distinctly non-uniform. Prior studies have shown flankers at specific spatial geometries exert differential effects on target perception. To resolve this discrepancy, we investigated how flanker geometry impacted the representation of a target stimulus in the laminar microcircuits of V1. Our study reveals flanker location differentially impairs stimulus representation in excitatory neurons in the superficial and input layers of V1 by tuned suppression and untuned facilitation of orientation responses. Mechanistically, this effect can be explained by asymmetrical spatial kernels in a normalization model of cortical activity. Strikingly, these non-uniform modulations of neural representation mirror perceptual anisotropies. These results establish the non-uniform spatial integration of information in the earliest stages of cortical processing as a fundamental limitation of spatial vision.

Neural correlates of crowding in macaque area V4

Visual crowding refers to the phenomenon where a target object that is easily identifiable in isolation becomes difficult to recognize when surrounded by other stimuli (distractors). Extensive psychophysical studies support two alternative possibilities for the underlying mechanisms. One hypothesis suggests that crowding results from the loss of visual information due to pooled encoding of multiple nearby stimuli in the mid-level processing stages along the ventral visual pathway. Alternatively, crowding may arise from limited resolution in decoding object information during recognition and the encoded information may remain inaccessible unless it is salient. To rigorously test these alternatives, we studied the responses of single neurons in macaque area V4, an intermediate stage of the ventral, object-processing pathway, to parametrically designed crowded displays and their texture-statistics matched metameric counterparts. Our investigations reveal striking parallels between how crowding parameters, e.g., number, distance, and position of distractors, influence human psychophysical performance and V4 shape selectivity. Importantly, we found that enhancing the salience of a target stimulus could reverse crowding effects even in highly cluttered scenes and such reversals could be protracted reflecting a dynamical process. Overall, we conclude that a pooled encoding of nearby stimuli cannot explain the observed responses and we propose an alternative model where V4 neurons preferentially encode salient stimuli in crowded displays.