Area summation in human visual system: psychophysics, fMRI, and modeling

The Psychosis Human Connectome Project: Design and rationale for studies of visual neurophysiology

Visual perception is abnormal in psychotic disorders such as schizophrenia. In addition to hallucinations, laboratory tests show differences in fundamental visual processes including contrast sensitivity, center-surround interactions, and perceptual organization. A number of hypotheses have been proposed to explain visual dysfunction in psychotic disorders, including an imbalance between excitation and inhibition. However, the precise neural basis of abnormal visual perception in people with psychotic psychopathology (PwPP) remains unknown. Here, we describe the behavioral and 7 tesla MRI methods we used to interrogate visual neurophysiology in PwPP as part of the Psychosis Human Connectome Project (HCP). In addition to PwPP (n = 66) and healthy controls (n = 43), we also recruited first-degree biological relatives (n = 44) in order to examine the role of genetic liability for psychosis in visual perception. Our visual tasks were designed to assess fundamental visual processes in PwPP, whereas MR spectroscopy enabled us to examine neurochemistry, including excitatory and inhibitory markers. We show that it is feasible to collect high-quality data across multiple psychophysical, functional MRI, and MR spectroscopy experiments with a sizable number of participants at a single research site. These data, in addition to those from our previously described 3 tesla experiments, will be made publicly available in order to facilitate further investigations by other research groups. By combining visual neuroscience techniques and HCP brain imaging methods, our experiments offer new opportunities to investigate the neural basis of abnormal visual perception in PwPP.

Population receptive fields of human primary visual cortex organised as DC-balanced bandpass filters

The response to visual stimulation of population receptive fields (pRF) in the human visual cortex has been modelled with a Difference of Gaussians model, yet many aspects of their organisation remain poorly understood. Here, we examined the mathematical basis and signal-processing properties of this model and argue that the DC-balanced Difference of Gaussians (DoG) holds a number of advantages over a DC-biased DoG. Through functional magnetic resonance imaging (fMRI) pRF mapping, we compared performance of DC-balanced and DC-biased models in human primary visual cortex and found that when model complexity is taken into account, the DC-balanced model is preferred. Finally, we present evidence indicating that the BOLD signal DC offset contains information related to the processing of visual stimuli. Taken together, the results indicate that V1 pRFs are at least frequently organised in the exact constellation that allows them to function as bandpass filters, which makes the separation of stimulus contrast and luminance possible. We further speculate that if the DoG models stimulus contrast, the DC offset may reflect stimulus luminance. These findings suggest that it may be possible to separate contrast and luminance processing in fMRI experiments and this could lead to new insights on the haemodynamic response.

Divisive normalization unifies disparate response signatures throughout the human visual hierarchy

A canonical neural computation is a mathematical operation applied by the brain in a wide variety of contexts and capable of explaining and unifying seemingly unrelated neural and perceptual phenomena. Here, we use a combination of state-of-the-art experiments (ultra-high-field functional MRI) and mathematical methods (population receptive field [pRF] modeling) to uniquely demonstrate the role of divisive normalization (DN) as the canonical neural computation underlying visuospatial responses throughout the human visual hierarchy. The DN pRF model provides a tool to investigate and interpret the computational processes underlying neural responses in human and animal recordings, but also in clinical and cognitive dimensions.

Neural processing is hypothesized to apply the same mathematical operations in a variety of contexts, implementing so-called canonical neural computations. Divisive normalization (DN) is considered a prime candidate for a canonical computation. Here, we propose a population receptive field (pRF) model based on DN and evaluate it using ultra-high-field functional MRI (fMRI). The DN model parsimoniously captures seemingly disparate response signatures with a single computation, superseding existing pRF models in both performance and biological plausibility. We observe systematic variations in specific DN model parameters across the visual hierarchy and show how they relate to differences in response modulation and visuospatial information integration. The DN model delivers a unifying framework for visuospatial responses throughout the human visual hierarchy and provides insights into its underlying information-encoding computations. These findings extend the role of DN as a canonical computation to neuronal populations throughout the human visual hierarchy.

Reduced visual contrast suppression during major depressive episodes

BACKGROUND

Previous studies have suggested that processing of visual contrast information could be altered in major depressive disorder. To clarify the changes at different levels of the visual hierarchy, we behaviourally measured contrast perception in 2 centre-surround conditions, assessing retinal and cortical processing.

METHODS

As part of a prospective cohort study, our sample consisted of controls (n = 29; 21 female) and patients with unipolar depression, bipolar disorder and borderline personality disorder who had baseline major depressive episodes (n = 111; 74 female). In a brightness induction test that assessed retinal processing, participants compared the perceived luminance of uniform patches (presented on a computer screen) as the luminance of the backgrounds was varied. In a contrast suppression test that assessed cortical processing, participants compared the perceived contrast of gratings, which were presented with collinearly or orthogonally oriented backgrounds.

RESULTS

Brightness induction was similar for patients with major depressive episodes and controls (p = 0.60, d = 0.115, Bayes factor = 3.9), but contrast suppression was significantly lower for patients than for controls (p < 0.006, d = 0.663, Bayes factor = 35.2). We observed no statistically significant associations between contrast suppression and age, sex, or medication or diagnostic subgroup. At follow-up (n = 74), we observed some normalization of contrast perception.

LIMITATIONS

We assessed contrast perception using behavioural tests instead of electrophysiology.

CONCLUSION

The reduced contrast suppression we observed may have been caused by decreased retinal feedforward or cortical feedback signals. Because we observed intact brightness induction, our results suggest normal retinal but altered cortical processing of visual contrast during a major depressive episode. This alteration is likely to be present in multiple types of depression and to partially normalize upon remission.

Foveal pRF properties in the visual cortex depend on the extent of stimulated visual field

Previous studies demonstrated that alterations in functional MRI derived receptive field (pRF) properties in cortical projection zones of retinal lesions can erroneously be mistaken for cortical large-scale reorganization in response to visual system pathologies. We tested, whether such confounds are also evident in the normal cortical projection zone of the fovea for simulated peripheral visual field defects. We applied fMRI-based visual field mapping of the central visual field at 3 T in eight controls to compare the pRF properties of the central visual field of a reference condition (stimulus radius: 14°) and two conditions with simulated peripheral visual field defect, i.e., with a peripheral gray mask, stimulating only the central 7° or 4° radius. We quantified, for the cortical representation of the actually stimulated visual field, the changes in the position and size of the pRFs associated with reduced peripheral stimulation using conventional and advanced pRF modeling. We found foveal pRF-positions (≤3°) to be significantly shifted towards the periphery (p<0.05, corrected). These pRF-shifts were largest for the 4° condition [visual area (mean eccentricity shift): V1 (0.9°), V2 (0.9°), V3 (1.0°)], but also evident for the 7° condition [V1 (0.5°), V2 (0.5°), V3 (0.9°)]. Further, an overall enlargement of pRF-sizes was observed. These findings indicate the dependence of foveal pRF parameters on the spatial extent of the stimulated visual field and are likely associated with methodological biases and/or physiological mechanisms. Consequently, our results imply that, previously reported similar findings in patients with actual peripheral scotomas need to be interpreted with caution and indicate the need for adequate control conditions in investigations of visual cortex reorganization.

Distinct patterns of surround modulation in V1 and hMT

Modulation of a neuron's responses by the stimuli presented outside of its classical receptive field is ubiquitous in the visual system. This "surround modulation" mechanism is believed to be critical for efficient processing and leads to many well-known perceptual effects. The details of surround modulation, however, are still not fully understood. One of the open questions is related to the differences in surround modulation mechanisms in different cortical areas, and their interactions. Here we study patterns of surround modulation in primary visual cortex (V1) and middle temporal complex (hMT+) utilizing a well-studied effect in motion perception, where human observers' ability to discriminate the drift direction of a grating improves as its size gets bigger if the grating has a low contrast, and deteriorates if it has a high contrast. We first replicated the findings in the literature with a behavioral experiment using small and large (1.67 and 8.05 degrees of visual angle) drifting gratings with either low (2%) or high (99%) contrast presented at the periphery. Next, using functional MRI, we found that in V1 with increasing size cortical responses increased at both contrast levels. Whereas in hMT+ with increasing size cortical responses remained unchanged or decreased at high contrast, and increased at low contrast, reflecting the perceptual effect. We also show that the divisive normalization model successfully predicts these activity patterns, and establishes a link between the behavioral results and hMT+ ​activity. We conclude that surround modulation patterns in V1 and hMT+ ​are different, and that the size-contrast interaction in motion perception is likely to originate in hMT+.

Top-down feedback controls spatial summation and response amplitude in primate visual cortex

Sensory information travels along feedforward connections through a hierarchy of cortical areas, which, in turn, send feedback connections to lower-order areas. Feedback has been implicated in attention, expectation, and sensory context, but the mechanisms underlying these diverse feedback functions are unknown. Using specific optogenetic inactivation of feedback connections from the secondary visual area (V2), we show how feedback affects neural responses in the primate primary visual cortex (V1). Reducing feedback activity increases V1 cells' receptive field (RF) size, decreases their responses to stimuli confined to the RF, and increases their responses to stimuli extending into the proximal surround, therefore reducing surround suppression. Moreover, stronger reduction of V2 feedback activity leads to progressive increase in RF size and decrease in response amplitude, an effect predicted by a recurrent network model. Our results indicate that feedback modulates RF size, surround suppression and response amplitude, similar to the modulatory effects of visual spatial attention.

The effects of orientation and attention during surround suppression of small image features: A 7 Tesla fMRI study

Although V1 responses are driven primarily by elements within a neuron's receptive field, which subtends about 1° visual angle in parafoveal regions, previous work has shown that localized fMRI responses to visual elements reflect not only local feature encoding but also long-range pattern attributes. However, separating the response to an image feature from the response to the surrounding stimulus and studying the interactions between these two responses demands both spatial precision and signal independence, which may be challenging to attain with fMRI. The present study used 7 Tesla fMRI with 1.2-mm resolution to measure the interactions between small sinusoidal grating patches (targets) at 3° eccentricity and surrounds of various sizes and orientations to test the conditions under which localized, context-dependent fMRI responses could be predicted from either psychophysical or electrophysiological data. Targets were presented at 8%, 16%, and 32% contrast while manipulating (a) spatial extent of parallel (strongly suppressive) or orthogonal (weakly suppressive) surrounds, (b) locus of attention, (c) stimulus onset asynchrony between target and surround, and (d) blocked versus event-related design. In all experiments, the V1 fMRI signal was lower when target stimuli were flanked by parallel versus orthogonal context. Attention amplified fMRI responses to all stimuli but did not show a selective effect on central target responses or a measurable effect on orientation-dependent surround suppression. Suppression of the V1 fMRI response by parallel surrounds was stronger than predicted from psychophysics but showed a better match to previous electrophysiological reports.

Cholinergic, But Not Dopaminergic or Noradrenergic, Enhancement Sharpens Visual Spatial Perception in Humans

The neuromodulator acetylcholine modulates spatial integration in visual cortex by altering the balance of inputs that generate neuronal receptive fields. These cholinergic effects may provide a neurobiological mechanism underlying the modulation of visual representations by visual spatial attention. However, the consequences of cholinergic enhancement on visuospatial perception in humans are unknown. We conducted two experiments to test whether enhancing cholinergic signaling selectively alters perceptual measures of visuospatial interactions in human subjects. In Experiment 1, a double-blind placebo-controlled pharmacology study, we measured how flanking distractors influenced detection of a small contrast decrement of a peripheral target, as a function of target-flanker distance. We found that cholinergic enhancement with the cholinesterase inhibitor donepezil improved target detection, and modeling suggested that this was mainly due to a narrowing of the extent of facilitatory perceptual spatial interactions. In Experiment 2, we tested whether these effects were selective to the cholinergic system or would also be observed following enhancements of related neuromodulators dopamine or norepinephrine. Unlike cholinergic enhancement, dopamine (bromocriptine) and norepinephrine (guanfacine) manipulations did not improve performance or systematically alter the spatial profile of perceptual interactions between targets and distractors. These findings reveal mechanisms by which cholinergic signaling influences visual spatial interactions in perception and improves processing of a visual target among distractors, effects that are notably similar to those of spatial selective attention.SIGNIFICANCE STATEMENT Acetylcholine influences how visual cortical neurons integrate signals across space, perhaps providing a neurobiological mechanism for the effects of visual selective attention. However, the influence of cholinergic enhancement on visuospatial perception remains unknown. Here we demonstrate that cholinergic enhancement improves detection of a target flanked by distractors, consistent with sharpened visuospatial perceptual representations. Furthermore, whereas most pharmacological studies focus on a single neurotransmitter, many neuromodulators can have related effects on cognition and perception. Thus, we also demonstrate that enhancing noradrenergic and dopaminergic systems does not systematically improve visuospatial perception or alter its tuning. Our results link visuospatial tuning effects of acetylcholine at the neuronal and perceptual levels and provide insights into the connection between cholinergic signaling and visual attention.

Identifying separate components of surround suppression

Surround suppression is a well-known phenomenon in which the response to a visual stimulus is diminished by the presence of neighboring stimuli. This effect is observed in neural responses in areas such as primary visual cortex, and also manifests in visual contrast perception. Studies in animal models have identified at least two separate mechanisms that may contribute to surround suppression: one that is monocular and resistant to contrast adaptation, and another that is binocular and strongly diminished by adaptation. The current study was designed to investigate whether these two mechanisms exist in humans and if they can be identified psychophysically using eye-of-origin and contrast adaptation manipulations. In addition, we examined the prediction that the monocular suppression component is broadly tuned for orientation, while suppression between eyes is narrowly tuned. Our results confirmed that when center and surrounding stimuli were presented dichoptically (in opposite eyes), suppression was orientation-tuned. Following adaptation in the surrounding region, no dichoptic suppression was observed, and monoptic suppression no longer showed orientation selectivity. These results are consistent with a model of surround suppression that depends on both low-level and higher level components. This work provides a method to assess the separate contributions of these components during spatial context processing in human vision.

Modeling fMRI signals can provide insights into neural processing in the cerebral cortex

Every stimulus or task activates multiple areas in the mammalian cortex. These distributed activations can be measured with functional magnetic resonance imaging (fMRI), which has the best spatial resolution among the noninvasive brain imaging methods. Unfortunately, the relationship between the fMRI activations and distributed cortical processing has remained unclear, both because the coupling between neural and fMRI activations has remained poorly understood and because fMRI voxels are too large to directly sense the local neural events. To get an idea of the local processing given the macroscopic data, we need models to simulate the neural activity and to provide output that can be compared with fMRI data. Such models can describe neural mechanisms as mathematical functions between input and output in a specific system, with little correspondence to physiological mechanisms. Alternatively, models can be biomimetic, including biological details with straightforward correspondence to experimental data. After careful balancing between complexity, computational efficiency, and realism, a biomimetic simulation should be able to provide insight into how biological structures or functions contribute to actual data processing as well as to promote theory-driven neuroscience experiments. This review analyzes the requirements for validating system-level computational models with fMRI. In particular, we study mesoscopic biomimetic models, which include a limited set of details from real-life networks and enable system-level simulations of neural mass action. In addition, we discuss how recent developments in neurophysiology and biophysics may significantly advance the modelling of fMRI signals.

Feedback to distal dendrites links fMRI signals to neural receptive fields in a spiking network model of the visual cortex

The blood oxygenation level-dependent (BOLD) response has been strongly associated with neuronal activity in the brain. However, some neuronal tuning properties are consistently different from the BOLD response. We studied the spatial extent of neural and hemodynamic responses in the primary visual cortex, where the BOLD responses spread and interact over much longer distances than the small receptive fields of individual neurons would predict. Our model shows that a feedforward-feedback loop between V1 and a higher visual area can account for the observed spread of the BOLD response. In particular, anisotropic landing of inputs to compartmental neurons were necessary to account for the BOLD signal spread, while retaining realistic spiking responses. Our work shows that simple dendrites can separate tuning at the synapses and at the action potential output, thus bridging the BOLD signal to the neural receptive fields with high fidelity.

Multiple components of surround modulation in primary visual cortex: multiple neural circuits with multiple functions?

The responses of neurons in primary visual cortex (V1) to stimulation of their receptive field (RF) are modulated by stimuli in the RF surround. This modulation is suppressive when the stimuli in the RF and surround are of similar orientation, but less suppressive or facilitatory when they are cross-oriented. Similarly, in human vision surround stimuli selectively suppress the perceived contrast of a central stimulus. Although the properties of surround modulation have been thoroughly characterized in many species, cortical areas and sensory modalities, its role in perception remains unknown. Here we argue that surround modulation in V1 consists of multiple components having different spatio-temporal and tuning properties, generated by different neural circuits and serving different visual functions. One component arises from LGN afferents, is fast, untuned for orientation, and spatially restricted to the surround region nearest to the RF (the near-surround); its function is to normalize V1 cell responses to local contrast. Intra-V1 horizontal connections contribute a slower, narrowly orientation-tuned component to near-surround modulation, whose function is to increase the coding efficiency of natural images in manner that leads to the extraction of object boundaries. The third component is generated by topdown feedback connections to V1, is fast, broadly orientation-tuned, and extends into the far-surround; its function is to enhance the salience of behaviorally relevant visual features. Far- and near-surround modulation, thus, act as parallel mechanisms: the former quickly detects and guides saccades/attention to salient visual scene locations, the latter segments object boundaries in the scene.

Effect of retinopathy of prematurity on scotopic spatial summation

PURPOSE

To evaluate scotopic retinal organization in retinopathy of prematurity (ROP) through a study of spatial summation.

METHODS

Thresholds for a range of stimulus diameters (0.4°-10°) were measured using a two alternative, spatial, forced choice psychophysical procedure. The critical diameter (DCRIT) for complete summation was estimated in subjects with a history of severe ROP (N = 7) and mild ROP (N = 17). Subjects who were born preterm and never had ROP (N = 16) and term-born subjects (N = 7) were also tested. The subjects ranged in age from 9 to 17 (median 13.5) years.

RESULTS

Critical diameter for complete spatial summation was significantly larger in ROP subjects than in subjects who never had ROP and in term-born control subjects. Critical diameter varied significantly with severity of ROP.

CONCLUSIONS

The larger DCRIT values in ROP are consistent with altered organization of the post receptor retina. This may offer the ROP retina a strategy for achieving noise reduction and good dark-adapted visual sensitivity.

Retinal visual processing constrains human ocular following response

Ocular following responses (OFRs) are the initial tracking eye movements elicited at ultra-short latency by sudden motion of a textured pattern. We wished to evaluate quantitatively the impact that subcortical stages of visual processing might have on the OFRs. In three experiments we recorded the OFRs of human subjects to brief horizontal motion of 1D vertical sine-wave gratings restricted to an elongated horizontal aperture. Gratings were composed of a variable number of abutting horizontal strips where alternate strips were in counterphase. In one of the experiments we also utilized gratings occupying a variable number of horizontal strips separated vertically by mean-luminance gaps. We modeled retinal center/surround receptive fields as a difference of two 2-D Gaussian functions. When the characteristics of such local filters were selected in accord with the known properties of primate retinal ganglion cells, a single-layer model was capable to quantitatively account for the observed changes in the OFR amplitude for stimuli composed of counterphase strips of different heights (Experiment 1), for a wide range of stimulus contrasts (Experiment 2) and spatial frequencies (Experiment 3). A similar model using oriented filters that resemble cortical simple cells was also able to account for these data. Since similar filters can be constructed from the linear summation of retinal filters, and these filters alone can explain the data, we conclude that retinal processing determines the response to these stimuli. Thus, with appropriately chosen stimuli, OFRs can be used to study visual spatial integration processes as early as in the retina.

Visual interactions conform to pattern decorrelation in multiple cortical areas

Neural responses to visual stimuli are strongest in the classical receptive field, but they are also modulated by stimuli in a much wider region. In the primary visual cortex, physiological data and models suggest that such contextual modulation is mediated by recurrent interactions between cortical areas. Outside the primary visual cortex, imaging data has shown qualitatively similar interactions. However, whether the mechanisms underlying these effects are similar in different areas has remained unclear. Here, we found that the blood oxygenation level dependent (BOLD) signal spreads over considerable cortical distances in the primary visual cortex, further than the classical receptive field. This indicates that the synaptic activity induced by a given stimulus occurs in a surprisingly extensive network. Correspondingly, we found suppressive and facilitative interactions far from the maximum retinotopic response. Next, we characterized the relationship between contextual modulation and correlation between two spatial activation patterns. Regardless of the functional area or retinotopic eccentricity, higher correlation between the center and surround response patterns was associated with stronger suppressive interaction. In individual voxels, suppressive interaction was predominant when the center and surround stimuli produced BOLD signals with the same sign. Facilitative interaction dominated in the voxels with opposite BOLD signal signs. Our data was in unison with recently published cortical decorrelation model, and was validated against alternative models, separately in different eccentricities and functional areas. Our study provides evidence that spatial interactions among neural populations involve decorrelation of macroscopic neural activation patterns, and suggests that the basic design of the cerebral cortex houses a robust decorrelation mechanism for afferent synaptic input.

The second face of blindness: processing speed deficits in the intact visual field after pre- and post-chiasmatic lesions

Purpose

Damage along the visual pathway results in a visual field defect (scotoma), which retinotopically corresponds to the damaged neural tissue. Other parts of the visual field, processed by the uninjured tissue, are considered to be intact. However, perceptual deficits have been observed in the “intact” visual field, but these functional impairments are poorly understood. We now studied temporal processing deficits in the intact visual field of patients with either pre- or post-chiasmatic lesions to better understand the functional consequences of partial blindness.

Methods

Patients with pre- (n = 53) or post- chiasmatic lesions (n = 98) were tested with high resolution perimetry – a method used to map visual fields with supra-threshold light stimuli. Reaction time of detections in the intact visual field was then analyzed as an indicator of processing speed and correlated with features of the visual field defect.

Results

Patients from both groups exhibited processing speed deficits in their presumably “intact” field as indicated by comparison to a normative sample. Further, in both groups processing speed was found to be a function of two factors. Firstly, a spatially restricted (retinotopic) influence of the scotoma was seen in longer reaction times when stimuli were presented in intact field sectors close to the defect. Secondly, patients with larger scotomata had on average longer reaction times in their intact field indicating a more general (non-retinotopic) influence of the scotoma.

Conclusions

Processing speed deficits in the “intact” visual field of patients with visual system damage demonstrate that visual system lesions have more widespread consequences on perception than previously thought. Because dysfunctions of the seeing field are expected to contribute to subjective vision, including visual tests of the presumed “intact” field may help to better understand vision loss and to improve methods of vision restoration and rehabilitation.

Compressive spatial summation in human visual cortex

Neurons within a small (a few cubic millimeters) region of visual cortex respond to stimuli within a restricted region of the visual field. Previous studies have characterized the population response of such neurons using a model that sums contrast linearly across the visual field. In this study, we tested linear spatial summation of population responses using blood oxygenation level-dependent (BOLD) functional MRI. We measured BOLD responses to a systematic set of contrast patterns and discovered systematic deviation from linearity: the data are more accurately explained by a model in which a compressive static nonlinearity is applied after linear spatial summation. We found that the nonlinearity is present in early visual areas (e.g., V1, V2) and grows more pronounced in relatively anterior extrastriate areas (e.g., LO-2, VO-2). We then analyzed the effect of compressive spatial summation in terms of changes in the position and size of a viewed object. Compressive spatial summation is consistent with tolerance to changes in position and size, an important characteristic of object representation.

Different orientation tuning of near- and far-surround suppression in macaque primary visual cortex mirrors their tuning in human perception

In primary visual cortex (V1), neuronal responses to stimuli inside the receptive field (RF) are usually suppressed by stimuli in the RF surround. This suppression is orientation specific. Similarly, in human vision surround stimuli can suppress perceived contrast of a central stimulus in an orientation-dependent manner. The surround consists of two regions likely generated by different circuits: a near-surround generated predominantly by geniculocortical and intra-V1 horizontal connections, and a far-surround generated exclusively by interareal feedback. Using stimuli confined to the near- or far-surround of V1 neurons, and similar stimuli in human psychophysics, we find that near-surround suppression is more sharply orientation tuned than far-surround suppression in both macaque V1 and human perception. These results point to a similarity between surround suppression in macaque V1 and human vision, and suggest that feedback circuits are less orientation biased than horizontal circuits. We find the sharpest tuning of near-surround suppression in V1 layers (3, 4B, 4Cα) with patterned and orientation-specific horizontal connections. Sharpest tuning of far-surround suppression occurs in layer 4B, suggesting greater orientation specificity of feedback to this layer. Different orientation tuning of near- and far-surround suppression may reflect a statistical bias in natural images, whereby nearby edges have higher probability than distant edges of being co-oriented and belonging to the same contour. Surround suppression would, thus, increase the coding efficiency of frequently co-occurring contours and the saliency of less frequent ones. Such saliency increase can help detect small orientation differences in nearby edges (for contour completion), but large orientation differences in distant edges (for directing saccades/attention).

Fovea-periphery axis symmetry of surround modulation in the human visual system

A visual stimulus activates different sized cortical area depending on eccentricity of the stimulus. Here, our aim is to understand whether the visual field size of a stimulus or cortical size of the corresponding representation determines how strongly it interacts with other stimuli. We measured surround modulation of blood-oxygenation-level-dependent signal and perceived contrast with surrounds that extended either towards the periphery or the fovea from a center stimulus, centered at 6° eccentricity. This design compares the effects of two surrounds which are identical in visual field size, but differ in the sizes of their cortical representations. The surrounds produced equally strong suppression, which suggests that visual field size of the surround determines suppression strength. A modeled population of neuronal responses, in which all the parameters were experimentally fixed, captured the pattern of results both in psychophysics and functional magnetic resonance imaging. Although the fovea-periphery anisotropy affects nearly all aspects of spatial vision, our results suggest that in surround modulation the visual system compensates for it.

Spatial summation of neurometabolic coupling in the central visual pathway

Noninvasive neural imaging has become an important tool in both applied and theoretical applications. The hemodynamic properties that are measured in functional magnetic resonance imaging (fMRI), for example, are generally used to infer neuronal characteristics. In an attempt to provide empirical data to connect the hemodynamic measurements with neural function, we have conducted previous studies in which neural activity and tissue oxygen metabolic functions are determined together in co-localized regions of the central visual pathway. A basic question in this procedure is whether oxygen responses are coupled linearly in space and time with neural activity. We have previously examined temporal factors, and in the current study, spatial characteristics are addressed. We have recorded from neurons in the lateral geniculate nucleus (LGN) and striate cortex in anesthetized cats. In both structures, there is a classical receptive field (CRF) within which a neuron can be activated. There is also a region outside the CRF from which stimulation cannot activate the cell directly but can influence the response elicited from the CRF. In this investigation we have used several specific spatial stimulus patterns presented to either the CRF or the surrounding region or to both areas together in order to determine spatial response patterns. Within the CRF, we find that neural and metabolic responses sum in a nonlinear fashion but changes in these two measurements are closely coupled. For stimuli that extend beyond the CRF, neural activity is generally reduced while oxygen response exhibits uncoupled changes.

Local model for contextual modulation in the cerebral cortex

A neural response to a sensory stimulus in cerebral cortex is modulated when other stimuli are presented simultaneously. The other stimuli can modulate responses even when they do not drive the neural output alone, indicating a non-linear summation of synaptic activity. The mechanisms of the nonlinearity have remained unclear. Here, I explore a model which considers both network and intracellular processes, and which can account for various types of contextual modulation. The processes include synaptic sensitivity function, determination of inhibition strength, dendritic decay of membrane voltage, and summation of excitatory and inhibitory membrane voltages. First, the model assumes that excitatory and inhibitory units have the same input sensitivity function, which is more broadly tuned than the output tuning function. Second, a central property of the model is that inhibition is a fraction of excitation, determined by covariance between the input and the sensitivity function. With proper fraction, a model neuron sums apparently decorrelated input, regardless of correlations in the original input. Third, the model assumes that synaptic input lands anisotropically on the dendrites, which together with passive dendritic decay cause exponential decay in summation along the input space. This explains the difference between input sensitivity function and output tuning function, and thus accounts for the division between driving classical and modulating extra-classical receptive fields. The model simulations replicate single-cell area summation function, far surround facilitation, and a shift in tuning function due to contextual stimulation. The model is very general, and should be applicable to various interactions between cortical representations.

Local non-linear interactions in the visual cortex may reflect global decorrelation

The classical receptive field in the primary visual cortex have been successfully explained by sparse activation of relatively independent units, whose tuning properties reflect the statistical dependencies in the natural environment. Robust surround modulation, emerging from stimulation beyond the classical receptive field, has been associated with increase of lifetime sparseness in the V1, but the system-wide modulation of response strength have currently no theoretical explanation. We measured fMRI responses from human visual cortex and quantified the contextual modulation with a decorrelation coefficient (d), derived from a subtractive normalization model. All active cortical areas demonstrated local non-linear summation of responses, which were in line with hypothesis of global decorrelation of voxels responses. In addition, we found sensitivity to surrounding stimulus structure across the ventral stream, and large-scale sensitivity to the number of simultaneous objects. Response sparseness across voxel population increased consistently with larger stimuli. These data suggest that contextual modulation for a stimulus event reflect optimization of the code and perhaps increase in energy efficiency throughout the ventral stream hierarchy. Our model provides a novel prediction that average suppression of response amplitude for simultaneous stimuli across the cortical network is a monotonic function of similarity of response strengths in the network when the stimuli are presented alone.

High-resolution BOLD fMRI measurements of local orientation-dependent contextual modulation show a mismatch between predicted V1 output and local BOLD response

The blood oxygenation level-dependent (BOLD) functional MRI response to suppressive neural activity has not been tested on a fine spatial scale. Using Gabor patches placed in the near periphery, we precisely localized individual regions of interest in primary visual cortex and measured the response at a range of contrasts in two different contexts: with parallel and with orthogonal flanking Gabor patches. Psychophysical measurements confirmed strong suppression of the target Gabor response when flanked by parallel Gabors. However, the BOLD response to the target with parallel flankers decreased as the target contrast increased, which contradicts psychophysical estimates of local neural activity.