Contrast gain control in the visual cortex: monocular versus binocular mechanisms

Binocular properties of contrast adaptation in human vision

Adaptation to contrast has been known and studied for 50 years, and the functional importance of dynamic gain control mechanisms is widely recognized. Understanding of binocular combination and binocular fusion has also advanced in the last 20 years, but aside from interocular transfer (IOT), we still know little about binocular properties of contrast adaptation. Our observers adapted to a high contrast 3.6 c/deg grating, and we assessed contrast detection and discrimination across a wide range of test contrasts (plotted as threshold vs contrast [TvC] functions). For each combination of adapt/test eye(s), the adapted TvC data followed a 'dipper' curve similar to the unadapted data, but displaced obliquely to higher contrasts. Adaptation had effectively re-scaled all contrasts by a common factor Cs that varied with the combination of adapt and test eye(s). Cs was well described by a simple 2-parameter model that had separate monocular and binocular gain controls, sited before and after binocular summation respectively. When these two levels of adaptation were inserted into an existing model for contrast discrimination, the extended 2-stage model gave a good account of the TvC functions, their shape invariance with adaptation, and the contrast scaling factors. The underlying contrast-response function is of almost constant shape, and adaptation shifts it to higher contrasts by the factor log10(Cs) - a 'pure contrast gain control'. Evidence of partial IOT in cat V1 cells supports the 2-stage scheme, but is not consistent with a classic (single-stage) model.

Binocular Integration in the Primate Primary Visual Cortex

binocular vision, binocular fusion, binocular combination, LGN, V1.

Nearby contours abolish the binocular advantage

That binocular viewing confers an advantage over monocular viewing for detecting isolated low luminance or low contrast objects, has been known for well over a century; however, the processes involved in combining the images from the two eyes are still not fully understood. Importantly, in natural vision, objects are rarely isolated but appear in context. It is well known that nearby contours can either facilitate or suppress detection, depending on their distance from the target and the global configuration. Here we report that at close distances collinear (but not orthogonal) flanking contours suppress detection more under binocular compared to monocular viewing, thus completely abolishing the binocular advantage, both at threshold and suprathreshold levels. In contrast, more distant flankers facilitate both monocular and binocular detection, preserving a binocular advantage up to about four times the detection threshold. Our results for monocular and binocular viewing, for threshold contrast discrimination without nearby flankers, can be explained by a gain control model with uncertainty and internal multiplicative noise adding additional constraints on detection. However, in context with nearby flankers, both contrast detection threshold and suprathreshold contrast appearance matching require the addition of both target-to-target and flank-to-target interactions occurring before the site of binocular combination. To test an alternative model, in which the interactions occur after the site of binocular combination, we performed a dichoptic contrast matching experiment, with the target presented to one eye, and the flanks to the other eye. The two models make very different predictions for abutting flanks under dichoptic conditions. Interactions after the combination site predict that the perceived contrast of the flanked target will be strongly suppressed, while interactions before the site predict the perceived contrast will be more or less veridical. The data are consistent with the latter model, strongly suggesting that the interactions take place before the site of binocular combination.

Contrast adaptation and interocular transfer in cortical cells: A re-analysis & a two-stage gain-control model of binocular combination

How do V1 cells respond to, adapt to, and combine signals from the two eyes? We tested a simple functional model that has monocular and binocular stages of divisive contrast gain control (CGC) that sit before, and after, binocular summation respectively. Interocular suppression (IOS) was another potential influence on contrast gain. Howarth, Vorobyov & Sengpiel (2009, Cerebral Cortex, 19, 1835-1843) studied contrast adaptation and interocular transfer in cat V1 cells. In our re-analysis we found that ocular dominance (OD) and contrast adaptation at a fixed test contrast were well described by a re-scaling of the unadapted orientation tuning curve - a simple change in response gain. We compared six variants of the basic model, and one model fitted the gain data notably better than the others did. When the dominant eye was tested, adaptation reduced cell response gain more when that eye was adapted than when the other eye was adapted. But when the non-dominant eye was tested, adapting either eye gave about the same reduction in overall gain, and there was an interaction between OD and adapting eye that was well described by the best-fitting model. Two key features of this model are that signals driving IOS arise 'early', before attenuation due to OD, while suppressive CGC signals are 'late' and so affected by OD. We show that late CGC confers a functional advantage: it yields partial compensation for OD, which should reduce ocular imbalance at the input to binocular summation, and improve the cell's sensitivity to variation in stereo disparity.

A unified model for binocular fusion and depth perception

We describe a new unified model to explain both binocular fusion and depth perception, over a broad range of depths. At each location, the model consists of an array of paired spatial frequency filters, with different relative horizontal shifts (position disparity) and interocular phase disparities of 0, 90, ±180, or -90°. The paired filters with different spatial profiles (non-zero phase disparity) compute interocular misalignment and provide phase-disparity energy (binocular fusion energy) to drive selection of the appropriate filters along the position disparity space until the misalignment is eliminated and sensory fusion is achieved locally. The paired filters with identical spatial profiles (0 phase disparity) compute the position-disparity energy. After sensory fusion, the combination of position and possible residual phase disparity energies is calculated for binocular depth perception. Binocular fusion occurs at multiple scales following a coarse-to-fine process. At a given location, the apparent depth is the weighted sum of fusion shifts combined with residual phase disparity in all spatial-frequency channels, and the weights depend on stimulus spatial frequency and stimulus contrast. To test the theory, we measured disparity minimum and maximum thresholds (Dmin and Dmax) at three spatial frequencies and with different intraocular contrast levels. The stimuli were Random-Gabor-Patch (RGP) stereograms consisting of Gabor patches with random positions and phases, but with a fixed spatial frequency. The two eyes viewed identical arrays of patches except that one eye's array could be shifted horizontally and could differ in contrast. Our experiments and modeling reveal two contrast normalization mechanisms: (1) Energy Normalization (EN): Binocular energy is normalized with monocular energy after the site of binocular combination. This predicts constant Dmin thresholds when varying stimulus contrast in the two eyes; (2) DSKL model Interocular interactions: Monocular contrasts are normalized before the binocular combination site through interocular contrast gain-control and gain-enhancement mechanisms. This predicts contrast dependent Dmax thresholds. We tested a range of models and found that a model consisting of a second-order pathway with DSKL interocular interactions and a first-order pathway with EN at each spatial-frequency band can account for both the Dmin and Dmax data very well. Simulations show that the model makes reasonable predictions of suprathreshold depth perception.

Binocular global motion perception is improved by dichoptic segregation when stimuli have high contrast and high speed

The brain combines information from the two eyes during vision. This combination is obligatory to a remarkable extent: In random-dot kinematograms (RDKs), randomly moving noise dots were similarly effective at preventing observers from seeing the motion of coherently moving signals dots, independent of whether the signal and noise were presented to the same eye or segregated to different eyes. However, motion detectors have varied binocularity: Neurons in visual brain area V1 that encode high contrast, high speed stimuli may be less completely binocular than neurons that encode low contrast, low speed stimuli. Also, neurons in MT often have unbalanced inputs from the two eyes. We predicted that for high contrast, high speed stimuli only, there would be a benefit to segregating the signal and noise of the RDK into different eyes. We found this benefit, both when performance was measured by percent coherence thresholds and when it was measured by luminance contrast ratio (signal-dot-contrast to noise-dot-contrast) thresholds. Thus, for high contrast, high speed stimuli, binocular fusion of local motion is not complete before the extraction of global motion. We also replicated a cross-over interaction: At high speed, global motion extraction was generally more efficient when dot contrast was high, but at low speed it was more efficient when dot contrast was low. We provide a schematic model of binocular global motion perception, to show how the contrast-speed interaction can be predicted from neurophysiology and why it should be exaggerated for segregated viewing. Our data bore out these predictions. We conclude that different neural populations limit performance during binocular global motion perception, depending on stimulus contrast and speed.

Binocular responsiveness of projection neurons of the praying mantis optic lobe in the frontal visual field

Praying mantids are the only insects proven to have stereoscopic vision (stereopsis): the ability to perceive depth from the slightly shifted images seen by the two eyes. Recently, the first neurons likely to be involved in mantis stereopsis were described and a speculative neuronal circuit suggested. Here we further investigate classes of neurons in the lobula complex of the praying mantis brain and their tuning to stereoscopically-defined depth. We used sharp electrode recordings with tracer injections to identify visual projection neurons with input in the optic lobe and output in the central brain. In order to measure binocular response fields of the cells the animals watched a vertical bar stimulus in a 3D insect cinema during recordings. We describe the binocular tuning of 19 neurons projecting from the lobula complex and the medulla to central brain areas. The majority of neurons (12/19) were binocular and had receptive fields for both eyes that overlapped in the frontal region. Thus, these neurons could be involved in mantis stereopsis. We also find that neurons preferring different contrast polarity (bright vs dark) tend to be segregated in the mantis lobula complex, reminiscent of the segregation for small targets and widefield motion in mantids and other insects.

Binocular Modulation of Monocular V1 Neurons

In humans and other primates, sensory signals from each eye remain separated until they arrive in the primary visual cortex (V1), but their exact meeting point is unknown. In V1, some neurons respond to stimulation of only one eye (monocular neurons), while most neurons respond to stimulation of either eye (binocular neurons). The main input layers of V1 contain most of the monocular neurons while binocular neurons dominate the layers above and below. This observation has given rise to the idea that the two eyes' signals remain separate until they converge outside V1's input layers. Here, we show that, despite responding to only one eye, monocular neurons in all layers, including the input layers, of V1 discriminate between stimulation of their driving eye alone and stimulation of both eyes. Some monocular V1 neurons' responses were significantly enhanced, or facilitated, when both eyes were stimulated. Binocular facilitation within V1's input layers tended to occur at the onset of the visual response, which could be explained by converging thalamocortical inputs. However, most V1 monocular neurons were significantly reduced, or suppressed, to binocular stimulation. In contrast to facilitation, binocular suppression occurred several milliseconds following the onset of the visual response, suggesting that the bulk of binocular modulation involves cortical inhibition. These findings, combined, suggest that binocular signals arise at an earlier processing stage than previously appreciated, as even so-called monocular neurons in V1's input layers encode what is shown to both eyes.

Binocular response modulation in the lateral geniculate nucleus

The dorsal lateral geniculate nucleus of the thalamus (LGN) receives the main outputs of both eyes and relays those signals to the visual cortex. Each retina projects to separate layers of the LGN so that each LGN neuron is innervated by a single eye. In line with this anatomical separation, visual responses of almost all of LGN neurons are driven by one eye only. Nonetheless, many LGN neurons are sensitive to what is shown to the other eye as their visual responses differ when both eyes are stimulated compared to when the driving eye is stimulated in isolation. This, predominantly suppressive, binocular modulation of LGN responses might suggest that the LGN is the first location in the primary visual pathway where the outputs from the two eyes interact. Indeed, the LGN features several anatomical structures that would allow for LGN neurons responding to one eye to modulate neurons that respond to the other eye. However, it is also possible that binocular response modulation in the LGN arises indirectly as the LGN also receives input from binocular visual structures. Here we review the extant literature on the effects of binocular stimulation on LGN spiking responses, highlighting findings from cats and primates, and evaluate the neural circuits that might mediate binocular response modulation in the LGN.

Disparity processing in primary visual cortex

The first step in binocular stereopsis is to match features on the left retina with the correct features on the right retina, discarding 'false' matches. The physiological processing of these signals starts in the primary visual cortex, where the binocular energy model has been a powerful framework for understanding the underlying computation. For this reason, it is often used when thinking about how binocular matching might be performed beyond striate cortex. But this step depends critically on the accuracy of the model, and real V1 neurons show several properties that suggest they may be less sensitive to false matches than the energy model predicts. Several recent studies provide empirical support for an extended version of the energy model, in which the same principles are used, but the responses of single neurons are described as the sum of several subunits, each of which follows the principles of the energy model. These studies have significantly improved our understanding of the role played by striate cortex in the stereo correspondence problem.This article is part of the themed issue 'Vision in our three-dimensional world'.

2015 Charles F. Prentice Medal Award Lecture: Neural Organization of Binocular Vision

During a Research Career Development Award from the National Eye Institute, I spent a year at the University of Cambridge doing research with John Robson. The goal was to use a visual stimulation approach that had not been previously attempted, with the intention of exploring fundamental organization principles of the neural basis of binocular vision. The idea was to use sinusoidal gratings that drifted before both eyes such that the relative phase for one eye was fixed while that of the other was varied. This provided binocular stimuli of variable relative phase, i.e. retinal disparity, to enable testing of binocular response characteristics. We were able to obtain different types of disparity tuning functions for neurons in the primary visual cortex. This work, followed by extended investigations in Berkeley, provided basic information regarding response characteristics of simple and complex cells. We have also shown for monocular deprivation, an approximate model for human amblyopia, that many neurons remain connected to the deprived eye, as demonstrated with dichoptic activation. A selected portion of this work is described here.

The divisive normalization model of V1 neurons: a comprehensive comparison of physiological data and model predictions

The physiological responses of simple and complex cells in the primary visual cortex (V1) have been studied extensively and modeled at different levels. At the functional level, the divisive normalization model (DNM; Heeger DJ. Vis Neurosci 9: 181-197, 1992) has accounted for a wide range of single-cell recordings in terms of a combination of linear filtering, nonlinear rectification, and divisive normalization. We propose standardizing the formulation of the DNM and implementing it in software that takes static grayscale images as inputs and produces firing rate responses as outputs. We also review a comprehensive suite of 30 empirical phenomena and report a series of simulation experiments that qualitatively replicate dozens of key experiments with a standard parameter set consistent with physiological measurements. This systematic approach identifies novel falsifiable predictions of the DNM. We show how the model simultaneously satisfies the conflicting desiderata of flexibility and falsifiability. Our key idea is that, while adjustable parameters are needed to accommodate the diversity across neurons, they must be fixed for a given individual neuron. This requirement introduces falsifiable constraints when this single neuron is probed with multiple stimuli. We also present mathematical analyses and simulation experiments that explicate some of these constraints.

Aerobic Exercise Effects on Ocular Dominance Plasticity with a Phase Combination Task in Human Adults

Several studies have shown that short-term monocular patching can induce ocular dominance plasticity in normal adults, in which the patched eye becomes stronger in binocular viewing. There is a recent study showing that exercise enhances this plasticity effect when assessed with binocular rivalry. We address one question, is this enhancement from exercise a general effect such that it is seen for measures of binocular processing other than that revealed using binocular rivalry? Using a binocular phase combination task in which we directly measure each eye's contribution to the binocularly fused percept, we show no additional effect of exercise after short-term monocular occlusion and argue that the enhancement of ocular dominance plasticity from exercise could not be demonstrated with our approach.

Contrast sensitivity, V1 neural activity, and natural vision

Contrast sensitivity is fundamental to natural visual processing and an important tool for characterizing both visual function and clinical disorders. We simultaneously measured contrast sensitivity and neural contrast response functions and compared measurements in common laboratory conditions with naturalistic conditions. In typical experiments, a subject holds fixation and a stimulus is flashed on, whereas in natural vision, saccades bring stimuli into view. Motivated by our previous V1 findings, we tested the hypothesis that perceptual contrast sensitivity is lower in natural vision and that this effect is associated with corresponding changes in V1 activity. We found that contrast sensitivity and V1 activity are correlated and that the relationship is similar in laboratory and naturalistic paradigms. However, in the more natural situation, contrast sensitivity is reduced up to 25% compared with that in a standard fixation paradigm, particularly at lower spatial frequencies, and this effect correlates with significant reductions in V1 responses. Our data suggest that these reductions in natural vision result from fast adaptation on one fixation that lowers the response on a subsequent fixation. This is the first demonstration of rapid, natural-image adaptation that carries across saccades, a process that appears to constantly influence visual sensitivity in natural vision.

NEW & NOTEWORTHY

Visual sensitivity and activity in brain area V1 were studied in a paradigm that included saccadic eye movements and natural visual input. V1 responses and contrast sensitivity were significantly reduced compared with results in common laboratory paradigms. The parallel neural and perceptual effects of eye movements and stimulus complexity appear to be due to a form of rapid adaptation that carries across saccades.

Cortical mechanisms for afterimage formation: evidence from interocular grouping

Whether the retinal process alone or retinal and cortical processes jointly determine afterimage (AI) formation has long been debated. Based on the retinal rebound responses, recent work proposes that afterimage signals are exclusively generated in the retina, although later modified by cortical mechanisms. We tested this notion with the method of "indirect proof". Each eye was presented with a 2-by-2 checkerboard of horizontal and vertical grating patches. Each corresponding patch of the two checkerboards was perpendicular to each other, which produces binocular rivalry, and can generate percepts ranging from complete interocular grouping to either monocular pattern. The monocular percepts became more frequent with higher contrast. Due to adaptation, the visual system is less sensitive during the AIs than during the inductions with AI-similar contrast. If the retina is the only origin of AIs, comparable contrast appearance would require stronger retinal signals in the AIs than in the inductions, thus leading to more frequent monocular percepts in the AIs than in the inductions. Surprisingly, subjects saw the fully coherent stripes significantly more often in AIs. Our results thus contradict the retinal generation notion, and suggest that in addition to the retina, cortex is directly involved in the generation of AI signals.

Binocular function during unequal monocular input

The fine task of stereoscopic depth discrimination in human subjects requires a functional binocular system. Behavioral investigations show that relatively small binocular abnormalities can diminish stereoscopic acuity. Clinical evaluations are consistent with this observation. Neurons in visual cortex represent the first stage of processing of the binocular system. Cells at this level are generally acutely sensitive to differences in relative depth. However, an apparent paradox in previous work demonstrates that tuning for binocular disparities remains relatively constant even when large contrast differences are imposed between left and right eye stimuli. This implies a range of neural binocular function that is at odds with behavioral findings. To explore this inconsistency, we have conducted psychophysical tests by which human subjects view vertical sinusoidal gratings drifting in opposite directions to left and right eyes. If the opposite drifting gratings are integrated in visual cortex, as wave theory and neurophysiological data predict, the subjects should perceive a fused stationary grating that is counter-phasing in place. However, this behavioral combination may not occur if there are differences in contrast and therefore signal strength between left and right eye stimuli. As expected for the control condition, our results show fused counter-phase perception for equal inter-ocular grating contrasts. Our experimental tests show a striking retention of counter-phase perception even for relatively large differences in inter-ocular contrast. This finding demonstrates that binocular integration, although relatively coarse, can occur during substantial differences in left and right eye signal strength.

The Whole is Other Than the Sum: Perceived Contrast Summation Within Color and Luminance Plaids

The apparent contrast of a plaid is a reflection of the neural relationship between the responses to its two orthogonal component gratings. To investigate the perceived contrast summation of the responses to component gratings in plaids, we compared the apparent contrasts of monocular plaids to a component grating presented alone across chromaticity and spatial frequency. Observers performed a contrast-matching task for red–green color and luminance stimuli at low- and medium-spatial frequencies. Using the measured points of subjective equality between plaids and gratings, we evaluate perceived contrast summation across conditions, which may vary between 1 (no summation) and 2 (full summation). We show that achromatic plaids have higher perceived contrast summation than chromatic plaids. The greatest difference occurs at the medium-spatial frequency, with summation highest for achromatic plaids (1.87) and lowest for chromatic plaids (1.49), while at low-spatial frequencies, there is a smaller summation difference between achromatic (1.72) and chromatic (1.65) plaids. These results are consistent with recent theories of distinct cross-orientation suppression and summation mechanisms in color and luminance vision. Two control experiments for binocular versus monocular viewing, and the overall size of the stimulus patches did not reveal any differences from our main results.

Binocular summation of chance decisions

Seeing with two eyes usually helps one respond faster. Here we show that with ambiguous stimuli, binocular viewing can paradoxically slow down reaction time. This is explained by the observers basing their decision on a noisy neuronal representation within the visual system, with the added noise breaking the symmetry between the two possible interpretations. Binocular integration improves the representation by reducing the noise, increasing ambiguity, and decision time. The neuronal Accumulator (Race) model is applied to quantify the underlying binocular integration. The model accounts for the distributions of reaction times, and predicts suboptimal integration between eyes. We conclude that under ambiguous stimulation neuronal noise within the visual system determines responses.

Abnormal inhibition-excitation imbalance in migraine

Background

People with migraine show increased surround suppression of perceived contrast, a perceptual analogue of centre-surround antagonistic interactions in visual cortex. A proposed mechanism is that cortical ‘hyperexcitability’ or ‘hyperresponsivity’, a prominent theory in the migraine literature, drives abnormal excitatory-inhibitory balance to give increased local inhibition. The purpose of this cross-sectional study was to determine whether cortical hyperresponsivity and excitatory-inhibitory imbalance manifests in the visual cortical response of migraine sufferers.

Methods

Interictal steady-state visual evoked potentials (VEPs) in response to 0 to 97% contrast were recorded in 30 migraine participants (15 without aura, 15 with aura) and 21 non-headache controls. Monotonicity indices were calculated to determine response saturation or supersaturation. Contrast gain was modelled with a modified saturating hyperbolic function to allow for variation in excitation and inhibition.

Results

A greater proportion of migraine participants (43%) than controls (14%) exhibited significant VEP supersaturation at high contrast, based on monotonicity index (chi-square, p = 0.028). Supersaturation was also evident by the trend for greater suppressive exponent values in migraine compared to control individuals (Mann-Whitney rank sum, p = 0.075).

Conclusions

Supersaturation in migraine is consistent with excess excitation (hyperresponsivity) driving increased network inhibition and provides support for excitatory-inhibitory imbalance as a pathophysiological disturbance in migraine.

Perceptual consequence of normalization revealed by a novel brightness induction

The human brain is renowned for its dynamic regulation of sensory inputs, which enables our brain to operate under an enormous range of physical energy with sensory neurons whose processing range is limited. Here we present a novel and strong brightness induction that reflects neural mechanisms underlying this dynamic regulation of sensory inputs. When physically identical, stationary and moving objects are viewed simultaneously, the stationary and moving objects appear largely different. Experiments reveal that normalization at multiple stages of visual processing provides a plausible account for the large shifts in perceptual experiences, observed in both the stationary and the moving objects. This novel brightness induction suggests that brightness of an object is influenced not only by variations in surrounding light (i.e. simultaneous contrast) but also by dynamically changing neural responses associated with stimulus motion.

Binocular pattern deprivation with delayed onset has impact on motion perception in adulthood

The quality of motion perception depends on visual input during early development. Even 1month of binocular deprivation (BD) from birth impairs motion coherence thresholds when tested in kittens; conversely BD with a 1-month delayed onset does not impair it (Mitchell et al., 2009). We showed that 6months of BD applied from birth induces a selective impairment in a Global Motion Detection task, but not in global form perception, when tested in adulthood (Burnat et al., 2002, 2005). In these animals cell counts of the retinal motion-sensitive alpha ganglion revealed a life-long increase in OFF-type ganglion cell (Burnat et al., 2012). Here we examined in adult cats the effect of BD on global motion perception using an array of tasks with gradually increasing perceptual difficulty. Two conditions of BD were applied: from birth, lasting for 1, 2, 4 or 6months, and with a delayed onset with first 2months of normal vision followed by 2months of BD. Cats deprived from birth for a 6-month period had Global Motion Detection impaired, as compared to the normal group. Velocity and low contrast-defined motion processing was impaired when BD was applied exclusively in months 3-4 of life. The cats deprived from birth for 1 or 2months were not impaired in any of the tested motion tasks. Motion coherence thresholds, when tested at the end of a long motion training were not affected by BD and did not differ from those obtained for the normal group. Impaired extraction of low contrast-defined motion signal was found in cats deprived solely in months 3-4 of life. Surprisingly, binocular pattern deprivation during the first 2months of life did not weaken motion sensitivity, revealing the occurrence of a critical period for motion perception later in development than previously suggested.

Binocular activation elicits differences in neurometabolic coupling in visual cortex

Non-invasive brain imaging requires comprehensive interpretation of hemodynamic signals. In functional magnetic resonance imaging, blood oxygen level dependent (BOLD) signals are used to infer neural processes. This necessitates a clear understanding of how BOLD signals and neural activity are related. One fundamental question concerns the relative importance of synaptic activity and spiking discharge. Although these two components are related, most previous work shows that synaptic activity is better reflected in the BOLD signal. However, the mechanisms of this relationship are not clear. The BOLD signal depends on relative changes in cerebral blood flow and cerebral metabolic rate of oxygen. Oxygen metabolism changes are difficult to measure with current imaging techniques, but it is possible to obtain direct quantitative simultaneous in vivo measurement of tissue oxygen and co-localized underlying neural activity. Here, we use this approach with a specific binocular stimulus protocol in order to activate inhibitory and excitatory neuronal pathways in the visual cortex. During excitatory binocular interaction, we find that metabolic, spiking, and local field potential responses are correlated. However, during suppressive binocular interaction, spiking activity and local field potentials (LFP) are dissociated while only the latter is coupled with metabolic response. These results suggest that inhibitory connections may be a key factor in the dissociation between LFP and spiking activity, which may contribute substantially to the close coupling between the BOLD signal and synchronized synaptic activity in the brain.

Push-pull training reduces foveal sensory eye dominance within the early visual channels

A push-pull training protocol is applied to reduce sensory eye dominance in the foveal region. The training protocol consists of cueing the weak eye to force it to become dominant while the strong eye is suppressed when a pair of dichoptic orthogonal grating stimulus is subsequently presented to it (Ooi & He, 1999). We trained with four pairs of dichoptic orthogonal gratings (0°/90°, 90°/0°, 45°/135° and 135°/45° at 3cpd) to affect the interocular inhibitory interaction tuned to the four trained orientations (0°, 45°, 90° and 135°). After a 10-day training session, we found a significant learning effect (reduced sensory eye dominance) at the trained orientations as well as at two other untrained orientations (22.5° and 67.5°). This suggests that the four pairs of oriented training stimuli are sufficient to produce a learning effect at any other orientation. The nearly complete transfer of the learning effect across orientation is attributed to the fact that the trained and untrained orientations are close enough to fall in the same orientation tuning function of the early visual cortical neurons (∼37.5°). Applying the same notion of transfer of learning within the same feature channel, we also found a large transfer effect to an untrained spatial frequency (6cpd), which is 1 octave higher than the trained spatial frequency (3cpd). Furthermore, we found that stereopsis is improved, as is the competitive ability between the two eyes, after the push-pull training. Our data analysis suggests that these improvements are correlated with the reduced sensory eye dominance after the training, i.e., due to a more balanced interocular inhibition. We also found that the learning effect (reduced SED and stereo threshold) can be retained for more than a year after the termination of the push-pull training.

Binocular vision

This essay reviews major developments - empirical and theoretical - in the field of binocular vision during the last 25years. We limit our survey primarily to work on human stereopsis, binocular rivalry and binocular contrast summation, with discussion where relevant of single-unit neurophysiology and human brain imaging. We identify several key controversies that have stimulated important work on these problems. In the case of stereopsis those controversies include position vs. phase encoding of disparity, dependence of disparity limits on spatial scale, role of occlusion in binocular depth and surface perception, and motion in 3D. In the case of binocular rivalry, controversies include eye vs. stimulus rivalry, role of "top-down" influences on rivalry dynamics, and the interaction of binocular rivalry and stereopsis. Concerning binocular contrast summation, the essay focuses on two representative models that highlight the evolving complexity in this field of study.

Eye smarter than scientists believed: neural computations in circuits of the retina

We rely on our visual system to cope with the vast barrage of incoming light patterns and to extract features from the scene that are relevant to our well-being. The necessary reduction of visual information already begins in the eye. In this review, we summarize recent progress in understanding the computations performed in the vertebrate retina and how they are implemented by the neural circuitry. A new picture emerges from these findings that helps resolve a vexing paradox between the retina's structure and function. Whereas the conventional wisdom treats the eye as a simple prefilter for visual images, it now appears that the retina solves a diverse set of specific tasks and provides the results explicitly to downstream brain areas.

A common contrast pooling rule for suppression within and between the eyes

Recent work has revealed multiple pathways for cross-orientation suppression in cat and human vision. In particular, ipsiocular and interocular pathways appear to assert their influence before binocular summation in human but have different (1) spatial tuning, (2) temporal dependencies, and (3) adaptation after-effects. Here we use mask components that fall outside the excitatory passband of the detecting mechanism to investigate the rules for pooling multiple mask components within these pathways. We measured psychophysical contrast masking functions for vertical 1 cycle/deg sine-wave gratings in the presence of left or right oblique (±45 deg) 3 cycles/deg mask gratings with contrast C%, or a plaid made from their sum, where each component (i) had contrast 0.5Ci%. Masks and targets were presented to two eyes (binocular), one eye (monoptic), or different eyes (dichoptic). Binocular-masking functions superimposed when plotted against C, but in the monoptic and dichoptic conditions, the grating produced slightly more suppression than the plaid when Ci ≥ 16%. We tested contrast gain control models involving two types of contrast combination on the denominator: (1) spatial pooling of the mask after a local nonlinearity (to calculate either root mean square contrast or energy) and (2) “linear suppression” (Holmes & Meese, 2004, Journal of Vision4, 1080–1089), involving the linear sum of the mask component contrasts. Monoptic and dichoptic masking were typically better fit by the spatial pooling models, but binocular masking was not: it demanded strict linear summation of the Michelson contrast across mask orientation. Another scheme, in which suppressive pooling followed compressive contrast responses to the mask components (e.g., oriented cortical cells), was ruled out by all of our data. We conclude that the different processes that underlie monoptic and dichoptic masking use the same type of contrast pooling within their respective suppressive fields, but the effects do not sum to predict the binocular case.

Binocular contrast interactions in two-frame motion discrimination

Previous studies have shown that two-frame motion detection thresholds are elevated if one frame's contrast is raised, despite the increase in average contrast--the "contrast paradox". In this study, we investigated if such contrast interactions occurred at a monocular or binocular site of visual processing. Two-frame motion direction discrimination thresholds were measured for motion frames that were presented binocularly, dichoptically or interocularly. Thresholds for each presentation condition were measured for motion frames that comprised either matched or unmatched contrasts. The results showed that contrast mechanisms producing the contrast paradox combine contrast signals from both eyes prior to motion computation. Furthermore, the results are consistent with the existence of monocular and binocular contrast gain control mechanisms that coexist either as combined or independent systems.

Binocular contrast interactions: dichoptic masking is not a single process

To decouple interocular suppression and binocular summation we varied the relative phase of mask and target in a 2IFC contrast-masking paradigm. In Experiment I, dichoptic mask gratings had the same orientation and spatial frequency as the target. For in-phase masking, suppression was strong (a log-log slope of approximately 1) and there was weak facilitation at low mask contrasts. Anti-phase masking was weaker (a log-log slope of approximately 0.7) and there was no facilitation. A two-stage model of contrast gain control [Meese, T.S., Georgeson, M.A. and Baker, D.H. (2006). Binocular contrast vision at and above threshold. Journal of Vision, 6: 1224-1243] provided a good fit to the in-phase results and fixed its free parameters. It made successful predictions (with no free parameters) for the anti-phase results when (A) interocular suppression was phase-indifferent but (B) binocular summation was phase sensitive. Experiments II and III showed that interocular suppression comprised two components: (i) a tuned effect with an orientation bandwidth of approximately +/-33 degrees and a spatial frequency bandwidth of >3 octaves, and (ii) an untuned effect that elevated threshold by a factor of between 2 and 4. Operationally, binocular summation was more tightly tuned, having an orientation bandwidth of approximately +/-8 degrees , and a spatial frequency bandwidth of approximately 0.5 octaves. Our results replicate the unusual shapes of the in-phase dichoptic tuning functions reported by Legge [Legge, G.E. (1979). Spatial frequency masking in human vision: Binocular interactions. Journal of the Optical Society of America, 69: 838-847]. These can now be seen as the envelope of the direct effects from interocular suppression and the indirect effect from binocular summation, which contaminates the signal channel with a mask that has been suppressed by the target.

Minimal physiological conditions for binocular rivalry and rivalry memory

Binocular rivalry entails a perceptual alternation between incompatible stimuli presented to the two eyes. A minimal explanation for binocular rivalry involves strong competitive inhibition between neurons responding to different monocular stimuli to preclude simultaneous activity in the two groups. In addition, strong self-adaptation of dominant neurons is necessary to enable suppressed neurons to become dominant in turn. Here a minimal nonlinear neural model is developed incorporating inhibition, self-adaptation, and recurrent excitation. The model permits derivation of an equation for mean dominance duration as a function of the underlying physiological variables. The dominance duration equation incorporates an explicit representation of Levelt's second law. The same equation also shows that introduction of a simple compressive response nonlinearity can explain Levelt's fourth law. Finally, addition of brief, recurrent synaptic facilitation to the model generates properties of rivalry memory.

Contrast constancy in natural scenes in shadow or direct light: A proposed role for contrast-normalisation (non-specific suppression) in visual cortex

The range of contrasts in natural scenes is generally thought to far exceed the limited dynamic ranges of individual contrast-encoding neurons in the primary visual cortex. The visual system may employ gain-control mechanisms (Ohzawa et al. 1985) to compensate for the mismatch between the range of natural contrast energies and the limited dynamic range of visual neurons; one proposed mechanism is contrast normalisation or non-specific suppression (Heeger 1992a). This paper aims to evaluate the role of contrast normalisation in human contrast perception, using a computer model of primary visual cortex. The model uses orthogonal pairs of Gabor patches to simulate simple-cell receptive-fields to calculate local, band-limited contrast in a series of 50 digitised photographs of natural scenes. The average range of contrast energies in each image was 2.29 log units, while the "lifetime range" each model simple cell would see across all images was 2.98 log units. These ranges are greater than the dynamic range of real mammalian simple cells. Contrast normalisation (dividing contrast responses by the summed responses of all nearby neurons) reduces contrast ranges, perhaps sufficiently to match them to neurons' limited dynamic ranges. Comparison of images taken under diffuse and direct lighting conditions showed that contrast normalisation can sometimes match these conditions effectively. This may lead to perceptual contrast constancy in the face of spurious changes in contrast caused by natural environmental conditions.

The role of spiking nonlinearity in contrast gain control and information transmission

Threshold and saturation are two nonlinear features common to almost all spiking neurons. How these nonlinearities affect the performance gain of the transfer function and coding properties of the neurons has attracted much attention. Here, we deduce basic analytical relationships among these nonlinearities (threshold and saturation), performance gain and information transmission in neurons. We found that performance gain and information transmission can be maximized by input signals with optimal variance. The threshold and saturation inside the model determines the gain tuning property and maximum coding capacity. This framework provides an understanding of some basic design principles underlying information processing systems that can be adjusted to match the statistics of signals in the environment. This study also isolates the exact contributions of the nonlinearities on the contrast adaptation phenomena observed in real visual neurons.

Preserved gain control for luminance contrast during binocular rivalry suppression

Binocular rivalry elevates contrast increment thresholds for the detection of a transient stimulus presented to the suppressed eye, while thresholds measured during dominance are identical to those during monocular viewing (e.g. [Wales, R., & Fox, R. (1970). Increment detection thresholds during binocular rivalry suppression. Perception and Psychophysics, 8, 90-94]). It is well established that contrast increment thresholds depend on reference (pedestal) contrast. With high contrasts, increment thresholds increase with pedestal contrast, reflecting a gain control with sigmoidal non-linearity. We examined how this gain control mechanism operates during binocular rivalry (i.e., with and without perception of a pedestal mask). Subjects viewed a horizontal sine-wave grating (steady pedestal) and a radial checkerboard dichoptically. When the grating achieved a pre-specified phenomenal state (dominance or suppressed), subjects initiated the transient presentation (500-ms Gaussian pulse) of a contrast increment of the same spatial frequency. The pulse appeared in either the upper or lower half of the pedestal. Subjects indicated which half of the pedestal contained the pulse. Contrast increment thresholds were measured using a staircase method with various pedestal contrasts, which yielded threshold versus contrast (TvC) functions during dominance and suppression. The measured thresholds were reliably higher during suppression, but the rising slopes of TvC functions did not differ significantly between dominance and suppression (i.e., constant upward shift of TvC function). A control experiment demonstrated that the TvC function during dominance was identical to that during non-rivalry, monocular viewing. Evidently, the contrast gain control for transient luminance increment does not require the perception of pedestal contrast.

Retina versus cortex; contrast adaptation in parallel visual pathways

Human vision adapts to the contrast of patterns by changing its sensitivity, but the origins of this perceptual adaptation have been disputed. In this issue of Neuron, Solomon et al. show that contrast adaptation in the primate arises mostly in the retina for the magnocellular pathway and mostly in the cortex for the parvocellular pathway. It appears that adaptation arises most strongly at sites that pool over many inputs.

The role of the thalamus in the flow of information to the cortex

The lateral geniculate nucleus is the best understood thalamic relay and serves as a model for all thalamic relays. Only 5-10% of the input to geniculate relay cells derives from the retina, which is the driving input. The rest is modulatory and derives from local inhibitory inputs, descending inputs from layer 6 of the visual cortex, and ascending inputs from the brainstem. These modulatory inputs control many features of retinogeniculate transmission. One such feature is the response mode, burst or tonic, of relay cells, which relates to the attentional demands at the moment. This response mode depends on membrane potential, which is controlled effectively by the modulator inputs. The lateral geniculate nucleus is a first-order relay, because it relays subcortical (i.e. retinal) information to the cortex for the first time. By contrast, the other main thalamic relay of visual information, the pulvinar region, is largely a higher-order relay, since much of it relays information from layer 5 of one cortical area to another. All thalamic relays receive a layer-6 modulatory input from cortex, but higher-order relays in addition receive a layer-5 driver input. Corticocortical processing may involve these corticothalamocortical 're-entry' routes to a far greater extent than previously appreciated. If so, the thalamus sits at an indispensable position for the modulation of messages involved in corticocortical processing.

Fast and slow contrast adaptation in retinal circuitry

The visual system adapts to the magnitude of intensity fluctuations, and this process begins in the retina. Following the switch from a low-contrast environment to one of high contrast, ganglion cell sensitivity declines in two distinct phases: a fast change occurs in <0.1 s, and a slow decrease over approximately 10 s. To examine where these modulations arise, we recorded intracellularly from every major cell type in the salamander retina. Certain bipolar and amacrine cells, and all ganglion cells, adapted to contrast. Generally, these neurons showed both fast and slow adaptation. Fast effects of a contrast increase included accelerated kinetics, decreased sensitivity, and a depolarization of the baseline membrane potential. Slow adaptation did not affect kinetics, but produced a gradual hyperpolarization. This hyperpolarization can account for slow adaptation in the spiking output of ganglion cells.

The dependence of binocular contrast sensitivities on binocular single vision in normal and amblyopic human subjects

We have measured monocular and binocular contrast sensitivities in response to medium to high spatial frequencies of vertical sinusoidal grating patterns in normal subjects, anisometropic amblyopes, strabismic amblyopes and non-amblyopic esotropes. On binocular viewing, contrast sensitivities were slightly but significantly increased in normal subjects, markedly increased in anisometropes and esotropes with anomalous binocular single vision (BSV) and significantly reduced in esotropes and exotropes without BSV. Application of a prismatic correction to the strabismic eye in order to achieve bifoveal stimulation resulted in a significant reduction in contrast sensitivity in esotropes with and without anomalous BSV, in exotropes and in non-amblyopic esotropes. Control experiments in normal subjects with monocular viewing showed that degradative effects of the prism occurred only with high prism powers and at high spatial frequencies, thus establishing that the reduced contrast sensitivities were the consequence of bifoveal stimulation rather than optical degradation. Displacement of the image of the grating pattern by 2 deg. in normal subjects and anisometropes by a dichoptic method to simulate a small angle esotropia had no effect on the contrast sensitivities recorded through the companion eye. By contrast, esotropes showed similar reductions in contrast sensitivity to those obtained with the prism experiments, confirming a fundamental difference between subjects with normal and abnormal ocular alignments. The results have thus established a suppressive action of the fovea of the amblyopic eye acting on the companion, non-amblyopic eye and indicate that correction of ocular misalignments in adult esotropes may be disadvantageous to binocular visual performance.

Thalamic relay functions and their role in corticocortical communication: generalizations from the visual system

All neocortical areas receive thalamic inputs. Some thalamocortical pathways relay information from ascending pathways (first order thalamic relays) and others relay information from other cortical areas (higher order thalamic relays), thus serving a role in corticocortical communication. Most, possibly all, afferents reaching thalamus, ascending and cortical, are branches of axons that innervate lower (motor) centers, so that thalamocortical pathways can be viewed generally as monitors of ongoing motor instructions. In terms of numbers, the thalamic relay is dominated by synapses that modulate the relay functions. One of the roles of these modulatory pathways is to change the transfer of information through the thalamus, in accord with current attentional demands. Other roles remain to be explored. These modulatory functions can be expected to act on corticocortical communication in addition to their action on ascending pathways.

Adaptation to temporal contrast in primate and salamander retina

Visual adaptation to temporal contrast (intensity modulation of a spatially uniform, randomly flickering stimulus) was examined in simultaneously recorded ensembles of retinal ganglion cells (RGCs) in tiger salamander and macaque monkey retina. Slow contrast adaptation similar to that recently discovered in salamander and rabbit retina was observed in monkey retina. A novel method was developed to quantify the effect of temporal contrast on steady-state sensitivity and kinetics of light responses, separately from nonlinearities that would otherwise significantly contaminate estimates of sensitivity. Increases in stimulus contrast progressively and reversibly attenuated and sped light responses in both salamander and monkey RGCs, indicating that a portion of the contrast adaptation observed in visual cortex originates in the retina. The effect of adaptation on sensitivity and kinetics differed in simultaneously recorded populations of ON and OFF cells. In salamander, adaptation affected the sensitivity of OFF cells more than ON cells. In monkey, adaptation affected the sensitivity of ON cells more than OFF cells. In both species, adaptation sped the light responses of OFF cells more than ON cells. Functionally defined subclasses of ON and OFF cells also exhibited asymmetric adaptation. These findings indicate that contrast adaptation differs in parallel retinal circuits that convey distinct visual signals to the brain.