The functional asymmetry of ON and OFF channels in the perception of contrast

Asymmetries between achromatic increments and decrements: Perceptual scales and discrimination thresholds

The perceptual response to achromatic incremental (A+) and decremental (A-) visual stimuli is known to be asymmetrical, due most likely to differences between ON and OFF channels. In the current study, we further investigated this asymmetry psychophysically. In Experiment 1, maximum likelihood difference scaling (MLDS) was used to estimate separately observers' perceptual scales for A+ and A-. In Experiment 2, observers performed two spatial alternative forced choice (2SAFC) pedestal discrimination on multiple pedestal contrast levels, using all combinations of A+ and A- pedestals and tests. Both experiments showed the well-known asymmetry. The perceptual scale curves of A+ follow a modified Naka-Rushton equation, whereas those of A- follow a cubic function. Correspondingly, the discrimination thresholds for the A+ pedestal increased monotonically with pedestal contrast, whereas the thresholds of the A- pedestal first increased as the pedestal contrast increased, then decreased as the contrast became higher. We propose a model that links the results of the two experiments, in which the pedestal discrimination threshold is inversely related to the derivative of the perceptual scale curve. Our findings generally agree with Whittle's previous findings (Whittle, 1986, 1992), which also included strong asymmetry between A+ and A-. We suggest that the perception of achromatic balanced incremental and decremental (bipolar) stimuli, such as gratings or flicker, might be dominated by one polarity due to this asymmetry under some conditions.

Serotonin increases population coding of behaviorally relevant stimuli by enhancing responses of ON but not OFF-type sensory neurons

How neural populations encode sensory input to generate behavioral responses remains a central problem in systems neuroscience. Here we investigated how neuromodulation influences population coding of behaviorally relevant stimuli to give rise to behavior in the electrosensory system of the weakly electric fish Apteronotus leptorhynchus. We performed multi-unit recordings from ON and OFF sensory pyramidal cells in response to stimuli whose amplitude (i.e., envelope) varied in time, before and after electrical stimulation of the raphe nuclei. Overall, raphe stimulation increased population coding by ON- but not by OFF-type cells, despite both cell types showing similar sensitivities to the stimulus at the single neuron level. Surprisingly, only changes in population coding by ON-type cells were correlated with changes in behavioral responses. Taken together, our results show that neuromodulation differentially affects ON vs. OFF-type cells in order to enhance perception of behaviorally relevant sensory input.

Faster Detection of "Darks" than "Brights" by Monkey Superior Colliculus Neurons

Visual processing is segregated into ON and OFF channels as early as in the retina, and the superficial (output) layers of the primary visual cortex (V1) are dominated by neurons preferring dark stimuli. However, it is not clear how the timing of neural processing differs between "darks" and "brights" in general, especially in light of psychophysical evidence; it is also equally not clear how subcortical visual pathways that are critical for active orienting represent stimuli of positive (luminance increments) and negative (luminance decrements) contrast polarity. Here, we recorded from all visually-responsive neuron types in the superior colliculus (SC) of two male rhesus macaque monkeys. We presented a disk (0.51° radius) within the response fields (RFs) of neurons, and we varied, across trials, stimulus Weber contrast relative to a gray background. We also varied contrast polarity. There was a large diversity of preferences for darks and brights across the population. However, regardless of individual neural sensitivity, most neurons responded significantly earlier to dark than bright stimuli. This resulted in a dissociation between neural preference and visual response onset latency: a neuron could exhibit a weaker response to a dark stimulus than to a bright stimulus of the same contrast, but it would still have an earlier response to the dark stimulus. Our results highlight an additional candidate visual neural pathway for explaining behavioral differences between the processing of darks and brights, and they demonstrate the importance of temporal aspects in the visual neural code for orienting eye movements.SIGNIFICANCE STATEMENT Objects in our environment, such as birds flying across a bright sky, often project shadows (or images darker than the surround) on our retina. We studied how primate superior colliculus (SC) neurons visually process such dark stimuli. We found that the overall population of SC neurons represented both dark and bright stimuli equally well, as evidenced by a relatively equal distribution of neurons that were either more or less sensitive to darks. However, independent of sensitivity, the great majority of neurons detected dark stimuli earlier than bright stimuli, evidenced by a smaller response latency for the dark stimuli. Thus, SC neural response latency can be dissociated from response sensitivity, and it favors the faster detection of dark image contrasts.

Regional Variation of Gap Junctional Connections in the Mammalian Inner Retina

The retinas of many species show regional specialisations that are evident in the differences in the processing of visual input from different parts of the visual field. Regional specialisation is thought to reflect an adaptation to the natural visual environment, optical constraints, and lifestyle of the species. Yet, little is known about regional differences in synaptic circuitry. Here, we were interested in the topographical distribution of connexin-36 (Cx36), the major constituent of electrical synapses in the retina. We compared the retinas of mice, rats, and cats to include species with different patterns of regional specialisations in the analysis. First, we used the density of Prox1-immunoreactive amacrine cells as a marker of any regional specialisation, with higher cell density signifying more central regions. Double-labelling experiments showed that Prox1 is expressed in AII amacrine cells in all three species. Interestingly, large Cx36 plaques were attached to about 8-10% of Prox1-positive amacrine cell somata, suggesting the strong electrical coupling of pairs or small clusters of cell bodies. When analysing the regional changes in the volumetric density of Cx36-immunoreactive plaques, we found a tight correlation with the density of Prox1-expressing amacrine cells in the ON, but not in the OFF sublamina in all three species. The results suggest that the relative contribution of electrical synapses to the ON- and OFF-pathways of the retina changes with retinal location, which may contribute to functional ON/OFF asymmetries across the visual field.

Stimulus Contrast Affects Spatial Integration in the Lateral Geniculate Nucleus of Macaque Monkeys

Gain-control mechanisms adjust neuronal responses to accommodate the wide range of stimulus conditions in the natural environment. Contrast gain control and extraclassical surround suppression are two manifestations of gain control that govern the responses of neurons in the early visual system. Understanding how these two forms of gain control interact has important implications for the detection and discrimination of stimuli across a range of contrast conditions. Here, we report that stimulus contrast affects spatial integration in the lateral geniculate nucleus of alert macaque monkeys (male and female), whereby neurons exhibit a reduction in the strength of extraclassical surround suppression and an expansion in the preferred stimulus size with low-contrast stimuli compared with high-contrast stimuli. Effects were greater for magnocellular neurons than for parvocellular neurons, indicating stream-specific interactions between stimulus contrast and stimulus size. Within the magnocellular pathway, contrast-dependent effects were comparable for ON-center and OFF-center neurons, despite ON neurons having larger receptive fields, less pronounced surround suppression, and more pronounced contrast gain control than OFF neurons. Together, these findings suggest that the parallel streams delivering visual information from retina to primary visual cortex, serve not only to broaden the range of signals delivered to cortex, but also to provide a substrate for differential interactions between stimulus contrast and stimulus size that may serve to improve stimulus detection and stimulus discrimination under pathway-specific lower and higher contrast conditions, respectively.SIGNIFICANCE STATEMENT Stimulus contrast is a salient feature of visual scenes. Here we examine the influence of stimulus contrast on spatial integration in the lateral geniculate nucleus (LGN). Our results demonstrate that increases in contrast generally increase extraclassical suppression and decrease the size of optimal stimuli, indicating a reduction in the extent of visual space from which LGN neurons integrate signals. Differences between magnocellular and parvocellular neurons are noteworthy and further demonstrate that the feedforward parallel pathways to cortex increase the range of information conveyed for downstream cortical processing, a range broadened by diversity in the ON and OFF pathways. These results have important implications for more complex visual processing that underly the detection and discrimination of stimuli under varying natural conditions.

Synergistic population coding of natural communication stimuli by hindbrain electrosensory neurons

Understanding how neural populations encode natural stimuli with complex spatiotemporal structure to give rise to perception remains a central problem in neuroscience. Here we investigated population coding of natural communication stimuli by hindbrain neurons within the electrosensory system of weakly electric fish Apteronotus leptorhynchus. Overall, we found that simultaneously recorded neural activities were correlated: signal but not noise correlations were variable depending on the stimulus waveform as well as the distance between neurons. Combining the neural activities using an equal-weight sum gave rise to discrimination performance between different stimulus waveforms that was limited by redundancy introduced by noise correlations. However, using an evolutionary algorithm to assign different weights to individual neurons before combining their activities (i.e., a weighted sum) gave rise to increased discrimination performance by revealing synergistic interactions between neural activities. Our results thus demonstrate that correlations between the neural activities of hindbrain electrosensory neurons can enhance information about the structure of natural communication stimuli that allow for reliable discrimination between different waveforms by downstream brain areas.

Assessment of optogenetically-driven strategies for prosthetic restoration of cortical vision in large-scale neural simulation of V1

The neural encoding of visual features in primary visual cortex (V1) is well understood, with strong correlates to low-level perception, making V1 a strong candidate for vision restoration through neuroprosthetics. However, the functional relevance of neural dynamics evoked through external stimulation directly imposed at the cortical level is poorly understood. Furthermore, protocols for designing cortical stimulation patterns that would induce a naturalistic perception of the encoded stimuli have not yet been established. Here, we demonstrate a proof of concept by solving these issues through a computational model, combining (1) a large-scale spiking neural network model of cat V1 and (2) a virtual prosthetic system transcoding the visual input into tailored light-stimulation patterns which drive in situ the optogenetically modified cortical tissue. Using such virtual experiments, we design a protocol for translating simple Fourier contrasted stimuli (gratings) into activation patterns of the optogenetic matrix stimulator. We then quantify the relationship between spatial configuration of the imposed light pattern and the induced cortical activity. Our simulations in the absence of visual drive (simulated blindness) show that optogenetic stimulation with a spatial resolution as low as 100 [Formula: see text]m, and light intensity as weak as [Formula: see text] photons/s/cm[Formula: see text] is sufficient to evoke activity patterns in V1 close to those evoked by normal vision.

Dynamics of Contrast Decrement and Increment Responses in Human Visual Cortex

Purpose

The goal of the present experiments was to determine whether electrophysiologic response properties of the ON and OFF visual pathways observed in animal experimental models can be observed in humans.

Methods

Steady-state visual evoked potentials (SSVEPs) were recorded in response to equivalent magnitude contrast increments and decrements presented within a probe-on-pedestal Westheimer sensitization paradigm. The probes were modulated with sawtooth temporal waveforms at a temporal frequency of 3 or 2.73 Hz. SSVEP response waveforms and response spectra for incremental and decremental stimuli were analyzed as a function of stimulus size and visual field location in 67 healthy adult participants.

Results

SSVEPs recorded at the scalp differ between contrast decrements and increments of equal Weber contrast: SSVEP responses were larger in amplitude and shorter in latency for contrast decrements than for contrast increments. Both increment and decrement responses were larger for displays that were scaled for cortical magnification.

Conclusions

In a fashion that parallels results from the early visual system of cats and monkeys, two key properties of ON versus OFF pathways found in single-unit recordings are recapitulated at the population level of activity that can be observed with scalp electrodes, allowing differential assessment of ON and OFF pathway activity in human.

Translational Relevance

As data from preclinical models of visual pathway dysfunction point to differential damage to subtypes of retinal ganglion cells, this approach may be useful in future work on disease detection and treatment monitoring.

Information processing in the LGN: a comparison of neural codes and cell types

To understand how anatomy and physiology allow an organism to perform its function, it is important to know how information that is transmitted by spikes in the brain is received and encoded. A natural question is whether the spike rate alone encodes the information about a stimulus (rate code), or additional information is contained in the temporal pattern of the spikes (temporal code). Here we address this question using data from the cat Lateral Geniculate Nucleus (LGN), which is the visual portion of the thalamus, through which visual information from the retina is communicated to the visual cortex. We analyzed the responses of LGN neurons to spatially homogeneous spots of various sizes with temporally random luminance modulation. We compared the Firing Rate with the Shannon Information Transmission Rate , which quantifies the information contained in the temporal relationships between spikes. We found that the behavior of these two rates can differ quantitatively. This suggests that the energy used for spiking does not translate directly into the information to be transmitted. We also compared Firing Rates with Information Rates for X-ON and X-OFF cells. We found that, for X-ON cells the Firing Rate and Information Rate often behave in a completely different way, while for X-OFF cells these rates are much more highly correlated. Our results suggest that for X-ON cells a more efficient "temporal code" is employed, while for X-OFF cells a straightforward "rate code" is used, which is more reliable and is correlated with energy consumption.

The psychophysics of stereopsis can be explained without invoking independent ON and OFF channels

Early vision proceeds through distinct ON and OFF channels, which encode luminance increments and decrements respectively. It has been argued that these channels also contribute separately to stereoscopic vision. This is based on the fact that observers perform better on a noisy disparity discrimination task when the stimulus is a random-dot pattern consisting of equal numbers of black and white dots (a “mixed-polarity stimulus,” argued to activate both ON and OFF stereo channels), than when it consists of all-white or all-black dots (“same-polarity,” argued to activate only one). However, it is not clear how this theory can be reconciled with our current understanding of disparity encoding. Recently, a binocular convolutional neural network was able to replicate the mixed-polarity advantage shown by human observers, even though it was based on linear filters and contained no mechanisms which would respond separately to black or white dots. Here, we show that a subtle feature of the way the stimuli were constructed in all these experiments can explain the results. The interocular correlation between left and right images is actually lower for the same-polarity stimuli than for mixed-polarity stimuli with the same amount of disparity noise applied to the dots. Because our current theories suggest stereopsis is based on a correlation-like computation in primary visual cortex, this postulate can explain why performance was better for the mixed-polarity stimuli. We conclude that there is currently no evidence supporting separate ON and OFF channels in stereopsis.

The mixed-polarity benefit of stereopsis arises in early visual cortex

Depth perception is better when observers view stimuli containing a mixture of bright and dark visual features. It is currently unclear where in the visual system sensory processing benefits from the availability of different contrast polarity. To address this question, we applied transcranial magnetic stimulation to the visual cortex to modulate normal neural activity during processing of single- or mixed-polarity random-dot stereograms. In line with previous work, participants gave significantly better depth judgments for mixed-polarity stimuli. Stimulation of early visual cortex (V1/V2) significantly increased this benefit for mixed-polarity stimuli, and it did not affect performance for single-polarity stimuli. Stimulation of disparity responsive areas V3a and LO had no effect on perception. Our findings show that disparity processing in early visual cortex gives rise to the mixed-polarity benefit. This is consistent with computational models of stereopsis at the level of V1 that produce a mixed polarity benefit.

Pathway-Specific Asymmetries between ON and OFF Visual Signals

Visual processing is largely organized into ON and OFF pathways that signal stimulus increments and decrements, respectively. These pathways exhibit natural pairings based on morphological and physiological similarities, such as ON and OFF α-ganglion cells in the mammalian retina. Several studies have noted asymmetries in the properties of ON and OFF pathways. For example, the spatial receptive fields (RFs) of OFF α-cells are systematically smaller than ON α-cells. Analysis of natural scenes suggests that these asymmetries are optimal for visual encoding. To test the generality of ON/OFF asymmetries, we measured the spatiotemporal RF properties of multiple RGC types in rat retina. Through a quantitative and serial classification, we identified three functional pairs of ON and OFF RGCs. We analyzed the structure of their RFs and compared spatial integration, temporal integration, and gain across ON and OFF pairs. Similar to previous results from the cat and primate, RGC types with larger spatial RFs exhibited briefer temporal integration and higher gain. However, each pair of ON and OFF RGC types exhibited distinct asymmetric relationships between RF properties, some of which were opposite to the findings of previous reports. These results reveal the functional organization of six RGC types in the rodent retina and indicate that ON/OFF asymmetries are pathway specific.SIGNIFICANCE STATEMENT Circuits that process sensory input frequently process increments separately from decrements, so-called ON and OFF responses. Theoretical studies indicate that this separation, and associated asymmetries in ON and OFF pathways, may be beneficial for encoding natural stimuli. However, the generality of ON and OFF pathway asymmetries has not been tested. Here we compare the functional properties of three distinct pairs of ON and OFF pathways in the rodent retina and show that their asymmetries are pathway specific. These results provide a new view on the partitioning of vision across diverse ON and OFF signaling pathways.

A Novel Display System Reveals Anisotropic Polarization Perception in the Motion Vision of the Butterfly Papilio xuthus

While the linear polarization of light is virtually invisible to humans, many invertebrates' eyes can detect it. How this information is processed in the nervous system, and what behavioral function it serves, are in many cases unclear. One reason for this is the technical difficulty involved in presenting images or video containing polarization contrast, particularly if intensity and/or color contrast is also required. In this primarily methods-focused article, we present a novel technique based on projecting video through a synchronously rotating linear polarizer. This approach allows the intensity, angle of polarization, degree of linear polarization, and potentially also color of individual pixels to be controlled independently. We characterize the performance of our system, and then use it to investigate the relationship between polarization and motion vision in the swallowtail butterfly Papilio xuthus. Although this animal has photoreceptors sensitive to four different polarization angles, we find that its motion vision cannot distinguish between diagonally-polarized and unpolarized light. Furthermore, it responds more strongly to vertically-polarized moving objects than horizontally-polarized ones. This implies that Papilio's polarization-based motion detection employs either an unbalanced two-channel (dipolatic) opponent architecture, or possibly a single-channel (monopolatic) scheme without opponent mechanisms.

A normalized contrast-encoding model exhibits bright/dark asymmetries similar to early visual neurons

Biological sensory systems share a number of organizing principles. One such principle is the formation of parallel streams. In the visual system, information about bright and dark features is largely conveyed via two separate streams: the ON and OFF pathways. While brightness and darkness can be considered symmetric and opposite forms of visual contrast, the response properties of cells in the ON and OFF pathways are decidedly asymmetric. Here, we ask whether a simple contrast‐encoding model predicts asymmetries for brights and darks that are similar to the asymmetries found in the ON and OFF pathways. Importantly, this model does not include any explicit differences in how the visual system represents brights and darks, but it does include a common normalization mechanism. The phenomena captured by the model include (1) nonlinear contrast response functions, (2) greater nonlinearities in the responses to darks, and (3) larger responses to dark contrasts. We report a direct, quantitative comparison between these model predictions and previously published electrophysiological measurements from the retina and thalamus (guinea pig and cat, respectively). This work suggests that the simple computation of visual contrast may account for a range of early visual processing nonlinearities. Assessing explicit models of sensory representations is essential for understanding which features of neuronal activity these models can and cannot predict, and for investigating how early computations may reverberate through the sensory pathways.