Neuronal and perceptual differences in the temporal processing of darks and lights

Binocular receptive-field construction in the primary visual cortex

ON and OFF thalamic afferents from the two eyes converge in the primary visual cortex to form binocular receptive fields. The receptive fields need to be diverse to sample our visual world but also similar across eyes to achieve binocular fusion. It is currently unknown how the cortex balances these competing needs between receptive-field diversity and similarity. Our results demonstrate that receptive fields in the cat visual cortex are binocularly matched with exquisite precision for retinotopy, orientation/direction preference, orientation/direction selectivity, response latency, and ON-OFF polarity/structure. Specifically, the average binocular mismatches in retinotopy and ON-OFF structure are tightly restricted to 1/20 and 1/5 of the average receptive-field size but are still large enough to generate all types of binocular disparity tuning. Based on these results, we conclude that cortical receptive fields are binocularly matched with the high precision needed to facilitate binocular fusion while allowing restricted mismatches to process visual depth.

Optimizing Visual Stimulation Paradigms for User-Friendly SSVEP-Based BCIs

In steady-state visual evoked potential (SSVEP)-based brain-computer interface (BCI) systems, traditional flickering stimulation patterns face challenges in achieving a trade-off in both BCI performance and visual comfort across various frequency bands. To investigate the optimal stimulation paradigms with high performance and high comfort for each frequency band, this study systematically compared the characteristics of SSVEP and user experience of different stimulation paradigms with a wide stimulation frequency range of 1-60 Hz. The findings suggest that, for a better balance between system performance and user experience, ON and OFF grid stimuli with a Weber contrast of 50% can be utilized as alternatives to traditional flickering stimulation paradigms in the frequency band of 1-25 Hz. In the 25-35 Hz range, uniform flicker stimuli with the same 50% contrast are more suitable. In the higher frequency band, traditional uniform flicker stimuli with a high 300% contrast are preferred. These results are significant for developing high performance and user-friendly SSVEP-based BCI systems.

Contrast Sensitivity of ON and OFF Human Retinal Pathways in Myopia

The human visual cortex processes light and dark stimuli with ON and OFF pathways that are differently modulated by luminance contrast. We have previously demonstrated that ON cortical pathways have higher contrast sensitivity than OFF cortical pathways and the difference increases with luminance range (defined as the maximum minus minimum luminance in the scene). Here, we demonstrate that these ON-OFF cortical differences are already present in the human retina and that retinal responses measured with electroretinography are more affected by reductions in luminance range than cortical responses measured with electroencephalography. Moreover, we show that ON-OFF pathway differences measured with electroretinography become more pronounced in myopia, a visual disorder that elongates the eye and blurs vision at far distance. We find that, as the eye axial length increases across subjects, ON retinal pathways become less responsive, slower in response latency, less sensitive, and less effective and slower at driving pupil constriction. Based on these results, we conclude that myopia is associated with a deficit in ON pathway function that decreases the ability of the retina to process low contrast and regulate retinal illuminance in bright environments.

Asymmetric stimulus representations bias visual perceptual learning

The primate visual cortex contains various regions that exhibit specialization for different stimulus properties, such as motion, shape, and color. Within each region, there is often further specialization, such that particular stimulus features, such as horizontal and vertical orientations, are over-represented. These asymmetries are associated with well-known perceptual biases, but little is known about how they influence visual learning. Most theories would predict that learning is optimal, in the sense that it is unaffected by these asymmetries. However, other approaches to learning would result in specific patterns of perceptual biases. To distinguish between these possibilities, we trained human observers to discriminate between expanding and contracting motion patterns, which have a highly asymmetrical representation in the visual cortex. Observers exhibited biased percepts of these stimuli, and these biases were affected by training in ways that were often suboptimal. We simulated different neural network models and found that a learning rule that involved only adjustments to decision criteria, rather than connection weights, could account for our data. These results suggest that cortical asymmetries influence visual perception and that human observers often rely on suboptimal strategies for learning.

Dynamic Recruitment of the Feedforward and Recurrent Mechanism for Black-White Asymmetry in the Primary Visual Cortex

Black and white information is asymmetrically distributed in natural scenes, evokes asymmetric neuronal responses, and causes asymmetric perceptions. Recognizing the universality and essentiality of black-white asymmetry in visual information processing, the neural substrates for black-white asymmetry remain unclear. To disentangle the role of the feedforward and recurrent mechanisms in the generation of cortical black-white asymmetry, we recorded the V1 laminar responses and LGN responses of anesthetized cats of both sexes. In a cortical column, we found that black-white asymmetry starts at the input layer and becomes more pronounced in the output layer. We also found distinct dynamics of black-white asymmetry between the output layer and the input layer. Specifically, black responses dominate in all layers after stimulus onset. After stimulus offset, black and white responses are balanced in the input layer, but black responses still dominate in the output layer. Compared with that in the input layer, the rebound response in the output layer is significantly suppressed. The relative suppression strength evoked by white stimuli is notably stronger and depends on the location within the ON-OFF cortical map. A model with delayed and polarity-selective cortical suppression explains black-white asymmetry in the output layer, within which prominent recurrent connections are identified by Granger causality analysis. In addition to black-white asymmetry in response strength, the interlaminar differences in spatial receptive field varied dynamically. Our findings suggest that the feedforward and recurrent mechanisms are dynamically recruited for the generation of black-white asymmetry in V1.SIGNIFICANCE STATEMENT Black-white asymmetry is universal and essential in visual information processing, yet the neural substrates for cortical black-white asymmetry remain unknown. Leveraging V1 laminar recordings, we provided the first laminar pattern of black-white asymmetry in cat V1 and found distinct dynamics of black-white asymmetry between the output layer and the input layer. Comparing black-white asymmetry across three visual hierarchies, the LGN, V1 input layer, and V1 output layer, we demonstrated that the feedforward and recurrent mechanisms are dynamically recruited for the generation of cortical black-white asymmetry. Our findings not only enhance our understanding of laminar processing within a cortical column but also elucidate how feedforward connections and recurrent connections interact to shape neuronal response properties.

Differences in visual stimulation between reading and walking and implications for myopia development

Visual input plays an important role in the development of myopia (nearsightedness), a visual disorder that blurs vision at far distances. The risk of myopia progression increases with the time spent reading and decreases with outdoor activity for reasons that remain poorly understood. To investigate the stimulus parameters driving this disorder, we compared the visual input to the retina of humans performing two tasks associated with different risks of myopia progression, reading and walking. Human subjects performed the two tasks while wearing glasses with cameras and sensors that recorded visual scenes and visuomotor activity. When compared with walking, reading black text in white background reduced spatiotemporal contrast in central vision and increased it in peripheral vision, leading to a pronounced reduction in the ratio of central/peripheral strength of visual stimulation. It also made the luminance distribution heavily skewed toward negative dark contrast in central vision and positive light contrast in peripheral vision, decreasing the central/peripheral stimulation ratio of ON visual pathways. It also decreased fixation distance, blink rate, pupil size, and head-eye coordination reflexes dominated by ON pathways. Taken together with previous work, these results support the hypothesis that reading drives myopia progression by understimulating ON visual pathways.

Contrast Increment and Decrement Processing in Individuals With and Without Diabetes

Purpose

Animal models suggest that ON retinal ganglion cells (RGCs) may be more vulnerable to diabetic insult than OFF cells. Using three psychophysical tasks to infer the function of ON and OFF RGCs, we hypothesized that functional responses to contrast increments will be preferentially affected in early diabetes mellitus (DM) compared to contrast decrement responses.

Methods

Fifty-two people with DM (type 1 or type 2) (mean age = 34.8 years, range = 18-60 years) and 48 age-matched controls (mean age = 35.4 years, range = 18-60 years) participated. Experiment 1 measured contrast sensitivity to increments and decrements at four visual field locations. Experiments 2 and 3 measured visual temporal processing using (i) a response time (RT) task, and (ii) a temporal order judgment task. Mean RT and accuracy were collected for experiment 2, whereas experiment 3 measured temporal thresholds.

Results

For experiment 1, the DM group showed reduced increment and decrement contrast sensitivity (F (1, 97) = 4.04, P = 0.047) especially for the central location. For experiment 2, those with DM demonstrated slower RT and lower response accuracies to increments and decrements (increments: U = 780, P = 0.01, decrements: U = 749, P = 0.005). For experiment 3, performance was similar between groups (F (1, 91) = 2.52, P = 0.137).

Conclusions

When assessed cross-sectionally, nonselective functional consequences of retinal neuron damage are present in early DM, particularly for foveal testing. Whether increment-decrement functional indices relate to diabetic retinopathy (DR) progression or poorer visual prognosis in DM requires further study.

Model-Based Approach Shows ON Pathway Afferents Elicit a Transient Decrease of V1 Responses

Neurons in the primary visual cortex (V1) receive excitation and inhibition from distinct parallel pathways processing lightness (ON) and darkness (OFF). V1 neurons overall respond more strongly to dark than light stimuli, consistent with a preponderance of darker regions in natural images, as well as human psychophysics. However, it has been unclear whether this "dark-dominance" is because of more excitation from the OFF pathway or more inhibition from the ON pathway. To understand the mechanisms behind dark-dominance, we record electrophysiological responses of individual simple-type V1 neurons to natural image stimuli and then train biologically inspired convolutional neural networks to predict the neurons' responses. Analyzing a sample of 71 neurons (in anesthetized, paralyzed cats of either sex) has revealed their responses to be more driven by dark than light stimuli, consistent with previous investigations. We show that this asymmetry is predominantly because of slower inhibition to dark stimuli rather than to stronger excitation from the thalamocortical OFF pathway. Consistent with dark-dominant neurons having faster responses than light-dominant neurons, we find dark-dominance to solely occur in the early latencies of neurons' responses. Neurons that are strongly dark-dominated also tend to be less orientation-selective. This novel approach gives us new insight into the dark-dominance phenomenon and provides an avenue to address new questions about excitatory and inhibitory integration in cortical neurons.SIGNIFICANCE STATEMENT Neurons in the early visual cortex respond on average more strongly to dark than to light stimuli, but the mechanisms behind this bias have been unclear. Here we address this issue by combining single-unit electrophysiology with a novel machine learning model to analyze neurons' responses to natural image stimuli in primary visual cortex. Using these techniques, we find slower inhibition to light than to dark stimuli to be the leading mechanism behind stronger dark responses. This slower inhibition to light might help explain other empirical findings, such as why orientation selectivity is weaker at earlier response latencies. These results demonstrate how imbalances in excitation versus inhibition can give rise to response asymmetries in cortical neuron responses.

Tablet-based 'ON/OFF' pathway test can distinguish between rod- and cone-dominated diseases

INTRODUCTION

The photopic ON pathway defect is associated with nocturnal vision loss. However, the measurement of ON function to detect a rod-dominated disease (rods affected more than cones) has not been explored. We evaluated whether the psychophysical evaluation of ON/OFF pathways can be used to distinguish cone-dominated from rod-dominated diseases.

METHODS

Thirty-seven patients with inherited retinal diseases were tested using the 'EyeSpeed' [iOS application] on an iPad. The test displayed a random number (1-3) of light or dark targets on a black-and-white noise background. Participants responded on a touch screen indicating the correct number of targets displayed. The outcome variables-reaction time, accuracy and performance index (speed [1/reaction time] * accuracy) to both light and dark targets were assessed for diagnostic ability using standard receiver-operating characteristic (ROC) analysis.

RESULTS

Mean ± standard deviation age and visual acuity for the cone- and rod-dominated groups were 25.15 ± 11.74 years, 0.80 ± 0.25 logMAR and 28.3 ± 14.29 years, 0.48 ± 0.26 logMAR, respectively. The median reaction time to light targets in rod-dominated disease [interquartile range] was 5.28 s [3.17], significantly greater than for patients with cone-dominated disease (2.07 s [0.93]; Mann-Whitney U test, p < 0.001). Amongst all of the outcome variables evaluated, the reaction time to light targets (criterion of ≥2.98 s) exhibited the highest area under the ROC curve (area = 0.89 ± 0.11; p < 0.001), with a sensitivity and specificity of 82.4% and 85% respectively.

CONCLUSIONS

Reaction time to light targets using the ON/OFF pathway paradigm is a valid marker to differentiate between rod- and cone-dominated retinal dystrophies. ON pathway function measured using a tablet-based test could act as a supplemental test in the diagnosis of challenging photoreceptor-specific inherited retinal diseases.

Luminance Contrast Shifts Dominance Balance between ON and OFF Pathways in Human Vision

Human vision processes light and dark stimuli in visual scenes with separate ON and OFF neuronal pathways. In nature, stimuli lighter or darker than their local surround have different spatial properties and contrast distributions (Ratliff et al., 2010; Cooper and Norcia, 2015; Rahimi-Nasrabadi et al., 2021). Similarly, in human vision, we show that luminance contrast affects the perception of lights and darks differently. At high contrast, human subjects of both sexes locate dark stimuli faster and more accurately than light stimuli, which is consistent with a visual system dominated by the OFF pathway. However, at low contrast, they locate light stimuli faster and more accurately than dark stimuli, which is consistent with a visual system dominated by the ON pathway. Luminance contrast was strongly correlated with multiple ON/OFF dominance ratios estimated from light/dark ratios of performance errors, missed targets, or reaction times (RTs). All correlations could be demonstrated at multiple eccentricities of the central visual field with an ON-OFF perimetry test implemented in a head-mounted visual display. We conclude that high-contrast stimuli are processed faster and more accurately by OFF pathways than ON pathways. However, the OFF dominance shifts toward ON dominance when stimulus contrast decreases, as expected from the higher-contrast sensitivity of ON cortical pathways (Kremkow et al., 2014; Rahimi-Nasrabadi et al., 2021). The results highlight the importance of contrast polarity in visual field measurements and predict a loss of low-contrast vision in humans with ON pathway deficits, as demonstrated in animal models (Sarnaik et al., 2014).SIGNIFICANCE STATEMENT ON and OFF retino-thalamo-cortical pathways respond differently to luminance contrast. In both animal models and humans, low contrasts drive stronger responses from ON pathways, whereas high contrasts drive stronger responses from OFF pathways. We demonstrate that these ON-OFF pathway differences have a correlate in human vision. At low contrast, humans locate light targets faster and more accurately than dark targets but, as contrast increases, dark targets become more visible than light targets. We also demonstrate that contrast is strongly correlated with multiple light/dark ratios of visual performance in central vision. These results provide a link between neuronal physiology and human vision while emphasizing the importance of stimulus polarity in measurements of visual fields and contrast sensitivity.

Contribution of parasol-magnocellular pathway ganglion cells to foveal retina in macaque monkey

Parasol-magnocellular pathway ganglion cells form an important output stream of the primate retina and make a major contribution to visual motion detection. They are known to comprise ON and OFF type response polarities but the relative numbers of ON and OFF parasol cells, and the overall contribution of parasol cells to high-acuity foveal vision are not well understood. Here we use antibodies against carbonic anhydrase 8 (CA8) and intracellular injections of the liphilic dye DiI to show that CA8 selectively labels OFF parasol cells in macaque retina. By combined labeling with CA8 antibodies and a previously-described marker for parasol cells (GABA_A receptor antibodies), we show that ON and OFF parasol cells each comprise ∼ 6% of all ganglion cells in central retina (each peak density ∼ 3000 cells/mm² at 5 deg.), and each population comprises ∼ 10% of all ganglion cells in peripheral temporal retina. Thus, the spatial density of parasol cells in central retina is greater than reported by previous anatomical studies, and the central-peripheral gradient in parasol cell density is shallower than previously reported. The data nevertheless predict decline in spatial acuity with visual field eccentricity for both midget-parvocellular pathway and parasol-magnocellular pathway mediated visual functions. The spatial resolving power of the OFF parasol array (peak ∼ 7 cpd) falls short of macaque behavioral grating acuity by at least a factor of three throughout the retina.

Faster Detection of "Darks" than "Brights" by Monkey Superior Colliculus Neurons

Visual processing is segregated into ON and OFF channels as early as in the retina, and the superficial (output) layers of the primary visual cortex (V1) are dominated by neurons preferring dark stimuli. However, it is not clear how the timing of neural processing differs between "darks" and "brights" in general, especially in light of psychophysical evidence; it is also equally not clear how subcortical visual pathways that are critical for active orienting represent stimuli of positive (luminance increments) and negative (luminance decrements) contrast polarity. Here, we recorded from all visually-responsive neuron types in the superior colliculus (SC) of two male rhesus macaque monkeys. We presented a disk (0.51° radius) within the response fields (RFs) of neurons, and we varied, across trials, stimulus Weber contrast relative to a gray background. We also varied contrast polarity. There was a large diversity of preferences for darks and brights across the population. However, regardless of individual neural sensitivity, most neurons responded significantly earlier to dark than bright stimuli. This resulted in a dissociation between neural preference and visual response onset latency: a neuron could exhibit a weaker response to a dark stimulus than to a bright stimulus of the same contrast, but it would still have an earlier response to the dark stimulus. Our results highlight an additional candidate visual neural pathway for explaining behavioral differences between the processing of darks and brights, and they demonstrate the importance of temporal aspects in the visual neural code for orienting eye movements.SIGNIFICANCE STATEMENT Objects in our environment, such as birds flying across a bright sky, often project shadows (or images darker than the surround) on our retina. We studied how primate superior colliculus (SC) neurons visually process such dark stimuli. We found that the overall population of SC neurons represented both dark and bright stimuli equally well, as evidenced by a relatively equal distribution of neurons that were either more or less sensitive to darks. However, independent of sensitivity, the great majority of neurons detected dark stimuli earlier than bright stimuli, evidenced by a smaller response latency for the dark stimuli. Thus, SC neural response latency can be dissociated from response sensitivity, and it favors the faster detection of dark image contrasts.

Efficient processing of natural scenes in visual cortex

Neural circuits in the periphery of the visual, auditory, and olfactory systems are believed to use limited resources efficiently to represent sensory information by adapting to the statistical structure of the natural environment. This "efficient coding" principle has been used to explain many aspects of early visual circuits including the distribution of photoreceptors, the mosaic geometry and center-surround structure of retinal receptive fields, the excess OFF pathways relative to ON pathways, saccade statistics, and the structure of simple cell receptive fields in V1. We know less about the extent to which such adaptations may occur in deeper areas of cortex beyond V1. We thus review recent developments showing that the perception of visual textures, which depends on processing in V2 and beyond in mammals, is adapted in rats and humans to the multi-point statistics of luminance in natural scenes. These results suggest that central circuits in the visual brain are adapted for seeing key aspects of natural scenes. We conclude by discussing how adaptation to natural temporal statistics may aid in learning and representing visual objects, and propose two challenges for the future: (1) explaining the distribution of shape sensitivity in the ventral visual stream from the statistics of object shape in natural images, and (2) explaining cell types of the vertebrate retina in terms of feature detectors that are adapted to the spatio-temporal structures of natural stimuli. We also discuss how new methods based on machine learning may complement the normative, principles-based approach to theoretical neuroscience.

Preferential Loss of Contrast Decrement Responses in Human Glaucoma

Purpose

The purpose of this study was to determine whether glaucoma in human patients produces preferential damage to OFF visual pathways, as suggested by animal experimental models, patient electroretinogram (ERG), and retinal imaging data.

Methods

Steady-state visual evoked potentials (SSVEPs) were recorded monocularly from 50 patients with glaucoma and 28 age-similar controls in response to equal Weber contrast increments and decrements presented using 2.73 hertz (Hz) sawtooth temporal waveforms.

Results

The eyes of patients with glaucoma were separated into mild (better than -6 decibel [dB] mean deviation; n = 28) and moderate to severe (worse than -6 dB mean deviation, n = 22) groups based on their Humphrey 24-2 visual field measurements. Response amplitudes and phases from the two glaucoma-severity groups were compared to controls at the group level. SSVEP amplitudes were depressed in both glaucoma groups, more so in the moderate to severe glaucoma group. The differences between controls and the moderate-severe glaucoma groups were more statistically reliable for decrements than for increments. Mean responses to decremental sawtooth stimuli were larger than those to increments in controls and in the mild glaucoma but not in the moderate to severe glaucoma group at the first harmonic. OFF/decrement responses at the first harmonic were faster in controls, but not in patients.

Conclusions

The observed pattern of preferential loss of decremental responses in human glaucoma is consistent with prior reports of selective damage to OFF retinal ganglion cells in murine models and in data from human ERG and retinal imaging. These data motivate pursuit of SSVEP as a biomarker for glaucoma progression.

Cortical mechanisms of visual brightness

The primary visual cortex signals the onset of light and dark stimuli with ON and OFF cortical pathways. Here, we demonstrate that both pathways generate similar response increments to large homogeneous surfaces and their response average increases with surface brightness. We show that, in cat visual cortex, response dominance from ON or OFF pathways is bimodally distributed when stimuli are smaller than one receptive field center but unimodally distributed when they are larger. Moreover, whereas small bright stimuli drive opposite responses from ON and OFF pathways (increased versus suppressed activity), large bright surfaces drive similar response increments. We show that this size-brightness relation emerges because strong illumination increases the size of light surfaces in nature and both ON and OFF cortical neurons receive input from ON thalamic pathways. We conclude that visual scenes are perceived as brighter when the average response increments from ON and OFF cortical pathways become stronger.

Mazade et al. find that the visual cortex encodes brightness differently for small than large stimuli. Bright small stimuli drive cortical pathways signaling lights and suppress cortical pathways signaling darks. Conversely, large surfaces drive response increments from both pathways and appear brightest when the response average is strongest.

A model for the development of binocular congruence in primary visual cortex

Neurons in primary visual cortex are selective for stimulus orientation, and a neuron's preferred orientation changes little when the stimulus is switched from one eye to the other. It has recently been shown that monocular orientation preferences are uncorrelated before eye opening; how, then, do they become aligned during visual experience? We aimed to provide a model for this acquired congruence. Our model, which simulates the cat's visual system, comprises multiple on-centre and off-centre channels from both eyes converging onto neurons in primary visual cortex; development proceeds in two phases via Hebbian plasticity in the geniculocortical synapse. First, cortical drive comes from waves of activity drifting across each retina. The result is orientation tuning that differs between the two eyes. The second phase begins with eye opening: at each visual field location, on-centre cortical inputs from one eye can cancel off-centre inputs from the other eye. Synaptic plasticity reduces the destructive interference by up-regulating inputs from one eye at the expense of its fellow, resulting in binocular congruence of orientation tuning. We also show that orthogonal orientation preferences at the end of the first phase result in ocular dominance, suggesting that ocular dominance is a by-product of binocular congruence.

Age-related decline in function of ON and OFF visual pathways

Purpose

A simple psychophysical paradigm is available as a digital application in iOS devices such as iPad to measure the function of ON and OFF visual pathways. However, an age-matched normative database is not readily available. The purpose of the study is to evaluate the response of ON and OFF visual pathways as a function of age.

Methods

158 normal healthy adults (84 males and 74 females) whose age ranged 18–80 years participated in the study. None of them had any ocular disease (except cataract of grade II or less) and visual acuity of ≤ 20/25. Monocular testing (only one eye) was performed on the ‘EyeSpeed’ application on an iPad at 40cm distance. The targets ranged between 1 to 3 light or dark squares presented randomly in a noise background and participants responded by indicating the number of squares by touching the screen as fast as possible. The main outcome variables are reaction time, accuracy and performance index (1 / speed * accuracy).

Results

The median reaction time was shorter (Median (IQR): 1.53s (0.49) [dark] Vs 1.76s (0.58) [light], p < 0.001) and accuracy was higher (97.21% (3.30) [dark] Vs 95.15% (5.10) [light], p < 0.001) for dark targets than the light targets. Performance index and reaction time for both target types significantly correlated with age (ρ = -0.41 to -0.43; p < 0.001).

Conclusions

This normative database will be useful to quantify disease-specific defects. More importantly, the ON pathway function can potentially serve as a surrogate for rod photoreceptor function.

Predicting and Manipulating Cone Responses to Naturalistic Inputs

Primates explore their visual environment by making frequent saccades, discrete and ballistic eye movements that direct the fovea to specific regions of interest. Saccades produce large and rapid changes in input. The magnitude of these changes and the limited signaling range of visual neurons mean that effective encoding requires rapid adaptation. Here, we explore how macaque cone photoreceptors maintain sensitivity under these conditions. Adaptation makes cone responses to naturalistic stimuli highly nonlinear and dependent on stimulus history. Such responses cannot be explained by linear or linear-nonlinear models but are well explained by a biophysical model of phototransduction based on well-established biochemical interactions. The resulting model can predict cone responses to a broad range of stimuli and enables the design of stimuli that elicit specific (e.g., linear) cone photocurrents. These advances will provide a foundation for investigating the contributions of cone phototransduction and post-transduction processing to visual function.SIGNIFICANCE STATEMENT We know a great deal about adaptational mechanisms that adjust sensitivity to slow changes in visual inputs such as the rising or setting sun. We know much less about the rapid adaptational mechanisms that are essential for maintaining sensitivity as gaze shifts around a single visual scene. We characterize how phototransduction in cone photoreceptors adapts to rapid changes in input similar to those encountered during natural vision. We incorporate these measurements into a quantitative model that can predict cone responses across a broad range of stimuli. This model not only shows how cone phototransduction aids the encoding of natural inputs but also provides a tool to identify the role of the cone responses in shaping those of downstream visual neurons.

ON and OFF Signaling Pathways in the Retina and the Visual System

Visual processing starts at the retina of the eye, and signals are then transferred primarily to the visual cortex and the tectum. In the retina, multiple neural networks encode different aspects of visual input, such as color and motion. Subsequently, multiple neural streams in parallel convey unique aspects of visual information to cortical and subcortical regions. Bipolar cells, which are the second order neurons of the retina, separate visual signals evoked by light and dark contrasts and encode them to ON and OFF pathways, respectively. The interplay between ON and OFF neural signals is the foundation for visual processing for object contrast which underlies higher order stimulus processing. ON and OFF pathways have been classically thought to signal in a mirror-symmetric manner. However, while these two pathways contribute synergistically to visual perception in some instances, they have pronounced asymmetries suggesting independent operation in other cases. In this review, we summarize the role of the ON-OFF dichotomy in visual signaling, aiming to contribute to the understanding of visual recognition.

Visual processing: Systematic variation in light-dark bias across visual space

Detecting changes in luminance is a fundamental property of the visual system. A new study shows that lights and darks are represented differently across visual space, with strong OFF bias in central vision and balanced ON/OFF in the periphery.

From Receptive to Perceptive Fields: Size-Dependent Asymmetries in Both Negative Afterimages and Subcortical On and Off Post-Stimulus Responses

Negative afterimages are perceptual phenomena that occur after physical stimuli disappear from sight. Their origin is linked to transient post-stimulus responses of visual neurons. The receptive fields (RFs) of these subcortical ON- and OFF-center neurons exhibit antagonistic interactions between central and surrounding visual space, resulting in selectivity for stimulus polarity and size. These two features are closely intertwined, yet their relationship to negative afterimage perception remains unknown. Here we tested whether size differentially affects the perception of bright and dark negative afterimages in humans of both sexes, and how this correlates with neural mechanisms in subcortical ON and OFF cells. Psychophysically, we found a size-dependent asymmetry whereby dark disks produce stronger and longer-lasting negative afterimages than bright disks of equal contrast at sizes >0.8°. Neurophysiological recordings from retinal and relay cells in female cat dorsal lateral geniculate nucleus showed that subcortical ON cells exhibited stronger sustained post-stimulus responses to dark disks, than OFF cells to bright disks, at sizes >1°. These sizes agree with the emergence of center-surround antagonism, revealing stronger suppression to opposite-polarity stimuli for OFF versus ON cells, particularly in dorsal lateral geniculate nucleus. Using a network-based retino-geniculate model, we confirmed stronger antagonism and temporal transience for OFF-cell post-stimulus rebound responses. A V1 population model demonstrated that both strength and duration asymmetries can be propagated to downstream cortical areas. Our results demonstrate how size-dependent antagonism impacts both the neuronal post-stimulus response and the resulting afterimage percepts, thereby supporting the idea of perceptual RFs reflecting the underlying neuronal RF organization of single cells.SIGNIFICANCE STATEMENT Visual illusions occur when sensory inputs and perceptual outcomes do not match, and provide a valuable tool to understand transformations from neural to perceptual responses. A classic example are negative afterimages that remain visible after a stimulus is removed from view. Such perceptions are linked to responses in early visual neurons, yet the details remain poorly understood. Combining human psychophysics, neurophysiological recordings in cats and retino-thalamo-cortical computational modeling, our study reveals how stimulus size and the receptive-field structure of subcortical ON and OFF cells contributes to the parallel asymmetries between neural and perceptual responses to bright versus dark afterimages. Thus, this work provides a deeper link from the underlying neural mechanisms to the resultant perceptual outcomes.

Dependence of perceptual saccadic suppression on peri-saccadic image flow properties and luminance contrast polarity

Across saccades, perceptual detectability of brief visual stimuli is strongly diminished. We recently observed that this perceptual suppression phenomenon is jumpstarted in the retina, suggesting that the phenomenon might be significantly more visual in nature than normally acknowledged. Here, we explicitly compared saccadic suppression strength when saccades were made across a uniform image of constant luminance versus when saccades were made across image patches of different luminance, width, and trans-saccadic luminance polarity. We measured perceptual contrast thresholds of human subjects for brief peri-saccadic flashes of positive (luminance increments) or negative (luminance decrements) polarity. Thresholds were >6–7 times higher when saccades translated a luminance stripe or edge across the retina than when saccades were made over a completely uniform image patch. Critically, both background luminance and flash luminance polarity strongly modulated peri-saccadic contrast thresholds. In addition, all of these very same visual dependencies also occurred in the absence of any saccades, but with qualitatively similar rapid translations of image patches across the retina. This similarity of visual dependencies with and without saccades supports the notion that perceptual saccadic suppression may be fundamentally a visual phenomenon, which strongly motivates neurophysiological and theoretical investigations on the role of saccadic eye movement commands in modulating its properties.

Different roles of subcortical inputs in V1 responses to luminance and contrast

Cells in the primary visual cortex (V1) generally respond weakly to large uniform luminance stimuli. Only a subset of V1 cells is thought to encode uniform luminance information. In natural scenes, local luminance is an important feature for defining an object that varies and coexists with local spatial contrast. However, the strategies used by V1 cells to encode local mean luminance for spatial contrast stimuli remain largely unclear. Here, using extracellular recordings in anesthetized cats, we investigated the responses of V1 cells by comparing with those of retinal ganglion (RG) cells and lateral geniculate nucleus (LGN) cells to simultaneous and rapid changes in luminance and spatial contrast. Almost all V1 cells exhibited a strong monotonic increasing luminance tuning when they were exposed to high spatial contrast. Thus, V1 cells encode the luminance carried by spatial contrast stimuli with the monotonically increasing response function. Moreover, high contrast decreased luminance tuning of OFF cells but increased that of in ON cells in RG and LGN. The luminance and contrast tunings of LGN ON cells were highly separable as V1 cells, whereas those of LGN OFF cells were lowly separable. These asymmetrical effects of spatial contrast on ON/OFF channels might underlie the robust ability of V1 cells to perform luminance tuning when exposed to spatial contrast stimuli.

Neural correlates of metacontrast masking across different contrast polarities

Metacontrast masking is a powerful illusion to investigate the dynamics of perceptual processing and to control conscious visual perception. However, the neural mechanisms underlying this fundamental investigative tool are still debated. In the present study, we examined metacontrast masking across different contrast polarities by employing a contour discrimination task combined with EEG (Electroencephalography). When the target and mask had the same contrast polarity, a typical U-shaped metacontrast function was observed. A change in mask polarity (i.e., opposite mask polarity) shifted this masking function to a monotonic increasing function such that the target visibility was strongly suppressed at stimulus onset asynchronies less than 50 ms. This transition in metacontrast function has been typically interpreted as an increase in intrachannel inhibition of the sustained activities functionally linked to object visibility and identity. Our EEG analyses revealed an early (160-300 ms) and a late (300-550 ms) spatiotemporal cluster associated with this effect of polarity. The early cluster was mainly over occipital and parieto-occipital scalp sites. On the other hand, the later modulations of the evoked activities were centered over parietal and centro-parietal sites. Since both of these clusters were beyond 160 ms, the EEG results point to late recurrent inhibitory mechanisms. Although the findings here do not directly preclude other proposed mechanisms for metacontrast, they highlight the involvement of recurrent intrachannel inhibition in metacontrast masking.

Image luminance changes contrast sensitivity in visual cortex

Accurate measures of contrast sensitivity are important for evaluating visual disease progression and for navigation safety. Previous measures suggested that cortical contrast sensitivity was constant across widely different luminance ranges experienced indoors and outdoors. Against this notion, here, we show that luminance range changes contrast sensitivity in both cat and human cortex, and the changes are different for dark and light stimuli. As luminance range increases, contrast sensitivity increases more within cortical pathways signaling lights than those signaling darks. Conversely, when the luminance range is constant, light-dark differences in contrast sensitivity remain relatively constant even if background luminance changes. We show that a Naka-Rushton function modified to include luminance range and light-dark polarity accurately replicates both the statistics of light-dark features in natural scenes and the cortical responses to multiple combinations of contrast and luminance. We conclude that differences in light-dark contrast increase with luminance range and are largest in bright environments.

Retinal ganglion cells and the magnocellular, parvocellular, and koniocellular subcortical visual pathways from the eye to the brain

In primates including humans, most retinal ganglion cells send signals to the lateral geniculate nucleus (LGN) of the thalamus. The anatomical and functional properties of the two major pathways through the LGN, the parvocellular (P) and magnocellular (M) pathways, are now well understood. Neurones in these pathways appear to convey a filtered version of the retinal image to primary visual cortex for further analysis. The properties of the P-pathway suggest it is important for high spatial acuity and red-green color vision, while those of the M-pathway suggest it is important for achromatic visual sensitivity and motion vision. Recent work has sharpened our understanding of how these properties are built in the retina, and described subtle but important nonlinearities that shape the signals that cortex receives. In addition to the P- and M-pathways, other retinal ganglion cells also project to the LGN. These ganglion cells are larger than those in the P- and M-pathways, have different retinal connectivity, and project to distinct regions of the LGN, together forming heterogenous koniocellular (K) pathways. Recent work has started to reveal the properties of these K-pathways, in the retina and in the LGN. The functional properties of K-pathways are more complex than those in the P- and M-pathways, and the K-pathways are likely to have a distinct contribution to vision. They provide a complementary pathway to the primary visual cortex, but can also send signals directly to extrastriate visual cortex. At the level of the LGN, many neurones in the K-pathways seem to integrate retinal with non-retinal inputs, and some may provide an early site of binocular convergence.

Dependence of the stimulus-driven microsaccade rate signature in rhesus macaque monkeys on visual stimulus size and polarity

Microsaccades have a steady rate of occurrence during maintained gaze fixation, which gets transiently modulated by abrupt sensory stimuli. Such modulation, characterized by a rapid reduction in microsaccade frequency followed by a stronger rebound phase of high microsaccade rate, is often described as the microsaccadic rate signature, owing to its stereotyped nature. Here, we investigated the impacts of stimulus polarity (luminance increments or luminance decrements relative to background luminance) and size on the microsaccadic rate signature. We presented brief, behaviorally irrelevant visual flashes consisting of large or small, white or black stimuli over an otherwise gray image background. Both large and small stimuli caused robust early microsaccadic inhibition, but postinhibition microsaccade rate rebound was significantly delayed and weakened for large stimuli when compared with small ones. Critically, small black stimuli were associated with stronger modulations in the microsaccade rate signature than small white stimuli, particularly in the postinhibition rebound phase, and black stimuli also amplified the incidence of early stimulus-directed microsaccades. Our results demonstrate that the microsaccadic rate signature is sensitive to stimulus size and polarity, and they point to dissociable neural mechanisms underlying early microsaccadic inhibition after stimulus onset and later microsaccadic rate rebound at longer times thereafter. These results also demonstrate early access of oculomotor control circuitry to diverse sensory representations, particularly for momentarily inhibiting saccade generation with short latencies.NEW & NOTEWORTHY Microsaccade rate is transiently reduced after sudden stimulus onsets, and then strongly rebounds before returning to baseline. We explored the influence of stimulus polarity (black vs. white) and size on this "rate signature." Large stimuli caused more muted microsaccadic rebound than small ones, and microsaccadic rebound was also differentially affected by black versus white stimuli, particularly with small stimuli. These results suggest dissociated neural mechanisms for microsaccadic inhibition and rebound in the microsaccadic rate signature.

A Model for the Origin of Motion Direction Selectivity in Visual Cortex

Motion perception is a vital part of our sensory repertoire in that it contributes to navigation, awareness of moving objects, and communication. Motion sense in carnivores and primates originates with primary visual cortical neurons selective for motion direction. More than 60 years after the discovery of these neurons, there is still no consensus on the mechanism underlying direction selectivity. This paper describes a model of the cat's visual system in which direction selectivity results from the well-documented orientation selectivity of inhibitory neurons: inhomogeneities in the orientation preference map for inhibitory neurons leads to spatially asymmetric inhibition, and thus to direction selectivity. Stimulation of the model with a drifting grating shows that direction selectivity results from the relative timing of excitatory and inhibitory inputs to a neuron. Using a stationary contrast-reversing grating reveals that the inhibitory input is spatially displaced in the preferred direction relative to the excitatory input, and that this asymmetry leads to the timing difference. More generally, the model yields physiologically realistic estimates of the direction selectivity index, and it reproduces the critical finding with contrast-reversing gratings that response phase advances with grating spatial phase. It is concluded that a model based on intracortical inhibition can account well for the known properties of direction selectivity in carnivores and primates.SIGNIFICANCE STATEMENT Motion perception is vital for navigation, communication, and the awareness of moving objects. Motion sense depends on cortical neurons that are selective for motion direction, and this paper describes a model for the physiological mechanism underlying cortical direction selectivity. The essence of the model is that intracortical inhibition of a direction-selective cell is spatially inhomogeneous and therefore depends on whether a stimulus generates inhibition before or after reaching the cell's receptive field: the response is weaker in the former than in the latter case. If the model is correct, it will contribute to the understanding of motion processing in carnivores and primates.

Idiosyncratic preferences in transparent motion and binocular rivalry are dissociable

Previous studies revealed that there are idiosyncratic preferences to perceive certain motion directions in front during motion transparency depth rivalry (Mamassian & Wallace, 2010; Schütz, 2014). Meanwhile, other studies reported idiosyncratic preferences in binocular rivalry during the onset stage (Carter & Cavanagh, 2007; Stanley, Carter, & Forte, 2011). Here we investigated the relationship of idiosyncratic preferences in transparent motion and binocular rivalry. We presented two dot clouds that were moving in opposite directions. In the transparent motion condition, both dot clouds were presented to both eyes and participants had to report the dot cloud they perceived in front. In the binocular rivalry condition, the dot clouds were presented to different eyes and participants had to report the dominant dot cloud. There were strong idiosyncratic directional preferences in transparent motion and rather weak directional preferences in binocular rivalry. In general, binocular rivalry was dominated by biases in contrast polarity, whereas transparent motion was dominated by biases in motion direction. A circular correlation analysis showed no correlation between directional preferences in transparent motion and binocular rivalry. These findings show that idiosyncratic preferences in a visual feature can be dissociated at different stages of processing.

Ensemble coding of color and luminance contrast

Ensemble coding has been demonstrated for many attributes including color, but the metrics on which this coding is based remain uncertain. We examined ensemble percepts for stimulus sets that varied in chromatic contrast between complementary hues, or that varied in luminance contrast between increments and decrements, in both cases focusing on the ensemble percepts for the neutral gray stimulus defining the category boundary. Each ensemble was composed of 16 circles with four contrast levels. Observers saw the display for 0.5 s and then judged whether a target contrast was a member of the set. False alarms were high for intermediate contrasts (within the range of the ensemble) and fell for higher or lower values. However, for ensembles with complementary hues, gray was less likely to be reported as a member, even when it represented the mean chromaticity of the set. When the settings were repeated for luminance contrast, false alarms for gray were higher and fell off more gradually for out-of-range contrasts. This difference implies that opposite luminance polarities represent a more continuous perceptual dimension than opponent-color variations, and that "gray" is a stronger category boundary for chromatic than luminance contrasts. For color, our results suggest that ensemble percepts reflect pooling within rather than between large hue differences, perhaps because the visual system represents hue differences more like qualitatively different categories than like quantitative differences within an underlying color "space." The differences for luminance and color suggest more generally that ensemble coding for different visual attributes might depend on different processes that in turn depend on the format of the visual representation.

Dynamics of Contrast Decrement and Increment Responses in Human Visual Cortex

Purpose

The goal of the present experiments was to determine whether electrophysiologic response properties of the ON and OFF visual pathways observed in animal experimental models can be observed in humans.

Methods

Steady-state visual evoked potentials (SSVEPs) were recorded in response to equivalent magnitude contrast increments and decrements presented within a probe-on-pedestal Westheimer sensitization paradigm. The probes were modulated with sawtooth temporal waveforms at a temporal frequency of 3 or 2.73 Hz. SSVEP response waveforms and response spectra for incremental and decremental stimuli were analyzed as a function of stimulus size and visual field location in 67 healthy adult participants.

Results

SSVEPs recorded at the scalp differ between contrast decrements and increments of equal Weber contrast: SSVEP responses were larger in amplitude and shorter in latency for contrast decrements than for contrast increments. Both increment and decrement responses were larger for displays that were scaled for cortical magnification.

Conclusions

In a fashion that parallels results from the early visual system of cats and monkeys, two key properties of ON versus OFF pathways found in single-unit recordings are recapitulated at the population level of activity that can be observed with scalp electrodes, allowing differential assessment of ON and OFF pathway activity in human.

Translational Relevance

As data from preclinical models of visual pathway dysfunction point to differential damage to subtypes of retinal ganglion cells, this approach may be useful in future work on disease detection and treatment monitoring.

Functional Specialization of ON and OFF Cortical Pathways for Global-Slow and Local-Fast Vision

Visual information is processed in the cortex by ON and OFF pathways that respond to light and dark stimuli. Responses to darks are stronger, faster, and driven by a larger number of cortical neurons than responses to lights. Here, we demonstrate that these light-dark cortical asymmetries reflect a functional specialization of ON and OFF pathways for different stimulus properties. We show that large long-lasting stimuli drive stronger cortical responses when they are light, whereas small fast stimuli drive stronger cortical responses when they are dark. Moreover, we show that these light-dark asymmetries are preserved under a wide variety of luminance conditions that range from photopic to low mesopic light. Our results suggest that ON and OFF pathways extract different spatiotemporal information from visual scenes, making OFF local-fast signals better suited to maximize visual acuity and ON global-slow signals better suited to guide the eye movements needed for retinal image stabilization.

Efficient coding of natural scene statistics predicts discrimination thresholds for grayscale textures

Previously, in Hermundstad et al., 2014, we showed that when sampling is limiting, the efficient coding principle leads to a 'variance is salience' hypothesis, and that this hypothesis accounts for visual sensitivity to binary image statistics. Here, using extensive new psychophysical data and image analysis, we show that this hypothesis accounts for visual sensitivity to a large set of grayscale image statistics at a striking level of detail, and also identify the limits of the prediction. We define a 66-dimensional space of local grayscale light-intensity correlations, and measure the relevance of each direction to natural scenes. The 'variance is salience' hypothesis predicts that two-point correlations are most salient, and predicts their relative salience. We tested these predictions in a texture-segregation task using un-natural, synthetic textures. As predicted, correlations beyond second order are not salient, and predicted thresholds for over 300 second-order correlations match psychophysical thresholds closely (median fractional error <0.13).

Interocular ND filter suppression: Eccentricity and luminance polarity effects

The depth and extent of interocular suppression were measured in binocularly normal observers who unilaterally adapted to neutral density (ND) filters (0, 1.5, 2, and 3 ND). Suppression was measured by dichoptically matching sectors of a ring presented to the adapted eye to a fixed contrast contiguous ring presented to the non-adapted eye. Other rings of alternating polarity were viewed binocularly. Rings were defined by luminance (L), luminance with added dynamic binary luminance noise (LM), and contrast modulating the same noise (CM). Interocular suppression depth increased with increasing ND, nearing significance (p = 0.058) for 1.5 ND. For L and LM stimuli, suppression depth across eccentricity (±12° visual field) differed for luminance increment (white) versus luminance decrement (black) stimuli, potentially confounding eccentricity results. Suppression for increment-only (white) luminance stimuli was steeper centrally and extended across the visual field, but was deeper for L than for LM stimuli. Suppression for decrement-only (black) luminance stimuli revealed only central suppression. Suppression was deeper with CM than LM stimuli, suggesting that CM stimuli are extracted in areas receiving predominantly binocular input which may be more sensitive to binocular disruption. Increment (white) luminance stimuli demonstrate deeper interocular suppression in the periphery than decrement (black) stimuli, so they are more sensitive to changes in peripheral suppression. Asymmetry of suppression in the periphery for opposite polarity luminance stimuli may be due to interocular receptive field size mismatch as a result of dark adaptation separately affecting ON and OFF pathways. Clinically, measurement of suppression with CM stimuli may provide the best information about post-combination binocularity.

The zebrafish visual system transmits dimming information via multiple segregated pathways

Vertebrate retinas contain circuits specialized to encode light level decrements. This information is transmitted to the brain by dimming-sensitive OFF retinal ganglion cells (OFF-RGCs) that respond to light decrements with increased firing. It is known that OFF-RGCs with distinct photosensitivity profiles form parallel visual channels to the vertebrate brain, yet how these channels are processed by first- and higher order brain areas has not been well characterized in any species. To address this question in the larval zebrafish visual system, we examined the visual response properties of a genetically identified population of tectal neurons with a defined axonal projection to a second-order visual area: id2b:gal4-positive torus longitudinalis projection neurons (TLPNs). TLPNs responded consistently to whole-field dimming stimuli and exhibited the strongest responses when dimming was preceded by low light levels. Functional characterization of OFF-RGC terminals in tectum revealed responses that varied in their photosensitivities: (a) low-sensitivity OFF-RGCs that selectively respond to large light decrements, (b) high-sensitivity OFF-RGCs that selectively encode small decrements, and (c) broad sensitivity OFF-RGCs that respond to a wide range of light decrements. Diverse photosensitivity profiles were also observed using pan-neuronal calcium imaging to identify dimming-responsive neurons in both tectum and torus longitudinalis. Together, these data support a model in which parallel OFF channels generated in the retina remain segregated across three stages of visual processing. Segregated OFF channels with different sensitivities may allow specific aspects of dimming-evoked behaviors to be modulated by ambient light levels.

Cortical Balance Between ON and OFF Visual Responses Is Modulated by the Spatial Properties of the Visual Stimulus

The primary visual cortex of carnivores and primates is dominated by the OFF visual pathway and responds more strongly to dark than light stimuli. Here, we demonstrate that this cortical OFF dominance is modulated by the size and spatial frequency of the stimulus in awake primates and we uncover a main neuronal mechanism underlying this modulation. We show that large grating patterns with low spatial frequencies drive five times more OFF-dominated than ON-dominated neurons, but this pronounced cortical OFF dominance is strongly reduced when the grating size decreases and the spatial frequency increases, as when the stimulus moves away from the observer. We demonstrate that the reduction in cortical OFF dominance is not caused by a selective reduction of visual responses in OFF-dominated neurons but by a change in the ON/OFF response balance of neurons with diverse receptive field properties that can be ON or OFF dominated, simple, or complex. We conclude that cortical OFF dominance is continuously adjusted by a neuronal mechanism that modulates ON/OFF response balance in multiple cortical neurons when the spatial properties of the visual stimulus change with viewing distance and/or optical blur.

Retinal Contrast Gain Control and Temporal Modulation Sensitivity Across the Visual Field in Glaucoma at Photopic and Mesopic Light Conditions

Purpose

Glaucoma affects many aspects of visual performance, including adaptation, and this may depend on ambient luminance. We determine the influence of glaucoma and luminance on temporal aspects of adaptation, specifically on contrast gain control and temporal modulation sensitivity (TMS).

Methods

This case-control study included 12 glaucoma patients and 25 age-similar controls (50-70 years). Threshold perimetry was performed with a minimized testing grid (fovea and four peripheral locations). Stimuli (Goldmann size III 50 ms increment/decrement) were presented on a time-varying background with sinusoidally-modulated luminance (amplitude 60%; frequency 0-30 Hz; mean background luminance, 1 and 100 cd/m2). TMS (2.5-30 Hz) was measured in the same locations with a sinusoidally-modulated stimulus (Goldmann size IV, 334 ms) on a steady background (1 and 100 cd/m2).

Results

In healthy subjects, contrast sensitivity decreased with increasing background modulation frequency and increased again at very high frequencies, indicating contrast gain control. Minimum sensitivity was located between 2.5 and 20 Hz, depending on luminance and eccentricity. In glaucoma patients, the same frequency dependency was found (P = 0.12) but with an overall reduced sensitivity (P = 1 × 10-5), independent of luminance (P = 0.20). Decrements differentiated better between glaucoma and healthy subjects than increments (P = 0.004). TMS was reduced in glaucoma (P = 5 × 10-6) across all frequencies and luminance levels, with complete loss for high frequencies at 1 cd/m2.

Conclusions

Contrast gain control is largely unaffected in glaucoma, suggesting intact amacrine cell function. Perimetry with decrements or a high-frequency stimulus on a low-luminance background seems best to differentiate between glaucoma and healthy subjects.

Distinct Frequency Specialization for Detecting Dark Transients in Humans and Tree Shrews

Despite well-known privileged perception of dark over light stimuli, it is unknown to what extent this dark dominance is maintained when visual transients occur in rapid succession, for example, during perception of moving stimuli. Here, we address this question using dark and light transients presented at different flicker frequencies. Although both human participants and tree shrews exhibited dark dominance for temporally modulated transients, these occurred at different flicker frequencies, namely, at 11 Hz in humans and 40 Hz and higher in tree shrews. Tree shrew V1 neuronal activity confirmed that differences between light and dark flicker were maximal at 40 Hz, corresponding closely to behavioral findings. These findings suggest large differences in flicker perception between humans and tree shrews, which may be related to the lifestyle of these species. A specialization for detecting dark transients at high temporal frequencies may thus be adaptive for tree shrews, which are particularly fast-moving small mammals.

Luminance-contrast properties of texture-shape and texture-surround suppression of contour shape

Studies have revealed that textures suppress the processing of the shapes of contours they surround. One manifestation of texture-surround suppression is the reduction in the magnitude of adaptation-induced contour-shape aftereffects when the adaptor contour is surrounded by a texture. Here we utilize this phenomenon to investigate the nature of the first-order inputs to texture-surround suppression of contour shape by examining its selectivity to luminance polarity and the magnitude of luminance contrast. Stimuli were constructed from sinusoidal-shaped strings of either "bright" or "dark" elongated Gaussians. Observers adapted to pairs of contours, and the aftereffect was measured as the shift in the apparent shape frequency of subsequently presented test contours. We found that the suppression of the contour-shape aftereffect by a surround texture made of similar contours was maximal when the adaptor's center and surround contours were of the same polarity, revealing polarity specificity of the surround-suppression effect. We also measured the effect of varying the relative contrasts of the adaptor's center and surround and found that the reduction in the contour-shape aftereffect was determined by the surround-to-center contrast ratio. Finally, we measured the selectivity to luminance polarity of the texture-shape aftereffect itself and found that it was reduced when the adaptors and tests were of opposite luminance polarity. We conclude that texture-surround suppression of contour-shape as well as texture-shape processing itself depend on "on-off" luminance-polarity channel interactions. These selectivities may constitute an important neural substrate underlying efficient figure-ground segregation and image segmentation.

Amblyopia Affects the ON Visual Pathway More than the OFF

Visual information reaches the cerebral cortex through parallel ON and OFF pathways that signal the presence of light and dark stimuli in visual scenes. We have previously demonstrated that optical blur reduces visual salience more for light than dark stimuli because it removes the high spatial frequencies from the stimulus, and low spatial frequencies drive weaker ON than OFF cortical responses. Therefore, we hypothesized that sustained optical blur during brain development should weaken ON cortical pathways more than OFF, increasing the dominance of darks in visual perception. Here we provide support for this hypothesis in humans with anisometropic amblyopia who suffered sustained optical blur early after birth in one of the eyes. In addition, we show that the dark dominance in visual perception also increases in strabismic amblyopes that have their vision to high spatial frequencies reduced by mechanisms not associated with optical blur. Together, we show that amblyopia increases visual dark dominance by 3-10 times and that the increase in dark dominance is strongly correlated with amblyopia severity. These results can be replicated with a computational model that uses greater luminance/response saturation in ON than OFF pathways and, as a consequence, reduces more ON than OFF cortical responses to stimuli with low spatial frequencies. We conclude that amblyopia affects the ON cortical pathway more than the OFF, a finding that could have implications for future amblyopia treatments.SIGNIFICANCE STATEMENT Amblyopia is a loss of vision that affects 2-5% of children across the world and originates from a deficit in visual cortical circuitry. Current models assume that amblyopia affects similarly ON and OFF visual pathways, which signal light and dark features in visual scenes. Against this current belief, here we demonstrate that amblyopia affects the ON visual pathway more than the OFF, a finding that could have implications for new amblyopia treatments targeted at strengthening a weak ON visual pathway.

Early Visual Processing of Feature Saliency Tasks: A Review of Psychophysical Experiments

The visual system is constantly bombarded with information originating from the outside world, but it is unable to process all the received information at any given time. In fact, the most salient parts of the visual scene are chosen to be processed involuntarily and immediately after the first glance along with endogenous signals in the brain. Vision scientists have shown that the early visual system, from retina to lateral geniculate nucleus (LGN) and then primary visual cortex, selectively processes the low-level features of the visual scene. Everything we perceive from the visual scene is based on these feature properties and their subsequent combination in higher visual areas. Different experiments have been designed to investigate the impact of these features on saliency and understand the relative visual mechanisms. In this paper, we review the psychophysical experiments which have been published in the last decades to indicate how the low-level salient features are processed in the early visual cortex and extract the most important and basic information of the visual scene. Important and open questions are discussed in this review as well and one might pursue these questions to investigate the impact of higher level features on saliency in complex scenes or natural images.

Pathway-Specific Asymmetries between ON and OFF Visual Signals

Visual processing is largely organized into ON and OFF pathways that signal stimulus increments and decrements, respectively. These pathways exhibit natural pairings based on morphological and physiological similarities, such as ON and OFF α-ganglion cells in the mammalian retina. Several studies have noted asymmetries in the properties of ON and OFF pathways. For example, the spatial receptive fields (RFs) of OFF α-cells are systematically smaller than ON α-cells. Analysis of natural scenes suggests that these asymmetries are optimal for visual encoding. To test the generality of ON/OFF asymmetries, we measured the spatiotemporal RF properties of multiple RGC types in rat retina. Through a quantitative and serial classification, we identified three functional pairs of ON and OFF RGCs. We analyzed the structure of their RFs and compared spatial integration, temporal integration, and gain across ON and OFF pairs. Similar to previous results from the cat and primate, RGC types with larger spatial RFs exhibited briefer temporal integration and higher gain. However, each pair of ON and OFF RGC types exhibited distinct asymmetric relationships between RF properties, some of which were opposite to the findings of previous reports. These results reveal the functional organization of six RGC types in the rodent retina and indicate that ON/OFF asymmetries are pathway specific.SIGNIFICANCE STATEMENT Circuits that process sensory input frequently process increments separately from decrements, so-called ON and OFF responses. Theoretical studies indicate that this separation, and associated asymmetries in ON and OFF pathways, may be beneficial for encoding natural stimuli. However, the generality of ON and OFF pathway asymmetries has not been tested. Here we compare the functional properties of three distinct pairs of ON and OFF pathways in the rodent retina and show that their asymmetries are pathway specific. These results provide a new view on the partitioning of vision across diverse ON and OFF signaling pathways.

Neural Mechanisms of Motion Processing in the Mammalian Retina

Visual motion on the retina activates a cohort of retinal ganglion cells (RGCs). This population activity encodes multiple streams of information extracted by parallel retinal circuits. Motion processing in the retina is best studied in the direction-selective circuit. The main focus of this review is the neural basis of direction selectivity, which has been investigated in unprecedented detail using state-of-the-art functional, connectomic, and modeling methods. Mechanisms underlying the encoding of other motion features by broader RGC populations are also discussed. Recent discoveries at both single-cell and population levels highlight the dynamic and stimulus-dependent engagement of multiple mechanisms that collectively implement robust motion detection under diverse visual conditions.

Motion changes response balance between ON and OFF visual pathways

Humans are faster at detecting dark than light stationary stimuli, a temporal difference that originates early in the visual pathway. Here we show that this difference reverses when stimuli move, making detection faster for moving lights than darks. Human subjects judged the direction of moving edges and bars, and made faster and more accurate responses for light than for dark stimuli. This light/dark asymmetry is greatest at low speeds and disappears at high speeds. In parallel experiments, we recorded responses in the cat visual cortex for moving bars and again find that responses are faster for light bars than for dark bars moving at low speeds. We show that differences in the luminance-response function between ON and OFF pathways can reproduce these findings, and may explain why ON pathways are used for slow-motion image stabilization in many species.

Thalamocortical Circuits and Functional Architecture

The thalamocortical pathway is the main route of communication between the eye and the cerebral cortex. During embryonic development, thalamocortical afferents travel to L4 and are sorted by receptive field position, eye of origin, and contrast polarity (i.e., preference for light or dark stimuli). In primates and carnivores, this sorting involves numerous afferents, most of which sample a limited region of the binocular field. Devoting abundant thalamocortical resources to process a limited visual field has a clear advantage: It allows many stimulus combinations to be sampled at each spatial location. Moreover, the sampling efficiency can be further enhanced by organizing the afferents in a cortical grid for eye input and contrast polarity. We argue that thalamocortical interactions within this eye-polarity grid can be used to represent multiple stimulus combinations found in nature and to build an accurate cortical map for multidimensional stimulus space.

Age-related changes in ON and OFF responses to luminance increments and decrements

Impulse response functions for an incremental luminous pulse (ON flash) or a decremental luminous pulse (OFF flash) were derived for twelve young (19-24 years old) and ten old (65-84 years old) observers. Thresholds were measured for two pulses separated by stimulus-onset-asynchronies from 13.3 to 186.7 ms. The pulses had a spatial Gaussian shape and were presented as increments or decrements on a 15  cd/m² equal-energy white background, having the same chromaticity as the pulse. A spatial four-alternative forced-choice method was combined with a staircase procedure. Retinal illuminance was equated individually by heterochromatic flicker photometry and using a 2.3-mm exit pupil in a Maxwellian-view optical system to reduce the effects of age-related changes and individual variations in lens density and pupil size. Luminance ON- and OFF-impulse response functions calculated from the threshold data revealed significant age-related changes in the response amplitude of both first excitatory and first inhibitory phases. However, there were no significant changes in the time to the first peak or the second peak. These age-related changes in luminance varying ON- and OFF-impulse response functions (IRFs), reflecting putative properties of the magnocellular pathway, are discussed in relation to motion detection and the balance of ON and OFF pathways across the life span.

Neuronal mechanisms underlying differences in spatial resolution between darks and lights in human vision

Artists and astronomers noticed centuries ago that humans perceive dark features in an image differently from light ones; however, the neuronal mechanisms underlying these dark/light asymmetries remained unknown. Based on computational modeling of neuronal responses, we have previously proposed that such perceptual dark/light asymmetries originate from a luminance/response saturation within the ON retinal pathway. Consistent with this prediction, here we show that stimulus conditions that increase ON luminance/response saturation (e.g., dark backgrounds) or its effect on light stimuli (e.g., optical blur) impair the perceptual discrimination and salience of light targets more than dark targets in human vision. We also show that, in cat visual cortex, the magnitude of the ON luminance/response saturation remains relatively constant under a wide range of luminance conditions that are common indoors, and only shifts away from the lowest luminance contrasts under low mesopic light. Finally, we show that the ON luminance/response saturation affects visual salience mostly when the high spatial frequencies of the image are reduced by poor illumination or optical blur. Because both low luminance and optical blur are risk factors in myopia, our results suggest a possible neuronal mechanism linking myopia progression with the function of the ON visual pathway.

Catching the voltage gradient-asymmetric boost of cortical spread generates motion signals across visual cortex: a brief review with special thanks to Amiram Grinvald

Wide-field voltage imaging is unique in its capability to capture snapshots of activity-across the full gradient of average changes in membrane potentials from subthreshold to suprathreshold levels-of hundreds of thousands of superficial cortical neurons that are simultaneously active. Here, I highlight two examples where voltage-sensitive dye imaging (VSDI) was exploited to track gradual space-time changes of activity within milliseconds across several millimeters of cortex at submillimeter resolution: the line-motion condition, measured in Amiram Grinvald's Laboratory more than 10 years ago and-coming full circle running VSDI in my laboratory-another motion-inducing condition, in which two neighboring stimuli counterchange luminance simultaneously. In both examples, cortical spread is asymmetrically boosted, creating suprathreshold activity drawn out over primary visual cortex. These rapidly propagating waves may integrate brain signals that encode motion independent of direction-selective circuits.

Asymmetries of Dark and Bright Negative Afterimages Are Paralleled by Subcortical ON and OFF Poststimulus Responses

Humans are more sensitive to luminance decrements than increments, as evidenced by lower thresholds and shorter latencies for dark stimuli. This asymmetry is consistent with results of neurophysiological recordings in dorsal lateral geniculate nucleus (dLGN) and primary visual cortex (V1) of cat and monkey. Specifically, V1 population responses demonstrate that darks elicit higher levels of activation than brights, and the latency of OFF responses in dLGN and V1 is shorter than that of ON responses. The removal of a dark or bright disc often generates the perception of a negative afterimage, and here we ask whether there also exist asymmetries for negative afterimages elicited by dark and bright discs. If so, do the poststimulus responses of subcortical ON and OFF cells parallel such afterimage asymmetries? To test these hypotheses, we performed psychophysical experiments in humans and single-cell/S-potential recordings in cat dLGN. Psychophysically, we found that bright afterimages elicited by luminance decrements are stronger and last longer than dark afterimages elicited by luminance increments of equal sizes. Neurophysiologically, we found that ON cells responded to the removal of a dark disc with higher firing rates that were maintained for longer than OFF cells to the removal of a bright disc. The ON and OFF cell asymmetry was most pronounced at long stimulus durations in the dLGN. We conclude that subcortical response strength differences between ON and OFF channels parallel the asymmetries between bright and dark negative afterimages, further supporting a subcortical origin of bright and dark afterimage perception.SIGNIFICANCE STATEMENT Afterimages are physiological aftereffects following stimulation of the eye, the study of which helps us to understand how our visual brain generates visual perception in the absence of physical stimuli. We report, for the first time to our knowledge, asymmetries between bright and dark negative afterimages elicited by luminance decrements and increments, respectively. Bright afterimages are stronger and last longer than dark afterimages. Subcortical neuronal recordings of poststimulus responses of ON and OFF cells reveal similar asymmetries with respect to response strength and duration. Our results suggest that subcortical differences between ON and OFF channels help explain intensity and duration asymmetries between bright and dark afterimages, supporting the notion of a subcortical origin of bright and dark afterimages.