Functional Specialization of ON and OFF Cortical Pathways for Global-Slow and Local-Fast Vision

Good vision without peripheries: behavioral and fMRI evidence

In healthy vision, bright slow-motion stimuli are processed primarily by the regions of the visual system that receive input from the central part of the scene, whereas processing of dark fast-motion stimuli is more dependent on peripheral visual input. We tested 31 retinitis pigmentosa (RP) patients with long-term loss of peripheral photoreceptors and healthy controls with temporarily limited peripheral vision. We measured motion-based acuity using random-dot kinematograms, establishing individual thresholds for differentiating a circle from an ellipse. Participants subsequently performed a functional magnetic resonance imaging (fMRI) task set at a constant level of difficulty. The results showed that limiting vision did not affect motion-acuity thresholds in control participants but did cause different brain activations than those in RP patients, indicating prompt implementation of the strategy that would be perceptually successful. Compared with controls with both full and limited vision, impaired motion acuity in RP patients led to decreased brain activation, particularly in the primary peripheral visual areas V1-3. Importantly, compared with controls in full vision, matched decreased activation in MT+/V5, salience-processing cortices and the superior temporal cortex were detected in RP patients and in controls with limited peripheral vision, revealing brain networks that compensate for the loss of peripheral vision.

OPTICAL BLUR AFFECTS DIFFERENTLY ON AND OFF VISUAL PATHWAYS

The human eye has a crystalline lens that focuses retinal images at the point of fixation. Outside this fixation region, images are distorted by optical blur, which increases light scatter and reduces the spatial resolution and contrast processed by neuronal pathways. The spectacle lenses that humans use for optical correction also minify or magnify the images, affecting neuronal surround suppression in visual processing. Because light and dark stimuli are processed with ON and OFF pathways that have different spatial resolution, contrast sensitivity and surround suppression, optical blur and image magnification should affect differently the two pathways and the perception of lights and darks. Our results provide support for this prediction in cats and humans. We demonstrate that optical blur expands ON receptive fields while shrinking OFF receptive fields, as expected from the expansion of light stimuli and shrinkage of dark stimuli with light scatter. Spectacle-induced image magnification also shrinks OFF more than ON receptive fields, as expected from the stronger surround suppression in OFF than ON pathways. Optical blur also decreases the population response of OFF more than ON pathways, consistent with the different effects of light scatter on dark and light stimuli and the ON-OFF pathway differences in contrast sensitivity. Based on these results, we conclude that optical blur and image magnification reduce the receptive field sizes and cortical responses of OFF more than ON pathways, making the ON-OFF response balance a reliable signal to optimize the size and quality of the retinal image.

Environmental Lighting Conditions, Phenomenal Contrast, and the Conscious Perception of Near and Far

BACKGROUND

Recent evidence in systems neuroscience suggests that lighting conditions affect the whole chain of brain processing, from retina to high-level cortical networks, for perceptual and cognitive function. Here, visual adaptation levels to three different environmental lighting conditions, (1) darkness, (2) daylight, and (3) prolonged exposure to very bright light akin to sunlight, were simulated in lab to investigate the effects of light adaptation levels on classic cases of subjective contrast, assimilation, and contrast-induced relative depth in achromatic, i.e., ON-OFF pathway mediated visual configurations.

METHODS

After adaptation/exposure to a given lighting condition, configurations were shown in grouped and ungrouped conditions in random order to healthy young humans in computer-controlled two-alternative forced-choice procedures that consisted of deciding, as quickly as possible, which of two background patterns in a given configuration of achromatic contrast appeared lighter, or which of two foreground patterns appeared to stand out in front, as if it were nearer to the observer.

RESULTS

We found a statistically significant effect of the adaptation levels on the consciously perceived subjective contrast (F(2,23) = 20.73; p < 0.001) and the relative depth (F(2,23) = 12.67; p < 0.001), a statistically significant interaction between the adaptation levels and the grouping factor (F(2,23) = 4.73; p < 0.05) on subjective contrast, and a statistically significant effect of the grouping factor on the relative depth (F(2,23) = 13.71; p < 0.01).

CONCLUSIONS

Visual adaption to different lighting conditions significantly alters the conscious perception of contrast and assimilation, classically linked to non-linear functional synergies between ON and OFF processing channels in the visual brain, and modulates the repeatedly demonstrated effectiveness of luminance contrast as a depth cue; the physically brighter pattern regions in the configurations are no longer consistently perceived as nearer to a conscious observer under daylight and extreme bright light adapted (rod-saturated) conditions.

Reconfiguration of the visual code and retinal cell type complement in closely related diurnal and nocturnal mice

How does evolution act on neuronal populations to match computational characteristics to functional demands? We address this problem by comparing visual code and retinal cell composition in closely related murid species with different behaviours. Rhabdomys pumilio are diurnal and have substantially thicker inner retina and larger visual thalamus than nocturnal Mus musculus. High-density electrophysiological recordings of visual response features in the dorsal lateral geniculate nucleus (dLGN) reveals that Rhabdomys attains higher spatiotemporal acuity both by denser coverage of the visual scene and a selective expansion of elements of the code characterised by non-linear spatiotemporal summation. Comparative analysis of single cell transcriptomic cell atlases reveals that realignment of the visual code is associated with increased relative abundance of bipolar and ganglion cell types supporting OFF and ON-OFF responses. These findings demonstrate how changes in retinal cell complement can reconfigure the coding of visual information to match changes in visual needs.

Visual evoked potentials in patients with congenital color vision deficiency

BACKGROUND/AIM

Congenital color vision deficiency (CCVD) is an eye disease characterized by abnormalities in the cone cells in the photoreceptor layer. Visual evoked potentials (VEPs) are electrophysiological tests that physiologically examine the optic nerve, other visual pathways, and the visual cortex. The aim of this research was to determine whether there are VEP abnormalities in CCVD patients.

METHODS

Patients with CCVD and healthy individuals were included in this prospective case-control study. Participants with eye disease or neurodegenerative disease were excluded from the study. Pattern reversal VEP (PVEP), flash VEP (FVEP), and optical coherence tomography were performed on all participants.

RESULTS

Twenty healthy individuals (15 male) and 21 patients with CCVD (18 male) were included in the study. The mean ages of healthy individuals and patients with CCVD were 29.8 ± 9.6 and 31.1 ± 10.9 years (p = 0.804). Retinal nerve fiber layer thickness and central macular thickness values did not differ between the two groups. In PVEP, Right P100, Left N75, P100, N135 values were delayed in CCVD patients compared to healthy individuals (p = 0.001, p = 0.032, p = 0.003, p = 0.032). At least one PVEP and FVEP abnormality was present in nine (42.9%) and six (28.6%) of the patients, respectively. PVEP or FVEP abnormalities were found in 13 (61.9%) of the patients.

CONCLUSION

This study indicated that there may be PVEP and FVEP abnormalities in patients with CCVD.

Binocular receptive-field construction in the primary visual cortex

ON and OFF thalamic afferents from the two eyes converge in the primary visual cortex to form binocular receptive fields. The receptive fields need to be diverse to sample our visual world but also similar across eyes to achieve binocular fusion. It is currently unknown how the cortex balances these competing needs between receptive-field diversity and similarity. Our results demonstrate that receptive fields in the cat visual cortex are binocularly matched with exquisite precision for retinotopy, orientation/direction preference, orientation/direction selectivity, response latency, and ON-OFF polarity/structure. Specifically, the average binocular mismatches in retinotopy and ON-OFF structure are tightly restricted to 1/20 and 1/5 of the average receptive-field size but are still large enough to generate all types of binocular disparity tuning. Based on these results, we conclude that cortical receptive fields are binocularly matched with the high precision needed to facilitate binocular fusion while allowing restricted mismatches to process visual depth.

Encoding luminance surfaces in the visual cortex of mice and monkeys: difference in responses to edge and center

Luminance and spatial contrast provide information on the surfaces and edges of objects. We investigated neural responses to black and white surfaces in the primary visual cortex (V1) of mice and monkeys. Unlike primates that use their fovea to inspect objects with high acuity, mice lack a fovea and have low visual acuity. It thus remains unclear whether monkeys and mice share similar neural mechanisms to process surfaces. The animals were presented with white or black surfaces and the population responses were measured at high spatial and temporal resolution using voltage-sensitive dye imaging. In mice, the population response to the surface was not edge-dominated with a tendency to center-dominance, whereas in monkeys the response was edge-dominated with a "hole" in the center of the surface. The population response to the surfaces in both species exhibited suppression relative to a grating stimulus. These results reveal the differences in spatial patterns to luminance surfaces in the V1 of mice and monkeys and provide evidence for a shared suppression process relative to grating.

Predicting Single Neuron Responses of the Primary Visual Cortex with Deep Learning Model

Modeling neuron responses to stimuli can shed light on next-generation technologies such as brain-chip interfaces. Furthermore, high-performing models can serve to help formulate hypotheses and reveal the mechanisms underlying neural responses. Here the state-of-the-art computational model is presented for predicting single neuron responses to natural stimuli in the primary visual cortex (V1) of mice. The algorithm incorporates object positions and assembles multiple models with different train-validation data, resulting in a 15%-30% improvement over the existing models in cross-subject predictions and ranking first in the SENSORIUM 2022 Challenge, which benchmarks methods for neuron-specific prediction based on thousands of images. Importantly, The model reveals evidence that the spatial organizations of V1 are conserved across mice. This model will serve as an important noninvasive tool for understanding and utilizing the response patterns of primary visual cortex neurons.

Contrast Sensitivity of ON and OFF Human Retinal Pathways in Myopia

The human visual cortex processes light and dark stimuli with ON and OFF pathways that are differently modulated by luminance contrast. We have previously demonstrated that ON cortical pathways have higher contrast sensitivity than OFF cortical pathways and the difference increases with luminance range (defined as the maximum minus minimum luminance in the scene). Here, we demonstrate that these ON-OFF cortical differences are already present in the human retina and that retinal responses measured with electroretinography are more affected by reductions in luminance range than cortical responses measured with electroencephalography. Moreover, we show that ON-OFF pathway differences measured with electroretinography become more pronounced in myopia, a visual disorder that elongates the eye and blurs vision at far distance. We find that, as the eye axial length increases across subjects, ON retinal pathways become less responsive, slower in response latency, less sensitive, and less effective and slower at driving pupil constriction. Based on these results, we conclude that myopia is associated with a deficit in ON pathway function that decreases the ability of the retina to process low contrast and regulate retinal illuminance in bright environments.

Dynamic Recruitment of the Feedforward and Recurrent Mechanism for Black-White Asymmetry in the Primary Visual Cortex

Black and white information is asymmetrically distributed in natural scenes, evokes asymmetric neuronal responses, and causes asymmetric perceptions. Recognizing the universality and essentiality of black-white asymmetry in visual information processing, the neural substrates for black-white asymmetry remain unclear. To disentangle the role of the feedforward and recurrent mechanisms in the generation of cortical black-white asymmetry, we recorded the V1 laminar responses and LGN responses of anesthetized cats of both sexes. In a cortical column, we found that black-white asymmetry starts at the input layer and becomes more pronounced in the output layer. We also found distinct dynamics of black-white asymmetry between the output layer and the input layer. Specifically, black responses dominate in all layers after stimulus onset. After stimulus offset, black and white responses are balanced in the input layer, but black responses still dominate in the output layer. Compared with that in the input layer, the rebound response in the output layer is significantly suppressed. The relative suppression strength evoked by white stimuli is notably stronger and depends on the location within the ON-OFF cortical map. A model with delayed and polarity-selective cortical suppression explains black-white asymmetry in the output layer, within which prominent recurrent connections are identified by Granger causality analysis. In addition to black-white asymmetry in response strength, the interlaminar differences in spatial receptive field varied dynamically. Our findings suggest that the feedforward and recurrent mechanisms are dynamically recruited for the generation of black-white asymmetry in V1.SIGNIFICANCE STATEMENT Black-white asymmetry is universal and essential in visual information processing, yet the neural substrates for cortical black-white asymmetry remain unknown. Leveraging V1 laminar recordings, we provided the first laminar pattern of black-white asymmetry in cat V1 and found distinct dynamics of black-white asymmetry between the output layer and the input layer. Comparing black-white asymmetry across three visual hierarchies, the LGN, V1 input layer, and V1 output layer, we demonstrated that the feedforward and recurrent mechanisms are dynamically recruited for the generation of cortical black-white asymmetry. Our findings not only enhance our understanding of laminar processing within a cortical column but also elucidate how feedforward connections and recurrent connections interact to shape neuronal response properties.

Functional organization of visual responses in the octopus optic lobe

Cephalopods are highly visual animals with camera-type eyes, large brains, and a rich repertoire of visually guided behaviors. However, the cephalopod brain evolved independently from those of other highly visual species, such as vertebrates; therefore, the neural circuits that process sensory information are profoundly different. It is largely unknown how their powerful but unique visual system functions, as there have been no direct neural measurements of visual responses in the cephalopod brain. In this study, we used two-photon calcium imaging to record visually evoked responses in the primary visual processing center of the octopus central brain, the optic lobe, to determine how basic features of the visual scene are represented and organized. We found spatially localized receptive fields for light (ON) and dark (OFF) stimuli, which were retinotopically organized across the optic lobe, demonstrating a hallmark of visual system organization shared across many species. An examination of these responses revealed transformations of the visual representation across the layers of the optic lobe, including the emergence of the OFF pathway and increased size selectivity. We also identified asymmetries in the spatial processing of ON and OFF stimuli, which suggest unique circuit mechanisms for form processing that may have evolved to suit the specific demands of processing an underwater visual scene. This study provides insight into the neural processing and functional organization of the octopus visual system, highlighting both shared and unique aspects, and lays a foundation for future studies of the neural circuits that mediate visual processing and behavior in cephalopods.

ON and OFF receptive field processing in the presence of optical scattering

The balance of ON/OFF pathway activation in the retina plays a role in emmetropization. A new myopia control lens design uses contrast reduction to down-regulate a hypothesized enhanced ON contrast sensitivity in myopes. The study thus examined ON/OFF receptive field processing in myopes and non-myopes and the impact of contrast reduction. A psychophysical approach was used to measure the combined retinal-cortical output in the form of low-level ON and OFF contrast sensitivity with and without contrast reduction in 22 participants. ON responses were lower than OFF responses (ON 1.25 ± 0.03 vs. OFF 1.39 ± 0.03 log(CS); p < 0.0001) and myopes showed generally reduced sensitivities (myopes 1.25 ± 0.05 vs. non-myopes 1.39 ± 0.05 log(CS); p = 0.05). These findings remained unaffected by contrast reduction (p > 0.05). The study suggests that perceptual differences in ON and OFF signal processing between myopes and non-myopes exist but cannot explain how contrast reduction can inhibit myopia development.

Differences in visual stimulation between reading and walking and implications for myopia development

Visual input plays an important role in the development of myopia (nearsightedness), a visual disorder that blurs vision at far distances. The risk of myopia progression increases with the time spent reading and decreases with outdoor activity for reasons that remain poorly understood. To investigate the stimulus parameters driving this disorder, we compared the visual input to the retina of humans performing two tasks associated with different risks of myopia progression, reading and walking. Human subjects performed the two tasks while wearing glasses with cameras and sensors that recorded visual scenes and visuomotor activity. When compared with walking, reading black text in white background reduced spatiotemporal contrast in central vision and increased it in peripheral vision, leading to a pronounced reduction in the ratio of central/peripheral strength of visual stimulation. It also made the luminance distribution heavily skewed toward negative dark contrast in central vision and positive light contrast in peripheral vision, decreasing the central/peripheral stimulation ratio of ON visual pathways. It also decreased fixation distance, blink rate, pupil size, and head-eye coordination reflexes dominated by ON pathways. Taken together with previous work, these results support the hypothesis that reading drives myopia progression by understimulating ON visual pathways.

Functional organization of visual responses in the octopus optic lobe

Cephalopods are highly visual animals with camera-type eyes, large brains, and a rich repertoire of visually guided behaviors. However, the cephalopod brain evolved independently from that of other highly visual species, such as vertebrates, and therefore the neural circuits that process sensory information are profoundly different. It is largely unknown how their powerful but unique visual system functions, since there have been no direct neural measurements of visual responses in the cephalopod brain. In this study, we used two-photon calcium imaging to record visually evoked responses in the primary visual processing center of the octopus central brain, the optic lobe, to determine how basic features of the visual scene are represented and organized. We found spatially localized receptive fields for light (ON) and dark (OFF) stimuli, which were retinotopically organized across the optic lobe, demonstrating a hallmark of visual system organization shared across many species. Examination of these responses revealed transformations of the visual representation across the layers of the optic lobe, including the emergence of the OFF pathway and increased size selectivity. We also identified asymmetries in the spatial processing of ON and OFF stimuli, which suggest unique circuit mechanisms for form processing that may have evolved to suit the specific demands of processing an underwater visual scene. This study provides insight into the neural processing and functional organization of the octopus visual system, highlighting both shared and unique aspects, and lays a foundation for future studies of the neural circuits that mediate visual processing and behavior in cephalopods.

Highlights

The functional organization and visual response properties of the cephalopod visual system are largely unknownUsing calcium imaging, we performed mapping of visual responses in the octopus optic lobeVisual responses demonstrate localized ON and OFF receptive fields with retinotopic organizationON/OFF pathways and size selectivity emerge across layers of the optic lobe and have distinct properties relative to other species.

Luminance Contrast Shifts Dominance Balance between ON and OFF Pathways in Human Vision

Human vision processes light and dark stimuli in visual scenes with separate ON and OFF neuronal pathways. In nature, stimuli lighter or darker than their local surround have different spatial properties and contrast distributions (Ratliff et al., 2010; Cooper and Norcia, 2015; Rahimi-Nasrabadi et al., 2021). Similarly, in human vision, we show that luminance contrast affects the perception of lights and darks differently. At high contrast, human subjects of both sexes locate dark stimuli faster and more accurately than light stimuli, which is consistent with a visual system dominated by the OFF pathway. However, at low contrast, they locate light stimuli faster and more accurately than dark stimuli, which is consistent with a visual system dominated by the ON pathway. Luminance contrast was strongly correlated with multiple ON/OFF dominance ratios estimated from light/dark ratios of performance errors, missed targets, or reaction times (RTs). All correlations could be demonstrated at multiple eccentricities of the central visual field with an ON-OFF perimetry test implemented in a head-mounted visual display. We conclude that high-contrast stimuli are processed faster and more accurately by OFF pathways than ON pathways. However, the OFF dominance shifts toward ON dominance when stimulus contrast decreases, as expected from the higher-contrast sensitivity of ON cortical pathways (Kremkow et al., 2014; Rahimi-Nasrabadi et al., 2021). The results highlight the importance of contrast polarity in visual field measurements and predict a loss of low-contrast vision in humans with ON pathway deficits, as demonstrated in animal models (Sarnaik et al., 2014).SIGNIFICANCE STATEMENT ON and OFF retino-thalamo-cortical pathways respond differently to luminance contrast. In both animal models and humans, low contrasts drive stronger responses from ON pathways, whereas high contrasts drive stronger responses from OFF pathways. We demonstrate that these ON-OFF pathway differences have a correlate in human vision. At low contrast, humans locate light targets faster and more accurately than dark targets but, as contrast increases, dark targets become more visible than light targets. We also demonstrate that contrast is strongly correlated with multiple light/dark ratios of visual performance in central vision. These results provide a link between neuronal physiology and human vision while emphasizing the importance of stimulus polarity in measurements of visual fields and contrast sensitivity.

Bio-mimetic high-speed target localization with fused frame and event vision for edge application

Evolution has honed predatory skills in the natural world where localizing and intercepting fast-moving prey is required. The current generation of robotic systems mimics these biological systems using deep learning. High-speed processing of the camera frames using convolutional neural networks (CNN) (frame pipeline) on such constrained aerial edge-robots gets resource-limited. Adding more compute resources also eventually limits the throughput at the frame rate of the camera as frame-only traditional systems fail to capture the detailed temporal dynamics of the environment. Bio-inspired event cameras and spiking neural networks (SNN) provide an asynchronous sensor-processor pair (event pipeline) capturing the continuous temporal details of the scene for high-speed but lag in terms of accuracy. In this work, we propose a target localization system combining event-camera and SNN-based high-speed target estimation and frame-based camera and CNN-driven reliable object detection by fusing complementary spatio-temporal prowess of event and frame pipelines. One of our main contributions involves the design of an SNN filter that borrows from the neural mechanism for ego-motion cancelation in houseflies. It fuses the vestibular sensors with the vision to cancel the activity corresponding to the predator's self-motion. We also integrate the neuro-inspired multi-pipeline processing with task-optimized multi-neuronal pathway structure in primates and insects. The system is validated to outperform CNN-only processing using prey-predator drone simulations in realistic 3D virtual environments. The system is then demonstrated in a real-world multi-drone set-up with emulated event data. Subsequently, we use recorded actual sensory data from multi-camera and inertial measurement unit (IMU) assembly to show desired working while tolerating the realistic noise in vision and IMU sensors. We analyze the design space to identify optimal parameters for spiking neurons, CNN models, and for checking their effect on the performance metrics of the fused system. Finally, we map the throughput controlling SNN and fusion network on edge-compatible Zynq-7000 FPGA to show a potential 264 outputs per second even at constrained resource availability. This work may open new research directions by coupling multiple sensing and processing modalities inspired by discoveries in neuroscience to break fundamental trade-offs in frame-based computer vision.

Contrast polarity-specific mapping improves efficiency of neuronal computation for collision detection

Neurons receive information through their synaptic inputs, but the functional significance of how those inputs are mapped on to a cell's dendrites remains unclear. We studied this question in a grasshopper visual neuron that tracks approaching objects and triggers escape behavior before an impending collision. In response to black approaching objects, the neuron receives OFF excitatory inputs that form a retinotopic map of the visual field onto compartmentalized, distal dendrites. Subsequent processing of these OFF inputs by active membrane conductances allows the neuron to discriminate the spatial coherence of such stimuli. In contrast, we show that ON excitatory synaptic inputs activated by white approaching objects map in a random manner onto a more proximal dendritic field of the same neuron. The lack of retinotopic synaptic arrangement results in the neuron's inability to discriminate the coherence of white approaching stimuli. Yet, the neuron retains the ability to discriminate stimulus coherence for checkered stimuli of mixed ON/OFF polarity. The coarser mapping and processing of ON stimuli thus has a minimal impact, while reducing the total energetic cost of the circuit. Further, we show that these differences in ON/OFF neuronal processing are behaviorally relevant, being tightly correlated with the animal's escape behavior to light and dark stimuli of variable coherence. Our results show that the synaptic mapping of excitatory inputs affects the fine stimulus discrimination ability of single neurons and document the resulting functional impact on behavior.

Cortical mechanisms of visual brightness

The primary visual cortex signals the onset of light and dark stimuli with ON and OFF cortical pathways. Here, we demonstrate that both pathways generate similar response increments to large homogeneous surfaces and their response average increases with surface brightness. We show that, in cat visual cortex, response dominance from ON or OFF pathways is bimodally distributed when stimuli are smaller than one receptive field center but unimodally distributed when they are larger. Moreover, whereas small bright stimuli drive opposite responses from ON and OFF pathways (increased versus suppressed activity), large bright surfaces drive similar response increments. We show that this size-brightness relation emerges because strong illumination increases the size of light surfaces in nature and both ON and OFF cortical neurons receive input from ON thalamic pathways. We conclude that visual scenes are perceived as brighter when the average response increments from ON and OFF cortical pathways become stronger.

Mazade et al. find that the visual cortex encodes brightness differently for small than large stimuli. Bright small stimuli drive cortical pathways signaling lights and suppress cortical pathways signaling darks. Conversely, large surfaces drive response increments from both pathways and appear brightest when the response average is strongest.

ON than OFF pathway disruption leads to greater deficits in visual function and retinal dopamine signaling

The visual system uses ON and OFF pathways to signal luminance increments and decrements. Increasing evidence suggests that ON and OFF pathways have different signaling properties and serve specialized visual functions. However, it is still unclear the contribution of ON and OFF pathways to visual behavior. Therefore, we examined the effects on optomotor response and the retinal dopamine system in nob mice with ON pathway dysfunction and Vsx1-/- mice with partial OFF pathway dysfunction. Spatial frequency and contrast sensitivity thresholds were determined, and values were compared to age-matched wild-type controls. Retinas were collected immediately after visual testing to measure levels of dopamine and its metabolite, DOPAC. At 4 weeks of age, we found that nob mice had significantly reduced spatial frequency (19%) and contrast sensitivity (60%) thresholds compared to wild-type mice. Vsx1-/- mice also exhibited reductions in optomotor responses (3% in spatial frequency; 18% in contrast sensitivity) at 4 weeks, although these changes were significantly smaller than those found in nob mice. Furthermore, nob mice had significantly lower DOPAC levels (53%) and dopamine turnover (41%) compared to controls while Vsx1-/- mice displayed a transient increase in DOPAC levels at 4 weeks of age (55%). Our results show that dysfunction of ON pathways leads to reductions in contrast sensitivity, spatial frequency threshold, and retinal dopamine turnover whereas partial loss of the OFF pathway has minimal effect. We conclude that ON pathways play a critical role in visual reflexes and retinal dopamine signaling, highlighting a potential association for future investigations.

ON and OFF Signaling Pathways in the Retina and the Visual System

Visual processing starts at the retina of the eye, and signals are then transferred primarily to the visual cortex and the tectum. In the retina, multiple neural networks encode different aspects of visual input, such as color and motion. Subsequently, multiple neural streams in parallel convey unique aspects of visual information to cortical and subcortical regions. Bipolar cells, which are the second order neurons of the retina, separate visual signals evoked by light and dark contrasts and encode them to ON and OFF pathways, respectively. The interplay between ON and OFF neural signals is the foundation for visual processing for object contrast which underlies higher order stimulus processing. ON and OFF pathways have been classically thought to signal in a mirror-symmetric manner. However, while these two pathways contribute synergistically to visual perception in some instances, they have pronounced asymmetries suggesting independent operation in other cases. In this review, we summarize the role of the ON-OFF dichotomy in visual signaling, aiming to contribute to the understanding of visual recognition.

Retinal OFF-Pathway Overstimulation Leads to Greater Accommodation-Induced Choroidal Thinning

Purpose

To examine the interactions between accommodation and overstimulation of the retinal ON- and OFF-pathways, and their association with changes in choroidal thickness (ChT) and vascularity.

Methods

Optical coherence tomography imaging of the choroid of twenty young adults (ages 25 ± 5 years) was performed before and after a series of 30-minute-long viewing tasks, including reading a bright text on dark background (ON-pathway overstimulation) and dark text on bright background (OFF-pathway overstimulation), and a control task of viewing a movie with unbiased ON-/OFF-pathway activation. The viewing tasks were performed with relaxed, and 5 diopter (D) accommodation (induced by soft contact lenses) demands. Both reading texts were matched for the mean luminance (35 cd/m²), luminance contrast (87%), and letter size (approximately 11.8 arc minutes). The change in ChT from baseline associated with contrast polarity and accommodation was examined using linear mixed model analysis.

Results

The subfoveal ChT decreased significantly by −7 ± 1 µm with 5 D accommodation compared with relaxed accommodation (−3 ± 1 µm; P < 0.001), and by −9 ± 1 µm with OFF-pathway compared with ON-pathway overstimulation (−4 ± 1 µm; P = 0.002) and the control condition (−2 ± 1 µm; P < 0.001). Overstimulation of the OFF-pathway, but not the ON-pathway, resulted in a significantly greater choroidal thinning compared with the control condition, both at relaxed (−7 ± 1 µm; P = 0.003) and 5 D (−11 ± 1 µm; P = 0.005) accommodation levels. Similar changes were also observed for macular total, stromal, and luminal ChT.

Conclusions

Retinal OFF-pathway stimulation enhanced the choroidal thinning associated with accommodation, thereby providing a potential mechanism that involves accommodation and the retinal OFF-signaling pathway, linking near work and myopia.

Visual processing: Systematic variation in light-dark bias across visual space

Detecting changes in luminance is a fundamental property of the visual system. A new study shows that lights and darks are represented differently across visual space, with strong OFF bias in central vision and balanced ON/OFF in the periphery.

From Receptive to Perceptive Fields: Size-Dependent Asymmetries in Both Negative Afterimages and Subcortical On and Off Post-Stimulus Responses

Negative afterimages are perceptual phenomena that occur after physical stimuli disappear from sight. Their origin is linked to transient post-stimulus responses of visual neurons. The receptive fields (RFs) of these subcortical ON- and OFF-center neurons exhibit antagonistic interactions between central and surrounding visual space, resulting in selectivity for stimulus polarity and size. These two features are closely intertwined, yet their relationship to negative afterimage perception remains unknown. Here we tested whether size differentially affects the perception of bright and dark negative afterimages in humans of both sexes, and how this correlates with neural mechanisms in subcortical ON and OFF cells. Psychophysically, we found a size-dependent asymmetry whereby dark disks produce stronger and longer-lasting negative afterimages than bright disks of equal contrast at sizes >0.8°. Neurophysiological recordings from retinal and relay cells in female cat dorsal lateral geniculate nucleus showed that subcortical ON cells exhibited stronger sustained post-stimulus responses to dark disks, than OFF cells to bright disks, at sizes >1°. These sizes agree with the emergence of center-surround antagonism, revealing stronger suppression to opposite-polarity stimuli for OFF versus ON cells, particularly in dorsal lateral geniculate nucleus. Using a network-based retino-geniculate model, we confirmed stronger antagonism and temporal transience for OFF-cell post-stimulus rebound responses. A V1 population model demonstrated that both strength and duration asymmetries can be propagated to downstream cortical areas. Our results demonstrate how size-dependent antagonism impacts both the neuronal post-stimulus response and the resulting afterimage percepts, thereby supporting the idea of perceptual RFs reflecting the underlying neuronal RF organization of single cells.SIGNIFICANCE STATEMENT Visual illusions occur when sensory inputs and perceptual outcomes do not match, and provide a valuable tool to understand transformations from neural to perceptual responses. A classic example are negative afterimages that remain visible after a stimulus is removed from view. Such perceptions are linked to responses in early visual neurons, yet the details remain poorly understood. Combining human psychophysics, neurophysiological recordings in cats and retino-thalamo-cortical computational modeling, our study reveals how stimulus size and the receptive-field structure of subcortical ON and OFF cells contributes to the parallel asymmetries between neural and perceptual responses to bright versus dark afterimages. Thus, this work provides a deeper link from the underlying neural mechanisms to the resultant perceptual outcomes.

Stimulus Contrast Affects Spatial Integration in the Lateral Geniculate Nucleus of Macaque Monkeys

Gain-control mechanisms adjust neuronal responses to accommodate the wide range of stimulus conditions in the natural environment. Contrast gain control and extraclassical surround suppression are two manifestations of gain control that govern the responses of neurons in the early visual system. Understanding how these two forms of gain control interact has important implications for the detection and discrimination of stimuli across a range of contrast conditions. Here, we report that stimulus contrast affects spatial integration in the lateral geniculate nucleus of alert macaque monkeys (male and female), whereby neurons exhibit a reduction in the strength of extraclassical surround suppression and an expansion in the preferred stimulus size with low-contrast stimuli compared with high-contrast stimuli. Effects were greater for magnocellular neurons than for parvocellular neurons, indicating stream-specific interactions between stimulus contrast and stimulus size. Within the magnocellular pathway, contrast-dependent effects were comparable for ON-center and OFF-center neurons, despite ON neurons having larger receptive fields, less pronounced surround suppression, and more pronounced contrast gain control than OFF neurons. Together, these findings suggest that the parallel streams delivering visual information from retina to primary visual cortex, serve not only to broaden the range of signals delivered to cortex, but also to provide a substrate for differential interactions between stimulus contrast and stimulus size that may serve to improve stimulus detection and stimulus discrimination under pathway-specific lower and higher contrast conditions, respectively.SIGNIFICANCE STATEMENT Stimulus contrast is a salient feature of visual scenes. Here we examine the influence of stimulus contrast on spatial integration in the lateral geniculate nucleus (LGN). Our results demonstrate that increases in contrast generally increase extraclassical suppression and decrease the size of optimal stimuli, indicating a reduction in the extent of visual space from which LGN neurons integrate signals. Differences between magnocellular and parvocellular neurons are noteworthy and further demonstrate that the feedforward parallel pathways to cortex increase the range of information conveyed for downstream cortical processing, a range broadened by diversity in the ON and OFF pathways. These results have important implications for more complex visual processing that underly the detection and discrimination of stimuli under varying natural conditions.

Natural environment statistics in the upper and lower visual field are reflected in mouse retinal specializations

Pressures for survival make sensory circuits adapted to a species' natural habitat and its behavioral challenges. Thus, to advance our understanding of the visual system, it is essential to consider an animal's specific visual environment by capturing natural scenes, characterizing their statistical regularities, and using them to probe visual computations. Mice, a prominent visual system model, have salient visual specializations, being dichromatic with enhanced sensitivity to green and UV in the dorsal and ventral retina, respectively. However, the characteristics of their visual environment that likely have driven these adaptations are rarely considered. Here, we built a UV-green-sensitive camera to record footage from mouse habitats. This footage is publicly available as a resource for mouse vision research. We found chromatic contrast to greatly diverge in the upper, but not the lower, visual field. Moreover, training a convolutional autoencoder on upper, but not lower, visual field scenes was sufficient for the emergence of color-opponent filters, suggesting that this environmental difference might have driven superior chromatic opponency in the ventral mouse retina, supporting color discrimination in the upper visual field. Furthermore, the upper visual field was biased toward dark UV contrasts, paralleled by more light-offset-sensitive ganglion cells in the ventral retina. Finally, footage recorded at twilight suggests that UV promotes aerial predator detection. Our findings support that natural scene statistics shaped early visual processing in evolution.

Inter-mosaic coordination of retinal receptive fields

The output of the retina is organized into many detector grids, called ‘mosaics’ that signal different features of visual scenes to the brain^1–4. Each mosaic comprises a single retinal ganglion cell (RGC) type, whose receptive fields (RFs) tile space. Many mosaics arise as pairs, signaling increments (ON) and decrements (OFF), respectively, of a particular visual feature⁵. Using a model of efficient coding⁶, we determine how such mosaic pairs should be arranged to optimize the encoding of natural scenes. We find that information is maximized when these mosaic pairs are anti-aligned, meaning the RF centers between mosaics are more distant than expected by chance. We test this prediction across multiple RF mosaics acquired with large-scale measurements of RGC light responses from rat and primate. We find that ON and OFF RGC pairs with similar feature selectivity exhibit anti-aligned RF mosaics, consistent with theory. ON and OFF types that encode distinct features exhibit independent mosaics. These results extend efficient coding theory (ECT) beyond individual cells to predict how populations of diverse RGC types are spatially arranged.

Image luminance changes contrast sensitivity in visual cortex

Accurate measures of contrast sensitivity are important for evaluating visual disease progression and for navigation safety. Previous measures suggested that cortical contrast sensitivity was constant across widely different luminance ranges experienced indoors and outdoors. Against this notion, here, we show that luminance range changes contrast sensitivity in both cat and human cortex, and the changes are different for dark and light stimuli. As luminance range increases, contrast sensitivity increases more within cortical pathways signaling lights than those signaling darks. Conversely, when the luminance range is constant, light-dark differences in contrast sensitivity remain relatively constant even if background luminance changes. We show that a Naka-Rushton function modified to include luminance range and light-dark polarity accurately replicates both the statistics of light-dark features in natural scenes and the cortical responses to multiple combinations of contrast and luminance. We conclude that differences in light-dark contrast increase with luminance range and are largest in bright environments.

Dynamics of Contrast Decrement and Increment Responses in Human Visual Cortex

Purpose

The goal of the present experiments was to determine whether electrophysiologic response properties of the ON and OFF visual pathways observed in animal experimental models can be observed in humans.

Methods

Steady-state visual evoked potentials (SSVEPs) were recorded in response to equivalent magnitude contrast increments and decrements presented within a probe-on-pedestal Westheimer sensitization paradigm. The probes were modulated with sawtooth temporal waveforms at a temporal frequency of 3 or 2.73 Hz. SSVEP response waveforms and response spectra for incremental and decremental stimuli were analyzed as a function of stimulus size and visual field location in 67 healthy adult participants.

Results

SSVEPs recorded at the scalp differ between contrast decrements and increments of equal Weber contrast: SSVEP responses were larger in amplitude and shorter in latency for contrast decrements than for contrast increments. Both increment and decrement responses were larger for displays that were scaled for cortical magnification.

Conclusions

In a fashion that parallels results from the early visual system of cats and monkeys, two key properties of ON versus OFF pathways found in single-unit recordings are recapitulated at the population level of activity that can be observed with scalp electrodes, allowing differential assessment of ON and OFF pathway activity in human.

Translational Relevance

As data from preclinical models of visual pathway dysfunction point to differential damage to subtypes of retinal ganglion cells, this approach may be useful in future work on disease detection and treatment monitoring.

Inhibitory components of retinal bipolar cell receptive fields are differentially modulated by dopamine D1 receptors

During adaptation to an increase in environmental luminance, retinal signaling adjustments are mediated by the neuromodulator dopamine. Retinal dopamine is released with light and can affect center-surround receptive fields, the coupling state between neurons, and inhibitory pathways through inhibitory receptors and neurotransmitter release. While the inhibitory receptive field surround of bipolar cells becomes narrower and weaker during light adaptation, it is unknown how dopamine affects bipolar cell surrounds. If dopamine and light have similar effects, it would suggest that dopamine could be a mechanism for light-adapted changes. We tested the hypothesis that dopamine D1 receptor activation is sufficient to elicit the magnitude of light-adapted reductions in inhibitory bipolar cell surrounds. Surrounds were measured from OFF bipolar cells in dark-adapted mouse retinas while stimulating D1 receptors, which are located on bipolar, horizontal, and inhibitory amacrine cells. The D1 agonist SKF-38393 narrowed and weakened OFF bipolar cell inhibitory receptive fields but not to the same extent as with light adaptation. However, the receptive field surround reductions differed between the glycinergic and GABAergic components of the receptive field. GABAergic inhibitory strength was reduced only at the edges of the surround, while glycinergic inhibitory strength was reduced across the whole receptive field. These results expand the role of retinal dopamine to include modulation of bipolar cell receptive field surrounds. Additionally, our results suggest that D1 receptor pathways may be a mechanism for the light-adapted weakening of glycinergic surround inputs and the furthest wide-field GABAergic inputs to bipolar cells. However, remaining differences between light-adapted and D1 receptor-activated inhibition demonstrate that non-D1 receptor mechanisms are necessary to elicit the full effect of light adaptation on inhibitory surrounds.

Asymmetric ON-OFF processing of visual motion cancels variability induced by the structure of natural scenes

Animals detect motion using a variety of visual cues that reflect regularities in the natural world. Experiments in animals across phyla have shown that motion percepts incorporate both pairwise and triplet spatiotemporal correlations that could theoretically benefit motion computation. However, it remains unclear how visual systems assemble these cues to build accurate motion estimates. Here, we used systematic behavioral measurements of fruit fly motion perception to show how flies combine local pairwise and triplet correlations to reduce variability in motion estimates across natural scenes. By generating synthetic images with statistics controlled by maximum entropy distributions, we show that the triplet correlations are useful only when images have light-dark asymmetries that mimic natural ones. This suggests that asymmetric ON-OFF processing is tuned to the particular statistics of natural scenes. Since all animals encounter the world's light-dark asymmetries, many visual systems are likely to use asymmetric ON-OFF processing to improve motion estimation.

Amblyopia Affects the ON Visual Pathway More than the OFF

Visual information reaches the cerebral cortex through parallel ON and OFF pathways that signal the presence of light and dark stimuli in visual scenes. We have previously demonstrated that optical blur reduces visual salience more for light than dark stimuli because it removes the high spatial frequencies from the stimulus, and low spatial frequencies drive weaker ON than OFF cortical responses. Therefore, we hypothesized that sustained optical blur during brain development should weaken ON cortical pathways more than OFF, increasing the dominance of darks in visual perception. Here we provide support for this hypothesis in humans with anisometropic amblyopia who suffered sustained optical blur early after birth in one of the eyes. In addition, we show that the dark dominance in visual perception also increases in strabismic amblyopes that have their vision to high spatial frequencies reduced by mechanisms not associated with optical blur. Together, we show that amblyopia increases visual dark dominance by 3-10 times and that the increase in dark dominance is strongly correlated with amblyopia severity. These results can be replicated with a computational model that uses greater luminance/response saturation in ON than OFF pathways and, as a consequence, reduces more ON than OFF cortical responses to stimuli with low spatial frequencies. We conclude that amblyopia affects the ON cortical pathway more than the OFF, a finding that could have implications for future amblyopia treatments.SIGNIFICANCE STATEMENT Amblyopia is a loss of vision that affects 2-5% of children across the world and originates from a deficit in visual cortical circuitry. Current models assume that amblyopia affects similarly ON and OFF visual pathways, which signal light and dark features in visual scenes. Against this current belief, here we demonstrate that amblyopia affects the ON visual pathway more than the OFF, a finding that could have implications for new amblyopia treatments targeted at strengthening a weak ON visual pathway.