Neuronal mechanisms underlying differences in spatial resolution between darks and lights in human vision

A virtual patient simulation modeling the neural and perceptual effects of human visual cortical stimulation, from pulse trains to percepts

The field of cortical sight restoration prostheses is making rapid progress with three clinical trials of visual cortical prostheses underway. However, as yet, we have only limited insight into the perceptual experiences produced by these implants. Here we describe a computational model or 'virtual patient', based on the neurophysiological architecture of V1, which successfully predicts the perceptual experience of participants across a wide range of previously published human cortical stimulation studies describing the location, size, brightness and spatiotemporal shape of electrically induced percepts in humans. Our simulations suggest that, in the foreseeable future the perceptual quality of cortical prosthetic devices is likely to be limited by the neurophysiological organization of visual cortex, rather than engineering constraints.

Contrast Sensitivity of ON and OFF Human Retinal Pathways in Myopia

The human visual cortex processes light and dark stimuli with ON and OFF pathways that are differently modulated by luminance contrast. We have previously demonstrated that ON cortical pathways have higher contrast sensitivity than OFF cortical pathways and the difference increases with luminance range (defined as the maximum minus minimum luminance in the scene). Here, we demonstrate that these ON-OFF cortical differences are already present in the human retina and that retinal responses measured with electroretinography are more affected by reductions in luminance range than cortical responses measured with electroencephalography. Moreover, we show that ON-OFF pathway differences measured with electroretinography become more pronounced in myopia, a visual disorder that elongates the eye and blurs vision at far distance. We find that, as the eye axial length increases across subjects, ON retinal pathways become less responsive, slower in response latency, less sensitive, and less effective and slower at driving pupil constriction. Based on these results, we conclude that myopia is associated with a deficit in ON pathway function that decreases the ability of the retina to process low contrast and regulate retinal illuminance in bright environments.

Differences in visual stimulation between reading and walking and implications for myopia development

Visual input plays an important role in the development of myopia (nearsightedness), a visual disorder that blurs vision at far distances. The risk of myopia progression increases with the time spent reading and decreases with outdoor activity for reasons that remain poorly understood. To investigate the stimulus parameters driving this disorder, we compared the visual input to the retina of humans performing two tasks associated with different risks of myopia progression, reading and walking. Human subjects performed the two tasks while wearing glasses with cameras and sensors that recorded visual scenes and visuomotor activity. When compared with walking, reading black text in white background reduced spatiotemporal contrast in central vision and increased it in peripheral vision, leading to a pronounced reduction in the ratio of central/peripheral strength of visual stimulation. It also made the luminance distribution heavily skewed toward negative dark contrast in central vision and positive light contrast in peripheral vision, decreasing the central/peripheral stimulation ratio of ON visual pathways. It also decreased fixation distance, blink rate, pupil size, and head-eye coordination reflexes dominated by ON pathways. Taken together with previous work, these results support the hypothesis that reading drives myopia progression by understimulating ON visual pathways.

Pulse trains to percepts: A virtual patient describing the perceptual effects of human visual cortical stimulation

The field of cortical sight restoration prostheses is making rapid progress with three clinical trials of visual cortical prostheses underway. However, as yet, we have only limited insight into the perceptual experiences produced by these implants. Here we describe a computational model or 'virtual patient', based on the neurophysiological architecture of V1, which successfully predicts the perceptual experience of participants across a wide range of previously published cortical stimulation studies describing the location, size, brightness and spatiotemporal shape of electrically induced percepts in humans. Our simulations suggest that, in the foreseeable future the perceptual quality of cortical prosthetic devices is likely to be limited by the neurophysiological organization of visual cortex, rather than engineering constraints.

Tablet-based 'ON/OFF' pathway test can distinguish between rod- and cone-dominated diseases

INTRODUCTION

The photopic ON pathway defect is associated with nocturnal vision loss. However, the measurement of ON function to detect a rod-dominated disease (rods affected more than cones) has not been explored. We evaluated whether the psychophysical evaluation of ON/OFF pathways can be used to distinguish cone-dominated from rod-dominated diseases.

METHODS

Thirty-seven patients with inherited retinal diseases were tested using the 'EyeSpeed' [iOS application] on an iPad. The test displayed a random number (1-3) of light or dark targets on a black-and-white noise background. Participants responded on a touch screen indicating the correct number of targets displayed. The outcome variables-reaction time, accuracy and performance index (speed [1/reaction time] * accuracy) to both light and dark targets were assessed for diagnostic ability using standard receiver-operating characteristic (ROC) analysis.

RESULTS

Mean ± standard deviation age and visual acuity for the cone- and rod-dominated groups were 25.15 ± 11.74 years, 0.80 ± 0.25 logMAR and 28.3 ± 14.29 years, 0.48 ± 0.26 logMAR, respectively. The median reaction time to light targets in rod-dominated disease [interquartile range] was 5.28 s [3.17], significantly greater than for patients with cone-dominated disease (2.07 s [0.93]; Mann-Whitney U test, p < 0.001). Amongst all of the outcome variables evaluated, the reaction time to light targets (criterion of ≥2.98 s) exhibited the highest area under the ROC curve (area = 0.89 ± 0.11; p < 0.001), with a sensitivity and specificity of 82.4% and 85% respectively.

CONCLUSIONS

Reaction time to light targets using the ON/OFF pathway paradigm is a valid marker to differentiate between rod- and cone-dominated retinal dystrophies. ON pathway function measured using a tablet-based test could act as a supplemental test in the diagnosis of challenging photoreceptor-specific inherited retinal diseases.

Luminance Contrast Shifts Dominance Balance between ON and OFF Pathways in Human Vision

Human vision processes light and dark stimuli in visual scenes with separate ON and OFF neuronal pathways. In nature, stimuli lighter or darker than their local surround have different spatial properties and contrast distributions (Ratliff et al., 2010; Cooper and Norcia, 2015; Rahimi-Nasrabadi et al., 2021). Similarly, in human vision, we show that luminance contrast affects the perception of lights and darks differently. At high contrast, human subjects of both sexes locate dark stimuli faster and more accurately than light stimuli, which is consistent with a visual system dominated by the OFF pathway. However, at low contrast, they locate light stimuli faster and more accurately than dark stimuli, which is consistent with a visual system dominated by the ON pathway. Luminance contrast was strongly correlated with multiple ON/OFF dominance ratios estimated from light/dark ratios of performance errors, missed targets, or reaction times (RTs). All correlations could be demonstrated at multiple eccentricities of the central visual field with an ON-OFF perimetry test implemented in a head-mounted visual display. We conclude that high-contrast stimuli are processed faster and more accurately by OFF pathways than ON pathways. However, the OFF dominance shifts toward ON dominance when stimulus contrast decreases, as expected from the higher-contrast sensitivity of ON cortical pathways (Kremkow et al., 2014; Rahimi-Nasrabadi et al., 2021). The results highlight the importance of contrast polarity in visual field measurements and predict a loss of low-contrast vision in humans with ON pathway deficits, as demonstrated in animal models (Sarnaik et al., 2014).SIGNIFICANCE STATEMENT ON and OFF retino-thalamo-cortical pathways respond differently to luminance contrast. In both animal models and humans, low contrasts drive stronger responses from ON pathways, whereas high contrasts drive stronger responses from OFF pathways. We demonstrate that these ON-OFF pathway differences have a correlate in human vision. At low contrast, humans locate light targets faster and more accurately than dark targets but, as contrast increases, dark targets become more visible than light targets. We also demonstrate that contrast is strongly correlated with multiple light/dark ratios of visual performance in central vision. These results provide a link between neuronal physiology and human vision while emphasizing the importance of stimulus polarity in measurements of visual fields and contrast sensitivity.

ON and OFF Signaling Pathways in the Retina and the Visual System

Visual processing starts at the retina of the eye, and signals are then transferred primarily to the visual cortex and the tectum. In the retina, multiple neural networks encode different aspects of visual input, such as color and motion. Subsequently, multiple neural streams in parallel convey unique aspects of visual information to cortical and subcortical regions. Bipolar cells, which are the second order neurons of the retina, separate visual signals evoked by light and dark contrasts and encode them to ON and OFF pathways, respectively. The interplay between ON and OFF neural signals is the foundation for visual processing for object contrast which underlies higher order stimulus processing. ON and OFF pathways have been classically thought to signal in a mirror-symmetric manner. However, while these two pathways contribute synergistically to visual perception in some instances, they have pronounced asymmetries suggesting independent operation in other cases. In this review, we summarize the role of the ON-OFF dichotomy in visual signaling, aiming to contribute to the understanding of visual recognition.

Personalizing image enhancement for critical visual tasks: improved legibility of papyri using color processing and visual illusions

This article develops theoretical, algorithmic, perceptual, and interaction aspects of script legibility enhancement in the visible light spectrum for the purpose of scholarly editing of papyri texts. Novel legibility enhancement algorithms based on color processing and visual illusions are compared to classic methods in a user experience experiment. (1) The proposed methods outperformed the comparison methods. (2) Users exhibited a broad behavioral spectrum, under the influence of factors such as personality and social conditioning, tasks and application domains, expertise level and image quality, and affordances of software, hardware, and interfaces. No single enhancement method satisfied all factor configurations. Therefore, it is suggested to offer users a broad choice of methods to facilitate personalization, contextualization, and complementarity. (3) A distinction is made between casual and critical vision on the basis of signal ambiguity and error consequences. The criteria of a paradigm for enhancing images for critical applications comprise: interpreting images skeptically; approaching enhancement as a system problem; considering all image structures as potential information; and making uncertainty and alternative interpretations explicit, both visually and numerically.

Supplementary Information

The online version contains supplementary material available at 10.1007/s10032-021-00386-0.

Image luminance changes contrast sensitivity in visual cortex

Accurate measures of contrast sensitivity are important for evaluating visual disease progression and for navigation safety. Previous measures suggested that cortical contrast sensitivity was constant across widely different luminance ranges experienced indoors and outdoors. Against this notion, here, we show that luminance range changes contrast sensitivity in both cat and human cortex, and the changes are different for dark and light stimuli. As luminance range increases, contrast sensitivity increases more within cortical pathways signaling lights than those signaling darks. Conversely, when the luminance range is constant, light-dark differences in contrast sensitivity remain relatively constant even if background luminance changes. We show that a Naka-Rushton function modified to include luminance range and light-dark polarity accurately replicates both the statistics of light-dark features in natural scenes and the cortical responses to multiple combinations of contrast and luminance. We conclude that differences in light-dark contrast increase with luminance range and are largest in bright environments.

Ambient Light Regulates Retinal Dopamine Signaling and Myopia Susceptibility

Purpose

Exposure to high-intensity or outdoor lighting has been shown to decrease the severity of myopia in both human epidemiological studies and animal models. Currently, it is not fully understood how light interacts with visual signaling to impact myopia. Previous work performed in the mouse retina has demonstrated that functional rod photoreceptors are needed to develop experimentally-induced myopia, alluding to an essential role for rod signaling in refractive development.

Methods

To determine whether dim rod-dominated illuminance levels influence myopia susceptibility, we housed male C57BL/6J mice under 12:12 light/dark cycles with scotopic (1.6 × 10⁻³ candela/m²), mesopic (1.6 × 10¹ cd/m²), or photopic (4.7 × 10³ cd/m²) lighting from post-natal day 23 (P23) to P38. Half the mice received monocular exposure to −10 diopter (D) lens defocus from P28–38. Molecular assays to measure expression and content of DA-related genes and protein were conducted to determine how illuminance and lens defocus alter dopamine (DA) synthesis, storage, uptake, and degradation and affect myopia susceptibility in mice.

Results

We found that mice exposed to either scotopic or photopic lighting developed significantly less severe myopic refractive shifts (lens treated eye minus contralateral eye; –1.62 ± 0.37D and −1.74 ± 0.44D, respectively) than mice exposed to mesopic lighting (–3.61 ± 0.50D; P < 0.005). The 3,4-dihydroxyphenylacetic acid /DA ratio, indicating DA activity, was highest under photopic light regardless of lens defocus treatment (controls: 0.09 ± 0.011 pg/mg, lens defocus: 0.08 ± 0.008 pg/mg).

Conclusions

Lens defocus interacted with ambient conditions to differentially alter myopia susceptibility and DA-related genes and proteins. Collectively, these results show that scotopic and photopic lighting protect against lens-induced myopia, potentially indicating that a broad range of light levels are important in refractive development.

Light and myopia: from epidemiological studies to neurobiological mechanisms

Myopia is far beyond its inconvenience and represents a true, highly prevalent, sight-threatening ocular condition, especially in Asia. Without adequate interventions, the current epidemic of myopia is projected to affect 50% of the world population by 2050, becoming the leading cause of irreversible blindness. Although blurred vision, the predominant symptom of myopia, can be improved by contact lenses, glasses or refractive surgery, corrected myopia, particularly high myopia, still carries the risk of secondary blinding complications such as glaucoma, myopic maculopathy and retinal detachment, prompting the need for prevention. Epidemiological studies have reported an association between outdoor time and myopia prevention in children. The protective effect of time spent outdoors could be due to the unique characteristics (intensity, spectral distribution, temporal pattern, etc.) of sunlight that are lacking in artificial lighting. Concomitantly, studies in animal models have highlighted the efficacy of light and its components in delaying or even stopping the development of myopia and endeavoured to elucidate possible mechanisms involved in this process. In this narrative review, we (1) summarize the current knowledge concerning light modulation of ocular growth and refractive error development based on studies in human and animal models, (2) summarize potential neurobiological mechanisms involved in the effects of light on ocular growth and emmetropization and (3) highlight a potential pathway for the translational development of noninvasive light-therapy strategies for myopia prevention in children.

Tumor mutation burden in blood predicts benefit from neoadjuvant chemo/radiotherapy in locally advanced rectal cancer

Distant metastasis has been the major concern of prognosis in patients with locally advanced rectal cancer (LARC). The purpose of this study was to investigate the prognostic value of TMB in blood (bTMB) in LARC patients after receiving neoadjuvant chemoradiotherapy (nCRT) and surgery. Using targeted ctDNA sequencing, we revealed that bTMB level at baseline was positively correlated with recurrence-free survival (RFS). Following nCRT, the patients with decreasing TMB tends to have a longer median RFS. bTMB level after surgery was negatively correlated with RFS. The serum cytokines including IFNγ, IFNα2, IL-1β, IL-2 and MIP-1β were significantly higher in pre-nCRT serum with higher bTMB group than that of lower bTMB group. Clonal evolution analysis showed that the pre- and post-nCRT ctDNAs of most cases had shared mutations. In conclusion, we presume that bTMB could potentially improve pre- and post-treatment risk assessment and facilitate individualized therapy for patients with LARC.

Functional Specialization of ON and OFF Cortical Pathways for Global-Slow and Local-Fast Vision

Visual information is processed in the cortex by ON and OFF pathways that respond to light and dark stimuli. Responses to darks are stronger, faster, and driven by a larger number of cortical neurons than responses to lights. Here, we demonstrate that these light-dark cortical asymmetries reflect a functional specialization of ON and OFF pathways for different stimulus properties. We show that large long-lasting stimuli drive stronger cortical responses when they are light, whereas small fast stimuli drive stronger cortical responses when they are dark. Moreover, we show that these light-dark asymmetries are preserved under a wide variety of luminance conditions that range from photopic to low mesopic light. Our results suggest that ON and OFF pathways extract different spatiotemporal information from visual scenes, making OFF local-fast signals better suited to maximize visual acuity and ON global-slow signals better suited to guide the eye movements needed for retinal image stabilization.

Cortical Balance Between ON and OFF Visual Responses Is Modulated by the Spatial Properties of the Visual Stimulus

The primary visual cortex of carnivores and primates is dominated by the OFF visual pathway and responds more strongly to dark than light stimuli. Here, we demonstrate that this cortical OFF dominance is modulated by the size and spatial frequency of the stimulus in awake primates and we uncover a main neuronal mechanism underlying this modulation. We show that large grating patterns with low spatial frequencies drive five times more OFF-dominated than ON-dominated neurons, but this pronounced cortical OFF dominance is strongly reduced when the grating size decreases and the spatial frequency increases, as when the stimulus moves away from the observer. We demonstrate that the reduction in cortical OFF dominance is not caused by a selective reduction of visual responses in OFF-dominated neurons but by a change in the ON/OFF response balance of neurons with diverse receptive field properties that can be ON or OFF dominated, simple, or complex. We conclude that cortical OFF dominance is continuously adjusted by a neuronal mechanism that modulates ON/OFF response balance in multiple cortical neurons when the spatial properties of the visual stimulus change with viewing distance and/or optical blur.

Retinal Contrast Gain Control and Temporal Modulation Sensitivity Across the Visual Field in Glaucoma at Photopic and Mesopic Light Conditions

Purpose

Glaucoma affects many aspects of visual performance, including adaptation, and this may depend on ambient luminance. We determine the influence of glaucoma and luminance on temporal aspects of adaptation, specifically on contrast gain control and temporal modulation sensitivity (TMS).

Methods

This case-control study included 12 glaucoma patients and 25 age-similar controls (50-70 years). Threshold perimetry was performed with a minimized testing grid (fovea and four peripheral locations). Stimuli (Goldmann size III 50 ms increment/decrement) were presented on a time-varying background with sinusoidally-modulated luminance (amplitude 60%; frequency 0-30 Hz; mean background luminance, 1 and 100 cd/m2). TMS (2.5-30 Hz) was measured in the same locations with a sinusoidally-modulated stimulus (Goldmann size IV, 334 ms) on a steady background (1 and 100 cd/m2).

Results

In healthy subjects, contrast sensitivity decreased with increasing background modulation frequency and increased again at very high frequencies, indicating contrast gain control. Minimum sensitivity was located between 2.5 and 20 Hz, depending on luminance and eccentricity. In glaucoma patients, the same frequency dependency was found (P = 0.12) but with an overall reduced sensitivity (P = 1 × 10-5), independent of luminance (P = 0.20). Decrements differentiated better between glaucoma and healthy subjects than increments (P = 0.004). TMS was reduced in glaucoma (P = 5 × 10-6) across all frequencies and luminance levels, with complete loss for high frequencies at 1 cd/m2.

Conclusions

Contrast gain control is largely unaffected in glaucoma, suggesting intact amacrine cell function. Perimetry with decrements or a high-frequency stimulus on a low-luminance background seems best to differentiate between glaucoma and healthy subjects.

Amblyopia Affects the ON Visual Pathway More than the OFF

Visual information reaches the cerebral cortex through parallel ON and OFF pathways that signal the presence of light and dark stimuli in visual scenes. We have previously demonstrated that optical blur reduces visual salience more for light than dark stimuli because it removes the high spatial frequencies from the stimulus, and low spatial frequencies drive weaker ON than OFF cortical responses. Therefore, we hypothesized that sustained optical blur during brain development should weaken ON cortical pathways more than OFF, increasing the dominance of darks in visual perception. Here we provide support for this hypothesis in humans with anisometropic amblyopia who suffered sustained optical blur early after birth in one of the eyes. In addition, we show that the dark dominance in visual perception also increases in strabismic amblyopes that have their vision to high spatial frequencies reduced by mechanisms not associated with optical blur. Together, we show that amblyopia increases visual dark dominance by 3-10 times and that the increase in dark dominance is strongly correlated with amblyopia severity. These results can be replicated with a computational model that uses greater luminance/response saturation in ON than OFF pathways and, as a consequence, reduces more ON than OFF cortical responses to stimuli with low spatial frequencies. We conclude that amblyopia affects the ON cortical pathway more than the OFF, a finding that could have implications for future amblyopia treatments.SIGNIFICANCE STATEMENT Amblyopia is a loss of vision that affects 2-5% of children across the world and originates from a deficit in visual cortical circuitry. Current models assume that amblyopia affects similarly ON and OFF visual pathways, which signal light and dark features in visual scenes. Against this current belief, here we demonstrate that amblyopia affects the ON visual pathway more than the OFF, a finding that could have implications for new amblyopia treatments targeted at strengthening a weak ON visual pathway.

Pathway-Specific Asymmetries between ON and OFF Visual Signals

Visual processing is largely organized into ON and OFF pathways that signal stimulus increments and decrements, respectively. These pathways exhibit natural pairings based on morphological and physiological similarities, such as ON and OFF α-ganglion cells in the mammalian retina. Several studies have noted asymmetries in the properties of ON and OFF pathways. For example, the spatial receptive fields (RFs) of OFF α-cells are systematically smaller than ON α-cells. Analysis of natural scenes suggests that these asymmetries are optimal for visual encoding. To test the generality of ON/OFF asymmetries, we measured the spatiotemporal RF properties of multiple RGC types in rat retina. Through a quantitative and serial classification, we identified three functional pairs of ON and OFF RGCs. We analyzed the structure of their RFs and compared spatial integration, temporal integration, and gain across ON and OFF pairs. Similar to previous results from the cat and primate, RGC types with larger spatial RFs exhibited briefer temporal integration and higher gain. However, each pair of ON and OFF RGC types exhibited distinct asymmetric relationships between RF properties, some of which were opposite to the findings of previous reports. These results reveal the functional organization of six RGC types in the rodent retina and indicate that ON/OFF asymmetries are pathway specific.SIGNIFICANCE STATEMENT Circuits that process sensory input frequently process increments separately from decrements, so-called ON and OFF responses. Theoretical studies indicate that this separation, and associated asymmetries in ON and OFF pathways, may be beneficial for encoding natural stimuli. However, the generality of ON and OFF pathway asymmetries has not been tested. Here we compare the functional properties of three distinct pairs of ON and OFF pathways in the rodent retina and show that their asymmetries are pathway specific. These results provide a new view on the partitioning of vision across diverse ON and OFF signaling pathways.

Motion changes response balance between ON and OFF visual pathways

Humans are faster at detecting dark than light stationary stimuli, a temporal difference that originates early in the visual pathway. Here we show that this difference reverses when stimuli move, making detection faster for moving lights than darks. Human subjects judged the direction of moving edges and bars, and made faster and more accurate responses for light than for dark stimuli. This light/dark asymmetry is greatest at low speeds and disappears at high speeds. In parallel experiments, we recorded responses in the cat visual cortex for moving bars and again find that responses are faster for light bars than for dark bars moving at low speeds. We show that differences in the luminance-response function between ON and OFF pathways can reproduce these findings, and may explain why ON pathways are used for slow-motion image stabilization in many species.