Dynamics of adaptation at high luminances: adaptation is faster after luminance decrements than after luminance increments

Luminance Contrast Shifts Dominance Balance between ON and OFF Pathways in Human Vision

Human vision processes light and dark stimuli in visual scenes with separate ON and OFF neuronal pathways. In nature, stimuli lighter or darker than their local surround have different spatial properties and contrast distributions (Ratliff et al., 2010; Cooper and Norcia, 2015; Rahimi-Nasrabadi et al., 2021). Similarly, in human vision, we show that luminance contrast affects the perception of lights and darks differently. At high contrast, human subjects of both sexes locate dark stimuli faster and more accurately than light stimuli, which is consistent with a visual system dominated by the OFF pathway. However, at low contrast, they locate light stimuli faster and more accurately than dark stimuli, which is consistent with a visual system dominated by the ON pathway. Luminance contrast was strongly correlated with multiple ON/OFF dominance ratios estimated from light/dark ratios of performance errors, missed targets, or reaction times (RTs). All correlations could be demonstrated at multiple eccentricities of the central visual field with an ON-OFF perimetry test implemented in a head-mounted visual display. We conclude that high-contrast stimuli are processed faster and more accurately by OFF pathways than ON pathways. However, the OFF dominance shifts toward ON dominance when stimulus contrast decreases, as expected from the higher-contrast sensitivity of ON cortical pathways (Kremkow et al., 2014; Rahimi-Nasrabadi et al., 2021). The results highlight the importance of contrast polarity in visual field measurements and predict a loss of low-contrast vision in humans with ON pathway deficits, as demonstrated in animal models (Sarnaik et al., 2014).SIGNIFICANCE STATEMENT ON and OFF retino-thalamo-cortical pathways respond differently to luminance contrast. In both animal models and humans, low contrasts drive stronger responses from ON pathways, whereas high contrasts drive stronger responses from OFF pathways. We demonstrate that these ON-OFF pathway differences have a correlate in human vision. At low contrast, humans locate light targets faster and more accurately than dark targets but, as contrast increases, dark targets become more visible than light targets. We also demonstrate that contrast is strongly correlated with multiple light/dark ratios of visual performance in central vision. These results provide a link between neuronal physiology and human vision while emphasizing the importance of stimulus polarity in measurements of visual fields and contrast sensitivity.

Subjective and Electroretinographic Dynamics of Light Adaptation in the Human Visual System

The excitation of the visual system increases with increasing retinal illumination. At the same time, the sensitivity of the system decreases (light adaptation). Higher excitation automatically results in a lower sensitivity. This study investigates whether this antagonistic relationship between excitation and sensitivity also applies to the dynamic case, that is, during the transition to a higher excitation level after a sudden increase in retinal illuminance. For this purpose, the courses of the subjective and the electroretinographic threshold in the transitional period during and after a step of the adaptation illuminance were investigated by means of a special light-stimulation system. The investigation was carried out on 9 (subjective threshold) and 12 (electroretinographic threshold) subjects. As a measure of the course of the excitation during this time, the response ERG on the adaptation step was recorded. With the step in adaptation light, the thresholds show a rapid increase, which starts already about 0.1 s before the step. This is followed, within the next second, by a threshold decrease to a new plateau above the initial level. The comparison between the response ERG on the adaptation step and the course of the electroretinographic increment threshold during this time shows a broad agreement between the two courses. Thus, it can be assumed that the sensitivity of the visual system also follows the excitation in the dynamic case. In addition, the investigation shows that the glare experienced after a step in illuminance apparently shows great subjective differences.

Neuronal mechanisms underlying differences in spatial resolution between darks and lights in human vision

Artists and astronomers noticed centuries ago that humans perceive dark features in an image differently from light ones; however, the neuronal mechanisms underlying these dark/light asymmetries remained unknown. Based on computational modeling of neuronal responses, we have previously proposed that such perceptual dark/light asymmetries originate from a luminance/response saturation within the ON retinal pathway. Consistent with this prediction, here we show that stimulus conditions that increase ON luminance/response saturation (e.g., dark backgrounds) or its effect on light stimuli (e.g., optical blur) impair the perceptual discrimination and salience of light targets more than dark targets in human vision. We also show that, in cat visual cortex, the magnitude of the ON luminance/response saturation remains relatively constant under a wide range of luminance conditions that are common indoors, and only shifts away from the lowest luminance contrasts under low mesopic light. Finally, we show that the ON luminance/response saturation affects visual salience mostly when the high spatial frequencies of the image are reduced by poor illumination or optical blur. Because both low luminance and optical blur are risk factors in myopia, our results suggest a possible neuronal mechanism linking myopia progression with the function of the ON visual pathway.

A computational model of afterimage rotation in the peripheral drift illusion based on retinal ON/OFF responses

Human observers perceive illusory rotations after the disappearance of circularly repeating patches containing dark-to-light luminance. This afterimage rotation is a very powerful phenomenon, but little is known about the mechanisms underlying it. Here, we use a computational model to show that the afterimage rotation can be explained by a combination of fast light adaptation and the physiological architecture of the early visual system, consisting of ON- and OFF-type visual pathways. In this retinal ON/OFF model, the afterimage rotation appeared as a rotation of focus lines of retinal ON/OFF responses. Focus lines rotated clockwise on a light background, but counterclockwise on a dark background. These findings were consistent with the results of psychophysical experiments, which were also performed by us. Additionally, the velocity of the afterimage rotation was comparable with that observed in our psychophysical experiments. These results suggest that the early visual system (including the retina) is responsible for the generation of the afterimage rotation, and that this illusory rotation may be systematically misinterpreted by our high-level visual system.

Dynamical adaptation in photoreceptors

Adaptation is at the heart of sensation and nowhere is it more salient than in early visual processing. Light adaptation in photoreceptors is doubly dynamical: it depends upon the temporal structure of the input and it affects the temporal structure of the response. We introduce a non-linear dynamical adaptation model of photoreceptors. It is simple enough that it can be solved exactly and simulated with ease; analytical and numerical approaches combined provide both intuition on the behavior of dynamical adaptation and quantitative results to be compared with data. Yet the model is rich enough to capture intricate phenomenology. First, we show that it reproduces the known phenomenology of light response and short-term adaptation. Second, we present new recordings and demonstrate that the model reproduces cone response with great precision. Third, we derive a number of predictions on the response of photoreceptors to sophisticated stimuli such as periodic inputs, various forms of flickering inputs, and natural inputs. In particular, we demonstrate that photoreceptors undergo rapid adaptation of response gain and time scale, over ∼ 300[Formula: see text] ms-i. e., over the time scale of the response itself-and we confirm this prediction with data. For natural inputs, this fast adaptation can modulate the response gain more than tenfold and is hence physiologically relevant.

The effect of mean luminance change and grating pedestals on contrast perception: model simulations suggest a common, retinal, origin

The percept of a contrast target is substantially affected by co-occurring changes in mean luminance or underlying ("pedestal") contrast elements. These two types of modulatory effects have traditionally been studied as separate phenomena. However, regardless of different higher-level mechanisms, both classes of phenomena will necessarily also depend on shared mechanisms in the first stages of vision, starting with the primary responses of photoreceptors. Here we present model simulations showing that important aspects of both classes may be explained by the temporal dynamics of photoreceptor responses read by integrate-and-fire operators. The model is physiologically justified and all its parameters are constrained by experimental evidence. Although there remains plenty of room for additional mechanisms to shape the exact quantitative realization of the perceptual functions in different situations, we suggest that signature features may be inherited from primary retinal signaling.

Darks are processed faster than lights

Recent physiological studies claim that dark stimuli have access to greater neuronal resources than light stimuli in early visual pathway. We used two sets of novel stimuli to examine the functional consequences of this dark dominance in human observers. We show that increment and decrement thresholds are equal when controlled for adaptation and eye movements. However, measurements for salience differences at high contrasts show that darks are detected pronouncedly faster and more accurately than lights when presented against uniform binary noise. In addition, the salience advantage for darks is abolished when the background distribution is adjusted to control for the irradiation illusion. The threshold equality suggests that the highest sensitivities of neurons in the ON and OFF channels are similar, whereas the salience difference is consistent with a population advantage for the OFF system.

Effects of mean luminance changes on human contrast perception: contrast dependence, time-course and spatial specificity

Background

When we are viewing natural scenes, every saccade abruptly changes both the mean luminance and the contrast structure falling on any given retinal location. Thus it would be useful if the two were independently encoded by the visual system, even when they change simultaneously. Recordings from single neurons in the cat visual system have suggested that contrast information may be quite independently represented in neural responses to simultaneous changes in contrast and luminance. Here we test to what extent this is true in human perception.

Methodology/Principal Findings

Small contrast stimuli were presented together with a 7-fold upward or downward step of mean luminance (between 185 and 1295 Td, corresponding to 14 and 98 cd/m²), either simultaneously or with various delays (50–800 ms). The perceived contrast of the target under the different conditions was measured with an adaptive staircase method. Over the contrast range 0.1–0.45, mainly subtractive attenuation was found. Perceived contrast decreased by 0.052±0.021 (N = 3) when target onset was simultaneous with the luminance increase. The attenuation subsided within 400 ms, and even faster after luminance decreases, where the effect was also smaller. The main results were robust against differences in target types and the size of the field over which luminance changed.

Conclusions/Significance

Perceived contrast is attenuated mainly by a subtractive term when coincident with a luminance change. The effect is of ecologically relevant magnitude and duration; in other words, strict contrast constancy must often fail during normal human visual behaviour. Still, the relative robustness of the contrast signal is remarkable in view of the limited dynamic response range of retinal cones. We propose a conceptual model for how early retinal signalling may allow this.

Saccadic modulation of neural responses: possible roles in saccadic suppression, enhancement, and time compression

Humans use saccadic eye movements to make frequent gaze changes, yet the associated full-field image motion is not perceived. The theory of saccadic suppression has been proposed to account for this phenomenon, but it is not clear whether suppression originates from a retinal signal at saccade onset or from the brain before saccade onset. Perceptually, visual sensitivity is reduced before saccades and enhanced afterward. Over the same time period, the perception of time is compressed and even inverted. We explore the origins and neural basis of these effects by recording from neurons in the dorsal medial superior temporal area (MSTd) of alert macaque monkeys. Neuronal responses to flashed presentations of a textured pattern presented at random times relative to saccades exhibit a stereotypical pattern of modulation. Response amplitudes are strongly suppressed for flashes presented up to 90 ms before saccades. Immediately after the suppression, there is a period of 200-450 ms in which flashes generate enhanced response amplitudes. Our results show that (1) MSTd is not directly suppressed, rather suppression is inherited from earlier visual areas; (2) early suppression of the visual system must be of extra-retinal origin; (3) postsaccadic enhancement of neural activity occurs in MSTd; and (4) the enhanced responses have reduced latencies. As a whole, these observations reveal response properties that could account for perceptual observations relating to presaccadic suppression, postsaccadic enhancement and time compression.

Light adaptation in salamander L-cone photoreceptors

The responses of individual salamander L-cones to light steps of moderate intensity (bleaching 0.3-3% of the total photopigment) and duration (between 5 and 90 s) were recorded using suction electrodes. Light initially suppressed the circulating current, which partially recovered or "sagged" over several seconds. The sensitivity of the cone to dim flashes decreased rapidly after light onset and approached a minimum within 500 ms. Background light did not affect the rising phase of the dim flash response, a measure of the initial gain of phototransduction. When the light was extinguished, the circulating current transiently exceeded or "overshot" its level in darkness. During the overshoot, the sensitivity of the cone required several seconds to recover. The sag and overshoot remained in voltage-clamped cones. Comparison with theory suggests that three mechanisms cause the sag, overshoot, and slow recovery of sensitivity after the light step: a gradual increase in the rate of inactivation of the phototransduction cascade during the light step, residual activity of the transduction cascade after the step is extinguished, and an increase in guanylate cyclase activity during the light step that persists after the light is extinguished.

Perceiving colour at a glimpse: The relevance of where one fixates

We used classification images to examine whether certain parts of a surface are particularly important when judging its colour, such as its centre, its edges, or where one is looking. The scene consisted of a regular pattern of square tiles with random colours from along a short line in colour space. Targets defined by a square array of brighter tiles were presented for 200ms. The colours of the tiles within the target were biased by an amount that led to about 70% of the responses being correct. Subjects fixated a point that fell within the target's lower left quadrant and reported each target's colour. They tended to report the colour of the tiles near the fixation point. The influence of the tiles' colour reversed at the target's border and was weaker outside the target. The colour at the border itself was not particularly important. When coloured tiles were also presented before (and after) target presentation they had an opposite (but weaker) effect, indicating that the change in colour is important. Comparing the influence of tiles outside the target with that of tiles at the position at which the target would soon appear suggests that when judging surface colours during the short "glimpses" between saccades, temporal comparisons can be at least as important as spatial ones. We conclude that eye movements are important for colour vision, both because they determine which part of the surface of interest will be given most weight and because the perceived colour of such a surface also depends on what one looked at last.

Retinal ganglion cell coding in simulated active vision

The image on the retina is almost never static. Eye, head, and body movements, and externally generated motion create rapid and continual changes in the retinal image (“active vision”). Virtually all vision in animals such as primates, which make saccades as often as 3–4 times/s, is based on information that must be derived from the first few hundred milliseconds after sudden, global changes in the retinal image. These changes may be accompanied by large changes in area mean luminance, as well as higher order image contrast statistics. This study investigated how retinal ganglion cell responses, whose response properties have been typically studied and defined in a stable stimulus regime, are affected by sudden changes in mean luminance that are characteristic of active vision. Specifically, the steady-state responses of retinal ganglion cells to static or moving square-wave grating stimuli were recorded in an isolated, superfused rabbit eyecup preparation and compared to responses after saccade-like changes in luminance. The manner of coding after luminance changes was different for different ganglion cell classes; both suppression and enhancement of responses to patterns following luminance changes were found. Brisk-transient Off cells unambiguously signaled the darkening of the overall image, but were also modulated by the subsequently appearing grating stimulus. Several types of On-center cell behavior were observed, ranging from strong suppression of the subsequent response by luminance changes, to strong enhancement. Overall, most ganglion cells distinguished static patterns after a luminance change via differences in their spike discharges nearly as well as before, although there were clear asymmetries between the On and Off pathways. Changes in mean luminance in some ganglion cells, such as On–Off directionally selective ganglion cells, could create large phase shifts in the response to patterned, moving stimuli, although these stimuli were still detected immediately after luminance changes. The results of this study show that the image dynamics of active vision may be a fundamental challenge for the visual system because of strong effects on retinal ganglion cell function. However, rapid extraction of unambiguous information after luminance changes appears to be encoded in differences in the spike discharges in different retinal ganglion cell classes. Asymmetries among ganglion cell classes in sensitivity to luminance changes may provide a basis by which some provide the “context” for interpreting the firing of others.

Texture segregation by motion under low luminance levels

We examined the effect of average luminance level on texture segregation by motion. We determined the minimum presentation duration required for subjects to detect a target defined by motion direction against a moving background. The average luminance level and retinal position of the target were systematically varied. We found that the minimum presentation duration needed for texture segregation depends significantly on the average luminance level and on retinal position. The minimum presentation duration increased as the mean luminance decreased. At a very low (presumably scotopic) luminance level, the motion-defined target was never detected rapidly. Under scotopic conditions, the minimum presentation duration was shorter in the periphery than in a near foveal region when the task was simple detection of the target. When the task included identifying the shape of the target patch, however, the target presented near the fovea was identified faster at all luminance levels. These results suggest that the performance of texture segregation is constrained by the spatiotemporal characteristics of the early visual system.

Time course of adaptation to stimuli presented along cardinal lines in color space

Visual sensitivity is a process that allows the visual system to maintain optimal response over a wide range of ambient light levels and chromaticities. Several studies have used variants of the probe-flash paradigm to show that the time course of adaptation to abrupt changes in ambient luminance depends on both receptoral and postreceptoral mechanisms. Though a few studies have explored how these processes govern adaptation to color changes, most of this effort has targeted the L-M-cone pathway. The purpose of our work was to use the probe-flash paradigm to more fully explore light adaptation in both the L-M- and the S-cone pathways. We measured sensitivity to chromatic probes presented after the onset of a 2-s chromatic flash. Test and flash stimuli were spatially coextensive 2 degrees fields presented in Maxwellian view. Flash stimuli were presented as excursions from white and could extended in one of two directions along an equiluminant L-M-cone or S-cone line. Probes were presented as excursions from the adapting flash chromaticity and could extend either toward the spectrum locus or toward white. For both color lines, the data show a fast and slow adaptation component, although this was less evident in the S-cone data. The fast and slow components were modeled as first- and second-site adaptive processes, respectively. We find that the time course of adaptation is different for the two cardinal pathways. In addition, the time course for S-cone stimulation is polarity dependent. Our results characterize the rapid time course of adaptation in the chromatic pathways and reveal that the mechanics of adaptation within the S-cone pathway are distinct from those in the L-M-cone pathways.

Recovery from contrast adaptation matches ideal-observer predictions

Recovery from contrast adaptation was studied in psychophysical experiments. We measured detection thresholds for a test pulse presented on a photopic background as a function of the time after the offset of a high-contrast flicker of the background. The decrease of thresholds with time is well described by a power-law function. Thresholds for tests presented at 640 ms after the offset of the background contrast are still significantly elevated above the threshold measured when the observers have completely adapted to a steady background. We compare the psychophysical data with contrast estimates of ideal-observer models. A match between the results for human and ideal observers can be obtained when the ideal observer is limited by noise. For a quantitative match, we assume that the ideal observer performs a Bayesian calculation on its noise-perturbed input, sampled every 10-20 ms. For the Bayesian calculation we assume a prior probability distribution function for the input contrast that has a lower cutoff at the standard deviation of the noise.

Effects of luminance oscillations on simulated lightness discriminations

The speed of processes underlying lightness constancy was studied by having observers discriminate small differences in simulated lightness under an oscillating illumination. The period of oscillation varied from 0.25 to 120 sec. The target was a 1 degrees square which appeared for 150 msec at random intervals either directly against a uniform background or separated from the background by a 1 degrees dark gap. When the target and background were adjacent to each other, discrimination accuracy approached control levels (fixed illumination) at all but the shortest periods of oscillation. When the gap was introduced, accuracy increased as the period of oscillation increased, but never approached control levels. The results suggest that a fast local contrast mechanism is the primary mediator of lightness constancy for this task, but that there is also a slower mechanism that may be related to adaptation.

Achromatic impulses unmask L- and M-cone adaptive mechanisms

The mechanisms underlying the adaptive response for achromatic impulses seen on achromatic fields were investigated. Foveal thresholds were measured for a static probe-impulse under two conditions of adaptation. Thresholds were obtained under gain-clamped conditions after observers had reached steady-state adaptation and with a probe-flash paradigm. It was found that thresholds isolated on steady-state fields cannot be modelled using a single mechanism. Likewise, the probe-flash condition failed to reflect the response of a single mechanism. Both threshold functions showed distinct breaks occurring at about the same field luminance (approximately 1.0 log cd/m2). Optimum data fits required the incorporation of two mechanisms implying the existence of independent processes mediating detection. Chromatic isolation confirmed that differential adaptation had been unmasked in the long- and medium-wavelength sensitive cone inputs to the achromatic channel.

Light adaptation in motion direction judgments

We examined the time course of light adaptation in the visual motion system. Subjects judged the direction of a two-frame apparent-motion display, with the two frames separated by a 50-ms interstimulus interval of the same mean luminance. The phase of the first frame was randomly determined on each trial. The grating presented in the second frame was phase shifted either leftward or rightward by pi/2 with respect to the grating in the first frame. At some variable point during the first frame, the mean luminance of the pattern increased or decreased by 1-3 log units. Mean luminance levels varied from scotopic or low mesopic to photopic levels. We found that the perceived direction of motion depended jointly on the luminance level of the first frame grating and the time at which the shift in average luminance occurs. When the average luminance increases from scotopic or mesopic to photopic levels at least 0.5 s before the offset of the first frame, motion in the 3pi/2 direction is perceived. When average luminance decreases to low mesopic or scotopic levels, motion in the pi/2 direction is perceived if the change occurs 1.0 s or more before first frame offset, depending on the size of the luminance step. Thus light adaptation in the visual motion system is essentially complete within 1 s. This suggests a rapid change in the shape (biphasic or monophasic) of the temporal impulse response functions that feed into a first-order motion mechanism.

Exploring the dynamics of light adaptation: the effects of varying the flickering background's duration in the probed-sinewave paradigm

In the probed-sinewave paradigm, threshold for detecting a probe is measured at various phases with respect to a sinusoidally-flickering background. Here we vary the duration of the flickering background before (and after) the test probe is presented. The adaptation is rapid; after approximately 10-30 ms of the flickering background, probe threshold is the same as that on a continually-flickering background. It is interesting that this result holds at both low (1. 2 Hz) and middle (9.4 Hz) frequencies because at middle frequencies (but not at low) there is a dc-shift, i.e. probe threshold is elevated at all phases relative to that on a steady background (of the same mean luminance). We compare our results to predictions from Wilson's model [Wilson (1997), Visual Neuroscience, 14, 403-423; Hood & Graham (1998), Visual Neuroscience, 15, 957-967] of light adaptation. The model predicts the rapid adaptation, and the dc-shift, but not the detailed shape of the probe-threshold-versus-phase curve at middle frequencies.

Increment and decrement detection on temporally modulated fields

Increment and decrement probe thresholds were measured during the presentation of two types of temporal masking stimuli. In Experiment 1, we measured thresholds for increment or decrement rectangular probes presented during the presentation of an increment or decrement Gaussian masking stimulus. We find that thresholds are higher when the probe and the Gaussian mask are of the same sign (e. g. both increments). However, both types of Gaussian mask raised increment and decrement probe thresholds above steady state conditions. In Experiment 2, we presented increment or decrement probes at one of eight possible phases of a 1 Hz luminance-modulated sine wave. For both increment and decrement probes, threshold variation with phase is non-sinusoidal in shape, but increment and decrement probe thresholds vary as a function of the sinusoid phase. These experiments show that increment and decrement thresholds vary as a function of the adaptation state of the visual system, and as a function of the direction of change in the adaptation state. Data from both experiments are discussed in terms of a recent neurophysiological model [Hood & Graham (1998). Threshold fluctuations on temporally modulated backgrounds: a possible physiological explanation based upon a recent computational model. Visual Neuroscience, 15 (5), 957-967]. We find that the predicted ON- and OFF-pathway responses do not correlate in a straightforward manner with the psychophysical thresholds, suggesting that detection of increment and decrement probes may not be performed exclusively by one pathway. Our data have implications for modeling visual performance under conditions where visual adaptation is dynamic, such as when scanning complex images or natural scenes.

Visual sensitivity in the presence of a patterned background

The sensitivity of the visual system depends on ambient illumination: Sensitivity is reduced in the presence of a bright, uniform background. We asked how sensitivity is adjusted when the background is spatially detailed and therefore contains both luminance peaks and troughs in the neighborhood of a foreground object. A test flash was superimposed on a static sinusoidal grating. As the grating's spatial frequency increased, sensitivity for flash detection declined, regardless of whether the flash was superimposed on a peak or a trough of the grating. We studied the mechanisms underlying this loss of sensitivity by delivering the test stimulus through one eye and the background through the other. The conclusion is that three mechanisms are involved. Luminance adaptation and a masking process adjust sensitivity at low- and mid-range spatial frequencies, respectively. The third mechanism, a contrast gain control, is localized (it occurs at spatial frequencies approaching the limit for resolution) and fast (complete in half a second), and it results from early processing in the visual pathway (it is absent during dichoptic viewing). This local adjustment of sensitivity may help to protect the clarity of even the smallest details in the visual scene.