Retinal noise and absolute threshold

Effects of packetization on communication dynamics in brain networks

Computational studies in network neuroscience build models of communication dynamics in the connectome that help us understand the structure-function relationships of the brain. In these models, the dynamics of cortical signal transmission in brain networks are approximated with simple propagation strategies such as random walks and shortest path routing. Furthermore, the signal transmission dynamics in brain networks can be associated with the switching architectures of engineered communication systems (e.g., message switching and packet switching). However, it has been unclear how propagation strategies and switching architectures are related in models of brain network communication. Here, we investigate the effects of the difference between packet switching and message switching (i.e., whether signals are packetized or not) on the transmission completion time of propagation strategies when simulating signal propagation in mammalian brain networks. The results show that packetization in the connectome with hubs increases the time of the random walk strategy and does not change that of the shortest path strategy, but decreases that of more plausible strategies for brain networks that balance between communication speed and information requirements. This finding suggests an advantage of packet-switched communication in the connectome and provides new insights into modeling the communication dynamics in brain networks.

Estimating lighting direction in scenes with multiple objects

To recover the reflectance and shape of an object in a scene, the human visual system must account for the properties of the light illuminating the object. Here, we examine the extent to which multiple objects within a scene are utilised to estimate the direction of lighting in a scene. In Experiment 1, we presented participants with rendered scenes that contained 1, 9, or 25 unfamiliar blob-like objects and measured their capacity to discriminate whether a directional light source was left or right of the participants' vantage point. Trends reported for ensemble perception suggest that the number of utilised objects-and, consequently, discrimination sensitivity-would increase with set size. However, we find little indication that increasing the number of objects in a scene increased discrimination sensitivity. In Experiment 2, an equivalent noise analysis was used to measure participants' internal noise and the number of objects used to judge the average light source direction in a scene, finding that participants relied on 1 or 2 objects to make their judgement regardless of whether 9 or 25 objects were present. In Experiment 3, participants completed a shape identification task that required an implicit judgement of light source direction, rather than an explicit judgement as in Experiments 1 and 2. We find that sensitivity for identifying surface shape was comparable for scenes containing 1, 9, and 25 objects. Our results suggest that the visual system relied on a small number of objects to estimate the direction of lighting in our rendered scenes.

Origin of Discrete and Continuous Dark Noise in Rod Photoreceptors

The detection of a single photon by a rod photoreceptor is limited by two sources of physiological noise, called discrete and continuous noise. Discrete noise occurs as intermittent current deflections with a waveform very similar to that of the single-photon response to real light and is thought to be produced by spontaneous activation of rhodopsin. Continuous noise occurs as random and continuous fluctuations in outer-segment current and is usually attributed to some intermediate in the phototransduction cascade. To confirm the origin of these noise sources, we have recorded from retinas of mouse lines with rods having reduced levels of rhodopsin, transducin, or phosphodiesterase. We show that the rate of discrete noise is diminished in proportion to the decrease in rhodopsin concentration, and that continuous noise is independent of transducin concentration but clearly elevated when the level of phosphodiesterase is reduced. Our experiments provide new molecular evidence that discrete noise is indeed produced by rhodopsin itself, and that continuous noise is generated by spontaneous activation of phosphodiesterase resulting in random fluctuations in outer-segment current.

Contributions of the Basal Ganglia to Visual Perceptual Decisions

The basal ganglia (BG) make up a prominent nexus between visual and motor-related brain regions. In contrast to the BG's well-established roles in movement control and value-based decision making, their contributions to the transformation of visual input into an action remain unclear, especially in the context of perceptual decisions based on uncertain visual evidence. This article reviews recent progress in our understanding of the BG's contributions to the formation, evaluation, and adjustment of such decisions. From theoretical and experimental perspectives, the review focuses on four key stations in the BG network, namely, the striatum, pallidum, subthalamic nucleus, and midbrain dopamine neurons, which can have different roles and together support the decision process.

Amblyopic stereo vision is efficient but noisy

People with amblyopia demonstrate a reduced ability to judge depth using stereopsis. Our understanding of this deficit is limited, as standard clinical stereo tests may not be suited to give a quantitative account of the residual stereo ability in amblyopia. In this study we used a stereo test designed specifically for that purpose. Participants identified the location of a disparity-defined odd-one-out target within a random-dot display. We tested 29 amblyopic (3 strabismic, 17 anisometropic, 9 mixed) participants and 17 control participants. We obtained stereoacuity thresholds from 59% of our amblyopic participants. There was a factor of two difference between the median stereoacuity of our amblyopic (103 arcsec) and control (56 arcsec) groups. We used the equivalent noise method to evaluate the role of equivalent internal noise and processing efficiency in amblyopic stereopsis. Using the linear amplifier model (LAM), we determined the threshold difference was due to a greater equivalent internal noise in the amblyopic group (238 vs 135 arcsec), with no significant difference in processing efficiency. A multiple linear regression determined 56% of the stereoacuity variance within the amblyopic group was predicted by the two LAM parameters, with equivalent internal noise predicting 46% alone. Analysis of control group data aligned with our previous work, finding that trade-offs between equivalent internal noise and efficiency play a greater role. Our results allow a better understanding of what is limiting amblyopic performance in our task. We find this to be a reduced quality of disparity signals in the input to the task-specific processing.

Hierarchical Bayesian perceptual template modeling of mechanisms of spatial attention in central and peripheral cuing

The external noise paradigm and perceptual template model (PTM) have successfully been applied to characterize observer properties and mechanisms of observer state changes (e.g. attention and perceptual learning) in several research domains, focusing on individual level analysis. In this study, we developed a new hierarchical Bayesian perceptual template model (HBPTM) to model the trial-by-trial data from all individuals and conditions in a published spatial cuing study within a single structure and compared its performance to that of a Bayesian Inference Procedure (BIP), which separately infers the posterior distributions of the model parameters for each individual subject without the hierarchical structure. The HBPTM allowed us to compute the joint posterior distribution of the hyperparameters and parameters at the population, observer, and experiment levels and make statistical inferences at all these levels. In addition, we ran a large simulation study that varied the number of observers and number of trials in each condition and demonstrated the advantage of the HBPTM over the BIP across all the simulated datasets. Although it is developed in the context of spatial attention, the HBPTM and its extensions can be used to model data from the external noise paradigm in other domains and enable predictions of human performance at both the population and individual levels.

Colour vision in nocturnal insects

The ability to see colour at night is known only from a handful of animals. First discovered in the elephant hawk moth Deilephila elpenor, nocturnal colour vision is now known from two other species of hawk moths, a single species of carpenter bee, a nocturnal gecko and two species of anurans. The reason for this rarity—particularly in vertebrates—is the immense challenge of achieving a sufficient visual signal-to-noise ratio to support colour discrimination in dim light. Although no less challenging for nocturnal insects, unique optical and neural adaptations permit reliable colour vision and colour constancy even in starlight. Using the well-studied Deilephila elpenor, we describe the visual light environment at night, the visual challenges that this environment imposes and the adaptations that have evolved to overcome them. We also explain the advantages of colour vision for nocturnal insects and its usefulness in discriminating night-opening flowers. Colour vision is probably widespread in nocturnal insects, particularly pollinators, where it is likely crucial for nocturnal pollination. This relatively poorly understood but vital ecosystem service is threatened from increasingly abundant and spectrally abnormal sources of anthropogenic light pollution, which can disrupt colour vision and thus the discrimination and pollination of flowers.

This article is part of the theme issue ‘Understanding colour vision: molecular, physiological, neuronal and behavioural studies in arthropods’.

A new computational model illuminates the extraordinary eyes of Phronima

Vision in the midwater of the open ocean requires animals to perform visual tasks quite unlike those of any other environment. These tasks consist of detecting small, low contrast objects and point sources against a relatively dim and uniform background. Deep-sea animals have evolved many extraordinary visual adaptations to perform these tasks. Linking eye anatomy to specific selective pressures, however, is challenging, not least because of the many difficulties of studying deep-sea animals. Computational modelling of vision, based on detailed morphological reconstructions of animal eyes, along with underwater optics, offers a chance to understand the specific visual capabilities of individual visual systems. Prior to the work presented here, comprehensive models for apposition compound eyes in the mesopelagic, the dominant eye form of crustaceans, were lacking. We adapted a model developed for single-lens eyes and used it to examine how different parameters affect the model’s ability to detect point sources and extended objects. This new model also allowed us to examine spatial summation as a means to improve visual performance. Our results identify a trade-off between increased depth range over which eyes function effectively and increased distance at which extended objects can be detected. This trade-off is driven by the size of the ommatidial acceptance angle. We also show that if neighbouring ommatidia have overlapping receptive fields, spatial summation helps with all detection tasks, including the detection of bioluminescent point sources. By applying our model to the apposition compound eyes of Phronima, a mesopelagic hyperiid amphipod, we show that the specialisations of the large medial eyes of Phronima improve both the detection of point sources and of extended objects. The medial eyes outperformed the lateral eyes at every modelled detection task. We suggest that the small visual field size of Phronima’s medial eyes and the strong asymmetry between the medial and lateral eyes reflect Phronima’s need for effective vision across a large depth range and its habit of living inside a barrel. The barrel’s narrow aperture limits the usefulness of a large visual field and has allowed a strong asymmetry between the medial and lateral eyes. The model provides a useful tool for future investigations into the visual abilities of apposition compound eyes in the deep sea.

How do animals see the world? This is particularly an interesting question when the animal’s eyes look very different from our own, or if they inhabit an environment that is visually very different from ours. Biologists approach this question by seeking to determine not only how animal eyes function but also what selective pressures led to the evolution of their eyes. Understanding the eyes of deep-sea animals is particularly intriguing and more challenging than usual because their visual world is so dramatically different from our own and they are inaccessible and therefore hard to study. Understanding their visual capabilities by behavioural or physiological experiments is at best extremely challenging and often impossible. However, modelling of their visual abilities, by combining knowledge about ocular anatomy with information about the way light propagates in the deep sea, is comparatively tractable. Here we present a computational model that predicts the ability of apposition compound eyes (eyes that are widely found in many arthropod invertebrates) to detect salient visual targets in the deep sea between 200 and 700 m below the surface. We use this model specifically to examine the extraordinary ‘double eyes’ of the midwater hyperiid amphipod Phronima that have perplexed scientists for decades. This allowed us to put forward a new hypothesis about the selective pressures that have led to Phronima’s unusual eyes. The predictive model we present here also provides a framework for future assessments of visual performance of apposition compound eyes in other deep-sea animals.

Night skies through animals' eyes-Quantifying night-time visual scenes and light pollution as viewed by animals

A large proportion of animal species enjoy the benefits of being active at night, and have evolved the corresponding optical and neural adaptations to cope with the challenges of low light intensities. However, over the past century electric lighting has introduced direct and indirect light pollution into the full range of terrestrial habitats, changing nocturnal animals' visual worlds dramatically. To understand how these changes affect nocturnal behavior, we here propose an animal-centered analysis method based on environmental imaging. This approach incorporates the sensitivity and acuity limits of individual species, arriving at predictions of photon catch relative to noise thresholds, contrast distributions, and the orientation cues nocturnal species can extract from visual scenes. This analysis relies on just a limited number of visual system parameters known for each species. By accounting for light-adaptation in our analysis, we are able to make more realistic predictions of the information animals can extract from nocturnal visual scenes under different levels of light pollution. With this analysis method, we aim to provide context for the interpretation of behavioral findings, and to allow researchers to generate specific hypotheses for the behavior of nocturnal animals in observed light-polluted scenes.

Acute Alcohol Intake Affects Internal Additive Noise and the Perceptual Template in Visual Perception

A reduction in visual performance is among the serious consequences of acute alcohol intake. Contrast sensitivity (CS) is a fundamental feature of visual function. Here, we investigated the negative effect of a moderate dose of alcohol on CS across a wide range of spatial frequencies and with multiple levels of external noise and clarified the corresponding mechanisms in the context of a perceptual template model (PTM). To avoid the effect of alcohol washout, a quick contrast sensitivity function (qCSF) method was used to assess the visual performance of subjects before and 30 min after a moderate dose of alcohol intake. We found that (1) CS was significantly disrupted by acute alcohol intake; (2) alcohol-induced CS loss was dependent on spatial frequency and external noise; and (3) increased internal additive noise and an impaired perceptual template accounted for alcohol-induced CS loss. These results help us better understand the negative effect of alcohol consumption and provide guidance for driver safety studies.

A neural surveyor to map touch on the body

Perhaps the most recognizable “sensory map” in neuroscience is the somatosensory homunculus. Although the homunculus suggests a direct link between cortical territory and body part, the relationship is actually ambiguous without a decoder that knows this mapping. How the somatosensory system derives a spatial code from an activation in the homunculus is a longstanding mystery we aimed to solve. We propose that touch location is disambiguated using multilateration, a computation used by surveying and global positioning systems to localize objects. We develop a Bayesian formulation of multilateration, which we implement in a neural network to identify its computational signature. We then detect this signature in psychophysical experiments. Our results suggest that multilateration provides the homunculus-to-body mapping necessary for localizing touch.

Perhaps the most recognizable sensory map in all of neuroscience is the somatosensory homunculus. Although it seems straightforward, this simple representation belies the complex link between an activation in a somatotopic map and the associated touch location on the body. Any isolated activation is spatially ambiguous without a neural decoder that can read its position within the entire map, but how this is computed by neural networks is unknown. We propose that the somatosensory system implements multilateration, a common computation used by surveying and global positioning systems to localize objects. Specifically, to decode touch location on the body, multilateration estimates the relative distance between the afferent input and the boundaries of a body part (e.g., the joints of a limb). We show that a simple feedforward neural network, which captures several fundamental receptive field properties of cortical somatosensory neurons, can implement a Bayes-optimal multilateral computation. Simulations demonstrated that this decoder produced a pattern of localization variability between two boundaries that was unique to multilateration. Finally, we identify this computational signature of multilateration in actual psychophysical experiments, suggesting that it is a candidate computational mechanism underlying tactile localization.

Real models: The limits of behavioural evidence for understanding the ANS

Clarke and Beck use behavioural evidence to argue that (1) approximate ratio computations are sufficient for claiming that the approximate number system (ANS) represents the rationals, and (2) the ANS does not represent the reals. We argue that pure behaviour is a poor litmus test for this problem, and that we should trust the psychophysical models that place ANS representations within the reals.

Double-pass consistency for amplitude- and frequency-modulation detection in normal-hearing listeners

Amplitude modulation (AM) and frequency modulation (FM) provide crucial auditory information. If FM is encoded as AM, it should be possible to give a unified account of AM and FM perception both in terms of response consistency and performance. These two aspects of behavior were estimated for normal-hearing participants using a constant-stimuli, forced-choice detection task repeated twice with the same stimuli (double pass). Sinusoidal AM or FM with rates of 2 or 20 Hz were applied to a 500-Hz pure-tone carrier and presented at detection threshold. All stimuli were masked by a modulation noise. Percent agreement of responses across passes and percent-correct detection for the two passes were used to estimate consistency and performance, respectively. These data were simulated using a model implementing peripheral processes, a central modulation filterbank, an additive internal noise, and a template-matching device. Different levels of internal noise were required to reproduce AM and FM data, but a single level could account for the 2- and 20-Hz AM data. As for FM, two levels of internal noise were needed to account for detection at slow and fast rates. Finally, the level of internal noise yielding best predictions increased with the level of the modulation-noise masker. Overall, these results suggest that different sources of internal variability are involved for AM and FM detection at low audio frequencies.

Quantifying Uncertainty of the Estimated Visual Acuity Behavioral Function With Hierarchical Bayesian Modeling

Purpose

The goal of this study is to develop a hierarchical Bayesian model (HBM) to better quantify uncertainty in visual acuity (VA) tests by incorporating the relationship between VA threshold and range across multiple individuals and tests.

Methods

The three-level HBM consisted of multiple two-dimensional Gaussian distributions of hyperparameters and parameters of the VA behavioral function (VABF) at the population, individual, and test levels. The model was applied to a dataset of quantitative VA (qVA) assessments of 14 eyes in 4 Bangerter foil conditions. We quantified uncertainties of the estimated VABF parameters (VA threshold and range) from the HBM and compared them with those from the qVA.

Results

The HBM recovered covariances between VABF parameters and provided better fits to the data than the qVA. It reduced the uncertainty of their estimates by 4.2% to 45.8%. The reduction of uncertainty, on average, resulted in 3 fewer rows needed to reach a 95% accuracy in detecting a 0.15 logMAR change of VA threshold or both parameters than the qVA.

Conclusions

The HBM utilized knowledge across individuals and tests in a single model and provided better quantification of the uncertainty of the estimated VABF, especially when the number of tested rows was relatively small.

Translational Relevance

The HBM can increase the accuracy in detecting VA changes. Further research is necessary to evaluate its potential in clinical populations.

A reinterpretation of critical flicker-frequency (CFF) data reveals key details about light adaptation and normal and abnormal visual processing

Our ability to see flicker has an upper frequency limit above which flicker is invisible, known as the "critical flicker frequency" (CFF), that typically grows with light intensity (I). The relation between CFF and I, the focus of nearly 200 years of research, is roughly logarithmic, i.e., CFF ∝ log(I)-a relation called the Ferry-Porter law. However, why this law should occur, and how it relates to the underlying physiology, have never been adequately explained. Over the past two decades we have measured CFF in normal observers and in patients with retinal gene defects. Here, we reanalyse and model our data and historical CFF data. Remarkably, CFF-versus-I functions measured under a wide range of conditions in patients and in normal observers all have broadly similar shapes when plotted in double-logarithmic coordinates, i.e., log (CFF)-versus-log(I). Thus, the entire dataset can be characterised by horizontal and vertical logarithmic shifts of a fixed-shape template. Shape invariance can be predicted by a simple model of visual processing built from a sequence of low-pass filters, subtractive feedforward stages and gain adjustment (Rider, Henning & Stockman, 2019). It depends primarily on the numbers of visual processing stages that approach their power-law region at a given intensity and a frequency-independent gain reduction at higher light levels. Counter-intuitively, the CFF-versus-I relation depends primarily on the gain of the visual response rather than its speed-a conclusion that changes our understanding and interpretation of human flicker perception. The Ferry-Porter "law" is merely an approximation of the shape-invariant template.

Identification of Multiple Noise Sources Improves Estimation of Neural Responses across Stimulus Conditions

Most models of neural responses are constructed to reproduce the average response to inputs but lack the flexibility to capture observed variability in responses. The origins and structure of this variability have significant implications for how information is encoded and processed in the nervous system, both by limiting information that can be conveyed and by determining processing strategies that are favorable for minimizing its negative effects. Here, we present a new modeling framework that incorporates multiple sources of noise to better capture observed features of neural response variability across stimulus conditions. We apply this model to retinal ganglion cells at two different ambient light levels and demonstrate that it captures the full distribution of responses. Further, the model reveals light level-dependent changes that could not be seen with previous models, showing both large changes in rectification of nonlinear circuit elements and systematic differences in the contributions of different noise sources under different conditions.

Coming of Age in Science: Just Look?

With Professor Patrick Cavanagh, I started the Harvard Vision Sciences Laboratory in 1990. Blessed with the largesse of a wealthy university, we occupied a very large common space. Here, students pursued their own projects in a uniquely cooperative and exciting scientific environment. The times were just right in the emerging and expanding field of vision science. With good thesis projects under their belt, most of the students went on to successful careers. However, my own coming of age in science did not have such promising start. It only started well into my thirties when I joined the Smith Kettlewell Eye Research Institute in San Francisco. Providentially, it was there that I had the rare and unique opportunity to work closely and essentially only with peers (not students). Through these intense collaborations, I found my way as a scientist. Most of this account describes these formative years. Expected final online publication date for the Annual Review of Vision Science, Volume 7 is September 2021. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.

Properties of multivesicular release from mouse rod photoreceptors support transmission of single-photon responses

Vision under starlight requires rod photoreceptors to transduce and transmit single-photon responses to the visual system. Small single-photon voltage changes must therefore cause detectable reductions in glutamate release. We found that rods achieve this by employing mechanisms that enhance release regularity and its sensitivity to small voltage changes. At the resting membrane potential in darkness, mouse rods exhibit coordinated and regularly timed multivesicular release events, each consisting of ~17 vesicles and occurring two to three times more regularly than predicted by Poisson statistics. Hyperpolarizing rods to mimic the voltage change produced by a single photon abruptly reduced the probability of multivesicular release nearly to zero with a rebound increase at stimulus offset. Simulations of these release dynamics indicate that this regularly timed, multivesicular release promotes transmission of single-photon responses to post-synaptic rod-bipolar cells. Furthermore, the mechanism is efficient, requiring lower overall release rates than uniquantal release governed by Poisson statistics.

Vitamin A1/A2 chromophore exchange: Its role in spectral tuning and visual plasticity

Vertebrate rod and cone photoreceptors detect light via a specialized organelle called the outer segment. This structure is packed with light-sensitive molecules known as visual pigments that consist of a G-protein-coupled, seven-transmembrane protein known as opsin, and a chromophore prosthetic group, either 11-cis retinal ('A₁') or 11-cis 3,4-didehydroretinal ('A₂'). The enzyme cyp27c1 converts A₁ into A₂ in the retinal pigment epithelium. Replacing A₁ with A₂ in a visual pigment red-shifts its spectral sensitivity and broadens its bandwidth of absorption at the expense of decreased photosensitivity and increased thermal noise. The use of vitamin A₂-based visual pigments is strongly associated with the occupation of aquatic habitats in which the ambient light is red-shifted. By modulating the A₁/A₂ ratio in the retina, an organism can dynamically tune the spectral sensitivity of the visual system to better match the predominant wavelengths of light in its environment. As many as a quarter of all vertebrate species utilize A₂, at least during a part of their life cycle or under certain environmental conditions. A₂ utilization therefore represents an important and widespread mechanism of sensory plasticity. This review provides an up-to-date account of the A₁/A₂ chromophore exchange system.

Threshold vision under full-field stimulation: Revisiting the minimum number of quanta necessary to evoke a visual sensation

At the absolute threshold of vision, Hecht, Shlaer and Pirenne estimate that 5-14 photons are absorbed within a retinal area containing ~500 rods. Other estimates of scotopic threshold vision based on stimuli with different durations and focal areas range up to ~100,000 photons. Given that rod density varies with retinal eccentricity and the magnitude of the intrinsic noise increases with increasing stimulus area and duration, here we determine whether the scotopic threshold estimates with focal stimuli can be extended to full-field stimulation and whether summation explains inter-study differences. We show that full-field threshold vision (~1018 mm², 10 ms duration) is more sensitive than at absolute threshold, requiring the absorption of ~1000 photons across ~91.96 million rods. A summation model is presented integrating our and published data and using a nominal exposure duration, criterion frequency of seeing, rod density, and retinal area that largely explains the inter-study differences and allows estimation of rods per photon ratio for any stimulus size and duration. The highest signal to noise ratio is defined by a peak rod convergence estimated at 53:4:1:2 (rods:rod bipolar cells:AII amacrine cells:retinal ganglion cells), in line with macaque anatomical estimates that show AII amacrine cells form the bottleneck in the rod pathway to set the scotopic visual limit. Our model estimations that the rods per photon ratio under full-field stimulation is ~3000X higher than at absolute threshold are in accordance with visual summation effects and provide an alternative approach for understanding the limits of scotopic vision.

Increased Equivalent Input Noise in Glaucomatous Central Vision: Is it Due to Undersampling of Retinal Ganglion Cells?

Purpose

Recent evidence shows that macular damage is common even in early stages of glaucoma. Here we investigated whether contrast sensitivity loss in the central vision of glaucoma patients is due to an increase in equivalent input noise (Neq), a decrease in calculation efficiency, or both. We also examined how retinal undersampling resulting from loss of retinal ganglion cells (RGCs) may affect Neq and calculation efficiency.

Methods

This study included 21 glaucoma patients and 23 age-matched normally sighted individuals. Threshold contrast for orientation discrimination was measured with a sinewave grating embedded in varying levels of external noise. Data were fitted to the linear amplifier model (LAM) to factor contrast sensitivity into Neq and calculation efficiency. We also correlated macular RGC counts estimated from structural (spectral-domain optical coherence tomography) and functional (standard automated perimetry Swedish interactive thresholding algorithm 10-2) data with either Neq or efficiency. Furthermore, using analytical and computer simulation approach, the relative effect of retinal undersampling on Neq and efficiency was evaluated by adding the RGC sampling module into the LAM.

Results

Compared with normal controls, glaucoma patients exhibited a significantly larger Neq without significant difference in efficiency. Neq was significantly correlated with Pelli-Robson contrast sensitivity and macular RGC counts. The results from analytical derivation and model simulation further demonstrated that Neq can be expressed as a function of internal noise and retinal sampling.

Conclusions

Our results showed that equivalent input noise is significantly elevated in glaucomatous vision, thereby impairing foveal contrast sensitivity. Our findings further elucidated how undersampling at the retinal level may increase equivalent input noise.

The exceptional diversity of visual adaptations in deep-sea teleost fishes

The deep-sea is the largest and one of the dimmest habitats on earth. In this extreme environment, every photon counts and may make the difference between life and death for its inhabitants. Two sources of light are present in the deep-sea; downwelling light, that becomes dimmer and spectrally narrower with increasing depth until completely disappearing at around 1000 m, and bioluminescence, the light emitted by animals themselves. Despite these relatively dark and inhospitable conditions, many teleost fish have made the deep-sea their home, relying heavily on vision to survive. Their visual systems have had to adapt, sometimes in astonishing and bizarre ways. This review examines some aspects of the visual system of deep-sea teleosts and highlights the exceptional diversity in both optical and retinal specialisations. We also reveal how widespread several of these adaptations are across the deep-sea teleost phylogeny. Finally, the significance of some recent findings as well as the surprising diversity in visual adaptations is discussed.

Fundamental bounds on the fidelity of sensory cortical coding

How the brain processes information accurately despite stochastic neural activity is a longstanding question¹. For instance, perception is fundamentally limited by the information that the brain can extract from the noisy dynamics of sensory neurons. Seminal experiments^2,3 suggest that correlated noise in sensory cortical neural ensembles is what limits their coding accuracy^4-6, although how correlated noise affects neural codes remains debated^7-11. Recent theoretical work proposes that how a neural ensemble's sensory tuning properties relate statistically to its correlated noise patterns is a greater determinant of coding accuracy than is absolute noise strength^12-14. However, without simultaneous recordings from thousands of cortical neurons with shared sensory inputs, it is unknown whether correlated noise limits coding fidelity. Here we present a 16-beam, two-photon microscope to monitor activity across the mouse primary visual cortex, along with analyses to quantify the information conveyed by large neural ensembles. We found that, in the visual cortex, correlated noise constrained signalling for ensembles with 800-1,300 neurons. Several noise components of the ensemble dynamics grew proportionally to the ensemble size and the encoded visual signals, revealing the predicted information-limiting correlations^12-14. Notably, visual signals were perpendicular to the largest noise mode, which therefore did not limit coding fidelity. The information-limiting noise modes were approximately ten times smaller and concordant with mouse visual acuity¹⁵. Therefore, cortical design principles appear to enhance coding accuracy by restricting around 90% of noise fluctuations to modes that do not limit signalling fidelity, whereas much weaker correlated noise modes inherently bound sensory discrimination.

Rod nuclear architecture determines contrast transmission of the retina and behavioral sensitivity in mice

Rod photoreceptors of nocturnal mammals display a striking inversion of nuclear architecture, which has been proposed as an evolutionary adaptation to dark environments. However, the nature of visual benefits and the underlying mechanisms remains unclear. It is widely assumed that improvements in nocturnal vision would depend on maximization of photon capture at the expense of image detail. Here, we show that retinal optical quality improves 2-fold during terminal development, and that this enhancement is caused by nuclear inversion. We further demonstrate that improved retinal contrast transmission, rather than photon-budget or resolution, enhances scotopic contrast sensitivity by 18–27%, and improves motion detection capabilities up to 10-fold in dim environments. Our findings therefore add functional significance to a prominent exception of nuclear organization and establish retinal contrast transmission as a decisive determinant of mammalian visual perception.

The mechanism of photon-like dark noise in rod photoreceptors

Pugh highlights recent work ruling out a role for ultraweak photon emission in spontaneous photon-like events in retinal rods.

Dim-light vision in jumping spiders (Araneae, Salticidae): identification of prey and rivals

Jumping spiders (family Salticidae) are known for their intricate vision-based behavior during encounters with prey and conspecific individuals. This is achieved using eyes specialized for discerning fine detail, but there has been minimal research on the capacity that salticids might have for visual performance under low ambient light levels. Here, we investigated the capacity of two salticid species, Cyrba algerina from Portugal and Cyrba ocellata from Kenya, to perform two specific visual tasks under low ambient light levels. We used lures made from spiders and midges in prey-identification experiments and mirror images (virtual conspecifics) in rival-identification experiments. These experiments were implemented under a range of ambient light levels (234, 1.35, 0.54, 0.24 cd m^-2). In most instances, C algerina and C ocellata were proficient at performing both of these visual tasks when ambient light was 234 and 1.35 cd m^-2, and a minority performed these tasks at 0.54 cd m^-2, but none succeeded when the light level was 0.24 cd m^-2 Cyrba algerina and C. ocellata showed vision-based discrimination under low ambient light levels previously associated with nocturnal species.

Dopaminergic modulation of retinal processing from starlight to sunlight

Neuromodulators such as dopamine, enable context-dependent plasticity of neural circuit function throughout the central nervous system. For example, in the retina, dopamine tunes visual processing for daylight and nightlight conditions. Specifically, high levels of dopamine release in the retina tune vision for daylight (photopic) conditions, while low levels tune it for nightlight (scotopic) conditions. This review covers the cellular and circuit-level mechanisms within the retina that are altered by dopamine. These mechanisms include changes in gap junction coupling and ionic conductances, both of which are altered by the activation of diverse types of dopamine receptors across diverse types of retinal neurons. We contextualize the modulatory actions of dopamine in terms of alterations and optimizations to visual processing under photopic and scotopic conditions, with particular attention to how they differentially impact distinct cell types. Finally, we discuss how transgenic mice and disease models have shaped our understanding of dopaminergic signaling and its role in visual processing. Cumulatively, this review illustrates some of the diverse and potent mechanisms through which neuromodulation can shape brain function.

Ricco's law and absolute threshold for foveal detection of black holes

Visual detection of small black objects surrounded by a light background depends on background luminance, pupil size, optical blur, and object size. Holding pupil and optics fixed, we measured the minimum background luminance needed for foveal detection of small black targets as a function of target size. For all three observers, absolute threshold varied inversely with target area when disk diameter subtended less than 10^' of visual angle. For target diameter ≥10^', threshold remained constant at about 0.3 Td, which was also the absolute threshold for detecting light spots 10^' or larger in diameter on a black background. These results are consistent with Ricco's law of spatial summation: a "black hole" is just detectable when the background luminance is sufficiently high for its absence inside the Ricco area to reduce 555 nm photon flux by 7500 photons/s, which is the same change needed to detect light spots on a black surround. These results can be accounted for by a differential pair of Ricco detectors, each about the size of the receptive field center of magocellular retinal ganglion cells when projected into object space through the eye's weakly aberrated optical system. Statistical analysis of the model suggests the quantum fluctuations due to internal, biological noise (i.e., "scotons") are a greater handicap than the photon fluctuations inherent in the light stimulus at absolute foveal threshold.

Probing Computation in the Primate Visual System at Single-Cone Resolution

Daylight vision begins when light activates cone photoreceptors in the retina, creating spatial patterns of neural activity. These cone signals are then combined and processed in downstream neural circuits, ultimately producing visual perception. Recent technical advances have made it possible to deliver visual stimuli to the retina that probe this processing by the visual system at its elementary resolution of individual cones. Physiological recordings from nonhuman primate retinas reveal the spatial organization of cone signals in retinal ganglion cells, including how signals from cones of different types are combined to support both spatial and color vision. Psychophysical experiments with human subjects characterize the visual sensations evoked by stimulating a single cone, including the perception of color. Future combined physiological and psychophysical experiments focusing on probing the elementary visual inputs are likely to clarify how neural processing generates our perception of the visual world.

Eye and wing structure closely reflects the visual ecology of dung beetles

An important resource partitioning strategy allowing dung beetles to coexist in the same habitat, while utilising the same food, is species' separation of activity times. After establishing the diel activity period of three closely related, co-occurring dung beetles, we examined their eye and wing morphology. Absolute and relative eye size, and facet size were greater in the nocturnal Escarabaeus satyrus, followed by the crepuscular Scarabaeus zambesianus and then the diurnal Kheper lamarcki. The diurnal K. lamarcki had the highest wing aspect ratio (long, narrow wings), followed by the crepuscular S. zambesianus and the nocturnal E. satyrus (short, broad wings), suggesting that dim-light active species fly slower than diurnal species. In addition, the two species active in dim light had a lower wing loading than the diurnal species, indicating the need for greater manoeuvrability in the dark. Analyses of wing shape revealed that the diurnal K. lamarcki wing had a proportionally larger jugal and anal region than both dim light species. Our results show that different species of dung beetles have a combination of optical and morphological wing adaptations to support their foraging activities in diverse light conditions.

Both a Gauge and a Filter: Cognitive Modulations of Pupil Size

Over 50 years of research have established that cognitive processes influence pupil size. This has led to the widespread use of pupil size as a peripheral measure of cortical processing in psychology and neuroscience. However, the function of cortical control over the pupil remains poorly understood. Why does visual attention change the pupil light reflex? Why do mental effort and surprise cause pupil dilation? Here, we consider these functional questions as we review and synthesize two literatures on cognitive effects on the pupil: how cognition affects pupil light response and how cognition affects pupil size under constant luminance. We propose that cognition may have co-opted control of the pupil in order to filter incoming visual information to optimize it for particular goals. This could complement other cortical mechanisms through which cognition shapes visual perception.

Temporal resolution of single-photon responses in primate rod photoreceptors and limits imposed by cellular noise

Sensory receptor noise corrupts sensory signals, contributing to imperfect perception and dictating central processing strategies. For example, noise in rod phototransduction limits our ability to detect light, and minimizing the impact of this noise requires precisely tuned nonlinear processing by the retina. But detection sensitivity is only one aspect of night vision: prompt and accurate behavior also requires that rods reliably encode the timing of photon arrivals. We show here that the temporal resolution of responses of primate rods is much finer than the duration of the light response and identify the key limiting sources of transduction noise. We also find that the thermal activation rate of rhodopsin is lower than previous estimates, implying that other noise sources are more important than previously appreciated. A model of rod single-photon responses reveals that the limiting noise relevant for behavior depends critically on how rod signals are pooled by downstream neurons. NEW & NOTEWORTHY Many studies have focused on the visual system's ability to detect photons, but not on its ability to encode the relative timing of detected photons. Timing is essential for computations such as determining the velocity of moving objects. Here we examine the timing precision of primate rod photoreceptor responses and show that it is more precise than previously appreciated. This motivates an evaluation of whether scotopic vision approaches limits imposed by rod temporal resolution.

Seafinding revisited: how hatchling marine turtles respond to natural lighting at a nesting beach

Hatchling marine turtles emerge at night from underground nests on oceanic beaches and then use visual cues to crawl from the nest site to the sea ("seafinding"). However, the light wavelengths (λ's) used to accomplish this orientation have not been thoroughly documented, nor do we understand why some λ's are favored over others. We measured nocturnal radiance on the horizon at 20 nm intervals between 340 and 600 nm at two nesting beach sites and then, under laboratory conditions, determined the lowest intensities of those λ's that induced green turtle and loggerhead hatchlings to crawl toward each light source (a low positive "phototaxis threshold"). Both species were similarly sensitive and were attracted to all λ's. Radiance measures at all λ's were greater toward the seaward horizon than toward the landward horizon, providing an important orientation cue regardless of variation in lunar illumination. Previous studies document that both species detect λ's longer than those that are most attractive. We hypothesize that seafinding is a specialized response mediated by cones that are sensitive to the shorter λ's (to minimize the effects of dark noise) but such as rods, are especially sensitive to low levels of nocturnal illumination.

The effects of high-frequency transcranial random noise stimulation (hf-tRNS) on global motion processing: An equivalent noise approach

BACKGROUND

High frequency transcranial random noise stimulation (hf-tRNS) facilitates performance in several perceptual and cognitive tasks, however, little is known about the underlying modulatory mechanisms.

OBJECTIVE

In this study we compared the effects of hf-tRNS to those of anodal and cathodal tDCS in a global motion direction discrimination task. An equivalent noise (EN) paradigm was used to assess how hf-tRNS modulates the mechanisms underlying local and global motion processing.

METHOD

Motion coherence threshold and slope of the psychometric function were estimated using an 8AFC task in which observers had to discriminate the motion direction of a random dot kinematogram presented either in the left or right visual hemi-field. During the task hf-tRNS, anodal and cathodal tDCS were delivered over the left hMT⁺. In a subsequent experiment we implemented an EN paradigm in order to investigate the effects of hf-tRNS on the mechanisms involved in visual motion integration (i.e., internal noise and sampling).

RESULTS

hf-tRNS reduced the motion coherence threshold but did not affect the slope of the psychometric function, suggesting no modulation of stimulus discriminability. Anodal and cathodal tDCS did not produce any modulatory effects. EN analysis in the last experiment found that hf-tRNS modulates sampling but not internal noise, suggesting that hf-tRNS modulates the integration of local motion cues.

CONCLUSION

hf-tRNS interacts with the output neurons tuned to directions near to the directional signal, incrementing the signal-to-noise ratio and the pooling of local motion cues and thus increasing the sensitivity for global moving stimuli.

Correlated cone noise decreases rod signal contributions to the post-receptoral pathways

This study investigated how invisible extrinsic temporal white noise that correlates with the activity of one of the three [magnocellular (MC), parvocellular (PC), or koniocellular (KC)] post-receptoral pathways alters mesopic rod signaling. A four-primary photostimulator provided independent control of the rod and three cone photoreceptor excitations. The rod contributions to the three post-receptoral pathways were estimated by perceptually matching a 20% contrast rod pulse by independently varying the LMS (MC pathway), +L-M (PC pathway), and S-cone (KC pathway) excitations. We show that extrinsic cone noise caused a predominant decrease in the overall magnitude and ratio of the rod contributions to each pathway. Thus, the relative cone activity in the post-receptoral pathways determines the relative mesopic rod inputs to each pathway.

The discovery of the ability of rod photoreceptors to signal single photons

A retrospective on the scientific importance and impact of Hecht, Shlaer, and Pirenne’s classic 1942 paper, “Energy, Quanta, and Vision.”

Vertebrate rod photoreceptors evolved the astonishing ability to respond reliably to single photons. In parallel, the proximate neurons of the visual system evolved the ability to reliably encode information from a few single-photon responses (SPRs) as arising from the presence of an object of interest in the visual environment. These amazing capabilities were first inferred from measurements of human visual threshold by Hecht et al. (1942), whose paper has since been cited over 1,000 times. Subsequent research, in part inspired by Hecht et al.’s discovery, has directly measured rod SPRs, characterized the molecular mechanism responsible for their generation, and uncovered much about the specializations in the retina that enable the reliable transmission of SPRs in the teeth of intrinsic neuronal noise.

Internal noise sources limiting contrast sensitivity

Contrast sensitivity varies substantially as a function of spatial frequency and luminance intensity. The variation as a function of luminance intensity is well known and characterized by three laws that can be attributed to the impact of three internal noise sources: early spontaneous neural activity limiting contrast sensitivity at low luminance intensities (i.e. early noise responsible for the linear law), probabilistic photon absorption at intermediate luminance intensities (i.e. photon noise responsible for de Vries-Rose law) and late spontaneous neural activity at high luminance intensities (i.e. late noise responsible for Weber’s law). The aim of this study was to characterize how the impact of these three internal noise sources vary with spatial frequency and determine which one is limiting contrast sensitivity as a function of luminance intensity and spatial frequency. To estimate the impact of the different internal noise sources, the current study used an external noise paradigm to factorize contrast sensitivity into equivalent input noise and calculation efficiency over a wide range of luminance intensities and spatial frequencies. The impact of early and late noise was found to drop linearly with spatial frequency, whereas the impact of photon noise rose with spatial frequency due to ocular factors.

Is The Weber Fraction a Function of Physical or Perceived Input?

It is well known that a given physical input (e.g. intensity of light or sound, length or weight of an object) does not always give rise to the same sensation. For example, arrow heads affect the perceived length of lines (Muller-Lyer illusion) and size affects the apparent weight of an object (size-weight illusion). It is generally assumed that the differential threshold is a simple function of the physical intensity of the stimulus. We may however ask whether the differential threshold is affected by illusions.

To try to answer this question we estimate differential thresholds under a pair of conditions in which the relevant input is the same but appears different. Using the size-weight illusion, we have found that the differential threshold for weight is greater for a set of small weights than for a set of larger and apparently lighter weights.

Changes in Threshold Level Produced by a Signal Preceding or following the Threshold Stimulus

In a previous experiment (Howarth and Treisman, 1958) it was shown that when a warning preceded a stimulus by a fixed interval, the threshold level for the stimulus was higher the longer the fixed interval. A model of this effect was proposed, assuming that the threshold criterion adopted by the subject at any moment was modified by his estimate of the probability of a stimulus at that moment.

Three predictions are derived and tested. It is found that: the standard deviation of the response is constant despite the shifts in threshold induced; the threshold continues to fall as the interval from warning to stimulus is decreased to zero, with the lowest threshold when the warning signal and the stimulus are simultaneous; and that a warning signal following the stimulus by an interval of less than 0 5 to 1 sec. also lowers the threshold.

High internal noise and poor external noise filtering characterize perception in autism spectrum disorder

An emerging hypothesis postulates that internal noise is a key factor influencing perceptual abilities in autism spectrum disorder (ASD). Given fundamental and inescapable effects of noise on nearly all aspects of neural processing, this could be a critical abnormality with broad implications for perception, behavior, and cognition. However, this proposal has been challenged by both theoretical and empirical studies. A crucial question is whether and how internal noise limits perception in ASD, independently from other sources of perceptual inefficiency, such as the ability to filter out external noise. Here, we separately estimated internal noise and external noise filtering in ASD. In children and adolescents with and without ASD, we computationally modeled individuals' visual orientation discrimination in the presence of varying levels of external noise. The results revealed increased internal noise and worse external noise filtering in individuals with ASD. For both factors, we also observed high inter-individual variability in ASD, with only the internal noise estimates significantly correlating with severity of ASD symptoms. We provide evidence for reduced perceptual efficiency in ASD that is due to both increased internal noise and worse external noise filtering, while highlighting internal noise as a possible contributing factor to variability in ASD symptoms.

Behavioural and physiological limits to vision in mammals

Human vision is exquisitely sensitive-a dark-adapted observer is capable of reliably detecting the absorption of a few quanta of light. Such sensitivity requires that the sensory receptors of the retina, rod photoreceptors, generate a reliable signal when single photons are absorbed. In addition, the retina must be able to extract this information and relay it to higher visual centres under conditions where very few rods signal single-photon responses while the majority generate only noise. Critical to signal transmission are mechanistic optimizations within rods and their dedicated retinal circuits that enhance the discriminability of single-photon responses by mitigating photoreceptor and synaptic noise. We describe behavioural experiments over the past century that have led to the appreciation of high sensitivity near absolute visual threshold. We further consider mechanisms within rod photoreceptors and dedicated rod circuits that act to extract single-photon responses from cellular noise. We highlight how these studies have shaped our understanding of brain function and point out several unresolved questions in the processing of light near the visual threshold.This article is part of the themed issue 'Vision in dim light'.

Processing of single-photon responses in the mammalian On and Off retinal pathways at the sensitivity limit of vision

Visually guided behaviour at its sensitivity limit relies on single-photon responses originating in a small number of rod photoreceptors. For decades, researchers have debated the neural mechanisms and noise sources that underlie this striking sensitivity. To address this question, we need to understand the constraints arising from the retinal output signals provided by distinct retinal ganglion cell types. It has recently been shown in the primate retina that On and Off parasol ganglion cells, the cell types likely to underlie light detection at the absolute visual threshold, differ fundamentally not only in response polarity, but also in the way they handle single-photon responses originating in rods. The On pathway provides the brain with a thresholded, low-noise readout and the Off pathway with a noisy, linear readout. We outline the mechanistic basis of these different coding strategies and analyse their implications for detecting the weakest light signals. We show that high-fidelity, nonlinear signal processing in the On pathway comes with costs: more single-photon responses are lost and their propagation is delayed compared with the Off pathway. On the other hand, the responses of On ganglion cells allow better intensity discrimination compared with the Off ganglion cell responses near visual threshold.

This article is part of the themed issue ‘Vision in dim light’.

The remarkable visual capacities of nocturnal insects: vision at the limits with small eyes and tiny brains

Nocturnal insects have evolved remarkable visual capacities, despite small eyes and tiny brains. They can see colour, control flight and land, react to faint movements in their environment, navigate using dim celestial cues and find their way home after a long and tortuous foraging trip using learned visual landmarks. These impressive visual abilities occur at light levels when only a trickle of photons are being absorbed by each photoreceptor, begging the question of how the visual system nonetheless generates the reliable signals needed to steer behaviour. In this review, I attempt to provide an answer to this question. Part of the answer lies in their compound eyes, which maximize light capture. Part lies in the slow responses and high gains of their photoreceptors, which improve the reliability of visual signals. And a very large part lies in the spatial and temporal summation of these signals in the optic lobe, a strategy that substantially enhances contrast sensitivity in dim light and allows nocturnal insects to see a brighter world, albeit a slower and coarser one. What is abundantly clear, however, is that during their evolution insects have overcome several serious potential visual limitations, endowing them with truly extraordinary night vision.This article is part of the themed issue 'Vision in dim light'.