The unsolved mystery of vision

Cone-Opponent Ganglion Cells in the Primate Fovea Tuned to Non-Cardinal Color Directions

A long-standing question in vision science is how the three cone photoreceptor types - long (L), medium (M) and short (S) wavelength sensitive - combine to generate our perception of color. Hue perception can be described along two opponent axes: red-green and blue-yellow. Psychophysical measurements of color appearance indicate that the cone inputs to the red-green and blue-yellow opponent axes are M vs. L+S and L vs. M+S, respectively. However, the "cardinal directions of color space" revealed by psychophysical measurements of color detection thresholds are L vs. M and S vs. L+M. The cardinal directions match the most common cone-opponent retinal ganglion cells (RGCs) in the primate retina. Accordingly, the cone opponency necessary for color appearance is thought to be established in cortex. However, small populations with the appropriate M vs. L+S and L vs. M+S cone-opponency have been reported in large surveys of cone inputs to primate RGCs and their projections to the lateral geniculate nucleus (LGN) yet their existence continues to be debated. Resolving this long-standing open question is needed as a complete account of the cone-opponency in the retinal output is critical for efforts to understand how downstream neural circuits process color. Here, we performed adaptive optics calcium imaging to longitudinally and noninvasively measurements of the foveal RGC light responses in the living macaque eye. We confirm the presence of L vs. M+S and M vs. L+S neurons with non-cardinal cone-opponency and demonstrate that cone-opponent signals in the retinal output are substantially more diverse than classically thought.

Collective evolution learning model for vision-based collective motion with collision avoidance

Collective motion (CM) takes many forms in nature; schools of fish, flocks of birds, and swarms of locusts to name a few. Commonly, during CM the individuals of the group avoid collisions. These CM and collision avoidance (CA) behaviors are based on input from the environment such as smell, air pressure, and vision, all of which are processed by the individual and defined action. In this work, a novel vision-based CM with CA model (i.e., VCMCA) simulating the collective evolution learning process is proposed. In this setting, a learning agent obtains a visual signal about its environment, and throughout trial-and-error over multiple attempts, the individual learns to perform a local CM with CA which emerges into a global CM with CA dynamics. The proposed algorithm was evaluated in the case of locusts' swarms, showing the evolution of these behaviors in a swarm from the learning process of the individual in the swarm. Thus, this work proposes a biologically-inspired learning process to obtain multi-agent multi-objective dynamics.

In vivo extracellular recordings of thalamic and cortical visual responses reveal V1 connectivity rules

The brain's connectome provides the scaffold for canonical neural computations. However, a comparison of connectivity studies in the mouse primary visual cortex (V1) reveals that the average number and strength of connections between specific neuron types can vary. Can variability in V1 connectivity measurements coexist with canonical neural computations? We developed a theory-driven approach to deduce V1 network connectivity from visual responses in mouse V1 and visual thalamus (dLGN). Our method revealed that the same recorded visual responses were captured by multiple connectivity configurations. Remarkably, the magnitude and selectivity of connectivity weights followed a specific order across most of the inferred connectivity configurations. We argue that this order stems from the specific shapes of the recorded contrast response functions and contrast invariance of orientation tuning. Remarkably, despite variability across connectivity studies, connectivity weights computed from individual published connectivity reports followed the order we identified with our method, suggesting that the relations between the weights, rather than their magnitudes, represent a connectivity motif supporting canonical V1 computations.

Murburn model of vision: Precepts and proof of concept

The classical paradigm of visual physiology comprises of the following features: (i) rod/cone cells located at the rear end of the retina serve as the primary transducers of incoming photo-information, (ii) cis-trans retinal (C₂₀ H₂₈ O) transformations on rhodopsin act as the transduction switch to generate a transmittable signal, (iii) signal amplification occurs via GDP-GTP exchange at transducin, and (iv) the amplified signal is relayed (as an action potential) as a flux-based ripple of Na-K ions along the axons of neurons. Fundamental physical principles, chemical kinetics, and awareness of architecture of eye/retina prompt a questioning of these classical assumptions. In lieu, based on experimental and in silico findings, a simple space-time resolved murburn model for the physiology of phototransduction in the retina is presented wherein molecular oxygen plays key roles. It is advocated that: (a) photo-induced oxygen to superoxide conversion serves as the key step in signal transduction in the visual cycle, (b) all photoactive cells of the retina serve as photoreceptors and rods/cones serve as the ultimate electron source in the retina (deriving oxygen and nutrients from retinal pigmented epithelium), (c) signal amplification is through superoxide mediated phosphorylation of GDP bound to inactive transducin, thereby activating a GDP-based cascade (a new mechanism for trimeric G-proteins), and (d) signal relay is primarily an electron movement along the neuron, from dendritic source to synaptic sink. In particular, we specify the roles for the various modules of transducin and GDP-based activation of phosphodiesterase-6 in the physiology of visual transduction.

Conserved circuits for direction selectivity in the primate retina

The detection of motion direction is a fundamental visual function and a classic model for neural computation. In the non-primate retina, direction selectivity arises in starburst amacrine cell (SAC) dendrites, which provide selective inhibition to direction-selective retinal ganglion cells (dsRGCs). Although SACs are present in primates, their connectivity and the existence of dsRGCs remain open questions. Here, we present a connectomic reconstruction of the primate ON SAC circuit from a serial electron microscopy volume of the macaque central retina. We show that the structural basis for the SACs' ability to confer directional selectivity on postsynaptic neurons is conserved. SACs selectively target a candidate homolog to the mammalian ON-sustained dsRGCs that project to the accessory optic system (AOS) and contribute to gaze-stabilizing reflexes. These results indicate that the capacity to compute motion direction is present in the retina, which is earlier in the primate visual system than classically thought.

The organization of cholinergic projections in the visual thalamus of the mouse

Cholinergic projections from the brainstem serve as important modulators of activity in visual thalamic nuclei such as the dorsal lateral geniculate nucleus (dLGN). While these projections have been studied in several mammals, a comprehensive examination of their organization in the mouse is lacking. We used the retrograde transport of viruses or cholera toxin subunit B (CTB) injected in the dLGN, immunocytochemical labeling with antibodies against choline acetyltransferase (ChAT), brain nitric oxide synthase (BNOS), and vesicular acetylcholine transporter (VAChT), ChAT-Cre mice crossed with a reporter line (Ai9), as well as brainstem virus injections in ChAT-Cre mice to examine the pattern of thalamic innervation from cholinergic neurons in the pedunculopontine tegmental nucleus (PPTg), laterodorsal tegmental nucleus (LDTg), and the parabigeminal nucleus (PBG). Retrograde tracing demonstrated that the dLGN receives input from the PPTg, LDTg, and PBG. Viral tracing in ChAT-Cre mice and retrograde tracing combined with immunocytochemistry revealed that many of these inputs originate from cholinergic neurons in the PBG and PPTg. Most notable was an extensive cholinergic projection from the PBG which innervated most of the contralateral dLGN, with an especially dense concentration in the dorsolateral shell, as well as a small region in the dorsomedial pole of the ipsilateral dLGN. The PPTg was found to provide a sparse somewhat diffuse innervation of the ipsilateral dLGN. Neurons in the PPTg co-expressed ChAT, BNOS, and VAChT, whereas PBG neurons expressed ChAT, but not BNOS or VAChT. These results highlight the presence of distinct cholinergic populations that innervate the mouse dLGN.

Feature Detection by Retinal Ganglion Cells

Retinal circuits transform the pixel representation of photoreceptors into the feature representations of ganglion cells, whose axons transmit these representations to the brain. Functional, morphological, and transcriptomic surveys have identified more than 40 retinal ganglion cell (RGC) types in mice. RGCs extract features of varying complexity; some simply signal local differences in brightness (i.e., luminance contrast), whereas others detect specific motion trajectories. To understand the retina, we need to know how retinal circuits give rise to the diverse RGC feature representations. A catalog of the RGC feature set, in turn, is fundamental to understanding visual processing in the brain. Anterograde tracing indicates that RGCs innervate more than 50 areas in the mouse brain. Current maps connecting RGC types to brain areas are rudimentary, as is our understanding of how retinal signals are transformed downstream to guide behavior. In this article, I review the feature selectivities of mouse RGCs, how they arise, and how they are utilized downstream. Not only is knowledge of the behavioral purpose of RGC signals critical for understanding the retinal contributions to vision; it can also guide us to the most relevant areas of visual feature space. Expected final online publication date for the Annual Review of Vision Science, Volume 8 is September 2022. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.

Characterizing the canine and feline optic pathways in vivo with diffusion MRI

The visual system is known to be vital for cognition and perception in the feline and canine and much behavioral research for these species has used visual stimuli and focused on visual perception. There has been extensive investigations into the visual pathway in cats and dogs via histological and neurobiological methods, however to date, only one study has mapped the canine optic pathway in vivo. Advanced imaging methods such as diffusion MRI (DTI) have been routinely used in human research to study the visual system in vivo. This study applied DTI imaging methods to assess and characterize the optic pathway of feline and canine subjects in vivo. The optic nerve (ON), optic tract (OT), and optic radiation (OR) were successfully delineated for each species and the average volume and FA for each tract is reported. The application of DTI to map the optic pathway for canine and feline subjects provides a healthy baseline for comparison in future studies.

[Electroretinographic signs of retinal remodeling after experimental induction of retinal pigment epithelium atrophy]

Various animal models of atrophy of retinal pigment epithelium (RPE) are created in order to study certain aspects of geographical atrophy in humans. To study the effects of new methods of therapy, it is necessary to determine the objective functional markers of structural changes in the retina.

PURPOSE

To determine the alterations in activity of the retina that characterize its remodeling in induction of RPE atrophy.

MATERIAL AND METHODS

Full-field electroretinograms (ERG), pattern ERG, and multifocal ERG were recorded according to the ISCEV standards from the right eyes of twenty rabbits of the New Zealand albino breed 6-7 weeks after induction of RPE atrophy by subretinal administration of 0.9% sodium chloride or bevacizumab solution.

RESULTS

Characteristic electroretinographic signs of RPE atrophy and retinal remodeling are described. Changes in ERG indicate a predominant inhibition of the functional activity of photoreceptors compared with bipolar cells, which objectively reflects an impairment of their metabolism associated with RPE pathology. With the injection of bevacizumab, a sharp weakening of the functional symbiosis of Mueller cells with bipolar cells was observed. According to pattern ERG, the function of the retinal ganglion cells was reduced. The reaction of the paired eyes after induction of RPE atrophy included a moderate decrease in the amplitude of b-wave of photopic ERG and activation of glia-neuronal relationships.

CONCLUSION

Subretinal injections of 0.9% sodium chloride and bevacizumab trigger changes in the retina that reflect specific remodeling of retinal neurons of the second and third orders, which characterizes the used models of RPE atrophy.

Mouse vision: La vie en ultraviolet

Visual systems evolve to extract salient information from natural scenes. A new study demonstrates that the specialized organization of ultraviolet-sensitive photoreceptors in the mouse retina optimizes the visibility of aerial predators within the upper visual scenes experienced by mice.

Natural environment statistics in the upper and lower visual field are reflected in mouse retinal specializations

Pressures for survival make sensory circuits adapted to a species' natural habitat and its behavioral challenges. Thus, to advance our understanding of the visual system, it is essential to consider an animal's specific visual environment by capturing natural scenes, characterizing their statistical regularities, and using them to probe visual computations. Mice, a prominent visual system model, have salient visual specializations, being dichromatic with enhanced sensitivity to green and UV in the dorsal and ventral retina, respectively. However, the characteristics of their visual environment that likely have driven these adaptations are rarely considered. Here, we built a UV-green-sensitive camera to record footage from mouse habitats. This footage is publicly available as a resource for mouse vision research. We found chromatic contrast to greatly diverge in the upper, but not the lower, visual field. Moreover, training a convolutional autoencoder on upper, but not lower, visual field scenes was sufficient for the emergence of color-opponent filters, suggesting that this environmental difference might have driven superior chromatic opponency in the ventral mouse retina, supporting color discrimination in the upper visual field. Furthermore, the upper visual field was biased toward dark UV contrasts, paralleled by more light-offset-sensitive ganglion cells in the ventral retina. Finally, footage recorded at twilight suggests that UV promotes aerial predator detection. Our findings support that natural scene statistics shaped early visual processing in evolution.

Beyond cognitive templates: re-examining template metaphors used for animal recognition and navigation

The term 'cognitive template' originated from work in human-based cognitive science to describe a literal, stored, neural representation used in recognition tasks. As the study of cognition has expanded to non-human animals, the term has diffused to describe a wider range of animal cognitive tools and strategies that guide action through the recognition of and discrimination between external states. One potential reason for this non-standardized meaning and variable employment is that researchers interested in the broad range of animal recognition tasks enjoy the simplicity of the cognitive template concept and have allowed it to become shorthand for many dissimilar or unknown neural processes without deep scrutiny of how this metaphor might comport with underlying neurophysiology. We review the functional evidence for cognitive templates in fields such as perception, navigation, communication, and learning, highlighting any neural correlates identified by these studies. We find that the concept of cognitive templates has facilitated valuable exploration at the interface between animal behavior and cognition, but the quest for a literal template has failed to attain mechanistic support at the level of neurophysiology. This may be the result of a misled search for a single physical locus for the 'template' itself. We argue that recognition and discrimination processes are best treated as emergent and, as such, may not be physically localized within single structures of the brain. Rather, current evidence suggests that such tasks are accomplished through synergies between multiple distributed processes in animal nervous systems. We thus advocate for researchers to move towards a more ecological, process-oriented conception, especially when discussing the neural underpinnings of recognition-based cognitive tasks.

Retinal Ganglion Cells Functional Changes in a Mouse Model of Alzheimer's Disease Are Linked with Neurotransmitter Alterations

BACKGROUND

Alzheimer's disease (AD) is the most prevalent form of dementia worldwide. This neurodegenerative syndrome affects cognition, memory, behavior, and the visual system, particularly the retina.

OBJECTIVE

This work aims to determine whether the 5xFAD mouse, a transgenic model of AD, displays changes in the function of retinal ganglion cells (RGCs) and if those alterations are correlated with changes in the expression of glutamate and gamma-aminobutyric acid (GABA) neurotransmitters.

METHODS

In young (2-3-month-old) and adult (6-7-month-old) 5xFAD and WT mice, we have studied the physiological response, firing rate, and burst of RGCs to various types of visual stimuli using a multielectrode array system.

RESULTS

The firing rate and burst response in 5xFAD RGCs showed hyperactivity at the early stage of AD in young mice, whereas hypoactivity was seen at the later stage of AD in adults. The physiological alterations observed in 5xFAD correlate well with an increase in the expression of glutamate in the ganglion cell layer in young and adults. GABA staining increased in the inner nuclear and plexiform layer, which was more pronounced in the adult than the young 5xFAD retina, altering the excitation/inhibition balance, which could explain the observed early hyperactivity and later hypoactivity in RGC physiology.

CONCLUSION

These findings indicate functional changes may be caused by neurochemical alterations of the retina starting at an early stage of the AD disease.

Electric Stimulation Elicits Heterogeneous Responses in ON but Not OFF Retinal Ganglion Cells to Transmit Rich Neural Information

Retinal implants electrically stimulate surviving retinal neurons to restore vision in people blinded by outer retinal degeneration. Although the healthy retina is known to transmit a vast amount of visual information to the brain, it has not been studied whether prosthetic vision contains a similar amount of information. Here, we assessed the neural information transmitted by population responses arising in brisk transient (BT) and brisk sustained (BS) subtypes of ON and OFF retinal ganglion cells (RGCs) in the rabbit retina. To correlate the response heterogeneity and the information transmission, we first quantified the cell-to-cell heterogeneity by calculating the spike time tiling coefficient (STTC) across spiking patterns of RGCs in each type. Then, we computed the neural information encoded by the RGC population in a given type. In responses to light stimulation, spiking activities were more heterogeneous in OFF than ON RGCs (STTC_AVG = 0.36, 0.45, 0.77 and 0.55 for OFF BT, OFF BS, ON BT, and ON BS, respectively). Interestingly, however, in responses to electric stimulation, both BT and BS subtypes of OFF RGCs showed remarkably homogeneous spiking patterns across cells (STTC_AVG = 0.93 and 0.82 for BT and BS, respectively), whereas the two subtypes of ON RGCs showed slightly increased populational heterogeneity compared to light-evoked responses (STTC_AVG = 0.71 and 0.63 for BT and BS, respectively). Consequently, the neural information encoded by the electrically-evoked responses of a population of 15 RGCs was substantially lower in the OFF than the ON pathway: OFF BT and BS cells transmit only ~23% and ~53% of the neural information transmitted by their ON counterparts. Together with previously-reported natural spiking activities in ON RGCs, the higher neural information may make ON responses more recognizable, eliciting the biased percepts of bright phosphenes.

Movement-Related Signals in Sensory Areas: Roles in Natural Behavior

Recent studies have demonstrated prominent and widespread movement-related signals in the brain of head-fixed mice, even in primary sensory areas. However, it is still unknown what role these signals play in sensory processing. Why are these sensory areas 'contaminated' by movement signals? During natural behavior, animals actively acquire sensory information as they move through the environment and use this information to guide ongoing actions. In this context, movement-related signals could allow sensory systems to predict self-induced sensory changes and extract additional information about the environment. In this review we summarize recent findings on the presence of movement-related signals in sensory areas and discuss how their study, in the context of natural freely moving behaviors, could advance models of sensory processing.

A large-scale standardized physiological survey reveals functional organization of the mouse visual cortex

To understand how the brain processes sensory information to guide behavior, we must know how stimulus representations are transformed throughout the visual cortex. Here we report an open, large-scale physiological survey of activity in the awake mouse visual cortex: the Allen Brain Observatory Visual Coding dataset. This publicly available dataset includes the cortical activity of nearly 60,000 neurons from six visual areas, four layers, and 12 transgenic mouse lines in a total of 243 adult mice, in response to a systematic set of visual stimuli. We classify neurons on the basis of joint reliabilities to multiple stimuli and validate this functional classification with models of visual responses. While most classes are characterized by responses to specific subsets of the stimuli, the largest class is not reliably responsive to any of the stimuli and becomes progressively larger in higher visual areas. These classes reveal a functional organization wherein putative dorsal areas show specialization for visual motion signals.

Understanding the retinal basis of vision across species

The vertebrate retina first evolved some 500 million years ago in ancestral marine chordates. Since then, the eyes of different species have been tuned to best support their unique visuoecological lifestyles. Visual specializations in eye designs, large-scale inhomogeneities across the retinal surface and local circuit motifs mean that all species' retinas are unique. Computational theories, such as the efficient coding hypothesis, have come a long way towards an explanation of the basic features of retinal organization and function; however, they cannot explain the full extent of retinal diversity within and across species. To build a truly general understanding of vertebrate vision and the retina's computational purpose, it is therefore important to more quantitatively relate different species' retinal functions to their specific natural environments and behavioural requirements. Ultimately, the goal of such efforts should be to build up to a more general theory of vision.

Mouse dLGN Receives Functional Input from a Diverse Population of Retinal Ganglion Cells with Limited Convergence

Mouse vision is based on the parallel output of more than 30 functional types of retinal ganglion cells (RGCs). Little is known about how representations of visual information change between retina and dorsolateral geniculate nucleus (dLGN) of the thalamus, the main relay between retina and cortex. Here, we functionally characterized responses of retrogradely labeled dLGN-projecting RGCs and dLGN neurons to the same set of visual stimuli. We found that many of the previously identified functional RGC types innervate dLGN, which maintained a high degree of functional diversity. Using a linear model to assess functional connectivity between RGC types and dLGN neurons, we found that responses of dLGN neurons could be predicted as linear combination of inputs from on average five RGC types, but only two of those had the strongest functional impact. Thus, mouse dLGN receives functional input from a diverse population of RGC types with limited convergence.

Speed-Selectivity in Retinal Ganglion Cells is Sharpened by Broad Spatial Frequency, Naturalistic Stimuli

Motion detection represents one of the critical tasks of the visual system and has motivated a large body of research. However, it remains unclear precisely why the response of retinal ganglion cells (RGCs) to simple artificial stimuli does not predict their response to complex, naturalistic stimuli. To explore this topic, we use Motion Clouds (MC), which are synthetic textures that preserve properties of natural images and are merely parameterized, in particular by modulating the spatiotemporal spectrum complexity of the stimulus by adjusting the frequency bandwidths. By stimulating the retina of the diurnal rodent, Octodon degus with MC we show that the RGCs respond to increasingly complex stimuli by narrowing their adjustment curves in response to movement. At the level of the population, complex stimuli produce a sparser code while preserving movement information; therefore, the stimuli are encoded more efficiently. Interestingly, these properties were observed throughout different populations of RGCs. Thus, our results reveal that the response at the level of RGCs is modulated by the naturalness of the stimulus - in particular for motion - which suggests that the tuning to the statistics of natural images already emerges at the level of the retina.

What do dogs (Canis familiaris) see? A review of vision in dogs and implications for cognition research

Over the last 20 years, a large amount of research has been conducted in an attempt to uncover the cognitive abilities of the domestic dog. While substantial advancements have been made, progress has been impeded by the fact that little is known about how dogs visually perceive their external environment. It is imperative that future research determines more precisely canine visual processing capabilities, particularly considering the increasing number of studies assessing cognition via paradigms requiring vision. This review discusses current research on visual cognition and emphasizes the importance of understanding dog visual processing. We review several areas of vision research in domestic dogs, such as sensitivity to light, visual perspective, visual acuity, form perception, and color vision, with a focus on how these abilities may affect performance in cognition tasks. Additionally, we consider the immense diversity seen in dog morphology and explore ways in which these physical differences, particularly in facial morphology, may result in, or perhaps even be caused by, different visual processing capacities in dogs. Finally, we suggest future directions for research in dog vision and cognition.

Stimulus- and goal-oriented frameworks for understanding natural vision

Our knowledge of sensory processing has advanced dramatically in the last few decades, but this understanding remains far from complete, especially for stimuli with the large dynamic range and strong temporal and spatial correlations characteristic of natural visual inputs. Here we describe some of the issues that make understanding the encoding of natural images a challenge. We highlight two broad strategies for approaching this problem: a stimulus-oriented framework and a goal-oriented one. Different contexts can call for one framework or the other. Looking forward, recent advances, particularly those based in machine learning, show promise in borrowing key strengths of both frameworks and by doing so illuminating a path to a more comprehensive understanding of the encoding of natural stimuli.

Characterization of Retinal Functionality at Different Eccentricities in a Diurnal Rodent

Although the properties of the neurons of the visual system that process central and peripheral regions of the visual field have been widely researched in the visual cortex and the LGN, they have scarcely been documented for the retina. The retina is the first step in integrating optical signals, and despite considerable efforts to functionally characterize the different types of retinal ganglion cells (RGCs), a clear account of the particular functionality of cells with central vs. peripheral fields is still wanting. Here, we use electrophysiological recordings, gathered from retinas of the diurnal rodent Octodon degus, to show that RGCs with peripheral receptive fields (RF) are larger, faster, and have shorter transient responses. This translates into higher sensitivity at high temporal frequencies and a full frequency bandwidth when compared to RGCs with more central RF. We also observed that imbalances between ON and OFF cell populations are preserved with eccentricity. Finally, the high diversity of functional types of RGCs highlights the complexity of the computational strategies implemented in the early stages of visual processing, which could inspire the development of bio-inspired artificial systems.

Development, form, and function of the mouse visual thalamus

The dorsal lateral geniculate nucleus (dLGN) of the thalamus is the exclusive relay of retinal information en route to the visual cortex. Although much of our understanding about dLGN comes from studies done in higher mammals, such as the cat and primate, the mouse as a model organism has moved to the forefront as a tractable experimental platform to examine cell type-specific relations. This review highlights our current knowledge about the development, structure, and function of the mouse dLGN.

Neural Mechanisms Mediating Motion Sensitivity in Parasol Ganglion Cells of the Primate Retina

Considerable theoretical and experimental effort has been dedicated to understanding how neural circuits detect visual motion. In primates, much is known about the cortical circuits that contribute to motion processing, but the role of the retina in this fundamental neural computation is poorly understood. Here, we used a combination of extracellular and whole-cell recording to test for motion sensitivity in the two main classes of output neurons in the primate retina-midget (parvocellular-projecting) and parasol (magnocellular-projecting) ganglion cells. We report that parasol, but not midget, ganglion cells are motion sensitive. This motion sensitivity is present in synaptic excitation and disinhibition from presynaptic bipolar cells and amacrine cells, respectively. Moreover, electrical coupling between neighboring bipolar cells and the nonlinear nature of synaptic release contribute to the observed motion sensitivity. Our findings indicate that motion computations arise far earlier in the primate visual stream than previously thought.

Orientation-Selective Retinal Circuits in Vertebrates

Visual information is already processed in the retina before it is transmitted to higher visual centers in the brain. This includes the extraction of salient features from visual scenes, such as motion directionality or contrast, through neurons belonging to distinct neural circuits. Some retinal neurons are tuned to the orientation of elongated visual stimuli. Such ‘orientation-selective’ neurons are present in the retinae of most, if not all, vertebrate species analyzed to date, with species-specific differences in frequency and degree of tuning. In some cases, orientation-selective neurons have very stereotyped functional and morphological properties suggesting that they represent distinct cell types. In this review, we describe the retinal cell types underlying orientation selectivity found in various vertebrate species, and highlight their commonalities and differences. In addition, we discuss recent studies that revealed the cellular, synaptic and circuit mechanisms at the basis of retinal orientation selectivity. Finally, we outline the significance of these findings in shaping our current understanding of how this fundamental neural computation is implemented in the visual systems of vertebrates.

Do domestic dogs (Canis lupus familiaris) perceive the Delboeuf illusion?

In the last decade, visual illusions have been repeatedly used as a tool to compare visual perception among species. Several studies have investigated whether non-human primates perceive visual illusions in a human-like fashion, but little attention has been paid to other mammals, and sensitivity to visual illusions has been never investigated in the dog. Here, we studied whether domestic dogs perceive the Delboeuf illusion. In human and non-human primates, this illusion creates a misperception of item size as a function of its surrounding context. To examine this effect in dogs, we adapted the spontaneous preference paradigm recently used with chimpanzees. Subjects were presented with two plates containing food. In control trials, two different amounts of food were presented in two identical plates. In this circumstance, dogs were expected to select the larger amount. In test trials, equal food portion sizes were presented in two plates differing in size: if dogs perceived the illusion as primates do, they were expected to select the amount of food presented in the smaller plate. Dogs significantly discriminated the two alternatives in control trials, whereas their performance did not differ from chance in test trials with the illusory pattern. The fact that dogs do not seem to be susceptible to the Delboeuf illusion suggests a potential discontinuity in the perceptual biases affecting size judgments between primates and dogs.

Efficacy of electrical stimulation of retinal ganglion cells with temporal patterns resembling light-evoked spike trains

People with degenerative retinal diseases such as retinitis pigmentosa lose most of their photoreceptors but retain a significant proportion (~30%) of their retinal ganglion cells (RGCs). Microelectronic retinal prostheses aim to bypass the lost photoreceptors and restore vision by directly stimulating the surviving RGCs. Here we investigate the extent to which electrical stimulation of RGCs can evoke neural spike trains with statistics resembling those of normal visually-evoked responses. Whole-cell patch clamp recordings were made from individual cat RGCs in vitro. We first recorded the responses of each cell to short sequences of visual stimulation. These responses were converted to trains of electrical stimulation that we then presented to the same cell via an epiretinal stimulating electrode. We then quantified the efficacy of the electrical stimuli and the latency of the evoked spikes. In all cases, spikes were evoked with sub-millisecond latency (0.55 ms, median, ON cells, n = 8; 0.75 ms, median, OFF cells, n = 6) and efficacy ranged from 0.4-1.0 (0.79, median, ON cells; 0.97, median, OFF cells). These data demonstrate that meaningful spike trains, resembling normal responses of RGCs to visual stimulation, can be reliably evoked by epiretinal prostheses.

Dorsal raphe nucleus projecting retinal ganglion cells: Why Y cells?

Retinal ganglion Y (alpha) cells are found in retinas ranging from frogs to mice to primates. The highly conserved nature of the large, fast conducting retinal Y cell is a testament to its fundamental task, although precisely what this task is remained ill-defined. The recent discovery that Y-alpha retinal ganglion cells send axon collaterals to the serotonergic dorsal raphe nucleus (DRN) in addition to the lateral geniculate nucleus (LGN), medial interlaminar nucleus (MIN), pretectum and the superior colliculus (SC) has offered new insights into the important survival tasks performed by these cells with highly branched axons. We propose that in addition to its role in visual perception, the Y-alpha retinal ganglion cell provides concurrent signals via axon collaterals to the DRN, the major source of serotonergic afferents to the forebrain, to dramatically inhibit 5-HT activity during orientation or alerting/escape responses, which dis-facilitates ongoing tonic motor activity while dis-inhibiting sensory information processing throughout the visual system. The new data provide a fresh view of these evolutionarily old retinal ganglion cells.

Vision: more than expected in the early visual system

In the standard model of central visual processing, orientation tuned responses in cortex are built from untuned thalamic inputs. But recent studies in the mouse show orientation selectivity in thalamic neurons, and address their potential source and possible roles in cortical computation.

Diverse visual features encoded in mouse lateral geniculate nucleus

The thalamus is crucial in determining the sensory information conveyed to cortex. In the visual system, the thalamic lateral geniculate nucleus (LGN) is generally thought to encode simple center-surround receptive fields, which are combined into more sophisticated features in cortex, such as orientation and direction selectivity. However, recent evidence suggests that a more diverse set of retinal ganglion cells projects to the LGN. We therefore used multisite extracellular recordings to define the repertoire of visual features represented in the LGN of mouse, an emerging model for visual processing. In addition to center-surround cells, we discovered a substantial population with more selective coding properties, including direction and orientation selectivity, as well as neurons that signal absence of contrast in a visual scene. The direction and orientation selective neurons were enriched in regions that match the termination zones of direction selective ganglion cells from the retina, suggesting a source for their tuning. Together, these data demonstrate that the mouse LGN contains a far more elaborate representation of the visual scene than current models posit. These findings should therefore have a significant impact on our understanding of the computations performed in mouse visual cortex.

Visual system: prostriata--a visual area off the beaten path

Recent work establishes that Prostriata, a little-studied area of the visual cortex neighboring V1, has distinct but hybrid visual properties which are suggestive of an unsuspected role in the rapid analysis and integration of peripheral visual stimuli.

The neuronal organization of the retina

The mammalian retina consists of neurons of >60 distinct types, each playing a specific role in processing visual images. They are arranged in three main stages. The first decomposes the outputs of the rod and cone photoreceptors into ∼12 parallel information streams. The second connects these streams to specific types of retinal ganglion cells. The third combines bipolar and amacrine cell activity to create the diverse encodings of the visual world--roughly 20 of them--that the retina transmits to the brain. New transformations of the visual input continue to be found: at least half of the encodings sent to the brain (ganglion cell response selectivities) remain to be discovered. This diversity of the retina's outputs has yet to be incorporated into our understanding of higher visual function.

Types of parvalbumin-containing retinotectal ganglion cells in mouse

The calcium-binding protein parvalbumin (PV) occurs in the retinal ganglion cells (RGCs) of various vertebrate species. In the present study, we aimed to identify the types of PV-containing RGCs that project to the superior colliculus (SC) in the mouse. We injected retrograde tracer dextran into the mouse SC to label RGCs. PV-containing RGCs were first identified by immunocytochemistry and then neurons double-labeled with dextran and PV were iontophoretically injected with a lipophilic dye, DiI. Subsequently, confocal microscopy was used to characterize the morphologic classification of the PV-immunoreactive (IR) retinotectal ganglion cells on the basis of dendritic field size, branching pattern, and stratification within the inner plexiform layer. Among the 8 different types of PV-containing RGCs in the mouse retina, we found all 8 types of RGCs projecting to the SC. The RGCs were heterogeneous in morphology. The combined approach of using tracer injection and a single cell injection after immunocytochemistry on a particular protein will provide valuable data to further understand the functional features of the RGCs which constitute the retinotectal pathway.

Direction selectivity in the retina: symmetry and asymmetry in structure and function

Visual information is processed in the retina to a remarkable degree before it is transmitted to higher visual centres. Several types of retinal ganglion cells (the output neurons of the retina) respond preferentially to image motion in a particular direction, and each type of direction-selective ganglion cell (DSGC) is comprised of multiple subtypes with different preferred directions. The direction selectivity of the cells is generated by diverse mechanisms operating within microcircuits that rely on independent neuronal processing in individual dendrites of both the DSGCs and the presynaptic neurons that innervate them.

A novel type of complex ganglion cell in rabbit retina

The 15-20 physiological types of retinal ganglion cells (RGCs) can be grouped according to whether they fire to increased illumination in the receptive-field center (ON cells), decreased illumination (OFF cells), or both (ON-OFF cells). The diversity of RGCs has been best described in the rabbit retina, which has three types of ON-OFF RGCs with complex receptive-field properties: the ON-OFF direction-selective ganglion cells (DSGCs), the local edge detectors, and the uniformity detectors. Here we describe a novel type of bistratified ON-OFF RGC that has not been described in either physiological or morphological studies of rabbit RGCs. These cells stratify in the ON and OFF sublaminae of the inner plexiform layer, branching at about 30% and 60% depth, between the ON and OFF arbors of the bistratified DSGCs. Similar to the ON-OFF DSGCs, these cells respond with transient firing to both bright and dark spots flashed in the receptive field but, unlike the DSGCs, they show no directional preference for moving stimuli. We have termed these cells "transient ON-OFF" RGCs. Area-response measurements show that both the ON and the OFF spike responses have an antagonistic receptive-field organization, but with different spatial extents. Voltage-clamp recordings reveal transient excitatory inputs at light ON and light OFF; this excitation is strongly suppressed by surround stimulation, which also elicits direct inhibitory inputs to the cells at light ON and light OFF. Thus the receptive-field organization is mediated both within the presynaptic circuitry and by direct feed-forward inhibition.

Encoding visual information in retinal ganglion cells with prosthetic stimulation

Retinal prostheses aim to restore functional vision to those blinded by outer retinal diseases using electric stimulation of surviving retinal neurons. The ability to replicate the spatiotemporal pattern of ganglion cell spike trains present under normal viewing conditions is presumably an important factor for restoring high-quality vision. In order to replicate such activity with a retinal prosthesis, it is important to consider both how visual information is encoded in ganglion cell spike trains, and how retinal neurons respond to electric stimulation. The goal of the current review is to bring together these two concepts in order to guide the development of more effective stimulation strategies. We review the experiments to date that have studied how retinal neurons respond to electric stimulation and discuss these findings in the context of known retinal signaling strategies. The results from such in vitro studies reveal the advantages and disadvantages of activating the ganglion cell directly with the electric stimulus (direct activation) as compared to activation of neurons that are presynaptic to the ganglion cell (indirect activation). While direct activation allows high temporal but low spatial resolution, indirect activation yields improved spatial resolution but poor temporal resolution. Finally, we use knowledge gained from in vitro experiments to infer the patterns of elicited activity in ongoing human trials, providing insights into some of the factors limiting the quality of prosthetic vision.

Nonstimulated early visual areas carry information about surrounding context

Even within the early sensory areas, the majority of the input to any given cortical neuron comes from other cortical neurons. To extend our knowledge of the contextual information that is transmitted by such lateral and feedback connections, we investigated how visually nonstimulated regions in primary visual cortex (V1) and visual area V2 are influenced by the surrounding context. We used functional magnetic resonance imaging (fMRI) and pattern-classification methods to show that the cortical representation of a nonstimulated quarter-field carries information that can discriminate the surrounding visual context. We show further that the activity patterns in these regions are significantly related to those observed with feed-forward stimulation and that these effects are driven primarily by V1. These results thus demonstrate that visual context strongly influences early visual areas even in the absence of differential feed-forward thalamic stimulation.

Morphologies of mouse retinal ganglion cells expressing transcription factors Brn3a, Brn3b, and Brn3c: analysis of wild type and mutant cells using genetically-directed sparse labeling

The mammalian retina contains more than 50 distinct neuronal types, which are broadly classified into several major classes: photoreceptor, bipolar, horizontal, amacrine, and ganglion cells. Although some of the developmental mechanisms involved in the differentiation of retinal ganglion cells (RGCs) are beginning to be understood, there is little information regarding the genetic and molecular determinants of the distinct morphologies of the 15-20 mammalian RGC cell types. Previous work has shown that the transcription factor Brn3b/Pou4f2 plays a major role in the development and survival of many RGCs. The roles of the closely related family members, Brn3a/Pou4f1 and Brn3c/Pou4f3 in RGC development are less clear. Using a genetically-directed method for sparse cell labeling and sparse conditional gene ablation in mice, we describe here the sets of RGC types in which each of the three Brn3/Pou4f transcription factors are expressed and the consequences of ablating these factors on the development of RGC morphologies.

Stimulus predictability reduces responses in primary visual cortex

In this functional magnetic resonance imaging study we tested whether the predictability of stimuli affects responses in primary visual cortex (V1). The results of this study indicate that visual stimuli evoke smaller responses in V1 when their onset or motion direction can be predicted from the dynamics of surrounding illusory motion. We conclude from this finding that the human brain anticipates forthcoming sensory input that allows predictable visual stimuli to be processed with less neural activation at early stages of cortical processing.

Segregation of short-wavelength-sensitive (S) cone signals in the macaque dorsal lateral geniculate nucleus

An important problem in the study of the mammalian visual system is whether functionally different retinal ganglion cell types are anatomically segregated further up along the central visual pathway. It was previously demonstrated that, in a New World diurnal monkey (marmoset), the neurones carrying signals from the short-wavelength-sensitive (S) cones [blue-yellow (B/Y)-opponent cells] are predominantly located in the koniocellular layers of the dorsal lateral geniculate nucleus (LGN), whereas the red-green (R/G)-opponent cells carrying signals from the medium- and long-wavelength-sensitive cones are segregated in the parvocellular layers. Here, we used extracellular single-unit recordings followed by histological reconstruction to investigate the distribution of color-selective cells in the LGN of the macaque, an Old World diurnal monkey. Cells were classified using cone-isolating stimuli to identify their cone inputs. Our results indicate that the majority of cells carrying signals from S-cones are located either in the koniocellular layers or in the 'koniocellular bridges' that fully or partially span the parvocellular layers. By contrast, the R/G-opponent cells are located in the parvocellular layers. We conclude that anatomical segregation of B/Y- and R/G-opponent afferent signals for color vision is common to the LGNs of New World and Old World diurnal monkeys.

Rod phototransduction determines the trade-off of temporal integration and speed of vision in dark-adapted toads

Human vision is approximately 10 times less sensitive than toad vision on a cool night. Here, we investigate (1) how far differences in the capacity for temporal integration underlie such differences in sensitivity and (2) whether the response kinetics of the rod photoreceptors can explain temporal integration at the behavioral level. The toad was studied as a model that allows experimentation at different body temperatures. Sensitivity, integration time, and temporal accuracy of vision were measured psychophysically by recording snapping at worm dummies moving at different velocities. Rod photoresponses were studied by ERG recording across the isolated retina. In both types of experiments, the general timescale of vision was varied by using two temperatures, 15 and 25 degrees C. Behavioral integration times were 4.3 s at 15 degrees C and 0.9 s at 25 degrees C, and rod integration times were 4.2-4.3 s at 15 degrees C and 1.0-1.3 s at 25 degrees C. Maximal behavioral sensitivity was fivefold lower at 25 degrees C than at 15 degrees C, which can be accounted for by inability of the "warm" toads to integrate light over longer times than the rods. However, the long integration time at 15 degrees C, allowing high sensitivity, degraded the accuracy of snapping toward quickly moving worms. We conclude that temporal integration explains a considerable part of all variation in absolute visual sensitivity. The strong correlation between rods and behavior suggests that the integration time of dark-adapted vision is set by rod phototransduction at the input to the visual system. This implies that there is an inexorable trade-off between temporal integration and resolution.

Natural image coding in V1: how much use is orientation selectivity?

Orientation selectivity is the most striking feature of simple cell coding in V1 that has been shown to emerge from the reduction of higher-order correlations in natural images in a large variety of statistical image models. The most parsimonious one among these models is linear Independent Component Analysis (ICA), whereas second-order decorrelation transformations such as Principal Component Analysis (PCA) do not yield oriented filters. Because of this finding, it has been suggested that the emergence of orientation selectivity may be explained by higher-order redundancy reduction. To assess the tenability of this hypothesis, it is an important empirical question how much more redundancy can be removed with ICA in comparison to PCA or other second-order decorrelation methods. Although some previous studies have concluded that the amount of higher-order correlation in natural images is generally insignificant, other studies reported an extra gain for ICA of more than 100%. A consistent conclusion about the role of higher-order correlations in natural images can be reached only by the development of reliable quantitative evaluation methods. Here, we present a very careful and comprehensive analysis using three evaluation criteria related to redundancy reduction: In addition to the multi-information and the average log-loss, we compute complete rate-distortion curves for ICA in comparison with PCA. Without exception, we find that the advantage of the ICA filters is small. At the same time, we show that a simple spherically symmetric distribution with only two parameters can fit the data significantly better than the probabilistic model underlying ICA. This finding suggests that, although the amount of higher-order correlation in natural images can in fact be significant, the feature of orientation selectivity does not yield a large contribution to redundancy reduction within the linear filter bank models of V1 simple cells.

The smooth monostratified ganglion cell: evidence for spatial diversity in the Y-cell pathway to the lateral geniculate nucleus and superior colliculus in the macaque monkey

In the primate visual system approximately 20 morphologically distinct pathways originate from retinal ganglion cells and project in parallel to the lateral geniculate nucleus (LGN) and/or the superior colliculus. Understanding of the properties of these pathways and the significance of such extreme early pathway diversity for later visual processing is limited. In a companion study we found that the magnocellular LGN-projecting parasol ganglion cells also projected to the superior colliculus and showed Y-cell receptive field structure supporting the hypothesis that the parasol cells are analogous to the well studied alpha-Y cell of the cat's retina. We here identify a novel ganglion cell class, the smooth monostratified cells, that share many properties with the parasol cells. Smooth cells were retrogradely stained from tracer injections made into either the LGN or superior colliculus and formed inner-ON and outer-OFF populations with narrowly monostratified dendritic trees that surprisingly appeared to perfectly costratify with the dendrites of parasol cells. Also like parasol cells, smooth cells summed input from L- and M-cones, lacked measurable S-cone input, showed high spike discharge rates, high contrast and temporal sensitivity, and a Y-cell type nonlinear spatial summation. Smooth cells were distinguished from parasol cells however by smaller cell body and axon diameters but approximately 2 times larger dendritic tree and receptive field diameters that formed a regular but lower density mosaic organization. We suggest that the smooth and parasol populations may sample a common presynaptic circuitry but give rise to distinct, parallel achromatic spatial channels in the primate retinogeniculate pathway.