Zebrafish Retinal Ganglion Cells Asymmetrically Encode Spectral and Temporal Information across Visual Space

Transcriptomic neuron types vary topographically in function and morphology

Neuronal phenotypic traits such as morphology, connectivity and function are dictated, to a large extent, by a specific combination of differentially expressed genes. Clusters of neurons in transcriptomic space correspond to distinct cell types and in some cases-for example, Caenorhabditis elegans neurons1 and retinal ganglion cells2-4-have been shown to share morphology and function. The zebrafish optic tectum is composed of a spatial array of neurons that transforms visual inputs into motor outputs. Although the visuotopic map is continuous, subregions of the tectum are functionally specialized5,6. Here, to uncover the cell-type architecture of the tectum, we transcriptionally profiled its neurons, revealing more than 60 cell types that are organized in distinct anatomical layers. We measured the visual responses of thousands of tectal neurons by two-photon calcium imaging and matched them with their transcriptional profiles. Furthermore, we characterized the morphologies of transcriptionally identified neurons using specific transgenic lines. Notably, we found that neurons that are transcriptionally similar can diverge in shape, connectivity and visual responses. Incorporating the spatial coordinates of neurons within the tectal volume revealed functionally and morphologically defined anatomical subclusters within individual transcriptomic clusters. Our findings demonstrate that extrinsic, position-dependent factors expand the phenotypic repertoire of genetically similar neurons.

Ontogeny of Thyroid Hormone Signaling in the Retina of Zebrafish: Effects of Thyroidal Status on Retinal Morphology, Cell Survival, and Color Preference

The retina is crucial for converting light into neuronal signals for visual perception. Understanding the retina's structure, function, and development is essential for vision research. It is known that the thyroid hormone (TH) receptor type beta 2 (TRβ2) is a key element in the regulation of cone differentiation in the retina, but other elements of TH signaling, such as transporters and enzyme deiodinases, have also been implicated in retinal cell development and survival. In the present study, we investigated the expression profile of genes involved in TH signaling and analyzed the impact of thyroidal status on retinal morphology, opsin expression, cell death/proliferation profile, as well as color preference behavior during the early retina development of zebrafish larvae. mRNA expression analysis on dissected whole eyes revealed that TH signaling elements gradually increase during eye development, with dio3b being the component that shows the most dramatic change. Mutations generated by CRISPR/CAS9 in the dio3b gene, but not in the thrb gene, modifies the structure of the retina. Disruption in TH level reduces the cell number of the ganglion cell layer, increases cell death, and modifies color preference, emphasizing the critical importance of precise TH regulation by its signaling elements for optimal retinal development and function.

Asymmetric distribution of color-opponent response types across mouse visual cortex supports superior color vision in the sky

Color is an important visual feature that informs behavior, and the retinal basis for color vision has been studied across various vertebrate species. While many studies have investigated how color information is processed in visual brain areas of primate species, we have limited understanding of how it is organized beyond the retina in other species, including most dichromatic mammals. In this study, we systematically characterized how color is represented in the primary visual cortex (V1) of mice. Using large-scale neuronal recordings and a luminance and color noise stimulus, we found that more than a third of neurons in mouse V1 are color-opponent in their receptive field center, while the receptive field surround predominantly captures luminance contrast. Furthermore, we found that color-opponency is especially pronounced in posterior V1 that encodes the sky, matching the statistics of natural scenes experienced by mice. Using unsupervised clustering, we demonstrate that the asymmetry in color representations across cortex can be explained by an uneven distribution of green-On/UV-Off color-opponent response types that are represented in the upper visual field. Finally, a simple model with natural scene-inspired parametric stimuli shows that green-On/UV-Off color-opponent response types may enhance the detection of 'predatory'-like dark UV-objects in noisy daylight scenes. The results from this study highlight the relevance of color processing in the mouse visual system and contribute to our understanding of how color information is organized in the visual hierarchy across species.

Restoration of cone-circuit functionality in the regenerating adult zebrafish retina

Unlike humans, teleosts like zebrafish exhibit robust retinal regeneration after injury from endogenous stem cells. However, it is unclear if regenerating cone photoreceptors regain physiological function and integrate correctly into post-synaptic circuits. We used two-photon calcium imaging of living adult retina to examine photoreceptor responses before and after light-induced lesions. To assess functional recovery of cones and downstream outer retinal circuits, we exploited color opponency; UV cones exhibit intrinsic Off-response to blue light, but On-response to green light, which depends on feedback signals from outer retinal circuits. Accordingly, we assessed the presence and quality of Off- vs. On-responses and found that regenerated UV cones regain both Off-responses to short-wavelength and On-responses to long-wavelength light within 3 months after lesion. Therefore, physiological circuit functionality is restored in regenerated cone photoreceptors, suggesting that inducing endogenous regeneration is a promising strategy for human retinal repair.

A large-scale CRISPR screen reveals context-specific genetic regulation of retinal ganglion cell regeneration

Many genes are known to regulate retinal regeneration after widespread tissue damage. Conversely, genes controlling regeneration after limited cell loss, as per degenerative diseases, are undefined. As stem/progenitor cell responses scale to injury levels, understanding how the extent and specificity of cell loss impact regenerative processes is important. Here, transgenic zebrafish enabling selective retinal ganglion cell (RGC) ablation were used to identify genes that regulate RGC regeneration. A single cell multiomics-informed screen of 100 genes identified seven knockouts that inhibited and 11 that promoted RGC regeneration. Surprisingly, 35 out of 36 genes known and/or implicated as being required for regeneration after widespread retinal damage were not required for RGC regeneration. The loss of seven even enhanced regeneration kinetics, including the proneural factors neurog1, olig2 and ascl1a. Mechanistic analyses revealed that ascl1a disruption increased the propensity of progenitor cells to produce RGCs, i.e. increased 'fate bias'. These data demonstrate plasticity in the mechanism through which Müller glia convert to a stem-like state and context specificity in how genes function during regeneration. Increased understanding of how the regeneration of disease-relevant cell types is specifically controlled will support the development of disease-tailored regenerative therapeutics.

Light wavelength modulates search behavior performance in zebrafish

Visual systems have evolved to discriminate between different wavelengths of light. The ability to perceive color, or specific light wavelengths, is important as color conveys crucial information about both biotic and abiotic features in the environment. Indeed, different wavelengths of light can drive distinct patterns of activity in the vertebrate brain, yet what remains incompletely understood is whether distinct wavelengths can invoke etiologically relevant behavioral changes. To address how specific wavelengths in the visible spectrum modulate behavioral performance, we use larval zebrafish and a stereotypic light-search behavior. Prior work has shown that the cessation of light triggers a transitional light-search behavior, which we use to interrogate wavelength-dependent behavioral modulation. Using 8 narrow spectrum light sources in the visible range, we demonstrate that all wavelengths induce motor parameters consistent with search behavior, yet the magnitude of search behavior is spectrum sensitive and the underlying motor parameters are modulated in distinct patterns across short, medium, and long wavelengths. However, our data also establishes that not all motor features of search are impacted by wavelength. To define how wavelength modulates search performance, we performed additional assays with alternative wavelengths, dual wavelengths, and variable intensity. Last, we also tested blind larvae to resolve which components of wavelength dependent behavioral changes potentially include signaling from non-retinal photoreception. These findings have important implications as organisms can be exposed to varying wavelengths in laboratory and natural settings and therefore impose unique behavioral outputs.

Ancient origin of the rod bipolar cell pathway in the vertebrate retina

Vertebrates rely on rod photoreceptors for vision in low-light conditions. The specialized downstream circuit for rod signalling, called the primary rod pathway, is well characterized in mammals, but circuitry for rod signalling in non-mammals is largely unknown. Here we demonstrate that the mammalian primary rod pathway is conserved in zebrafish, which diverged from extant mammals ~400 million years ago. Using single-cell RNA sequencing, we identified two bipolar cell types in zebrafish that are related to mammalian rod bipolar cell (RBCs), the only bipolar type that directly carries rod signals from the outer to the inner retina in the primary rod pathway. By combining electrophysiology, histology and ultrastructural reconstruction of the zebrafish RBCs, we found that, similar to mammalian RBCs, both zebrafish RBC types connect with all rods in their dendritic territory and provide output largely onto amacrine cells. The wiring pattern of the amacrine cells postsynaptic to one RBC type is strikingly similar to that of mammalian RBCs and their amacrine partners, suggesting that the cell types and circuit design of the primary rod pathway emerged before the divergence of teleost fish and mammals. The second RBC type, which forms separate pathways, was either lost in mammals or emerged in fish.

The vertebrate retina: a window into the evolution of computation in the brain

Animal brains are probably the most complex computational machines on our planet, and like everything in biology, they are the product of evolution. Advances in developmental and palaeobiology have been expanding our general understanding of how nervous systems can change at a molecular and structural level. However, how these changes translate into altered function - that is, into 'computation' - remains comparatively sparsely explored. What, concretely, does it mean for neuronal computation when neurons change their morphology and connectivity, when new neurons appear or old ones disappear, or when transmitter systems are slowly modified over many generations? And how does evolution use these many possible knobs and dials to constantly tune computation to give rise to the amazing diversity in animal behaviours we see today? Addressing these major gaps of understanding benefits from choosing a suitable model system. Here, I present the vertebrate retina as one perhaps unusually promising candidate. The retina is ancient and displays highly conserved core organisational principles across the entire vertebrate lineage, alongside a myriad of adjustments across extant species that were shaped by the history of their visual ecology. Moreover, the computational logic of the retina is readily interrogated experimentally, and our existing understanding of retinal circuits in a handful of species can serve as an anchor when exploring the visual circuit adaptations across the entire vertebrate tree of life, from fish deep in the aphotic zone of the oceans to eagles soaring high up in the sky.

Asymmetric distribution of color-opponent response types across mouse visual cortex supports superior color vision in the sky

Color is an important visual feature that informs behavior, and the retinal basis for color vision has been studied across various vertebrate species. While many studies have investigated how color information is processed in visual brain areas of primate species, we have limited understanding of how it is organized beyond the retina in other species, including most dichromatic mammals. In this study, we systematically characterized how color is represented in the primary visual cortex (V1) of mice. Using large-scale neuronal recordings and a luminance and color noise stimulus, we found that more than a third of neurons in mouse V1 are color-opponent in their receptive field center, while the receptive field surround predominantly captures luminance contrast. Furthermore, we found that color-opponency is especially pronounced in posterior V1 that encodes the sky, matching the statistics of natural scenes experienced by mice. Using unsupervised clustering, we demonstrate that the asymmetry in color representations across cortex can be explained by an uneven distribution of green-On/UV-Off color-opponent response types that are represented in the upper visual field. Finally, a simple model with natural scene-inspired parametric stimuli shows that green-On/UV-Off color-opponent response types may enhance the detection of "predatory"-like dark UV-objects in noisy daylight scenes. The results from this study highlight the relevance of color processing in the mouse visual system and contribute to our understanding of how color information is organized in the visual hierarchy across species.

Transcriptional control of visual neural circuit development by GS homeobox 1

As essential components of gene expression networks, transcription factors regulate neural circuit assembly. The homeobox transcription factor encoding gene, gs homeobox 1 (gsx1), is expressed in the developing visual system; however, no studies have examined its role in visual system formation. In zebrafish, retinal ganglion cell (RGC) axons that transmit visual information to the brain terminate in ten arborization fields (AFs) in the optic tectum (TeO), pretectum (Pr), and thalamus. Pretectal AFs (AF1-AF9) mediate distinct visual behaviors, yet we understand less about their development compared to AF10 in the TeO. Using gsx1 zebrafish mutants, immunohistochemistry, and transgenic lines, we observed that gsx1 is required for vesicular glutamate transporter, Tg(slc17a6b:DsRed), expression in the Pr, but not overall neuron number. gsx1 mutants have normal eye morphology, yet they exhibit impaired visual ability during prey capture. RGC axon volume in the gsx1 mutant Pr and TeO is reduced, and AF7 that is active during feeding is missing which is consistent with reduced hunting performance. Timed laser ablation of Tg(slc17a6b:DsRed)-positive cells reveals that they are necessary for AF7 formation. This work is the first to implicate gsx1 in establishing cell identity and functional neural circuits in the visual system.

Ancestral photoreceptor diversity as the basis of visual behaviour

Animal colour vision is based on comparing signals from different photoreceptors. It is generally assumed that processing different spectral types of photoreceptor mainly serves colour vision. Here I propose instead that photoreceptors are parallel feature channels that differentially support visual-motor programmes like motion vision behaviours, prey capture and predator evasion. Colour vision may have emerged as a secondary benefit of these circuits, which originally helped aquatic vertebrates to visually navigate and segment their underwater world. Specifically, I suggest that ancestral vertebrate vision was built around three main systems, including a high-resolution general purpose greyscale system based on ancestral red cones and rods to mediate visual body stabilization and navigation, a high-sensitivity specialized foreground system based on ancestral ultraviolet cones to mediate threat detection and prey capture, and a net-suppressive system based on ancestral green and blue cones for regulating red/rod and ultraviolet circuits. This ancestral strategy probably still underpins vision today, and different vertebrate lineages have since adapted their original photoreceptor circuits to suit their diverse visual ecologies.

Ancient origin of the rod bipolar cell pathway in the vertebrate retina

Vertebrates rely on rod photoreceptors for vision in low-light conditions. Mammals have a specialized downstream circuit for rod signaling called the primary rod pathway, which comprises specific cell types and wiring patterns that are thought to be unique to this lineage. Thus, it has been long assumed that the primary rod pathway evolved in mammals. Here, we challenge this view by demonstrating that the mammalian primary rod pathway is conserved in zebrafish, which diverged from extant mammals ~400 million years ago. Using single-cell RNA-sequencing, we identified two bipolar cell (BC) types in zebrafish that are related to mammalian rod BCs (RBCs) of the primary rod pathway. By combining electrophysiology, histology, and ultrastructural reconstruction of the zebrafish RBCs, we found that, like mammalian RBCs, both zebrafish RBC types connect with all rods in their dendritic territory, and provide output largely onto amacrine cells. The wiring pattern of the amacrine cells post-synaptic to one RBC type is strikingly similar to that of mammalian RBCs, suggesting that the cell types and circuit design of the primary rod pathway have emerged before the divergence of teleost fish and amniotes. The second RBC type, which forms separate pathways, is either lost in mammals or emerged in fish.

Ancient origin of the rod bipolar cell pathway in the vertebrate retina

Vertebrates rely on rod photoreceptors for vision in low-light conditions1. Mammals have a specialized downstream circuit for rod signaling called the primary rod pathway, which comprises specific cell types and wiring patterns that are thought to be unique to this lineage2-6. Thus, it has been long assumed that the primary rod pathway evolved in mammals3,5-7. Here, we challenge this view by demonstrating that the mammalian primary rod pathway is conserved in zebrafish, which diverged from extant mammals ~400 million years ago. Using single-cell RNA-sequencing, we identified two bipolar cell (BC) types in zebrafish that are related to mammalian rod BCs (RBCs) of the primary rod pathway. By combining electrophysiology, histology, and ultrastructural reconstruction of the zebrafish RBCs, we found that, like mammalian RBCs8, both zebrafish RBC types connect with all rods and red-cones in their dendritic territory, and provide output largely onto amacrine cells. The wiring pattern of the amacrine cells post-synaptic to one RBC type is strikingly similar to that of mammalian RBCs. This suggests that the cell types and circuit design of the primary rod pathway may have emerged before the divergence of teleost fish and amniotes (mammals, bird, reptiles). The second RBC type in zebrafish, which forms separate pathways from the first RBC type, is either lost in mammals or emerged in fish to serve yet unknown roles.

Retinal ganglion cell repopulation for vision restoration in optic neuropathy: a roadmap from the RReSTORe Consortium

Retinal ganglion cell (RGC) death in glaucoma and other optic neuropathies results in irreversible vision loss due to the mammalian central nervous system's limited regenerative capacity. RGC repopulation is a promising therapeutic approach to reverse vision loss from optic neuropathies if the newly introduced neurons can reestablish functional retinal and thalamic circuits. In theory, RGCs might be repopulated through the transplantation of stem cell-derived neurons or via the induction of endogenous transdifferentiation. The RGC Repopulation, Stem Cell Transplantation, and Optic Nerve Regeneration (RReSTORe) Consortium was established to address the challenges associated with the therapeutic repair of the visual pathway in optic neuropathy. In 2022, the RReSTORe Consortium initiated ongoing international collaborative discussions to advance the RGC repopulation field and has identified five critical areas of focus: (1) RGC development and differentiation, (2) Transplantation methods and models, (3) RGC survival, maturation, and host interactions, (4) Inner retinal wiring, and (5) Eye-to-brain connectivity. Here, we discuss the most pertinent questions and challenges that exist on the path to clinical translation and suggest experimental directions to propel this work going forward. Using these five subtopic discussion groups (SDGs) as a framework, we suggest multidisciplinary approaches to restore the diseased visual pathway by leveraging groundbreaking insights from developmental neuroscience, stem cell biology, molecular biology, optical imaging, animal models of optic neuropathy, immunology & immunotolerance, neuropathology & neuroprotection, materials science & biomedical engineering, and regenerative neuroscience. While significant hurdles remain, the RReSTORe Consortium's efforts provide a comprehensive roadmap for advancing the RGC repopulation field and hold potential for transformative progress in restoring vision in patients suffering from optic neuropathies.

Birds multiplex spectral and temporal visual information via retinal On- and Off-channels

In vertebrate vision, early retinal circuits divide incoming visual information into functionally opposite elementary signals: On and Off, transient and sustained, chromatic and achromatic. Together these signals can yield an efficient representation of the scene for transmission to the brain via the optic nerve. However, this long-standing interpretation of retinal function is based on mammals, and it is unclear whether this functional arrangement is common to all vertebrates. Here we show that male poultry chicks use a fundamentally different strategy to communicate information from the eye to the brain. Rather than using functionally opposite pairs of retinal output channels, chicks encode the polarity, timing, and spectral composition of visual stimuli in a highly correlated manner: fast achromatic information is encoded by Off-circuits, and slow chromatic information overwhelmingly by On-circuits. Moreover, most retinal output channels combine On- and Off-circuits to simultaneously encode, or multiplex, both achromatic and chromatic information. Our results from birds conform to evidence from fish, amphibians, and reptiles which retain the full ancestral complement of four spectral types of cone photoreceptors.

Spatiotemporal visual statistics of aquatic environments in the natural habitats of zebrafish

Animal sensory systems are tightly adapted to the demands of their environment. In the visual domain, research has shown that many species have circuits and systems that exploit statistical regularities in natural visual signals. The zebrafish is a popular model animal in visual neuroscience, but relatively little quantitative data is available about the visual properties of the aquatic habitats where zebrafish reside, as compared to terrestrial environments. Improving our understanding of the visual demands of the aquatic habitats of zebrafish can enhance the insights about sensory neuroscience yielded by this model system. We analyzed a video dataset of zebrafish habitats captured by a stationary camera and compared this dataset to videos of terrestrial scenes in the same geographic area. Our analysis of the spatiotemporal structure in these videos suggests that zebrafish habitats are characterized by low visual contrast and strong motion when compared to terrestrial environments. Similar to terrestrial environments, zebrafish habitats tended to be dominated by dark contrasts, particularly in the lower visual field. We discuss how these properties of the visual environment can inform the study of zebrafish visual behavior and neural processing and, by extension, can inform our understanding of the vertebrate brain.

Functional organization of visual responses in the octopus optic lobe

Cephalopods are highly visual animals with camera-type eyes, large brains, and a rich repertoire of visually guided behaviors. However, the cephalopod brain evolved independently from those of other highly visual species, such as vertebrates; therefore, the neural circuits that process sensory information are profoundly different. It is largely unknown how their powerful but unique visual system functions, as there have been no direct neural measurements of visual responses in the cephalopod brain. In this study, we used two-photon calcium imaging to record visually evoked responses in the primary visual processing center of the octopus central brain, the optic lobe, to determine how basic features of the visual scene are represented and organized. We found spatially localized receptive fields for light (ON) and dark (OFF) stimuli, which were retinotopically organized across the optic lobe, demonstrating a hallmark of visual system organization shared across many species. An examination of these responses revealed transformations of the visual representation across the layers of the optic lobe, including the emergence of the OFF pathway and increased size selectivity. We also identified asymmetries in the spatial processing of ON and OFF stimuli, which suggest unique circuit mechanisms for form processing that may have evolved to suit the specific demands of processing an underwater visual scene. This study provides insight into the neural processing and functional organization of the octopus visual system, highlighting both shared and unique aspects, and lays a foundation for future studies of the neural circuits that mediate visual processing and behavior in cephalopods.

Amacrine cells differentially balance zebrafish color circuits in the central and peripheral retina

The vertebrate inner retina is driven by photoreceptors whose outputs are already pre-processed; in zebrafish, outer retinal circuits split "color" from "grayscale" information across four cone-photoreceptor types. It remains unclear how the inner retina processes incoming spectral information while also combining cone signals to shape grayscale functions. We address this question by imaging the light-driven responses of amacrine cells (ACs) and bipolar cells (BCs) in larval zebrafish in the presence and pharmacological absence of inner retinal inhibition. We find that ACs enhance opponency in some bipolar cells while at the same time suppressing pre-existing opponency in others, so that, depending on the retinal region, the net change in the number of color-opponent units is essentially zero. To achieve this "dynamic balance," ACs counteract intrinsic color opponency of BCs via the On channel. Consistent with these observations, Off-stratifying ACs are exclusively achromatic, while all color-opponent ACs stratify in the On sublamina.

GliaMorph: a modular image analysis toolkit to quantify Müller glial cell morphology

Cell morphology is crucial for all cell functions. This is particularly true for glial cells as they rely on complex shape to contact and support neurons. However, methods to quantify complex glial cell shape accurately and reproducibly are lacking. To address this, we developed the image analysis pipeline 'GliaMorph'. GliaMorph is a modular analysis toolkit developed to perform (1) image pre-processing, (2) semi-automatic region-of-interest selection, (3) apicobasal texture analysis, (4) glia segmentation, and (5) cell feature quantification. Müller glia (MG) have a stereotypic shape linked to their maturation and physiological status. Here, we characterized MG on three levels: (1) global image-level, (2) apicobasal texture, and (3) regional apicobasal vertical-to-horizontal alignment. Using GliaMorph, we quantified MG development on a global and single-cell level, showing increased feature elaboration and subcellular morphological rearrangement in the zebrafish retina. As proof of principle, we analysed expression changes in a mouse glaucoma model, identifying subcellular protein localization changes in MG. Together, these data demonstrate that GliaMorph enables an in-depth understanding of MG morphology in the developing and diseased retina.

From perception to behavior: The neural circuits underlying prey hunting in larval zebrafish

A key challenge for neural systems is to extract relevant information from the environment and make appropriate behavioral responses. The larval zebrafish offers an exciting opportunity for studying these sensing processes and sensory-motor transformations. Prey hunting is an instinctual behavior of zebrafish that requires the brain to extract and combine different attributes of the sensory input and form appropriate motor outputs. Due to its small size and transparency the larval zebrafish brain allows optical recording of whole-brain activity to reveal the neural mechanisms involved in prey hunting and capture. In this review we discuss how the larval zebrafish brain processes visual information to identify and locate prey, the neural circuits governing the generation of motor commands in response to prey, how hunting behavior can be modulated by internal states and experience, and some outstanding questions for the field.

Mepanipyrim induces visual developmental toxicity and vision-guided behavioral alteration in zebrafish larvae

Mepanipyrim, an anilinopyrimidine fungicide, has been extensively used to prevent fungal diseases in fruit culture. Currently, research on mepanipyrim-induced toxicity in organisms is still very scarce, especially visual developmental toxicity. Here, zebrafish larvae were employed to investigate mepanipyrim-induced visual developmental toxicity. Intense light and monochromatic light stimuli-evoked escape experiments were used to investigate vision-guided behaviors. Meanwhile, transcriptomic sequencing and real-time quantitative PCR assays were applied to assess the potential mechanisms of mepanipyrim-induced visual developmental toxicity and vision-guided behavioral alteration. Our results showed that mepanipyrim exposure could induce retinal impairment and vision-guided behavioral alteration in larval zebrafish. In addition, the grk1b gene of the phototransduction signaling pathway was found to be a potential aryl hydrocarbon receptor (AhR)-regulated gene. Mepanipyrim-induced visual developmental toxicity was potentially related to the AhR signaling pathway. Furthermore, mepanipyrim-induced behavioral alteration was guided by the visual function, and the effects of mepanipyrim on long and middle wavelength light-sensitive opsins may be the main cause of vision-guided behavioral alteration. Our results provide insights into understanding the relationship between visual development and vision-guided behaviors induced by mepanipyrim exposure.

Foxd1-dependent induction of a temporal retinal character is required for visual function

Appropriate patterning of the retina during embryonic development is assumed to underlie the establishment of spatially localised specialisations that mediate the perception of specific visual features. For example, in zebrafish, an area involved in high acuity vision (HAA) is thought to be present in the ventro-temporal retina. Here, we show that the interplay of the transcription factor Rx3 with Fibroblast Growth Factor and Hedgehog signals initiates and restricts foxd1 expression to the prospective temporal retina, initiating naso-temporal regionalisation of the retina. Abrogation of Foxd1 results in the loss of temporal and expansion of nasal retinal character, and consequent absence of the HAA. These structural defects correlate with severe visual defects, as assessed in optokinetic and optomotor response assays. In contrast, optokinetic responses are unaffected in the opposite condition, in which nasal retinal character is lost at the expense of expanded temporal character. Our study indicates that the establishment of temporal retinal character during early retinal development is required for the specification of the HAA, and suggests a prominent role of the temporal retina in controlling specific visual functions.

Bio-mimetic high-speed target localization with fused frame and event vision for edge application

Evolution has honed predatory skills in the natural world where localizing and intercepting fast-moving prey is required. The current generation of robotic systems mimics these biological systems using deep learning. High-speed processing of the camera frames using convolutional neural networks (CNN) (frame pipeline) on such constrained aerial edge-robots gets resource-limited. Adding more compute resources also eventually limits the throughput at the frame rate of the camera as frame-only traditional systems fail to capture the detailed temporal dynamics of the environment. Bio-inspired event cameras and spiking neural networks (SNN) provide an asynchronous sensor-processor pair (event pipeline) capturing the continuous temporal details of the scene for high-speed but lag in terms of accuracy. In this work, we propose a target localization system combining event-camera and SNN-based high-speed target estimation and frame-based camera and CNN-driven reliable object detection by fusing complementary spatio-temporal prowess of event and frame pipelines. One of our main contributions involves the design of an SNN filter that borrows from the neural mechanism for ego-motion cancelation in houseflies. It fuses the vestibular sensors with the vision to cancel the activity corresponding to the predator's self-motion. We also integrate the neuro-inspired multi-pipeline processing with task-optimized multi-neuronal pathway structure in primates and insects. The system is validated to outperform CNN-only processing using prey-predator drone simulations in realistic 3D virtual environments. The system is then demonstrated in a real-world multi-drone set-up with emulated event data. Subsequently, we use recorded actual sensory data from multi-camera and inertial measurement unit (IMU) assembly to show desired working while tolerating the realistic noise in vision and IMU sensors. We analyze the design space to identify optimal parameters for spiking neurons, CNN models, and for checking their effect on the performance metrics of the fused system. Finally, we map the throughput controlling SNN and fusion network on edge-compatible Zynq-7000 FPGA to show a potential 264 outputs per second even at constrained resource availability. This work may open new research directions by coupling multiple sensing and processing modalities inspired by discoveries in neuroscience to break fundamental trade-offs in frame-based computer vision.

Seeing Picasso: an investigation into the visual system of the triggerfish Rhinecanthus aculeatus

Vision is used by animals to find food and mates, avoid predators, defend resources and navigate through complex habitats. Behavioural experiments are essential for understanding animals' perception but are often challenging and time-consuming; therefore, using species that can be trained easily for complex tasks is advantageous. Picasso triggerfish, Rhinecanthus aculeatus, have been used in many behavioural studies investigating vision and navigation. However, little is known about the molecular and anatomical basis of their visual system. We addressed this knowledge gap here and behaviourally tested achromatic and chromatic acuity. In terms of visual opsins, R. aculeatus possessed one rod opsin gene (RH1) and at least nine cone opsins: one violet-sensitive SWS2B gene, seven duplicates of the blue-green-sensitive RH2 gene (RH2A, RH2B, RH2C1-5) and one red-sensitive LWS gene. However, only five cone opsins were expressed: SWS2B expression was consistent, while RH2A, RH2C-1 and RH2C-2 expression varied depending on whether fish were sampled from the field or aquaria. Levels of LWS expression were very low. Using fluorescence in situ hybridisation, we found SWS2B was expressed exclusively in single cones, whereas RH2A and RH2Cs were expressed in opposite double cone members. Anatomical resolution estimated from ganglion cell densities was 6.8 cycles per degree (cpd), which was significantly higher than values obtained from behavioural testing for black-and-white achromatic stimuli (3.9 cpd) and chromatic stimuli (1.7-1.8 cpd). These measures were twice as high as previously reported. This detailed information on their visual system will help inform future studies with this emerging focal species.

Populations of local direction-selective cells encode global motion patterns generated by self-motion

Self-motion generates visual patterns on the eye that are important for navigation. These optic flow patterns are encoded by the population of local direction–selective cells in the mouse retina, whereas in flies, local direction–selective T4/T5 cells are thought to be uniformly tuned. How complex global motion patterns can be computed downstream is unclear. We show that the population of T4/T5 cells in Drosophila encodes global motion patterns. Whereas the mouse retina encodes four types of optic flow, the fly visual system encodes six. This matches the larger number of degrees of freedom and the increased complexity of translational and rotational motion patterns during flight. The four uniformly tuned T4/T5 subtypes described previously represent a local subset of the population. Thus, a population code for global motion patterns appears to be a general coding principle of visual systems that matches local motion responses to modes of the animal’s movement.

Spectral inference reveals principal cone-integration rules of the zebrafish inner retina

Retinal bipolar cells integrate cone signals at dendritic and axonal sites. The axonal route, involving amacrine cells, remains largely uncharted. However, because cone types differ in their spectral sensitivities, insights into bipolar cells' cone integration might be gained based on their spectral tunings. We therefore recorded in vivo responses of bipolar cell presynaptic terminals in larval zebrafish to widefield but spectrally resolved flashes of light and mapped the results onto spectral responses of the four cones. This "spectral circuit mapping" allowed explaining ∼95% of the spectral and temporal variance of bipolar cell responses in a simple linear model, thereby revealing several notable integration rules of the inner retina. Bipolar cells were dominated by red-cone inputs, often alongside equal sign inputs from blue and green cones. In contrast, UV-cone inputs were uncorrelated with those of the remaining cones. This led to a new axis of spectral opponency where red-, green-, and blue-cone "Off" circuits connect to "natively-On" UV-cone circuits in the outermost fraction of the inner plexiform layer-much as how key color opponent circuits are established in mammals. Beyond this, and despite substantial temporal diversity that was not present in the cones, bipolar cell spectral tunings were surprisingly simple. They either approximately resembled both opponent and non-opponent spectral motifs already present in the cones or exhibited a stereotyped non-opponent broadband response. In this way, bipolar cells not only preserved the efficient spectral representations in the cones but also diversified them to set up a total of six dominant spectral motifs, which included three axes of spectral opponency.

Panx1b Modulates the Luminance Response and Direction of Locomotion in the Zebrafish

Pannexin1 (Panx1) can form ATP-permeable channels that play roles in the physiology of the visual system. In the zebrafish two ohnologs of Panx1, Panx1a and Panx1b, have unique and shared channel properties and tissue expression patterns. Panx1a channels are located in horizontal cells of the outer retina and modulate light decrement detection through an ATP/pH-dependent mechanisms and adenosine/dopamine signaling. Here, we decipher how the strategic localization of Panx1b channels in the inner retina and ganglion cell layer modulates visually evoked motor behavior. We describe a panx1b knockout model generated by TALEN technology. The RNA-seq analysis of 6 days post-fertilization larvae is confirmed by real-time PCR and paired with testing of locomotion behaviors by visual motor and optomotor response tests. We show that the loss of Panx1b channels disrupts the retinal response to an abrupt loss of illumination and it decreases the larval ability to follow leftward direction of locomotion in low light conditions. We concluded that the loss of Panx1b channels compromises the final output of luminance as well as motion detection. The Panx1b protein also emerges as a modulator of the circadian clock system. The disruption of the circadian clock system in mutants suggests that Panx1b could participate in non-image forming processes in the inner retina.

Ancestral circuits for vertebrate color vision emerge at the first retinal synapse

For color vision, retinal circuits separate information about intensity and wavelength. In vertebrates that use the full complement of four “ancestral” cone types, the nature and implementation of this computation remain poorly understood. Here, we establish the complete circuit architecture of outer retinal circuits underlying color processing in larval zebrafish. We find that the synaptic outputs of red and green cones efficiently rotate the encoding of natural daylight in a principal components analysis–like manner to yield primary achromatic and spectrally opponent axes, respectively. Blue cones are tuned to capture most remaining variance when opposed to green cones, while UV cone present a UV achromatic axis for prey capture. We note that fruitflies use essentially the same strategy. Therefore, rotating color space into primary achromatic and chromatic axes at the eye’s first synapse may thus be a fundamental principle of color vision when using more than two spectrally well-separated photoreceptor types.

Ganglion cells in larval zebrafish retina integrate inputs from multiple cone types

We recently showed the presence of seven physiological cone opsins-R1 (575 nm), R2 (556 nm), G1 (460 nm), G3 (480 nm), B1 (415 nm), B2 (440 nm), and UV (358 nm)-in electroretinogram (ERG) recordings of larval zebrafish (Danio rerio) retina. Larval ganglion cells (GCs) are generally thought to integrate only four cone opsin signals (red, green, blue, and UV). We address the question as to whether they may integrate seven cone spectral signals. Here we examined the 127 possible combinations of seven cone signals to find the optimal representation, as based on impulse discharge data sets from GC axons in the larval optic nerve. We recorded four varieties of light-response waveform, sustained-ON, transient-ON, ON-OFF, and OFF, based on the time course of mean discharge rates to all stimulus wavelengths combined. Modeling of GC responses revealed that each received 1-6 cone opsin signals, with a mean of 3.8 ± 1.3 cone signals/GC. Most onset or offset responses were opponent (ON, 80%; OFF, 100%). The most common cone signals were UV (93%), R2 (50%), G3 (55%), and G1 (60%). Seventy-three percent of cone opsin signals were excitatory, and 27% were inhibitory. UV signals favored excitation, whereas G3 and B2 signals favored inhibition. R1/R2, G1/G3, and B1/B2 opsin signals were selectively associated along a nonsynergistic/opponent axis. Overall, these results suggest that larval zebrafish GC spectral responses are complex and use inputs from the seven expressed opsins.NEW & NOTEWORTHY Ganglion cells in larval zebrafish retina have complex spectral responses driven by seven different cone opsin types. UV cone inputs are significant and excitatory to ganglion cells, whereas green and blue cone inputs favor inhibition. Most dramatic are the pentachromatic cells. These responses were identified at 5-6 days after fertilization, reflecting an impressive level of color processing not seen in older fish or mammals.

Circuit mechanisms for colour vision in zebrafish

The use of spectral information in natural light to inform behaviour is one of the oldest and most fundamental abilities of visual systems. It long-predates animals' venture onto the land, and even the appearance of image-forming eyes. Accordingly, circuits for colour vision evolved under the surface of ancient oceans for hundreds of millions of years. These aquatic beginnings fundamentally underpin, and likely constrain, the organisation of modern visual systems. In contrast to our detailed circuit level understanding from diverse terrestrial vertebrates, however, comparatively little is known about their aquatic counterparts. Here, I summarise some of what is known about neural circuits for colour vision in fish, the most species-diverse group of vertebrates. With a focus on zebrafish, I will explore how their computational strategies are linked to the statistics of natural light in the underwater world, and how their study might help us understand vision in general, including in our own eyes.

Colourfulness as a possible measure of object proximity in the larval zebrafish brain

The encoding of light increments and decrements by separate On- and Off- systems is a fundamental ingredient of vision, which supports edge detection and makes efficient use of the limited dynamic range of visual neurons1. Theory predicts that the neural representation of On- and Off-signals should be balanced, including across an animal's visible spectrum. Here we find that larval zebrafish violate this textbook expectation: in the zebrafish brain, UV-stimulation near exclusively gives On-responses, blue/green stimulation mostly Off-responses, and red-light alone elicits approximately balanced On- and Off-responses (see also references2-4). We link these findings to zebrafish visual ecology, and suggest that the observed spectral tuning boosts the encoding of object 'colourfulness', which correlates with object proximity in their underwater world5.

Distributed chromatic processing at the interface between retina and brain in the larval zebrafish

Larval zebrafish (Danio rerio) are an ideal organism for studying color vision, as their retina possesses four types of cone photoreceptors, covering most of the visible range and into the UV.^1,2 Additionally, their eye and nervous systems are accessible to imaging, given that they are naturally transparent.^3-5 Recent studies have found that, through a set of wavelength-range-specific horizontal, bipolar, and retinal ganglion cells (RGCs),^6-9 the eye relays tetrachromatic information to several retinorecipient areas (RAs).^10-13 The main RA is the optic tectum, receiving 97% of the RGC axons via the neuropil mass termed arborization field 10 (AF10).^14,15 Here, we aim to understand the processing of chromatic signals at the interface between RGCs and their major brain targets. We used 2-photon calcium imaging to separately measure the responses of RGCs and neurons in the brain to four different chromatic stimuli in awake animals. We find that chromatic information is widespread throughout the brain, with a large variety of responses among RGCs, and an even greater diversity in their targets. Specific combinations of response types are enriched in specific nuclei, but there is no single color processing structure. In the main interface in this pathway, the connection between AF10 and tectum, we observe key elements of neural processing, such as enhanced signal decorrelation and improved chromatic decoding.^16,17 A richer stimulus set revealed that these enhancements occur in the context of a more distributed code in tectum, facilitating chromatic signal association in this small vertebrate brain.

Molecular classification of zebrafish retinal ganglion cells links genes to cell types to behavior

Retinal ganglion cells (RGCs) form an array of feature detectors, which convey visual information to central brain regions. Characterizing RGC diversity is required to understand the logic of the underlying functional segregation. Using single-cell transcriptomics, we systematically classified RGCs in adult and larval zebrafish, thereby identifying marker genes for >30 mature types and several developmental intermediates. We used this dataset to engineer transgenic driver lines, enabling specific experimental access to a subset of RGC types. Expression of one or few transcription factors often predicts dendrite morphologies and axonal projections to specific tectal layers and extratectal targets. In vivo calcium imaging revealed that molecularly defined RGCs exhibit specific functional tuning. Finally, chemogenetic ablation of eomesa+ RGCs, which comprise melanopsin-expressing types with projections to a small subset of central targets, selectively impaired phototaxis. Together, our study establishes a framework for systematically studying the functional architecture of the visual system.

Colored visual stimuli evoke spectrally tuned neuronal responses across the central nervous system of zebrafish larvae

BACKGROUND

Visually guided behaviors such as optomotor and optokinetic responses, phototaxis, and prey capture are crucial for survival in zebrafish and become apparent after just a few days of development. Color vision, which in zebrafish is based on a spatially anisotropic tetrachromatic retina, provides an additional important component of world representation driving fundamental larval behaviors. However, little is known about the central nervous system (CNS) circuitry underlying color vision processing downstream of the retina, and its activity correlates with behavior. Here, we used the transparent larva of zebrafish to image CNS neurons and their activity in response to colored visual stimuli.

RESULTS

To investigate the processing of chromatic information in the zebrafish larva brain, we mapped with cellular resolution, spectrally responsive neurons in the larva encephalon and spinal cord. We employed the genetically encoded calcium indicator GCaMP6s and two-photon microscopy to image the neuronal activity while performing visual stimulation with spectrally distinct stimuli at wavelengths matching the absorption peaks of the four zebrafish cone types. We observed the presence of a high number of wavelength-selective neurons not only in the optic tectum, but also in all other regions of the CNS, demonstrating that the circuitry involved in processing spectral information and producing color-selective responses extends to the whole CNS.

CONCLUSIONS

Our measurements provide a map of neurons involved in color-driven responses, revealing that spectral information spreads in all regions of the CNS. This suggests the underlying complexity of the circuits involved and opens the way to their detailed future investigation.

Seeing Beyond Violet: UV Cones Guide High-Resolution Prey-Capture Behavior in Fish

How can fish see tiny underwater prey invisible to human eyes? In this issue of Neuron, Yoshimatsu et al. (2020) show that ultraviolet light and a rich set of fine-tuned anatomical and neural specializations originating in ultraviolet-sensitive cones underlie high-resolution prey-capture behavior in larval zebrafish.