Natural binocular depth discrimination behavior in mice explained by visual cortical activity

Development of the Binocular Circuit

Seeing in three dimensions is a major property of the visual system in mammals. The circuit underlying this property begins in the retina, from which retinal ganglion cells (RGCs) extend to the same or opposite side of the brain. RGC axons decussate to form the optic chiasm, then grow to targets in the thalamus and midbrain, where they synapse with neurons that project to the visual cortex. Here we review the cellular and molecular mechanisms of RGC axonal growth cone guidance across or away from the midline via receptors to cues in the midline environment. We present new views on the specification of ipsi- and contralateral RGC subpopulations and factors implementing their organization in the optic tract and termination in subregions of their targets. Lastly, we describe the functional and behavioral aspects of binocular vision, focusing on the mouse, and discuss recent discoveries in the evolution of the binocular circuit.

Pictorial depth cues elicit the perception of tridimensionality in dogs

The perception of tridimensionality is elicited by binocular disparity, motion parallax, and monocular or pictorial cues. The perception of tridimensionality arising from pictorial cues has been investigated in several non-human animal species. Although dogs can use and discriminate bidimensional images, to date there is no evidence of dogs' ability to perceive tridimensionality in pictures and/or through pictorial cues. The aim of the present study was to assess the perception of tridimensionality in dogs elicited by two pictorial cues: linear perspective and shading. Thirty-two dogs were presented with a tridimensional stimulus (i.e., a ball) rolling onto a planar surface until eventually falling into a hole (control condition) or until reaching and rolling over an illusory hole (test condition). The illusory hole corresponded to the bidimensional pictorial representation of the real hole, in which the pictorial cues of shading and linear perspective created the impression of tridimensionality. In a violation of expectation paradigm, dogs showed a longer looking time at the scene in which the unexpected situation of a ball rolling over an illusory hole occurred. The surprise reaction observed in the test condition suggests that the pictorial cues of shading and linear perspective in the bidimensional image of the hole were able to elicit the perception of tridimensionality in dogs.

A pupillary contrast response in mice and humans: Neural mechanisms and visual functions

In the pupillary light response (PLR), increases in ambient light constrict the pupil to dampen increases in retinal illuminance. Here, we report that the pupillary reflex arc implements a second input-output transformation; it senses temporal contrast to enhance spatial contrast in the retinal image and increase visual acuity. The pupillary contrast response (PCoR) is driven by rod photoreceptors via type 6 bipolar cells and M1 ganglion cells. Temporal contrast is transformed into sustained pupil constriction by the M1's conversion of excitatory input into spike output. Computational modeling explains how the PCoR shapes retinal images. Pupil constriction improves acuity in gaze stabilization and predation in mice. Humans exhibit a PCoR with similar tuning properties to mice, which interacts with eye movements to optimize the statistics of the visual input for retinal encoding. Thus, we uncover a conserved component of active vision, its cell-type-specific pathway, computational mechanisms, and optical and behavioral significance.

Cell-type specific binocular interactions in mouse visual thalamus

Projections from each eye are segregated in separate domains within the dorsal lateral geniculate nucleus (dLGN). Yet, in vivo studies indicate that the activity of single dLGN neurons can be influenced by visual stimuli presented to either eye. In this study we explored whether intrinsic circuits mediate binocular interactions in the mouse dLGN. We employed dual color optogenetics in vitro to selectively activate input from each eye and recorded synaptic responses in thalamocortical (relay) cells as well as inhibitory interneurons, which have extensive dendritic arbors that are not confined to eye specific domains. While most relay cells received monocular retinal input, most interneurons received binocular retinal input; consequently, the majority of dLGN relay cells received binocular retinogeniculate-evoked inhibition. Moreover, in recordings from adjacent pairs of relay cells and interneurons, the most common relationship observed was binocular excitation of interneurons paired with binocular inhibition of adjacent relay cells. Finally, we found that dLGN interneurons are interconnected, displaying both monocular and binocular inhibition in response to retinal activation. In sum, our results indicate that geniculate interneurons provide one of the first locations where signals from the two eyes can be compared, integrated, and adjusted before being transmitted to cortex, shedding new light on the role of the thalamus in binocular vision.

Highlights

In vitro dual color optogenetics examined convergence of eye-specific retinal inputs to thalamocortical (relay) cells and interneurons in the dLGNThe majority of relay cells receive monocular excitatory retinogeniculate input while the majority of interneurons receive binocular inputBinocular relay cells are located in and around the ipsilateral patch whereas binocular interneurons are distributed throughout the dLGNThe majority of relay cells receive binocular retinogeniculate-evoked inhibitiondLGN interneurons are interconnected, receiving both monocular and binocular retinogeniculate-evoked inhibition.

Natural visual behavior and active sensing in the mouse

In the natural world, animals use vision for a wide variety of behaviors not reflected in most laboratory paradigms. Although mice have low-acuity vision, they use their vision for many natural behaviors, including predator avoidance, prey capture, and navigation. They also perform active sensing, moving their head and eyes to achieve behavioral goals and acquire visual information. These aspects of natural vision result in visual inputs and corresponding behavioral outputs that are outside the range of conventional vision studies but are essential aspects of visual function. Here, we review recent studies in mice that have tapped into natural behavior and active sensing to reveal the computational logic of neural circuits for vision.

From innate to instructed: A new look at perceptual decision-making

Understanding how subjects perceive sensory stimuli in their environment and use this information to guide appropriate actions is a major challenge in neuroscience. To study perceptual decision-making in animals, researchers use tasks that either probe spontaneous responses to stimuli (often described as "naturalistic") or train animals to associate stimuli with experimenter-defined responses. Spontaneous decisions rely on animals' pre-existing knowledge, while trained tasks offer greater versatility, albeit often at the cost of extensive training. Here, we review emerging approaches to investigate perceptual decision-making using both spontaneous and trained behaviors, highlighting their strengths and limitations. Additionally, we propose how trained decision-making tasks could be improved to achieve faster learning and a more generalizable understanding of task rules.

Behind mouse eyes: The function and control of eye movements in mice

The mouse visual system has become the most popular model to study the cellular and circuit mechanisms of sensory processing. However, the importance of eye movements only started to be appreciated recently. Eye movements provide a basis for predictive sensing and deliver insights into various brain functions and dysfunctions. A plethora of knowledge on the central control of eye movements and their role in perception and behaviour arose from work on primates. However, an overview of various eye movements in mice and a comparison to primates is missing. Here, we review the eye movement types described to date in mice and compare them to those observed in primates. We discuss the central neuronal mechanisms for their generation and control. Furthermore, we review the mounting literature on eye movements in mice during head-fixed and freely moving behaviours. Finally, we highlight gaps in our understanding and suggest future directions for research.

Full field-of-view virtual reality goggles for mice

Visual virtual reality (VR) systems for head-fixed mice offer advantages over real-world studies for investigating the neural circuitry underlying behavior. However, current VR approaches do not fully cover the visual field of view of mice, do not stereoscopically illuminate the binocular zone, and leave the lab frame visible. To overcome these limitations, we developed iMRSIV (Miniature Rodent Stereo Illumination VR)-VR goggles for mice. Our system is compact, separately illuminates each eye for stereo vision, and provides each eye with an ∼180° field of view, thus excluding the lab frame while accommodating saccades. Mice using iMRSIV while navigating engaged in virtual behaviors more quickly than in a current monitor-based system and displayed freezing and fleeing reactions to overhead looming stimulation. Using iMRSIV with two-photon functional imaging, we found large populations of hippocampal place cells during virtual navigation, global remapping during environment changes, and unique responses of place cell ensembles to overhead looming stimulation.

Representation of conspecific vocalizations in amygdala of awake marmosets

Human speech and animal vocalizations are important for social communication and animal survival. Neurons in the auditory pathway are responsive to a range of sounds, from elementary sound features to complex acoustic sounds. For social communication, responses to distinct patterns of vocalization are usually highly specific to an individual conspecific call, in some species. This includes the specificity of sound patterns and embedded biological information. We conducted single-unit recordings in the amygdala of awake marmosets and presented calls used in marmoset communication, calls of other species and calls from specific marmoset individuals. We found that some neurons (47/262) in the amygdala distinguished 'Phee' calls from vocalizations of other animals and other types of marmoset vocalizations. Interestingly, a subset of Phee-responsive neurons (22/47) also exhibited selectivity to one out of the three Phees from two different 'caller' marmosets. Our findings suggest that, while it has traditionally been considered the key structure in the limbic system, the amygdala also represents a critical stage of socially relevant auditory perceptual processing.

Widespread and Multifaceted Binocular Integration in the Mouse Primary Visual Cortex

The brain combines two-dimensional images received from the two eyes to form a percept of three-dimensional surroundings. This process of binocular integration in the primary visual cortex (V1) serves as a useful model for studying how neural circuits generate emergent properties from multiple input signals. Here, we perform a thorough characterization of binocular integration using electrophysiological recordings in the V1 of awake adult male and female mice by systematically varying the orientation and phase disparity of monocular and binocular stimuli. We reveal widespread binocular integration in mouse V1 and demonstrate that the three commonly studied binocular properties-ocular dominance, interocular matching, and disparity selectivity-are independent of each other. For individual neurons, the responses to monocular stimulation can predict the average amplitude of binocular response but not its selectivity. Finally, the extensive and independent binocular integration of monocular inputs is seen across cortical layers in both regular-spiking and fast-spiking neurons, regardless of stimulus design. Our data indicate that the current model of simple feedforward convergence is inadequate to account for binocular integration in mouse V1, thus suggesting an indispensable role played by intracortical circuits in binocular computation.SIGNIFICANCE STATEMENT Binocular integration is an important step of visual processing that takes place in the visual cortex. Studying the process by which V1 neurons become selective for certain binocular disparities is informative about how neural circuits integrate multiple information streams at a more general level. Here, we systematically characterize binocular integration in mice. Our data demonstrate more widespread and complex binocular integration in mouse V1 than previously reported. Binocular responses cannot be explained by a simple convergence of monocular responses, contrary to the prevailing model of binocular integration. These findings thus indicate that intracortical circuits must be involved in the exquisite computation of binocular disparity, which would endow brain circuits with the plasticity needed for binocular development and processing.

Human deprivation amblyopia: treatment insights from animal models

Amblyopia is a common visual impairment that develops during the early years of postnatal life. It emerges as a sequela to eye misalignment, an imbalanced refractive state, or obstruction to form vision. All of these conditions prevent normal vision and derail the typical development of neural connections within the visual system. Among the subtypes of amblyopia, the most debilitating and recalcitrant to treatment is deprivation amblyopia. Nevertheless, human studies focused on advancing the standard of care for amblyopia have largely avoided recruitment of patients with this rare but severe impairment subtype. In this review, we delineate characteristics of deprivation amblyopia and underscore the critical need for new and more effective therapy. Animal models offer a unique opportunity to address this unmet need by enabling the development of unconventional and potent amblyopia therapies that cannot be pioneered in humans. Insights derived from studies using animal models are discussed as potential therapeutic innovations for the remediation of deprivation amblyopia. Retinal inactivation is highlighted as an emerging therapy that exhibits efficacy against the effects of monocular deprivation at ages when conventional therapy is ineffective, and recovery occurs without apparent detriment to the treated eye.

Interactions between rodent visual and spatial systems during navigation

Many behaviours that are critical for animals to survive and thrive rely on spatial navigation. Spatial navigation, in turn, relies on internal representations about one's spatial location, one's orientation or heading direction and the distance to objects in the environment. Although the importance of vision in guiding such internal representations has long been recognized, emerging evidence suggests that spatial signals can also modulate neural responses in the central visual pathway. Here, we review the bidirectional influences between visual and navigational signals in the rodent brain. Specifically, we discuss reciprocal interactions between vision and the internal representations of spatial position, explore the effects of vision on representations of an animal's heading direction and vice versa, and examine how the visual and navigational systems work together to assess the relative distances of objects and other features. Throughout, we consider how technological advances and novel ethological paradigms that probe rodent visuo-spatial behaviours allow us to advance our understanding of how brain areas of the central visual pathway and the spatial systems interact and enable complex behaviours.

Peripheral and central sensation: multisensory orienting and recognition across species

Attentional bottlenecks force animals to deeply process only a selected fraction of sensory inputs. This motivates a unifying central-peripheral dichotomy (CPD), which separates multisensory processing into functionally defined central and peripheral senses. Peripheral senses (e.g., human audition and peripheral vision) select a fraction of the sensory inputs by orienting animals' attention; central senses (e.g., human foveal vision) allow animals to recognize the selected inputs. Originally used to understand human vision, CPD can be applied to multisensory processes across species. I first describe key characteristics of central and peripheral senses, such as the degree of top-down feedback and density of sensory receptors, and then show CPD as a framework to link ecological, behavioral, neurophysiological, and anatomical data and produce falsifiable predictions.

Stereopsis without correspondence

Stereopsis has traditionally been considered a complex visual ability, restricted to large-brained animals. The discovery in the 1980s that insects, too, have stereopsis, therefore, challenged theories of stereopsis. How can such simple brains see in three dimensions? A likely answer is that insect stereopsis has evolved to produce simple behaviour, such as orienting towards the closer of two objects or triggering a strike when prey comes within range. Scientific thinking about stereopsis has been unduly anthropomorphic, for example assuming that stereopsis must require binocular fusion or a solution of the stereo correspondence problem. In fact, useful behaviour can be produced with very basic stereoscopic algorithms which make no attempt to achieve fusion or correspondence, or to produce even a coarse map of depth across the visual field. This may explain why some aspects of insect stereopsis seem poorly designed from an engineering point of view: for example, paying no attention to whether interocular contrast or velocities match. Such algorithms demonstrably work well enough in practice for their species, and may prove useful in particular autonomous applications. This article is part of a discussion meeting issue 'New approaches to 3D vision'.

CyclinD2-mediated regulation of neurogenic output from the retinal ciliary margin is perturbed in albinism

In albinism, aberrations in the ipsi-/contralateral retinal ganglion cell (RGC) ratio compromise the functional integrity of the binocular circuit. Here, we focus on the mouse ciliary margin zone (CMZ), a neurogenic niche at the embryonic peripheral retina, to investigate developmental processes regulating RGC neurogenesis and identity acquisition. We found that the mouse ventral CMZ generates predominantly ipsilaterally projecting RGCs, but this output is altered in the albino visual system because of CyclinD2 downregulation and disturbed timing of the cell cycle. Consequently, albino as well as CyclinD2-deficient pigmented mice exhibit diminished ipsilateral retinogeniculate projection and poor depth perception. In albino mice, pharmacological stimulation of calcium channels, known to upregulate CyclinD2 in other cell types, augmented CyclinD2-dependent neurogenesis of ipsilateral RGCs and improved stereopsis. Together, these results implicate CMZ neurogenesis and its regulators as critical for the formation and function of the mammalian binocular circuit.

Neural circuits for binocular vision: Ocular dominance, interocular matching, and disparity selectivity

The brain creates a single visual percept of the world with inputs from two eyes. This means that downstream structures must integrate information from the two eyes coherently. Not only does the brain meet this challenge effortlessly, it also uses small differences between the two eyes' inputs, i.e., binocular disparity, to construct depth information in a perceptual process called stereopsis. Recent studies have advanced our understanding of the neural circuits underlying stereoscopic vision and its development. Here, we review these advances in the context of three binocular properties that have been most commonly studied for visual cortical neurons: ocular dominance of response magnitude, interocular matching of orientation preference, and response selectivity for binocular disparity. By focusing mostly on mouse studies, as well as recent studies using ferrets and tree shrews, we highlight unresolved controversies and significant knowledge gaps regarding the neural circuits underlying binocular vision. We note that in most ocular dominance studies, only monocular stimulations are used, which could lead to a mischaracterization of binocularity. On the other hand, much remains unknown regarding the circuit basis of interocular matching and disparity selectivity and its development. We conclude by outlining opportunities for future studies on the neural circuits and functional development of binocular integration in the early visual system.

Joint coding of visual input and eye/head position in V1 of freely moving mice

Visual input during natural behavior is highly dependent on movements of the eyes and head, but how information about eye and head position is integrated with visual processing during free movement is unknown, as visual physiology is generally performed under head fixation. To address this, we performed single-unit electrophysiology in V1 of freely moving mice while simultaneously measuring the mouse's eye position, head orientation, and the visual scene from the mouse's perspective. From these measures, we mapped spatiotemporal receptive fields during free movement based on the gaze-corrected visual input. Furthermore, we found a significant fraction of neurons tuned for eye and head position, and these signals were integrated with visual responses through a multiplicative mechanism in the majority of modulated neurons. These results provide new insight into coding in the mouse V1 and, more generally, provide a paradigm for investigating visual physiology under natural conditions, including active sensing and ethological behavior.

Unusual Mathematical Approaches Untangle Nervous Dynamics

The massive amount of available neurodata suggests the existence of a mathematical backbone underlying neuronal oscillatory activities. For example, geometric constraints are powerful enough to define cellular distribution and drive the embryonal development of the central nervous system. We aim to elucidate whether underrated notions from geometry, topology, group theory and category theory can assess neuronal issues and provide experimentally testable hypotheses. The Monge’s theorem might contribute to our visual ability of depth perception and the brain connectome can be tackled in terms of tunnelling nanotubes. The multisynaptic ascending fibers connecting the peripheral receptors to the neocortical areas can be assessed in terms of knot theory/braid groups. Presheaves from category theory permit the tackling of nervous phase spaces in terms of the theory of infinity categories, highlighting an approach based on equivalence rather than equality. Further, the physical concepts of soft-matter polymers and nematic colloids might shed new light on neurulation in mammalian embryos. Hidden, unexpected multidisciplinary relationships can be found when mathematics copes with neural phenomena, leading to novel answers for everlasting neuroscientific questions. For instance, our framework leads to the conjecture that the development of the nervous system might be correlated with the occurrence of local thermal changes in embryo–fetal tissues.

Distance estimation from monocular cues in an ethological visuomotor task

In natural contexts, sensory processing and motor output are closely coupled, which is reflected in the fact that many brain areas contain both sensory and movement signals. However, standard reductionist paradigms decouple sensory decisions from their natural motor consequences, and head-fixation prevents the natural sensory consequences of self-motion. In particular, movement through the environment provides a number of depth cues beyond stereo vision that are poorly understood. To study the integration of visual processing and motor output in a naturalistic task, we investigated distance estimation in freely moving mice. We found that mice use vision to accurately jump across a variable gap, thus directly coupling a visual computation to its corresponding ethological motor output. Monocular eyelid suture did not affect gap jumping success, thus mice can use cues that do not depend on binocular disparity and stereo vision. Under monocular conditions, mice altered their head positioning and performed more vertical head movements, consistent with a shift from using stereopsis to other monocular cues, such as motion or position parallax. Finally, optogenetic suppression of primary visual cortex impaired task performance under both binocular and monocular conditions when optical fiber placement was localized to binocular or monocular zone V1, respectively. Together, these results show that mice can use monocular cues, relying on visual cortex, to accurately judge distance. Furthermore, this behavioral paradigm provides a foundation for studying how neural circuits convert sensory information into ethological motor output.

The Development of Receptive Field Tuning Properties in Mouse Binocular Primary Visual Cortex

The mouse primary visual cortex is a model system for understanding the relationship between cortical structure, function, and behavior (Seabrook et al., 2017; Chaplin and Margrie, 2020; Hooks and Chen, 2020; Saleem, 2020; Flossmann and Rochefort, 2021). Binocular neurons in V1 are the cellular basis of binocular vision, which is required for predation (Scholl et al., 2013; Hoy et al., 2016; La Chioma et al., 2020; Berson, 2021; Johnson et al., 2021). The normal development of binocular responses, however, has not been systematically measured. Here, we measure tuning properties of neurons to either eye in awake mice of either sex from eye opening to the closure of the critical period. At eye opening, we find an adult-like fraction of neurons responding to the contralateral-eye stimulation, which are selective for orientation and spatial frequency; few neurons respond to ipsilateral eye, and their tuning is immature. Fraction of ipsilateral-eye responses increases rapidly in the first few days after eye opening and more slowly thereafter, reaching adult levels by critical period closure. Tuning of these responses improves with a similar time course. The development and tuning of binocular responses parallel that of ipsilateral-eye responses. Four days after eye opening, monocular neurons respond to a full range of orientations but become more biased to cardinal orientations. Binocular responses, by contrast, lose their cardinal bias with age. Together, these data provide an in-depth accounting of the development of monocular and binocular responses in the binocular region of mouse V1 using a consistent set of visual stimuli and measurements.SIGNIFICANCE STATEMENT In this manuscript, we present a full accounting of the emergence and refinement of monocular and binocular receptive field tuning properties of thousands of pyramidal neurons in mouse primary visual cortex. Our data reveal new features of monocular and binocular development that revise current models on the emergence of cortical binocularity. Given the recent interest in visually guided behaviors in mice that require binocular vision (e.g., predation), our measures will provide the basis for studies on the emergence of the neural circuitry guiding these behaviors.

Vision: Depth perception in climbing mice

Depth perception helps animals interact with a three-dimensional world. A new study presents a novel paradigm for studying depth perception in naturally climbing mice and links their behavior to binocular disparity signals in primary visual cortical neurons.