Area-Specific Mapping of Binocular Disparity across Mouse Visual Cortex

Natural visual behavior and active sensing in the mouse

In the natural world, animals use vision for a wide variety of behaviors not reflected in most laboratory paradigms. Although mice have low-acuity vision, they use their vision for many natural behaviors, including predator avoidance, prey capture, and navigation. They also perform active sensing, moving their head and eyes to achieve behavioral goals and acquire visual information. These aspects of natural vision result in visual inputs and corresponding behavioral outputs that are outside the range of conventional vision studies but are essential aspects of visual function. Here, we review recent studies in mice that have tapped into natural behavior and active sensing to reveal the computational logic of neural circuits for vision.

Behind mouse eyes: The function and control of eye movements in mice

The mouse visual system has become the most popular model to study the cellular and circuit mechanisms of sensory processing. However, the importance of eye movements only started to be appreciated recently. Eye movements provide a basis for predictive sensing and deliver insights into various brain functions and dysfunctions. A plethora of knowledge on the central control of eye movements and their role in perception and behaviour arose from work on primates. However, an overview of various eye movements in mice and a comparison to primates is missing. Here, we review the eye movement types described to date in mice and compare them to those observed in primates. We discuss the central neuronal mechanisms for their generation and control. Furthermore, we review the mounting literature on eye movements in mice during head-fixed and freely moving behaviours. Finally, we highlight gaps in our understanding and suggest future directions for research.

A primary sensory cortical interareal feedforward inhibitory circuit for tacto-visual integration

Tactile sensation and vision are often both utilized for the exploration of objects that are within reach though it is not known whether or how these two distinct sensory systems combine such information. Here in mice, we used a combination of stereo photogrammetry for 3D reconstruction of the whisker array, brain-wide anatomical tracing and functional connectivity analysis to explore the possibility of tacto-visual convergence in sensory space and within the circuitry of the primary visual cortex (VISp). Strikingly, we find that stimulation of the contralateral whisker array suppresses visually evoked activity in a tacto-visual sub-region of VISp whose visual space representation closely overlaps with the whisker search space. This suppression is mediated by local fast-spiking interneurons that receive a direct cortico-cortical input predominantly from layer 6 neurons located in the posterior primary somatosensory barrel cortex (SSp-bfd). These data demonstrate functional convergence within and between two primary sensory cortical areas for multisensory object detection and recognition.

Mammals Achieve Common Neural Coverage of Visual Scenes Using Distinct Sampling Behaviors

Most vertebrates use head and eye movements to quickly change gaze orientation and sample different portions of the environment with periods of stable fixation. Visual information must be integrated across fixations to construct a complete perspective of the visual environment. In concert with this sampling strategy, neurons adapt to unchanging input to conserve energy and ensure that only novel information from each fixation is processed. We demonstrate how adaptation recovery times and saccade properties interact and thus shape spatiotemporal tradeoffs observed in the motor and visual systems of mice, cats, marmosets, macaques, and humans. These tradeoffs predict that in order to achieve similar visual coverage over time, animals with smaller receptive field sizes require faster saccade rates. Indeed, we find comparable sampling of the visual environment by neuronal populations across mammals when integrating measurements of saccadic behavior with receptive field sizes and V1 neuronal density. We propose that these mammals share a common statistically driven strategy of maintaining coverage of their visual environment over time calibrated to their respective visual system characteristics.

Truly pattern: Nonlinear integration of motion signals is required to account for the responses of pattern cells in rat visual cortex

A key feature of advanced motion processing in the primate dorsal stream is the existence of pattern cells-specialized cortical neurons that integrate local motion signals into pattern-invariant representations of global direction. Pattern cells have also been reported in rodent visual cortex, but it is unknown whether the tuning of these neurons results from truly integrative, nonlinear mechanisms or trivially arises from linear receptive fields (RFs) with a peculiar geometry. Here, we show that pattern cells in rat primary (V1) and lateromedial (LM) visual cortex process motion direction in a way that cannot be explained by the linear spatiotemporal structure of their RFs. Instead, their tuning properties are consistent with and well explained by those of units in a state-of-the-art neural network model of the dorsal stream. This suggests that similar cortical processes underlay motion representation in primates and rodents. The latter could thus serve as powerful model systems to unravel the underlying circuit-level mechanisms.

Saccade-Responsive Visual Cortical Neurons Do Not Exhibit Distinct Visual Response Properties

Rapid saccadic eye movements are used by animals to sample different parts of the visual scene. Previous work has investigated neural correlates of these saccades in visual cortical areas such as V1; however, how saccade-responsive neurons are distributed across visual areas, cell types, and cortical layers has remained unknown. Through analyzing 818 1 h experimental sessions from the Allen Brain Observatory, we present a large-scale analysis of saccadic behaviors in head-fixed mice and their neural correlates. We find that saccade-responsive neurons are present across visual cortex, but their distribution varies considerably by transgenically defined cell type, cortical area, and cortical layer. We also find that saccade-responsive neurons do not exhibit distinct visual response properties from the broader neural population, suggesting that the saccadic responses of these neurons are likely not predominantly visually driven. These results provide insight into the roles played by different cell types within a broader, distributed network of sensory and motor interactions.

Mammals achieve common neural coverage of visual scenes using distinct sampling behaviors

Most vertebrates use head and eye movements to quickly change gaze orientation and sample different portions of the environment with periods of stable fixation. Visual information must be integrated across several fixations to construct a more complete perspective of the visual environment. In concert with this sampling strategy, neurons adapt to unchanging input to conserve energy and ensure that only novel information from each fixation is processed. We demonstrate how adaptation recovery times and saccade properties interact, and thus shape spatiotemporal tradeoffs observed in the motor and visual systems of different species. These tradeoffs predict that in order to achieve similar visual coverage over time, animals with smaller receptive field sizes require faster saccade rates. Indeed, we find comparable sampling of the visual environment by neuronal populations across mammals when integrating measurements of saccadic behavior with receptive field sizes and V1 neuronal density. We propose that these mammals share a common statistically driven strategy of maintaining coverage of their visual environment over time calibrated to their respective visual system characteristics.

Interactions between rodent visual and spatial systems during navigation

Many behaviours that are critical for animals to survive and thrive rely on spatial navigation. Spatial navigation, in turn, relies on internal representations about one's spatial location, one's orientation or heading direction and the distance to objects in the environment. Although the importance of vision in guiding such internal representations has long been recognized, emerging evidence suggests that spatial signals can also modulate neural responses in the central visual pathway. Here, we review the bidirectional influences between visual and navigational signals in the rodent brain. Specifically, we discuss reciprocal interactions between vision and the internal representations of spatial position, explore the effects of vision on representations of an animal's heading direction and vice versa, and examine how the visual and navigational systems work together to assess the relative distances of objects and other features. Throughout, we consider how technological advances and novel ethological paradigms that probe rodent visuo-spatial behaviours allow us to advance our understanding of how brain areas of the central visual pathway and the spatial systems interact and enable complex behaviours.

Walking humans and running mice: perception and neural encoding of optic flow during self-motion

Locomotion produces full-field optic flow that often dominates the visual motion inputs to an observer. The perception of optic flow is in turn important for animals to guide their heading and interact with moving objects. Understanding how locomotion influences optic flow processing and perception is therefore essential to understand how animals successfully interact with their environment. Here, we review research investigating how perception and neural encoding of optic flow are altered during self-motion, focusing on locomotion. Self-motion has been found to influence estimation and sensitivity for optic flow speed and direction. Nonvisual self-motion signals also increase compensation for self-driven optic flow when parsing the visual motion of moving objects. The integration of visual and nonvisual self-motion signals largely follows principles of Bayesian inference and can improve the precision and accuracy of self-motion perception. The calibration of visual and nonvisual self-motion signals is dynamic, reflecting the changing visuomotor contingencies across different environmental contexts. Throughout this review, we consider experimental research using humans, non-human primates and mice. We highlight experimental challenges and opportunities afforded by each of these species and draw parallels between experimental findings. These findings reveal a profound influence of locomotion on optic flow processing and perception across species. This article is part of a discussion meeting issue 'New approaches to 3D vision'.

Neural circuits for binocular vision: Ocular dominance, interocular matching, and disparity selectivity

The brain creates a single visual percept of the world with inputs from two eyes. This means that downstream structures must integrate information from the two eyes coherently. Not only does the brain meet this challenge effortlessly, it also uses small differences between the two eyes' inputs, i.e., binocular disparity, to construct depth information in a perceptual process called stereopsis. Recent studies have advanced our understanding of the neural circuits underlying stereoscopic vision and its development. Here, we review these advances in the context of three binocular properties that have been most commonly studied for visual cortical neurons: ocular dominance of response magnitude, interocular matching of orientation preference, and response selectivity for binocular disparity. By focusing mostly on mouse studies, as well as recent studies using ferrets and tree shrews, we highlight unresolved controversies and significant knowledge gaps regarding the neural circuits underlying binocular vision. We note that in most ocular dominance studies, only monocular stimulations are used, which could lead to a mischaracterization of binocularity. On the other hand, much remains unknown regarding the circuit basis of interocular matching and disparity selectivity and its development. We conclude by outlining opportunities for future studies on the neural circuits and functional development of binocular integration in the early visual system.

Strong tuning for stereoscopic depth indicates orientation-specific recurrent circuitry in tree shrew V1

Neurons in the primary visual cortex (V1) are tuned to specific disparities between the two retinal images, which form the neural substrate for stereoscopic vision. We show that V1 neurons in tree shrews, but not in mice, display highly selective responses to narrow ranges of disparity in random-dot stereograms. Surprisingly, V1 neurons in both species show similarly strong tuning to gratings of varying interocular phase differences. This stimulus-dependent dissociation of disparity tuning can be explained by a network model that combines both feedforward and recurrent connections. The features of the model connections are supported by cortical organizations specific to each species. We validate this model by identifying putative inhibitory neurons and confirming their predicted disparity tuning in both species. Together, our studies establish a foundation for using tree shrews in studying binocular vision and raise an exciting possibility of how cortical columns could be uniquely important in computing stereoscopic depth.

Diversity of spatiotemporal coding reveals specialized visual processing streams in the mouse cortex

The cerebral cortex contains diverse neural representations of the visual scene, each enabling distinct visual and spatial abilities. However, the extent to which representations are distributed or segregated across cortical areas remains poorly understood. By determining the spatial and temporal responses of >30,000 layer 2/3 pyramidal neurons, we characterize the functional organization of parallel visual streams across eight areas of the mouse cortex. While dorsal and ventral areas form complementary representations of spatiotemporal frequency, motion speed, and spatial patterns, the anterior and posterior dorsal areas show distinct specializations for fast and slow oriented contrasts. At the cellular level, while diverse spatiotemporal tuning lies along a continuum, oriented and non-oriented spatial patterns are encoded by distinct tuning types. The identified tuning types are present across dorsal and ventral streams. The data underscore the highly specific and highly distributed nature of visual cortical representations, which drives specialization of cortical areas and streams.

The cerebral cortex contains different neural representations of the visual scene. Here, the authors show diverse and stereotyped tuning composing specialized representations in the dorsal and ventral areas of the mouse visual cortex, suggesting parallel processing channels and streams.

The Development of Receptive Field Tuning Properties in Mouse Binocular Primary Visual Cortex

The mouse primary visual cortex is a model system for understanding the relationship between cortical structure, function, and behavior (Seabrook et al., 2017; Chaplin and Margrie, 2020; Hooks and Chen, 2020; Saleem, 2020; Flossmann and Rochefort, 2021). Binocular neurons in V1 are the cellular basis of binocular vision, which is required for predation (Scholl et al., 2013; Hoy et al., 2016; La Chioma et al., 2020; Berson, 2021; Johnson et al., 2021). The normal development of binocular responses, however, has not been systematically measured. Here, we measure tuning properties of neurons to either eye in awake mice of either sex from eye opening to the closure of the critical period. At eye opening, we find an adult-like fraction of neurons responding to the contralateral-eye stimulation, which are selective for orientation and spatial frequency; few neurons respond to ipsilateral eye, and their tuning is immature. Fraction of ipsilateral-eye responses increases rapidly in the first few days after eye opening and more slowly thereafter, reaching adult levels by critical period closure. Tuning of these responses improves with a similar time course. The development and tuning of binocular responses parallel that of ipsilateral-eye responses. Four days after eye opening, monocular neurons respond to a full range of orientations but become more biased to cardinal orientations. Binocular responses, by contrast, lose their cardinal bias with age. Together, these data provide an in-depth accounting of the development of monocular and binocular responses in the binocular region of mouse V1 using a consistent set of visual stimuli and measurements.SIGNIFICANCE STATEMENT In this manuscript, we present a full accounting of the emergence and refinement of monocular and binocular receptive field tuning properties of thousands of pyramidal neurons in mouse primary visual cortex. Our data reveal new features of monocular and binocular development that revise current models on the emergence of cortical binocularity. Given the recent interest in visually guided behaviors in mice that require binocular vision (e.g., predation), our measures will provide the basis for studies on the emergence of the neural circuitry guiding these behaviors.

What and Where: Location-Dependent Feature Sensitivity as a Canonical Organizing Principle of the Visual System

Traditionally, functional representations in early visual areas are conceived as retinotopic maps preserving ego-centric spatial location information while ensuring that other stimulus features are uniformly represented for all locations in space. Recent results challenge this framework of relatively independent encoding of location and features in the early visual system, emphasizing location-dependent feature sensitivities that reflect specialization of cortical circuits for different locations in visual space. Here we review the evidence for such location-specific encoding including: (1) systematic variation of functional properties within conventional retinotopic maps in the cortex; (2) novel periodic retinotopic transforms that dramatically illustrate the tight linkage of feature sensitivity, spatial location, and cortical circuitry; and (3) retinotopic biases in cortical areas, and groups of areas, that have been defined by their functional specializations. We propose that location-dependent feature sensitivity is a fundamental organizing principle of the visual system that achieves efficient representation of positional regularities in visual experience, and reflects the evolutionary selection of sensory and motor circuits to optimally represent behaviorally relevant information. Future studies are necessary to discover mechanisms underlying joint encoding of location and functional information, how this relates to behavior, emerges during development, and varies across species.

Hierarchical and nonhierarchical features of the mouse visual cortical network

Neocortical computations underlying vision are performed by a distributed network of functionally specialized areas. Mouse visual cortex, a dense interareal network that exhibits hierarchical properties, comprises subnetworks interconnecting distinct processing streams. To determine the layout of the mouse visual hierarchy, we have evaluated the laminar patterns formed by interareal axonal projections originating in each of ten areas. Reciprocally connected pairs of areas exhibit feedforward/feedback relationships consistent with a hierarchical organization. Beta regression analyses, which estimate a continuous hierarchical distance measure, indicate that the network comprises multiple nonhierarchical circuits embedded in a hierarchical organization of overlapping levels. Single-unit recordings in anaesthetized mice show that receptive field sizes are generally consistent with the hierarchy, with the ventral stream exhibiting a stricter hierarchy than the dorsal stream. Together, the results provide an anatomical metric for hierarchical distance, and reveal both hierarchical and nonhierarchical motifs in mouse visual cortex.

Mouse visual cortex is a dense, interconnected network of distinct areas. D’Souza et al. identify an anatomical index to quantify the hierarchical nature of pathways, and highlight the hierarchical and nonhierarchical features of the network.

Vision-dependent specification of cell types and function in the developing cortex

The role of postnatal experience in sculpting cortical circuitry, while long appreciated, is poorly understood at the level of cell types. We explore this in the mouse primary visual cortex (V1) using single-nucleus RNA sequencing, visual deprivation, genetics, and functional imaging. We find that vision selectively drives the specification of glutamatergic cell types in upper layers (L) (L2/3/4), while deeper-layer glutamatergic, GABAergic, and non-neuronal cell types are established prior to eye opening. L2/3 cell types form an experience-dependent spatial continuum defined by the graded expression of ∼200 genes, including regulators of cell adhesion and synapse formation. One of these genes, Igsf9b, a vision-dependent gene encoding an inhibitory synaptic cell adhesion molecule, is required for the normal development of binocular responses in L2/3. In summary, vision preferentially regulates the development of upper-layer glutamatergic cell types through the regulation of cell-type-specific gene expression programs.

Visual pursuit behavior in mice maintains the pursued prey on the retinal region with least optic flow

Mice have a large visual field that is constantly stabilized by vestibular ocular reflex (VOR) driven eye rotations that counter head-rotations. While maintaining their extensive visual coverage is advantageous for predator detection, mice also track and capture prey using vision. However, in the freely moving animal quantifying object location in the field of view is challenging. Here, we developed a method to digitally reconstruct and quantify the visual scene of freely moving mice performing a visually based prey capture task. By isolating the visual sense and combining a mouse eye optic model with the head and eye rotations, the detailed reconstruction of the digital environment and retinal features were projected onto the corneal surface for comparison, and updated throughout the behavior. By quantifying the spatial location of objects in the visual scene and their motion throughout the behavior, we show that the prey image consistently falls within a small area of the VOR-stabilized visual field. This functional focus coincides with the region of minimal optic flow within the visual field and consequently area of minimal motion-induced image-blur, as during pursuit mice ran directly toward the prey. The functional focus lies in the upper-temporal part of the retina and coincides with the reported high density-region of Alpha-ON sustained retinal ganglion cells.

Recent understanding of binocular vision in the natural environment with clinical implications

Technological advances in recent decades have allowed us to measure both the information available to the visual system in the natural environment and the rich array of behaviors that the visual system supports. This review highlights the tasks undertaken by the binocular visual system in particular and how, for much of human activity, these tasks differ from those considered when an observer fixates a static target on the midline. The everyday motor and perceptual challenges involved in generating a stable, useful binocular percept of the environment are discussed, together with how these challenges are but minimally addressed by much of current clinical interpretation of binocular function. The implications for new technology, such as virtual reality, are also highlighted in terms of clinical and basic research application.

How Cortical Circuits Implement Cortical Computations: Mouse Visual Cortex as a Model

The mouse, as a model organism to study the brain, gives us unprecedented experimental access to the mammalian cerebral cortex. By determining the cortex's cellular composition, revealing the interaction between its different components, and systematically perturbing these components, we are obtaining mechanistic insight into some of the most basic properties of cortical function. In this review, we describe recent advances in our understanding of how circuits of cortical neurons implement computations, as revealed by the study of mouse primary visual cortex. Further, we discuss how studying the mouse has broadened our understanding of the range of computations performed by visual cortex. Finally, we address how future approaches will fulfill the promise of the mouse in elucidating fundamental operations of cortex.

Mouse visual cortex contains a region of enhanced spatial resolution

The representation of space in mouse visual cortex was thought to be relatively uniform. Here we reveal, using population receptive-field (pRF) mapping techniques, that mouse visual cortex contains a region in which pRFs are considerably smaller. This region, the “focea,” represents a location in space in front of, and slightly above, the mouse. Using two-photon imaging we show that the smaller pRFs are due to lower scatter of receptive-fields at the focea and an over-representation of binocular regions of space. We show that receptive-fields of single-neurons in areas LM and AL are smaller at the focea and that mice have improved visual resolution in this region of space. Furthermore, freely moving mice make compensatory eye-movements to hold this region in front of them. Our results indicate that mice have spatial biases in their visual processing, a finding that has important implications for the use of the mouse model of vision.

The representation of space in mouse visual cortex was considered to be relatively uniform. The authors show that mice have improved visual resolution in a cortical region representing a location in space directly in front and slightly above them, showing that the representation of space in mouse visual cortex is non-uniform.

Natural binocular depth discrimination behavior in mice explained by visual cortical activity

In mice and other mammals, forebrain neurons integrate right and left eye information to generate a three-dimensional representation of the visual environment. Neurons in the visual cortex of mice are sensitive to binocular disparity,^1-3 yet it is unclear whether that sensitivity is linked to the perception of depth.^4-8 We developed a natural task based on the classic visual cliff and pole descent tasks to estimate the psychophysical range of mouse depth discrimination.^5,9 Mice with binocular vision descended to a near (shallow) surface more often when surrounding far (deep) surfaces were progressively more distant. Occlusion of one eye severely impaired their ability to target the near surface. We quantified the distance at which animals make their decisions to estimate the binocular image displacement of the checkerboard pattern on the near and far surfaces. Then, we assayed the disparity sensitivity of large populations of binocular neurons in primary visual cortex (V1) using two-photon microscopy² and quantitatively compared this information available in V1 to their behavioral sensitivity. Disparity information in V1 matches the behavioral performance over the range of depths examined and was resistant to changes in binocular alignment. These findings reveal that mice naturally use stereoscopic cues to guide their behavior and indicate a neural basis for this depth discrimination task.

Vision: Depth perception in climbing mice

Depth perception helps animals interact with a three-dimensional world. A new study presents a novel paradigm for studying depth perception in naturally climbing mice and links their behavior to binocular disparity signals in primary visual cortical neurons.

Organization of feedback projections to mouse primary visual cortex

Top-down, context-dependent modulation of visual processing has been a topic of wide interest, including in mouse primary visual cortex (V1). However, the organization of feedback projections to V1 is relatively unknown. Here, we investigated inputs to mouse V1 by injecting retrograde tracers. We developed a software pipeline that maps labeled cell bodies to corresponding brain areas in the Allen Reference Atlas. We identified more than 24 brain areas that provide inputs to V1 and quantified the relative strength of their projections. We also assessed the organization of the projections, based on either the organization of cell bodies in the source area (topography) or the distribution of projections across V1 (bias). Projections from most higher visual and some nonvisual areas to V1 showed both topography and bias. Such organization of feedback projections to V1 suggests that parts of the visual field are differentially modulated by context, which can be ethologically relevant for a navigating animal.

Cell-type-specific binocular vision guides predation in mice

Predators use vision to hunt, and hunting success is one of evolution's main selection pressures. However, how viewing strategies and visual systems are adapted to predation is unclear. Tracking predator-prey interactions of mice and crickets in 3D, we find that mice trace crickets with their binocular visual fields and that monocular mice are poor hunters. Mammalian binocular vision requires ipsi- and contralateral projections of retinal ganglion cells (RGCs) to the brain. Large-scale single-cell recordings and morphological reconstructions reveal that only a small subset (9 of 40+) of RGC types in the ventrotemporal mouse retina innervate ipsilateral brain areas (ipsi-RGCs). Selective ablation of ipsi-RGCs (<2% of RGCs) in the adult retina drastically reduces the hunting success of mice. Stimuli based on ethological observations indicate that five ipsi-RGC types reliably signal prey. Thus, viewing strategies align with a spatially restricted and cell-type-specific set of ipsi-RGCs that supports binocular vision to guide predation.

Visual Cortex: Binocular Matchmaking

Most binocular neurons in the mammalian visual cortex show matched selectivity for light stimuli presented through either eye. A recent study tracked the responses of individual neurons in early visual cortex over time, revealing that matched binocular selectivity develops through major rearrangements of binocular visual circuits.

Motion Streak Neurons in the Mouse Visual Cortex

Motion streaks are smeared representation of fast-moving objects due to temporal integration. Here, we test for motion streak signals in mice with two-photon calcium imaging. For small dots moving at low speeds, neurons in primary visual cortex (V1) encode the component motion, with preferred direction along the axis perpendicular to their preferred orientation. At high speeds, V1 neurons prefer the direction along the axis parallel to their preferred orientation, as expected for encoding motion streaks. Whereas some V1 neurons (∼20%) display a switch of preferred motion axis with increasing speed, others (>40%) respond specifically to high speeds at the parallel axis. Motion streak neurons are also seen in higher visual lateromedial (LM), anterolateral (AL), and rostrolateral (RL) areas, but with higher transition speeds, and many still prefer the perpendicular axis even with fast motion. Our results thus indicate that diverse motion encoding exists in mouse visual cortex, with intriguing differences among visual areas.

Reconsidering the Border between the Visual and Posterior Parietal Cortex of Mice

The posterior parietal cortex (PPC) contributes to multisensory and sensory-motor integration, as well as spatial navigation. Based on primate studies, the PPC is composed of several subdivisions with differing connection patterns, including areas that exhibit retinotopy. In mice the composition of the PPC is still under debate. We propose a revised anatomical delineation in which we classify the higher order visual areas rostrolateral area (RL), anteromedial area (AM), and Medio-Medial-Anterior cortex (MMA) as subregions of the mouse PPC. Retrograde and anterograde tracing revealed connectivity, characteristic for primate PPC, with sensory, retrosplenial, orbitofrontal, cingulate and motor cortex, as well as with several thalamic nuclei and the superior colliculus in the mouse. Regarding cortical input, RL receives major input from the somatosensory barrel field, while AM receives more input from the trunk, whereas MMA receives strong inputs from retrosplenial, cingulate, and orbitofrontal cortices. These input differences suggest that each posterior PPC subregion may have a distinct function. Summarized, we put forward a refined cortical map, including a mouse PPC that contains at least 6 subregions, RL, AM, MMA and PtP, MPta, LPta/A. These anatomical results set the stage for a more detailed understanding about the role that the PPC and its subdivisions play in multisensory integration-based behavior in mice.

Sensory and Behavioral Components of Neocortical Signal Flow in Discrimination Tasks with Short-Term Memory

In the neocortex, each sensory modality engages distinct sensory areas that route information to association areas. Where signal flow converges for maintaining information in short-term memory and how behavior may influence signal routing remain open questions. Using wide-field calcium imaging, we compared cortex-wide neuronal activity in layer 2/3 for mice trained in auditory and tactile tasks with delayed response. In both tasks, mice were either active or passive during stimulus presentation, moving their body or sitting quietly. Irrespective of behavioral strategy, auditory and tactile stimulation activated distinct subdivisions of the posterior parietal cortex, anterior area A and rostrolateral area RL, which held stimulus-related information necessary for the respective tasks. In the delay period, in contrast, behavioral strategy rather than sensory modality determined short-term memory location, with activity converging frontomedially in active trials and posterolaterally in passive trials. Our results suggest behavior-dependent routing of sensory-driven cortical signals flow from modality-specific posterior parietal cortex (PPC) subdivisions to higher association areas.

Disparity Sensitivity and Binocular Integration in Mouse Visual Cortex Areas

Binocular disparity, the difference between the two eyes' images, is a powerful cue to generate the 3D depth percept known as stereopsis. In primates, binocular disparity is processed in multiple areas of the visual cortex, with distinct contributions of higher areas to specific aspects of depth perception. Mice, too, can perceive stereoscopic depth, and neurons in primary visual cortex (V1) and higher-order, lateromedial (LM) and rostrolateral (RL) areas were found to be sensitive to binocular disparity. A detailed characterization of disparity tuning across mouse visual areas is lacking, however, and acquiring such data might help clarifying the role of higher areas for disparity processing and establishing putative functional correspondences to primate areas. We used two-photon calcium imaging in female mice to characterize the disparity tuning properties of neurons in visual areas V1, LM, and RL in response to dichoptically presented binocular gratings, as well as random dot correlograms (RDC). In all three areas, many neurons were tuned to disparity, showing strong response facilitation or suppression at optimal or null disparity, respectively, even in neurons classified as monocular by conventional ocular dominance (OD) measurements. Neurons in higher areas exhibited broader and more asymmetric disparity tuning curves compared with V1, as observed in primate visual cortex. Finally, we probed neurons' sensitivity to true stereo correspondence by comparing responses to correlated RDC (cRDC) and anticorrelated RDC (aRDC). Area LM, akin to primate ventral visual stream areas, showed higher selectivity for correlated stimuli and reduced anticorrelated responses, indicating higher-level disparity processing in LM compared with V1 and RL.SIGNIFICANCE STATEMENT A major cue for inferring 3D depth is disparity between the two eyes' images. Investigating how binocular disparity is processed in the mouse visual system will not only help delineating the role of mouse higher areas for visual processing, but also shed light on how the mammalian brain computes stereopsis. We found that binocular integration is a prominent feature of mouse visual cortex, as many neurons are selectively and strongly modulated by binocular disparity. Comparison of responses to correlated and anticorrelated random dot correlograms (RDC) revealed that lateromedial area (LM) is more selective to correlated stimuli, while less sensitive to anticorrelated stimuli compared with primary visual cortex (V1) and rostrolateral area (RL), suggesting higher-level disparity processing in LM, resembling primate ventral visual stream areas.

Posterior parietal cortex contributions to cross-modal brain plasticity upon sensory loss

Sensory loss causes compensatory behavior, like echolocation upon vision loss or improved visual motion detection upon deafness. This is enabled by recruitment of the deprived cortical area by the intact senses. Such cross-modal plasticity can however hamper rehabilitation via sensory substitution devices. To steer rehabilitation towards the desired outcome for the patient, having control over the cross-modal take-over is essential. Evidence accumulates to support a role for the posterior parietal cortex (PPC) in multimodal plasticity. This area shows increased activity after sensory loss, keeping similar functions but driven by other senses. Patient-specific factors like stress, social situation, age and attention, have a significant influence on the PPC and on cross-modal plasticity. We propose that understanding the response of the PPC to sensory loss and context is extremely important for determining the best possible implant-based therapies, and that mouse research holds potential to help unraveling the underlying anatomical, cellular and neuromodulatory mechanisms.

Rapid Recalibration of Peri-Personal Space: Psychophysical, Electrophysiological, and Neural Network Modeling Evidence

Interactions between individuals and the environment occur within the peri-personal space (PPS). The encoding of this space plastically adapts to bodily constraints and stimuli features. However, these remapping effects have not been demonstrated on an adaptive time-scale, trial-to-trial. Here, we test this idea first via a visuo-tactile reaction time (RT) paradigm in augmented reality where participants are asked to respond as fast as possible to touch, as visual objects approach them. Results demonstrate that RTs to touch are facilitated as a function of visual proximity, and the sigmoidal function describing this facilitation shifts closer to the body if the immediately precedent trial had indexed a smaller visuo-tactile disparity. Next, we derive the electroencephalographic correlates of PPS and demonstrate that this multisensory measure is equally shaped by recent sensory history. Finally, we demonstrate that a validated neural network model of PPS is able to account for the present results via a simple Hebbian plasticity rule. The present findings suggest that PPS encoding remaps on a very rapid time-scale and, more generally, that it is sensitive to sensory history, a key feature for any process contextualizing subsequent incoming sensory information (e.g., a Bayesian prior).

Interocular velocity cues elicit vergence eye movements in mice

We stabilize the dynamic visual world on our retina by moving our eyes in response to motion signals. Coordinated movements between the two eyes are characterized as version when both eyes move in the same direction and vergence when the two eyes move in opposite directions. Vergence eye movements are necessary to track objects in three dimensions. In primates they can be elicited by intraocular differences in either spatial signals (disparity) or velocity, requiring the integration of left and right eye inputs. Whether mice are capable of similar behaviors is not known. To address this issue, we measured vergence eye movements in mice using a stereoscopic stimulus known to elicit vergence eye movements in primates. We found that mice also exhibit vergence eye movements, although at a low gain and that the primary driver of these vergence eye movements is interocular motion. Spatial disparity cues alone are ineffective. We also found that the vergence eye movements we observed in mice were robust to silencing visual cortex and to manipulations that disrupt the normal development of binocularity in visual cortex. A sublinear combination of motor commands driven by monocular signals is sufficient to account for our results.NEW & NOTEWORTHY The visual system integrates signals from the left and right eye to generate a representation of the world in depth. The binocular integration of signals may be observed from the coordinated vergence eye movements elicited by object motion in depth. We explored the circuits and signals responsible for these vergence eye movements in rodent and find these vergence eye movements are generated by a comparison of the motion and not spatial visual signals.

Distributed and retinotopically asymmetric processing of coherent motion in mouse visual cortex

Perception of visual motion is important for a range of ethological behaviors in mammals. In primates, specific visual cortical regions are specialized for processing of coherent visual motion. However, whether mouse visual cortex has a similar organization remains unclear, despite powerful genetic tools available for measuring population neural activity. Here, we use widefield and 2-photon calcium imaging of transgenic mice to measure mesoscale and cellular responses to coherent motion. Imaging of primary visual cortex (V1) and higher visual areas (HVAs) during presentation of natural movies and random dot kinematograms (RDKs) reveals varied responsiveness to coherent motion, with stronger responses in dorsal stream areas compared to ventral stream areas. Moreover, there is considerable anisotropy within visual areas, such that neurons representing the lower visual field are more responsive to coherent motion. These results indicate that processing of visual motion in mouse cortex is distributed heterogeneously both across and within visual areas.

Vision: How Mice Control Their View

Across vertebrates, eye movements serve the dual purpose of image stabilization during head or body movement, and gaze relocation. A new study has measured head and bilateral eye movements in freely moving mice, providing a detailed characterization of dynamic gaze behavior.

Two Distinct Types of Eye-Head Coupling in Freely Moving Mice

Animals actively interact with their environment to gather sensory information. There is conflicting evidence about how mice use vision to sample their environment. During head restraint, mice make rapid eye movements coupled between the eyes, similar to conjugate saccadic eye movements in humans. However, when mice are free to move their heads, eye movements are more complex and often non-conjugate, with the eyes moving in opposite directions. We combined head and eye tracking in freely moving mice and found both observations are explained by two eye-head coupling types, associated with vestibular mechanisms. The first type comprised non-conjugate eye movements, which compensate for head tilt changes to maintain a similar visual field relative to the horizontal ground plane. The second type of eye movements was conjugate and coupled to head yaw rotation to produce a "saccade and fixate" gaze pattern. During head-initiated saccades, the eyes moved together in the head direction but during subsequent fixation moved in the opposite direction to the head to compensate for head rotation. This saccade and fixate pattern is similar to humans who use eye movements (with or without head movement) to rapidly shift gaze but in mice relies on combined head and eye movements. Both couplings were maintained during social interactions and visually guided object tracking. Even in head-restrained mice, eye movements were invariably associated with attempted head motion. Our results reveal that mice combine head and eye movements to sample their environment and highlight similarities and differences between eye movements in mice and humans.

Spatiotemporal refinement of signal flow through association cortex during learning

Association areas in neocortex encode novel stimulus-outcome relationships, but the principles of their engagement during task learning remain elusive. Using chronic wide-field calcium imaging, we reveal two phases of spatiotemporal refinement of layer 2/3 cortical activity in mice learning whisker-based texture discrimination in the dark. Even before mice reach learning threshold, association cortex-including rostro-lateral (RL), posteromedial (PM), and retrosplenial dorsal (RD) areas-is generally suppressed early during trials (between auditory start cue and whisker-texture touch). As learning proceeds, a spatiotemporal activation sequence builds up, spreading from auditory areas to RL immediately before texture touch (whereas PM and RD remain suppressed) and continuing into barrel cortex, which eventually efficiently discriminates between textures. Additional correlation analysis substantiates this diverging learning-related refinement within association cortex. Our results indicate that a pre-learning phase of general suppression in association cortex precedes a learning-related phase of task-specific signal flow enhancement.

A segregated cortical stream for retinal direction selectivity

Visual features extracted by retinal circuits are streamed into higher visual areas (HVAs) after being processed along the visual hierarchy. However, how specialized neuronal representations of HVAs are built, based on retinal output channels, remained unclear. Here, we addressed this question by determining the effects of genetically disrupting retinal direction selectivity on motion-evoked responses in visual stages from the retina to HVAs in mice. Direction-selective (DS) cells in the rostrolateral (RL) area that prefer higher temporal frequencies, and that change direction tuning bias as the temporal frequency of a stimulus increases, are selectively reduced upon retinal manipulation. DS cells in the primary visual cortex projecting to area RL, but not to the posteromedial area, were similarly affected. Therefore, the specific connectivity of cortico-cortical projection neurons routes feedforward signaling originating from retinal DS cells preferentially to area RL. We thus identify a cortical processing stream for motion computed in the retina.

Visual features are streamed into higher visual areas (HVAs), but how representations in HVAs are built, based on retinal output channels, is unknown. Here, the authors show that specific connectivity of cortical neurons routes retina-originated direction-selective signaling into distinct HVAs.

Long-term Monocular Deprivation during Juvenile Critical Period Disrupts Binocular Integration in Mouse Visual Thalamus

Study of the neural deficits caused by mismatched binocular vision in early childhood has predominantly focused on circuits in the primary visual cortex (V1). Recent evidence has revealed that neurons in mouse dorsolateral geniculate nucleus (dLGN) can undergo rapid ocular dominance plasticity following monocular deprivation (MD). It remains unclear, however, whether the long-lasting deficits attributed to MD during the critical period originate in the thalamus. Using in vivo two-photon Ca2+ imaging of dLGN afferents in superficial layers of V1 in female and male mice, we demonstrate that 14 d MD during the critical period leads to a chronic loss of binocular dLGN inputs while sparing response strength and spatial acuity. Importantly, MD leads to profoundly mismatched visual tuning properties in remaining binocular dLGN afferents. Furthermore, MD impairs binocular modulation, reducing facilitation of responses of both binocular and monocular dLGN inputs during binocular viewing. As predicted by our findings in thalamic inputs, Ca2+ imaging from V1 neurons revealed spared spatial acuity but impaired binocularity in L4 neurons. V1 L2/3 neurons in contrast displayed deficits in both binocularity and spatial acuity. Our data demonstrate that critical-period MD produces long-lasting disruptions in binocular integration beginning in early binocular circuits in dLGN, whereas spatial acuity deficits first arise from circuits further downstream in V1. Our findings indicate that the development of normal binocular vision and spatial acuity depend upon experience-dependent refinement of distinct stages in the mammalian visual system.SIGNIFICANCE STATEMENT Abnormal binocular vision and reduced acuity are hallmarks of amblyopia, a disorder that affects 2%-5% of the population. It is widely thought that the neural deficits underlying amblyopia begin in the circuits of primary visual cortex. Using in vivo two-photon calcium imaging of thalamocortical axons in mice, we show that depriving one eye of input during a critical period in development chronically impairs binocular integration in thalamic inputs to primary visual cortex. In contrast, visual acuity is spared in thalamic inputs. These findings shed new light on the role for developmental mechanisms in the thalamus in establishing binocular vision and may have critical implications for amblyopia.

Mice Discriminate Stereoscopic Surfaces Without Fixating in Depth

Stereopsis is a ubiquitous feature of primate mammalian vision, but little is known about if and how rodents such as mice use stereoscopic vision. We used random dot stereograms to test for stereopsis in male and female mice, and they were able to discriminate near from far surfaces over a range of disparities, with diminishing performance for small and large binocular disparities. Based on two-photon measurements of disparity tuning, the range of disparities represented in the visual cortex aligns with the behavior and covers a broad range of disparities. When we examined their binocular eye movements, we found that, unlike primates, mice did not systematically vary relative eye positions or use vergence eye movements when presented with different disparities. Nonetheless, the representation of disparity tuning was wide enough to capture stereoscopic information over a range of potential vergence angles. Although mice share fundamental characteristics of stereoscopic vision with primates and carnivores, their lack of disparity-dependent vergence eye movements and wide neuronal representation suggests that they may use a distinct strategy for stereopsis.SIGNIFICANCE STATEMENT Binocular vision allows us to derive depth information by comparing right and left eye information. We characterized binocular integration in mice because tools exist in these animals to dissect the underlying neural circuitry for binocular vision. Using random dot stereograms, we find that behavior and disparity tuning in the visual cortex share fundamental characteristics with primates, but we did not observe any evidence of disparity-dependent changes in vergence angle. We propose that mice use a distinct strategy of stereopsis compared with primates by using a broad range of disparities to encode depth over a large field of view and to compensate for nonstereoscopic changes in vergence angle that arise during natural behavior.