Stimulus-dependent differences in cortical versus subcortical contributions to visual detection in mice

The primary visual cortex (V1) and the superior colliculus (SC) both occupy stations early in the processing of visual information. They have long been thought to perform distinct functions, with the V1 supporting the perception of visual features and the SC regulating orienting to visual inputs. However, growing evidence suggests that the SC supports the perception of many of the same visual features traditionally associated with the V1. To distinguish V1 and SC contributions to visual processing, it is critical to determine whether both areas causally contribute to the detection of specific visual stimuli. Here, mice reported changes in visual contrast or luminance near their perceptual threshold while white noise patterns of optogenetic stimulation were delivered to V1 or SC inhibitory neurons. We then performed a reverse correlation analysis on the optogenetic stimuli to estimate a neuronal-behavioral kernel (NBK), a moment-to-moment estimate of the impact of V1 or SC inhibition on stimulus detection. We show that the earliest moments of stimulus-evoked activity in the SC are critical for the detection of both luminance and contrast changes. Strikingly, there was a robust stimulus-aligned modulation in the V1 contrast-detection NBK but no sign of a comparable modulation for luminance detection. The data suggest that behavioral detection of visual contrast depends on both V1 and SC spiking, whereas mice preferentially use SC activity to detect changes in luminance. Electrophysiological recordings showed that neurons in both the SC and V1 responded strongly to both visual stimulus types, while the reverse correlation analysis reveals when these neuronal signals actually contribute to visually guided behaviors.

A non-image-forming visual circuit mediates the innate fear of heights in male mice

The neural basis of fear of heights remains largely unknown. In this study, we investigated the fear response to heights in male mice and observed characteristic aversive behaviors resembling human height vertigo. We identified visual input as a critical factor in mouse reactions to heights, while peripheral vestibular input was found to be nonessential for fear of heights. Unexpectedly, we found that fear of heights in naïve mice does not rely on image-forming visual processing by the primary visual cortex. Instead, a subset of neurons in the ventral lateral geniculate nucleus (vLGN), which connects to the lateral/ventrolateral periaqueductal gray (l/vlPAG), drives the expression of fear associated with heights. Additionally, we observed that a subcortical visual pathway linking the superior colliculus to the lateral posterior thalamic nucleus inhibits the defensive response to height threats. These findings highlight a rapid fear response to height threats through a subcortical visual and defensive pathway from the vLGN to the l/vlPAG.

Stimulus-dependent synaptic plasticity underlies neuronal circuitry refinement in the mouse primary visual cortex

Perceptual learning improves our ability to interpret sensory stimuli present in our environment through experience. Despite its importance, the underlying mechanisms that enable perceptual learning in our sensory cortices are still not fully understood. In this study, we used in vivo two-photon imaging to investigate the functional and structural changes induced by visual stimulation in the mouse primary visual cortex (V1). Our results demonstrate that repeated stimulation leads to a refinement of V1 circuitry by decreasing the number of responsive neurons while potentiating their response. At the synaptic level, we observe a reduction in the number of dendritic spines and an overall increase in spine AMPA receptor levels in the same subset of neurons. In addition, visual stimulation induces synaptic potentiation in neighboring spines within individual dendrites. These findings provide insights into the mechanisms of synaptic plasticity underlying information processing in the neocortex.

Brightness illusions drive a neuronal response in the primary visual cortex under top-down modulation

Brightness illusions are a powerful tool in studying vision, yet their neural correlates are poorly understood. Based on a human paradigm, we presented illusory drifting gratings to mice. Primary visual cortex (V1) neurons responded to illusory gratings, matching their direction selectivity for real gratings, and they tracked the spatial phase offset between illusory and real gratings. Illusion responses were delayed compared to real gratings, in line with the theory that processing illusions requires feedback from higher visual areas (HVAs). We provide support for this theory by showing a reduced V1 response to illusions, but not real gratings, following HVAs optogenetic inhibition. Finally, we used the pupil response (PR) as an indirect perceptual report and showed that the mouse PR matches the human PR to perceived luminance changes. Our findings resolve debates over whether V1 neurons are involved in processing illusions and highlight the involvement of feedback from HVAs.

Encoding luminance surfaces in the visual cortex of mice and monkeys: difference in responses to edge and center

Luminance and spatial contrast provide information on the surfaces and edges of objects. We investigated neural responses to black and white surfaces in the primary visual cortex (V1) of mice and monkeys. Unlike primates that use their fovea to inspect objects with high acuity, mice lack a fovea and have low visual acuity. It thus remains unclear whether monkeys and mice share similar neural mechanisms to process surfaces. The animals were presented with white or black surfaces and the population responses were measured at high spatial and temporal resolution using voltage-sensitive dye imaging. In mice, the population response to the surface was not edge-dominated with a tendency to center-dominance, whereas in monkeys the response was edge-dominated with a "hole" in the center of the surface. The population response to the surfaces in both species exhibited suppression relative to a grating stimulus. These results reveal the differences in spatial patterns to luminance surfaces in the V1 of mice and monkeys and provide evidence for a shared suppression process relative to grating.

Spontaneous variations in arousal modulate subsequent visual processing and local field potential dynamics in the ferret during quiet wakefulness

Behavioral states affect neuronal responses throughout the cortex and influence visual processing. Quiet wakefulness (QW) is a behavioral state during which subjects are quiescent but awake and connected to the environment. Here, we examined the effects of pre-stimulus arousal variability on post-stimulus neural activity in the primary visual cortex and posterior parietal cortex in awake ferrets, using pupil diameter as an indicator of arousal. We observed that the power of stimuli-induced alpha (8-12 Hz) decreases when the arousal level increases. The peak of alpha power shifts depending on arousal. High arousal increases inter- and intra-areal coherence. Using a simplified model of laminar circuits, we show that this connectivity pattern is compatible with feedback signals targeting infragranular layers in area posterior parietal cortex and supragranular layers in V1. During high arousal, neurons in V1 displayed higher firing rates at their preferred orientations. Broad-spiking cells in V1 are entrained to high-frequency oscillations (>80 Hz), whereas narrow-spiking neurons are phase-locked to low- (12-18 Hz) and high-frequency (>80 Hz) rhythms. These results indicate that the variability and sensitivity of post-stimulus cortical responses and coherence depend on the pre-stimulus behavioral state and account for the neuronal response variability observed during repeated stimulation.

Increasing neural network robustness improves match to macaque V1 eigenspectrum, spatial frequency preference and predictivity

Task-optimized convolutional neural networks (CNNs) show striking similarities to the ventral visual stream. However, human-imperceptible image perturbations can cause a CNN to make incorrect predictions. Here we provide insight into this brittleness by investigating the representations of models that are either robust or not robust to image perturbations. Theory suggests that the robustness of a system to these perturbations could be related to the power law exponent of the eigenspectrum of its set of neural responses, where power law exponents closer to and larger than one would indicate a system that is less susceptible to input perturbations. We show that neural responses in mouse and macaque primary visual cortex (V1) obey the predictions of this theory, where their eigenspectra have power law exponents of at least one. We also find that the eigenspectra of model representations decay slowly relative to those observed in neurophysiology and that robust models have eigenspectra that decay slightly faster and have higher power law exponents than those of non-robust models. The slow decay of the eigenspectra suggests that substantial variance in the model responses is related to the encoding of fine stimulus features. We therefore investigated the spatial frequency tuning of artificial neurons and found that a large proportion of them preferred high spatial frequencies and that robust models had preferred spatial frequency distributions more aligned with the measured spatial frequency distribution of macaque V1 cells. Furthermore, robust models were quantitatively better models of V1 than non-robust models. Our results are consistent with other findings that there is a misalignment between human and machine perception. They also suggest that it may be useful to penalize slow-decaying eigenspectra or to bias models to extract features of lower spatial frequencies during task-optimization in order to improve robustness and V1 neural response predictivity.

Tightly coupled inhibitory and excitatory functional networks in the developing primary visual cortex

Intracortical inhibition plays a critical role in shaping activity patterns in the mature cortex. However, little is known about the structure of inhibition in early development prior to the onset of sensory experience, a time when spontaneous activity exhibits long-range correlations predictive of mature functional networks. Here, using calcium imaging of GABAergic neurons in the ferret visual cortex, we show that spontaneous activity in inhibitory neurons is already highly organized into distributed modular networks before visual experience. Inhibitory neurons exhibit spatially modular activity with long-range correlations and precise local organization that is in quantitative agreement with excitatory networks. Furthermore, excitatory and inhibitory networks are strongly co-aligned at both millimeter and cellular scales. These results demonstrate a remarkable degree of organization in inhibitory networks early in the developing cortex, providing support for computational models of self-organizing networks and suggesting a mechanism for the emergence of distributed functional networks during development.

Double-μPeriscope, a tool for multilayer optical recordings, optogenetic stimulations or both

Intelligent behavior and cognitive functions in mammals depend on cortical microcircuits made up of a variety of excitatory and inhibitory cells that form a forest-like complex across six layers. Mechanistic understanding of cortical microcircuits requires both manipulation and monitoring of multiple layers and interactions between them. However, existing techniques are limited as to simultaneous monitoring and stimulation at different depths without damaging a large volume of cortical tissue. Here, we present a relatively simple and versatile method for delivering light to any two cortical layers simultaneously. The method uses a tiny optical probe consisting of two microprisms mounted on a single shaft. We demonstrate the versatility of the probe in three sets of experiments: first, two distinct cortical layers were optogenetically and independently manipulated; second, one layer was stimulated while the activity of another layer was monitored; third, the activity of thalamic axons distributed in two distinct cortical layers was simultaneously monitored in awake mice. Its simple-design, versatility, small-size, and low-cost allow the probe to be applied widely to address important biological questions.

Multiple gamma rhythms carry distinct spatial frequency information in primary visual cortex

Gamma rhythms in many brain regions, including the primary visual cortex (V1), are thought to play a role in information processing. Here, we report a surprising finding of 3 narrowband gamma rhythms in V1 that processed distinct spatial frequency (SF) signals and had different neural origins. The low gamma (LG; 25 to 40 Hz) rhythm was generated at the V1 superficial layer and preferred a higher SF compared with spike activity, whereas both the medium gamma (MG; 40 to 65 Hz), generated at the cortical level, and the high gamma HG; (65 to 85 Hz), originated precortically, preferred lower SF information. Furthermore, compared with the rates of spike activity, the powers of the 3 gammas had better performance in discriminating the edge and surface of simple objects. These findings suggest that gamma rhythms reflect the neural dynamics of neural circuitries that process different SF information in the visual system, which may be crucial for multiplexing SF information and synchronizing different features of an object.

Sensory coding and contrast invariance emerge from the control of plastic inhibition over emergent selectivity

Visual stimuli are represented by a highly efficient code in the primary visual cortex, but the development of this code is still unclear. Two distinct factors control coding efficiency: Representational efficiency, which is determined by neuronal tuning diversity, and metabolic efficiency, which is influenced by neuronal gain. How these determinants of coding efficiency are shaped during development, supported by excitatory and inhibitory plasticity, is only partially understood. We investigate a fully plastic spiking network of the primary visual cortex, building on phenomenological plasticity rules. Our results suggest that inhibitory plasticity is key to the emergence of tuning diversity and accurate input encoding. We show that inhibitory feedback (random and specific) increases the metabolic efficiency by implementing a gain control mechanism. Interestingly, this led to the spontaneous emergence of contrast-invariant tuning curves. Our findings highlight that (1) interneuron plasticity is key to the development of tuning diversity and (2) that efficient sensory representations are an emergent property of the resulting network.

Synaptic plasticity is crucial for the development of efficient input representation in the different sensory cortices, such as the primary visual cortex. Efficient visual representation is determined by two factors: representational efficiency, i.e. how many different input features can be represented, and metabolic efficiency, i.e. how many spikes are required to represent a specific feature. Previous research has pointed out the importance of plasticity at excitatory synapses to achieve high representational efficiency and feedback inhibition as a gain control mechanism for controlling metabolic efficiency. However, it is only partially understood how the influence of inhibitory plasticity on excitatory plasticity can lead to an efficient representation. Using a spiking neural network, we show that plasticity at feed-forward and feedback inhibitory synapses is necessary for the emergence of well-distributed neuronal selectivity to improve representational efficiency. Further, the emergent balance between excitatory and inhibitory currents improves the metabolic efficiency, and leads to contrast-invariant tuning as an inherent network property. Extending previous work, our simulation results highlight the importance of plasticity at inhibitory synapses.

Dissecting cascade computational components in spiking neural networks

Finding out the physical structure of neuronal circuits that governs neuronal responses is an important goal for brain research. With fast advances for large-scale recording techniques, identification of a neuronal circuit with multiple neurons and stages or layers becomes possible and highly demanding. Although methods for mapping the connection structure of circuits have been greatly developed in recent years, they are mostly limited to simple scenarios of a few neurons in a pairwise fashion; and dissecting dynamical circuits, particularly mapping out a complete functional circuit that converges to a single neuron, is still a challenging question. Here, we show that a recent method, termed spike-triggered non-negative matrix factorization (STNMF), can address these issues. By simulating different scenarios of spiking neural networks with various connections between neurons and stages, we demonstrate that STNMF is a persuasive method to dissect functional connections within a circuit. Using spiking activities recorded at neurons of the output layer, STNMF can obtain a complete circuit consisting of all cascade computational components of presynaptic neurons, as well as their spiking activities. For simulated simple and complex cells of the primary visual cortex, STNMF allows us to dissect the pathway of visual computation. Taken together, these results suggest that STNMF could provide a useful approach for investigating neuronal systems leveraging recorded functional neuronal activity.

It is well known that the computation of neuronal circuits is carried out through the staged and cascade structure of different types of neurons. Nevertheless, the information, particularly sensory information, is processed in a network primarily with feedforward connections through different pathways. A peculiar example is the early visual system, where light is transcoded by the retinal cells, routed by the lateral geniculate nucleus, and reached the primary visual cortex. One meticulous interest in recent years is to map out these physical structures of neuronal pathways. However, most methods so far are limited to taking snapshots of a static view of connections between neurons. It remains unclear how to obtain a functional and dynamical neuronal circuit beyond the simple scenarios of a few randomly sampled neurons. Using simulated spiking neural networks of visual pathways with different scenarios of multiple stages, mixed cell types, and natural image stimuli, we demonstrate that a recent computational tool, named spike-triggered non-negative matrix factorization, can resolve these issues. It enables us to recover the entire structural components of neural networks underlying the computation, together with the functional components of each individual neuron. Utilizing it for complex cells of the primary visual cortex allows us to reveal every underpinning of the nonlinear computation. Our results, together with other recent experimental and computational efforts, show that it is possible to systematically dissect neural circuitry with detailed structural and functional components.

BOLD signal response in primary visual cortex to flickering checkerboard increases with stimulus temporal frequency in older adults

Many older adults have difficulty seeing brief visual stimuli which younger adults can easily recognize. The primary visual cortex (V1) may induce this difficulty. However, in neuroimaging studies, the V1 response change to the increase of temporal frequency of visual stimulus in older adults was unclear. Here we investigated the association between the temporal frequency of flickering stimuli and the BOLD activity within V1 in older adults, using surface-based fMRI analysis. The fMRI data from 29 healthy older participants stimulated by contrast-reversing checkerboard at temporal flicker frequencies of 2, 4, and 8 Hz were obtained. The participants also performed a useful field of view (UFOV) test. The slope coefficient of BOLD activity regarding the temporal frequency of the visual stimulus averaged within V1 regions of interest was positive and significantly different from zero. Group analysis in the V1 showed significant clusters with positive slope and no significant clusters with a negative slope. The correlation coefficient between the slope coefficient and UFOV performance was not significant. The results indicated that V1 BOLD response to a flickering visual stimulus increases as the stimulus temporal frequency increases from 2 to 8 Hz in older adults.

Cross-population coupling of neural activity based on Gaussian process current source densities

Because local field potentials (LFPs) arise from multiple sources in different spatial locations, they do not easily reveal coordinated activity across neural populations on a trial-to-trial basis. As we show here, however, once disparate source signals are decoupled, their trial-to-trial fluctuations become more accessible, and cross-population correlations become more apparent. To decouple sources we introduce a general framework for estimation of current source densities (CSDs). In this framework, the set of LFPs result from noise being added to the transform of the CSD by a biophysical forward model, while the CSD is considered to be the sum of a zero-mean, stationary, spatiotemporal Gaussian process, having fast and slow components, and a mean function, which is the sum of multiple time-varying functions distributed across space, each varying across trials. We derived biophysical forward models relevant to the data we analyzed. In simulation studies this approach improved identification of source signals compared to existing CSD estimation methods. Using data recorded from primate auditory cortex, we analyzed trial-to-trial fluctuations in both steady-state and task-evoked signals. We found cortical layer-specific phase coupling between two probes and showed that the same analysis applied directly to LFPs did not recover these patterns. We also found task-evoked CSDs to be correlated across probes, at specific cortical depths. Using data from Neuropixels probes in mouse visual areas, we again found evidence for depth-specific phase coupling of primary visual cortex and lateromedial area based on the CSDs.

Distance-tuned neurons drive specialized path integration calculations in medial entorhinal cortex

During navigation, animals estimate their position using path integration and landmarks, engaging many brain areas. Whether these areas follow specialized or universal cue integration principles remains incompletely understood. We combine electrophysiology with virtual reality to quantify cue integration across thousands of neurons in three navigation-relevant areas: primary visual cortex (V1), retrosplenial cortex (RSC), and medial entorhinal cortex (MEC). Compared with V1 and RSC, path integration influences position estimates more in MEC, and conflicts between path integration and landmarks trigger remapping more readily. Whereas MEC codes position prospectively, V1 codes position retrospectively, and RSC is intermediate between the two. Lowered visual contrast increases the influence of path integration on position estimates only in MEC. These properties are most pronounced in a population of MEC neurons, overlapping with grid cells, tuned to distance run in darkness. These results demonstrate the specialized role that path integration plays in MEC compared with other navigation-relevant cortical areas.

Limited Evidence for Sensory Prediction Error Responses in Visual Cortex of Macaques and Humans

A recent formulation of predictive coding theory proposes that a subset of neurons in each cortical area encodes sensory prediction errors, the difference between predictions relayed from higher cortex and the sensory input. Here, we test for evidence of prediction error responses in spiking responses and local field potentials (LFP) recorded in primary visual cortex and area V4 of macaque monkeys, and in complementary electroencephalographic (EEG) scalp recordings in human participants. We presented a fixed sequence of visual stimuli on most trials, and violated the expected ordering on a small subset of trials. Under predictive coding theory, pattern-violating stimuli should trigger robust prediction errors, but we found that spiking, LFP and EEG responses to expected and pattern-violating stimuli were nearly identical. Our results challenge the assertion that a fundamental computational motif in sensory cortex is to signal prediction errors, at least those based on predictions derived from temporal patterns of visual stimulation.

Analysis of segmentation ontology reveals the similarities and differences in connectivity onto L2/3 neurons in mouse V1

Quantitatively comparing brain-wide connectivity of different types of neuron is of vital importance in understanding the function of the mammalian cortex. Here we have designed an analytical approach to examine and compare datasets from hierarchical segmentation ontologies, and applied it to long-range presynaptic connectivity onto excitatory and inhibitory neurons, mainly located in layer 2/3 (L2/3), of mouse primary visual cortex (V1). We find that the origins of long-range connections onto these two general cell classes-as well as their proportions-are quite similar, in contrast to the inputs on to a cell type in L6. These anatomical data suggest that distal inputs received by the general excitatory and inhibitory classes of neuron in L2/3 overlap considerably.

Spatial modulation of visual responses arises in cortex with active navigation

During navigation, the visual responses of neurons in mouse primary visual cortex (V1) are modulated by the animal's spatial position. Here we show that this spatial modulation is similarly present across multiple higher visual areas but negligible in the main thalamic pathway into V1. Similar to hippocampus, spatial modulation in visual cortex strengthens with experience and with active behavior. Active navigation in a familiar environment, therefore, enhances the spatial modulation of visual signals starting in the cortex.

Performance in even a simple perceptual task depends on mouse secondary visual areas

Primary visual cortex (V1) in the mouse projects to numerous brain areas, including several secondary visual areas, frontal cortex, and basal ganglia. While it has been demonstrated that optogenetic silencing of V1 strongly impairs visually guided behavior, it is not known which downstream areas are required for visual behaviors. Here we trained mice to perform a contrast-increment change detection task, for which substantial stimulus information is present in V1. Optogenetic silencing of visual responses in secondary visual areas revealed that their activity is required for even this simple visual task. In vivo electrophysiology showed that, although inhibiting secondary visual areas could produce some feedback effects in V1, the principal effect was profound suppression at the location of the optogenetic light. The results show that pathways through secondary visual areas are necessary for even simple visual behaviors.

Sense of external agency is sustained by multisensory functional integration in the somatosensory cortex

"Sense of agency" (SoA), the feeling of control for events caused by one's own actions, is deceived by visuomotor incongruence. Sensorimotor networks are implicated in SoA, however little evidence exists on brain functionality during agency processing. Concurrently, it has been suggested that the brain's intrinsic resting-state (rs) activity has a preliminary influence on processing of agency cues. Here, we investigated the relation between performance in an agency attribution task and functional interactions among brain regions as derived by network analysis of rs functional magnetic resonance imaging. The action-effect delay was adaptively increased (range 90-1,620 ms) and behavioral measures correlated to indices of cognitive processes and appraised self-concepts. They were then regressed on local metrics of rs brain functional connectivity as to isolate the core areas enabling self-agency. Across subjects, the time window for self-agency was 90-625 ms, while the action-effect integration was impacted by self-evaluated personality traits. Neurally, the brain intrinsic organization sustaining consistency in self-agency attribution was characterized by high connectiveness in the secondary visual cortex, and regional segregation in the primary somatosensory area. Decreased connectiveness in the secondary visual area, regional segregation in the superior parietal lobule, and information control within a primary visual cortex-frontal eye fields network sustained self-agency over long-delayed effects. We thus demonstrate that self-agency is grounded on the intrinsic mode of brain function designed to organize information for visuomotor integration. Our observation is relevant for current models of psychopathology in clinical conditions in which both rs activity and sense of agency are altered.

Anatomy and Physiology of Macaque Visual Cortical Areas V1, V2, and V5/MT: Bases for Biologically Realistic Models

The cerebral cortex of primates encompasses multiple anatomically and physiologically distinct areas processing visual information. Areas V1, V2, and V5/MT are conserved across mammals and are central for visual behavior. To facilitate the generation of biologically accurate computational models of primate early visual processing, here we provide an overview of over 350 published studies of these three areas in the genus Macaca, whose visual system provides the closest model for human vision. The literature reports 14 anatomical connection types from the lateral geniculate nucleus of the thalamus to V1 having distinct layers of origin or termination, and 194 connection types between V1, V2, and V5, forming multiple parallel and interacting visual processing streams. Moreover, within V1, there are reports of 286 and 120 types of intrinsic excitatory and inhibitory connections, respectively. Physiologically, tuning of neuronal responses to 11 types of visual stimulus parameters has been consistently reported. Overall, the optimal spatial frequency (SF) of constituent neurons decreases with cortical hierarchy. Moreover, V5 neurons are distinct from neurons in other areas for their higher direction selectivity, higher contrast sensitivity, higher temporal frequency tuning, and wider SF bandwidth. We also discuss currently unavailable data that could be useful for biologically accurate models.

Neural Patterns are More Similar across Individuals during Successful Memory Encoding than during Failed Memory Encoding

After experiencing the same episode, some people can recall certain details about it, whereas others cannot. We investigate how common (intersubject) neural patterns during memory encoding influence whether an episode will be subsequently remembered, and how divergence from a common organization is associated with encoding failure. Using functional magnetic resonance imaging with intersubject multivariate analyses, we measured brain activity as people viewed episodes within wildlife videos and then assessed their memory for these episodes. During encoding, greater neural similarity was observed between the people who later remembered an episode (compared with those who did not) within the regions of the declarative memory network (hippocampus, posterior medial cortex [PMC], and dorsal Default Mode Network [dDMN]). The intersubject similarity of the PMC and dDMN was episode-specific. Hippocampal encoding patterns were also more similar between subjects for memory success that was defined after one day, compared with immediately after retrieval. The neural encoding patterns were sufficiently robust and generalizable to train machine learning classifiers to predict future recall success in held-out subjects, and a subset of decodable regions formed a network of shared classifier predictions of subsequent memory success. This work suggests that common neural patterns reflect successful, rather than unsuccessful, encoding across individuals.