Responses to Pattern-Violating Visual Stimuli Evolve Differently Over Days in Somata and Distal Apical Dendrites

Scientists have long conjectured that the neocortex learns patterns in sensory data to generate top-down predictions of upcoming stimuli. In line with this conjecture, different responses to pattern-matching vs pattern-violating visual stimuli have been observed in both spiking and somatic calcium imaging data. However, it remains unknown whether these pattern-violation signals are different between the distal apical dendrites, which are heavily targeted by top-down signals, and the somata, where bottom-up information is primarily integrated. Furthermore, it is unknown how responses to pattern-violating stimuli evolve over time as an animal gains more experience with them. Here, we address these unanswered questions by analyzing responses of individual somata and dendritic branches of layer 2/3 and layer 5 pyramidal neurons tracked over multiple days in primary visual cortex of awake, behaving female and male mice. We use sequences of Gabor patches with patterns in their orientations to create pattern-matching and pattern-violating stimuli, and two-photon calcium imaging to record neuronal responses. Many neurons in both layers show large differences between their responses to pattern-matching and pattern-violating stimuli. Interestingly, these responses evolve in opposite directions in the somata and distal apical dendrites, with somata becoming less sensitive to pattern-violating stimuli and distal apical dendrites more sensitive. These differences between the somata and distal apical dendrites may be important for hierarchical computation of sensory predictions and learning, since these two compartments tend to receive bottom-up and top-down information, respectively.

Recurrent pattern completion drives the neocortical representation of sensory inference

When sensory information is incomplete or ambiguous, the brain relies on prior expectations to infer perceptual objects. Despite the centrality of this process to perception, the neural mechanism of sensory inference is not known. Illusory contours (ICs) are key tools to study sensory inference because they contain edges or objects that are implied only by their spatial context. Using cellular resolution, mesoscale two-photon calcium imaging and multi-Neuropixels recordings in the mouse visual cortex, we identified a sparse subset of neurons in the primary visual cortex (V1) and higher visual areas that respond emergently to ICs. We found that these highly selective 'IC-encoders' mediate the neural representation of IC inference. Strikingly, selective activation of these neurons using two-photon holographic optogenetics was sufficient to recreate IC representation in the rest of the V1 network, in the absence of any visual stimulus. This outlines a model in which primary sensory cortex facilitates sensory inference by selectively strengthening input patterns that match prior expectations through local, recurrent circuitry. Our data thus suggest a clear computational purpose for recurrence in the generation of holistic percepts under sensory ambiguity. More generally, selective reinforcement of top-down predictions by pattern-completing recurrent circuits in lower sensory cortices may constitute a key step in sensory inference.

Differential encoding of temporal context and expectation under representational drift across hierarchically connected areas

The classic view that neural populations in sensory cortices preferentially encode responses to incoming stimuli has been strongly challenged by recent experimental studies. Despite the fact that a large fraction of variance of visual responses in rodents can be attributed to behavioral state and movements, trial-history, and salience, the effects of contextual modulations and expectations on sensory-evoked responses in visual and association areas remain elusive. Here, we present a comprehensive experimental and theoretical study showing that hierarchically connected visual and association areas differentially encode the temporal context and expectation of naturalistic visual stimuli, consistent with the theory of hierarchical predictive coding. We measured neural responses to expected and unexpected sequences of natural scenes in the primary visual cortex (V1), the posterior medial higher order visual area (PM), and retrosplenial cortex (RSP) using 2-photon imaging in behaving mice collected through the Allen Institute Mindscope's OpenScope program. We found that information about image identity in neural population activity depended on the temporal context of transitions preceding each scene, and decreased along the hierarchy. Furthermore, our analyses revealed that the conjunctive encoding of temporal context and image identity was modulated by expectations of sequential events. In V1 and PM, we found enhanced and specific responses to unexpected oddball images, signaling stimulus-specific expectation violation. In contrast, in RSP the population response to oddball presentation recapitulated the missing expected image rather than the oddball image. These differential responses along the hierarchy are consistent with classic theories of hierarchical predictive coding whereby higher areas encode predictions and lower areas encode deviations from expectation. We further found evidence for drift in visual responses on the timescale of minutes. Although activity drift was present in all areas, population responses in V1 and PM, but not in RSP, maintained stable encoding of visual information and representational geometry. Instead we found that RSP drift was independent of stimulus information, suggesting a role in generating an internal model of the environment in the temporal domain. Overall, our results establish temporal context and expectation as substantial encoding dimensions in the visual cortex subject to fast representational drift and suggest that hierarchically connected areas instantiate a predictive coding mechanism.

Responses of pyramidal cell somata and apical dendrites in mouse visual cortex over multiple days

The apical dendrites of pyramidal neurons in sensory cortex receive primarily top-down signals from associative and motor regions, while cell bodies and nearby dendrites are heavily targeted by locally recurrent or bottom-up inputs from the sensory periphery. Based on these differences, a number of theories in computational neuroscience postulate a unique role for apical dendrites in learning. However, due to technical challenges in data collection, little data is available for comparing the responses of apical dendrites to cell bodies over multiple days. Here we present a dataset collected through the Allen Institute Mindscope's OpenScope program that addresses this need. This dataset comprises high-quality two-photon calcium imaging from the apical dendrites and the cell bodies of visual cortical pyramidal neurons, acquired over multiple days in awake, behaving mice that were presented with visual stimuli. Many of the cell bodies and dendrite segments were tracked over days, enabling analyses of how their responses change over time. This dataset allows neuroscientists to explore the differences between apical and somatic processing and plasticity.

A whole-brain monosynaptic input connectome to neuron classes in mouse visual cortex

Identification of structural connections between neurons is a prerequisite to understanding brain function. Here we developed a pipeline to systematically map brain-wide monosynaptic input connections to genetically defined neuronal populations using an optimized rabies tracing system. We used mouse visual cortex as the exemplar system and revealed quantitative target-specific, layer-specific and cell-class-specific differences in its presynaptic connectomes. The retrograde connectivity indicates the presence of ventral and dorsal visual streams and further reveals topographically organized and continuously varying subnetworks mediated by different higher visual areas. The visual cortex hierarchy can be derived from intracortical feedforward and feedback pathways mediated by upper-layer and lower-layer input neurons. We also identify a new role for layer 6 neurons in mediating reciprocal interhemispheric connections. This study expands our knowledge of the visual system connectomes and demonstrates that the pipeline can be scaled up to dissect connectivity of different cell populations across the mouse brain.

Reconciling functional differences in populations of neurons recorded with two-photon imaging and electrophysiology

Extracellular electrophysiology and two-photon calcium imaging are widely used methods for measuring physiological activity with single-cell resolution across large populations of cortical neurons. While each of these two modalities has distinct advantages and disadvantages, neither provides complete, unbiased information about the underlying neural population. Here, we compare evoked responses in visual cortex recorded in awake mice under highly standardized conditions using either imaging of genetically expressed GCaMP6f or electrophysiology with silicon probes. Across all stimulus conditions tested, we observe a larger fraction of responsive neurons in electrophysiology and higher stimulus selectivity in calcium imaging, which was partially reconciled by applying a spikes-to-calcium forward model to the electrophysiology data. However, the forward model could only reconcile differences in responsiveness when restricted to neurons with low contamination and an event rate above a minimum threshold. This work established how the biases of these two modalities impact functional metrics that are fundamental for characterizing sensory-evoked responses.

Survey of spiking in the mouse visual system reveals functional hierarchy

The anatomy of the mammalian visual system, from the retina to the neocortex, is organized hierarchically¹. However, direct observation of cellular-level functional interactions across this hierarchy is lacking due to the challenge of simultaneously recording activity across numerous regions. Here we describe a large, open dataset-part of the Allen Brain Observatory²-that surveys spiking from tens of thousands of units in six cortical and two thalamic regions in the brains of mice responding to a battery of visual stimuli. Using cross-correlation analysis, we reveal that the organization of inter-area functional connectivity during visual stimulation mirrors the anatomical hierarchy from the Allen Mouse Brain Connectivity Atlas³. We find that four classical hierarchical measures-response latency, receptive-field size, phase-locking to drifting gratings and response decay timescale-are all correlated with the hierarchy. Moreover, recordings obtained during a visual task reveal that the correlation between neural activity and behavioural choice also increases along the hierarchy. Our study provides a foundation for understanding coding and signal propagation across hierarchically organized cortical and thalamic visual areas.

Regional, Layer, and Cell-Type-Specific Connectivity of the Mouse Default Mode Network

The evolutionarily conserved default mode network (DMN) is a distributed set of brain regions coactivated during resting states that is vulnerable to brain disorders. How disease affects the DMN is unknown, but detailed anatomical descriptions could provide clues. Mice offer an opportunity to investigate structural connectivity of the DMN across spatial scales with cell-type resolution. We co-registered maps from functional magnetic resonance imaging and axonal tracing experiments into the 3D Allen mouse brain reference atlas. We find that the mouse DMN consists of preferentially interconnected cortical regions. As a population, DMN layer 2/3 (L2/3) neurons project almost exclusively to other DMN regions, whereas L5 neurons project in and out of the DMN. In the retrosplenial cortex, a core DMN region, we identify two L5 projection types differentiated by in- or out-DMN targets, laminar position, and gene expression. These results provide a multi-scale description of the anatomical correlates of the mouse DMN.

•

Mouse resting-state default mode network anatomy described at high resolution in 3D

•

Systematic axon tracing shows cortical DMN regions are preferentially interconnected

•

Layer 2/3 DMN neurons project mostly in the DMN; layer 5 neurons project in and out

•

Retrosplenial cortex contains distinct types of in- and out-DMN projection neurons

A standardized head-fixation system for performing large-scale, in vivo physiological recordings in mice

BACKGROUND

The Allen Institute recently built a set of high-throughput experimental pipelines to collect comprehensive in vivo surveys of physiological activity in the visual cortex of awake, head-fixed mice. Developing these large-scale, industrial-like pipelines posed many scientific, operational, and engineering challenges.

NEW METHOD

Our strategies for creating a cross-platform reference space to which all pipeline datasets were mapped required development of 1) a robust headframe, 2) a reproducible clamping system, and 3) data-collection systems that are built, and maintained, around precise alignment with a reference artifact.

RESULTS

When paired with our pipeline clamping system, our headframe exceeded deflection and reproducibility requirements. By leveraging our headframe and clamping system we were able to create a cross-platform reference space to which multi-modal imaging datasets could be mapped.

COMPARISON WITH EXISTING METHODS

Together, the Allen Brain Observatory headframe, surgical tooling, clamping system, and system registration strategy create a unique system for collecting large amounts of standardized in vivo datasets over long periods of time. Moreover, the integrated approach to cross-platform registration allows for multi-modal datasets to be collected within a shared reference space.

CONCLUSIONS

Here we report the engineering strategies that we implemented when creating the Allen Brain Observatory physiology pipelines. All of the documentation related to headframe, surgical tooling, and clamp design has been made freely available and can be readily manufactured or procured. The engineering strategy, or components of the strategy, described in this report can be tailored and applied by external researchers to improve data standardization and stability.

Experience shapes activity dynamics and stimulus coding of VIP inhibitory cells

Cortical circuits can flexibly change with experience and learning, but the effects on specific cell types, including distinct inhibitory types, are not well understood. Here we investigated how excitatory and VIP inhibitory cells in layer 2/3 of mouse visual cortex were impacted by visual experience in the context of a behavioral task. Mice learned a visual change detection task with a set of eight natural scene images. Subsequently, during 2-photon imaging experiments, mice performed the task with these familiar images and three sets of novel images. Strikingly, the temporal dynamics of VIP activity differed markedly between novel and familiar images: VIP cells were stimulus-driven by novel images but were suppressed by familiar stimuli and showed ramping activity when expected stimuli were omitted from a temporally predictable sequence. This prominent change in VIP activity suggests that these cells may adopt different modes of processing under novel versus familiar conditions.

A large-scale standardized physiological survey reveals functional organization of the mouse visual cortex

To understand how the brain processes sensory information to guide behavior, we must know how stimulus representations are transformed throughout the visual cortex. Here we report an open, large-scale physiological survey of activity in the awake mouse visual cortex: the Allen Brain Observatory Visual Coding dataset. This publicly available dataset includes the cortical activity of nearly 60,000 neurons from six visual areas, four layers, and 12 transgenic mouse lines in a total of 243 adult mice, in response to a systematic set of visual stimuli. We classify neurons on the basis of joint reliabilities to multiple stimuli and validate this functional classification with models of visual responses. While most classes are characterized by responses to specific subsets of the stimuli, the largest class is not reliably responsive to any of the stimuli and becomes progressively larger in higher visual areas. These classes reveal a functional organization wherein putative dorsal areas show specialization for visual motion signals.

The Hill–Robertson effect: evolutionary consequences of weak selection and linkage in finite populations

The 'Hill-Robertson (HR) effect' describes that linkage between sites under selection will reduce the overall effectiveness of selection in finite populations. Here we discuss the major concepts associated with the HR effect and present results of computer simulations focusing on the linkage effects generated by multiple sites under weak selection. Most models of linkage and selection forecast differences in effectiveness of selection between chromosomes or chromosomal regions involving a number of genes. The abundance and physical clustering of weakly selected mutations across genomes, however, justify the investigation of HR effects at a very local level and we pay particular attention to linkage effects among selected sites of the same gene. Overall, HR effects caused by weakly selected mutations predict differences in effectiveness of selection between genes that differ in exon-intron structures and across genes. Under this scenario, introns might play an advantageous role reducing intragenic HR effects. Finally, we summarize observations that are consistent with local HR effects in Drosophila, discuss potential consequences on population genetic studies and suggest future lines of research.