Mesoscale cortical dynamics reflect the interaction of sensory evidence and temporal expectation during perceptual decision-making

A multi-region recurrent circuit for evidence accumulation in rats

Decision-making based on noisy evidence requires accumulating evidence and categorizing it to form a choice. Here we evaluate a proposed feedforward and modular mapping of this process in rats: evidence accumulated in anterodorsal striatum (ADS) is categorized in prefrontal cortex (frontal orienting fields, FOF). Contrary to this, we show that both regions appear to be indistinguishable in their encoding/decoding of accumulator value and communicate this information bidirectionally. Consistent with a role for FOF in accumulation, silencing FOF to ADS projections impacted behavior throughout the accumulation period, even while nonselective FOF silencing did not. We synthesize these findings into a multi-region recurrent neural network trained with a novel approach. In-silico experiments reveal that multiple scales of recurrence in the cortico-striatal circuit rescue computation upon nonselective FOF perturbations. These results suggest that ADS and FOF accumulate evidence in a recurrent and distributed manner, yielding redundant representations and robustness to certain perturbations.

Wide-field imaging in behaving mice as a tool to study cognitive function

Cognitive functions are mediated through coordinated and dynamic neuronal responses that involve many different areas across the brain. Therefore, it is of high interest to simultaneously record neuronal activity from as many brain areas as possible while the subject performs a cognitive behavioral task. One of the emerging tools to achieve a mesoscopic field of view is wide-field imaging of cortex-wide dynamics in mice. Wide-field imaging is cost-effective, user-friendly, and enables obtaining cortex-wide signals from mice performing complex and demanding cognitive tasks. Importantly, wide-field imaging offers an unbiased cortex-wide observation that sheds light on overlooked cortical regions and highlights parallel processing circuits. Recent wide-field imaging studies have shown that multi-area cortex-wide patterns, rather than just a single area, are involved in encoding cognitive functions. The optical properties of wide-field imaging enable imaging of different brain signals, such as layer-specific, inhibitory subtypes, or neuromodulation signals. Here, I review the main advantages of wide-field imaging in mice, review the recent literature, and discuss future directions of the field. It is expected that wide-field imaging in behaving mice will continue to gain popularity and aid in understanding the mesoscale dynamics underlying cognitive function.

Neural assemblies coordinated by cortical waves are associated with waking and hallucinatory brain states

The relationship between sensory stimuli and perceptions is brain-state dependent: in wakefulness, suprathreshold stimuli evoke perceptions; under anesthesia, perceptions are abolished; and during dreaming and in dissociated states, percepts are internally generated. Here, we exploit this state dependence to identify brain activity associated with internally generated or stimulus-evoked perceptions. In awake mice, visual stimuli phase reset spontaneous cortical waves to elicit 3-6 Hz feedback traveling waves. These stimulus-evoked waves traverse the cortex and entrain visual and parietal neurons. Under anesthesia as well as during ketamine-induced dissociation, visual stimuli do not disrupt spontaneous waves. Uniquely, in the dissociated state, spontaneous waves traverse the cortex caudally and entrain visual and parietal neurons, akin to stimulus-evoked waves in wakefulness. Thus, coordinated neuronal assemblies orchestrated by traveling cortical waves emerge in states in which perception can manifest. The awake state is privileged in that this coordination is reliably elicited by external visual stimuli.

Functional specificity of recurrent inhibition in visual cortex

In the neocortex, neural activity is shaped by the interaction of excitatory and inhibitory neurons, defined by the organization of their synaptic connections. Although connections among excitatory pyramidal neurons are sparse and functionally tuned, inhibitory connectivity is thought to be dense and largely unstructured. By measuring in vivo visual responses and synaptic connectivity of parvalbumin-expressing (PV+) inhibitory cells in mouse primary visual cortex, we show that the synaptic weights of their connections to nearby pyramidal neurons are specifically tuned according to the similarity of the cells' responses. Individual PV+ cells strongly inhibit those pyramidal cells that provide them with strong excitation and share their visual selectivity. This structured organization of inhibitory synaptic weights provides a circuit mechanism for tuned inhibition onto pyramidal cells despite dense connectivity, stabilizing activity within feature-specific excitatory ensembles while supporting competition between them.

The secondary somatosensory cortex gates mechanical and heat sensitivity

The cerebral cortex is vital for the processing and perception of sensory stimuli. In the somatosensory axis, information is received primarily by two distinct regions, the primary (S1) and secondary (S2) somatosensory cortices. Top-down circuits stemming from S1 can modulate mechanical and cooling but not heat stimuli such that circuit inhibition causes blunted perception. This suggests that responsiveness to particular somatosensory stimuli occurs in a modality specific fashion and we sought to determine additional cortical substrates. In this work, we identify in a mouse model that inhibition of S2 output increases mechanical and heat, but not cooling sensitivity, in contrast to S1. Combining 2-photon anatomical reconstruction with chemogenetic inhibition of specific S2 circuits, we discover that S2 projections to the secondary motor cortex (M2) govern mechanical and heat sensitivity without affecting motor performance or anxiety. Taken together, we show that S2 is an essential cortical structure that governs mechanical and heat sensitivity.

Joint encoding of stimulus and decision in monkey primary visual cortex

We investigated whether neurons in monkey primary visual cortex (V1) exhibit mixed selectivity for sensory input and behavioral choice. Parallel multisite spiking activity was recorded from area V1 of awake monkeys performing a delayed match-to-sample task. The monkeys had to make a forced choice decision of whether the test stimulus matched the preceding sample stimulus. The population responses evoked by the test stimulus contained information about both the identity of the stimulus and with some delay but before the onset of the motor response the forthcoming choice. The results of subspace identification analysis indicate that stimulus-specific and decision-related information coexists in separate subspaces of the high-dimensional population activity, and latency considerations suggest that the decision-related information is conveyed by top-down projections.

Neurons in the primary visual cortex of freely moving rats encode both sensory and non-sensory task variables

Neurons in primary visual cortex (area V1) are strongly driven by both sensory stimuli and non-sensory events. However, although the representation of sensory stimuli has been well characterized, much less is known about the representation of non-sensory events. Here, we characterize the specificity and organization of non-sensory representations in rat V1 during a freely moving visual decision task. We find that single neurons encode diverse combinations of task features simultaneously and across task epochs. Despite heterogeneity at the level of single neuron response patterns, both visual and nonvisual task variables could be reliably decoded from small neural populations (5 to 40 units) throughout a trial. Interestingly, in animals trained to make an auditory decision following passive observation of a visual stimulus, some but not all task features could also be decoded from V1 activity. Our results support the view that even in V1-the earliest stage of the cortical hierarchy-bottom-up sensory information may be combined with top-down non-sensory information in a task-dependent manner.

Quantifying decision-making in dynamic, continuously evolving environments

During perceptual decision-making tasks, centroparietal electroencephalographic (EEG) potentials report an evidence accumulation-to-bound process that is time locked to trial onset. However, decisions in real-world environments are rarely confined to discrete trials; they instead unfold continuously, with accumulation of time-varying evidence being recency-weighted towards its immediate past. The neural mechanisms supporting recency-weighted continuous decision-making remain unclear. Here, we use a novel continuous task design to study how the centroparietal positivity (CPP) adapts to different environments that place different constraints on evidence accumulation. We show that adaptations in evidence weighting to these different environments are reflected in changes in the CPP. The CPP becomes more sensitive to fluctuations in sensory evidence when large shifts in evidence are less frequent, and the potential is primarily sensitive to fluctuations in decision-relevant (not decision-irrelevant) sensory input. A complementary triphasic component over occipito-parietal cortex encodes the sum of recently accumulated sensory evidence, and its magnitude covaries with parameters describing how different individuals integrate sensory evidence over time. A computational model based on leaky evidence accumulation suggests that these findings can be accounted for by a shift in decision threshold between different environments, which is also reflected in the magnitude of pre-decision EEG activity. Our findings reveal how adaptations in EEG responses reflect flexibility in evidence accumulation to the statistics of dynamic sensory environments.

How far neuroscience is from understanding brains

The cellular biology of brains is relatively well-understood, but neuroscientists have not yet generated a theory explaining how brains work. Explanations of how neurons collectively operate to produce what brains can do are tentative and incomplete. Without prior assumptions about the brain mechanisms, I attempt here to identify major obstacles to progress in neuroscientific understanding of brains and central nervous systems. Most of the obstacles to our understanding are conceptual. Neuroscience lacks concepts and models rooted in experimental results explaining how neurons interact at all scales. The cerebral cortex is thought to control awake activities, which contrasts with recent experimental results. There is ambiguity distinguishing task-related brain activities from spontaneous activities and organized intrinsic activities. Brains are regarded as driven by external and internal stimuli in contrast to their considerable autonomy. Experimental results are explained by sensory inputs, behavior, and psychological concepts. Time and space are regarded as mutually independent variables for spiking, post-synaptic events, and other measured variables, in contrast to experimental results. Dynamical systems theory and models describing evolution of variables with time as the independent variable are insufficient to account for central nervous system activities. Spatial dynamics may be a practical solution. The general hypothesis that measurements of changes in fundamental brain variables, action potentials, transmitter releases, post-synaptic transmembrane currents, etc., propagating in central nervous systems reveal how they work, carries no additional assumptions. Combinations of current techniques could reveal many aspects of spatial dynamics of spiking, post-synaptic processing, and plasticity in insects and rodents to start with. But problems defining baseline and reference conditions hinder interpretations of the results. Furthermore, the facts that pooling and averaging of data destroy their underlying dynamics imply that single-trial designs and statistics are necessary.

How 'visual' is the visual cortex? The interactions between the visual cortex and other sensory, motivational and motor systems as enabling factors for visual perception

The definition of the visual cortex is primarily based on the evidence that lesions of this area impair visual perception. However, this does not exclude that the visual cortex may process more information than of retinal origin alone, or that other brain structures contribute to vision. Indeed, research across the past decades has shown that non-visual information, such as neural activity related to reward expectation and value, locomotion, working memory and other sensory modalities, can modulate primary visual cortical responses to retinal inputs. Nevertheless, the function of this non-visual information is poorly understood. Here we review recent evidence, coming primarily from studies in rodents, arguing that non-visual and motor effects in visual cortex play a role in visual processing itself, for instance disentangling direct auditory effects on visual cortex from effects of sound-evoked orofacial movement. These findings are placed in a broader framework casting vision in terms of predictive processing under control of frontal, reward- and motor-related systems. In contrast to the prevalent notion that vision is exclusively constructed by the visual cortical system, we propose that visual percepts are generated by a larger network-the extended visual system-spanning other sensory cortices, supramodal areas and frontal systems. This article is part of the theme issue 'Decision and control processes in multisensory perception'.

Mouse frontal cortex mediates additive multisensory decisions

The brain can combine auditory and visual information to localize objects. However, the cortical substrates underlying audiovisual integration remain uncertain. Here, we show that mouse frontal cortex combines auditory and visual evidence; that this combination is additive, mirroring behavior; and that it evolves with learning. We trained mice in an audiovisual localization task. Inactivating frontal cortex impaired responses to either sensory modality, while inactivating visual or parietal cortex affected only visual stimuli. Recordings from >14,000 neurons indicated that after task learning, activity in the anterior part of frontal area MOs (secondary motor cortex) additively encodes visual and auditory signals, consistent with the mice's behavioral strategy. An accumulator model applied to these sensory representations reproduced the observed choices and reaction times. These results suggest that frontal cortex adapts through learning to combine evidence across sensory cortices, providing a signal that is transformed into a binary decision by a downstream accumulator.

The Secondary Somatosensory Cortex Gates Mechanical and Thermal Sensitivity

The cerebral cortex is vital for the perception and processing of sensory stimuli. In the somatosensory axis, information is received by two distinct regions, the primary (S1) and secondary (S2) somatosensory cortices. Top-down circuits stemming from S1 can modulate mechanical and cooling but not heat stimuli such that circuit inhibition causes blunted mechanical and cooling perception. Using optogenetics and chemogenetics, we find that in contrast to S1, an inhibition of S2 output increases mechanical and heat, but not cooling sensitivity. Combining 2-photon anatomical reconstruction with chemogenetic inhibition of specific S2 circuits, we discover that S2 projections to the secondary motor cortex (M2) govern mechanical and thermal sensitivity without affecting motor or cognitive function. This suggests that while S2, like S1, encodes specific sensory information, that S2 operates through quite distinct neural substrates to modulate responsiveness to particular somatosensory stimuli and that somatosensory cortical encoding occurs in a largely parallel fashion.

Neural assemblies coordinated by cortical waves are associated with waking and hallucinatory brain states

The relationship between sensory stimuli and perceptions is brain-state dependent: in wakefulness stimuli evoke perceptions; under anesthesia perceptions are abolished; during dreaming and in dissociated states, percepts are internally generated. Here, we exploit this state dependence to identify brain activity associated with internally generated or stimulus-evoked perception. In awake mice, visual stimuli phase reset spontaneous cortical waves to elicit 3-6 Hz feedback traveling waves. These stimulus-evoked waves traverse the cortex and entrain visual and parietal neurons. Under anesthesia and during ketamine-induced dissociation, visual stimuli do not disrupt spontaneous waves. Uniquely in the dissociated state, spontaneous waves traverse the cortex caudally and entrain visual and parietal neurons, akin to stimulus-evoked waves in wakefulness. Thus, coordinated neuronal assemblies orchestrated by traveling cortical waves emerge in states in which perception can manifest. The awake state is privileged in that this coordination is elicited by specifically by external visual stimuli.

The Secondary Somatosensory Cortex Gates Mechanical and Thermal Sensitivity

The cerebral cortex is vital for the perception and processing of sensory stimuli. In the somatosensory axis, information is received by two distinct regions, the primary (S1) and secondary (S2) somatosensory cortices. Top-down circuits stemming from S1 can modulate mechanical and cooling but not heat stimuli such that circuit inhibition causes blunted mechanical and cooling perception. Using optogenetics and chemogenetics, we find that in contrast to S1, an inhibition of S2 output increases mechanical and heat, but not cooling sensitivity. Combining 2-photon anatomical reconstruction with chemogenetic inhibition of specific S2 circuits, we discover that S2 projections to the secondary motor cortex (M2) govern mechanical and thermal sensitivity without affecting motor or cognitive function. This suggests that while S2, like S1, encodes specific sensory information, that S2 operates through quite distinct neural substrates to modulate responsiveness to particular somatosensory stimuli and that somatosensory cortical encoding occurs in a largely parallel fashion.

Attention in flux

Selective attention comprises essential infrastructural functions supporting cognition-anticipating, prioritizing, selecting, routing, integrating, and preparing signals to guide adaptive behavior. Most studies have examined its consequences, systems, and mechanisms in a static way, but attention is at the confluence of multiple sources of flux. The world advances, we operate within it, our minds change, and all resulting signals progress through multiple pathways within the dynamic networks of our brains. Our aim in this review is to raise awareness of and interest in three important facets of how timing impacts our understanding of attention. These include the challenges posed to attention by the timing of neural processing and psychological functions, the opportunities conferred to attention by various temporal structures in the environment, and how tracking the time courses of neural and behavioral modulations with continuous measures yields surprising insights into the workings and principles of attention.

The fractal brain: scale-invariance in structure and dynamics

The past 40 years have witnessed extensive research on fractal structure and scale-free dynamics in the brain. Although considerable progress has been made, a comprehensive picture has yet to emerge, and needs further linking to a mechanistic account of brain function. Here, we review these concepts, connecting observations across different levels of organization, from both a structural and functional perspective. We argue that, paradoxically, the level of cortical circuits is the least understood from a structural point of view and perhaps the best studied from a dynamical one. We further link observations about scale-freeness and fractality with evidence that the environment provides constraints that may explain the usefulness of fractal structure and scale-free dynamics in the brain. Moreover, we discuss evidence that behavior exhibits scale-free properties, likely emerging from similarly organized brain dynamics, enabling an organism to thrive in an environment that shares the same organizational principles. Finally, we review the sparse evidence for and try to speculate on the functional consequences of fractality and scale-freeness for brain computation. These properties may endow the brain with computational capabilities that transcend current models of neural computation and could hold the key to unraveling how the brain constructs percepts and generates behavior.

Pyramidal cell types drive functionally distinct cortical activity patterns during decision-making

Understanding how cortical circuits generate complex behavior requires investigating the cell types that comprise them. Functional differences across pyramidal neuron (PyN) types have been observed within cortical areas, but it is not known whether these local differences extend throughout the cortex, nor whether additional differences emerge when larger-scale dynamics are considered. We used genetic and retrograde labeling to target pyramidal tract, intratelencephalic and corticostriatal projection neurons and measured their cortex-wide activity. Each PyN type drove unique neural dynamics, both at the local and cortex-wide scales. Cortical activity and optogenetic inactivation during an auditory decision task revealed distinct functional roles. All PyNs in parietal cortex were recruited during perception of the auditory stimulus, but, surprisingly, pyramidal tract neurons had the largest causal role. In frontal cortex, all PyNs were required for accurate choices but showed distinct choice tuning. Our results reveal that rich, cell-type-specific cortical dynamics shape perceptual decisions.

Pupillary dynamics reflect the impact of temporal expectation on detection strategy

Everyday life's perceptual decision-making is informed by experience. In particular, temporal expectation can ease the detection of relevant events in noisy sensory streams. Here, we investigated if humans can extract hidden temporal cues from the occurrences of probabilistic targets and utilize them to inform target detection in a complex acoustic stream. To understand what neural mechanisms implement temporal expectation influence on decision-making, we used pupillometry as a proxy for underlying neuromodulatory activity. We found that participants' detection strategy was influenced by the hidden temporal context and correlated with sound-evoked pupil dilation. A model of urgency fitted on false alarms predicted detection reaction time. Altogether, these findings suggest that temporal expectation informs decision-making and could be implemented through neuromodulatory-mediated urgency signals.

Dexmedetomidine Preserves Activity of Neurons in Primary Somatosensory Cortex Compared to Propofol and Ketamine

General anesthesia has been shown to induce significant changes in the functional connectivity of the cerebral cortex. However, traditional methods such as electroencephalography (EEG) or functional magnetic resonance imaging (fMRI) lack the spatial resolution to study the effects of general anesthesia on individual cortical neurons. This study aimed to use high-resolution two-photon imaging, which can provide single-neuron resolution, to investigate the characteristics of consciousness under general anesthesia. We used C57BL/6J and Thy1-GCamp6s mice and found that at similar levels of sedation, as measured by EEG, dexmedetomidine did not significantly inhibit the spontaneous activity of neuronal somata in the S1 cortex, but preserved the frequency of calcium events in neuronal spines. In contrast, propofol and ketamine dramatically inhibited the spontaneous activity of both neuronal somata and spines. The S1 cortex still responded to whisker stimulation under dexmedetomidine anesthesia, but not under propofol or ketamine anesthesia. Our results suggest that dexmedetomidine anesthesia has unique neuronal properties associated with its ability to facilitate easy awakening in the clinic. These findings provide insights into the development of more effective strategies for monitoring consciousness during general anesthesia.

Wide-Field Calcium Imaging of Neuronal Network Dynamics In Vivo

A central tenet of neuroscience is that sensory, motor, and cognitive behaviors are generated by the communications and interactions among neurons, distributed within and across anatomically and functionally distinct brain regions. Therefore, to decipher how the brain plans, learns, and executes behaviors requires characterizing neuronal activity at multiple spatial and temporal scales. This includes simultaneously recording neuronal dynamics at the mesoscale level to understand the interactions among brain regions during different behavioral and brain states. Wide-field Ca2+ imaging, which uses single photon excitation and improved genetically encoded Ca2+ indicators, allows for simultaneous recordings of large brain areas and is proving to be a powerful tool to study neuronal activity at the mesoscopic scale in behaving animals. This review details the techniques used for wide-field Ca2+ imaging and the various approaches employed for the analyses of the rich neuronal-behavioral data sets obtained. Also discussed is how wide-field Ca2+ imaging is providing novel insights into both normal and altered neural processing in disease. Finally, we examine the limitations of the approach and new developments in wide-field Ca2+ imaging that are bringing new capabilities to this important technique for investigating large-scale neuronal dynamics.

Multiregion neuronal activity: the forest and the trees

The past decade has witnessed remarkable advances in the simultaneous measurement of neuronal activity across many brain regions, enabling fundamentally new explorations of the brain-spanning cellular dynamics that underlie sensation, cognition and action. These recently developed multiregion recording techniques have provided many experimental opportunities, but thoughtful consideration of methodological trade-offs is necessary, especially regarding field of view, temporal acquisition rate and ability to guarantee cellular resolution. When applied in concert with modern optogenetic and computational tools, multiregion recording has already made possible fundamental biological discoveries - in part via the unprecedented ability to perform unbiased neural activity screens for principles of brain function, spanning dozens of brain areas and from local to global scales.

Visuomotor learning promotes visually evoked activity in the medial prefrontal cortex

The medial prefrontal cortex (mPFC) is necessary for executing many learned associations between stimuli and movement. It is unclear, however, how activity in the mPFC evolves across learning, and how this activity correlates with sensory stimuli and the learned movements they evoke. To address these questions, we record cortical activity with widefield calcium imaging while mice learned to associate a visual stimulus with a forelimb movement. After learning, the mPFC shows stimulus-evoked activity both during task performance and during passive viewing, when the stimulus evokes no action. This stimulus-evoked activity closely tracks behavioral performance across training, with both exhibiting a marked increase between days when mice first learn the task, followed by a steady increase with further training. Electrophysiological recordings localized this activity to the secondary motor and anterior cingulate cortex. We conclude that learning a visuomotor task promotes a route for visual information to reach the prefrontal cortex.

Polymer Skulls With Integrated Transparent Electrode Arrays for Cortex-Wide Opto-Electrophysiological Recordings

Electrophysiology and optical imaging provide complementary neural sensing capabilities - electrophysiological recordings have high temporal resolution, while optical imaging allows recording of genetically-defined populations at high spatial resolution. Combining these two modalities for simultaneous large-scale, multimodal sensing of neural activity across multiple brain regions can be very powerful. Here, transparent, inkjet-printed electrode arrays with outstanding optical and electrical properties are seamlessly integrated with morphologically conformant transparent polymer skulls. Implanted on transgenic mice expressing the Calcium (Ca2+ ) indicator GCaMP6f in excitatory neurons, these "eSee-Shells" provide a robust opto-electrophysiological interface for over 100 days. eSee-Shells enable simultaneous mesoscale Ca2+ imaging and electrocorticography (ECoG) acquisition from multiple brain regions covering 45 mm2 of cortex under anesthesia and in awake animals. The clarity and transparency of eSee-Shells allow recording single-cell Ca2+ signals directly below the electrodes and interconnects. Simultaneous multimodal measurement of cortical dynamics reveals changes in both ECoG and Ca2+ signals that depend on the behavioral state.

Combining Cortical Voltage Imaging and Hippocampal Electrophysiology for Investigating Global, Multi-Timescale Activity Interactions in the Brain

A new generation of optogenetic tools for analyzing neural activity has been contributing to the elucidation of classical open questions in neuroscience. Specifically, voltage imaging technologies using enhanced genetically encoded voltage indicators have been increasingly used to observe the dynamics of large circuits at the mesoscale. Here, we describe how to combine cortical wide-field voltage imaging with hippocampal electrophysiology in awake, behaving mice. Furthermore, we highlight how this method can be useful for different possible investigations, using the characterization of hippocampal-neocortical interactions as a case study.

Multiple timescales of sensory-evidence accumulation across the dorsal cortex

Cortical areas seem to form a hierarchy of intrinsic timescales, but the relevance of this organization for cognitive behavior remains unknown. In particular, decisions requiring the gradual accrual of sensory evidence over time recruit widespread areas across this hierarchy. Here, we tested the hypothesis that this recruitment is related to the intrinsic integration timescales of these widespread areas. We trained mice to accumulate evidence over seconds while navigating in virtual reality and optogenetically silenced the activity of many cortical areas during different brief trial epochs. We found that the inactivation of all tested areas affected the evidence-accumulation computation. Specifically, we observed distinct changes in the weighting of sensory evidence occurring during and before silencing, such that frontal inactivations led to stronger deficits on long timescales than posterior cortical ones. Inactivation of a subset of frontal areas also led to moderate effects on behavioral processes beyond evidence accumulation. Moreover, large-scale cortical Ca2+ activity during task performance displayed different temporal integration windows. Our findings suggest that the intrinsic timescale hierarchy of distributed cortical areas is an important component of evidence-accumulation mechanisms.

Emerging principles of spacetime in brains: Meeting report on spatial neurodynamics

How do neurons and networks of neurons interact spatially? Here, we overview recent discoveries revealing how spatial dynamics of spiking and postsynaptic activity efficiently expose and explain fundamental brain and brainstem mechanisms behind detection, perception, learning, and behavior.

Visual association cortex links cues with conjunctions of reward and locomotor contexts

Postrhinal cortex (POR) and neighboring lateral visual association areas are necessary for identifying objects and interpreting them in specific contexts, but how POR neurons encode the same object across contexts remains unclear. Here, we imaged excitatory neurons in mouse POR across tens of days prior to and throughout initial cue-reward learning and reversal learning. We assessed responses to the same cue when it was rewarded or unrewarded, during both locomotor and stationary contexts. Surprisingly, a large class of POR neurons were minimally cue-driven prior to learning. After learning, distinct clusters within this class responded selectively to a given cue when presented in a specific conjunction of reward and locomotion contexts. In addition, another class contained clusters of neurons whose cue responses were more transient, insensitive to reward learning, and adapted over thousands of presentations. These two classes of POR neurons may support context-dependent interpretation and context-independent identification of sensory cues.

Sensory coding and the causal impact of mouse cortex in a visual decision

Correlates of sensory stimuli and motor actions are found in multiple cortical areas, but such correlates do not indicate whether these areas are causally relevant to task performance. We trained mice to discriminate visual contrast and report their decision by steering a wheel. Widefield calcium imaging and Neuropixels recordings in cortex revealed stimulus-related activity in visual (VIS) and frontal (MOs) areas, and widespread movement-related activity across the whole dorsal cortex. Optogenetic inactivation biased choices only when targeted at VIS and MOs,proportionally to each site's encoding of the visual stimulus, and at times corresponding to peak stimulus decoding. A neurometric model based on summing and subtracting activity in VIS and MOs successfully described behavioral performance and predicted the effect of optogenetic inactivation. Thus, sensory signals localized in visual and frontal cortex play a causal role in task performance, while widespread dorsal cortical signals correlating with movement reflect processes that do not play a causal role.

Visual intracortical and transthalamic pathways carry distinct information to cortical areas

Sensory processing involves information flow between neocortical areas, assumed to rely on direct intracortical projections. However, cortical areas may also communicate indirectly via higher-order nuclei in the thalamus, such as the pulvinar or lateral posterior nucleus (LP) in the visual system of rodents. The fine-scale organization and function of these cortico-thalamo-cortical pathways remains unclear. We find that responses of mouse LP neurons projecting to higher visual areas likely derive from feedforward input from primary visual cortex (V1) combined with information from many cortical and subcortical areas, including superior colliculus. Signals from LP projections to different higher visual areas are tuned to specific features of visual stimuli and their locomotor context, distinct from the signals carried by direct intracortical projections from V1. Thus, visual transthalamic pathways are functionally specific to their cortical target, different from feedforward cortical pathways, and combine information from multiple brain regions, linking sensory signals with behavioral context.

•

Transthalamic pathway through pulvinar indirectly connects lower to higher cortical areas

•

This pathway combines input from V1 with that of many cortical and subcortical areas

•

Pulvinar conveys distinct visual and motor information to different higher visual areas

•

Direct intracortical and transthalamic pathways convey different information