Movement and Performance Explain Widespread Cortical Activity in a Visual Detection Task

Latent dynamics of primary sensory cortical population activity structured by fluctuations in the local field potential

Introduction

As emerging technologies enable measurement of precise details of the activity within microcircuits at ever-increasing scales, there is a growing need to identify the salient features and patterns within the neural populations that represent physiologically and behaviorally relevant aspects of the network. Accumulating evidence from recordings of large neural populations suggests that neural population activity frequently exhibits relatively low-dimensional structure, with a small number of variables explaining a substantial fraction of the structure of the activity. While such structure has been observed across the brain, it is not known how reduced-dimension representations of neural population activity relate to classical metrics of "brain state," typically described in terms of fluctuations in the local field potential (LFP), single-cell activity, and behavioral metrics.

Methods

Hidden state models were fit to spontaneous spiking activity of populations of neurons, recorded in the whisker area of primary somatosensory cortex of awake mice. Classic measures of cortical state in S1, including the LFP and whisking activity, were compared to the dynamics of states inferred from spiking activity.

Results

A hidden Markov model fit the population spiking data well with a relatively small number of states, and putative inhibitory neurons played an outsize role in determining the latent state dynamics. Spiking states inferred from the model were more informative of the cortical state than a direct readout of the spiking activity of single neurons or of the population. Further, the spiking states predicted both the trial-by-trial variability in sensory responses and one aspect of behavior, whisking activity.

Discussion

Our results show how classical measurements of brain state relate to neural population spiking dynamics at the scale of the microcircuit and provide an approach for quantitative mapping of brain state dynamics across brain areas.

Amygdala and Cortex Relationships during Learning of a Sensory Discrimination Task

During learning of a sensory discrimination task, the cortical and subcortical regions display complex spatiotemporal dynamics. During learning, both the amygdala and cortex link stimulus information to its appropriate association, for example, a reward. In addition, both structures are also related to nonsensory parameters such as body movements and licking during the reward period. However, the emergence of the cortico-amygdala relationships during learning is largely unknown. To study this, we combined wide-field cortical imaging with fiber photometry to simultaneously record cortico-amygdala population dynamics as male mice learn a whisker-dependent go/no-go task. We were able to simultaneously record neuronal populations from the posterior cortex and either the basolateral amygdala (BLA) or central/medial amygdala (CEM). Prior to learning, the somatosensory and associative cortex responded during sensation, while amygdala areas did not show significant responses. As mice became experts, amygdala responses emerged early during the sensation period, increasing in the CEM, while decreasing in the BLA. Interestingly, amygdala and cortical responses were associated with task-related body movement, displaying significant responses ∼200 ms before movement initiation which led to licking for the reward. A correlation analysis between the cortex and amygdala revealed negative and positive correlation with the BLA and CEM, respectively, only in the expert case. These results imply that learning induces an involvement of the cortex and amygdala which may aid to link sensory stimuli with appropriate associations.

Goal-directed learning is multidimensional and accompanied by diverse and widespread changes in neocortical signaling

New tasks are often learned in stages with each stage reflecting a different learning challenge. Accordingly, each learning stage is likely mediated by distinct neuronal processes. And yet, most rodent studies of the neuronal correlates of goal-directed learning focus on individual outcome measures and individual brain regions. Here, we longitudinally studied mice from naïve to expert performance in a head-fixed, operant conditioning whisker discrimination task. In addition to tracking the primary behavioral outcome of stimulus discrimination, we tracked and compared an array of object-based and temporal-based behavioral measures. These behavioral analyses identify multiple, partially overlapping learning stages in this task, consistent with initial response implementation, early stimulus-response generalization, and late response inhibition. To begin to understand the neuronal foundations of these learning processes, we performed widefield Ca2+ imaging of dorsal neocortex throughout learning and correlated behavioral measures with neuronal activity. We found distinct and widespread correlations between neocortical activation patterns and various behavioral measures. For example, improvements in sensory discrimination correlated with target stimulus evoked activations of response-related cortices along with distractor stimulus evoked global cortical suppression. Our study reveals multidimensional learning for a simple goal-directed learning task and generates hypotheses for the neuronal modulations underlying these various learning processes.

Sensation and expectation are embedded in mouse motor cortical activity

During behavior, the motor cortex sends copies of motor-related signals to sensory cortices. Here, we combine closed-loop behavior with large-scale physiology, projection-pattern-specific recordings, and circuit perturbations to show that neurons in mouse secondary motor cortex (M2) encode sensation and are influenced by expectation. When a movement unexpectedly produces a sound, M2 becomes dominated by sound-evoked activity. Sound responses in M2 are inherited partially from the auditory cortex and are routed back to the auditory cortex, providing a path for the reciprocal exchange of sensory-motor information during behavior. When the acoustic consequences of a movement become predictable, M2 responses to self-generated sounds are selectively gated off. These changes in single-cell responses are reflected in population dynamics, which are influenced by both sensation and expectation. Together, these findings reveal the embedding of sensory and expectation signals in motor cortical activity.

Wide-field imaging in behaving mice as a tool to study cognitive function

Cognitive functions are mediated through coordinated and dynamic neuronal responses that involve many different areas across the brain. Therefore, it is of high interest to simultaneously record neuronal activity from as many brain areas as possible while the subject performs a cognitive behavioral task. One of the emerging tools to achieve a mesoscopic field of view is wide-field imaging of cortex-wide dynamics in mice. Wide-field imaging is cost-effective, user-friendly, and enables obtaining cortex-wide signals from mice performing complex and demanding cognitive tasks. Importantly, wide-field imaging offers an unbiased cortex-wide observation that sheds light on overlooked cortical regions and highlights parallel processing circuits. Recent wide-field imaging studies have shown that multi-area cortex-wide patterns, rather than just a single area, are involved in encoding cognitive functions. The optical properties of wide-field imaging enable imaging of different brain signals, such as layer-specific, inhibitory subtypes, or neuromodulation signals. Here, I review the main advantages of wide-field imaging in mice, review the recent literature, and discuss future directions of the field. It is expected that wide-field imaging in behaving mice will continue to gain popularity and aid in understanding the mesoscale dynamics underlying cognitive function.

Coexistence of state, choice, and sensory integration coding in barrel cortex LII/III

During perceptually guided decisions, correlates of choice are found as upstream as in the primary sensory areas. However, how well these choice signals align with early sensory representations, a prerequisite for their interpretation as feedforward substrates of perception, remains an open question. We designed a two alternative forced choice task (2AFC) in which male mice compared stimulation frequencies applied to two adjacent vibrissae. The optogenetic silencing of individual columns in the primary somatosensory cortex (wS1) resulted in predicted shifts of psychometric functions, demonstrating that perception depends on focal, early sensory representations. Functional imaging of layer II/III single neurons revealed mixed coding of stimuli, choices and engagement in the task. Neurons with multi-whisker suppression display improved sensory discrimination and had their activity increased during engagement in the task, enhancing selectively representation of the signals relevant to solving the task. From trial to trial, representation of stimuli and choice varied substantially, but mostly orthogonally to each other, suggesting that perceptual variability does not originate from wS1 fluctuations but rather from downstream areas. Together, our results highlight the role of primary sensory areas in forming a reliable sensory substrate that could be used for flexible downstream decision processes.

Pan-cortical 2-photon mesoscopic imaging and neurobehavioral alignment in awake, behaving mice

The flow of neural activity across the neocortex during active sensory discrimination is constrained by task-specific cognitive demands, movements, and internal states. During behavior, the brain appears to sample from a broad repertoire of activation motifs. Understanding how these patterns of local and global activity are selected in relation to both spontaneous and task-dependent behavior requires in-depth study of densely sampled activity at single neuron resolution across large regions of cortex. In a significant advance toward this goal, we developed procedures to record mesoscale 2-photon Ca2+ imaging data from two novel in vivo preparations that, between them, allow for simultaneous access to nearly all 0f the mouse dorsal and lateral neocortex. As a proof of principle, we aligned neural activity with both behavioral primitives and high-level motifs to reveal the existence of large populations of neurons that coordinated their activity across cortical areas with spontaneous changes in movement and/or arousal. The methods we detail here facilitate the identification and exploration of widespread, spatially heterogeneous neural ensembles whose activity is related to diverse aspects of behavior.

Simultaneous, cortex-wide dynamics of up to 1 million neurons reveal unbounded scaling of dimensionality with neuron number

The brain's remarkable properties arise from the collective activity of millions of neurons. Widespread application of dimensionality reduction to multi-neuron recordings implies that neural dynamics can be approximated by low-dimensional "latent" signals reflecting neural computations. However, can such low-dimensional representations truly explain the vast range of brain activity, and if not, what is the appropriate resolution and scale of recording to capture them? Imaging neural activity at cellular resolution and near-simultaneously across the mouse cortex, we demonstrate an unbounded scaling of dimensionality with neuron number in populations up to 1 million neurons. Although half of the neural variance is contained within sixteen dimensions correlated with behavior, our discovered scaling of dimensionality corresponds to an ever-increasing number of neuronal ensembles without immediate behavioral or sensory correlates. The activity patterns underlying these higher dimensions are fine grained and cortex wide, highlighting that large-scale, cellular-resolution recording is required to uncover the full substrates of neuronal computations.

Information flow between motor cortex and striatum reverses during skill learning

The coordination of neural activity across brain areas during a specific behavior is often interpreted as neural communication involved in controlling the behavior. However, whether information relevant to the behavior is actually transferred between areas is often untested. Here, we used information-theoretic tools to quantify how motor cortex and striatum encode and exchange behaviorally relevant information about specific reach-to-grasp movement features during skill learning in rats. We found a temporal shift in the encoding of behaviorally relevant information during skill learning, as well as a reversal in the primary direction of behaviorally relevant information flow, from cortex-to-striatum during naive movements to striatum-to-cortex during skilled movements. Standard analytical methods that quantify the evolution of overall neural activity during learning-such as changes in neural signal amplitude or the overall exchange of information between areas-failed to capture these behaviorally relevant information dynamics. Using these standard methods, we instead found a consistent coactivation of overall neural signals during movement production and a bidirectional increase in overall information propagation between areas during learning. Our results show that skill learning is achieved through a transformation in how behaviorally relevant information is routed across cortical and subcortical brain areas and that isolating the components of neural activity relevant to and informative about behavior is critical to uncover directional interactions within a coactive and coordinated network.

Stereotyped goal-directed manifold dynamics in the insular cortex

The insular cortex is involved in diverse processes, including bodily homeostasis, emotions, and cognition. However, we lack a comprehensive understanding of how it processes information at the level of neuronal populations. We leveraged recent advances in unsupervised machine learning to study insular cortex population activity patterns (i.e., neuronal manifold) in mice performing goal-directed behaviors. We find that the insular cortex activity manifold is remarkably consistent across different animals and under different motivational states. Activity dynamics within the neuronal manifold are highly stereotyped during rewarded trials, enabling robust prediction of single-trial outcomes across different mice and across various natural and artificial motivational states. Comparing goal-directed behavior with self-paced free consumption, we find that the stereotyped activity patterns reflect task-dependent goal-directed reward anticipation, and not licking, taste, or positive valence. These findings reveal a core computation in insular cortex that could explain its involvement in pathologies involving aberrant motivations.

Sound elicits stereotyped facial movements that provide a sensitive index of hearing abilities in mice

Sound elicits rapid movements of muscles in the face, ears, and eyes that protect the body from injury and trigger brain-wide internal state changes. Here, we performed quantitative facial videography from mice resting atop a piezoelectric force plate and observed that broadband sounds elicited rapid and stereotyped facial twitches. Facial motion energy (FME) adjacent to the whisker array was 30 dB more sensitive than the acoustic startle reflex and offered greater inter-trial and inter-animal reliability than sound-evoked pupil dilations or movement of other facial and body regions. FME tracked the low-frequency envelope of broadband sounds, providing a means to study behavioral discrimination of complex auditory stimuli, such as speech phonemes in noise. Approximately 25% of layer 5-6 units in the auditory cortex (ACtx) exhibited firing rate changes during facial movements. However, FME facilitation during ACtx photoinhibition indicated that sound-evoked facial movements were mediated by a midbrain pathway and modulated by descending corticofugal input. FME and auditory brainstem response (ABR) thresholds were closely aligned after noise-induced sensorineural hearing loss, yet FME growth slopes were disproportionately steep at spared frequencies, reflecting a central plasticity that matched commensurate changes in ABR wave 4. Sound-evoked facial movements were also hypersensitive in Ptchd1 knockout mice, highlighting the use of FME for identifying sensory hyper-reactivity phenotypes after adult-onset hyperacusis and inherited deficiencies in autism risk genes. These findings present a sensitive and integrative measure of hearing while also highlighting that even low-intensity broadband sounds can elicit a complex mixture of auditory, motor, and reafferent somatosensory neural activity.

Thalamic feedback shapes brain responses evoked by cortical stimulation in mice and humans

Cortical stimulation with single pulses is a common technique in clinical practice and research. However, we still do not understand the extent to which it engages subcortical circuits which contribute to the associated evoked potentials (EPs). Here we find that cortical stimulation generates remarkably similar EPs in humans and mice, with a late component similarly modulated by the subject's behavioral state. We optogenetically dissect the underlying circuit in mice, demonstrating that the late component of these EPs is caused by a thalamic hyperpolarization and rebound. The magnitude of this late component correlates with the bursting frequency and synchronicity of thalamic neurons, modulated by the subject's behavioral state. A simulation of the thalamo-cortical circuit highlights that both intrinsic thalamic currents as well as cortical and thalamic GABAergic neurons contribute to this response profile. We conclude that the cortical stimulation engages cortico-thalamo-cortical circuits highly preserved across different species and stimulation modalities.

Auditory cortex conveys non-topographic sound localization signals to visual cortex

Spatiotemporally congruent sensory stimuli are fused into a unified percept. The auditory cortex (AC) sends projections to the primary visual cortex (V1), which could provide signals for binding spatially corresponding audio-visual stimuli. However, whether AC inputs in V1 encode sound location remains unknown. Using two-photon axonal calcium imaging and a speaker array, we measured the auditory spatial information transmitted from AC to layer 1 of V1. AC conveys information about the location of ipsilateral and contralateral sound sources to V1. Sound location could be accurately decoded by sampling AC axons in V1, providing a substrate for making location-specific audiovisual associations. However, AC inputs were not retinotopically arranged in V1, and audio-visual modulations of V1 neurons did not depend on the spatial congruency of the sound and light stimuli. The non-topographic sound localization signals provided by AC might allow the association of specific audiovisual spatial patterns in V1 neurons.

Triple dissociation of visual, auditory and motor processing in mouse primary visual cortex

Primary sensory cortices respond to crossmodal stimuli-for example, auditory responses are found in primary visual cortex (V1). However, it remains unclear whether these responses reflect sensory inputs or behavioral modulation through sound-evoked body movement. We address this controversy by showing that sound-evoked activity in V1 of awake mice can be dissociated into auditory and behavioral components with distinct spatiotemporal profiles. The auditory component began at approximately 27 ms, was found in superficial and deep layers and originated from auditory cortex. Sound-evoked orofacial movements correlated with V1 neural activity starting at approximately 80-100 ms and explained auditory frequency tuning. Visual, auditory and motor activity were expressed by different laminar profiles and largely segregated subsets of neuronal populations. During simultaneous audiovisual stimulation, visual representations remained dissociable from auditory-related and motor-related activity. This three-fold dissociability of auditory, motor and visual processing is central to understanding how distinct inputs to visual cortex interact to support vision.

Trial-by-trial variability in cortical responses exhibits scaling of spatial correlations predicted from critical dynamics

In the mammalian cortex, even simple sensory inputs or movements activate many neurons, with each neuron responding variably to repeated stimuli-a phenomenon known as trial-by-trial variability. Understanding the spatial patterns and dynamics of this variability is challenging. Using cellular 2-photon imaging, we study visual and auditory responses in the primary cortices of awake mice. We focus on how individual neurons' responses differed from the overall population. We find consistent spatial correlations in these differences that are unique to each trial and linearly scale with the cortical area observed, a characteristic of critical dynamics as confirmed in our neuronal simulations. Using chronic multi-electrode recordings, we observe similar scaling in the prefrontal and premotor cortex of non-human primates during self-initiated and visually cued motor tasks. These results suggest that trial-by-trial variability, rather than being random noise, reflects a critical, fluctuation-dominated state in the cortex, supporting the brain's efficiency in processing information.

Decision-making dynamics are predicted by arousal and uninstructed movements

During sensory-guided behavior, an animal's decision-making dynamics unfold through sequences of distinct performance states, even while stimulus-reward contingencies remain static. Little is known about the factors that underlie these changes in task performance. We hypothesize that these decision-making dynamics can be predicted by externally observable measures, such as uninstructed movements and changes in arousal. Here, using computational modeling of visual and auditory task performance data from mice, we uncovered lawful relationships between transitions in strategic task performance states and an animal's arousal and uninstructed movements. Using hidden Markov models applied to behavioral choices during sensory discrimination tasks, we find that animals fluctuate between minutes-long optimal, sub-optimal, and disengaged performance states. Optimal state epochs are predicted by intermediate levels, and reduced variability, of pupil diameter and movement. Our results demonstrate that externally observable uninstructed behaviors can predict optimal performance states and suggest that mice regulate their arousal during optimal performance.

Pan-cortical 2-photon mesoscopic imaging and neurobehavioral alignment in awake, behaving mice

The flow of neural activity across the neocortex during active sensory discrimination is constrained by task-specific cognitive demands, movements, and internal states. During behavior, the brain appears to sample from a broad repertoire of activation motifs. Understanding how these patterns of local and global activity are selected in relation to both spontaneous and task-dependent behavior requires in-depth study of densely sampled activity at single neuron resolution across large regions of cortex. In a significant advance toward this goal, we developed procedures to record mesoscale 2-photon Ca2+ imaging data from two novel in vivo preparations that, between them, allow simultaneous access to nearly all of the mouse dorsal and lateral neocortex. As a proof of principle, we aligned neural activity with both behavioral primitives and high-level motifs to reveal the existence of large populations of neurons that coordinated their activity across cortical areas with spontaneous changes in movement and/or arousal. The methods we detail here facilitate the identification and exploration of widespread, spatially heterogeneous neural ensembles whose activity is related to diverse aspects of behavior.

Brain-wide neural activity underlying memory-guided movement

Behavior relies on activity in structured neural circuits that are distributed across the brain, but most experiments probe neurons in a single area at a time. Using multiple Neuropixels probes, we recorded from multi-regional loops connected to the anterior lateral motor cortex (ALM), a circuit node mediating memory-guided directional licking. Neurons encoding sensory stimuli, choices, and actions were distributed across the brain. However, choice coding was concentrated in the ALM and subcortical areas receiving input from the ALM in an ALM-dependent manner. Diverse orofacial movements were encoded in the hindbrain; midbrain; and, to a lesser extent, forebrain. Choice signals were first detected in the ALM and the midbrain, followed by the thalamus and other brain areas. At movement initiation, choice-selective activity collapsed across the brain, followed by new activity patterns driving specific actions. Our experiments provide the foundation for neural circuit models of decision-making and movement initiation.

Responses to Pattern-Violating Visual Stimuli Evolve Differently Over Days in Somata and Distal Apical Dendrites

Scientists have long conjectured that the neocortex learns patterns in sensory data to generate top-down predictions of upcoming stimuli. In line with this conjecture, different responses to pattern-matching vs pattern-violating visual stimuli have been observed in both spiking and somatic calcium imaging data. However, it remains unknown whether these pattern-violation signals are different between the distal apical dendrites, which are heavily targeted by top-down signals, and the somata, where bottom-up information is primarily integrated. Furthermore, it is unknown how responses to pattern-violating stimuli evolve over time as an animal gains more experience with them. Here, we address these unanswered questions by analyzing responses of individual somata and dendritic branches of layer 2/3 and layer 5 pyramidal neurons tracked over multiple days in primary visual cortex of awake, behaving female and male mice. We use sequences of Gabor patches with patterns in their orientations to create pattern-matching and pattern-violating stimuli, and two-photon calcium imaging to record neuronal responses. Many neurons in both layers show large differences between their responses to pattern-matching and pattern-violating stimuli. Interestingly, these responses evolve in opposite directions in the somata and distal apical dendrites, with somata becoming less sensitive to pattern-violating stimuli and distal apical dendrites more sensitive. These differences between the somata and distal apical dendrites may be important for hierarchical computation of sensory predictions and learning, since these two compartments tend to receive bottom-up and top-down information, respectively.

Simultaneous, cortex-wide and cellular-resolution neuronal population dynamics reveal an unbounded scaling of dimensionality with neuron number

The brain's remarkable properties arise from collective activity of millions of neurons. Widespread application of dimensionality reduction to multi-neuron recordings implies that neural dynamics can be approximated by low-dimensional "latent" signals reflecting neural computations. However, what would be the biological utility of such a redundant and metabolically costly encoding scheme and what is the appropriate resolution and scale of neural recording to understand brain function? Imaging the activity of one million neurons at cellular resolution and near-simultaneously across mouse cortex, we demonstrate an unbounded scaling of dimensionality with neuron number. While half of the neural variance lies within sixteen behavior-related dimensions, we find this unbounded scaling of dimensionality to correspond to an ever-increasing number of internal variables without immediate behavioral correlates. The activity patterns underlying these higher dimensions are fine-grained and cortex-wide, highlighting that large-scale recording is required to uncover the full neural substrates of internal and potentially cognitive processes.

Facemap: a framework for modeling neural activity based on orofacial tracking

Recent studies in mice have shown that orofacial behaviors drive a large fraction of neural activity across the brain. To understand the nature and function of these signals, we need better computational models to characterize the behaviors and relate them to neural activity. Here we developed Facemap, a framework consisting of a keypoint tracker and a deep neural network encoder for predicting neural activity. Our algorithm for tracking mouse orofacial behaviors was more accurate than existing pose estimation tools, while the processing speed was several times faster, making it a powerful tool for real-time experimental interventions. The Facemap tracker was easy to adapt to data from new labs, requiring as few as 10 annotated frames for near-optimal performance. We used the keypoints as inputs to a deep neural network which predicts the activity of ~50,000 simultaneously-recorded neurons and, in visual cortex, we doubled the amount of explained variance compared to previous methods. Using this model, we found that the neuronal activity clusters that were well predicted from behavior were more spatially spread out across cortex. We also found that the deep behavioral features from the model had stereotypical, sequential dynamics that were not reversible in time. In summary, Facemap provides a stepping stone toward understanding the function of the brain-wide neural signals and their relation to behavior.

Mapping the bioimaging marker of Alzheimer's disease based on pupillary light response-driven brain-wide fMRI in awake mice

Pupil dynamics has emerged as a critical non-invasive indicator of brain state changes. In particular, pupillary-light-responses (PLR) in Alzheimer's disease (AD) patients may be used as biomarkers of brain degeneration. To characterize AD-specific PLR and its underlying neuromodulatory sources, we combined high-resolution awake mouse fMRI with real-time pupillometry to map brain-wide event-related correlation patterns based on illumination-driven pupil constriction ( P c ) and post-illumination pupil dilation recovery (amplitude, P d , and time, T ). The P c -driven differential analysis revealed altered visual signal processing coupled with reduced thalamocortical activation in AD mice compared with the wild-type normal mice. In contrast, the post-illumination pupil dilation recovery-based fMRI highlighted multiple brain areas related to AD brain degeneration, including the cingulate cortex, hippocampus, septal area of the basal forebrain, medial raphe nucleus, and pontine reticular nuclei (PRN). Also, brain-wide functional connectivity analysis highlighted the most significant changes in PRN of AD mice, which serves as the major subcortical relay nuclei underlying oculomotor function. This work combined non-invasive pupil-fMRI measurements in preclinical models to identify pupillary biomarkers based on neuromodulatory dysfunction coupled with AD brain degeneration.

Arousal as a universal embedding for spatiotemporal brain dynamics

Neural activity in awake organisms shows widespread and spatiotemporally diverse correlations with behavioral and physiological measurements. We propose that this covariation reflects in part the dynamics of a unified, arousal-related process that regulates brain-wide physiology on the timescale of seconds. Taken together with theoretical foundations in dynamical systems, this interpretation leads us to a surprising prediction: that a single, scalar measurement of arousal (e.g., pupil diameter) should suffice to reconstruct the continuous evolution of multimodal, spatiotemporal measurements of large-scale brain physiology. To test this hypothesis, we perform multimodal, cortex-wide optical imaging and behavioral monitoring in awake mice. We demonstrate that spatiotemporal measurements of neuronal calcium, metabolism, and blood-oxygen can be accurately and parsimoniously modeled from a low-dimensional state-space reconstructed from the time history of pupil diameter. Extending this framework to behavioral and electrophysiological measurements from the Allen Brain Observatory, we demonstrate the ability to integrate diverse experimental data into a unified generative model via mappings from an intrinsic arousal manifold. Our results support the hypothesis that spontaneous, spatially structured fluctuations in brain-wide physiology-widely interpreted to reflect regionally-specific neural communication-are in large part reflections of an arousal-related process. This enriched view of arousal dynamics has broad implications for interpreting observations of brain, body, and behavior as measured across modalities, contexts, and scales.

Vagal sensory neurons mediate the Bezold-Jarisch reflex and induce syncope

Visceral sensory pathways mediate homeostatic reflexes, the dysfunction of which leads to many neurological disorders1. The Bezold-Jarisch reflex (BJR), first described2,3 in 1867, is a cardioinhibitory reflex that is speculated to be mediated by vagal sensory neurons (VSNs) that also triggers syncope. However, the molecular identity, anatomical organization, physiological characteristics and behavioural influence of cardiac VSNs remain mostly unknown. Here we leveraged single-cell RNA-sequencing data and HYBRiD tissue clearing4 to show that VSNs that express neuropeptide Y receptor Y2 (NPY2R) predominately connect the heart ventricular wall to the area postrema. Optogenetic activation of NPY2R VSNs elicits the classic triad of BJR responses-hypotension, bradycardia and suppressed respiration-and causes an animal to faint. Photostimulation during high-resolution echocardiography and laser Doppler flowmetry with behavioural observation revealed a range of phenotypes reflected in clinical syncope, including reduced cardiac output, cerebral hypoperfusion, pupil dilation and eye-roll. Large-scale Neuropixels brain recordings and machine-learning-based modelling showed that this manipulation causes the suppression of activity across a large distributed neuronal population that is not explained by changes in spontaneous behavioural movements. Additionally, bidirectional manipulation of the periventricular zone had a push-pull effect, with inhibition leading to longer syncope periods and activation inducing arousal. Finally, ablating NPY2R VSNs specifically abolished the BJR. Combined, these results demonstrate a genetically defined cardiac reflex that recapitulates characteristics of human syncope at physiological, behavioural and neural network levels.

Activity in primate visual cortex is minimally driven by spontaneous movements

Organisms process sensory information in the context of their own moving bodies, an idea referred to as embodiment. This idea is important for developmental neuroscience, robotics and systems neuroscience. The mechanisms supporting embodiment are unknown, but a manifestation could be the observation in mice of brain-wide neuromodulation, including in the primary visual cortex, driven by task-irrelevant spontaneous body movements. We tested this hypothesis in macaque monkeys (Macaca mulatta), a primate model for human vision, by simultaneously recording visual cortex activity and facial and body movements. We also sought a direct comparison using an analogous approach to those used in mouse studies. Here we found that activity in the primate visual cortex (V1, V2 and V3/V3A) was associated with the animals' own movements, but this modulation was largely explained by the impact of the movements on the retinal image, that is, by changes in visual input. These results indicate that visual cortex in primates is minimally driven by spontaneous movements and may reflect species-specific sensorimotor strategies.

Transthalamic input to higher-order cortex selectively conveys state information

Communication among different neocortical areas is largely thought to be mediated by long-range synaptic interactions between cortical neurons, with the thalamus providing only an initial relay of information from the sensory periphery. Higher-order thalamic nuclei receive strong synaptic inputs from the cortex and send robust projections back to other cortical areas, providing a distinct and potentially critical route for cortico-cortical communication. However, the relative contributions of corticocortical and thalamocortical inputs to higher-order cortical function remain unclear. Using imaging of cortical neurons and projection axon terminals in combination with optogenetic manipulations, we find that the higher-order visual thalamus of mice conveys a specialized stream of information to higher-order visual cortex. Whereas corticocortical projections from lower cortical areas convey robust visual information, higher-order thalamocortical projections convey strong behavioral state information. Together, these findings suggest a key role for higher-order thalamus in providing contextual signals that flexibly modulate sensory processing in higher-order cortex.

How far neuroscience is from understanding brains

The cellular biology of brains is relatively well-understood, but neuroscientists have not yet generated a theory explaining how brains work. Explanations of how neurons collectively operate to produce what brains can do are tentative and incomplete. Without prior assumptions about the brain mechanisms, I attempt here to identify major obstacles to progress in neuroscientific understanding of brains and central nervous systems. Most of the obstacles to our understanding are conceptual. Neuroscience lacks concepts and models rooted in experimental results explaining how neurons interact at all scales. The cerebral cortex is thought to control awake activities, which contrasts with recent experimental results. There is ambiguity distinguishing task-related brain activities from spontaneous activities and organized intrinsic activities. Brains are regarded as driven by external and internal stimuli in contrast to their considerable autonomy. Experimental results are explained by sensory inputs, behavior, and psychological concepts. Time and space are regarded as mutually independent variables for spiking, post-synaptic events, and other measured variables, in contrast to experimental results. Dynamical systems theory and models describing evolution of variables with time as the independent variable are insufficient to account for central nervous system activities. Spatial dynamics may be a practical solution. The general hypothesis that measurements of changes in fundamental brain variables, action potentials, transmitter releases, post-synaptic transmembrane currents, etc., propagating in central nervous systems reveal how they work, carries no additional assumptions. Combinations of current techniques could reveal many aspects of spatial dynamics of spiking, post-synaptic processing, and plasticity in insects and rodents to start with. But problems defining baseline and reference conditions hinder interpretations of the results. Furthermore, the facts that pooling and averaging of data destroy their underlying dynamics imply that single-trial designs and statistics are necessary.

The Secondary Motor Cortex-striatum Circuit Contributes to Suppressing Inappropriate Responses in Perceptual Decision Behavior

The secondary motor cortex (M2) encodes choice-related information and plays an important role in cue-guided actions. M2 neurons innervate the dorsal striatum (DS), which also contributes to decision-making behavior, yet how M2 modulates signals in the DS to influence perceptual decision-making is unclear. Using mice performing a visual Go/No-Go task, we showed that inactivating M2 projections to the DS impaired performance by increasing the false alarm (FA) rate to the reward-irrelevant No-Go stimulus. The choice signal of M2 neurons correlated with behavioral performance, and the inactivation of M2 neurons projecting to the DS reduced the choice signal in the DS. By measuring and manipulating the responses of direct or indirect pathway striatal neurons defined by M2 inputs, we found that the indirect pathway neurons exhibited a shorter response latency to the No-Go stimulus, and inactivating their early responses increased the FA rate. These results demonstrate that the M2-to-DS pathway is crucial for suppressing inappropriate responses in perceptual decision behavior.

How 'visual' is the visual cortex? The interactions between the visual cortex and other sensory, motivational and motor systems as enabling factors for visual perception

The definition of the visual cortex is primarily based on the evidence that lesions of this area impair visual perception. However, this does not exclude that the visual cortex may process more information than of retinal origin alone, or that other brain structures contribute to vision. Indeed, research across the past decades has shown that non-visual information, such as neural activity related to reward expectation and value, locomotion, working memory and other sensory modalities, can modulate primary visual cortical responses to retinal inputs. Nevertheless, the function of this non-visual information is poorly understood. Here we review recent evidence, coming primarily from studies in rodents, arguing that non-visual and motor effects in visual cortex play a role in visual processing itself, for instance disentangling direct auditory effects on visual cortex from effects of sound-evoked orofacial movement. These findings are placed in a broader framework casting vision in terms of predictive processing under control of frontal, reward- and motor-related systems. In contrast to the prevalent notion that vision is exclusively constructed by the visual cortical system, we propose that visual percepts are generated by a larger network-the extended visual system-spanning other sensory cortices, supramodal areas and frontal systems. This article is part of the theme issue 'Decision and control processes in multisensory perception'.

Sensation and expectation are embedded in mouse motor cortical activity

During behavior, the motor cortex sends copies of motor-related signals to sensory cortices. It remains unclear whether these corollary discharge signals strictly encode movement or whether they also encode sensory experience and expectation. Here, we combine closed-loop behavior with large-scale physiology, projection-pattern specific recordings, and circuit perturbations to show that neurons in mouse secondary motor cortex (M2) encode sensation and are influenced by expectation. When a movement unexpectedly produces a sound, M2 becomes dominated by sound-evoked activity. Sound responses in M2 are inherited partially from the auditory cortex and are routed back to the auditory cortex, providing a path for the dynamic exchange of sensory-motor information during behavior. When the acoustic consequences of a movement become predictable, M2 responses to self-generated sounds are selectively gated off. These changes in single-cell responses are reflected in population dynamics, which are influenced by both sensation and expectation. Together, these findings reveal the rich embedding of sensory and expectation signals in motor cortical activity.

Behavioral measurements of motor readiness in mice

Motor planning facilitates rapid and precise execution of volitional movements. Although motor planning has been classically studied in humans and monkeys, the mouse has become an increasingly popular model system to study neural mechanisms of motor planning. It remains yet untested whether mice and primates share common behavioral features of motor planning. We combined videography and a delayed response task paradigm in an autonomous behavioral system to measure motor planning in non-body-restrained mice. Motor planning resulted in both reaction time (RT) savings and increased movement accuracy, replicating classic effects in primates. We found that motor planning was reflected in task-relevant body features. Both the specific actions prepared and the degree of motor readiness could be read out online during motor planning. The online readout further revealed behavioral evidence of simultaneous preparation for multiple actions under uncertain conditions. These results validate the mouse as a model to study motor planning, demonstrate body feature movements as a powerful real-time readout of motor readiness, and offer behavioral evidence that motor planning can be a parallel process that permits rapid selection of multiple prepared actions.

Neural mechanisms underlying uninstructed orofacial movements during reward-based learning behaviors

During reward-based learning tasks, animals make orofacial movements that globally influence brain activity at the timings of reward expectation and acquisition. These orofacial movements are not explicitly instructed and typically appear along with goal-directed behaviors. Here, we show that reinforcing optogenetic stimulation of dopamine neurons in the ventral tegmental area (oDAS) in mice is sufficient to induce orofacial movements in the whiskers and nose without accompanying goal-directed behaviors. Pavlovian conditioning with a sensory cue and oDAS elicited cue-locked and oDAS-aligned orofacial movements, which were distinguishable by a machine-learning model. Inhibition or knockout of dopamine D1 receptors in the nucleus accumbens inhibited oDAS-induced motion but spared cue-locked motion, suggesting differential regulation of these two types of orofacial motions. In contrast, inactivation of the whisker primary motor cortex (wM1) abolished both types of orofacial movements. We found specific neuronal populations in wM1 representing either oDAS-aligned or cue-locked whisker movements. Notably, optogenetic stimulation of wM1 neurons successfully replicated these two types of movements. Our results thus suggest that accumbal D1-receptor-dependent and -independent neuronal signals converge in the wM1 for facilitating distinct uninstructed orofacial movements during a reward-based learning task.

Multitasking via baseline control in recurrent neural networks

Changes in behavioral state, such as arousal and movements, strongly affect neural activity in sensory areas, and can be modeled as long-range projections regulating the mean and variance of baseline input currents. What are the computational benefits of these baseline modulations? We investigate this question within a brain-inspired framework for reservoir computing, where we vary the quenched baseline inputs to a recurrent neural network with random couplings. We found that baseline modulations control the dynamical phase of the reservoir network, unlocking a vast repertoire of network phases. We uncovered a number of bistable phases exhibiting the simultaneous coexistence of fixed points and chaos, of two fixed points, and of weak and strong chaos. We identified several phenomena, including noise-driven enhancement of chaos and ergodicity breaking; neural hysteresis, whereby transitions across a phase boundary retain the memory of the preceding phase. In each bistable phase, the reservoir performs a different binary decision-making task. Fast switching between different tasks can be controlled by adjusting the baseline input mean and variance. Moreover, we found that the reservoir network achieves optimal memory performance at any first-order phase boundary. In summary, baseline control enables multitasking without any optimization of the network couplings, opening directions for brain-inspired artificial intelligence and providing an interpretation for the ubiquitously observed behavioral modulations of cortical activity.

Distinct Features of Interictal Activity Predict Seizure Localization and Burden in a Mouse Model of Childhood Epilepsy

The epileptic brain is distinguished by spontaneous seizures and interictal epileptiform discharges (IEDs). Basic patterns of mesoscale brain activity outside of seizures and IEDs are also frequently disrupted in the epileptic brain and likely influence disease symptoms, but are poorly understood. We aimed to quantify how interictal brain activity differs from that in healthy individuals, and identify what features of interictal activity influence seizure occurrence in a genetic mouse model of childhood epilepsy. Neural activity across the majority of the dorsal cortex was monitored with widefield Ca2+ imaging in mice of both sexes expressing a human Kcnt1 variant (Kcnt1m/m ) and wild-type controls (WT). Ca2+ signals during seizures and interictal periods were classified according to their spatiotemporal features. We identified 52 spontaneous seizures, which emerged and propagated within a consistent set of susceptible cortical areas, and were predicted by a concentration of total cortical activity within the emergence zone. Outside of seizures and IEDs, similar events were detected in Kcnt1m/m and WT mice, suggesting that the spatial structure of interictal activity is similar. However, the rate of events whose spatial profile overlapped with where seizures and IEDs emerged was increased, and the characteristic global intensity of cortical activity in individual Kcnt1m/m mice predicted their epileptic activity burden. This suggests that cortical areas with excessive interictal activity are vulnerable to seizures, but epilepsy is not an inevitable outcome. Global scaling of the intensity of cortical activity below levels found in the healthy brain may provide a natural mechanism of seizure protection.SIGNIFICANCE STATEMENT Defining the scope and structure of an epilepsy-causing gene variant's effects on mesoscale brain activity constitutes a major contribution to our understanding of how epileptic brains differ from healthy brains, and informs the development of precision epilepsy therapies. We provide a clear roadmap for measuring how severely brain activity deviates from normal, not only in pathologically active areas, but across large portions of the brain and outside of epileptic activity. This will indicate where and how activity needs to be modulated to holistically restore normal function. It also has the potential to reveal unintended off-target treatment effects and facilitate therapy optimization to deliver maximal benefit with minimal side-effect potential.

Behavioral decomposition reveals rich encoding structure employed across neocortex in rats

The cortical population code is pervaded by activity patterns evoked by movement, but it remains largely unknown how such signals relate to natural behavior or how they might support processing in sensory cortices where they have been observed. To address this we compared high-density neural recordings across four cortical regions (visual, auditory, somatosensory, motor) in relation to sensory modulation, posture, movement, and ethograms of freely foraging male rats. Momentary actions, such as rearing or turning, were represented ubiquitously and could be decoded from all sampled structures. However, more elementary and continuous features, such as pose and movement, followed region-specific organization, with neurons in visual and auditory cortices preferentially encoding mutually distinct head-orienting features in world-referenced coordinates, and somatosensory and motor cortices principally encoding the trunk and head in egocentric coordinates. The tuning properties of synaptically coupled cells also exhibited connection patterns suggestive of area-specific uses of pose and movement signals, particularly in visual and auditory regions. Together, our results indicate that ongoing behavior is encoded at multiple levels throughout the dorsal cortex, and that low-level features are differentially utilized by different regions to serve locally relevant computations.

Not everything, not everywhere, not all at once: a study of brain-wide encoding of movement

Activity related to movement is found throughout sensory and motor regions of the brain. However, it remains unclear how movement-related activity is distributed across the brain and whether systematic differences exist between brain areas. Here, we analyzed movement related activity in brain-wide recordings containing more than 50,000 neurons in mice performing a decision-making task. Using multiple techniques, from markers to deep neural networks, we find that movement-related signals were pervasive across the brain, but systematically differed across areas. Movement-related activity was stronger in areas closer to the motor or sensory periphery. Delineating activity in terms of sensory- and motor-related components revealed finer scale structures of their encodings within brain areas. We further identified activity modulation that correlates with decision-making and uninstructed movement. Our work charts out a largescale map of movement encoding and provides a roadmap for dissecting different forms of movement and decision-making related encoding across multi-regional neural circuits.

Differential encoding of temporal context and expectation under representational drift across hierarchically connected areas

The classic view that neural populations in sensory cortices preferentially encode responses to incoming stimuli has been strongly challenged by recent experimental studies. Despite the fact that a large fraction of variance of visual responses in rodents can be attributed to behavioral state and movements, trial-history, and salience, the effects of contextual modulations and expectations on sensory-evoked responses in visual and association areas remain elusive. Here, we present a comprehensive experimental and theoretical study showing that hierarchically connected visual and association areas differentially encode the temporal context and expectation of naturalistic visual stimuli, consistent with the theory of hierarchical predictive coding. We measured neural responses to expected and unexpected sequences of natural scenes in the primary visual cortex (V1), the posterior medial higher order visual area (PM), and retrosplenial cortex (RSP) using 2-photon imaging in behaving mice collected through the Allen Institute Mindscope's OpenScope program. We found that information about image identity in neural population activity depended on the temporal context of transitions preceding each scene, and decreased along the hierarchy. Furthermore, our analyses revealed that the conjunctive encoding of temporal context and image identity was modulated by expectations of sequential events. In V1 and PM, we found enhanced and specific responses to unexpected oddball images, signaling stimulus-specific expectation violation. In contrast, in RSP the population response to oddball presentation recapitulated the missing expected image rather than the oddball image. These differential responses along the hierarchy are consistent with classic theories of hierarchical predictive coding whereby higher areas encode predictions and lower areas encode deviations from expectation. We further found evidence for drift in visual responses on the timescale of minutes. Although activity drift was present in all areas, population responses in V1 and PM, but not in RSP, maintained stable encoding of visual information and representational geometry. Instead we found that RSP drift was independent of stimulus information, suggesting a role in generating an internal model of the environment in the temporal domain. Overall, our results establish temporal context and expectation as substantial encoding dimensions in the visual cortex subject to fast representational drift and suggest that hierarchically connected areas instantiate a predictive coding mechanism.

Cholinergic and noradrenergic axonal activity contains a behavioral-state signal that is coordinated across the dorsal cortex

Fluctuations in brain and behavioral state are supported by broadly projecting neuromodulatory systems. In this study, we use mesoscale two-photon calcium imaging to examine spontaneous activity of cholinergic and noradrenergic axons in awake mice in order to determine the interaction between arousal/movement state transitions and neuromodulatory activity across the dorsal cortex at distances separated by up to 4 mm. We confirm that GCaMP6s activity within axonal projections of both basal forebrain cholinergic and locus coeruleus noradrenergic neurons track arousal, indexed as pupil diameter, and changes in behavioral engagement, as reflected by bouts of whisker movement and/or locomotion. The broad coordination in activity between even distant axonal segments indicates that both of these systems can communicate, in part, through a global signal, especially in relation to changes in behavioral state. In addition to this broadly coordinated activity, we also find evidence that a subpopulation of both cholinergic and noradrenergic axons may exhibit heterogeneity in activity that appears to be independent of our measures of behavioral state. By monitoring the activity of cholinergic interneurons in the cortex, we found that a subpopulation of these cells also exhibit state-dependent (arousal/movement) activity. These results demonstrate that cholinergic and noradrenergic systems provide a prominent and broadly synchronized signal related to behavioral state, and therefore may contribute to state-dependent cortical activity and excitability.

Decision-making dynamics are predicted by arousal and uninstructed movements

During sensory-guided behavior, an animal's decision-making dynamics unfold through sequences of distinct performance states, even while stimulus-reward contingencies remain static. Little is known about the factors that underlie these changes in task performance. We hypothesize that these decision-making dynamics can be predicted by externally observable measures, such as uninstructed movements and changes in arousal. Here, combining behavioral experiments in mice with computational modeling, we uncovered lawful relationships between transitions in strategic task performance states and an animal's arousal and uninstructed movements. Using hidden Markov models applied to behavioral choices during sensory discrimination tasks, we found that animals fluctuate between minutes-long optimal, sub-optimal and disengaged performance states. Optimal state epochs were predicted by intermediate levels, and reduced variability, of pupil diameter, along with reduced variability in face movements and locomotion. Our results demonstrate that externally observable uninstructed behaviors can predict optimal performance states, and suggest mice regulate their arousal during optimal performance.

Dorsolateral Striatum is a Bottleneck for Responding to Task-Relevant Stimuli in a Learned Whisker Detection Task in Mice

A learned sensory-motor behavior engages multiple brain regions, including the neocortex and the basal ganglia. How a target stimulus is detected by these regions and converted to a motor response remains poorly understood. Here, we performed electrophysiological recordings and pharmacological inactivations of whisker motor cortex and dorsolateral striatum to determine the representations within, and functions of, each region during performance in a selective whisker detection task in male and female mice. From the recording experiments, we observed robust, lateralized sensory responses in both structures. We also observed bilateral choice probability and preresponse activity in both structures, with these features emerging earlier in whisker motor cortex than dorsolateral striatum. These findings establish both whisker motor cortex and dorsolateral striatum as potential contributors to the sensory-to-motor (sensorimotor) transformation. We performed pharmacological inactivation studies to determine the necessity of these brain regions for this task. We found that suppressing the dorsolateral striatum severely disrupts responding to task-relevant stimuli, without disrupting the ability to respond, whereas suppressing whisker motor cortex resulted in more subtle changes in sensory detection and response criterion. Together these data support the dorsolateral striatum as an essential node in the sensorimotor transformation of this whisker detection task.SIGNIFICANCE STATEMENT Selecting an item in a grocery store, hailing a cab - these daily practices require us to transform sensory stimuli into motor responses. Many decades of previous research have studied goal-directed sensory-to-motor transformations within various brain structures, including the neocortex and the basal ganglia. Yet, our understanding of how these regions coordinate to perform sensory-to-motor transformations is limited because these brain structures are often studied by different researchers and through different behavioral tasks. Here, we record and perturb specific regions of the neocortex and the basal ganglia and compare their contributions during performance of a goal-directed somatosensory detection task. We find notable differences in the activities and functions of these regions, which suggests specific contributions to the sensory-to-motor transformation process.

Pyramidal cell types drive functionally distinct cortical activity patterns during decision-making

Understanding how cortical circuits generate complex behavior requires investigating the cell types that comprise them. Functional differences across pyramidal neuron (PyN) types have been observed within cortical areas, but it is not known whether these local differences extend throughout the cortex, nor whether additional differences emerge when larger-scale dynamics are considered. We used genetic and retrograde labeling to target pyramidal tract, intratelencephalic and corticostriatal projection neurons and measured their cortex-wide activity. Each PyN type drove unique neural dynamics, both at the local and cortex-wide scales. Cortical activity and optogenetic inactivation during an auditory decision task revealed distinct functional roles. All PyNs in parietal cortex were recruited during perception of the auditory stimulus, but, surprisingly, pyramidal tract neurons had the largest causal role. In frontal cortex, all PyNs were required for accurate choices but showed distinct choice tuning. Our results reveal that rich, cell-type-specific cortical dynamics shape perceptual decisions.

Improving the study of brain-behavior relationships by revisiting basic assumptions

Neuroimaging research has been at the forefront of concerns regarding the failure of experimental findings to replicate. In the study of brain-behavior relationships, past failures to find replicable and robust effects have been attributed to methodological shortcomings. Methodological rigor is important, but there are other overlooked possibilities: most published studies share three foundational assumptions, often implicitly, that may be faulty. In this paper, we consider the empirical evidence from human brain imaging and the study of non-human animals that calls each foundational assumption into question. We then consider the opportunities for a robust science of brain-behavior relationships that await if scientists ground their research efforts in revised assumptions supported by current empirical evidence.

Physiological Needs: Sensations and Predictions in the Insular Cortex

Physiological needs create powerful motivations (e.g., thirst and hunger). Studies in humans and animal models have implicated the insular cortex in the neural regulation of physiological needs and need-driven behavior. We review prominent mechanistic models of how the insular cortex might achieve this regulation and present a conceptual and analytical framework for testing these models in healthy and pathological conditions.

Relating Pupil Diameter and Blinking to Cortical Activity and Hemodynamics across Arousal States

Arousal state affects neural activity and vascular dynamics in the cortex, with sleep associated with large changes in the local field potential and increases in cortical blood flow. We investigated the relationship between pupil diameter and blink rate with neural activity and blood volume in the somatosensory cortex in male and female unanesthetized, head-fixed mice. We monitored these variables while the mice were awake, during periods of rapid eye movement (REM), and non-rapid eye movement (NREM) sleep. Pupil diameter was smaller during sleep than in the awake state. Changes in pupil diameter were coherent with both gamma-band power and blood volume in the somatosensory cortex, but the strength and sign of this relationship varied with arousal state. We observed a strong negative correlation between pupil diameter and both gamma-band power and blood volume during periods of awake rest and NREM sleep, although the correlations between pupil diameter and these signals became positive during periods of alertness, active whisking, and REM. Blinking was associated with increases in arousal and decreases in blood volume when the mouse was asleep. Bilateral coherence in gamma-band power and in blood volume dropped following awake blinking, indicating a reset of neural and vascular activity. Using only eye metrics (pupil diameter and eye motion), we could determine the arousal state of the mouse ('Awake,' 'NREM,' 'REM') with >90% accuracy with a 5 s resolution. There is a strong relationship between pupil diameter and hemodynamics signals in mice, reflecting the pronounced effects of arousal on cerebrovascular dynamics.SIGNIFICANCE STATEMENT Determining arousal state is a critical component of any neuroscience experiment. Pupil diameter and blinking are influenced by arousal state, as are hemodynamics signals in the cortex. We investigated the relationship between cortical hemodynamics and pupil diameter and found that pupil diameter was strongly related to the blood volume in the cortex. Mice were more likely to be awake after blinking than before, and blinking resets neural activity. Pupil diameter and eye motion can be used as a reliable, noninvasive indicator of arousal state. As mice transition from wake to sleep and back again over a timescale of seconds, monitoring pupil diameter and eye motion permits the noninvasive detection of sleep events during behavioral or resting-state experiments.

Behavioral measurements of motor readiness in mice

Motor planning facilitates rapid and precise execution of volitional movements. Although motor planning has been classically studied in humans and monkeys, the mouse has become an increasingly popular model system to study neural mechanisms of motor planning. It remains yet untested whether mice and primates share common behavioral features of motor planning. We combined videography and a delayed response task paradigm in an autonomous behavioral system to measure motor planning in non-body- restrained mice. Motor planning resulted in both reaction time savings and increased movement accuracy, replicating classic effects in primates. We found that motor planning was reflected in task-relevant body features. Both the specific actions prepared and the degree of motor readiness could be read out online during motor planning. The online readout further revealed behavioral evidence of simultaneous preparation for multiple actions under uncertain conditions. These results validate the mouse as a model to study motor planning, demonstrate body feature movements as a powerful real-time readout of motor readiness, and offer behavioral evidence that motor planning can be a parallel process that permits rapid selection of multiple prepared actions.

To be and not to be: wide-field Ca2+ imaging reveals neocortical functional segmentation combines stability and flexibility

The stability and flexibility of the functional parcellation of the cerebral cortex is fundamental to how familiar and novel information is both represented and stored. We leveraged new advances in Ca2+ sensors and microscopy to understand the dynamics of functional segmentation in the dorsal cerebral cortex. We performed wide-field Ca2+ imaging in head-fixed mice and used spatial independent component analysis (ICA) to identify independent spatial sources of Ca2+ fluorescence. The imaging data were evaluated over multiple timescales and discrete behaviors including resting, walking, and grooming. When evaluated over the entire dataset, a set of template independent components (ICs) were identified that were common across behaviors. Template ICs were present across a range of timescales, from days to 30 seconds, although with lower occurrence probability at shorter timescales, highlighting the stability of the functional segmentation. Importantly, unique ICs emerged at the shorter duration timescales that could act to transiently refine the cortical network. When data were evaluated by behavior, both common and behavior-specific ICs emerged. Each behavior is composed of unique combinations of common and behavior-specific ICs. These observations suggest that cerebral cortical functional segmentation exhibits considerable spatial stability over time and behaviors while retaining the flexibility for task-dependent reorganization.

Behavioral origin of sound-evoked activity in mouse visual cortex

Sensory cortices can be affected by stimuli of multiple modalities and are thus increasingly thought to be multisensory. For instance, primary visual cortex (V1) is influenced not only by images but also by sounds. Here we show that the activity evoked by sounds in V1, measured with Neuropixels probes, is stereotyped across neurons and even across mice. It is independent of projections from auditory cortex and resembles activity evoked in the hippocampal formation, which receives little direct auditory input. Its low-dimensional nature starkly contrasts the high-dimensional code that V1 uses to represent images. Furthermore, this sound-evoked activity can be precisely predicted by small body movements that are elicited by each sound and are stereotyped across trials and mice. Thus, neural activity that is apparently multisensory may simply arise from low-dimensional signals associated with internal state and behavior.

Walking humans and running mice: perception and neural encoding of optic flow during self-motion

Locomotion produces full-field optic flow that often dominates the visual motion inputs to an observer. The perception of optic flow is in turn important for animals to guide their heading and interact with moving objects. Understanding how locomotion influences optic flow processing and perception is therefore essential to understand how animals successfully interact with their environment. Here, we review research investigating how perception and neural encoding of optic flow are altered during self-motion, focusing on locomotion. Self-motion has been found to influence estimation and sensitivity for optic flow speed and direction. Nonvisual self-motion signals also increase compensation for self-driven optic flow when parsing the visual motion of moving objects. The integration of visual and nonvisual self-motion signals largely follows principles of Bayesian inference and can improve the precision and accuracy of self-motion perception. The calibration of visual and nonvisual self-motion signals is dynamic, reflecting the changing visuomotor contingencies across different environmental contexts. Throughout this review, we consider experimental research using humans, non-human primates and mice. We highlight experimental challenges and opportunities afforded by each of these species and draw parallels between experimental findings. These findings reveal a profound influence of locomotion on optic flow processing and perception across species. This article is part of a discussion meeting issue 'New approaches to 3D vision'.

Scale-free behavioral dynamics directly linked with scale-free cortical dynamics

Naturally occurring body movements and collective neural activity both exhibit complex dynamics, often with scale-free, fractal spatiotemporal structure. Scale-free dynamics of both brain and behavior are important because each is associated with functional benefits to the organism. Despite their similarities, scale-free brain activity and scale-free behavior have been studied separately, without a unified explanation. Here, we show that scale-free dynamics of mouse behavior and neurons in the visual cortex are strongly related. Surprisingly, the scale-free neural activity is limited to specific subsets of neurons, and these scale-free subsets exhibit stochastic winner-take-all competition with other neural subsets. This observation is inconsistent with prevailing theories of scale-free dynamics in neural systems, which stem from the criticality hypothesis. We develop a computational model which incorporates known cell-type-specific circuit structure, explaining our findings with a new type of critical dynamics. Our results establish neural underpinnings of scale-free behavior and clear behavioral relevance of scale-free neural activity.

Distributed context-dependent choice information in mouse posterior cortex

Choice information appears in multi-area brain networks mixed with sensory, motor, and cognitive variables. In the posterior cortex-traditionally implicated in decision computations-the presence, strength, and area specificity of choice signals are highly variable, limiting a cohesive understanding of their computational significance. Examining the mesoscale activity in the mouse posterior cortex during a visual task, we found that choice signals defined a decision variable in a low-dimensional embedding space with a prominent contribution along the ventral visual stream. Their subspace was near-orthogonal to concurrently represented sensory and motor-related activations, with modulations by task difficulty and by the animals' attention state. A recurrent neural network trained with animals' choices revealed an equivalent decision variable whose context-dependent dynamics agreed with that of the neural data. Our results demonstrated an independent, multi-area decision variable in the posterior cortex, controlled by task features and cognitive demands, possibly linked to contextual inference computations in dynamic animal-environment interactions.