Movement-Related Signals in Sensory Areas: Roles in Natural Behavior

The big mixup: Neural representation during natural modes of primate visual behavior

The primate brain has evolved specialized visual capacities to navigate complex physical and social environments. Researchers studying cortical circuits underlying these capacities have traditionally favored the use of simplified tasks and brief stimulus presentations in order to isolate cognitive variables with tight experimental control. As a result, operational theories about visual brain function have come to emphasize feature detection, hierarchical stimulus encoding, top-down task modulation, and functional segregation in distinct cortical areas. Recently, however, experimental paradigms combining natural behavior with electrophysiological recordings have begun to offer a distinctly different portrait of how the brain takes in and analyzes its visual surroundings. The present article reviews recent work in this area, highlighting some of the more surprising findings in domains of social vision and spatial navigation along with shifts in thinking that have begun to emanate from this approach.

Learning to segment self-generated from externally caused optic flow through sensorimotor mismatch circuits

Efficient sensory detection requires the capacity to ignore task-irrelevant information, for example when optic flow patterns created by egomotion need to be disentangled from object perception. To investigate how this is achieved in the visual system, predictive coding with sensorimotor mismatch detection is an attractive starting point. Indeed, experimental evidence for sensorimotor mismatch signals in early visual areas exists, but it is not understood how they are integrated into cortical networks that perform input segmentation and categorization. Our model advances a biologically plausible solution by extending predictive coding models with the ability to distinguish self-generated from externally caused optic flow. We first show that a simple three neuron circuit produces experience-dependent sensorimotor mismatch responses, in agreement with calcium imaging data from mice. This microcircuit is then integrated into a neural network with two generative streams. The motor-to-visual stream consists of parallel microcircuits between motor and visual areas and learns to spatially predict optic flow resulting from self-motion. The second stream bidirectionally connects a motion-selective higher visual area (mHVA) to V1, assigning a crucial role to the abundant feedback connections to V1: the maintenance of a generative model of externally caused optic flow. In the model, area mHVA learns to segment moving objects from the background, and facilitates object categorization. Based on shared neurocomputational principles across species, the model also maps onto primate visual cortex. Our work extends Hebbian predictive coding to sensorimotor settings, in which the agent actively moves - and learns to predict the consequences of its own movements.

Dynamics of odor-source localization: Insights from real-time odor plume recordings and head-motion tracking in freely moving mice

Animals navigating turbulent odor plumes exhibit a rich variety of behaviors, and employ efficient strategies to locate odor sources. A growing body of literature has started to probe this complex task of localizing airborne odor sources in walking mammals to further our understanding of neural encoding and decoding of naturalistic sensory stimuli. However, correlating the intermittent olfactory information with behavior has remained a long-standing challenge due to the stochastic nature of the odor stimulus. We recently reported a method to record real-time olfactory information available to freely moving mice during odor-guided navigation, hence overcoming that challenge. Here we combine our odor-recording method with head-motion tracking to establish correlations between plume encounters and head movements. We show that mice exhibit robust head-pitch motions in the 5-14Hz range during an odor-guided navigation task, and that these head motions are modulated by plume encounters. Furthermore, mice reduce their angles with respect to the source upon plume contact. Head motions may thus be an important part of the sensorimotor behavioral repertoire during naturalistic odor-source localization.

Distinct roles of prefrontal cortex neurons in set shifting

Cognitive flexibility, the ability to adjust behavioral strategies in response to changing environmental contingencies, requires adaptive processing of internal states and contextual cues to guide goal-oriented behavior, and is dependent on prefrontal cortex (PFC) functions. However, the neurophysiological underpinning of how the PFC supports cognitive flexibility is not well understood and has been under active investigation. We recorded spiking activity from single PFC neurons in mice performing the attentional set-shifting task, where mice learned to associate different contextually relevant sensory stimuli to reward. We identified subgroups of PFC neurons encoding task context, choice and trial outcome. Putative fast-spiking neurons were more involved in representing outcome and choice than putative regular-spiking neurons. Regression model further revealed that task context and trial outcome modulated the activity of choice-encoding neurons in rule-dependent and cell type-dependent manners. Together, our data provide new evidence to elucidate PFC's role in cognitive flexibility, suggesting differential cell type-specific engagement during set shifting, and that both contextual rule representation and trial outcome monitoring underlie PFC's unique capacity to support flexible behavioral switching.

Sound-seeking before and after hearing loss in mice

How we move our bodies affects how we perceive sound. For instance, head movements help us to better localize the source of a sound and to compensate for asymmetric hearing loss. However, many auditory experiments are designed to restrict head and body movements. To study the role of movement in hearing, we developed a behavioral task called sound-seeking that rewarded freely moving mice for tracking down an ongoing sound source. Over the course of learning, mice more efficiently navigated to the sound. Next, we asked how sound-seeking was affected by hearing loss induced by surgical removal of the malleus from the middle ear. After bilateral hearing loss sound-seeking performance drastically declined and did not recover. In striking contrast, after unilateral hearing loss mice were only transiently impaired and then recovered their sound-seek ability over about a week. Throughout recovery, unilateral mice increasingly relied on a movement strategy of sequentially checking potential locations for the sound source. In contrast, the startle reflex (an innate auditory behavior) was preserved after unilateral hearing loss and abolished by bilateral hearing loss without recovery over time. In sum, mice compensate with body movement for permanent unilateral damage to the peripheral auditory system. Looking forward, this paradigm provides an opportunity to examine how movement enhances perception and enables resilient adaptation to sensory disorders.

Flexible neural population dynamics govern the speed and stability of sensory encoding in mouse visual cortex

Time courses of neural responses underlie real-time sensory processing and perception. How these temporal dynamics change may be fundamental to how sensory systems adapt to different perceptual demands. By simultaneously recording from hundreds of neurons in mouse primary visual cortex, we examined neural population responses to visual stimuli at sub-second timescales, during different behavioural states. We discovered that during active behavioural states characterised by locomotion, single-neurons shift from transient to sustained response modes, facilitating rapid emergence of visual stimulus tuning. Differences in single-neuron response dynamics were associated with changes in temporal dynamics of neural correlations, including faster stabilisation of stimulus-evoked changes in the structure of correlations during locomotion. Using Factor Analysis, we examined temporal dynamics of latent population responses and discovered that trajectories of population activity make more direct transitions between baseline and stimulus-encoding neural states during locomotion. This could be partly explained by dampening of oscillatory dynamics present during stationary behavioural states. Functionally, changes in temporal response dynamics collectively enabled faster, more stable and more efficient encoding of new visual information during locomotion. These findings reveal a principle of how sensory systems adapt to perceptual demands, where flexible neural population dynamics govern the speed and stability of sensory encoding.

The speed and phase of locomotion dictate saccade probability and simultaneous low-frequency power spectra

Every day we make thousands of saccades and take thousands of steps as we explore our environment. Despite their common co-occurrence in a typical active state, we know little about the coordination between eye movements, walking behaviour and related changes in cortical activity. Technical limitations have been a major impediment, which we overcome here by leveraging the advantages of an immersive wireless virtual reality (VR) environment with three-dimensional (3D) position tracking, together with simultaneous recording of eye movements and mobile electroencephalography (EEG). Using this approach with participants engaged in unencumbered walking along a clear, level path, we find that the likelihood of eye movements at both slow and natural walking speeds entrains to the rhythm of footfall, peaking after the heel-strike of each step. Compared to previous research, this entrainment was captured in a task that did not require visually guided stepping - suggesting a persistent interaction between locomotor and visuomotor functions. Simultaneous EEG recordings reveal a concomitant modulation entrained to heel-strike, with increases and decreases in oscillatory power for a broad range of frequencies. The peak of these effects occurred in the theta and alpha range for slow and natural walking speeds, respectively. Together, our data show that the phase of the step-cycle influences other behaviours such as eye movements, and produces related modulations of simultaneous EEG following the same rhythmic pattern. These results reveal gait as an important factor to be considered when interpreting saccadic and time-frequency EEG data in active observers, and demonstrate that saccadic entrainment to gait may persist throughout everyday activities.

Mixed Representations of Sound and Action in the Auditory Midbrain

Linking sensory input and its consequences is a fundamental brain operation. During behavior, the neural activity of neocortical and limbic systems often reflects dynamic combinations of sensory and task-dependent variables, and these "mixed representations" are suggested to be important for perception, learning, and plasticity. However, the extent to which such integrative computations might occur outside of the forebrain is less clear. Here, we conduct cellular-resolution two-photon Ca2+ imaging in the superficial "shell" layers of the inferior colliculus (IC), as head-fixed mice of either sex perform a reward-based psychometric auditory task. We find that the activity of individual shell IC neurons jointly reflects auditory cues, mice's actions, and behavioral trial outcomes, such that trajectories of neural population activity diverge depending on mice's behavioral choice. Consequently, simple classifier models trained on shell IC neuron activity can predict trial-by-trial outcomes, even when training data are restricted to neural activity occurring prior to mice's instrumental actions. Thus, in behaving mice, auditory midbrain neurons transmit a population code that reflects a joint representation of sound, actions, and task-dependent variables.

Co-coding of head and whisker movements by both VPM and POm thalamic neurons

Rodents continuously move their heads and whiskers in a coordinated manner while perceiving objects through whisker-touch. Studies in head-fixed rodents showed that the ventroposterior medial (VPM) and posterior medial (POm) thalamic nuclei code for whisker kinematics, with POm involvement reduced in awake animals. To examine VPM and POm involvement in coding head and whisker kinematics in awake, head-free conditions, we recorded thalamic neuronal activity and tracked head and whisker movements in male mice exploring an open arena. Using optogenetic tagging, we found that in freely moving mice, both nuclei equally coded whisker kinematics and robustly coded head kinematics. The fraction of neurons coding head kinematics increased after whisker trimming, ruling out whisker-mediated coding. Optogenetic activation of thalamic neurons evoked overt kinematic changes and increased the fraction of neurons leading changes in head kinematics. Our data suggest that VPM and POm integrate head and whisker information and can influence head kinematics during tactile perception.

Dynamics of odor-source localization: Insights from real-time odor plume recordings and head-motion tracking in freely moving mice

Animals navigating turbulent odor plumes exhibit a rich variety of behaviors, and employ efficient strategies to locate odor sources. A growing body of literature has started to probe this complex task of localizing airborne odor sources in walking mammals to further our understanding of neural encoding and decoding of naturalistic sensory stimuli. However, correlating the intermittent olfactory information with behavior has remained a long-standing challenge due to the stochastic nature of the odor stimulus. We recently reported a method to record real-time olfactory information available to freely moving mice during odor-guided navigation, hence overcoming that challenge. Here we combine our odor-recording method with head-motion tracking to establish correlations between plume encounters and head movements. We show that mice exhibit robust head-pitch motions in the 5-14Hz range during an odor-guided navigation task, and that these head motions are modulated by plume encounters. Furthermore, mice reduce their angles with respect to the source upon plume contact. Head motions may thus be an important part of the sensorimotor behavioral repertoire during naturalistic odor-source localization.

Acquisition of non-olfactory encoding improves odour discrimination in olfactory cortex

Olfaction is influenced by contextual factors, past experiences, and the animal's internal state. Whether this information is integrated at the initial stages of cortical odour processing is not known, nor how these signals may influence odour encoding. Here we revealed multiple and diverse non-olfactory responses in the primary olfactory (piriform) cortex (PCx), which dynamically enhance PCx odour discrimination according to behavioural demands. We performed recordings of PCx neurons from mice trained in a virtual reality task to associate odours with visual contexts to obtain a reward. We found that learning shifts PCx activity from encoding solely odours to a regime in which positional, contextual, and associative responses emerge on odour-responsive neurons that become mixed-selective. The modulation of PCx activity by these non-olfactory signals was dynamic, improving odour decoding during task engagement and in rewarded contexts. This improvement relied on the acquired mixed-selectivity, demonstrating how integrating extra-sensory inputs in sensory cortices can enhance sensory processing while encoding the behavioural relevance of stimuli.

Toward a neuroscience of natural behavior

One of the most exciting new developments in systems neuroscience is the progress being made toward neurophysiological experiments that move beyond simplified laboratory settings and address the richness of natural behavior. This is enabled by technological advances such as wireless recording in freely moving animals, automated quantification of behavior, and new methods for analyzing large data sets. Beyond new empirical methods and data, however, there is also a need for new theories and concepts to interpret that data. Such theories need to address the particular challenges of natural behavior, which often differ significantly from the scenarios studied in traditional laboratory settings. Here, we discuss some strategies for developing such novel theories and concepts and some example hypotheses being proposed.

Behind mouse eyes: The function and control of eye movements in mice

The mouse visual system has become the most popular model to study the cellular and circuit mechanisms of sensory processing. However, the importance of eye movements only started to be appreciated recently. Eye movements provide a basis for predictive sensing and deliver insights into various brain functions and dysfunctions. A plethora of knowledge on the central control of eye movements and their role in perception and behaviour arose from work on primates. However, an overview of various eye movements in mice and a comparison to primates is missing. Here, we review the eye movement types described to date in mice and compare them to those observed in primates. We discuss the central neuronal mechanisms for their generation and control. Furthermore, we review the mounting literature on eye movements in mice during head-fixed and freely moving behaviours. Finally, we highlight gaps in our understanding and suggest future directions for research.

Differential representation of sensory information and behavioral choice across layers of the mouse auditory cortex

The activity of neurons in sensory areas sometimes covaries with upcoming choices in decision-making tasks. However, the prevalence, causal origin, and functional role of choice-related activity remain controversial. Understanding the circuit-logic of decision signals in sensory areas will require understanding their laminar specificity, but simultaneous recordings of neural activity across the cortical layers in forced-choice discrimination tasks have not yet been performed. Here, we describe neural activity from such recordings in the auditory cortex of mice during a frequency discrimination task with delayed report, which, as we show, requires the auditory cortex. Stimulus-related information was widely distributed across layers but disappeared very quickly after stimulus offset. Choice selectivity emerged toward the end of the delay period-suggesting a top-down origin-but only in the deep layers. Early stimulus-selective and late choice-selective deep neural ensembles were correlated, suggesting that the choice-selective signal fed back to the auditory cortex is not just action specific but develops as a consequence of the sensory-motor contingency imposed by the task.

Tactile processing in mouse cortex depends on action context

The brain receives constant tactile input, but only a subset guides ongoing behavior. Actions associated with tactile stimuli thus endow them with behavioral relevance. It remains unclear how the relevance of tactile stimuli affects processing in the somatosensory (S1) cortex. We developed a cross-modal selection task in which head-fixed mice switched between responding to tactile stimuli in the presence of visual distractors or to visual stimuli in the presence of tactile distractors using licking movements to the left or right side in different blocks of trials. S1 spiking encoded tactile stimuli, licking actions, and direction of licking in response to tactile but not visual stimuli. Bidirectional optogenetic manipulations showed that sensory-motor activity in S1 guided behavior when touch but not vision was relevant. Our results show that S1 activity and its impact on behavior depend on the actions associated with a tactile stimulus.

A mechanosensory feedback that uncouples external and self-generated sensory responses in the olfactory cortex

Sampling behaviors have sensory consequences that can hinder perceptual stability. In olfaction, sniffing affects early odor encoding, mimicking a sudden change in odor concentration. We examined how the inhalation speed affects the representation of odor concentration in the main olfactory cortex. Neurons combine the odor input with a global top-down signal preceding the sniff and a mechanosensory feedback generated by the air passage through the nose during inhalation. Still, the population representation of concentration is remarkably sniff invariant. This is because the mechanosensory and olfactory responses are uncorrelated within and across neurons. Thus, faster odor inhalation and an increase in concentration change the cortical activity pattern in distinct ways. This encoding strategy affords tolerance to potential concentration fluctuations caused by varying inhalation speeds. Since mechanosensory reafferences are widespread across sensory systems, the coding scheme described here may be a canonical strategy to mitigate the sensory ambiguities caused by movements.

Separating cognitive and motor processes in the behaving mouse

The cognitive processes supporting complex animal behavior are closely associated with ubiquitous movements responsible for our posture, facial expressions, ability to actively sample our sensory environments, and other critical processes. These movements are strongly related to neural activity across much of the brain and are often highly correlated with ongoing cognitive processes, making it challenging to dissociate the neural dynamics that support cognitive processes from those supporting related movements. In such cases, a critical issue is whether cognitive processes are separable from related movements, or if they are driven by common neural mechanisms. Here, we demonstrate how the separability of cognitive and motor processes can be assessed, and, when separable, how the neural dynamics associated with each component can be isolated. We establish a novel two-context behavioral task in mice that involves multiple cognitive processes and show that commonly observed dynamics taken to support cognitive processes are strongly contaminated by movements. When cognitive and motor components are isolated using a novel approach for subspace decomposition, we find that they exhibit distinct dynamical trajectories. Further, properly accounting for movement revealed that largely separate populations of cells encode cognitive and motor variables, in contrast to the 'mixed selectivity' often reported. Accurately isolating the dynamics associated with particular cognitive and motor processes will be essential for developing conceptual and computational models of neural circuit function and evaluating the function of the cell types of which neural circuits are composed.

Walking modulates visual detection performance according to stride cycle phase

Walking is among our most frequent and natural of voluntary behaviours, yet the consequences of locomotion upon perceptual and cognitive function remain largely unknown. Recent work has highlighted that although walking feels smooth and continuous, critical phases exist within each step for the successful coordination of perceptual and motor function. Here, we test whether these phasic demands impact upon visual perception, by assessing performance in a visual detection task during natural unencumbered walking. We finely sample visual performance over the stride cycle as participants walk along a smooth linear path at a comfortable speed in a wireless virtual reality environment. At the group-level, accuracy, reaction times, and response likelihood show strong oscillations, modulating at approximately 2 cycles per stride (~2 Hz) with a marked phase of optimal performance aligned with the swing phase of each step. At the participant level, Bayesian inference of population prevalence reveals highly prevalent oscillations in visual detection performance that cluster in two idiosyncratic frequency ranges (2 or 4 cycles per stride), with a strong phase alignment across participants.

Decision-making dynamics are predicted by arousal and uninstructed movements

During sensory-guided behavior, an animal's decision-making dynamics unfold through sequences of distinct performance states, even while stimulus-reward contingencies remain static. Little is known about the factors that underlie these changes in task performance. We hypothesize that these decision-making dynamics can be predicted by externally observable measures, such as uninstructed movements and changes in arousal. Here, using computational modeling of visual and auditory task performance data from mice, we uncovered lawful relationships between transitions in strategic task performance states and an animal's arousal and uninstructed movements. Using hidden Markov models applied to behavioral choices during sensory discrimination tasks, we find that animals fluctuate between minutes-long optimal, sub-optimal, and disengaged performance states. Optimal state epochs are predicted by intermediate levels, and reduced variability, of pupil diameter and movement. Our results demonstrate that externally observable uninstructed behaviors can predict optimal performance states and suggest that mice regulate their arousal during optimal performance.

Neuronal sensorimotor integration guiding salt concentration navigation in Caenorhabditis elegans

Animals navigate their environment by manipulating their movements and adjusting their trajectory which requires a sophisticated integration of sensory data with their current motor status. Here, we utilize the nematode Caenorhabditis elegans to explore the neural mechanisms of processing the sensory and motor information for navigation. We developed a microfluidic device which allows animals to freely move their heads while receiving temporal NaCl stimuli. We found that C. elegans regulates neck bending direction in response to temporal NaCl concentration changes in a way which is consistent with a C. elegans' navigational strategy which regulates traveling direction toward preferred NaCl concentrations. Our analysis also revealed that the activity of a neck motor neuron is significantly correlated with neck bending and activated by the decrease in NaCl concentration in a phase-dependent manner. By combining the analysis of behavioral and neural response to NaCl stimuli and optogenetic perturbation experiments, we revealed that NaCl decrease during ventral bending activates the neck motor neuron which counteracts ipsilateral bending. Simulations further suggest that this phase-dependent response of neck motor neurons can facilitate curving toward preferred salt concentrations.

All-optical interrogation of brain-wide activity in freely swimming larval zebrafish

We introduce an all-optical technique that enables volumetric imaging of brain-wide calcium activity and targeted optogenetic stimulation of specific brain regions in unrestrained larval zebrafish. The system consists of three main components: a 3D tracking module, a dual-color fluorescence imaging module, and a real-time activity manipulation module. Our approach uses a sensitive genetically encoded calcium indicator in combination with a long Stokes shift red fluorescence protein as a reference channel, allowing the extraction of Ca2+ activity from signals contaminated by motion artifacts. The method also incorporates rapid 3D image reconstruction and registration, facilitating real-time selective optogenetic stimulation of different regions of the brain. By demonstrating that selective light activation of the midbrain regions in larval zebrafish could reliably trigger biased turning behavior and changes of brain-wide neural activity, we present a valuable tool for investigating the causal relationship between distributed neural circuit dynamics and naturalistic behavior.

Sound-seeking before and after hearing loss in mice

How we move our bodies affects how we perceive sound. For instance, we can explore an environment to seek out the source of a sound and we can use head movements to compensate for hearing loss. How we do this is not well understood because many auditory experiments are designed to limit head and body movements. To study the role of movement in hearing, we developed a behavioral task called sound-seeking that rewarded mice for tracking down an ongoing sound source. Over the course of learning, mice more efficiently navigated to the sound. We then asked how auditory behavior was affected by hearing loss induced by surgical removal of the malleus from the middle ear. An innate behavior, the auditory startle response, was abolished by bilateral hearing loss and unaffected by unilateral hearing loss. Similarly, performance on the sound-seeking task drastically declined after bilateral hearing loss and did not recover. In striking contrast, mice with unilateral hearing loss were only transiently impaired on sound-seeking; over a recovery period of about a week, they regained high levels of performance, increasingly reliant on a different spatial sampling strategy. Thus, even in the face of permanent unilateral damage to the peripheral auditory system, mice recover their ability to perform a naturalistic sound-seeking task. This paradigm provides an opportunity to examine how body movement enables better hearing and resilient adaptation to sensory deprivation.

Sensory input to cortex encoded on low-dimensional periphery-correlated subspaces

As information about the world is conveyed from the sensory periphery to central neural circuits, it mixes with complex ongoing cortical activity. How do neural populations keep track of sensory signals, separating them from noisy ongoing activity? Here, we show that sensory signals are encoded more reliably in certain low-dimensional subspaces. These coding subspaces are defined by correlations between neural activity in the primary sensory cortex and upstream sensory brain regions; the most correlated dimensions were best for decoding. We analytically show that these correlation-based coding subspaces improve, reaching optimal limits (without an ideal observer), as noise correlations between cortex and upstream regions are reduced. We show that this principle generalizes across diverse sensory stimuli in the olfactory system and the visual system of awake mice. Our results demonstrate an algorithm the cortex may use to multiplex different functions, processing sensory input in low-dimensional subspaces separate from other ongoing functions.

Multimodal Deep Learning Model Unveils Behavioral Dynamics of V1 Activity in Freely Moving Mice

Despite their immense success as a model of macaque visual cortex, deep convolutional neural networks (CNNs) have struggled to predict activity in visual cortex of the mouse, which is thought to be strongly dependent on the animal's behavioral state. Furthermore, most computational models focus on predicting neural responses to static images presented under head fixation, which are dramatically different from the dynamic, continuous visual stimuli that arise during movement in the real world. Consequently, it is still unknown how natural visual input and different behavioral variables may integrate over time to generate responses in primary visual cortex (V1). To address this, we introduce a multimodal recurrent neural network that integrates gaze-contingent visual input with behavioral and temporal dynamics to explain V1 activity in freely moving mice. We show that the model achieves state-of-the-art predictions of V1 activity during free exploration and demonstrate the importance of each component in an extensive ablation study. Analyzing our model using maximally activating stimuli and saliency maps, we reveal new insights into cortical function, including the prevalence of mixed selectivity for behavioral variables in mouse V1. In summary, our model offers a comprehensive deep-learning framework for exploring the computational principles underlying V1 neurons in freely-moving animals engaged in natural behavior.

A dynamic sequence of visual processing initiated by gaze shifts

Animals move their head and eyes as they explore the visual scene. Neural correlates of these movements have been found in rodent primary visual cortex (V1), but their sources and computational roles are unclear. We addressed this by combining head and eye movement measurements with neural recordings in freely moving mice. V1 neurons responded primarily to gaze shifts, where head movements are accompanied by saccadic eye movements, rather than to head movements where compensatory eye movements stabilize gaze. A variety of activity patterns followed gaze shifts and together these formed a temporal sequence that was absent in darkness. Gaze-shift responses resembled those evoked by sequentially flashed stimuli, suggesting a large component corresponds to onset of new visual input. Notably, neurons responded in a sequence that matches their spatial frequency bias, consistent with coarse-to-fine processing. Recordings in freely gazing marmosets revealed a similar sequence following saccades, also aligned to spatial frequency preference. Our results demonstrate that active vision in both mice and marmosets consists of a dynamic temporal sequence of neural activity associated with visual sampling.

Activity in primate visual cortex is minimally driven by spontaneous movements

Organisms process sensory information in the context of their own moving bodies, an idea referred to as embodiment. This idea is important for developmental neuroscience, robotics and systems neuroscience. The mechanisms supporting embodiment are unknown, but a manifestation could be the observation in mice of brain-wide neuromodulation, including in the primary visual cortex, driven by task-irrelevant spontaneous body movements. We tested this hypothesis in macaque monkeys (Macaca mulatta), a primate model for human vision, by simultaneously recording visual cortex activity and facial and body movements. We also sought a direct comparison using an analogous approach to those used in mouse studies. Here we found that activity in the primate visual cortex (V1, V2 and V3/V3A) was associated with the animals' own movements, but this modulation was largely explained by the impact of the movements on the retinal image, that is, by changes in visual input. These results indicate that visual cortex in primates is minimally driven by spontaneous movements and may reflect species-specific sensorimotor strategies.

Mixed representations of sound and action in the auditory midbrain

Linking sensory input and its consequences is a fundamental brain operation. Accordingly, neural activity of neo-cortical and limbic systems often reflects dynamic combinations of sensory and behaviorally relevant variables, and these "mixed representations" are suggested to be important for perception, learning, and plasticity. However, the extent to which such integrative computations might occur in brain regions upstream of the forebrain is less clear. Here, we conduct cellular-resolution 2-photon Ca2+ imaging in the superficial "shell" layers of the inferior colliculus (IC), as head-fixed mice of either sex perform a reward-based psychometric auditory task. We find that the activity of individual shell IC neurons jointly reflects auditory cues and mice's actions, such that trajectories of neural population activity diverge depending on mice's behavioral choice. Consequently, simple classifier models trained on shell IC neuron activity can predict trial-by-trial outcomes, even when training data are restricted to neural activity occurring prior to mice's instrumental actions. Thus in behaving animals, auditory midbrain neurons transmit a population code that reflects a joint representation of sound and action.

Continuous peripersonal tracking accuracy is limited by the speed and phase of locomotion

Recent evidence suggests that perceptual and cognitive functions are codetermined by rhythmic bodily states. Prior investigations have focused on the cardiac and respiratory rhythms, both of which are also known to synchronise with locomotion-arguably our most common and natural of voluntary behaviours. Compared to the cardiorespiratory rhythms, walking is easier to voluntarily control, enabling a test of how natural and voluntary rhythmic action may affect sensory function. Here we show that the speed and phase of human locomotion constrains sensorimotor performance. We used a continuous visuo-motor tracking task in a wireless, body-tracking virtual environment, and found that the accuracy and reaction time of continuous reaching movements were decreased at slower walking speeds, and rhythmically modulated according to the phases of the step-cycle. Decreased accuracy when walking at slow speeds suggests an advantage for interlimb coordination at normal walking speeds, in contrast to previous research on dual-task walking and reach-to-grasp movements. Phasic modulations of reach precision within the step-cycle also suggest that the upper limbs are affected by the ballistic demands of motor-preparation during natural locomotion. Together these results show that the natural phases of human locomotion impose constraints on sensorimotor function and demonstrate the value of examining dynamic and natural behaviour in contrast to the traditional and static methods of psychological science.

Auditory cortex ensembles jointly encode sound and locomotion speed to support sound perception during movement

The ability to process and act upon incoming sounds during locomotion is critical for survival and adaptive behavior. Despite the established role that the auditory cortex (AC) plays in behavior- and context-dependent sound processing, previous studies have found that auditory cortical activity is on average suppressed during locomotion as compared to immobility. While suppression of auditory cortical responses to self-generated sounds results from corollary discharge, which weakens responses to predictable sounds, the functional role of weaker responses to unpredictable external sounds during locomotion remains unclear. In particular, whether suppression of external sound-evoked responses during locomotion reflects reduced involvement of the AC in sound processing or whether it results from masking by an alternative neural computation in this state remains unresolved. Here, we tested the hypothesis that rather than simple inhibition, reduced sound-evoked responses during locomotion reflect a tradeoff with the emergence of explicit and reliable coding of locomotion velocity. To test this hypothesis, we first used neural inactivation in behaving mice and found that the AC plays a critical role in sound-guided behavior during locomotion. To investigate the nature of this processing, we used two-photon calcium imaging of local excitatory auditory cortical neural populations in awake mice. We found that locomotion had diverse influences on activity of different neurons, with a net suppression of baseline-subtracted sound-evoked responses and neural stimulus detection, consistent with previous studies. Importantly, we found that the net inhibitory effect of locomotion on baseline-subtracted sound-evoked responses was strongly shaped by elevated ongoing activity that compressed the response dynamic range, and that rather than reflecting enhanced "noise," this ongoing activity reliably encoded the animal's locomotion speed. Decoding analyses revealed that locomotion speed and sound are robustly co-encoded by auditory cortical ensemble activity. Finally, we found consistent patterns of joint coding of sound and locomotion speed in electrophysiologically recorded activity in freely moving rats. Together, our data suggest that rather than being suppressed by locomotion, auditory cortical ensembles explicitly encode it alongside sound information to support sound perception during locomotion.

Cognition from the Body-Brain Partnership: Exaptation of Memory

Examination of cognition has historically been approached from language and introspection. However, human language-dependent definitions ignore the evolutionary roots of brain mechanisms and constrain their study in experimental animals. We promote an alternative view, namely that cognition, including memory, can be explained by exaptation and expansion of the circuits and algorithms serving bodily functions. Regulation and protection of metabolic and energetic processes require time-evolving brain computations enabling the organism to prepare for altered future states. Exaptation of such circuits was likely exploited for exploration of the organism's niche. We illustrate that exploration gives rise to a cognitive map, and in turn, environment-disengaged computation allows for mental travel into the past (memory) and the future (planning). Such brain-body interactions not only occur during waking but also persist during sleep. These exaptation steps are illustrated by the dual, endocrine-homeostatic and memory, contributions of the hippocampal system, particularly during hippocampal sharp-wave ripples.

Behavioral decomposition reveals rich encoding structure employed across neocortex in rats

The cortical population code is pervaded by activity patterns evoked by movement, but it remains largely unknown how such signals relate to natural behavior or how they might support processing in sensory cortices where they have been observed. To address this we compared high-density neural recordings across four cortical regions (visual, auditory, somatosensory, motor) in relation to sensory modulation, posture, movement, and ethograms of freely foraging male rats. Momentary actions, such as rearing or turning, were represented ubiquitously and could be decoded from all sampled structures. However, more elementary and continuous features, such as pose and movement, followed region-specific organization, with neurons in visual and auditory cortices preferentially encoding mutually distinct head-orienting features in world-referenced coordinates, and somatosensory and motor cortices principally encoding the trunk and head in egocentric coordinates. The tuning properties of synaptically coupled cells also exhibited connection patterns suggestive of area-specific uses of pose and movement signals, particularly in visual and auditory regions. Together, our results indicate that ongoing behavior is encoded at multiple levels throughout the dorsal cortex, and that low-level features are differentially utilized by different regions to serve locally relevant computations.

Interactions between rodent visual and spatial systems during navigation

Many behaviours that are critical for animals to survive and thrive rely on spatial navigation. Spatial navigation, in turn, relies on internal representations about one's spatial location, one's orientation or heading direction and the distance to objects in the environment. Although the importance of vision in guiding such internal representations has long been recognized, emerging evidence suggests that spatial signals can also modulate neural responses in the central visual pathway. Here, we review the bidirectional influences between visual and navigational signals in the rodent brain. Specifically, we discuss reciprocal interactions between vision and the internal representations of spatial position, explore the effects of vision on representations of an animal's heading direction and vice versa, and examine how the visual and navigational systems work together to assess the relative distances of objects and other features. Throughout, we consider how technological advances and novel ethological paradigms that probe rodent visuo-spatial behaviours allow us to advance our understanding of how brain areas of the central visual pathway and the spatial systems interact and enable complex behaviours.

Multimodal Deep Learning Model Unveils Behavioral Dynamics of V1 Activity in Freely Moving Mice

Despite their immense success as a model of macaque visual cortex, deep convolutional neural networks (CNNs) have struggled to predict activity in visual cortex of the mouse, which is thought to be strongly dependent on the animal's behavioral state. Furthermore, most computational models focus on predicting neural responses to static images presented under head fixation, which are dramatically different from the dynamic, continuous visual stimuli that arise during movement in the real world. Consequently, it is still unknown how natural visual input and different behavioral variables may integrate over time to generate responses in primary visual cortex (V1). To address this, we introduce a multimodal recurrent neural network that integrates gaze-contingent visual input with behavioral and temporal dynamics to explain V1 activity in freely moving mice. We show that the model achieves state-of-the-art predictions of V1 activity during free exploration and demonstrate the importance of each component in an extensive ablation study. Analyzing our model using maximally activating stimuli and saliency maps, we reveal new insights into cortical function, including the prevalence of mixed selectivity for behavioral variables in mouse V1. In summary, our model offers a comprehensive deep-learning framework for exploring the computational principles underlying V1 neurons in freely-moving animals engaged in natural behavior.

Data-driven segmentation of cortical calcium dynamics

Demixing signals in transcranial videos of neuronal calcium flux across the cerebral hemispheres is a key step before mapping features of cortical organization. Here we demonstrate that independent component analysis can optimally recover neural signal content in widefield recordings of neuronal cortical calcium dynamics captured at a minimum sampling rate of 1.5×106 pixels per one-hundred millisecond frame for seventeen minutes with a magnification ratio of 1:1. We show that a set of spatial and temporal metrics obtained from the components can be used to build a random forest classifier, which separates neural activity and artifact components automatically at human performance. Using this data, we establish functional segmentation of the mouse cortex to provide a map of ~115 domains per hemisphere, in which extracted time courses maximally represent the underlying signal in each recording. Domain maps revealed substantial regional motifs, with higher order cortical regions presenting large, eccentric domains compared with smaller, more circular ones in primary sensory areas. This workflow of data-driven video decomposition and machine classification of signal sources can greatly enhance high quality mapping of complex cerebral dynamics.

Global change in brain state during spontaneous and forced walk in Drosophila is composed of combined activity patterns of different neuron classes

Movement-correlated brain activity has been found across species and brain regions. Here, we used fast whole brain lightfield imaging in adult Drosophila to investigate the relationship between walk and brain-wide neuronal activity. We observed a global change in activity that tightly correlated with spontaneous bouts of walk. While imaging specific sets of excitatory, inhibitory, and neuromodulatory neurons highlighted their joint contribution, spatial heterogeneity in walk- and turning-induced activity allowed parsing unique responses from subregions and sometimes individual candidate neurons. For example, previously uncharacterized serotonergic neurons were inhibited during walk. While activity onset in some areas preceded walk onset exclusively in spontaneously walking animals, spontaneous and forced walk elicited similar activity in most brain regions. These data suggest a major contribution of walk and walk-related sensory or proprioceptive information to global activity of all major neuronal classes.

Humans have a basic physical and psychological need to move the body: Physical activity as a primary drive

Physical activity, while less necessary for survival in modern times, is still essential for thriving in life, and low levels of movement are related to numerous physical and mental health problems. However, we poorly understand why people move on a day-to-day basis and how to promote greater energy expenditure. Recently, there has been a turn to understand automatic processes with close examination of older theories of behavior. This has co-occurred with new developments in the study of non-exercise activity thermogenesis (NEAT). In this narrative review, it is hypothesized that psycho-physiological drive is important to understand movement in general and NEAT, specifically. Drive, in short, is a motivation state, characterized by arousal and felt tension, energizing the organism to acquire a basic need. Movement is a biological necessity, like food, water, and sleep, but varies across the lifespan and having the greatest impact before adolescence. Movement meets various criteria for a primary drive: (a) deprivation of it produces feelings of tension, such as an urge or craving, known as affectively-charged motivation states, and particularly the feelings of being antsy, restless, hyper or cooped up, (b) provision of the need quickly reduces tension - one can be satiated, and may even over-consume, (c) it can be provoked by qualities of the environment, (d) it is under homeostatic control, (e) there is an appetite (i.e., appetence) for movement but also aversion, and (f) it has a developmental time course. Evidence for drive has mainly come from children and populations with hyperkinetic disorders, such as those with anorexia nervosa, restless legs syndrome, and akathisia. It is also stimulated in conditions of deprivation, such as bed rest, quarantine, long flights, and physical restraint. It seems to be lacking in the hypokinetic disorders, such as depression and Parkinson's. Thus, drive is associated with displeasure and negative reinforcement, subsuming it within the theory of hedonic drive, but it may fit better within new paradigms, such as the WANT model (Wants and Aversions for Neuromuscular Tasks). Recently developed measurement tools, such as the CRAVE scale, may permit the earnest investigation of movement drive, satiation, and motivation states in humans.

Wide-field calcium imaging of cortical activation and functional connectivity in externally- and internally-driven locomotion

The neural dynamics underlying self-initiated versus sensory driven movements is central to understanding volitional action. Upstream motor cortices are associated with the generation of internally-driven movements over externally-driven. Here we directly compare cortical dynamics during internally- versus externally-driven locomotion using wide-field Ca2+ imaging. We find that secondary motor cortex (M2) plays a larger role in internally-driven spontaneous locomotion transitions, with increased M2 functional connectivity during starting and stopping than in the externally-driven, motorized treadmill locomotion. This is not the case in steady-state walk. In addition, motorized treadmill and spontaneous locomotion are characterized by markedly different patterns of cortical activation and functional connectivity at the different behavior periods. Furthermore, the patterns of fluorescence activation and connectivity are uncorrelated. These experiments reveal widespread and striking differences in the cortical control of internally- and externally-driven locomotion, with M2 playing a major role in the preparation and execution of the self-initiated state.

Decision-making dynamics are predicted by arousal and uninstructed movements

During sensory-guided behavior, an animal's decision-making dynamics unfold through sequences of distinct performance states, even while stimulus-reward contingencies remain static. Little is known about the factors that underlie these changes in task performance. We hypothesize that these decision-making dynamics can be predicted by externally observable measures, such as uninstructed movements and changes in arousal. Here, combining behavioral experiments in mice with computational modeling, we uncovered lawful relationships between transitions in strategic task performance states and an animal's arousal and uninstructed movements. Using hidden Markov models applied to behavioral choices during sensory discrimination tasks, we found that animals fluctuate between minutes-long optimal, sub-optimal and disengaged performance states. Optimal state epochs were predicted by intermediate levels, and reduced variability, of pupil diameter, along with reduced variability in face movements and locomotion. Our results demonstrate that externally observable uninstructed behaviors can predict optimal performance states, and suggest mice regulate their arousal during optimal performance.

Walking humans and running mice: perception and neural encoding of optic flow during self-motion

Locomotion produces full-field optic flow that often dominates the visual motion inputs to an observer. The perception of optic flow is in turn important for animals to guide their heading and interact with moving objects. Understanding how locomotion influences optic flow processing and perception is therefore essential to understand how animals successfully interact with their environment. Here, we review research investigating how perception and neural encoding of optic flow are altered during self-motion, focusing on locomotion. Self-motion has been found to influence estimation and sensitivity for optic flow speed and direction. Nonvisual self-motion signals also increase compensation for self-driven optic flow when parsing the visual motion of moving objects. The integration of visual and nonvisual self-motion signals largely follows principles of Bayesian inference and can improve the precision and accuracy of self-motion perception. The calibration of visual and nonvisual self-motion signals is dynamic, reflecting the changing visuomotor contingencies across different environmental contexts. Throughout this review, we consider experimental research using humans, non-human primates and mice. We highlight experimental challenges and opportunities afforded by each of these species and draw parallels between experimental findings. These findings reveal a profound influence of locomotion on optic flow processing and perception across species. This article is part of a discussion meeting issue 'New approaches to 3D vision'.

Distributed context-dependent choice information in mouse posterior cortex

Choice information appears in multi-area brain networks mixed with sensory, motor, and cognitive variables. In the posterior cortex-traditionally implicated in decision computations-the presence, strength, and area specificity of choice signals are highly variable, limiting a cohesive understanding of their computational significance. Examining the mesoscale activity in the mouse posterior cortex during a visual task, we found that choice signals defined a decision variable in a low-dimensional embedding space with a prominent contribution along the ventral visual stream. Their subspace was near-orthogonal to concurrently represented sensory and motor-related activations, with modulations by task difficulty and by the animals' attention state. A recurrent neural network trained with animals' choices revealed an equivalent decision variable whose context-dependent dynamics agreed with that of the neural data. Our results demonstrated an independent, multi-area decision variable in the posterior cortex, controlled by task features and cognitive demands, possibly linked to contextual inference computations in dynamic animal-environment interactions.

Dual-Task Interference Slows Down Proprioception

It is well-known that multitasking impairs the performance of one or both of the concomitant ongoing tasks. Previous studies have mainly focused on how a secondary task can compromise visual or auditory information processing. However, despite dual tasking being critical to motor performance, the effects of dual-task performance on proprioceptive information processing have not been studied yet. The purpose of the present study was, therefore, to investigate whether sensorimotor task performance would be affected by the dual task and if so, in which phase of the sensorimotor task performance would this negative effect occur. The kinematic variables of passive and active knee movements elicited by the leg drop test were analyzed. Thirteen young adults participated in the study. The dual task consisted of performing serial subtractions. The results showed that the dual task increased both the reaction time to counteract passive knee-joint movements in the leg drop test and the threshold to detect those movements. The dual task did not affect the speed and time during the active knee movement and the absolute angle error between the final and the target knee angles. Furthermore, the results showed that the time to complete the sensorimotor task was prolonged in dual tasking. Our findings suggest that dual tasking reduces motor performance due to slowing down proprioceptive information processing without affecting movement execution.

Joint coding of visual input and eye/head position in V1 of freely moving mice

Visual input during natural behavior is highly dependent on movements of the eyes and head, but how information about eye and head position is integrated with visual processing during free movement is unknown, as visual physiology is generally performed under head fixation. To address this, we performed single-unit electrophysiology in V1 of freely moving mice while simultaneously measuring the mouse's eye position, head orientation, and the visual scene from the mouse's perspective. From these measures, we mapped spatiotemporal receptive fields during free movement based on the gaze-corrected visual input. Furthermore, we found a significant fraction of neurons tuned for eye and head position, and these signals were integrated with visual responses through a multiplicative mechanism in the majority of modulated neurons. These results provide new insight into coding in the mouse V1 and, more generally, provide a paradigm for investigating visual physiology under natural conditions, including active sensing and ethological behavior.

Spatiotemporally heterogeneous coordination of cholinergic and neocortical activity

Variation in an animal's behavioral state is linked to fluctuations in brain activity and cognitive ability. In the neocortex, state-dependent circuit dynamics may reflect neuromodulatory influences such as that of acetylcholine (ACh). Although early literature suggested that ACh exerts broad, homogeneous control over cortical function, recent evidence indicates potential anatomical and functional segregation of cholinergic signaling. In addition, it is unclear whether states as defined by different behavioral markers reflect heterogeneous cholinergic and cortical network activity. Here, we perform simultaneous, dual-color mesoscopic imaging of both ACh and calcium across the neocortex of awake mice to investigate their relationships with behavioral variables. We find that higher arousal, categorized by different motor behaviors, is associated with spatiotemporally dynamic patterns of cholinergic modulation and enhanced large-scale network correlations. Overall, our findings demonstrate that ACh provides a highly dynamic and spatially heterogeneous signal that links fluctuations in behavior to functional reorganization of cortical networks.

Estimation of skeletal kinematics in freely moving rodents

Forming a complete picture of the relationship between neural activity and skeletal kinematics requires quantification of skeletal joint biomechanics during free behavior; however, without detailed knowledge of the underlying skeletal motion, inferring limb kinematics using surface-tracking approaches is difficult, especially for animals where the relationship between the surface and underlying skeleton changes during motion. Here we developed a videography-based method enabling detailed three-dimensional kinematic quantification of an anatomically defined skeleton in untethered freely behaving rats and mice. This skeleton-based model was constrained using anatomical principles and joint motion limits and provided skeletal pose estimates for a range of body sizes, even when limbs were occluded. Model-inferred limb positions and joint kinematics during gait and gap-crossing behaviors were verified by direct measurement of either limb placement or limb kinematics using inertial measurement units. Together we show that complex decision-making behaviors can be accurately reconstructed at the level of skeletal kinematics using our anatomically constrained model.

Optogenetic fMRI for Brain-Wide Circuit Analysis of Sensory Processing

Sensory processing is a complex neurological process that receives, integrates, and responds to information from one's own body and environment, which is closely related to survival as well as neurological disorders. Brain-wide networks of sensory processing are difficult to investigate due to their dynamic regulation by multiple brain circuits. Optogenetics, a neuromodulation technique that uses light-sensitive proteins, can be combined with functional magnetic resonance imaging (ofMRI) to measure whole-brain activity. Since ofMRI has increasingly been used for investigating brain circuits underlying sensory processing for over a decade, we systematically reviewed recent ofMRI studies of sensory circuits and discussed the challenges of optogenetic fMRI in rodents.

Behavior is movement only but how to interpret it? Problems and pitfalls in translational neuroscience-a 40-year experience

Translational research in behavioral neuroscience seeks causes and remedies for human mental health problems in animals, following leads imposed by clinical research in psychiatry. This endeavor faces several problems because scientists must read and interpret animal movements to represent human perceptions, mood, and memory processes. Yet, it is still not known how mammalian brains bundle all these processes into a highly compressed motor output in the brain stem and spinal cord, but without that knowledge, translational research remains aimless. Based on some four decades of experience in the field, the article identifies sources of interpretation problems and illustrates typical translational pitfalls. (1) The sensory world of mice is different. Smell, hearing, and tactile whisker sensations dominate in rodents, while visual input is comparatively small. In humans, the relations are reversed. (2) Mouse and human brains are equated inappropriately: the association cortex makes up a large portion of the human neocortex, while it is relatively small in rodents. The predominant associative cortex in rodents is the hippocampus itself, orchestrating chiefly inputs from secondary sensorimotor areas and generating species-typical motor patterns that are not easily reconciled with putative human hippocampal functions. (3) Translational interpretation of studies of memory or emotionality often neglects the ecology of mice, an extremely small species surviving by freezing or flight reactions that do not need much cognitive processing. (4) Further misinterpretations arise from confounding neuronal properties with system properties, and from rigid mechanistic thinking unaware that many experimentally induced changes in the brain do partially reflect unpredictable compensatory plasticity. (5) Based on observing hippocampal lesion effects in mice indoors and outdoors, the article offers a simplistic general model of hippocampal functions in relation to hypothalamic input and output, placing hypothalamus and the supraspinal motor system at the top of a cerebral hierarchy. (6) Many translational problems could be avoided by inclusion of simple species-typical behaviors as end-points comparable to human cognitive or executive processing, and to rely more on artificial intelligence for recognizing patterns not classifiable by traditional psychological concepts.

Distance estimation from monocular cues in an ethological visuomotor task

In natural contexts, sensory processing and motor output are closely coupled, which is reflected in the fact that many brain areas contain both sensory and movement signals. However, standard reductionist paradigms decouple sensory decisions from their natural motor consequences, and head-fixation prevents the natural sensory consequences of self-motion. In particular, movement through the environment provides a number of depth cues beyond stereo vision that are poorly understood. To study the integration of visual processing and motor output in a naturalistic task, we investigated distance estimation in freely moving mice. We found that mice use vision to accurately jump across a variable gap, thus directly coupling a visual computation to its corresponding ethological motor output. Monocular eyelid suture did not affect gap jumping success, thus mice can use cues that do not depend on binocular disparity and stereo vision. Under monocular conditions, mice altered their head positioning and performed more vertical head movements, consistent with a shift from using stereopsis to other monocular cues, such as motion or position parallax. Finally, optogenetic suppression of primary visual cortex impaired task performance under both binocular and monocular conditions when optical fiber placement was localized to binocular or monocular zone V1, respectively. Together, these results show that mice can use monocular cues, relying on visual cortex, to accurately judge distance. Furthermore, this behavioral paradigm provides a foundation for studying how neural circuits convert sensory information into ethological motor output.

Active vision during prey capture in wild marmoset monkeys

A foundational pressure in the evolution of all animals is the ability to travel through the world, inherently coupling the sensory and motor systems. While this relationship has been explored in several species,1-4 it has been largely overlooked in primates, which have typically relied on paradigms in which head-restrained subjects view stimuli on screens.5 Natural visual behaviors, by contrast, are typified by locomotion through the environment guided by active sensing as animals explore and interact with the world,4,6 a relationship well illustrated by prey capture.7-12 Here, we characterized prey capture in wild marmoset monkeys as they negotiated their dynamic, arboreal habitat to illustrate the inherent role of vision as an active process in natural nonhuman primate behavior. Not only do marmosets share the core properties of vision that typify the primate Order,13-18 but they are prolific hunters that prey on a diverse set of prey animals.19-22 Marmosets pursued prey using vision in several different contexts, but executed precise visually guided motor control that predominantly involved grasping with hands for successful capture of prey. Applying markerless tracking for the first time in wild primates yielded novel findings that precisely quantified how marmosets track insects prior to initiating an attack and the rapid visually guided corrections of the hands during capture. These findings offer the first detailed insight into the active nature of vision to guide multiple facets of a natural goal-directed behavior in wild primates and can inform future laboratory studies of natural primate visual behaviors and the supporting neural processes.

Representational drift: Emerging theories for continual learning and experimental future directions

Recent work has revealed that the neural activity patterns correlated with sensation, cognition, and action often are not stable and instead undergo large scale changes over days and weeks-a phenomenon called representational drift. Here, we highlight recent observations of drift, how drift is unlikely to be explained by experimental confounds, and how the brain can likely compensate for drift to allow stable computation. We propose that drift might have important roles in neural computation to allow continual learning, both for separating and relating memories that occur at distinct times. Finally, we present an outlook on future experimental directions that are needed to further characterize drift and to test emerging theories for drift's role in computation.

Shared and specialized coding across posterior cortical areas for dynamic navigation decisions

Animals adaptively integrate sensation, planning, and action to navigate toward goal locations in ever-changing environments, but the functional organization of cortex supporting these processes remains unclear. We characterized encoding in approximately 90,000 neurons across the mouse posterior cortex during a virtual navigation task with rule switching. The encoding of task and behavioral variables was highly distributed across cortical areas but differed in magnitude, resulting in three spatial gradients for visual cue, spatial position plus dynamics of choice formation, and locomotion, with peaks respectively in visual, retrosplenial, and parietal cortices. Surprisingly, the conjunctive encoding of these variables in single neurons was similar throughout the posterior cortex, creating high-dimensional representations in all areas instead of revealing computations specialized for each area. We propose that, for guiding navigation decisions, the posterior cortex operates in parallel rather than hierarchically, and collectively generates a state representation of the behavior and environment, with each area specialized in handling distinct information modalities.