Revealing the structure of pharmacobehavioral space through motion sequencing

Sub-second characterization of locomotor activities of mouse models of Parkinsonism

The degeneration of midbrain dopamine (DA) neurons disrupts the neural control of natural behavior, such as walking, posture, and gait in Parkinson's disease. While some aspects of motor symptoms can be managed by dopamine replacement therapies, others respond poorly. Recent advancements in machine learning-based technologies offer opportunities for unbiased segmentation and quantification of natural behavior in both healthy and diseased states. In the present study, we applied the motion sequencing (MoSeq) platform to study the spontaneous locomotor activities of neurotoxin and genetic mouse models of Parkinsonism as the midbrain DA neurons progressively degenerate. We also evaluated the treatment efficacy of levodopa (L-DOPA) on behavioral modules at fine time scales. We revealed robust changes in the kinematics and usage of the behavioral modules that encode spontaneous locomotor activity. Further analysis demonstrates that fast behavioral modules with higher velocities were more vulnerable to loss of DA and preferentially affected at early stages of Parkinsonism. Last, L-DOPA effectively improved the velocity, but not the usage and transition probability, of behavioral modules of Parkinsonian animals. In conclusion, the hypokinetic phenotypes in Parkinsonism are mediated by the decreased velocities of behavioral modules and the disrupted temporal organization of sub-second modules into actions. Moreover, we showed that the therapeutic effect of L-DOPA is mainly mediated by its effect on the velocities of behavior modules at fine time scales. This work documents robust changes in the velocity, usage, and temporal organization of behavioral modules and their responsiveness to dopaminergic treatment under the Parkinsonian state.

Psychotropic Taxonomies: Constructing a Therapeutic Framework for Psychiatry

Pharmacological interventions are a cornerstone of psychiatric practice. The taxonomies used to classify these interventions influence the treatment and interpretation of psychiatric symptoms. Disease-based classification systems (e.g., 'antidepressant' and 'antipsychotic') do not reflect the fact that psychotropic agents are used across diagnostic categories, nor account for the dimensional nature of both the psychopathology and biology of psychiatric illnesses. In this review we discuss the history of psychotropic drug taxonomies and their influence on both clinical practice and drug development. We frame taxonomies as existing on a spectrum, with high-level disease-based approaches at one end and target-based molecular approaches at the other. Finally, we consider how data-driven methods might address the issue of classification at an intermediate level, based around transdiagnostic neurobiological and psychopathological markers.

A study of animal action segmentation algorithms across supervised, unsupervised, and semi-supervised learning paradigms

Action segmentation of behavioral videos is the process of labeling each frame as belonging to one or more discrete classes, and is a crucial component of many studies that investigate animal behavior. A wide range of algorithms exist to automatically parse discrete animal behavior, encompassing supervised, unsupervised, and semi-supervised learning paradigms. These algorithms - which include tree-based models, deep neural networks, and graphical models - differ widely in their structure and assumptions on the data. Using four datasets spanning multiple species - fly, mouse, and human - we systematically study how the outputs of these various algorithms align with manually annotated behaviors of interest. Along the way, we introduce a semi-supervised action segmentation model that bridges the gap between supervised deep neural networks and unsupervised graphical models. We find that fully supervised temporal convolutional networks with the addition of temporal information in the observations perform the best on our supervised metrics across all datasets.

Data-driven analysis identifies novel modulation of social behavior in female mice witnessing chronic social defeat stress

BACKGROUND

Chronic social defeat stress is a widely used depression model in male mice. Several proposed adaptations extend this model to females with variable, often marginal effects. We examine if the widely used male-defined metrics of stress are suboptimal in females witnessing defeat.

METHODS

Using a data-driven method we comprehensively classified social interaction behavior in 761 male and female mice after chronic social witness/defeat stress, examining social modulation of behavior and associations with conventional metrics (i.e., social interaction (SI) ratio).

RESULTS

Social stress induces distinct behavioral adaptation patterns in defeated males and witness females. SI ratio leads to underpowered analyses in witness females with limited utility to differentiate susceptibility/resilience. Data-driven analyses reveal changes in social adaptation in witness females that are captured in attenuated velocity change from no target to target tests (ΔVelocity). We explore the utility of this metric in four female social stress models and in male witnesses. Combining SI ratio and ΔVelocity optimally differentiates susceptibility/resilience in witness females and reveals resilient-specific adaptation in a resilience-associated neural circuit in female mice.

CONCLUSIONS

We demonstrate that chronic witness stress induces behavioral changes in females that are qualitatively distinct from those observed in defeated males and not adequately sampled by standard male-defined metrics. We identify modulation of locomotion as a robust and easily implementable metric for rigorous research in witness female mice. Overall, our findings highlight the need to critically evaluate sex differences in behavior and implement sex-based considerations in preclinical model design.

Building egocentric models of local space from retinal input

Determining the location of objects relative to ourselves is essential for interacting with the world. Neural activity in the retina is used to form a vision-independent model of the local spatial environment relative to the body. For example, when an animal navigates through a forest, it rapidly shifts its gaze to identify the position of important objects, such as a tree obstructing its path. This seemingly trivial behavior belies a sophisticated neural computation. Visual information entering the brain in a retinocentric reference frame must be transformed into an egocentric reference frame to guide motor planning and action. This, in turn, allows the animal to extract the location of the tree and plan a path around it. In this review, we explore the anatomical, physiological, and computational implementation of retinocentric-to-egocentric reference frame transformations - a research area undergoing rapid progress stimulated by an ever-expanding molecular, physiological, and computational toolbox for probing neural circuits. We begin by summarizing evidence for retinocentric and egocentric reference frames in the brains of diverse organisms, from insects to primates. Next, we cover how distance estimation contributes to creating a three-dimensional representation of local space. We then review proposed implementations of reference frame transformations across different biological and artificial neural networks. Finally, we discuss how an internal egocentric model of the environment is maintained independently of the sensory inputs from which it is derived. By comparing findings across a variety of nervous systems and behaviors, we aim to inspire new avenues for investigating the neural basis of reference frame transformation, a canonical computation critical for modeling the external environment and guiding goal-directed behavior.

Biomarker discovery using machine learning in the psychosis spectrum

The past decade witnessed substantial discoveries related to the psychosis spectrum. Many of these discoveries resulted from pursuits of objective and quantifiable biomarkers in tandem with the application of analytical tools such as machine learning. These approaches provided exciting new insights that significantly helped improve precision in diagnosis, prognosis, and treatment. This article provides an overview of how machine learning has been employed in recent biomarker discovery research in the psychosis spectrum, which includes schizophrenia, schizoaffective disorders, bipolar disorder with psychosis, first episode psychosis, and clinical high risk for psychosis. It highlights both human and animal model studies and explores a varying range of the most impactful biomarkers including cognition, neuroimaging, electrophysiology, and digital markers. We specifically highlight new applications and opportunities for machine learning to impact noninvasive symptom monitoring, prediction of future diagnosis and treatment outcomes, integration of new methods with traditional clinical research and practice, and personalized medicine approaches.

Analysis of behavioral flow resolves latent phenotypes

The accurate detection and quantification of rodent behavior forms a cornerstone of basic biomedical research. Current data-driven approaches, which segment free exploratory behavior into clusters, suffer from low statistical power due to multiple testing, exhibit poor transferability across experiments and fail to exploit the rich behavioral profiles of individual animals. Here we introduce a pipeline to capture each animal's behavioral flow, yielding a single metric based on all observed transitions between clusters. By stabilizing these clusters through machine learning, we ensure data transferability, while dimensionality reduction techniques facilitate detailed analysis of individual animals. We provide a large dataset of 771 behavior recordings of freely moving mice-including stress exposures, pharmacological and brain circuit interventions-to identify hidden treatment effects, reveal subtle variations on the level of individual animals and detect brain processes underlying specific interventions. Our pipeline, compatible with popular clustering methods, substantially enhances statistical power and enables predictions of an animal's future behavior.

A contextual fear conditioning paradigm in head-fixed mice exploring virtual reality

Contextual fear conditioning is a classical laboratory task that tests associative memory formation and recall. Techniques such as multi-photon microscopy and holographic stimulation offer tremendous opportunities to understand the neural underpinnings of these memories. However, these techniques generally require animals to be head-fixed. There are few paradigms that test contextual fear conditioning in head-fixed mice, and none where the behavioral outcome following fear conditioning is freezing, the most common measure of fear in freely moving animals. To address this gap, we developed a contextual fear conditioning paradigm in head-fixed mice using virtual reality (VR) environments. We designed an apparatus to deliver tail shocks (unconditioned stimulus, US) while mice navigated a VR environment (conditioned stimulus, CS). The acquisition of contextual fear was tested when the mice were reintroduced to the shock-paired VR environment the following day. We tested three different variations of this paradigm and, in all of them, observed an increased conditioned fear response characterized by increased freezing behavior. This was especially prominent during the first trial in the shock-paired VR environment, compared to a neutral environment where the mice received no shocks. Our results demonstrate that head-fixed mice can be fear conditioned in VR, discriminate between a feared and neutral VR context, and display freezing as a conditioned response, similar to freely behaving animals. Furthermore, using a two-photon microscope, we imaged from large populations of hippocampal CA1 neurons before, during, and following contextual fear conditioning. Our findings reconfirmed those from the literature on freely moving animals, showing that CA1 place cells undergo remapping and show narrower place fields following fear conditioning. Our approach offers new opportunities to study the neural mechanisms underlying the formation, recall, and extinction of contextual fear memories. As the head-fixed preparation is compatible with multi-photon microscopy and holographic stimulation, it enables long-term tracking and manipulation of cells throughout distinct memory stages and provides subcellular resolution for investigating axonal, dendritic, and synaptic dynamics in real-time.

Classification of psychedelics and psychoactive drugs based on brain-wide imaging of cellular c-Fos expression

Psilocybin, ketamine, and MDMA are psychoactive compounds that exert behavioral effects with distinguishable but also overlapping features. The growing interest in using these compounds as therapeutics necessitates preclinical assays that can accurately screen psychedelics and related analogs. We posit that a promising approach may be to measure drug action on markers of neural plasticity in native brain tissues. We therefore developed a pipeline for drug classification using light sheet fluorescence microscopy of immediate early gene expression at cellular resolution followed by machine learning. We tested male and female mice with a panel of drugs, including psilocybin, ketamine, 5-MeO-DMT, 6-fluoro-DET, MDMA, acute fluoxetine, chronic fluoxetine, and vehicle. In one-versus-rest classification, the exact drug was identified with 67% accuracy, significantly above the chance level of 12.5%. In one-versus-one classifications, psilocybin was discriminated from 5-MeO-DMT, ketamine, MDMA, or acute fluoxetine with >95% accuracy. We used Shapley additive explanation to pinpoint the brain regions driving the machine learning predictions. Our results support a novel approach for characterizing and validating psychoactive drugs with psychedelic properties.

Quantifying spontaneous infant movements using state-space models

Over the first few months after birth, the typical emergence of spontaneous, fidgety general movements is associated with later developmental outcomes. In contrast, the absence of fidgety movements is a core feature of several neurodevelopmental and cognitive disorders. Currently, manual assessment of early infant movement patterns is time consuming and labour intensive, limiting its wider use. Recent advances in computer vision and deep learning have led to the emergence of pose estimation techniques, computational methods designed to locate and track body points from video without specialised equipment or markers, for movement tracking. In this study, we use automated markerless tracking of infant body parts to build statistical models of early movements. Using a dataset of infant movement videos (n = 486) from 330 infants we demonstrate that infant movement can be modelled as a sequence of eight motor states using autoregressive, state-space models. Each, motor state Is characterised by specific body part movements, the expression of which varies with age and differs in infants at high-risk of poor neurodevelopmental outcome.

Uncovering multiscale structure in the variability of larval zebrafish navigation

Animals chain movements into long-lived motor strategies, exhibiting variability across scales that reflects the interplay between internal states and environmental cues. To reveal structure in such variability, we build Markov models of movement sequences that bridge across timescales and enable a quantitative comparison of behavioral phenotypes among individuals. Applied to larval zebrafish responding to diverse sensory cues, we uncover a hierarchy of long-lived motor strategies, dominated by changes in orientation distinguishing cruising versus wandering strategies. Environmental cues induce preferences along these modes at the population level: while fish cruise in the light, they wander in response to aversive stimuli, or in search for appetitive prey. As our method encodes the behavioral dynamics of each individual fish in the transitions among coarse-grained motor strategies, we use it to uncover a hierarchical structure in the phenotypic variability that reflects exploration-exploitation trade-offs. Across a wide range of sensory cues, a major source of variation among fish is driven by prior and/or immediate exposure to prey that induces exploitation phenotypes. A large degree of variability that is not explained by environmental cues unravels hidden states that override the sensory context to induce contrasting exploration-exploitation phenotypes. Altogether, by extracting the timescales of motor strategies deployed during navigation, our approach exposes structure among individuals and reveals internal states tuned by prior experience.

Characterizing Behavioral Dynamics in Bipolar Disorder with Computational Ethology

New technologies for the quantification of behavior have revolutionized animal studies in social, cognitive, and pharmacological neurosciences. However, comparable studies in understanding human behavior, especially in psychiatry, are lacking. In this study, we utilized data-driven machine learning to analyze natural, spontaneous open-field human behaviors from people with euthymic bipolar disorder (BD) and non-BD participants. Our computational paradigm identified representations of distinct sets of actions (motifs) that capture the physical activities of both groups of participants. We propose novel measures for quantifying dynamics, variability, and stereotypy in BD behaviors. These fine-grained behavioral features reflect patterns of cognitive functions of BD and better predict BD compared with traditional ethological and psychiatric measures and action recognition approaches. This research represents a significant computational advancement in human ethology, enabling the quantification of complex behaviors in real-world conditions and opening new avenues for characterizing neuropsychiatric conditions from behavior.

Modeling Complex Animal Behavior with Latent State Inverse Reinforcement Learning

Understanding complex animal behavior is crucial for linking brain computation to observed actions. While recent research has shifted towards modeling behavior as a dynamic process, few approaches exist for modeling long-term, naturalistic behaviors such as navigation. We introduce discrete Dynamical Inverse Reinforcement Learning (dDIRL), a latent state-dependent paradigm for modeling complex animal behavior over extended periods. dDIRL models animal behavior as being driven by internal state-specific rewards, with Markovian transitions between the distinct internal states. Using expectation-maximization, we infer reward functions corresponding to each internal states and the transition probabilities between them, from observed behavior. We applied dDIRL to water-starved mice navigating a labyrinth, analyzing each animal individually. Our results reveal three distinct internal states sufficient to describe behavior, including a consistent water-seeking state occupied for less than half the time. We also identified two clusters of animals with different exploration patterns in the labyrinth. dDIRL offers a nuanced understanding of how internal states and their associated rewards shape observed behavior in complex environments, paving the way for deeper insights into the neural basis of naturalistic behavior.

Hunger modulates exploration through suppression of dopamine signaling in the tail of striatum

Caloric depletion leads to behavioral changes that help an animal find food and restore its homeostatic balance. Hunger increases exploration and risk-taking behavior, allowing an animal to forage for food despite risks; however, the neural circuitry underlying this change is unknown. Here, we characterize how hunger restructures an animal's spontaneous behavior as well as its directed exploration of a novel object. We show that hunger-induced changes in exploration are accompanied by and result from modulation of dopamine signaling in the tail of the striatum (TOS). Dopamine signaling in the TOS is modulated by internal hunger state through the activity of agouti-related peptide (AgRP) neurons, putative "hunger neurons" in the arcuate nucleus of the hypothalamus. These AgRP neurons are poly-synaptically connected to TOS-projecting dopaminergic neurons through the lateral hypothalamus, the central amygdala, and the periaqueductal grey. We thus delineate a hypothalamic-midbrain circuit that coordinates changes in exploration behavior in the hungry state.

Multiparametric Assays Capture Sex- and Environment-Dependent Modifiers of Behavioral Phenotypes in Autism Mouse Models

Background

Current phenotyping approaches for murine autism models often focus on one selected behavioral feature, making the translation onto a spectrum of autistic characteristics in humans challenging. Furthermore, sex and environmental factors are rarely considered. Here, we aimed to capture the full spectrum of behavioral manifestations in 3 autism mouse models to develop a "behavioral fingerprint" that takes environmental and sex influences under consideration.

Methods

To this end, we employed a wide range of classical standardized behavioral tests and 2 multiparametric behavioral assays-the Live Mouse Tracker and Motion Sequencing-on male and female Shank2, Tsc1, and Purkinje cell-specific Tsc1 mutant mice raised in standard or enriched environments. Our aim was to integrate our high dimensional data into one single platform to classify differences in all experimental groups along dimensions with maximum discriminative power.

Results

Multiparametric behavioral assays enabled a more accurate classification of experimental groups than classical tests, and dimensionality reduction analysis demonstrated significant additional gains in classification accuracy, highlighting the presence of sex, environmental, and genotype differences in our experimental groups.

Conclusions

Together, our results provide a complete phenotypic description of all tested groups, suggesting that multiparametric assays can capture the entire spectrum of the heterogeneous phenotype in autism mouse models.

Characterizing the structure of mouse behavior using Motion Sequencing

Spontaneous mouse behavior is composed from repeatedly used modules of movement (e.g., rearing, running or grooming) that are flexibly placed into sequences whose content evolves over time. By identifying behavioral modules and the order in which they are expressed, researchers can gain insight into the effect of drugs, genes, context, sensory stimuli and neural activity on natural behavior. Here we present a protocol for performing Motion Sequencing (MoSeq), an ethologically inspired method that uses three-dimensional machine vision and unsupervised machine learning to decompose spontaneous mouse behavior into a series of elemental modules called 'syllables'. This protocol is based upon a MoSeq pipeline that includes modules for depth video acquisition, data preprocessing and modeling, as well as a standardized set of visualization tools. Users are provided with instructions and code for building a MoSeq imaging rig and acquiring three-dimensional video of spontaneous mouse behavior for submission to the modeling framework; the outputs of this protocol include syllable labels for each frame of the video data as well as summary plots describing how often each syllable was used and how syllables transitioned from one to the other. In addition, we provide instructions for analyzing and visualizing the outputs of keypoint-MoSeq, a recently developed variant of MoSeq that can identify behavioral motifs from keypoints identified from standard (rather than depth) video. This protocol and the accompanying pipeline significantly lower the bar for users without extensive computational ethology experience to adopt this unsupervised, data-driven approach to characterize mouse behavior.

Thyroid hormone remodels cortex to coordinate body-wide metabolism and exploration

Animals adapt to environmental conditions by modifying the function of their internal organs, including the brain. To be adaptive, alterations in behavior must be coordinated with the functional state of organs throughout the body. Here, we find that thyroid hormone-a regulator of metabolism in many peripheral organs-directly activates cell-type-specific transcriptional programs in the frontal cortex of adult male mice. These programs are enriched for axon-guidance genes in glutamatergic projection neurons, synaptic regulatory genes in both astrocytes and neurons, and pro-myelination factors in oligodendrocytes, suggesting widespread plasticity of cortical circuits. Indeed, whole-cell electrophysiology revealed that thyroid hormone alters excitatory and inhibitory synaptic transmission, an effect that requires thyroid hormone-induced gene regulatory programs in presynaptic neurons. Furthermore, thyroid hormone action in the frontal cortex regulates innate exploratory behaviors and causally promotes exploratory decision-making. Thus, thyroid hormone acts directly on the cerebral cortex in males to coordinate exploratory behaviors with whole-body metabolic state.

Dopaminergic manipulations affect the modulation and meta-modulation of movement speed: Evidence from two pharmacological interventions

A body of research implicates dopamine in the average speed of simple movements. However, naturalistic movements span a range of different shaped trajectories and rarely proceed at a single constant speed. Instead, speed is reduced when drawing "corners" compared to "straights" (i.e., speed modulation), and the extent of this slowing down is dependent upon the global shape of the movement trajectory (i.e., speed meta-modulation) - for example whether the shape is an ellipse or a rounded square. At present, it is not known how (or whether) dopaminergic function controls continuous changes in speed during movement execution. The current paper reports effects on these kinematic features of movement following two forms of dopamine manipulation: Study One highlights movement differences in individuals with PD both ON and OFF their dopaminergic medication (N = 32); Study Two highlights movement differences in individuals from the general population on haloperidol (a dopamine receptor blocker, or "antagonist") and placebo (N = 43). Evidence is presented implicating dopamine in speed, speed modulation and speed meta-modulation, whereby low dopamine conditions are associated with reductions in these variables. These findings move beyond vigour models implicating dopamine in average movement speed, and towards a conceptualisation that involves the modulation of speed as a function of contextual information.

Mapping the developmental structure of stereotyped and individual-unique behavioral spaces in C. elegans

Developmental patterns of behavior are variably organized in time and among different individuals. However, long-term behavioral diversity was previously studied using pre-defined behavioral parameters, representing a limited fraction of the full individuality structure. Here, we continuously extract ∼1.2 billion body postures of ∼2,200 single C. elegans individuals throughout their full development time to create a complete developmental atlas of stereotyped and individual-unique behavioral spaces. Unsupervised inference of low-dimensional movement modes of each single individual identifies a dynamic developmental trajectory of stereotyped behavioral spaces and exposes unique behavioral trajectories of individuals that deviate from the stereotyped patterns. Moreover, classification of behavioral spaces within tens of neuromodulatory and environmentally perturbed populations shows plasticity in the temporal structures of stereotyped behavior and individuality. These results present a comprehensive atlas of continuous behavioral dynamics across development time and a general framework for unsupervised dissection of shared and unique developmental signatures of behavior.

A Perspective on Neuroscience Data Standardization with Neurodata Without Borders

Neuroscience research has evolved to generate increasingly large and complex experimental data sets, and advanced data science tools are taking on central roles in neuroscience research. Neurodata Without Borders (NWB), a standard language for neurophysiology data, has recently emerged as a powerful solution for data management, analysis, and sharing. We here discuss our labs' efforts to implement NWB data science pipelines. We describe general principles and specific use cases that illustrate successes, challenges, and non-trivial decisions in software engineering. We hope that our experience can provide guidance for the neuroscience community and help bridge the gap between experimental neuroscience and data science. Key takeaways from this article are that (1) standardization with NWB requires non-trivial design choices; (2) the general practice of standardization in the lab promotes data awareness and literacy, and improves transparency, rigor, and reproducibility in our science; (3) we offer several feature suggestions to ease the extensibility, publishing/sharing, and usability for NWB standard and users of NWB data.

Unsupervised decomposition of natural monkey behavior into a sequence of motion motifs

Nonhuman primates (NHPs) exhibit complex and diverse behavior that typifies advanced cognitive function and social communication, but quantitative and systematical measure of this natural nonverbal processing has been a technical challenge. Specifically, a method is required to automatically segment time series of behavior into elemental motion motifs, much like finding meaningful words in character strings. Here, we propose a solution called SyntacticMotionParser (SMP), a general-purpose unsupervised behavior parsing algorithm using a nonparametric Bayesian model. Using three-dimensional posture-tracking data from NHPs, SMP automatically outputs an optimized sequence of latent motion motifs classified into the most likely number of states. When applied to behavioral datasets from common marmosets and rhesus monkeys, SMP outperformed conventional posture-clustering models and detected a set of behavioral ethograms from publicly available data. SMP also quantified and visualized the behavioral effects of chemogenetic neural manipulations. SMP thus has the potential to dramatically improve our understanding of natural NHP behavior in a variety of contexts.

AVN: A Deep Learning Approach for the Analysis of Birdsong

Deep learning tools for behavior analysis have enabled important new insights and discoveries in neuroscience. Yet, they often compromise interpretability and generalizability for performance, making it difficult to quantitively compare phenotypes across datasets and research groups. We developed a novel deep learning-based behavior analysis pipeline, Avian Vocalization Network (AVN), for the learned vocalizations of the most extensively studied vocal learning model species - the zebra finch. AVN annotates songs with high accuracy across multiple animal colonies without the need for any additional training data and generates a comprehensive set of interpretable features to describe the syntax, timing, and acoustic properties of song. We use this feature set to compare song phenotypes across multiple research groups and experiments, and to predict a bird's stage in song development. Additionally, we have developed a novel method to measure song imitation that requires no additional training data for new comparisons or recording environments, and outperforms existing similarity scoring methods in its sensitivity and agreement with expert human judgements of song similarity. These tools are available through the open-source AVN python package and graphical application, which makes them accessible to researchers without any prior coding experience. Altogether, this behavior analysis toolkit stands to facilitate and accelerate the study of vocal behavior by enabling a standardized mapping of phenotypes and learning outcomes, thus helping scientists better link behavior to the underlying neural processes.

Mouse Exploratory Behaviour in the Open Field with and without NAT-1 EEG Device: Effects of MK801 and Scopolamine

One aspect of reproducibility in preclinical research that is frequently overlooked is the physical condition in which physiological, pharmacological, or behavioural recordings are conducted. In this study, the physical conditions of mice were altered through the attachments of wireless electrophysiological recording devices (Neural Activity Tracker-1, NAT-1). NAT-1 devices are miniaturised multichannel devices with onboard memory for direct high-resolution recording of brain activity for >48 h. Such devices may limit the mobility of animals and affect their behavioural performance due to the added weight (total weight of approximately 3.4 g). The mice were additionally treated with saline (control), N-methyl-D-aspartate (NMDA) receptor antagonist MK801 (0.85 mg/kg), or the muscarinic acetylcholine receptor blocker scopolamine (0.65 mg/kg) to allow exploration of the effect of NAT-1 attachments in pharmacologically treated mice. We found only minimal differences in behavioural outcomes with NAT-1 attachments in standard parameters of locomotor activity widely reported for the open field test between the drug treatments. Hypoactivity was globally observed as a consistent outcome in the MK801-treated mice and hyperactivity in scopolamine groups regardless of NAT-1 attachments. These data collectively confirm the reproducibility for combined behavioural, pharmacological, and physiological endpoints even in the presence of lightweight wireless data loggers. The NAT-1 therefore constitutes a pertinent tool for investigating brain activity in, e.g., drug discovery and models of neuropsychiatric and/or neurodegenerative diseases with minimal effects on pharmacological and behavioural outcomes.

A novel behavioral paradigm using mice to study predictive postural control

Postural control circuitry performs the essential function of maintaining balance and body position in response to perturbations that are either self-generated (e.g. reaching to pick up an object) or externally delivered (e.g. being pushed by another person). Human studies have shown that anticipation of predictable postural disturbances can modulate such responses. This indicates that postural control could involve higher-level neural structures associated with predictive functions, rather than being purely reactive. However, the underlying neural circuitry remains largely unknown. To enable studies of predictive postural control circuits, we developed a novel task for mice. In this task, modeled after human studies, a dynamic platform generated reproducible translational perturbations. While mice stood bipedally atop a perch to receive water rewards, they experienced backward translations that were either unpredictable or preceded by an auditory cue. To validate the task, we investigated the effect of the auditory cue on postural responses to perturbations across multiple days in three mice. These preliminary results serve to validate a new postural control model, opening the door to the types of neural recordings and circuit manipulations that are currently possible only in mice.

Keypoint-MoSeq: parsing behavior by linking point tracking to pose dynamics

Keypoint tracking algorithms can flexibly quantify animal movement from videos obtained in a wide variety of settings. However, it remains unclear how to parse continuous keypoint data into discrete actions. This challenge is particularly acute because keypoint data are susceptible to high-frequency jitter that clustering algorithms can mistake for transitions between actions. Here we present keypoint-MoSeq, a machine learning-based platform for identifying behavioral modules ('syllables') from keypoint data without human supervision. Keypoint-MoSeq uses a generative model to distinguish keypoint noise from behavior, enabling it to identify syllables whose boundaries correspond to natural sub-second discontinuities in pose dynamics. Keypoint-MoSeq outperforms commonly used alternative clustering methods at identifying these transitions, at capturing correlations between neural activity and behavior and at classifying either solitary or social behaviors in accordance with human annotations. Keypoint-MoSeq also works in multiple species and generalizes beyond the syllable timescale, identifying fast sniff-aligned movements in mice and a spectrum of oscillatory behaviors in fruit flies. Keypoint-MoSeq, therefore, renders accessible the modular structure of behavior through standard video recordings.

Lightning Pose: improved animal pose estimation via semi-supervised learning, Bayesian ensembling and cloud-native open-source tools

Contemporary pose estimation methods enable precise measurements of behavior via supervised deep learning with hand-labeled video frames. Although effective in many cases, the supervised approach requires extensive labeling and often produces outputs that are unreliable for downstream analyses. Here, we introduce 'Lightning Pose', an efficient pose estimation package with three algorithmic contributions. First, in addition to training on a few labeled video frames, we use many unlabeled videos and penalize the network whenever its predictions violate motion continuity, multiple-view geometry and posture plausibility (semi-supervised learning). Second, we introduce a network architecture that resolves occlusions by predicting pose on any given frame using surrounding unlabeled frames. Third, we refine the pose predictions post hoc by combining ensembling and Kalman smoothing. Together, these components render pose trajectories more accurate and scientifically usable. We released a cloud application that allows users to label data, train networks and process new videos directly from the browser.

Open Data In Neurophysiology: Advancements, Solutions & Challenges

Across the life sciences, an ongoing effort over the last 50 years has made data and methods more reproducible and transparent. This openness has led to transformative insights and vastly accelerated scientific progress1,2. For example, structural biology3 and genomics4,5 have undertaken systematic collection and publication of protein sequences and structures over the past half-century, and these data have led to scientific breakthroughs that were unthinkable when data collection first began (e.g.6). We believe that neuroscience is poised to follow the same path, and that principles of open data and open science will transform our understanding of the nervous system in ways that are impossible to predict at the moment. To this end, new social structures along with active and open scientific communities are essential7 to facilitate and expand the still limited adoption of open science practices in our field8. Unified by shared values of openness, we set out to organize a symposium for Open Data in Neuroscience (ODIN) to strengthen our community and facilitate transformative neuroscience research at large. In this report, we share what we learned during this first ODIN event. We also lay out plans for how to grow this movement, document emerging conversations, and propose a path toward a better and more transparent science of tomorrow.

Psilocybin decreases neural responsiveness and increases functional connectivity while preserving pure-tone frequency selectivity in mouse auditory cortex

Psilocybin is a serotonergic psychedelic believed to have therapeutic potential for neuropsychiatric conditions. Despite well-documented prevalence of perceptual alterations, hallucinations, and synesthesia associated with psychedelic experiences, little is known about how psilocybin affects sensory cortex or alters the activity of neurons in awake animals. To investigate, we conducted two-photon imaging experiments in auditory cortex of awake mice and collected video of free-roaming mouse behavior, both at baseline and during psilocybin treatment. In comparison with pre-dose neural activity, a 2 mg/kg ip dose of psilocybin initially increased the amplitude of neural responses to sound. Thirty minutes post-dose, behavioral activity and neural response amplitudes decreased, yet functional connectivity increased. In contrast, control mice given intraperitoneal saline injections showed no significant changes in either neural or behavioral activity across conditions. Notably, neuronal stimulus selectivity remained stable during psilocybin treatment, for both tonotopic cortical maps and single-cell pure-tone frequency tuning curves. Our results mirror similar findings regarding the effects of serotonergic psychedelics in visual cortex and suggest that psilocybin modulates the balance of intrinsic versus stimulus-driven influences on neural activity in auditory cortex.NEW & NOTEWORTHY Recent studies have shown promising therapeutic potential for psychedelics in treating neuropsychiatric conditions. Musical experience during psilocybin-assisted therapy is predictive of treatment outcome, yet little is known about how psilocybin affects auditory processing. Here, we conducted two-photon imaging experiments in auditory cortex of awake mice that received a dose of psilocybin. Our results suggest that psilocybin modulates the roles of intrinsic neural activity versus stimulus-driven influences on auditory perception.

Reconfiguration of Behavioral Signals in the Anterior Cingulate Cortex Based on Emotional State

Behaviors and their execution depend on the context and emotional state in which they are performed. The contextual modulation of behavior likely relies on regions such as the anterior cingulate cortex (ACC) that multiplex information about emotional/autonomic states and behaviors. The objective of the present study was to understand how the representations of behaviors by ACC neurons become modified when performed in different emotional states. A pipeline of machine learning techniques was developed to categorize and classify complex, spontaneous behaviors in male rats from the video. This pipeline, termed Hierarchical Unsupervised Behavioural Discovery Tool (HUB-DT), discovered a range of statistically separable behaviors during a task in which motivationally significant outcomes were delivered in blocks of trials that created three unique "emotional contexts." HUB-DT was capable of detecting behaviors specific to each emotional context and was able to identify and segregate the portions of a neural signal related to a behavior and to emotional context. Overall, ∼10× as many neurons responded to behaviors in a contextually dependent versus a fixed manner, highlighting the extreme impact of emotional state on representations of behaviors that were precisely defined based on detailed analyses of limb kinematics. This type of modulation may be a key mechanism that allows the ACC to modify the behavioral output based on emotional states and contextual demands.

Ontogeny and social context regulate the circadian activity patterns of Lake Malawi cichlids

Activity patterns tend to be highly stereotyped and critical for executing many different behaviors including foraging, social interactions, and predator avoidance. Differences in the circadian timing of locomotor activity and rest periods can facilitate habitat partitioning and the exploitation of novel niches. As a consequence, closely related species often display highly divergent activity patterns, suggesting that shifts from diurnal to nocturnal behavior, or vice versa, are critical for survival. In Africa's Lake Malawi alone, there are over 500 species of cichlids, which inhabit diverse environments and exhibit extensive phenotypic variation. We have previously identified a substantial range in activity patterns across adult Lake Malawi cichlid species, from strongly diurnal to strongly nocturnal. In many species, including fishes, ecological pressures differ dramatically across life-history stages, raising the possibility that activity patterns may change over ontogeny. To determine if rest-activity patterns change across life stages, we compared the locomotor patterns of six Lake Malawi cichlid species. While total rest and activity did not change between early juvenile and adult stages, rest-activity patterns did, with juveniles displaying distinct activity rhythms that are more robust than adults. One distinct difference between juveniles and adults is the emergence of complex social behavior. To determine whether social context is required for activity rhythms, we next measured locomotor behavior in group-housed adult fish. We found that when normal social interactions were allowed, locomotor activity patterns were restored, supporting the notion that social interactions promote circadian regulation of activity in adult fish. These findings reveal a previously unidentified link between developmental stage and social interactions in the circadian timing of cichlid activity.

Ethological computational psychiatry: Challenges and opportunities

Studying the intricacies of individual subjects' moods and cognitive processing over extended periods of time presents a formidable challenge in medicine. While much of systems neuroscience appropriately focuses on the link between neural circuit functions and well-constrained behaviors over short timescales (e.g., trials, hours), many mental health conditions involve complex interactions of mood and cognition that are non-stationary across behavioral contexts and evolve over extended timescales. Here, we discuss opportunities, challenges, and possible future directions in computational psychiatry to quantify non-stationary continuously monitored behaviors. We suggest that this exploratory effort may contribute to a more precision-based approach to treating mental disorders and facilitate a more robust reverse translation across animal species. We conclude with ethical considerations for any field that aims to bridge artificial intelligence and patient monitoring.

Uncovering multiscale structure in the variability of larval zebrafish navigation

Animals chain movements into long-lived motor strategies, exhibiting variability across scales that reflects the interplay between internal states and environmental cues. To reveal structure in such variability, we build Markov models of movement sequences that bridges across time scales and enables a quantitative comparison of behavioral phenotypes among individuals. Applied to larval zebrafish responding to diverse sensory cues, we uncover a hierarchy of long-lived motor strategies, dominated by changes in orientation distinguishing cruising versus wandering strategies. Environmental cues induce preferences along these modes at the population level: while fish cruise in the light, they wander in response to aversive stimuli, or in search for appetitive prey. As our method encodes the behavioral dynamics of each individual fish in the transitions among coarse-grained motor strategies, we use it to uncover a hierarchical structure in the phenotypic variability that reflects exploration-exploitation trade-offs. Across a wide range of sensory cues, a major source of variation among fish is driven by prior and/or immediate exposure to prey that induces exploitation phenotypes. A large degree of variability that is not explained by environmental cues unravels motivational states that override the sensory context to induce contrasting exploration-exploitation phenotypes. Altogether, by extracting the timescales of motor strategies deployed during navigation, our approach exposes structure among individuals and reveals internal states tuned by prior experience.

Exploratory Rearing Is Governed by Hypothalamic Melanin-Concentrating Hormone Neurons According to Locus Ceruleus

Information seeking, such as standing on tiptoes to look around in humans, is observed across animals and helps survival. Its rodent analog-unsupported rearing on hind legs-was a classic model in deciphering neural signals of cognition and is of intense renewed interest in preclinical modeling of neuropsychiatric states. Neural signals and circuits controlling this dedicated decision to seek information remain largely unknown. While studying subsecond timing of spontaneous behavioral acts and activity of melanin-concentrating hormone (MCH) neurons (MNs) in behaving male and female mice, we observed large MN activity spikes that aligned to unsupported rears. Complementary causal, loss and gain of function, analyses revealed specific control of rear frequency and duration by MNs and MCHR1 receptors. Activity in a key stress center of the brain-the locus ceruleus noradrenaline cells-rapidly inhibited MNs and required functional MCH receptors for its endogenous modulation of rearing. By defining a neural module that both tracks and controls rearing, these findings may facilitate further insights into biology of information seeking.

Uncovering multiscale structure in the variability of larval zebrafish navigation

Animals chain movements into long-lived motor strategies, resulting in variability that ultimately reflects the interplay between internal states and environmental cues. To reveal structure in such variability, we build models that bridges across time scales that enable a quantitative comparison of behavioral phenotypes among individuals. Applied to larval zebrafish exposed to diverse sensory cues, we uncover a hierarchy of long-lived motor strategies, dominated by changes in orientation distinguishing cruising and wandering strategies. Environmental cues induce preferences along these modes at the population level: while fish cruise in the light, they wander in response to aversive (dark) stimuli or in search for prey. Our method enables us to encode the behavioral dynamics of each individual fish in the transitions among coarse-grained motor strategies. By doing so, we uncover a hierarchical structure to the phenotypic variability that corresponds to exploration-exploitation trade-offs. Within a wide range of sensory cues, a major source of variation among fish is driven by prior and immediate exposure to prey that induces exploitation phenotypes. However, a large degree of variability is unexplained by environmental cues, pointing to hidden states that override the sensory context to induce contrasting exploration-exploitation phenotypes. Altogether, our approach extracts the timescales of motor strategies deployed during navigation, exposing undiscovered structure among individuals and pointing to internal states tuned by prior experience.

Cntnap2 loss drives striatal neuron hyperexcitability and behavioral inflexibility

Autism spectrum disorder (ASD) is a neurodevelopmental disorder characterized by two major diagnostic criteria - persistent deficits in social communication and interaction, and the presence of restricted, repetitive patterns of behavior (RRBs). Evidence from both human and animal model studies of ASD suggest that alteration of striatal circuits, which mediate motor learning, action selection, and habit formation, may contribute to the manifestation of RRBs. CNTNAP2 is a syndromic ASD risk gene, and loss of function of Cntnap2 in mice is associated with RRBs. How loss of Cntnap2 impacts striatal neuron function is largely unknown. In this study, we utilized Cntnap2-/- mice to test whether altered striatal neuron activity contributes to aberrant motor behaviors relevant to ASD. We find that Cntnap2-/- mice exhibit increased cortical drive of striatal projection neurons (SPNs), with the most pronounced effects in direct pathway SPNs. This enhanced drive is likely due to increased intrinsic excitability of SPNs, which make them more responsive to cortical inputs. We also find that Cntnap2-/- mice exhibit spontaneous repetitive behaviors, increased motor routine learning, and cognitive inflexibility. Increased corticostriatal drive, in particular of the direct pathway, may contribute to the acquisition of repetitive, inflexible behaviors in Cntnap2 mice.

The choice-wide behavioral association study: data-driven identification of interpretable behavioral components

Behavior contains rich structure across many timescales, but there is a dearth of methods to identify relevant components, especially over the longer periods required for learning and decision-making. Inspired by the goals and techniques of genome-wide association studies, we present a data-driven method-the choice-wide behavioral association study: CBAS-that systematically identifies such behavioral features. CBAS uses a powerful, resampling-based, method of multiple comparisons correction to identify sequences of actions or choices that either differ significantly between groups or significantly correlate with a covariate of interest. We apply CBAS to different tasks and species (flies, rats, and humans) and find, in all instances, that it provides interpretable information about each behavioral task.

Multimodal sensory control of motor performance by glycinergic interneurons of the mouse spinal cord deep dorsal horn

Sensory feedback is integral for contextually appropriate motor output, yet the neural circuits responsible remain elusive. Here, we pinpoint the medial deep dorsal horn of the mouse spinal cord as a convergence point for proprioceptive and cutaneous input. Within this region, we identify a population of tonically active glycinergic inhibitory neurons expressing parvalbumin. Using anatomy and electrophysiology, we demonstrate that deep dorsal horn parvalbumin-expressing interneuron (dPV) activity is shaped by convergent proprioceptive, cutaneous, and descending input. Selectively targeting spinal dPVs, we reveal their widespread ipsilateral inhibition onto pre-motor and motor networks and demonstrate their role in gating sensory-evoked muscle activity using electromyography (EMG) recordings. dPV ablation altered limb kinematics and step-cycle timing during treadmill locomotion and reduced the transitions between sub-movements during spontaneous behavior. These findings reveal a circuit basis by which sensory convergence onto dorsal horn inhibitory neurons modulates motor output to facilitate smooth movement and context-appropriate transitions.

Lightning Pose: improved animal pose estimation via semi-supervised learning, Bayesian ensembling, and cloud-native open-source tools

Contemporary pose estimation methods enable precise measurements of behavior via supervised deep learning with hand-labeled video frames. Although effective in many cases, the supervised approach requires extensive labeling and often produces outputs that are unreliable for downstream analyses. Here, we introduce "Lightning Pose," an efficient pose estimation package with three algorithmic contributions. First, in addition to training on a few labeled video frames, we use many unlabeled videos and penalize the network whenever its predictions violate motion continuity, multiple-view geometry, and posture plausibility (semi-supervised learning). Second, we introduce a network architecture that resolves occlusions by predicting pose on any given frame using surrounding unlabeled frames. Third, we refine the pose predictions post-hoc by combining ensembling and Kalman smoothing. Together, these components render pose trajectories more accurate and scientifically usable. We release a cloud application that allows users to label data, train networks, and predict new videos directly from the browser.

Rodent tests of depression and anxiety: Construct validity and translational relevance

Behavioral testing constitutes the primary method to measure the emotional states of nonhuman animals in preclinical research. Emerging as the characteristic tool of the behaviorist school of psychology, behavioral testing of animals, particularly rodents, is employed to understand the complex cognitive and affective symptoms of neuropsychiatric disorders. Following the symptom-based diagnosis model of the DSM, rodent models and tests of depression and anxiety focus on behavioral patterns that resemble the superficial symptoms of these disorders. While these practices provided researchers with a platform to screen novel antidepressant and anxiolytic drug candidates, their construct validity-involving relevant underlying mechanisms-has been questioned. In this review, we present the laboratory procedures used to assess depressive- and anxiety-like behaviors in rats and mice. These include constructs that rely on stress-triggered responses, such as behavioral despair, and those that emerge with nonaversive training, such as cognitive bias. We describe the specific behavioral tests that are used to assess these constructs and discuss the criticisms on their theoretical background. We review specific concerns about the construct validity and translational relevance of individual behavioral tests, outline the limitations of the traditional, symptom-based interpretation, and introduce novel, ethologically relevant frameworks that emphasize simple behavioral patterns. Finally, we explore behavioral monitoring and morphological analysis methods that can be integrated into behavioral testing and discuss how they can enhance the construct validity of these tests.

Multidimensional Analysis of a Social Behavior Identifies Regression and Phenotypic Heterogeneity in a Female Mouse Model for Rett Syndrome

Regression is a key feature of neurodevelopmental disorders such as autism spectrum disorder, Fragile X syndrome, and Rett syndrome (RTT). RTT is caused by mutations in the X-linked gene methyl-CpG-binding protein 2 (MECP2). It is characterized by an early period of typical development with subsequent regression of previously acquired motor and speech skills in girls. The syndromic phenotypes are individualistic and dynamic over time. Thus far, it has been difficult to capture these dynamics and syndromic heterogeneity in the preclinical Mecp2-heterozygous female mouse model (Het). The emergence of computational neuroethology tools allows for robust analysis of complex and dynamic behaviors to model endophenotypes in preclinical models. Toward this first step, we utilized DeepLabCut, a marker-less pose estimation software to quantify trajectory kinematics and multidimensional analysis to characterize behavioral heterogeneity in Het in the previously benchmarked, ethologically relevant social cognition task of pup retrieval. We report the identification of two distinct phenotypes of adult Het: Het that display a delay in efficiency in early days and then improve over days like wild-type mice and Het that regress and perform worse in later days. Furthermore, regression is dependent on age and behavioral context and can be detected in the initial days of retrieval. Together, the novel identification of two populations of Het suggests differential effects on neural circuitry, opens new avenues to investigate the underlying molecular and cellular mechanisms of heterogeneity, and designs better studies for stratifying therapeutics.

FABEL: Forecasting Animal Behavioral Events with Deep Learning-Based Computer Vision

Behavioral neuroscience aims to provide a connection between neural phenomena and emergent organism-level behaviors. This requires perturbing the nervous system and observing behavioral outcomes, and comparing observed post-perturbation behavior with predicted counterfactual behavior and therefore accurate behavioral forecasts. In this study we present FABEL, a deep learning method for forecasting future animal behaviors and locomotion trajectories from historical locomotion alone. We train an offline pose estimation network to predict animal body-part locations in behavioral video; then sequences of pose vectors are input to deep learning time-series forecasting models. Specifically, we train an LSTM network that predicts a future food interaction event in a specified time window, and a Temporal Fusion Transformer that predicts future trajectories of animal body-parts, which are then converted into probabilistic label forecasts. Importantly, accurate prediction of food interaction provides a basis for neurobehavioral intervention in the context of compulsive eating. We show promising results on forecasting tasks between 100 milliseconds and 5 seconds timescales. Because the model takes only behavioral video as input, it can be adapted to any behavioral task and does not require specific physiological readouts. Simultaneously, these deep learning models may serve as extensible modules that can accommodate diverse signals, such as in-vivo fluorescence imaging and electrophysiology, which may improve behavior forecasts and elucidate invervention targets for desired behavioral change.

Development of a 3D tracking system for multiple marmosets under free-moving conditions

Assessment of social interactions and behavioral changes in nonhuman primates is useful for understanding brain function changes during life events and pathogenesis of neurological diseases. The common marmoset (Callithrix jacchus), which lives in a nuclear family like humans, is a useful model, but longitudinal automated behavioral observation of multiple animals has not been achieved. Here, we developed a Full Monitoring and Animal Identification (FulMAI) system for longitudinal detection of three-dimensional (3D) trajectories of each individual in multiple marmosets under free-moving conditions by combining video tracking, Light Detection and Ranging, and deep learning. Using this system, identification of each animal was more than 97% accurate. Location preferences and inter-individual distance could be calculated, and deep learning could detect grooming behavior. The FulMAI system allows us to analyze the natural behavior of individuals in a family over their lifetime and understand how behavior changes due to life events together with other data.

A comparison of machine learning methods for quantifying self-grooming behavior in mice

Background

As machine learning technology continues to advance and the need for standardized behavioral quantification grows, commercial and open-source automated behavioral analysis tools are gaining prominence in behavioral neuroscience. We present a comparative analysis of three behavioral analysis pipelines-DeepLabCut (DLC) and Simple Behavioral Analysis (SimBA), HomeCageScan (HCS), and manual scoring-in measuring repetitive self-grooming among mice.

Methods

Grooming behavior of mice was recorded at baseline and after water spray or restraint treatments. Videos were processed and analyzed in parallel using 3 methods (DLC/SimBA, HCS, and manual scoring), quantifying both total number of grooming bouts and total grooming duration.

Results

Both treatment conditions (water spray and restraint) resulted in significant elevation in both total grooming duration and number of grooming bouts. HCS measures of grooming duration were significantly elevated relative to those derived from manual scoring: specifically, HCS tended to overestimate duration at low levels of grooming. DLC/SimBA duration measurements were not significantly different than those derived from manual scoring. However, both SimBA and HCS measures of the number of grooming bouts were significantly different than those derived from manual scoring; the magnitude and direction of the difference depended on treatment condition.

Conclusion

DLC/SimBA provides a high-throughput pipeline for quantifying grooming duration that correlates well with manual scoring. However, grooming bout data derived from both DLC/SimBA and HCS did not reliably estimate measures obtained via manual scoring.

Inferring neural dynamics of memory during naturalistic social communication

Memory processes in complex behaviors like social communication require forming representations of the past that grow with time. The neural mechanisms that support such continually growing memory remain unknown. We address this gap in the context of fly courtship, a natural social behavior involving the production and perception of long, complex song sequences. To study female memory for male song history in unrestrained courtship, we present 'Natural Continuation' (NC)-a general, simulation-based model comparison procedure to evaluate candidate neural codes for complex stimuli using naturalistic behavioral data. Applying NC to fly courtship revealed strong evidence for an adaptive population mechanism for how female auditory neural dynamics could convert long song histories into a rich mnemonic format. Song temporal patterning is continually transformed by heterogeneous nonlinear adaptation dynamics, then integrated into persistent activity, enabling common neural mechanisms to retain continuously unfolding information over long periods and yielding state-of-the-art predictions of female courtship behavior. At a population level this coding model produces multi-dimensional advection-diffusion-like responses that separate songs over a continuum of timescales and can be linearly transformed into flexible output signals, illustrating its potential to create a generic, scalable mnemonic format for extended input signals poised to drive complex behavioral responses. This work thus shows how naturalistic behavior can directly inform neural population coding models, revealing here a novel process for memory formation.

Hippocampal Engrams Generate Variable Behavioral Responses and Brain-Wide Network States

Freezing is a defensive behavior commonly examined during hippocampal-mediated fear engram reactivation. How these cellular populations engage the brain and modulate freezing across varying environmental demands is unclear. To address this, we optogenetically reactivated a fear engram in the dentate gyrus subregion of the hippocampus across three distinct contexts in male mice. We found that there were differential amounts of light-induced freezing depending on the size of the context in which reactivation occurred: mice demonstrated robust light-induced freezing in the most spatially restricted of the three contexts but not in the largest. We then utilized graph theoretical analyses to identify brain-wide alterations in cFos expression during engram reactivation across the smallest and largest contexts. Our manipulations induced positive interregional cFos correlations that were not observed in control conditions. Additionally, regions spanning putative "fear" and "defense" systems were recruited as hub regions in engram reactivation networks. Lastly, we compared the network generated from engram reactivation in the small context with a natural fear memory retrieval network. Here, we found shared characteristics such as modular composition and hub regions. By identifying and manipulating the circuits supporting memory function, as well as their corresponding brain-wide activity patterns, it is thereby possible to resolve systems-level biological mechanisms mediating memory's capacity to modulate behavioral states.

Keypoint-MoSeq: parsing behavior by linking point tracking to pose dynamics

Keypoint tracking algorithms have revolutionized the analysis of animal behavior, enabling investigators to flexibly quantify behavioral dynamics from conventional video recordings obtained in a wide variety of settings. However, it remains unclear how to parse continuous keypoint data into the modules out of which behavior is organized. This challenge is particularly acute because keypoint data is susceptible to high frequency jitter that clustering algorithms can mistake for transitions between behavioral modules. Here we present keypoint-MoSeq, a machine learning-based platform for identifying behavioral modules ("syllables") from keypoint data without human supervision. Keypoint-MoSeq uses a generative model to distinguish keypoint noise from behavior, enabling it to effectively identify syllables whose boundaries correspond to natural sub-second discontinuities inherent to mouse behavior. Keypoint-MoSeq outperforms commonly used alternative clustering methods at identifying these transitions, at capturing correlations between neural activity and behavior, and at classifying either solitary or social behaviors in accordance with human annotations. Keypoint-MoSeq therefore renders behavioral syllables and grammar accessible to the many researchers who use standard video to capture animal behavior.

Myomatrix arrays for high-definition muscle recording

Neurons coordinate their activity to produce an astonishing variety of motor behaviors. Our present understanding of motor control has grown rapidly thanks to new methods for recording and analyzing populations of many individual neurons over time. In contrast, current methods for recording the nervous system's actual motor output - the activation of muscle fibers by motor neurons - typically cannot detect the individual electrical events produced by muscle fibers during natural behaviors and scale poorly across species and muscle groups. Here we present a novel class of electrode devices ('Myomatrix arrays') that record muscle activity at unprecedented resolution across muscles and behaviors. High-density, flexible electrode arrays allow for stable recordings from the muscle fibers activated by a single motor neuron, called a 'motor unit,' during natural behaviors in many species, including mice, rats, primates, songbirds, frogs, and insects. This technology therefore allows the nervous system's motor output to be monitored in unprecedented detail during complex behaviors across species and muscle morphologies. We anticipate that this technology will allow rapid advances in understanding the neural control of behavior and identifying pathologies of the motor system.

OpenApePose, a database of annotated ape photographs for pose estimation

Because of their close relationship with humans, non-human apes (chimpanzees, bonobos, gorillas, orangutans, and gibbons, including siamangs) are of great scientific interest. The goal of understanding their complex behavior would be greatly advanced by the ability to perform video-based pose tracking. Tracking, however, requires high-quality annotated datasets of ape photographs. Here we present OpenApePose, a new public dataset of 71,868 photographs, annotated with 16 body landmarks of six ape species in naturalistic contexts. We show that a standard deep net (HRNet-W48) trained on ape photos can reliably track out-of-sample ape photos better than networks trained on monkeys (specifically, the OpenMonkeyPose dataset) and on humans (COCO) can. This trained network can track apes almost as well as the other networks can track their respective taxa, and models trained without one of the six ape species can track the held-out species better than the monkey and human models can. Ultimately, the results of our analyses highlight the importance of large, specialized databases for animal tracking systems and confirm the utility of our new ape database.

SaLSa: A Combinatory Approach of Semi-Automatic Labeling and Long Short-Term Memory to Classify Behavioral Syllables

Accurately and quantitatively describing mouse behavior is an important area. Although advances in machine learning have made it possible to track their behaviors accurately, reliable classification of behavioral sequences or syllables remains a challenge. In this study, we present a novel machine learning approach, called SaLSa (a combination of semi-automatic labeling and long short-term memory-based classification), to classify behavioral syllables of mice exploring an open field. This approach consists of two major steps. First, after tracking multiple body parts, spatial and temporal features of their egocentric coordinates are extracted. A fully automated unsupervised process identifies candidates for behavioral syllables, followed by manual labeling of behavioral syllables using a graphical user interface (GUI). Second, a long short-term memory (LSTM) classifier is trained with the labeled data. We found that the classification performance was marked over 97%. It provides a performance equivalent to a state-of-the-art model while classifying some of the syllables. We applied this approach to examine how hyperactivity in a mouse model of Alzheimer's disease develops with age. When the proportion of each behavioral syllable was compared between genotypes and sexes, we found that the characteristic hyperlocomotion of female Alzheimer's disease mice emerges between four and eight months. In contrast, age-related reduction in rearing is common regardless of genotype and sex. Overall, SaLSa enables detailed characterization of mouse behavior.