A Matlab-based toolbox for characterizing behavior of rodents engaged in string-pulling

Oppositions, joints, and targets: the attractors that are the glue of social interactions

Social interactions are often analyzed by scoring segments of predefined behavior and then statistically assessing numerical and sequential patterns to identify the structure of the encounters. However, this approach can miss the dynamics of the animals' relationship over the course of the encounter, one that often involves invariant bonds, say a nose-to-nose orientation, with many different movements performed by both partners acting to counteract each other's attempts to break or maintain the relationship. Moreover, these invariant bonds can switch from one configuration to another during an interaction, leading from one stable configuration to another. It is this stepwise sequence of configurational stabilities that lead to functional outcomes, such as mating, aggression, or predation. By focusing on the sequence of invariant relational configurations, the deep structure of interactions can be discerned. This deep structure can then be used to differentiate between compensatory movements, no matter how seemingly stereotyped they may appear, from movement patterns which are restricted to a particular form when more than one option is available. A dynamic perspective requires suitable tools for analysis, and such tools are highlighted as needed in describing particular interactions.

Aberrant cortical activity, functional connectivity, and neural assembly architecture after photothrombotic stroke in mice

Despite substantial progress in mapping the trajectory of network plasticity resulting from focal ischemic stroke, the extent and nature of changes in neuronal excitability and activity within the peri-infarct cortex of mice remains poorly defined. Most of the available data have been acquired from anesthetized animals, acute tissue slices, or infer changes in excitability from immunoassays on extracted tissue, and thus may not reflect cortical activity dynamics in the intact cortex of an awake animal. Here, in vivo two-photon calcium imaging in awake, behaving mice was used to longitudinally track cortical activity, network functional connectivity, and neural assembly architecture for 2 months following photothrombotic stroke targeting the forelimb somatosensory cortex. Sensorimotor recovery was tracked over the weeks following stroke, allowing us to relate network changes to behavior. Our data revealed spatially restricted but long-lasting alterations in somatosensory neural network function and connectivity. Specifically, we demonstrate significant and long-lasting disruptions in neural assembly architecture concurrent with a deficit in functional connectivity between individual neurons. Reductions in neuronal spiking in peri-infarct cortex were transient but predictive of impairment in skilled locomotion measured in the tapered beam task. Notably, altered neural networks were highly localized, with assembly architecture and neural connectivity relatively unaltered a short distance from the peri-infarct cortex, even in regions within 'remapped' forelimb functional representations identified using mesoscale imaging with anaesthetized preparations 8 weeks after stroke. Thus, using longitudinal two-photon microscopy in awake animals, these data show a complex spatiotemporal relationship between peri-infarct neuronal network function and behavioral recovery. Moreover, the data highlight an apparent disconnect between dramatic functional remapping identified using strong sensory stimulation in anaesthetized mice compared to more subtle and spatially restricted changes in individual neuron and local network function in awake mice during stroke recovery.

Information-theory analysis of mouse string-pulling agrees with Fitts's Law: Increasing task difficulty engages multiple sensorimotor modalities in a dual oscillator behavior

Mouse string pulling, in which a mouse reels in a string with hand-over-hand movements, can provide insights into skilled motor behavior, neurological status, and cognitive function. The task involves two oscillatory movements connected by a string. The snout oscillates to track the pendulum movement of the string produced by hand-over-hand oscillations of pulling, and so the snout guides the hands to grasp the string. The present study examines the allocation of time required to pull strings of varying diameter. Movement is also described with end-point measures, string-pulling topography with 2D markerless pose estimates based on transfer learning with deep neural networks, and Mat-lab image-segmentation and heuristic algorithms for object tracking. With reduced string diameter, mice took longer to pull 60 cm long strings. They also made more pulling cycles, misses, and mouth engagements, and displayed changes in the amplitude and frequency of pull cycles. The time measures agree with Fitts's law in showing that increased task difficulty slows behavior and engages multiple compensatory sensorimotor modalities. The analysis reveals that time is a valuable resource in skilled motor behavior and information-theory can serve as a measure of its effective use.

Automated system for training and assessing reaching and grasping behaviors in rodents

BACKGROUND

Reaching, grasping, and pulling behaviors are studied across species to investigate motor control and problem solving. String pulling is a distinct reaching and grasping behavior that is rapidly learned, requires bimanual coordination, is ethologically grounded, and has been applied across species and disease conditions.

NEW METHOD

Here we describe the PANDA system (Pulling And Neural Data Analysis), a hardware and software system that integrates a continuous string loop connected to a rotary encoder, feeder, microcontroller, high-speed camera, and analysis software for the assessment and training of reaching, grasping, and pulling behaviors and synchronization with neural data.

RESULTS

We demonstrate this system in rats implanted with electrodes in motor cortex and hippocampus and show how it can be used to assess relationships between reaching, pulling, and grasping movements and single-unit and local-field activity. Furthermore, we found that automating the shaping procedure significantly improved performance over manual training, with rats pulling > 100 m during a 15-minute session.

COMPARISON WITH EXISTING METHODS

String-pulling is typically shaped by tying food reward to the string and visually scoring behavior. The system described here automates training, streamlines video assessment with deep learning, and automatically segments reaching movements into distinct reach/pull phases. No system, to our knowledge, exists for the automated shaping and assessment of this behavior.

CONCLUSIONS

This system will be of general use to researchers investigating motor control, motivation, sensorimotor integration, and motor disorders such as Parkinson's disease and stroke.

Artificial intelligence in epilepsy phenotyping

Artificial intelligence (AI) allows data analysis and integration at an unprecedented granularity and scale. Here we review the technological advances, challenges, and future perspectives of using AI for electro-clinical phenotyping of animal models and patients with epilepsy. In translational research, AI models accurately identify behavioral states in animal models of epilepsy, allowing identification of correlations between neural activity and interictal and ictal behavior. Clinical applications of AI-based automated and semi-automated analysis of audio and video recordings of people with epilepsy, allow significant data reduction and reliable detection and classification of major motor seizures. AI models can accurately identify electrographic biomarkers of epilepsy, such as spikes, high-frequency oscillations, and seizure patterns. Integrating AI analysis of electroencephalographic, clinical, and behavioral data will contribute to optimizing therapy for patients with epilepsy.

Beyond simple laboratory studies: Developing sophisticated models to study rich behavior

Psychology and neuroscience are concerned with the study of behavior, of internal cognitive processes, and their neural foundations. However, most laboratory studies use constrained experimental settings that greatly limit the range of behaviors that can be expressed. While focusing on restricted settings ensures methodological control, it risks impoverishing the object of study: by restricting behavior, we might miss key aspects of cognitive and neural functions. In this article, we argue that psychology and neuroscience should increasingly adopt innovative experimental designs, measurement methods, analysis techniques and sophisticated computational models to probe rich, ecologically valid forms of behavior, including social behavior. We discuss the challenges of studying rich forms of behavior as well as the novel opportunities offered by state-of-the-art methodologies and new sensing technologies, and we highlight the importance of developing sophisticated formal models. We exemplify our arguments by reviewing some recent streams of research in psychology, neuroscience and other fields (e.g., sports analytics, ethology and robotics) that have addressed rich forms of behavior in a model-based manner. We hope that these "success cases" will encourage psychologists and neuroscientists to extend their toolbox of techniques with sophisticated behavioral models - and to use them to study rich forms of behavior as well as the cognitive and neural processes that they engage.

Automated system for training and assessing string-pulling behaviors in rodents

String-pulling tasks have been used for centuries to study coordinated bimanual motor behavior and problem solving. String pulling is rapidly learned, ethologically grounded, and has been applied to many species and disease conditions. Typically, training of string-pulling behaviors is achieved through manual shaping and baiting. Furthermore, behavioral assessment of reaching, grasping, and pulling is often performed through labor intensive manual video scoring. No system, to our knowledge, currently exists for the automated shaping and assessment of string-pulling behaviors. Here we describe the PANDA system (Pulling And Neural Data Analysis), an inexpensive hardware and software system that utilizes a continuous string loop connected to a rotary encoder, feeder, microcontroller, high-speed camera, and analysis software for assessment and training of string-pulling behaviors and synchronization with neural recording data. We demonstrate this system in unimplanted rats and rats implanted with electrodes in motor cortex and hippocampus and show how the PANDA system can be used to assess relationships between paw movements and single-unit and local-field activity. We also found that automating the shaping procedure significantly improved overall performance, with rats regularly pulling >100 meters during a 15-minute session. In conclusion, the PANDA system will be of general use to researchers investigating motor control, motivation, and motor disorders such as Parkinson's disease, Huntington's disease, and stroke. It will also support the investigation of neural mechanisms involved in sensorimotor integration.

Deep learning-based behavioral profiling of rodent stroke recovery

BACKGROUND

Stroke research heavily relies on rodent behavior when assessing underlying disease mechanisms and treatment efficacy. Although functional motor recovery is considered the primary targeted outcome, tests in rodents are still poorly reproducible and often unsuitable for unraveling the complex behavior after injury.

RESULTS

Here, we provide a comprehensive 3D gait analysis of mice after focal cerebral ischemia based on the new deep learning-based software (DeepLabCut, DLC) that only requires basic behavioral equipment. We demonstrate a high precision 3D tracking of 10 body parts (including all relevant joints and reference landmarks) in several mouse strains. Building on this rigor motion tracking, a comprehensive post-analysis (with >100 parameters) unveils biologically relevant differences in locomotor profiles after a stroke over a time course of 3 weeks. We further refine the widely used ladder rung test using deep learning and compare its performance to human annotators. The generated DLC-assisted tests were then benchmarked to five widely used conventional behavioral set-ups (neurological scoring, rotarod, ladder rung walk, cylinder test, and single-pellet grasping) regarding sensitivity, accuracy, time use, and costs.

CONCLUSIONS

We conclude that deep learning-based motion tracking with comprehensive post-analysis provides accurate and sensitive data to describe the complex recovery of rodents following a stroke. The experimental set-up and analysis can also benefit a range of other neurological injuries that affect locomotion.

Multidimensional analysis of behavior predicts genotype with high accuracy in a mouse model of Angelman syndrome

Angelman syndrome (AS) is a neurodevelopmental disorder caused by loss of expression of the maternal copy of the UBE3A gene. Individuals with AS have a multifaceted behavioral phenotype consisting of deficits in motor function, epilepsy, cognitive impairment, sleep abnormalities, as well as other comorbidities. Effectively modeling this behavioral profile and measuring behavioral improvement will be crucial for the success of ongoing and future clinical trials. Foundational studies have defined an array of behavioral phenotypes in the AS mouse model. However, no single behavioral test is able to fully capture the complex nature of AS-in mice, or in children. We performed multidimensional analysis (principal component analysis + k-means clustering) to quantify the performance of AS model mice (n = 148) and wild-type littermates (n = 138) across eight behavioral domains. This approach correctly predicted the genotype of mice based on their behavioral profile with ~95% accuracy, and remained effective with reasonable sample sizes (n = ~12-15). Multidimensional analysis was effective using different combinations of behavioral inputs and was able to detect behavioral improvement as a function of treatment in AS model mice. Overall, multidimensional behavioral analysis provides a tool for evaluating the effectiveness of preclinical treatments for AS. Multidimensional analysis of behavior may also be applied to rodent models of related neurodevelopmental disorders, and may be particularly valuable for disorders where individual behavioral tests are less reliable than in AS.

Inertial Measurement of Head Tilt in Rodents: Principles and Applications to Vestibular Research

Inertial sensors are increasingly used in rodent research, in particular for estimating head orientation relative to gravity, or head tilt. Despite this growing interest, the accuracy of tilt estimates computed from rodent head inertial data has never been assessed. Using readily available inertial measurement units mounted onto the head of freely moving rats, we benchmarked a set of tilt estimation methods against concurrent 3D optical motion capture. We show that, while low-pass filtered head acceleration signals only provided reliable tilt estimates in static conditions, sensor calibration combined with an appropriate choice of orientation filter and parameters could yield average tilt estimation errors below 1.5∘ during movement. We then illustrate an application of inertial head tilt measurements in a preclinical rat model of unilateral vestibular lesion and propose a set of metrics describing the severity of associated postural and motor symptoms and the time course of recovery. We conclude that headborne inertial sensors are an attractive tool for quantitative rodent behavioral analysis in general and for the study of vestibulo-postural functions in particular.

Automation of training and testing motor and related tasks in pre-clinical behavioural and rehabilitative neuroscience

Testing and training animals in motor and related tasks is a cornerstone of pre-clinical behavioural and rehabilitative neuroscience. Yet manually testing and training animals in these tasks is time consuming and analyses are often subjective. Consequently, there have been many recent advances in automating both the administration and analyses of animal behavioural training and testing. This review is an in-depth appraisal of the history of, and recent developments in, the automation of animal behavioural assays used in neuroscience. We describe the use of common locomotor and non-locomotor tasks used for motor training and testing before and after nervous system injury. This includes a discussion of how these tasks help us to understand the underlying mechanisms of neurological repair and the utility of some tasks for the delivery of rehabilitative training to enhance recovery. We propose two general approaches to automation: automating the physical administration of behavioural tasks (i.e., devices used to facilitate task training, rehabilitative training, and motor testing) and leveraging the use of machine learning in behaviour analysis to generate large volumes of unbiased and comprehensive data. The advantages and disadvantages of automating various motor tasks as well as the limitations of machine learning analyses are examined. In closing, we provide a critical appraisal of the current state of automation in animal behavioural neuroscience and a prospective on some of the advances in machine learning we believe will dramatically enhance the usefulness of these approaches for behavioural neuroscientists.

Skilled movement and posture deficits in rat string-pulling behavior following low dose space radiation (28Si) exposure

Deep space flight missions beyond the Van Allen belt have the potential to expose astronauts to space radiation which may damage the central nervous system and impair function. The proposed mission to Mars will be the longest mission-to-date and identifying mission critical tasks that are sensitive to space radiation is important for developing and evaluating the efficacy of counter measures. Fine motor control has been assessed in humans, rats, and many other species using string-pulling behavior. For example, focal cortical damage has been previously shown to disrupt the topographic (i.e., path circuity) and kinematic (i.e., moment-to-moment speed) organization of rat string-pulling behavior count to compromise task accuracy. In the current study, rats were exposed to a ground-based model of simulated space radiation (5 cGy ²⁸Silicon), and string-pulling behavior was used to assess fine motor control. Irradiated rats initially took longer to pull an unweighted string into a cage, exhibited impaired accuracy in grasping the string, and displayed postural deficits. Once rats were switched to a weighted string, some deficits lessened but postural instability remained. These results demonstrate that a single exposure to a low dose of space radiation disrupts skilled hand movements and posture, suggestive of neural impairment. This work establishes a foundation for future studies to investigate the neural structures and circuits involved in fine motor control and to examine the effectiveness of counter measures to attenuate the effects of space radiation on fine motor control.

A Matlab-based toolbox for characterizing behavior of rodents engaged in string-pulling

String-pulling by rodents is a behavior in which animals make rhythmical body, head, and bilateral forearm as well as skilled hand movements to spontaneously reel in a string. Typical analysis includes kinematic assessment of hand movements done by manually annotating frames. Here, we describe a Matlab-based software that allows whole-body motion characterization using optical flow estimation, descriptive statistics, principal component, and independent component analyses as well as temporal measures of Fano factor, entropy, and Higuchi fractal dimension. Based on image-segmentation and heuristic algorithms for object tracking, the software also allows tracking of body, ears, nose, and forehands for estimation of kinematic parameters such as body length, body angle, head roll, head yaw, head pitch, and path and speed of hand movements. The utility of the task and software is demonstrated by characterizing postural and hand kinematic differences in string-pulling behavior of two strains of mice, C57BL/6 and Swiss Webster.