Automated Home-Cage Testing as a Tool to Improve Reproducibility of Behavioral Research?

Measuring the replicability of our own research

In the study of transgenic mouse models of neurodevelopmental and neurodegenerative disorders, we use batteries of tests to measure deficits in behaviour and from the results of these tests, we make inferences about the mental states of the mice that we interpret as deficits in "learning", "memory", "anxiety", "depression", etc. This paper discusses the problems of determining whether a particular transgenic mouse is a valid mouse model of disease X, the problem of background strains, and the question of whether our behavioural tests are measuring what we say they are. The problem of the reliability of results is then discussed: are they replicable between labs and can we replicate our results in our own lab? This involves the study of intra- and inter- experimenter reliability. The variables that influence replicability and the importance of conducting a complete behavioural phenotype: sensory, motor, cognitive and social emotional behaviour are discussed. Then the thorny question of failure to replicate is examined: Is it a curse or a blessing? Finally, the role of failure in research and what it tells us about our research paradigms is examined.

Appetitively motivated tasks in the IntelliCage reveal a higher motivational cost of spatial learning in male than female mice

The IntelliCage (IC) permits the assessment of the behavior and learning abilities of mice in a social home cage context. To overcome water deprivation as an aversive driver of learning, we developed protocols in which spatial learning is motivated appetitively by the preference of mice for sweetened over plain water. While plain water is available at all times, only correct task responses give access to sweetened water rewards. Under these conditions, C57BL/6J mice successfully mastered a corner preference task with the reversal and also learned a more difficult time-place task with reversal. However, the rate of responding to sweetened water decreased strongly with increasing task difficulty, indicating that learning challenges and reduced success in obtaining rewards decreased the motivation of the animals to seek sweetened water. While C57BL/6J mice of both sexes showed similar initial taste preferences and learned similarly well in simple learning tasks, the rate of responding to sweetened water and performance dropped more rapidly in male than in female mice in response to increasing learning challenges. Taken together, our data indicate that male mice can have a disadvantage relative to females in mastering difficult, appetitively motivated learning tasks, likely due to sex differences in value-based decision-making.

Activity in Group-Housed Home Cages of Mice as a Novel Preclinical Biomarker in Oncology Studies

BACKGROUND

Improving experimental conditions in preclinical animal research is a major challenge, both scientifically and ethically. Automated digital ventilated cages (DVC®) offer the advantage of continuous monitoring of animal activity in their home-cage. The potential utility of this technology remains understudied and deserves investigation in the field of oncology.

METHODS

Using the DVC® platform, we sought to determine if the continuous assessment of locomotor activity of mice in their home cages can serve as useful digital readout in the monitoring of animals treated with the reference oncology compounds cisplatin and cyclophosphamide. SCID mice of 14 weeks of age were housed in DVC® cages in groups of four and followed with standard and digital examination before and after treatment over a 17-day total period.

RESULTS

DVC® detected statistically significant effects of cisplatin on the activity of mice in the short and long term, as well as trends for cyclophosphamide. The activity differences between the vehicle- and chemotherapy-treated groups were especially marked during the nighttime, a period when animals are most active and staff are generally not available for regular checks. Standard clinical parameters, such as body weight change and clinical assessment during the day, provided additional and complementary information.

CONCLUSION

The DVC® technology enabled the home cage monitoring of mice and non-invasive detection of animal activity disturbances. It can easily be integrated into a multimodal monitoring approach to better capture the different effects of oncology drugs on anti-tumor efficacy, toxicity, and safety and improve translation to clinical studies.

A paradigm shift in translational psychiatry through rodent neuroethology

Mental disorders are a significant cause of disability worldwide. They profoundly affect individuals' well-being and impose a substantial financial burden on societies and governments. However, despite decades of extensive research, the effectiveness of current therapeutics for mental disorders is often not satisfactory or well tolerated by the patient. Moreover, most novel therapeutic candidates fail in clinical testing during the most expensive phases (II and III), which results in the withdrawal of pharma companies from investing in the field. It also brings into question the effectiveness of using animal models in preclinical studies to discover new therapeutic agents and predict their potential for treating mental illnesses in humans. Here, we focus on rodents as animal models and propose that they are essential for preclinical investigations of candidate therapeutic agents' mechanisms of action and for testing their safety and efficiency. Nevertheless, we argue that there is a need for a paradigm shift in the methodologies used to measure animal behavior in laboratory settings. Specifically, behavioral readouts obtained from short, highly controlled tests in impoverished environments and social contexts as proxies for complex human behavioral disorders might be of limited face validity. Conversely, animal models that are monitored in more naturalistic environments over long periods display complex and ethologically relevant behaviors that reflect evolutionarily conserved endophenotypes of translational value. We present how semi-natural setups in which groups of mice are individually tagged, and video recorded continuously can be attainable and affordable. Moreover, novel open-source machine-learning techniques for pose estimation enable continuous and automatic tracking of individual body parts in groups of rodents over long periods. The trajectories of each individual animal can further be subjected to supervised machine learning algorithms for automatic detection of specific behaviors (e.g., chasing, biting, or fleeing) or unsupervised automatic detection of behavioral motifs (e.g., stereotypical movements that might be harder to name or label manually). Compared to studies of animals in the wild, semi-natural environments are more compatible with neural and genetic manipulation techniques. As such, they can be used to study the neurobiological mechanisms underlying naturalistic behavior. Hence, we suggest that such a paradigm possesses the best out of classical ethology and the reductive behaviorist approach and may provide a breakthrough in discovering new efficient therapies for mental illnesses.

Chronic alcohol consumption alters home-cage behaviors and responses to ethologically relevant predator tasks in mice

BACKGROUND

Alcohol withdrawal is a key component of severe alcohol use disorder. Animal models of alcohol withdrawal tend to focus on traditional anxiety/stress tests. While these have been essential to advancing our understanding of the biology of alcohol withdrawal, abrupt cessation of drinking following heavy alcohol consumption can also trigger withdrawal-related affective states that impact responses to a variety of life events and stressors. To this end, we show that behaviors in a variety of tasks that differ in task demand and intensity are altered during withdrawal in male and female mice after voluntary alcohol access.

METHODS

Male and female miceunderwent six weeks of intermittent two-bottle choice alcohol exposure followed by behavioral tests. The tests included-Home cage: low-stress baseline environment to measure spontaneous natural behaviors; Open field: anxiety-inducing bright novel environment; Looming disc: arena with a protective hut where mice are exposed to a series of discs that mimic an overhead advancing predator, and Robogator-simulated predator task: forced foraging behavioral choice in the presence of an advancing robot predator that "attacks" when mice are near a food pellet in a large open arena.

RESULTS

A history of alcohol exposure impacted behaviors in these tasks in a sex-dependent manner. In the home cage, alcohol induced reductions in digging and heightened stress coping through an increase in grooming time. In males, increased rearing yielded greater vigilance/exploration in a familiar environment. The open-field test revealed an anxiety phenotype in both male and female mice exposed to alcohol. Male mice showed no behavioral alterations to the looming disc task, while females exposed to alcohol showed greater escape responses than water controls, indicative of active stress-response behaviors. In males, the Robogator task revealed a hesitant/avoidant phenotype in alcohol-exposed mice under greater task demands.

CONCLUSIONS

Few drugs show robust evidence of efficacy in clinical trials for alcohol withdrawal. Understanding how withdrawal alters a variety of behaviors in both males and females that are linked to stress coping can increase our understanding of alcohol misuse and aid in developing better medications for treating individuals with AUD.

Blueprints for measuring natural behavior

Until recently laboratory tasks for studying behavior were highly artificial, simplified, and designed without consideration for the environmental or social context. Although such an approach offers good control over behavior, it does not allow for researching either voluntary responses or individual differences. Importantly for neuroscience studies, the activity of the neural circuits involved in producing unnatural, artificial behavior is variable and hard to predict. In addition, different ensembles may be activated depending on the strategy the animal adopts to deal with the spurious problem. Thus, artificial and simplified tasks based on responses, which do not occur spontaneously entail problems with modeling behavioral impairments and underlying brain deficits. To develop valid models of human disorders we need to test spontaneous behaviors consistently engaging well-defined, evolutionarily conserved neuronal circuits. Such research focuses on behavioral patterns relevant for surviving and thriving under varying environmental conditions, which also enable high reproducibility across different testing settings.

Do multiple experimenters improve the reproducibility of animal studies?

The credibility of scientific research has been seriously questioned by the widely claimed “reproducibility crisis”. In light of this crisis, there is a growing awareness that the rigorous standardisation of experimental conditions may contribute to poor reproducibility of animal studies. Instead, systematic heterogenisation has been proposed as a tool to enhance reproducibility, but a real-life test across multiple independent laboratories is still pending. The aim of this study was therefore to test whether heterogenisation of experimental conditions by using multiple experimenters improves the reproducibility of research findings compared to standardised conditions with only one experimenter. To this end, we replicated the same animal experiment in 3 independent laboratories, each employing both a heterogenised and a standardised design. Whereas in the standardised design, all animals were tested by a single experimenter; in the heterogenised design, 3 different experimenters were involved in testing the animals. In contrast to our expectation, the inclusion of multiple experimenters in the heterogenised design did not improve the reproducibility of the results across the 3 laboratories. Interestingly, however, a variance component analysis indicated that the variation introduced by the different experimenters was not as high as the variation introduced by the laboratories, probably explaining why this heterogenisation strategy did not bring the anticipated success. Even more interestingly, for the majority of outcome measures, the remaining residual variation was identified as an important source of variance accounting for 41% (CI₉₅ [34%, 49%]) to 72% (CI₉₅ [58%, 88%]) of the observed total variance. Despite some uncertainty surrounding the estimated numbers, these findings argue for systematically including biological variation rather than eliminating it in animal studies and call for future research on effective improvement strategies.

An experimenter heterogenisation was not sufficient to prevent idiosyncratic results in a multi-laboratory setting. Astonishingly, neither the experimenter nor the laboratory accounted for the main portion of the observed variation, but a high amount of residual variation in fact remained unexplained despite strict standardisation regimes.

Role of Environment and Experimenter in Reproducibility of Behavioral Studies With Laboratory Mice

Behavioral phenotyping of mice has received a great deal of attention during the past three decades. However, there is still a pressing need to understand the variability caused by environmental and biological factors, human interference, and poorly standardized experimental protocols. The inconsistency of results is often attributed to the inter-individual difference between the experimenters and environmental conditions. The present work aims to dissect the combined influence of the experimenter and the environment on the detection of behavioral traits in two inbred strains most commonly used in behavioral genetics due to their contrasting phenotypes, the C57BL/6J and DBA/2J mice. To this purpose, the elevated O-maze, the open field with object, the accelerating rotarod and the Barnes maze tests were performed by two experimenters in two diverse laboratory environments. Our findings confirm the well-characterized behavioral differences between these strains in exploratory behavior, motor performance, learning and memory. Moreover, the results demonstrate how the experimenter and the environment influence the behavioral tests with a variable-dependent effect, often with mutually exclusive contributions. In this context, our study highlights how both the experimenter and the environment can have an impact on the strain effect size without altering the direction of the conclusions. Importantly, the general agreement on the results is reached by converging evidence from multiple measures addressing the same trait. In conclusion, the present work elucidates the contribution of both the experimenter and the laboratory environment in the intricate field of reproducibility in mouse behavioral phenotyping.

Emerging Role of Translational Digital Biomarkers Within Home Cage Monitoring Technologies in Preclinical Drug Discovery and Development

In drug discovery and development, traditional assessment of human patients and preclinical subjects occurs at limited time points in potentially stressful surroundings (i.e., the clinic or a test arena), which can impact data quality and welfare. However, recent advances in remote digital monitoring technologies enable the assessment of human patients and preclinical subjects across multiple time points in familiar surroundings. The ability to monitor a patient throughout disease progression provides an opportunity for more relevant and efficient diagnosis as well as improved assessment of drug efficacy and safety. In preclinical in vivo animal models, these digital technologies allow for continuous, longitudinal, and non-invasive monitoring in the home environment. This manuscript provides an overview of digital monitoring technologies for use in preclinical studies including their history and evolution, current engagement through use cases, and impact of digital biomarkers (DBs) on drug discovery and the 3Rs. We also discuss barriers to implementation and strategies to overcome them. Finally, we address data consistency and technology standards from the perspective of technology providers, end-users, and subject matter experts. Overall, this review establishes an improved understanding of the value and implementation of digital biomarker (DB) technologies in preclinical research.

Low-intensity blast induces acute glutamatergic hyperexcitability in mouse hippocampus leading to long-term learning deficits and altered expression of proteins involved in synaptic plasticity and serine protease inhibitors

Neurocognitive consequences of blast-induced traumatic brain injury (bTBI) pose significant concerns for military service members and veterans with the majority of "invisible injury." However, the underlying mechanism of such mild bTBI by low-intensity blast (LIB) exposure for long-term cognitive and mental deficits remains elusive. Our previous studies have shown that mice exposed to LIB result in nanoscale ultrastructural abnormalities in the absence of gross or apparent cellular damage in the brain. Here we tested the hypothesis that glutamatergic hyperexcitability may contribute to long-term learning deficits. Using brain slice electrophysiological recordings, we found an increase in averaged frequencies with a burst pattern of miniature excitatory postsynaptic currents (mEPSCs) in hippocampal CA3 neurons in LIB-exposed mice at 1- and 7-days post injury, which was blocked by a specific NMDA receptor antagonist AP5. In addition, cognitive function assessed at 3-months post LIB exposure by automated home-cage monitoring showed deficits in dynamic patterns of discrimination learning and cognitive flexibility in LIB-exposed mice. Collected hippocampal tissue was further processed for quantitative global-proteomic analysis. Advanced data-independent acquisition for quantitative tandem mass spectrometry analysis identified altered expression of proteins involved in synaptic plasticity and serine protease inhibitors in LIB-exposed mice. Some were correlated with the ability of discrimination learning and cognitive flexibility. These findings show that acute glutamatergic hyperexcitability in the hippocampus induced by LIB may contribute to long-term cognitive dysfunction and protein alterations. Studies using this military-relevant mouse model of mild bTBI provide valuable insights into developing a potential therapeutic strategy to ameliorate hyperexcitability-modulated LIB injuries.

Long-Term Effects of Low-Intensity Blast Non-Inertial Brain Injury on Anxiety-Like Behaviors in Mice: Home-Cage Monitoring Assessments

Mild traumatic brain injury induced by low-intensity blast (LIB) exposure poses concerns in military personnel. Using an open-field, non-inertial blast model and assessments by conventional behavioral tests, our previous studies revealed early-phase anxiety-like behaviors in LIB-exposed mice. However, the impact of LIB upon long-term anxiety-like behaviors requires clarification. This study applied a highly sensitive automated home-cage monitoring (HCM) system, which minimized human intervention and environmental changes, to assess anxiety-like responses in mice 3 months after LIB exposure. Initial assessment of 72-h spontaneous activities in a natural cage condition over multiple light and dark phases showed altered sheltering behaviors. LIB-exposed mice exhibited a subtle, but significantly decreased, duration of short shelter visits as compared to sham controls. Other measured responses between LIB-exposed mice and sham controls were insignificant. When behavioral assessments were performed in a challenged condition using an aversive spotlight, LIB-exposed mice demonstrated a significantly higher frequency of movements of shorter distance and duration per movement. Taken together, these findings demonstrated the presence of chronic anxiety-like behaviors assessed by the HCM system under both natural and challenged conditions in mice occurring post-LIB exposure. This model thus provides a platform to test for screening and interventions on anxiety disorders occurring after LIB non-inertial brain injury.

Roaming in a Land of Milk and Honey: Life Trajectories and Metabolic Rate of Female Inbred Mice Living in a Semi Naturalistic Environment

Despite tremendous efforts at standardization, the results of scientific studies can vary greatly, especially when considering animal research. It is important to emphasize that consistent different personality-like traits emerge and accumulate over time in laboratory mice despite genetic and environmental standardization. To understand to what extent variability can unfold over time, we conducted a long-term study using inbred mice living in an exceptionally complex environment comprising an area of 4.6 m² spread over five levels. In this semi-naturalistic environment (SNE) the activity and spatial distribution of 20 female C57Bl/6J was recorded by radio-frequency identification (RFID). All individuals were monitored from an age of 11 months to 22 months and their individual pattern of spatial movement in time is described as roaming entropy. Overall, we detected an increase of diversification in roaming behavior over time with stabilizing activity patterns at the individual level. However, spontaneous behavior of the animals as well as physiological parameters did not correlate with cumulative roaming entropy. Moreover, the amount of variability did not exceed the literature data derived from mice living in restricted conventional laboratory conditions. We conclude that even taking quantum leaps towards improving animal welfare does not inevitably mean a setback in terms of data quality.

Incorporating inter-individual variability in experimental design improves the quality of results of animal experiments

Inter-individual variability in quantitative traits is believed to potentially inflate the quality of results in animal experimentation. Yet, to our knowledge this effect has not been empirically tested. Here we test whether inter-individual variability in emotional response within mouse inbred strains affects the outcome of a pharmacological experiment. Three mouse inbred strains (BALB/c, C57BL/6 and 129S2) were behaviorally characterized through repeated exposure to a mild aversive stimulus (modified Hole Board, five consecutive trials). A multivariate clustering procedure yielded two multidimensional response types which were displayed by individuals of all three strains. We show that systematic incorporation of these individual response types in the design of a pharmacological experiment produces different results from an experimental pool in which this variation was not accounted for. To our knowledge, this is the first study that empirically confirms that inter-individual variability affects the interpretation of behavioral phenotypes and may obscure experimental results in a pharmacological experiment.

Inter-individual variability in habituation of anxiety-related responses within three mouse inbred strains

Inter-individual variability in behavioral and physiological response has become a well-established phenomenon in animal models of anxiety and other disorders. Such variability is even demonstrated within mouse inbred strains. A recent study showed that adaptive and non-adaptive anxiety phenotypes (measured as habituation and/or sensitization of anxiety responses) may differ within cohorts of 129 mice. This variability was expressed across both anxiety- and activity-related behavioral dimensions. These findings were based however on re-analysis of previously published data. The present study therefore aimed to empirically validate these findings in 129 mice. In addition, we assessed such inter-individuality in two other strains: BALB/c and C57BL/6. Males of three mouse inbred strains (BALB/c, C57BL/6 and 129S2) were behaviorally characterized through repeated exposure to a mild aversive stimulus (modified Hole Board, 4 consecutive trials). Behavioral observations were supplemented with assessment of circulating corticosterone levels. Clustering the individual response trajectories of behavioral and endocrine responses yielded two multidimensional response types of different adaptive value. Interestingly, these response types were displayed by individuals of all three strains. The response types differed significantly on anxiety and activity related behavioral dimensions but not on corticosterone concentrations. This study empirically confirms that adaptive capacities may differ within 129 cohorts. In addition, it extends this inter-individual variability in behavioral profiles to BALB/c and C57BL/6. Whether these two sub-types constitute differential anxiety phenotypes may differ per strain and requires further study.

The Intellicage system provides a reproducible and standardized method to assess behavioral changes in cuprizone-induced demyelination mouse model

BACKGROUND

Multiple sclerosis is a neurodegenerative disorder characterized by myelin loss in the brain parenchyma. To mimic the disease, mice are fed a cuprizone-supplemented diet for 5 weeks, which leads to demyelination of white and grey matter regions, with the corpus callosum being the most susceptible to cuprizone intoxication. Although this model is highly exploited, classical behavioural tests showed inconsistent results.

OBJECTIVE

In our study, we aimed to use the automated system Intellicage to phenotype the behaviour of cuprizone-fed mice.

METHODS

Mice were continuously monitored during the 5 weeks of intoxication in their home cages, with minimal interference from the experimenter. Mice were assessed for spontaneous activity, fine movements, and impulsivity.

RESULTS

Consistently, cuprizone-fed mice showed reduced activity and impulsivity throughout the test period. These behavioral results were confirmed by repeating the battery of behavioral tests in a second cohort of cuprizone-fed mice. Our results suggest that the behavioural phenotyping of cuprizone-fed mice using Intellicage is reproducible and sensitive enough to detect changes normally missed in standard behavioral test batteries.

CONCLUSION

Using a reproducible and standardized method to assess behavioral changes in mice intoxicated with cuprizone is crucial to better understand the disease as well as the functional outcome of treatments.