The fallacy of behavioral phenotyping without standardisation

Switching between foods is reliably associated with intake across eating events in children

Emerging evidence suggests switching between foods during an eating event is positively associated with intake. However, it is unclear whether switching is a stable behavior that predicts consumption across multiple eating events. The current study explored whether switching is consistent within children and reliably associated with intake across varied eating events. We analyzed data from 88 (45 F), 7-8-year-old children without obesity participating in a 7-visit prospective cohort study (ClinicalTrials.gov NCT03341247). Amount consumed and energy intake were measured at 4 separate meals of foods that varied by portion sizes served. Meals included macaroni and cheese, chicken nuggets, broccoli, and grapes (all 0.7-2.5 kcal/g). Children's intake was also assessed during 2 eating in the absence of hunger (EAH) paradigms separated by ≥ 1 year. The EAH paradigm included 9 sweet and savory snack foods (all 1.9-5.7 kcal/g). All eating events were video-recorded and switching was assessed by counting the number of times a child shifted between different food items. Results demonstrated that switching was reliably associated with intake at both the meals and the EAH paradigms (ps < 0.01). Specifically, at meals each additional switch was associated with 11.7 ± 1.3 kcal (7.7 ± 0.8 g) more consumed, and during EAH each additional switch was associated with 8.1 ± 2.1 kcal (2.1 ± 0.5 g) more consumed. Switching behavior was also moderately consistent across meals (ICC = 0.70) and EAH paradigms (ICC = 0.50). However, switching at meals was not related to switching at EAH paradigms. This study demonstrates the consistency of switching behavior and its reliable association with intake across eating events, highlighting its potential to contribute to chronic overconsumption and childhood obesity.

Systematic heterogenization revisited: Increasing variation in animal experiments to improve reproducibility?

Life sciences are currently facing a reproducibility crisis. Originally, the crisis was born out of single alarming failures to reproduce findings at different times and locations. Nowadays, systematic studies indicate that the prevalence of irreproducible research does in fact exceed 50%. Viewed from a rather cynical perspective, Fett's law of the lab "Never replicate a successful experiment" has thus taken on a completely new meaning. In this respect, animal research has come under particular scrutiny, as the stakes are high in terms of both research ethics and societal impact. To counteract this, it is essential to identify sources of poor reproducibility as well as to iron out these failures. We here review the current debate, briefly discuss potential reasons, and summarize steps that have already been undertaken to improve reproducibility in animal research. By the example of classical behavioural phenotyping studies, we particularly highlight the role strict standardization plays in exacerbating the crisis, and review the concept of systematic heterogenization as an alternative strategy to deal with variation in animal studies. Briefly, we argue that systematic variation rather than strict homogenization of experimental conditions benefits the robustness of research findings, and hence their reproducibility. To this end, we will present concrete examples for systematically heterogenized experiments and provide a practical guide on how to apply systematic heterogenization in experimental practice.

Mapping strategies towards improved external validity in preclinical translational research

INTRODUCTION

Translation is about successfully bringing findings from preclinical contexts into the clinic. This transfer is challenging as clinical trials frequently fail despite positive preclinical results. Limited robustness of preclinical research has been marked as one of the drivers of such failures. One suggested solution is to improve the external validity of in vitro and in vivo experiments via a suite of complementary strategies.

AREAS COVERED

In this review, the authors summarize the literature available on different strategies to improve external validity in in vivo, in vitro, or ex vivo experiments; systematic heterogenization; generalizability tests; and multi-batch and multicenter experiments. Articles that tested or discussed sources of variability in systematically heterogenized experiments were identified, and the most prevalent sources of variability are reviewed further. Special considerations in sample size planning, analysis options, and practical feasibility associated with each strategy are also reviewed.

EXPERT OPINION

The strategies reviewed differentially influence variation in experiments. Different research projects, with their unique goals, can leverage the strengths and limitations of each strategy. Applying a combination of these approaches in confirmatory stages of preclinical research putatively increases the chances of success in clinical studies.

Role of Environment and Experimenter in Reproducibility of Behavioral Studies With Laboratory Mice

Behavioral phenotyping of mice has received a great deal of attention during the past three decades. However, there is still a pressing need to understand the variability caused by environmental and biological factors, human interference, and poorly standardized experimental protocols. The inconsistency of results is often attributed to the inter-individual difference between the experimenters and environmental conditions. The present work aims to dissect the combined influence of the experimenter and the environment on the detection of behavioral traits in two inbred strains most commonly used in behavioral genetics due to their contrasting phenotypes, the C57BL/6J and DBA/2J mice. To this purpose, the elevated O-maze, the open field with object, the accelerating rotarod and the Barnes maze tests were performed by two experimenters in two diverse laboratory environments. Our findings confirm the well-characterized behavioral differences between these strains in exploratory behavior, motor performance, learning and memory. Moreover, the results demonstrate how the experimenter and the environment influence the behavioral tests with a variable-dependent effect, often with mutually exclusive contributions. In this context, our study highlights how both the experimenter and the environment can have an impact on the strain effect size without altering the direction of the conclusions. Importantly, the general agreement on the results is reached by converging evidence from multiple measures addressing the same trait. In conclusion, the present work elucidates the contribution of both the experimenter and the laboratory environment in the intricate field of reproducibility in mouse behavioral phenotyping.

The importance of individual variation for the interpretation of behavioural studies: ethanol effects vary with basal activity level in zebrafish larvae

Standardization and reduction of variation is key to behavioural screening of animal models in toxicological and pharmacological studies. However, individual variation in behavioural and physiological phenotypes remains in each laboratory population and can undermine the understanding of toxicological and pharmaceutical effects and their underlying mechanisms. Here, we used zebrafish (ABTL-strain) larvae to explore individual consistency in activity level and emergence time, across subsequent days of early development (6-8 dpf). We also explored the correlation between these two behavioural parameters. We found inter-individual consistency over time in activity level and emergence time, but we did not find a consistent correlation between these parameters. Subsequently, we investigated the impact of variation in activity level on the effect of a 1% ethanol treatment, suitable for our proof-of-concept case study about whether impact from pharmacological treatments might be affected by inter-individual variation in basal locomotion. The inter-individual consistency over time in activity level did not persist in this test. This was due to the velocity change from before to after exposure, which turned out to be a dynamic individual trait related to basal activity level: low-activity individuals raised their swimming velocity, while high-activity individuals slowed down, yielding diametrically opposite response patterns to ethanol exposure. We therefore argue that inter-individual consistency in basal activity level, already from 6 dpf, is an important factor to take into account and provides a practical measure to improve the power of statistical analyses and the scope for data interpretation from behavioural screening studies.

Three Pillars of Automated Home-Cage Phenotyping of Mice: Novel Findings, Refinement, and Reproducibility Based on Literature and Experience

Animal models of neurodegenerative and neuropsychiatric disorders require extensive behavioral phenotyping. Currently, this presents several caveats and the most important are: (i) rodents are nocturnal animals, but mostly tested during the light period; (ii) the conventional behavioral experiments take into consideration only a snapshot of a rich behavioral repertoire; and (iii) environmental factors, as well as experimenter influence, are often underestimated. Consequently, serious concerns have been expressed regarding the reproducibility of research findings on the one hand, and appropriate welfare of the animals (based on the principle of 3Rs-reduce, refine and replace) on the other hand. To address these problems and improve behavioral phenotyping in general, several solutions have been proposed and developed. Undisturbed, 24/7 home-cage monitoring (HCM) is gaining increased attention and popularity as demonstrating the potential to substitute or complement the conventional phenotyping methods by providing valuable data for identifying the behavioral patterns that may have been missed otherwise. In this review, we will briefly describe the different technologies used for HCM systems. Thereafter, based on our experience, we will focus on two systems, IntelliCage (NewBehavior AG and TSE-systems) and Digital Ventilated Cage (DVC®, Tecniplast)-how they have been developed and applied during recent years. Additionally, we will touch upon the importance of the environmental/experimenter artifacts and propose alternative suggestions for performing phenotyping experiments based on the published evidence. We will discuss how the integration of telemetry systems for deriving certain physiological parameters can help to complement the description of the animal model to offer better translation to human studies. Ultimately, we will discuss how such HCM data can be statistically interpreted and analyzed.

Movement behavior remains stable in stroke survivors within the first two months after returning home

BACKGROUND AND PURPOSE

The aim of this study is to investigate changes in movement behaviors, sedentary behavior and physical activity, and to identify potential movement behavior trajectory subgroups within the first two months after discharge from the hospital to the home setting in first-time stroke patients.

METHODS

A total of 140 participants were included. Within three weeks after discharge, participants received an accelerometer, which they wore continuously for five weeks to objectively measure movement behavior outcomes. The movement behavior outcomes of interest were the mean time spent in sedentary behavior (SB), light physical activity (LPA) and moderate to vigorous physical activity (MVPA); the mean time spent in MVPA bouts ≥ 10 minutes; and the weighted median sedentary bout. Generalized estimation equation analyses were performed to investigate overall changes in movement behavior outcomes. Latent class growth analyses were performed to identify patient subgroups of movement behavior outcome trajectories.

RESULTS

In the first week, the participants spent an average, of 9.22 hours (67.03%) per day in SB, 3.87 hours (27.95%) per day in LPA and 0.70 hours (5.02%) per day in MVPA. Within the entire sample, a small but significant decrease in SB and increase in LPA were found in the first weeks in the home setting. For each movement behavior outcome variable, two or three distinctive subgroup trajectories were found. Although subgroup trajectories for each movement behavior outcome were identified, no relevant changes over time were found.

CONCLUSION

Overall, the majority of stroke survivors are highly sedentary and a substantial part is inactive in the period immediately after discharge from hospital care. Movement behavior outcomes remain fairly stable during this period, although distinctive subgroup trajectories were found for each movement behavior outcome. Future research should investigate whether movement behavior outcomes cluster in patterns.

A safe bet? Inter-laboratory variability in behaviour-based severity assessment

Evidence-based severity assessment is essential as a basis for ethical evaluation in animal experimentation to ensure animal welfare, legal compliance and scientific quality. To fulfil these tasks scientists, animal care and veterinary personnel need assessment tools that provide species-relevant measurements of the animals' physical and affective state. In a three-centre study inter-laboratory robustness of body weight monitoring, mouse grimace scale (MGS) and burrowing test were evaluated. The parameters were assessed in naïve and tramadol treated female C57BL/6J mice. During tramadol treatment a body weight loss followed by an increase, when treatment was terminated, was observed in all laboratories. Tramadol treatment did not affect the MGS or burrowing performance. Results were qualitatively comparable between the laboratories, but quantitatively significantly different (inter-laboratory analysis). Burrowing behaviour seems to be highly sensitive to inter-laboratory differences in testing protocol. All locations obtained comparable information regarding the qualitative effect of tramadol treatment in C57BL/6J mice, however, datasets differed as a result of differences in test and housing conditions. In conclusion, our study confirms that results of behavioural testing can be affected by many factors and may differ between laboratories. Nevertheless, the evaluated parameters appeared relatively robust even when conditions were not harmonized extensively and present useful tools for severity assessment. However, analgesia-related side effects on parameters have to be considered carefully.

Standardization of Small Animal Imaging-Current Status and Future Prospects

The benefit of small animal imaging is directly linked to the validity and reliability of the collected data. If the data (regardless of the modality used) are not reproducible and/or reliable, then the outcome of the data is rather questionable. Therefore, standardization of the use of small animal imaging equipment, as well as of animal handling in general, is of paramount importance. In a recent paper, guidance for efficient small animal imaging quality control was offered and discussed, among others, the use of phantoms in setting up a quality control program (Osborne et al. 2016). The same phantoms can be used to standardize image quality parameters for multi-center studies or multi-scanners within center studies. In animal experiments, the additional complexity due to animal handling needs to be addressed to ensure standardized imaging procedures. In this review, we will address the current status of standardization in preclinical imaging, as well as potential benefits from increased levels of standardization.

Understanding taurine CNS activity using alternative zebrafish models

Taurine is a highly abundant "amino acid" in the brain. Despite the potential neuroactive role of taurine in vertebrates has long been recognized, the underlying molecular mechanisms related to its pleiotropic effects in the brain remain poorly understood. Due to the genetic tractability, rich behavioral repertoire, neurochemical conservation, and small size, the zebrafish (Danio rerio) has emerged as a powerful candidate for neuropsychopharmacology investigation and in vivo drug screening. Here, we summarize the main physiological roles of taurine in mammals, including neuromodulation, osmoregulation, membrane stabilization, and antioxidant action. In this context, we also highlight how zebrafish models of brain disorders may present interesting approaches to assess molecular mechanisms underlying positive effects of taurine in the brain. Finally, we outline recent advances in zebrafish drug screening that significantly improve neuropsychiatric translational researches and small molecule screens.

Breeding Zebrafish: A Review of Different Methods and a Discussion on Standardization

In recent years, a rapidly increasing number of scientific papers have been published that utilize zebrafish (Danio rerio) as an alternative model organism in the study of a wide range of biological phenomena from cancer to behavior. This is, in large part, due to the prolific nature, relative ease of maintenance, and sufficiently high genetic homology of zebrafish to humans. With the surge of zebrafish use in animal research, the variations in methodologies of breeding and husbandry of this species have also increased. Investigators usually focus on the development and implementation of rigorous laboratory control that is specific to their studies. We suggest that the same scrutiny and attention may be required for the methods of breeding and housing of zebrafish. This article reviews a variety of zebrafish husbandry and breeding techniques and conditions employed around the world. It discusses factors ranging from numerous aspects of rearing/housing conditions through the sex ratio of the breeding group to the composition of the diet of zebrafish that may vary across laboratories. It provides some feedback on the potential pros and cons of the different methods. It argues that there is a substantial need for systematic analysis of these methods, that is, the effects of environmental factors on zebrafish health and breeding. It also discusses the question as to whether some degree of standardization of these methods is needed to enhance cross-laboratory comparability of results.

Evaluation of the behavioral characteristics of the mdx mouse model of duchenne muscular dystrophy through operant conditioning procedures

The mdx mouse is an important nonhuman model for Duchenne muscular dystrophy (DMD) research. Characterizing the behavioral traits of the strain relative to congenic wild-type (WT) mice may enhance our understanding of the cognitive deficits observed in some humans with DMD and contribute to treatment development and evaluation. In this paper we report the results of a number of experiments comparing the behavior of mdx to WT mice in operant conditioning procedures designed to assess learning and memory. We found that mdx outperformed WT in all learning and memory tasks involving food reinforcement, and this appeared to be related to the differential effects of the food deprivation motivating operation on mdx mice. Conversely, WT outperformed mdx in an escape/avoidance learning task. These results suggest motivational differences between the strains and demonstrate the potential utility of operant conditioning procedures in the assessment of the behavioral characteristics of the mdx mouse.

Identifying eating behavior phenotypes and their correlates: A novel direction toward improving weight management interventions

Common reports of over-response to food cues, difficulties with calorie restriction, and difficulty adhering to dietary guidelines suggest that eating behaviors could be interrelated in ways that influence weight management efforts. The feasibility of identifying robust eating phenotypes (showing face, content, and criterion validity) was explored based on well-validated individual eating behavior assessments. Adults (n = 260; mean age 34 years) completed online questionnaires with measurements of nine eating behaviors including: appetite for palatable foods, binge eating, bitter taste sensitivity, disinhibition, food neophobia, pickiness and satiety responsiveness. Discovery-based visualization procedures that have the combined strengths of heatmaps and hierarchical clustering were used to investigate: 1) how eating behaviors cluster, 2) how participants can be grouped within eating behavior clusters, and 3) whether group clustering is associated with body mass index (BMI) and dietary self-efficacy levels. Two distinct eating behavior clusters and participant groups that aligned within these clusters were identified: one with higher drive to eat and another with food avoidance behaviors. Participants' BMI (p = 0.0002) and dietary self-efficacy (p < 0.0001) were associated with cluster membership. Eating behavior clusters showed content and criterion validity based on their association with BMI (associated, but not entirely overlapping) and dietary self-efficacy. Identifying eating behavior phenotypes appears viable. These efforts could be expanded and ultimately inform tailored weight management interventions.

Methodological Considerations for Optimizing and Validating Behavioral Assays

Preclinical animal models are indispensable tools for translational research for which behavioral characterization and phenotyping are essential to testing hypotheses and for evaluating the potential of novel therapeutic agents to treat diseases. The methods employed for comprehensive behavioral phenotyping and pharmacological experiments are complex and should be conducted exclusively by trained technicians with demonstrated proficiency. The ultimate goal is to identify disease-relevant and translational behavioral endpoints that are robust, reliable, and reproducible, and that can be employed to evaluate potential of novel therapeutic agents to treat disease. The intent of the present article is to provide a pragmatic outline for establishing and optimizing behavioral assays and phenotyping batteries, ensuring that the assays and the data are reliable such that they can be reproduced within and across technicians and laboratories and, more importantly, that the data is translatable to the clinic. © 2016 by John Wiley & Sons, Inc.

Toward more predictive genetic mouse models of Alzheimer's disease

Genetic mouse models for Alzheimer's disease (AD) have been widely used to understand aspects of the biology of the disease, but have had limited success in translating these findings to the clinic. In this review, we discuss the benefits and limitations of existing genetic models and recent advances in technologies (including high throughput sequencing and genome editing) that promise more predictive models. We summarize widely used biomarkers and behavioral tests for mouse models of AD and highlight best practices that will maximize translatability of preclinical findings.

Response, use and habituation to a mouse house in C57BL/6J and BALB/c mice

Animal welfare depends on the possibility to express species-specific behaviours and can be strongly compromised in socially and environmentally deprived conditions. Nesting materials and refuges are very important resources to express these behaviours and should be considered as housing supplementation items. We evaluated the effects of one item of housing supplementation in standard settings in laboratory mice. C57BL/6JOlaHsd (B6) and BALB/cOlaHsd (BALB) young male and female mice, upon arrival, were housed in groups of four in standard laboratory cages and after 10 days of acclimatization, a red transparent plastic triangular-shaped Mouse House™ was introduced into half of the home cages. Animals with or without a mouse house were observed in various contexts for more than one month. Body weight gain and food intake, home cage behaviours, emotionality and response to standard cage changing procedures were evaluated. The presence of a mouse house in the home cage did not interfere with main developmental and behavioural parameters or emotionality of BALB and B6 male and female mice compared with controls. Both strains habituated to the mouse house in about a week, but made use of it differently, with BALB mice using the house more than the B6 strain. Our results suggest that mice habituated to the mouse house rather quickly without disrupting their home cage activities. Scientists can thus be encouraged to use mouse houses, also in view of the implementation of the EU Directive (2010/63/EU).

Structured evaluation of rodent behavioral tests used in drug discovery research

A large variety of rodent behavioral tests are currently being used to evaluate traits such as sensory-motor function, social interactions, anxiety-like and depressive-like behavior, substance dependence and various forms of cognitive function. Most behavioral tests have an inherent complexity, and their use requires consideration of several aspects such as the source of motivation in the test, the interaction between experimenter and animal, sources of variability, the sensory modality required by the animal to solve the task as well as costs and required work effort. Of particular importance is a test’s validity because of its influence on the chance of successful translation of preclinical results to clinical settings. High validity may, however, have to be balanced against practical constraints and there are no behavioral tests with optimal characteristics. The design and development of new behavioral tests is therefore an ongoing effort and there are now well over one hundred tests described in the contemporary literature. Some of them are well established following extensive use, while others are novel and still unproven. The task of choosing a behavioral test for a particular project may therefore be daunting and the aim of the present review is to provide a structured way to evaluate rodent behavioral tests aimed at drug discovery research.

Inhibitory avoidance learning in zebrafish (Danio rerio): effects of shock intensity and unraveling differences in task performance

The zebrafish (Danio rerio) is increasingly used as a model in neurobehavioral and neuroendocrine studies. The inhibitory avoidance paradigm has been proposed as tool to study mechanisms underlying learning and memory in zebrafish. In this paradigm subjects receive a shock after entering the black compartment of a black-white box. On the next day, latency to enter the black compartment is assessed; higher latencies are indicative of increased avoidance learning. Here, we aimed to understand the effects of different shock intensities (0, 1, 3, and 9 V) and to unravel variation in inhibitory avoidance learning in an in-house reared Tuebingen Long-Fin zebrafish (D. rerio) strain. While median latencies had increased in the 1, 3, and 9 V groups, no increase in median latency was found in the 0 V group. In addition, higher shock intensities resulted in a higher number of avoiders (latency ≥180 s) over nonavoiders (latency <60 s). Both changes are indicative of increased avoidance learning. We assessed whole-body cortisol content and the expression levels of genes relevant to stress, anxiety, fear, and learning 2 h after testing. Shock intensity was associated with whole-body cortisol content and the expression of glucocorticoid receptor alpha [nr3c1(alpha)], cocaine- and amphetamine-regulated transcript (cart4), and mineralocorticoid receptor (nr3c2), while avoidance behavior was associated with whole-body cortisol content only. The inhibitory avoidance paradigm in combination with measuring whole-body cortisol content and gene expression is suitable to unravel (genetic) mechanisms of fear avoidance learning. Our data further show differences in brain-behavior relationships underlying fear avoidance learning and memory in zebrafish. These findings serve as starting point for further unraveling differences in brain-behavior relationships underlying (fear avoidance) learning and memory in zebrafish.

The Directive 2010/63/EU on animal experimentation may skew the conclusions of pharmacological and behavioural studies

All laboratory animals shall be provided some form of environmental enrichment (EE) in the nearest future (Directive 2010/63/EU). Displacing standard housing with EE entails the possibility that data obtained under traditional housing may be reconsidered. Specifically, while EE often contrasts the abnormalities of consolidated disease models, it also indirectly demonstrates that their validity depends on housing conditions. We mimicked a situation in which the consequences of a novel pharmacological compound were addressed before and after the adoption of the Directive. We sub-chronically exposed standard- or EE-reared adolescent CD1 mice (postnatal days 23-33) to the synthetic compound JWH-018, and evaluated its short- and long-term potential cannabinoid properties on: weight gain, locomotion, analgesia, motor coordination, body temperature, brain metabolism (¹H MRI/MRS), anxiety- and depressive-related behaviours. While several parameters are modulated by JWH-018 independently of housing, other effects are environmentally mediated. The transition from standard housing to EE shall be carefully monitored.

The significance of meaning: why do over 90% of behavioral neuroscience results fail to translate to humans, and what can we do to fix it?

The vast majority of drugs entering human trials fail. This problem (called "attrition") is widely recognized as a public health crisis, and has been discussed openly for the last two decades. Multiple recent reviews argue that animals may be just too different physiologically, anatomically, and psychologically from humans to be able to predict human outcomes, essentially questioning the justification of basic biomedical research in animals. This review argues instead that the philosophy and practice of experimental design and analysis is so different in basic animal work and human clinical trials that an animal experiment (as currently conducted) cannot reasonably predict the outcome of a human trial. Thus, attrition does reflect a lack of predictive validity of animal experiments, but it would be a tragic mistake to conclude that animal models cannot show predictive validity. A variety of contributing factors to poor validity are reviewed. The need to adopt methods and models that are highly specific (i.e., which can identify true negative results) in order to complement the current preponderance of highly sensitive methods (which are prone to false positive results) is emphasized. Concepts in biomarker-based medicine are offered as a potential solution, and changes in the use of animal models required to embrace a translational biomarker-based approach are outlined. In essence, this review advocates a fundamental shift, where we treat every aspect of an animal experiment that we can as if it was a clinical trial in a human population. However, it is unrealistic to expect researchers to adopt a new methodology that cannot be empirically justified until a successful human trial. "Validation with known failures" is proposed as a solution. Thus new methods or models can be compared against existing ones using a drug that has translated (a known positive) and one that has failed (a known negative). Current methods should incorrectly identify both as effective, but a more specific method should identify the negative compound correctly. By using a library of known failures we can thereby empirically test the impact of suggested solutions such as enrichment, controlled heterogenization, biomarker-based models, or reverse-translated measures.

Preclinical research in Rett syndrome: setting the foundation for translational success

In September of 2011, the National Institute of Neurological Disorders and Stroke (NINDS), the Eunice Kennedy Shriver National Institute of Child Health and Human Development (NICHD), the International Rett Syndrome Foundation (IRSF) and the Rett Syndrome Research Trust (RSRT) convened a workshop involving a broad cross-section of basic scientists, clinicians and representatives from the National Institutes of Health (NIH), the US Food and Drug Administration (FDA), the pharmaceutical industry and private foundations to assess the state of the art in animal studies of Rett syndrome (RTT). The aim of the workshop was to identify crucial knowledge gaps and to suggest scientific priorities and best practices for the use of animal models in preclinical evaluation of potential new RTT therapeutics. This review summarizes outcomes from the workshop and extensive follow-up discussions among participants, and includes: (1) a comprehensive summary of the physiological and behavioral phenotypes of RTT mouse models to date, and areas in which further phenotypic analyses are required to enhance the utility of these models for translational studies; (2) discussion of the impact of genetic differences among mouse models, and methodological differences among laboratories, on the expression and analysis, respectively, of phenotypic traits; and (3) definitions of the standards that the community of RTT researchers can implement for rigorous preclinical study design and transparent reporting to ensure that decisions to initiate costly clinical trials are grounded in reliable preclinical data.

"Personality" in laboratory mice used for biomedical research: a way of understanding variability?

The mouse, including countless lines of transgenic and knockout mice, has become the most prominent model organism in biomedical research. Behavioral characterization is often conducted in batteries of short tests on locomotion, anxiety, learning and memory, etc. In such tests, any individual differences within groups are usually considered to be disturbing variance. In order to reduce variance in experimental animal research enormous efforts of standardization have been made. While a substantial reduction of variability has been reached compared to the earlier years of experimental animal studies a considerable amount of inter-individual differences still seems to escape standardization. This effect is demonstrated and evaluated by re-analyzing data from two experiments conducted in our laboratory with inbred mice. Interestingly, behavioral patterns of individual animals seem to be correlated across context and time. In evolutionary biology, "animal personalities" have been discussed recently to comprise such stable patterns. We argue here, that nonrandom behavioral correlations across contexts and time might underlie the variability commonly found in biomedical mouse studies.

Impact of inherent variability and experimental parameters on the reliability of small animal PET data

Background

Noninvasive preclinical imaging methodologies such as small animal positron emission tomography (PET) allow the repeated measurement of the same subject which is generally assumed to reduce the variability of the experimental outcome parameter and to produce more robust results. In this study, the variability of tracer uptake in the rodent brain was assessed within and between subjects using the established radiopharmaceuticals ¹⁸F-FDG and ¹⁸F-fallypride. Moreover, experimental factors with potential impact on study outcome were elicited, and the effect of their strict homogenization was assessed.

Methods

Brain standardized uptake values of rodents were compared between three PET scans of the same animal and scans of different individuals. ¹⁸F-FDG ex vivo tissue sampling was performed under variation of the following experimental parameters: gender, age, cage occupancy, anesthetic protocol, environmental temperature during uptake phase, and tracer formulation.

Results

No significant difference of variability in ¹⁸F-FDG or ¹⁸F-fallypride brain or striatal uptake was identified between scans of the same and scans of different animals (COV = 14 ± 7% vs. 21 ± 10% for ¹⁸F-FDG). ¹⁸F-FDG brain uptake was robust regarding a variety of experimental parameters; only anesthetic protocols showed a significant impact. In contrast to a heterogenization approach, homogenization of groups produced more false positive effects in ¹⁸F-FDG organ distribution showing a false positive rate of 9% vs. 6%.

Conclusions

Repeated measurements of the same animal may not reduce data variability compared with measurements on different animals. Controlled heterogenization of test groups with regard to experimental parameters is advisable as it decreases the generation of false positive results and thus increases external validity of study outcome.

Automated behavioral phenotyping reveals presymptomatic alterations in a SCA3 genetrap mouse model

Characterization of disease models of neurodegenerative disorders requires a systematic and comprehensive phenotyping in a highly standardized manner. Therefore, automated high-resolution behavior test systems such as the homecage based LabMaster system are of particular interest. We demonstrate the power of the automated LabMaster system by discovering previously unrecognized features of a recently characterized atxn3 mutant mouse model. This model provided neurological symptoms including gait ataxia, tremor, weight loss and premature death at the age of 12 months usually detectable just 2 weeks before the mice died. Moreover, using the LabMaster system we were able to detect hypoactivity in presymptomatic mutant mice in the dark as well as light phase. Additionally, we analyzed inflammation, immunological and hematological parameters, which indicated a reduced immune defense in phenotypic mice. Here we demonstrate that a detailed characterization even of organ systems that are usually not affected in SCA3 is important for further studies of pathogenesis and required for the preclinical therapeutic studies.

Evaluation of social and physical enrichment in modulation of behavioural phenotype in C57BL/6J female mice

Housing conditions represent an important environmental variable playing a critical role in the assessment of mouse behaviour. In the present study the effects of isolation and nesting material on the behaviour of female C57BL/6J mice were evaluated. The mice were subjected to different rearing conditions from weaning (at the age of 3 weeks). The study groups were group- and single-housed mice, divided further into groups with or without nesting material (species-specific enrichment). After 8 weeks spent in respective conditions the behavioural testing began. Both factors (social conditions and nesting material) appeared to have a significant impact on the behavioural phenotype. However, it is important to stress that the interaction between the factors was virtually absent. We established that isolation increased locomotor activity and reduced anxiety-like behaviour in several tests of exploration. In contrast, absence of nesting material increased anxiety-like behaviour. Neither factor affected rota-rod performance, nociception and prepulse inhibition. Contextual fear memory was significantly reduced in single-housed mice, and interestingly, in mice with nesting material. Cued fear memory was reduced by single-housing, but not affected by enrichment. Mice from enriched cages displayed faster and better learning and spatial search strategy in the water maze. In contrast, isolation caused significant impairment in the water maze. In conclusion, both isolation and species-specific enrichment have profound effects on mouse behaviour and should be considered in design of the experiments and in assessment of animal welfare issues.

Effect of population heterogenization on the reproducibility of mouse behavior: a multi-laboratory study

In animal experiments, animals, husbandry and test procedures are traditionally standardized to maximize test sensitivity and minimize animal use, assuming that this will also guarantee reproducibility. However, by reducing within-experiment variation, standardization may limit inference to the specific experimental conditions. Indeed, we have recently shown in mice that standardization may generate spurious results in behavioral tests, accounting for poor reproducibility, and that this can be avoided by population heterogenization through systematic variation of experimental conditions. Here, we examined whether a simple form of heterogenization effectively improves reproducibility of test results in a multi-laboratory situation. Each of six laboratories independently ordered 64 female mice of two inbred strains (C57BL/6NCrl, DBA/2NCrl) and examined them for strain differences in five commonly used behavioral tests under two different experimental designs. In the standardized design, experimental conditions were standardized as much as possible in each laboratory, while they were systematically varied with respect to the animals' test age and cage enrichment in the heterogenized design. Although heterogenization tended to improve reproducibility by increasing within-experiment variation relative to between-experiment variation, the effect was too weak to account for the large variation between laboratories. However, our findings confirm the potential of systematic heterogenization for improving reproducibility of animal experiments and highlight the need for effective and practicable heterogenization strategies.

Functional assays for neurotoxicity testing

Neurobehavioral and pathological evaluations of the nervous system are complementary components of basic research and toxicity testing of pharmaceutical and environmental chemicals. While neuropathological assessments provide insight as to cellular changes in neurons, behavioral and physiological methods evaluate the functional consequences of disruption of neuronal communications. The underlying causes of certain behavioral alterations may be understood, but many do not have known direct associations with specific brain pathologies. In some cases, however, rapidly expanding mouse models (transgenic, knock-out) are providing considerable information on behavioral phenotypes of altered pathology. Behavior represents the integrated sum of activities mediated by the nervous system, and functional tests used for neurotoxicity testing tap different behavioral repertoires. These tests have an advantage over pathologic measures in that they permit repeated evaluation of a single animal over time to determine the onset, progression, duration, and reversibility of a neurotoxic injury. Functional assays range from a screening-level battery of tests to refined procedures to tap specific forms of learning and/or memory. This article reviews common procedures for behavioral toxicity testing and provides examples of chemical-specific neurobehavioral-pathological correlations in order to inform interpretation and integration of neuropathological and behavioral outcomes.

Ten ways to improve the quality of descriptions of whole-animal movement

The demand for replicability of behavioral results across laboratories is viewed as a burden in behavior genetics. We demonstrate how it can become an asset offering a quantitative criterion that guides the design of better ways to describe behavior. Passing the high benchmark dictated by the replicability demand requires less stressful and less restraining experimental setups, less noisy data, individually customized cutoff points between the building blocks of movement, and less variable yet discriminative dynamic representations that would capture more faithfully the nature of the behavior, unmasking similarities and differences and revealing novel animal-centered measures. Here we review ten tools that enhance replicability without compromising discrimination. While we demonstrate the usefulness of these tools in the context of inbred mouse exploratory behavior they can readily be used in any study involving a high-resolution analysis of spatial behavior. Viewing replicability as a design concept and using the ten methodological improvements may prove useful in many fields not necessarily related to spatial behavior.

Modeling the positive symptoms of schizophrenia in genetically modified mice: pharmacology and methodology aspects

In recent years, there have been huge advances in the use of genetically modified mice to study pathophysiological mechanisms involved in schizophrenia. This has allowed rapid progress in our understanding of the role of several proposed gene mechanisms in schizophrenia, and yet this research has also revealed how much still remains unresolved. Behavioral studies in genetically modified mice are reviewed with special emphasis on modeling psychotic-like behavior. I will particularly focus on observations on locomotor hyperactivity and disruptions of prepulse inhibition (PPI). Recommendations are included to address pharmacological and methodological aspects in future studies. Mouse models of dopaminergic and glutamatergic dysfunction are then discussed, reflecting the most important and widely studied neurotransmitter systems in schizophrenia. Subsequently, psychosis-like behavior in mice with modifications in the most widely studied schizophrenia susceptibility genes is reviewed. Taken together, the available studies reveal a wealth of available data which have already provided crucial new insight and mechanistic clues which could lead to new treatments or even prevention strategies for schizophrenia.

Neurobehavioral tests in rat models of degenerative brain diseases

Each translational approach in medical research forces the establishment of neurobehavioral screening systems, dedicated to fill the gap between postgenomic generation of state-of-the-art animal models (i.e. transgenic rats) on the one hand and their added value for really predictive experimental preclinical therapy on the other. Owing to these developments in the field, neuroscientists are frequently challenged by the task of detecting discrete behavioral differences in rats. Systematic, comprehensive phenotyping covers these needs and represents a central part of the process. In this chapter, we provide an overview on theoretical issues related to comprehensive neurobehavioral phenotyping of rats and propose specific classical procedures, protocols (similar to the SHIRPA approach in mice), as well as techniques for repeated, intraindividual phenotyping. Neurological testing of rats, motorfunctional screening using the accelerod approach, emotional screening using the social interaction test of anxiety, and testing of sensorimotoric gating functions by prepulse inhibition of the startle response are provided in more detail. This description is completed by an outlook on most recent developments in the field dealing with automated, intra-home-cage technologies, allowing continuous screening in rats in various behavioral and physiological dimensions on an ethological basis.

Environmental standardization: cure or cause of poor reproducibility in animal experiments?

It is widely believed that environmental standardization is the best way to guarantee reproducible results in animal experiments. However, mounting evidence indicates that even subtle differences in laboratory or test conditions can lead to conflicting test outcomes. Because experimental treatments may interact with environmental conditions, experiments conducted under highly standardized conditions may reveal local 'truths' with little external validity. We review this hypothesis here and present a proof of principle based on data from a multilaboratory study on behavioral differences between inbred mouse strains. Our findings suggest that environmental standardization is a cause of, rather than a cure for, poor reproducibility of experimental outcomes. Environmental standardization can contribute to spurious and conflicting findings in the literature and unnecessary animal use. This conclusion calls for research into practicable and effective ways of systematic environmental heterogenization to attenuate these scientific, economic and ethical costs.

Evaluation of animal models of neurobehavioral disorders

Animal models play a central role in all areas of biomedical research. The process of animal model building, development and evaluation has rarely been addressed systematically, despite the long history of using animal models in the investigation of neuropsychiatric disorders and behavioral dysfunctions. An iterative, multi-stage trajectory for developing animal models and assessing their quality is proposed. The process starts with defining the purpose(s) of the model, preferentially based on hypotheses about brain-behavior relationships. Then, the model is developed and tested. The evaluation of the model takes scientific and ethical criteria into consideration.Model development requires a multidisciplinary approach. Preclinical and clinical experts should establish a set of scientific criteria, which a model must meet. The scientific evaluation consists of assessing the replicability/reliability, predictive, construct and external validity/generalizability, and relevance of the model. We emphasize the role of (systematic and extended) replications in the course of the validation process. One may apply a multiple-tiered 'replication battery' to estimate the reliability/replicability, validity, and generalizability of result.Compromised welfare is inherent in many deficiency models in animals. Unfortunately, 'animal welfare' is a vaguely defined concept, making it difficult to establish exact evaluation criteria. Weighing the animal's welfare and considerations as to whether action is indicated to reduce the discomfort must accompany the scientific evaluation at any stage of the model building and evaluation process. Animal model building should be discontinued if the model does not meet the preset scientific criteria, or when animal welfare is severely compromised. The application of the evaluation procedure is exemplified using the rat with neonatal hippocampal lesion as a proposed model of schizophrenia.In a manner congruent to that for improving animal models, guided by the procedure expounded upon in this paper, the developmental and evaluation procedure itself may be improved by careful definition of the purpose(s) of a model and by defining better evaluation criteria, based on the proposed use of the model.

Reliability, robustness, and reproducibility in mouse behavioral phenotyping: a cross-laboratory study

Establishing standard operating procedures (SOPs) as tools for the analysis of behavioral phenotypes is fundamental to mouse functional genomics. It is essential that the tests designed provide reliable measures of the process under investigation but most importantly that these are reproducible across both time and laboratories. For this reason, we devised and tested a set of SOPs to investigate mouse behavior. Five research centers were involved across France, Germany, Italy, and the UK in this study, as part of the EUMORPHIA program. All the procedures underwent a cross-validation experimental study to investigate the robustness of the designed protocols. Four inbred reference strains (C57BL/6J, C3HeB/FeJ, BALB/cByJ, 129S2/SvPas), reflecting their use as common background strains in mutagenesis programs, were analyzed to validate these tests. We demonstrate that the operating procedures employed, which includes open field, SHIRPA, grip-strength, rotarod, Y-maze, prepulse inhibition of acoustic startle response, and tail flick tests, generated reproducible results between laboratories for a number of the test output parameters. However, we also identified several uncontrolled variables that constitute confounding factors in behavioral phenotyping. The EUMORPHIA SOPs described here are an important start-point for the ongoing development of increasingly robust phenotyping platforms and their application in large-scale, multicentre mouse phenotyping programs.

Mice deficient in the alpha subunit of G(z) show changes in pre-pulse inhibition, anxiety and responses to 5-HT(1A) receptor stimulation, which are strongly dependent on the genetic background

RATIONALE

G(z), a member of the G(i) G protein family, is involved in the coupling of dopaminergic and serotonergic receptors. In the present study, we investigated behaviour of mice deficient in the alpha subunit of G(z) and focused on pre-pulse inhibition (PPI) and anxiety-like responses and the role of serotonin-1A (5-HT(1A)) receptors.

MATERIALS AND METHODS

We compared male and female wild-type and knock-out mice on either a C57Bl/6 or Balb/c background. We used automated startle boxes to assess startle and PPI and elevated plus maze to assess anxiety-like behaviours.

RESULTS

Balb/c mice showed higher baseline PPI than C57Bl/6 mice, and there was no difference between the genotypes. The 5-HT(1A) receptor agonist, 8-hydroxy-di-propylaminotetralin (8-OH-DPAT), had no effect on PPI in C57Bl/6 mice but markedly increased PPI in Balb/c mice, with the effect being attenuated in Galpha(z) knock-outs. On the elevated plus maze, there was little effect of the knock-out or 8-OH-DPAT in C57Bl/6 mice, whereas in Balb/c mice, Galpha(z) knock-outs showed a phenotype of high levels of anxiety-like behaviour. 8-OH-DPAT was anxiogenic in Balb/c mice, but this effect was attenuated in Galpha(z) knock-outs.

CONCLUSIONS

5-HT(1A) receptors couple to G(z). In a strictly background strain-dependent manner, Galpha(z) knock-out mice display high levels of anxiety-like behaviour and are less sensitive to the action of 8-OH-DPAT. Balb/c mice show much more clear effects of the Galpha(z) knock-out than C57Bl/6 mice, which are often considered the standard background strain for genetic modifications. Therefore, our results suggest caution when studying the behavioural effects of genetic modifications only in C57Bl/6 mice.

The duration of capture and restraint during anesthesia and euthanasia influences glucocorticoid levels in male golden hamsters

Deep litter has been shown to decrease stereotypic wire-gnawing in male golden hamsters, suggesting that increased litter depth may be associated with decreased chronic stress levels. To determine the relationship between litter depth and stress levels in hamsters, the authors measured serum levels of corticosterone, cortisol, and ACTH in male golden hamsters kept in cages with three different depths of litter. The duration of handling the hamsters significantly increased the concentrations of corticosterone, cortisol, and the ratio of cortisol/corticosterone. It took longer to catch hamsters housed in cages with deep litter and the ACTH levels were higher in these hamsters. The positive effect of the enrichment (deep litter) was diminished by methodological problems during handling/anesthesia.

Quantitative measurement of postural sway in mouse models of human neurodegenerative disease

Detection of motor dysfunction in genetic mouse models of neurodegenerative disease requires reproducible, standardized and sensitive behavioral assays. We have utilized a center of pressure (CoP) assay in mice to quantify postural sway produced by genetic mutations that affect motor control centers of the brain. As a positive control for postural instability, wild type mice were injected with harmaline, a tremorigenic agent, and the average areas of the 95% confidence ellipse, which measures 95% of the CoP trajectory values recorded in a single trial, were measured. Ellipse area significantly increased in mice treated with increasing doses of harmaline and returned to control values after recovery. We also examined postural sway in mice expressing mutations that mimic frontotemporal dementia with Parkinsonism linked to chromosome 17 (FTDP-17) (T-279, P301L or P301L-nitric oxide synthase 2 (NOS2)(-/-) mice) and that demonstrate motor symptoms. These mice were then compared with a mouse model of Alzheimer's disease (APPSwDI mice) that demonstrates cognitive, but not motor deficits. T-279 and P301L-NOS2(-/-) mice demonstrated a significant increase in CoP ellipse area compared with appropriate wild type control mice or to mice expressing the P301L mutation alone. In contrast, postural instability was significantly reduced in APPSwDI mice that have cognitive deficits but do not have associated motor deficits. The CoP assay provides a simple, sensitive and quantitative tool to detect motor deficits resulting from postural abnormalities in mice and may be useful in understanding the underlying mechanisms of disease.

Hypolocomotion, anxiety and serotonin syndrome-like behavior contribute to the complex phenotype of serotonin transporter knockout mice

Although mice with a targeted disruption of the serotonin transporter (SERT) have been studied extensively using various tests, their complex behavioral phenotype is not yet fully understood. Here we assess in detail the behavior of adult female SERT wild type (+/+), heterozygous (+/-) and knockout (-/-) mice on an isogenic C57BL/6J background subjected to a battery of behavioral paradigms. Overall, there were no differences in the ability to find food or a novel object, nest-building, self-grooming and its sequencing, and horizontal rod balancing, indicating unimpaired sensory functions, motor co-ordination and behavioral sequencing. In contrast, there were striking reductions in exploration and activity in novelty-based tests (novel object, sticky label and open field tests), accompanied by pronounced thigmotaxis, suggesting that combined hypolocomotion and anxiety (rather than purely anxiety) influence the SERT -/- behavioral phenotype. Social interaction behaviors were also markedly reduced. In addition, SERT -/- mice tended to move close to the ground, frequently displayed spontaneous Straub tail, tics, tremor and backward gait - a phenotype generally consistent with 'serotonin syndrome'-like behavior. In line with replicated evidence of much enhanced serotonin availability in SERT -/- mice, this serotonin syndrome-like state may represent a third factor contributing to their behavioral profile. An understanding of the emerging complexity of SERT -/- mouse behavior is crucial for a detailed dissection of their phenotype and for developing further neurobehavioral models using these mice.

What's wrong with my mouse model?

Stress plays a key role in pathogenesis of anxiety and depression. Animal models of these disorders are widely used in behavioral neuroscience to explore stress-evoked brain abnormalities, screen anxiolytic/antidepressant drugs and establish behavioral phenotypes of gene-targeted or transgenic animals. Here we discuss the current situation with these experimental models, and critically evaluate the state of the art in this field. Noting a deficit of fresh ideas and especially new paradigms for animal anxiety and depression models, we review existing challenges and outline important directions for further research in this field.

Behavioral models of Parkinson's disease in rodents: a new look at an old problem

The circuitry important for voluntary movement is influenced by dopamine from the substantia nigra and regulated by the nigrostriatal system. The basal ganglia influence the pyramidal tract and other motor systems, such as the mesopontine nuclei and the rubrospinal tract. Although the neuroanatomical substrates underlying motor control are similar for humans and rodents, the behavioral repertoire mediated by those circuits is not. The principal aim of this review is to evaluate how injury to dopamine-mediated pathways in rodents gives rise to motor dysfunction that mimics human Parkinsonism. We will examine the behavioral tests in common use with rodent models of Parkinson's disease and critically evaluate the appropriateness of each test for detecting motor impairment. We will show how tests of motor performance must be guided by a thorough understanding of the clinical symptoms accompanying the disease, the circuitry mediating dopamine deficits in rodents, and familiarity with the rodent behavioral repertoire. We will explain how investigations in rodents of skilled forepaw actions, including placing, grooming, or foot faults, have clear correlates in Parkinson's disease, and are, therefore, the most sensitive ways of detecting motor impairment following dopamine loss from the basal ganglia of rodents.

Methods to rapidly and accurately screen a large number of ENU mutagenized mice for abnormal motor phenotypes

In a dominant genetic screen for late-onset motor impairments in mice, 16-20-week-old N-nitroso-N-ethylurea (ENU)-mutagenized females were subjected to a behavioural test battery consisting of a visual assessment followed by the vertical pole, rotarod and grip strength tests. SOD1-G93A transgenic mice were tested in parallel as a positive control to provide information on the validity and sensitivity of the screen. From among the 1500 G1 ENU mice screened, four affected mice with impaired motor function were classified as outliers. Approximately 32% of the G2 and G3 progeny of one outlier were affected. Vertical pole, rotarod and grip strength test scores were significantly correlated with each other and with body weight in the G1 progeny, but the correlation with body weight was not maintained in the G2 and G3 progeny. We found that two tests, tail suspension and vertical pole, were sufficient to distinguish ENU outliers and SOD1-G93A hemizygotes from control mice, and could detect abnormalities earlier and more frequently than the other tests employed.