Improving reproducibility in animal research

Best practices for data management and sharing in experimental biomedical research

Effective data management is crucial for scientific integrity and reproducibility, a cornerstone of scientific progress. Well-organized and well-documented data enable validation and building on results. Data management encompasses activities including organization, documentation, storage, sharing, and preservation. Robust data management establishes credibility, fostering trust within the scientific community and benefiting researchers' careers. In experimental biomedicine, comprehensive data management is vital due to the typically intricate protocols, extensive metadata, and large datasets. Low-throughput experiments, in particular, require careful management to address variations and errors in protocols and raw data quality. Transparent and accountable research practices rely on accurate documentation of procedures, data collection, and analysis methods. Proper data management ensures long-term preservation and accessibility of valuable datasets. Well-managed data can be revisited, contributing to cumulative knowledge and potential new discoveries. Publicly funded research has an added responsibility for transparency, resource allocation, and avoiding redundancy. Meeting funding agency expectations increasingly requires rigorous methodologies, adherence to standards, comprehensive documentation, and widespread sharing of data, code, and other auxiliary resources. This review provides critical insights into raw and processed data, metadata, high-throughput versus low-throughput datasets, a common language for documentation, experimental and reporting guidelines, efficient data management systems, sharing practices, and relevant repositories. We systematically present available resources and optimal practices for wide use by experimental biomedical researchers.

Measuring the replicability of our own research

In the study of transgenic mouse models of neurodevelopmental and neurodegenerative disorders, we use batteries of tests to measure deficits in behaviour and from the results of these tests, we make inferences about the mental states of the mice that we interpret as deficits in "learning", "memory", "anxiety", "depression", etc. This paper discusses the problems of determining whether a particular transgenic mouse is a valid mouse model of disease X, the problem of background strains, and the question of whether our behavioural tests are measuring what we say they are. The problem of the reliability of results is then discussed: are they replicable between labs and can we replicate our results in our own lab? This involves the study of intra- and inter- experimenter reliability. The variables that influence replicability and the importance of conducting a complete behavioural phenotype: sensory, motor, cognitive and social emotional behaviour are discussed. Then the thorny question of failure to replicate is examined: Is it a curse or a blessing? Finally, the role of failure in research and what it tells us about our research paradigms is examined.

Neurobehavioral effects of fungicides in zebrafish: a systematic review and meta-analysis

Pesticides are widely used in global agriculture to achieve high productivity levels. Among them, fungicides are specifically designed to inhibit fungal growth in crops and seeds. However, their application often results in environmental contamination, as these chemicals can persistently be detected in surface waters. This poses a potential threat to non-target organisms, including humans, that inhabit the affected ecosystems. In toxicologic research, the zebrafish (Danio rerio) is the most commonly used fish species to assess the potential effects of fungicide exposure, and numerous and sometimes conflicting findings have been reported. To address this, we conducted a systematic review and meta-analysis focusing on the neurobehavioral effects of fungicides in zebrafish. Our search encompassed three databases (PubMed, Scopus, and Web of Science), and the screening process followed predefined inclusion/exclusion criteria. We extracted qualitative and quantitative data, as well as assessed reporting quality, from 60 included studies. Meta-analyses were performed for the outcomes of distance traveled in larvae and adults and spontaneous movements in embryos. The results revealed a significant overall effect of fungicide exposure on distance, with a lower distance traveled in the exposed versus control group. No significant effect was observed for spontaneous movements. The overall heterogeneity was high for distance and moderate for spontaneous movements. The poor reporting practices in the field hindered a critical evaluation of the studies. Nevertheless, a sensitivity analysis did not identify any studies skewing the meta-analyses. This review underscores the necessity for better-designed and reported experiments in this field.

Dose-dependent progression of multiple low-dose streptozotocin-induced diabetes in mice

This study investigated the effects of different multiple low doses of streptozotocin (STZ), namely 35 and 55 mg/kg, on the onset and progression of diabetes in mice. Both doses are commonly used in research, and although both induced a loss of beta cell mass, they had distinct effects on whole glucose tolerance, beta cell function, and gene transcription. Mice treated with 55 mg/kg became rapidly glucose intolerant, whereas those treated with 35 mg/kg had a slower onset and remained glucose tolerant for up to a week before becoming equally glucose intolerant as the 55 mg/kg group. Beta cell mass loss was similar between the two groups, but the 35 mg/kg-treated mice had improved glucose-stimulated insulin secretion in gold-standard hyperglycemic clamp studies. Transcriptomic analysis revealed that the 55 mg/kg dose caused disruptions in nearly five times as many genes as the 35 mg/kg dose in isolated pancreatic islets. Pathways that were downregulated in both doses were more downregulated in the 55 mg/kg-treated mice, whereas pathways that were upregulated in both doses were more upregulated in the 35 mg/kg-treated mice. Moreover, we observed a differential downregulation in the 55 mg/kg-treated islets of beta cell characteristic pathways, such as exocytosis or hormone secretion. On the other hand, apoptosis was differentially upregulated in 35 mg/kg-treated islets, suggesting different transcriptional mechanisms in the onset of STZ-induced damage in the islets. This study demonstrates that the two STZ doses induce distinctly mechanistic progressions for the loss of functional beta cell mass.

Dose-dependent progression of multiple low dose streptozotocin-induced diabetes in mice

This study investigated the effects of different multiple low doses of streptozotocin (STZ), namely 35 and 55 mg/kg, on the onset and progression of diabetes in mice. Both doses are commonly used in research, and while both induced a loss of beta cell mass, they had distinct effects on whole glucose tolerance, beta cell function and gene transcription. Mice treated with 55 mg/kg became rapidly glucose intolerant, whereas those treated with 35 mg/kg had a slower onset and remained glucose tolerant for up to a week before becoming equally glucose intolerant as the 55 mg/kg group. Beta cell mass loss was similar between the two groups, but the 35 mg/kg-treated mice had improved glucose-stimulated insulin secretion in gold-standard hyperglycemic clamp studies. Transcriptomic analysis revealed that the 55 mg/kg dose caused disruptions in nearly five times as many genes as the 35 mg/kg dose in isolated pancreatic islets. Pathways that were downregulated in both doses were more downregulated in the 55 mg/kg-treated mice, while pathways that were upregulated in both doses were more upregulated in the 35 mg/kg treated mice. Moreover, we observed a differential downregulation in the 55 mg/kg-treated islets of beta cell characteristic pathways, such as exocytosis or hormone secretion. On the other hand, apoptosis was differentially upregulated in 35 mg/kg-treated islets, suggesting different transcriptional mechanisms in the onset of STZ-induced damage in the islets. This study demonstrates that the two STZ doses induce distinctly mechanistic progressions for the loss of functional beta cell mass.

Rigor Me This: What Are the Basic Criteria for a Rigorous, Transparent, and Reproducible Scientific Study?

Scientific advancement is predicated upon the ability of a novel discovery to be independently reproduced and substantiated by others. Despite this inherent necessity, the research community is awash in published studies that cannot be replicated resulting in widespread confusion within the field and waning trust from the general public. In many cases, irreproducibility is the unavoidable consequence of a study that is conducted without the appropriate degree of rigor, typified by fundamental flaws in approach, design, execution, analysis, interpretation, and reporting. Combatting the irreproducibility pandemic in preclinical research is of urgent concern and is the primary responsibility of individual investigators, however there are important roles to be played by institutions, journals, government entities, and funding agencies as well. Herein, we provide an updated review of established rigor criteria pertaining to both in vitro and in vivo studies compiled from multiple sources across the research enterprise and present a practical checklist as a straightforward reference guide. It is our hope that this review may serve as an approachable resource for early career and experienced investigators alike, as they strive to improve all aspects of their scientific endeavors.

Challenges of a small world analysis for the continuous monitoring of behavior in mice

Documenting a mouse's "real world" behavior in the "small world" of a laboratory cage with continuous video recordings offers insights into phenotypical expression of mouse genotypes, development and aging, and neurological disease. Nevertheless, there are challenges in the design of a small world, the behavior selected for analysis, and the form of the analysis used. Here we offer insights into small world analyses by describing how acute behavioral procedures can guide continuous behavioral methodology. We show how algorithms can identify behavioral acts including walking and rearing, circadian patterns of action including sleep duration and waking activity, and the organization of patterns of movement into home base activity and excursions, and how they are altered with aging. We additionally describe how specific tests can be incorporated within a mouse's living arrangement. We emphasize how machine learning can condense and organize continuous activity that extends over extended periods of time.

Caught on Camera: On the Need of Responsible Use of Video Observation for Animal Behavior and Welfare Research

Video analysis is a popular and frequently used tool in animal behavior and welfare research. In addition to the actual object of research, video recordings often provide unforeseen information about the progress of the study, the animals or the people involved. Conflicts can arise when this information is weighed against the original intention of the recordings and broader social expectations. Uncertainty may prevent the video observers, often less experienced researchers, to properly address these conflicts, which can pose a threat to animal welfare and research quality and integrity. In this article, we aim to raise awareness of the interrelationship of variables characteristic for video-based animal studies and the potential conflicts emerging from this. We propose stepping stones for a framework which enables a culture of openness in dealing with unexpected and unintended events observed during video analysis. As a basis, a frame of reference regarding privacy and duty of care toward animals should be created and shared with all persons involved. At this stage, expectations and responsibilities need to be made explicit. During running and reporting of the study, the risk of animal welfare and research integrity issues can be mitigated by making conflicts discussible and offering realistic opportunities on how to deal with them. A practice which is outlined and guided by conversation will prevent a mere compliance-based approach centered on checklists and decision trees. Based on these stepping stones, educational material can be produced to foster reflection, co-creation and application of ethical practice.

Neuroinflammation, body temperature and behavioural changes in CD1 male mice undergoing acute restraint stress: An exploratory study

BACKGROUND

Animal models used to study pathologies requiring rehabilitation therapy, such as cardiovascular and neurologic disorders or oncologic disease, must be as refined and translationally relevant as possible. Sometimes, however, experimental procedures such as those involving restraint may generate undesired effects which may act as a source of bias. However, the extent to which potentially confounding effects derive from such routine procedures is currently unknown. Our study was therefore aimed at exploring possible undesirable effects of acute restraint stress, whereby animals were exposed to a brightly lit enclosed chamber (R&L) similar to those that are commonly used for substance injection. We hypothesised that this would induce a range of unwanted physiological alterations [such as neuroinflammatory response and changes in body weight and in brown adipose tissue (BAT)] and behavioural modification, and that these might be mitigated via the use of non-aversive handling methods: Tunnel Handling (NAH-T) and Mechanoceptive Handling (NAH-M)) as compared to standard Tail Handling (TH).

METHODS

Two indicators of physiological alterations and three potentially stress sensitive behavioural parameters were assessed. Physiological alterations were recorded via body weight changes and assessing the temperature of Brown Adipose Tissue (BAT) using infra-red thermography (IRT), and at the end of the experiment we determined the concentration of cytokines CXCL12 and CCL2 in bone marrow (BM) and activated microglia in the brain. Nest complexity scoring, automated home-cage behaviour analysis (HCS) and Elevated Plus Maze testing (EPM) were used to detect any behavioural alterations. Recordings were made before and after a 15-minute period of R&L in groups of mice handled via TH, NAH-T or NAH-M.

RESULTS

BAT temperature significantly decreased in all handling groups following R&L regardless of handling method. There was a difference, at the limit of significance (p = 0.06), in CXCL12 BM content among groups. CXCL12 content in BM of NAH-T animals was similar to that found in Sentinels, the less stressed group of animals. After R&L, mice undergoing NAH-T and NAH-M showed improved body-weight maintenance compared to those exposed to TH. Mice handled via NAH-M spent a significantly longer time on the open arms of the EPM. The HCS results showed that in all mice, regardless of handling method, R&L resulted in a significant reduction in walking and rearing, but not in total distance travelled. All mice also groomed more. No difference among the groups was found in Nest Score, in CCL2 BM content or in brain activated microglia.

CONCLUSIONS

Stress induced by a common restraint procedure caused metabolic and behavioural changes that might increase the risk of unexpected bias. In particular, the significant decrease in BAT temperature could affect the important metabolic pathways controlled by this tissue. R&L lowered the normal frequency of walking and rearing, increased grooming and probably carried a risk of low-grade neuro-inflammation. Some of the observed alterations can be mitigated by Non-aversive handlings.

Evaluating the clinical translational relevance of animal models for limbal stem cell deficiency: A systematic review

PURPOSE

Animal models are pivotal for elucidating pathophysiological mechanisms and evaluating novel therapies. This systematic review identified studies that developed or adapted animal models of limbal stem cell deficiency (LSCD), assessed their reporting quality, summarized their key characteristics, and established their clinical translational relevance to human disease.

METHODS

The protocol was prospectively registered (PROSPERO CRD42020203937). Searches were conducted in PubMed, Ovid EMBASE and Web of Science in August 2020. Two authors screened citations, extracted data, assessed the reporting quality of eligible studies using the ARRIVE guidelines, and judged the clinical translational relevance of each model using a custom matrix.

RESULTS

105 studies were included. Rabbits were the most common animal species. Overall, 97% of studies recapitulated LSCD to a clinical etiology, however 62% did not provide sufficient methodological detail to enable independent reproduction of the model. Adverse events and/or exclusion of animals were infrequently (20%) reported. Approximately one-quarter of studies did not produce the intended severity of LSCD; 34% provided insufficient information to assess the fidelity of disease induction. Adjunctive diagnostic confirmation of LSCD induction was performed in 13% of studies.

CONCLUSIONS

This is the first systematic review to assess the reporting quality and clinical translational relevance of animal models of LSCD. Models of LSCD have evolved over time, resulting in variable reporting of the characteristics of animals, experimental procedures and adverse events. In most studies, validation of LSCD was made using clinical tests; newer adjunctive techniques would enhance diagnostic validation. As most studies sought to evaluate novel therapies for LSCD, animal models should ideally recapitulate all features of the condition that develop in patients.

Awareness of Animal Welfare and the Law among Undergraduate Students in a Brazilian Medical School

This study aimed to evaluate medical and biomedical students' knowledge about legislation related to the use of animals in research (Arouca's Law), at the Federal University of São Paulo, Brazil. We received 62 responses to our online questionnaire of which 44 were considered valid. Only 25.3% of the students were aware of Arouca's Law and 15% of them had read it. The majority of the participants (54.5%) were not aware of the penalties established by this legislation and had not attended classes regarding animal bioethics (70.5%). Those who had attended courses about animal experimentation were less likely to begin their experiments without approval (p=0.03) and more likely not to use more animals than the number approved by the ethics committee (p=0.05). Overall, the results showed a lack of knowledge among students about animal bioethics legislation, and a failure on the part of the students' advisors to provide this information. The results highlight the need for more training on animal bioethics, better monitoring of compliance with the legislation and for courses on the subject for both students and advisors.