Statistical design considerations in animal studies published recently in cancer research

A review of animal models utilized in preclinical studies of approved gene therapy products: trends and insights

Scientific progress heavily relies on rigorous research, adherence to scientific standards, and transparent reporting. Animal models play a crucial role in advancing biomedical research, especially in the field of gene therapy. Animal models are vital tools in preclinical research, allowing scientists to predict outcomes and understand complex biological processes. The selection of appropriate animal models is critical, considering factors such as physiological and pathophysiological similarities, availability, and ethical considerations. Animal models continue to be indispensable tools in preclinical gene therapy research. Advancements in genetic engineering and model selection have improved the fidelity and relevance of these models. As gene therapy research progresses, careful consideration of animal models and transparent reporting will contribute to the development of effective therapies for various genetic disorders and diseases. This comprehensive review explores the use of animal models in preclinical gene therapy studies for approved products up to September 2023. The study encompasses 47 approved gene therapy products, with a focus on preclinical trials. This comprehensive analysis serves as a valuable reference for researchers in the gene therapy field, aiding in the selection of suitable animal models for their preclinical investigations.

Methodological rigour in preclinical urology: a systematic review reporting research quality over a 14-year period

OBJECTIVE

To investigate the prevalence and trends of essential study design elements in preclinical urological studies, as well as key factors that may improve methodological rigour, as the demand for methodological rigour in preclinical studies is increasing since research reproducibility and transparency in the medico-scientific field are being questioned.

METHODS AND RESULTS

PubMed was searched to include preclinical urological studies published between July 2007 to June 2021. A total of 3768 articles met the inclusion criteria. Data on study design elements and animal models used were collected. Citation density was also examined as a surrogate marker of study influence. We performed an analysis of the prevalence of seven critical study design elements and temporal patterns over 14 years. Randomisation was reported in 50.0%, blinding in 15.0%, sample size estimation in 1.0%, inclusion of both sexes in 6.3%, statistical analysis in 97.1%, housing and husbandry in 47.7%, and inclusion/exclusion criteria in 5.0%. Temporal analysis showed that the implementation of these study design elements has increased, except for inclusion of both sexes and inclusion/exclusion criteria. Reporting study design elements were associated with increased citation density in randomisation and statistical analysis.

CONCLUSIONS

The risk of bias is prevalent in 14-year publications describing preclinical urological research, and the quality of methodological rigour is barely related to the citation density of the article. Yet five study design elements (randomisation, blinding, sample size estimation, statistical analysis, and housing and husbandry) proposed by both the National Institutes of Health and Animal Research: Reporting of In Vivo Experiments guidelines have been either well reported or are being well reported over time.

SYSTEMATIC REVIEW REGISTRATION

PROSPERO CRD42022233125.

Advocating for Generalizability: Accepting Inherent Variability in Translation of Animal Research Outcomes

Advancing scientific discovery requires investigators to embrace research practices that increase transparency and disclosure about materials, methods, and outcomes. Several research advocacy and funding organizations have produced guidelines and recommended practices to enhance reproducibility through detailed and rigorous research approaches; however, confusion around vocabulary terms and a lack of adoption of suggested practices have stymied successful implementation. Although reproducibility of research findings cannot be guaranteed due to extensive inherent variables in attempts at experimental repetition, the scientific community can advocate for generalizability in the application of data outcomes to ensure a broad and effective impact on the comparison of animals to translation within human research. This report reviews suggestions, based upon work with National Institutes of Health advisory groups, for improving rigor and transparency in animal research through aspects of experimental design, statistical assessment, and reporting factors to advocate for generalizability in the application of comparative outcomes between animals and humans.

Integrated Genomic Selection for Accelerating Breeding Programs of Climate-Smart Cereals

Rapidly rising population and climate changes are two critical issues that require immediate action to achieve sustainable development goals. The rising population is posing increased demand for food, thereby pushing for an acceleration in agricultural production. Furthermore, increased anthropogenic activities have resulted in environmental pollution such as water pollution and soil degradation as well as alterations in the composition and concentration of environmental gases. These changes are affecting not only biodiversity loss but also affecting the physio-biochemical processes of crop plants, resulting in a stress-induced decline in crop yield. To overcome such problems and ensure the supply of food material, consistent efforts are being made to develop strategies and techniques to increase crop yield and to enhance tolerance toward climate-induced stress. Plant breeding evolved after domestication and initially remained dependent on phenotype-based selection for crop improvement. But it has grown through cytological and biochemical methods, and the newer contemporary methods are based on DNA-marker-based strategies that help in the selection of agronomically useful traits. These are now supported by high-end molecular biology tools like PCR, high-throughput genotyping and phenotyping, data from crop morpho-physiology, statistical tools, bioinformatics, and machine learning. After establishing its worth in animal breeding, genomic selection (GS), an improved variant of marker-assisted selection (MAS), has made its way into crop-breeding programs as a powerful selection tool. To develop novel breeding programs as well as innovative marker-based models for genetic evaluation, GS makes use of molecular genetic markers. GS can amend complex traits like yield as well as shorten the breeding period, making it advantageous over pedigree breeding and marker-assisted selection (MAS). It reduces the time and resources that are required for plant breeding while allowing for an increased genetic gain of complex attributes. It has been taken to new heights by integrating innovative and advanced technologies such as speed breeding, machine learning, and environmental/weather data to further harness the GS potential, an approach known as integrated genomic selection (IGS). This review highlights the IGS strategies, procedures, integrated approaches, and associated emerging issues, with a special emphasis on cereal crops. In this domain, efforts have been taken to highlight the potential of this cutting-edge innovation to develop climate-smart crops that can endure abiotic stresses with the motive of keeping production and quality at par with the global food demand.

Investigator brochures for phase I/II trials lack information on the robustness of preclinical safety studies

AIM

Meaningful and ethical phase I/II trials can only be conducted with supportive prospective risk-benefit assessment. This relies largely on preclinical animal studies addressing the safety and efficacy of treatments. These studies are reported in an Investigator's Brochure (IB) to inform ethics review boards and regulatory authorities. Our study investigated the extent, reporting quality and accessibility of preclinical safety studies (PCSSs) compiled in IBs.

METHODS

We analysed a sample of 46 IBs for phase I/II trials approved at a leading German university medical centre from 2010 to 2016. We extracted all PCSSs presented in the 46 IBs and assessed them for reporting on methodological measures to reduce validity threats.

RESULTS

The 46 IBs included 777 PCSSs. Blinded outcome assessment, randomization and sample size calculation were reported for fewer than 1% of studies. Only 5% of the PCSSs provided a reference to published data. Compliance with Good Laboratory Practice (GLP) guidance was reported for 52% of PCSSs, but the GLP document itself does not include any relevant methodological requirements for the reduction of validity threats.

CONCLUSION

Scarce reporting in IBs and the very limited publicly available data on PCSSs make it almost impossible for investigators to critically evaluate the robustness of preclinical evidence of drug safety. Combined with recent findings on the presentation of preclinical efficacy studies in IBs, we conclude that the current reporting patterns in IBs strongly limit the independent review of evidential support for early human trials. Regulatory authorities and IRBs should require better reporting in IBs.

Improving Replicability, Reproducibility, And Reliability In Preclinical Research: A Shared Responsibility

Reproducible and reliable scientific investigation depends on the identification and consideration of various intrinsic and extrinsic factors that may affect the model system used. The impact of these factors must be managed during all phases of a study: planning, execution, and reporting. The value of in vivo (animal) research has come under increasing scrutiny over the past decade because of multiple reports documenting poor translatability to human studies. These failures have been attributed to various causes, including poor study design and execution as well as deficiencies in reporting. It is important to recognize that achieving reproducible and reliable preclinical research results is a joint responsibility that requires a partnership between the investigative team and the animal care and use program staff. The myriad of intrinsic factors, such as species, strain/substrain, age, sex, physiologic and health status, and extrinsic factors, including temperature, humidity, lighting, housing system, and diet, need to be recognized and managed during study planning and execution, as they can influence animal physiology and biological response. Of equal importance is the need to document and report these details. The ARRIVE and PREPARE guidelines were developed by concerned scientists, veterinarians, statisticians, journal editors, and funding agencies to assist investigative teams and scientific journals manage and report on intrinsic and extrinsic factors to improve reproducibility and reliability. This issue of the ILAR Journal will focus on the various extrinsic factors that have been recognized to confound animal research.

A study to assess the methodological quality of in vivo animal experiments published in Indian journal of pharmacology: A retrospective, cross-sectional, observational study

BACKGROUND

Good reporting of experimental research is a vital part of research process. Although the reporting guidelines such as Animal research: Reporting in vivo experiments (ARRIVE) require the authors to stick to a standard format, they do not guarantee study reports' validity. For assessing the study reports validity, critical appraisal tools are required.

OBJECTIVE

The evaluation of the methodological quality of in vivo animal studies of Indian Journal of Pharmacology (IJP) published between 2011 and 2017 through critical appraisal was the primary objective. The secondary objective was to evaluate the adherence of selected studies to the ARRIVE guidelines.

MATERIALS AND METHODS

All in vivo animal studies published as full-text articles in IJP from January 2011 to December 2017 and satisfying the inclusion norms were included. A checklist based on the underlying principles of ARRIVE statement was applied to in vivo animal research (AR) published in IJP. For critical appraisal of reports, risk-of-bias domains were also applied on studies from in vivo AR.

RESULTS

One hundred and sixty-one studies satisfied the inclusion criteria. Seventy-three articles (45.34%, 95% confidence interval [CI]: 0.37-0.53) discussed about randomization procedure. Eighteen articles (11.18%, 95% CI: 0.07-0.16) gave details about blinding when assessing results. None of the studies provided details of sample size calculation. Eight articles (4.97%, 95% CI: 0.02-0.09) commented on the study limitations.

CONCLUSION

It was found that adherence to only some criteria of ARRIVE guidelines was subpar. There is a need for optimal reporting of random distribution of animals to experimental groups, concealment of allocation, blinded outcome evaluation, computation of sample size, and attrition of animals for improving the validity of AR.

How to design preclinical studies in nanomedicine and cell therapy to maximize the prospects of clinical translation

The clinical translation of promising products, technologies and interventions from the disciplines of nanomedicine and cell therapy has been slow and inefficient. In part, translation has been hampered by suboptimal research practices that propagate biases and hinder reproducibility. These include the publication of small and underpowered preclinical studies, suboptimal study design (in particular, biased allocation of experimental groups, experimenter bias and lack of necessary controls), the use of uncharacterized or poorly characterized materials, poor understanding of the relevant biology and mechanisms, poor use of statistics, large between-model heterogeneity, absence of replication, lack of interdisciplinarity, poor scientific training in study design and methods, a culture that does not incentivize transparency and sharing, poor or selective reporting, misaligned incentives and rewards, high costs of materials and protocols, and complexity of the developed products, technologies and interventions. In this Perspective, we discuss special manifestations of these problems in nanomedicine and in cell therapy, and describe mitigating strategies. Progress on reducing bias and enhancing reproducibility early on ought to enhance the translational potential of biomedical findings and technologies.

Animal experimental research design in critical care

Background

Limited translational success in critical care medicine is thought to be in part due to inadequate methodology, study design, and reporting in preclinical studies. The purpose of this study was to compare reporting of core features of experimental rigor: blinding, randomization, and power calculations in critical care medicine animal experimental research. We hypothesized that these study design characteristics were more frequently reported in 2015 versus 2005.

Methods

We performed an observational bibliometric study to grade manuscripts on blinding, randomization, and power calculations. Chi-square tests and logistic regression were used for analysis. Inter-rater agreement was assessed using kappa and Gwet’s AC1.

Results

A total of 825 articles from seven journals were included. In 2005, power estimations were reported in 2%, randomization in 35%, and blinding in 20% (n = 482). In 2015, these metrics were included in 9, 47, and 36% of articles (n = 343). The increase in proportion for the metrics tested was statistically significant (p < 0.001, p = 0.002, and p < 0.001).

Conclusions

Only a minority of published manuscripts in critical care medicine journals reported on recommended study design steps to increase rigor. Routine justification for the presence or absence of blinding, randomization, and power calculations should be considered to better enable readers to assess potential sources of bias.

The Physiological Mechanisms of Effect of Vitamins and Amino Acids on Tendon and Muscle Healing: A Systematic Review

Aims/Objectives: To evaluate the current literature via systematic review to ascertain whether amino acids/vitamins provide any influence on musculotendinous healing and if so, by which physiological mechanisms. Methods: EBSCO, PubMed, ScienceDirect, Embase Classic/Embase, and MEDLINE were searched using terms including “vitamins,” “amino acids,” “healing,” “muscle,” and “tendon.” The primary search had 479 citations, of which 466 were excluded predominantly due to nonrandomized design. Randomized human and animal studies investigating all supplement types/forms of administration were included. Critical appraisal of internal validity was assessed using the Cochrane risk of Bias Tool or the Systematic Review Centre for Laboratory Animal Experimentation Risk of Bias Tool for human and animal studies, respectively. Two reviewers performed duel data extraction. Results: Twelve studies met criteria for inclusion: eight examined tendon healing and four examined muscle healing. All studies used animal models, except two human trials using a combined integrator. Narrative synthesis was performed via content analysis of demonstrated statistically significant effects and thematic analysis of proposed physiological mechanisms of intervention. Vitamin C/taurine demonstrated indirect effects on tendon healing through antioxidant activity. Vitamin A/glycine showed direct effects on extracellular matrix tissue synthesis. Vitamin E shows an antiproliferative influence on collagen deposition. Leucine directly influences signaling pathways to promote muscle protein synthesis. Discussion: Preliminary evidence exists, demonstrating that vitamins and amino acids may facilitate multilevel changes in musculotendinous healing; however, recommendations on clinical utility should be made with caution. All animal studies and one human study showed high risk of bias with moderate interobserver agreement (k = 0.46). Currently, there is limited evidence to support the use of vitamins and amino acids for musculotendinous injury. Both high-quality animal experimentation of the proposed mechanisms confirming the physiological influence of supplementation and human studies evaluating effects on tissue morphology and biochemistry are required before practical application.

Efficient two-stage designs and proper inference for animal studies

Cost-effective yet efficient designs are critical to the success of animal studies. We propose a two-stage design for cost-effectiveness animal studies with continuous outcomes. Given the data from the two-stage design, we derive the exact distribution of the test statistic under null hypothesis to appropriately adjust for the design's adaptiveness. We further generalize the design and inferential procedure to the K-sample case with multiple comparison adjustment. We conduct simulation studies to evaluate the small sample behavior of the proposed design and test procedure. The results indicate that the proposed test procedure controls the type I error rate for the one-sample design and the family-wise error rate for K-sample design very well; whereas the naive approach that ignores the design's adaptiveness due to the interim look severely inflates the type I error rate or family-wise error rate. Compared with the standard one-stage design, the proposed design generally requires a smaller sample size.

Quality of reporting of otorhinolaryngology articles using animal models with the ARRIVE statement

Research involving animal models is crucial for the advancement of science, provided that experiments are designed, performed, interpreted, and reported well. In order to investigate the quality of reporting of articles in otorhinolaryngology research using animal models, a PubMed database search was conducted to retrieve eligible articles. The checklist of the ARRIVE (Animal Research: Reporting of In Vivo Experiments) guidelines was used to assess the quality of reporting of articles published in ear, nose and throat (ENT) and multidisciplinary journals. Two authors screened titles, abstracts, and full texts to select articles reporting otorhinolaryngology research using in vivo animal models. ENT journals ( n = 35) reported a mean of 57.1% adequately scored ARRIVE items (median: 58.3%; 95% confidence interval [CI; 53.4-60.9%]), while articles published in multidisciplinary journals ( n = 36) reported a mean of 49.1% adequately scored items (median: 50.0; 95% CI [46.2-52.0%]). Articles published in ENT journals showed better quality of reporting of animal studies based on the ARRIVE guidelines ( P < 0.05). However, adherence to the ARRIVE guidelines is generally poor in otorhinolaryngology research using in vivo animal models. The endorsement of the ARRIVE guidelines by authors, research and academic institutes, editorial offices and funding agencies is recommended for improved reporting of scientific research using animal models.

Study Design Rigor in Animal-Experimental Research Published in Anesthesia Journals

BACKGROUND

Lack of reproducibility of preclinical studies has been identified as an impediment for translation of basic mechanistic research into effective clinical therapies. Indeed, the National Institutes of Health has revised its grant application process to require more rigorous study design, including sample size calculations, blinding procedures, and randomization steps. We hypothesized that the reporting of such metrics of study design rigor has increased over time for animal-experimental research published in anesthesia journals.

METHODS

PubMed was searched for animal-experimental studies published in 2005, 2010, and 2015 in primarily English-language anesthesia journals. A total of 1466 publications were graded on the performance of sample size estimation, randomization, and blinding. Cochran-Armitage test was used to assess linear trends over time for the primary outcome of whether or not a metric was reported. Interrater agreement for each of the 3 metrics (power, randomization, and blinding) was assessed using the weighted κ coefficient in a 10% random sample of articles rerated by a second investigator blinded to the ratings of the first investigator.

RESULTS

A total of 1466 manuscripts were analyzed. Reporting for all 3 metrics of experimental design rigor increased over time (2005 to 2010 to 2015): for power analysis, from 5% (27/516), to 12% (59/485), to 17% (77/465); for randomization, from 41% (213/516), to 50% (243/485), to 54% (253/465); and for blinding, from 26% (135/516), to 38% (186/485), to 47% (217/465). The weighted κ coefficients and 98.3% confidence interval indicate almost perfect agreement between the 2 raters beyond that which occurs by chance alone (power, 0.93 [0.85, 1.0], randomization, 0.91 [0.85, 0.98], and blinding, 0.90 [0.84, 0.96]).

CONCLUSIONS

Our hypothesis that reported metrics of rigor in animal-experimental studies in anesthesia journals have increased during the past decade was confirmed. More consistent reporting, or explicit justification for absence, of sample size calculations, blinding techniques, and randomization procedures could better enable readers to evaluate potential sources of bias in animal-experimental research manuscripts. Future studies should assess whether such steps lead to improved translation of animal-experimental anesthesia research into successful clinical trials.

Enhancing Scientific Foundations to Ensure Reproducibility: A New Paradigm

Progress in science is dependent on a strong foundation of reliable results. The publish or perish paradigm in research, coupled with an increase in retracted articles from the peer-reviewed literature, is beginning to erode the trust of both the scientific community and the public. The NIH is combating errors by requiring investigators to follow new guidelines addressing scientific premise, experimental design, biological variables, and authentication of reagents. Herein, we discuss how implementation of NIH guidelines will help investigators proactively address pitfalls of experimental design and methods. Careful consideration of the variables contributing to reproducibility helps ensure robust results. The NIH, investigators, and journals must collaborate to ensure that quality science is funded, explored, and published.

The role of the IACUC in ensuring research reproducibility

There is a "village" of people impacting research reproducibility, such as funding panels, the IACUC and its support staff, institutional leaders, investigators, veterinarians, animal facilities, and professional journals. IACUCs can contribute to research reproducibility by ensuring that reviews of animal use requests, program self-assessments and post-approval monitoring programs are sufficiently thorough, the animal model is appropriate for testing the hypothesis, animal care and use is conducted in a manner that is compliant with external and institutional requirements, and extraneous variables are minimized. The persons comprising the village also must have a shared vision that guards against reproducibility problems while simultaneously avoids being viewed as a burden to research. This review analyzes and discusses aspects of the IACUC's "must do" and "can do" activities that impact the ability of a study to be reproduced. We believe that the IACUC, with support from and when working synergistically with other entities in the village, can contribute to minimizing unintended research variables and strengthen research reproducibility.

Microfluidic on-chip biomimicry for 3D cell culture: a fit-for-purpose investigation from the end user standpoint

A plethora of 3D and microfluidics-based culture models have been demonstrated in the recent years with the ultimate aim to facilitate predictive in vitro models for pharmaceutical development. This article summarizes to date the progress in the microfluidics-based tissue culture models, including organ-on-a-chip and vasculature-on-a-chip. Specific focus is placed on addressing the question of what kinds of 3D culture and system complexities are deemed desirable by the biological and biomedical community. This question is addressed through analysis of a research survey to evaluate the potential use of microfluidic cell culture models among the end users. Our results showed a willingness to adopt 3D culture technology among biomedical researchers, although a significant gap still exists between the desired systems and existing 3D culture options. With these results, key challenges and future directions are highlighted.

Survey of basic medical researchers on the awareness of animal experimental designs and reporting standards in China

Objective

To investigate the awareness and use of the Systematic Review Center for Laboratory Animal Experimentation’s (SYRCLE) risk-of-bias tool, the Animal Research: Reporting of In Vivo Experiments (ARRIVE) reporting guidelines, and Gold Standard Publication Checklist (GSPC) in China in basic medical researchers of animal experimental studies.

Methods

A national questionnaire-based survey targeting basic medical researchers was carried in China to investigate the basic information and awareness of SYRCLE’s risk of bias tool, ARRIVE guidelines, GSPC, and animal experimental bias risk control factors. The EpiData3.1 software was used for data entry, and Microsoft Excel 2013 was used for statistical analysis in this study. The number of cases (n) and percentage (%) of classified information were statistically described, and the comparison between groups (i.e., current students vs. research staff) was performed using chi-square test.

Results

A total of 298 questionnaires were distributed, and 272 responses were received, which included 266 valid questionnaires (from 118 current students and 148 research staff). Among the 266 survey participants, only 15.8% was aware of the SYRCLE’s risk of bias tool, with significant difference between the two groups (P = 0.003), and the awareness rates of ARRIVE guidelines and GSPC were only 9.4% and 9.0%, respectively; 58.6% survey participants believed that the reports of animal experimental studies in Chinese literature were inadequate, with significant difference between the two groups (P = 0.004). In addition, only approximately 1/3 of the survey participants had read systematic reviews and meta-analysis reports of animal experimental studies; only 16/266 (6.0%) had carried out/participated in and 11/266 (4.1%) had published systematic reviews/meta-analysis of animal experimental studies.

Conclusions

The awareness and use rates of SYRCLE’s risk-of-bias tool, the ARRIVE guidelines, and the GSPC were low among Chinese basic medical researchers. Therefore, specific measures are necessary to promote and popularize these standards and specifications and to introduce these standards into guidelines of Chinese domestic journals as soon as possible to raise awareness and increase use rates of researchers and journal editors, thereby improving the quality of animal experimental methods and reports.

Experimental Design and Data Analysis Issues Contribute to Inconsistent Results of C-Bouton Changes in Amyotrophic Lateral Sclerosis

The possible presence of pathological changes in cholinergic synaptic inputs [cholinergic boutons (C-boutons)] is a contentious topic within the ALS field. Conflicting data reported on this issue makes it difficult to assess the roles of these synaptic inputs in ALS. Our objective was to determine whether the reported changes are truly statistically and biologically significant and why replication is problematic. This is an urgent question, as C-boutons are an important regulator of spinal motoneuron excitability, and pathological changes in motoneuron excitability are present throughout disease progression. Using male mice of the SOD1-G93A high-expresser transgenic (G93A) mouse model of ALS, we examined C-boutons on spinal motoneurons. We performed histological analysis at high statistical power, which showed no difference in C-bouton size in G93A versus wild-type motoneurons throughout disease progression. In an attempt to examine the underlying reasons for our failure to replicate reported changes, we performed further histological analyses using several variations on experimental design and data analysis that were reported in the ALS literature. This analysis showed that factors related to experimental design, such as grouping unit, sampling strategy, and blinding status, potentially contribute to the discrepancy in published data on C-bouton size changes. Next, we systematically analyzed the impact of study design variability and potential bias on reported results from experimental and preclinical studies of ALS. Strikingly, we found that practices such as blinding and power analysis are not systematically reported in the ALS field. Protocols to standardize experimental design and minimize bias are thus critical to advancing the ALS field.

Translation of Pre-Clinical Studies into Successful Clinical Trials for Alzheimer's Disease: What are the Roadblocks and How Can They Be Overcome?

Preclinical studies are essential for translation to disease treatments and effective use in clinical practice. An undue emphasis on single approaches to Alzheimer's disease (AD) appears to have retarded the pace of translation in the field, and there is much frustration in the public about the lack of an effective treatment. We critically reviewed past literature (1990-2014), analyzed numerous data, and discussed key issues at a consensus conference on Brain Ageing and Dementia to identify and overcome roadblocks in studies intended for translation. We highlight various factors that influence the translation of preclinical research and highlight specific preclinical strategies that have failed to demonstrate efficacy in clinical trials. The field has been hindered by the domination of the amyloid hypothesis in AD pathogenesis while the causative pathways in disease pathology are widely considered to be multifactorial. Understanding the causative events and mechanisms in the pathogenesis are equally important for translation. Greater efforts are necessary to fill in the gaps and overcome a variety of confounds in the generation, study design, testing, and evaluation of animal models and the application to future novel anti-dementia drug trials. A greater variety of potential disease mechanisms must be entertained to enhance progress.

Bridging Translation by Improving Preclinical Study Design in AKI

Despite extensive research, no therapeutic interventions have been shown to prevent AKI, accelerate recovery of AKI, or reduce progression of AKI to CKD in patients. This failure in translation has led investigators to speculate that the animal models being used do not predict therapeutic responses in humans. Although this issue continues to be debated, an important concern that has not been addressed is whether improvements in preclinical study design can be identified that might also increase the likelihood of translating basic AKI research into clinical practice using the current models. In this review, we have taken an evidence-based approach to identify common weaknesses in study design and reporting in preclinical AKI research that may contribute to the poor translatability of the findings. We focused on use of N-acetylcysteine or sodium bicarbonate for the prevention of contrast-induced AKI and use of erythropoietin for the prevention of AKI, two therapeutic approaches that have been extensively studied in clinical trials. On the basis of our findings, we identified five areas for improvement in preclinical study design and reporting. These suggested and preliminary guidelines may help improve the quality of preclinical research for AKI drug development.

Cognition of and Demand for Education and Teaching in Medical Statistics in China: A Systematic Review and Meta-Analysis

Background

Although a substantial number of studies focus on the teaching and application of medical statistics in China, few studies comprehensively evaluate the recognition of and demand for medical statistics. In addition, the results of these various studies differ and are insufficiently comprehensive and systematic.

Objectives

This investigation aimed to evaluate the general cognition of and demand for medical statistics by undergraduates, graduates, and medical staff in China.

Methods

We performed a comprehensive database search related to the cognition of and demand for medical statistics from January 2007 to July 2014 and conducted a meta-analysis of non-controlled studies with sub-group analysis for undergraduates, graduates, and medical staff.

Results

There are substantial differences with respect to the cognition of theory in medical statistics among undergraduates (73.5%), graduates (60.7%), and medical staff (39.6%). The demand for theory in medical statistics is high among graduates (94.6%), undergraduates (86.1%), and medical staff (88.3%). Regarding specific statistical methods, the cognition of basic statistical methods is higher than of advanced statistical methods. The demand for certain advanced statistical methods, including (but not limited to) multiple analysis of variance (ANOVA), multiple linear regression, and logistic regression, is higher than that for basic statistical methods. The use rates of the Statistical Package for the Social Sciences (SPSS) software and statistical analysis software (SAS) are only 55% and 15%, respectively.

Conclusion

The overall statistical competence of undergraduates, graduates, and medical staff is insufficient, and their ability to practically apply their statistical knowledge is limited, which constitutes an unsatisfactory state of affairs for medical statistics education. Because the demand for skills in this area is increasing, the need to reform medical statistics education in China has become urgent.

An open investigation of the reproducibility of cancer biology research

It is widely believed that research that builds upon previously published findings has reproduced the original work. However, it is rare for researchers to perform or publish direct replications of existing results. The Reproducibility Project: Cancer Biology is an open investigation of reproducibility in preclinical cancer biology research. We have identified 50 high impact cancer biology articles published in the period 2010-2012, and plan to replicate a subset of experimental results from each article. A Registered Report detailing the proposed experimental designs and protocols for each subset of experiments will be peer reviewed and published prior to data collection. The results of these experiments will then be published in a Replication Study. The resulting open methodology and dataset will provide evidence about the reproducibility of high-impact results, and an opportunity to identify predictors of reproducibility.

DOI:http://dx.doi.org/10.7554/eLife.04333.001

The Future of Preclinical Animal Models in Pharmaceutical Discovery and Development

Animal models have provided an important tool to help make the decision to take potential therapies from preclinical studies to humans. In the past several years, the strong reliance of the pharmaceutical discovery and development process on the use of animal models has come under increasing scrutiny for ethical and scientific reasons. Several prominent and widely publicized articles have reported limited concordance of animal experiments with subsequent human clinical trials. Recent assessments of the quality of animal studies have suggested that this translational failure may be due in part to shortcomings in the planning, conduct, and reporting of in vivo studies. This article will emphasize methods to assure best practice rigor in animal study methods and reporting. It will introduce the so-called scientific 3Rs of relevance, robustness, and reproducibility to the in vivo study approach and will review important new trends in the animal research and pharmaceutical discovery and development communities.

Reproducibility of results in preclinical studies: a perspective from the bone field

The biomedical research enterprise-and the public support for it-is predicated on the belief that discoveries and the conclusions drawn from them can be trusted to build a body of knowledge which will be used to improve human health. As in all other areas of scientific inquiry, knowledge and understanding grow by layering new discoveries upon earlier ones. The process self-corrects and distills knowledge by discarding false ideas and unsubstantiated claims. Although self-correction is inexorable in the long-term, in recent years biomedical scientists and the public alike have become alarmed and deeply troubled by the fact that many published results cannot be reproduced. The chorus of concern reached a high pitch with a recent commentary from the NIH Director, Francis S. Collins, and Principal Deputy Director, Lawrence A. Tabak, and their announcement of specific plans to enhance reproducibility of preclinical research that relies on animal models. In this invited perspective, we highlight the magnitude of the problem across biomedical fields and address the relevance of these concerns to the field of bone and mineral metabolism. We also suggest how our specialty journals, our scientific organizations, and our community of bone and mineral researchers can help to overcome this troubling trend.

Flaws in animal studies exploring statins and impact on meta-analysis

BACKGROUND

Animal experiments should be appropriately designed, correctly analysed and transparently reported to increase their scientific validity and maximise the knowledge gained from each experiment. This systematic review of animal experiments investigating statins evaluates their quality of reporting and methodological aspects as well as their implications for the conduction of meta-analyses.

METHODS

We searched medline and embase for studies reporting research on statins in mice, rats and rabbits. We collected detailed information about the characteristics of studies, animals and experimental methods.

RESULTS

We retrieved 161 studies. A little over half did not report randomisation (55%) and most did not describe blinding (88%). All studies reported details on the experimental procedure, although many omitted information about animal gender, age or weight. Four percent did not report the number of animals used. None reported the sample size. Fixed- and random-effects models gave different results (ratio of effect size increased by five folds). Heterogeneity was consistently substantial within animal models, for which accounting for covariates had minimal impact. Publication bias is highly suspected across studies.

CONCLUSIONS

Although statins showed efficacy in animal models, preclinical studies highlighted fundamental problems in the way in which such research is conducted and reported. Results were often difficult to interpret and reproduce. Different meta-analytic approaches were highly inconsistent: a reliable approach to estimate the true parameter was imperceptible. Policies that address these issues are required from investigators, editors and institutions that care about the quality standards and ethics of animal research.

Whole animal experiments should be more like human randomized controlled trials

The quality of reporting of animal studies lags behind that of human randomized controlled trials but a series of additions to the ARRIVE guidelines will help ensure that the standards are comparable.

A call for transparent reporting to optimize the predictive value of preclinical research

The US National Institute of Neurological Disorders and Stroke convened major stakeholders in June 2012 to discuss how to improve the methodological reporting of animal studies in grant applications and publications. The main workshop recommendation is that at a minimum studies should report on sample-size estimation, whether and how animals were randomized, whether investigators were blind to the treatment, and the handling of data. We recognize that achieving a meaningful improvement in the quality of reporting will require a concerted effort by investigators, reviewers, funding agencies and journal editors. Requiring better reporting of animal studies will raise awareness of the importance of rigorous study design to accelerate scientific progress.