Improving Translation by Identifying Evidence for More Human-Relevant Preclinical Strategies

Preclinical animal studies are performed to analyse the safety and efficacy of new treatments, with the aim to protect humans. However, there are questions and concerns about the quality and usefulness of preclinical animal research. Translational success rates vary between 0 and 100%, and no clear relationship has been found with possible predictive factors such as animal species or field of research. Therefore, it is not yet possible to indicate what factors predict successful translation. Translational strategies were therefore discussed at an international conference held in the Netherlands in November 2019, aiming to develop practical guidelines for more robust animal-to-human translation. The conference was organised during the course of a research project funded by the Dutch Research Council (313-99-310), addressing possible solutions for the low translational values that had been published for a multitude of animal studies in human health care. This article provides an overview of the project and the conference discussions. Based on the conference results and the findings from the research project, we define four points of attention that are crucial in the search for improved translational success rates: (a) optimising the methods and design of studies; (b) incorporation of the complexity of the human patient in research; (c) start with the patient rather than existing animal models as the gold standard; and (d) more and better collaboration within the chain from funding to pharmacy. We conclude that this requires improved organization and use of procedures, as well as a change of attitude and culture in research, including a consideration of the translational value of animal-free innovations and human-relevant science.

Laboratory animals search filter for different literature databases: PubMed, Embase, Web of Science and PsycINFO

Systematic reviews are important tools in animal research, but the ever-increasing number of studies makes retrieval of all relevant publications challenging. Search filters aid in retrieving as many animal studies as possible. In this paper we provide updated and expanded versions of the SYRCLE animal filters for PubMed and Embase. We provide the Embase filter for both Embase.com and via Ovid. Furthermore, we provide new animal search filters for Web of Science (WoS) and APA PsycINFO via psycnet.apa.org and via Ovid. Compared with previous versions, the new filters retrieved 0.5-47.1% (19 references for PubMed, 837 for WoS) more references in a real-life example. All filters retrieved additional references, comprising multiple relevant reviews. A random sample from WoS found at least one potentially relevant primary study. These animal search filters facilitate identifying as many animal studies as possible while minimising the number of non-animal studies.

Reviewing the animal literature: how to describe and choose between different types of literature reviews

Before starting any (animal) research project, review of the existing literature is good practice. From both the scientific and the ethical perspective, high-quality literature reviews are essential. Literature reviews have many potential advantages besides synthesising the evidence for a research question. First, they can show if a proposed study has already been performed, preventing redundant research. Second, when planning new experiments, reviews can inform the experimental design, thereby increasing the reliability, relevance and efficiency of the study. Third, reviews may even answer research questions using already available data. Multiple definitions of the term literature review co-exist. In this paper, we describe the different steps in the review process, and the risks and benefits of using various methodologies in each step. We then suggest common terminology for different review types: narrative reviews, mapping reviews, scoping reviews, rapid reviews, systematic reviews and umbrella reviews. We recommend which review to select, depending on the research question and available resources. We believe that improved understanding of review methods and terminology will prevent ambiguity and increase appropriate interpretation of the conclusions of reviews.

A Systematic Review Comparing Experimental Design of Animal and Human Methotrexate Efficacy Studies for Rheumatoid Arthritis: Lessons for the Translational Value of Animal Studies

Increased awareness and understanding of current practices in translational research is required for informed decision making in drug development. This paper describes a systematic review of methotrexate for rheumatoid arthritis, comparing trial design between 147 animal and 512 human studies. Animal studies generally included fewer subjects than human studies, and less frequently reported randomisation and blinding. In relation to life span, study duration was comparable for animals and humans, but included animals were younger than included humans. Animal studies often comprised males only (61%), human studies always included females (98% included both sexes). Power calculations were poorly reported in both samples. Analyses of human studies more frequently comprised Chi-square tests, those of animal studies more frequently reported analyses of variance. Administration route was more variable, and more frequently reported in animal than human studies. Erythrocyte sedimentation rate and c-reactive protein were analysed more frequently in human than in animal studies. To conclude, experimental designs for animal and human studies are not optimally aligned. However, methotrexate is effective in treating rheumatoid arthritis in animal models and humans. Further evaluation of the available evidence in other research fields is needed to increase the understanding of translational success before we can optimise translational strategies.

Grimace scale, burrowing, and nest building for the assessment of post-surgical pain in mice and rats-A systematic review

Several studies suggested an informative value of behavioral and grimace scale parameters for the detection of pain. However, the robustness and reliability of the parameters as well as the current extent of implementation are still largely unknown. In this study, we aimed to systematically analyze the current evidence-base of grimace scale, burrowing, and nest building for the assessment of post-surgical pain in mice and rats. The following platforms were searched for relevant articles: PubMed, Embase via Ovid, and Web of Science. Only full peer-reviewed studies that describe the grimace scale, burrowing, and/or nest building as pain parameters in the post-surgical phase in mice and/or rats were included. Information about the study design, animal characteristics, intervention characteristics, and outcome measures was extracted from identified publications. In total, 74 papers were included in this review. The majority of studies have been conducted in young adult C57BL/6J mice and Sprague Dawley and Wistar rats. While there is an apparent lack of information about young animals, some studies that analyzed the grimace scale in aged rats were identified. The majority of studies focused on laparotomy-associated pain. Only limited information is available about other types of surgical interventions. While an impact of surgery and an influence of analgesia were rather consistently reported in studies focusing on grimace scales, the number of studies that assessed respective effects was rather low for nest building and burrowing. Moreover, controversial findings were evident for the impact of analgesics on post-surgical nest building activity. Regarding analgesia, a monotherapeutic approach was identified in the vast majority of studies with non-steroidal anti-inflammatory (NSAID) drugs and opioids being most commonly used. In conclusion, most evidence exists for grimace scales, which were more frequently used to assess post-surgical pain in rodents than the other behavioral parameters. However, our findings also point to relevant knowledge gaps concerning the post-surgical application in different strains, age levels, and following different surgical procedures. Future efforts are also necessary to directly compare the sensitivity and robustness of different readout parameters applied for the assessment of nest building and burrowing activities.

Animal models for cystic fibrosis: A systematic search and mapping review of the literature - Part 1: genetic models

Animal models for cystic fibrosis (CF) have enhanced our understanding of the pathology and contributed to the development of new treatments. In the field of CF, many animal models have been developed and described. To our knowledge, thus far, none of the reviews of CF animal models has used a systematic methodology. A systematic approach to creating model overviews can lead to an objective, evidence-based choice of an animal model for new research questions. We searched Pubmed and Embase for the currently available animal models for CF. Two independent reviewers screened the results. We included all primary studies describing an animal model for CF. After duplicate removal, 12,304 publications were left. Because of the large number of models, in the current paper, only the genetic models are presented. A total of 636 publications were identified describing genetic animal models for CF in mice, pigs, ferrets, rats and zebrafish. Most of these models have an altered Cftr gene. An overview of basic model characteristics and outcome measures for these genetic models is provided, together with advice on using these data. As far as the authors are aware, this is one of the largest systematic mapping reviews on genetic animal models for CF. It can aid in selecting a suitable model and outcome measures. In general, the reporting quality of the included publications was poor. Further systematic reviews are warranted to determine the quality and translational value of these models further.

A systematic scoping review of rodent models of catatonia: Clinical correlations, translation and future approaches

Catatonia is a psychiatric disorder, which subsumes a plethora of affective, motor and behavioral symptoms. In the last two decades, the number of behavioral and neuroimaging studies on catatonia has steadily increased. The majority of behavioral and neuroimaging studies in psychiatric patients suggested aberrant higher-order frontoparietal networks which, on the biochemical level, are insufficiently modulated by gamma-aminobutyric acid (GABA)-ergic and glutamatergic transmission. However, the pathomechanisms of catatonic symptoms have rarely been studied using rodent models. Here, we performed a scoping review of literature available on PubMed for studies on rodent models of catatonia. We sought to identify what we could learn from pre-clinical animal models of catatonia-like symptoms, their underlying neuronal correlates, and the complex molecular (i.e. genes and neurotransmitter) mechanisms by which its modulation exerts its effects. What becomes evident is that although many transgenic models present catatonia-like symptoms, they have not been used to better understand the pathophysiological mechanisms underlying catatonia so far. However, the identified neuronal correlates of catatonia-like symptoms correlate to a great extent with findings from neuroscience research in psychiatric patients. This points us towards fundamental cortical-striatal-thalamocortical and associated networks modulated by white matter inflammation as well as aberrant dopaminergic, GABAergic, and glutamatergic neurotransmission that is involved in catatonia. Therefore, this scoping review opens up the possibility of finally using transgenic models to help with identifying novel target mechanisms for the development of new drugs for the treatment of catatonia.

Anesthesia and analgesia for experimental craniotomy in mice and rats: a systematic scoping review comparing the years 2009 and 2019

Experimental craniotomies are a common surgical procedure in neuroscience. Because inadequate analgesia appears to be a problem in animal-based research, we conducted this review and collected information on management of craniotomy-associated pain in laboratory mice and rats. A comprehensive search and screening resulted in the identification of 2235 studies, published in 2009 and 2019, describing craniotomy in mice and/or rats. While key features were extracted from all studies, detailed information was extracted from a random subset of 100 studies/year. Reporting of perioperative analgesia increased from 2009 to 2019. However, the majority of studies from both years did not report pharmacologic pain management. Moreover, reporting of multimodal treatments remained at a low level, and monotherapeutic approaches were more common. Among drug groups, reporting of pre- and postoperative administration of non-steroidal anti-inflammatory drugs, opioids, and local anesthetics in 2019 exceeded that of 2009. In summary, these results suggest that inadequate analgesia and oligoanalgesia are persistent issues associated with experimental intracranial surgery. This underscores the need for intensified training of those working with laboratory rodents subjected to craniotomies.

Systematic review registration

https://osf.io/7d4qe.

Animal models for cystic fibrosis: a systematic search and mapping review of the literature. Part 2: nongenetic models

Various animal models are available to study cystic fibrosis (CF). These models may help to enhance our understanding of the pathology and contribute to the development of new treatments. We systematically searched all publications on CF animal models. Because of the large number of models retrieved, we split this mapping review into two parts. Previously, we presented the genetic CF animal models. In this paper we present the nongenetic CF animal models. While genetic animal models may, in theory, be preferable for genetic diseases, the phenotype of a genetic model does not automatically resemble human disease. Depending on the research question, other animal models may thus be more informative.We searched Pubmed and Embase and identified 12,303 unique publications (after duplicate removal). All references were screened for inclusion by two independent reviewers. The genetic animal models for CF (from 636 publications) were previously described. The non-genetic CF models (from 189 publications) are described in this paper, grouped by model type: infection-based, pharmacological, administration of human materials, xenografts and other. As before for the genetic models, an overview of basic model characteristics and outcome measures is provided. This CF animal model overview can be the basis for an objective, evidence-based model choice for specific research questions. Besides, it can help to retrieve relevant background literature on outcome measures of interest.

Glucocorticoids in relation to behavior, morphology, and physiology as proxy indicators for the assessment of animal welfare. A systematic mapping review

Translating theoretical concepts of animal welfare into quantitative assessment protocols is an ongoing challenge. Glucocorticoids (GCs) are frequently used as physiological measure in welfare assessment. The interpretation of levels of GCs and especially their relation to welfare, however, is not as straightforward, questioning the informative power of GCs. The aim of this systematic mapping review was therefore to provide an overview of the relevant literature to identify global patterns in studies using GCs as proxy for the assessment of welfare of vertebrate species. Following a systematic protocol and a-priory inclusion criteria, 509 studies with 517 experiments were selected for data extraction. The outcome of the experiments was categorized based on whether the intervention significantly affected levels of GCs, and whether these effects were accompanied by changes in behavior, morphology and physiology. Additional information, such as animal species, type of intervention, experimental set up and sample type used for GC determination was extracted, as well. Given the broad scope and large variation in included experiments, meta-analyses were not performed, but outcomes are presented to encourage further, in-depth analyses of the data set. The interventions did not consistently lead to changes in GCs with respect to the original authors hypothesis. Changes in GCs were not consistently paralleled by changes in additional assessment parameter on behavior, morphology and physiology. The minority of experiment quantified GCs in less invasive sample matrices compared to blood. Interventions showed a large variability, and species such as fish were underrepresented, especially in the assessment of behavior. The inconclusive effects on GCs and additional assessment parameter urges for further validation of techniques and welfare proxies. Several conceptual and technical challenges need to be met to create standardized and robust welfare assessment protocols and to determine the role of GCs herein.

Comparing translational success rates across medical research fields - A combined analysis of literature and clinical trial data

Many interventions that show promising results in preclinical development do not pass clinical tests. Part of this may be explained by poor animal-to-human translation. Using animal models with low predictability for humans is neither ethical nor efficient. If translational success shows variation between medical research fields, analyses of common practices in these fields could identify factors contributing to successful translation. We assessed translational success rates in medical research fields using two approaches: through literature and clinical trial registers. Literature: We comprehensively searched PubMed for pharmacology, neuroscience, cancer research, animal models, clinical trials, and translation. After screening, 117 review papers were included in this scoping review. Translational success rates were not different within pharmacology (72%), neuroscience (62%), and cancer research (69%). Clinical trials: The fraction of phase-2 clinical trials with a positive outcome was used as a proxy (i.e., an indirect resemblance measure) for translational success. Trials were retrieved from the WHO trial register and categorized into medical research fields following the international classification of disease (ICD-10). Of the phase-2 trials analyzed, 65.2% were successful. Fields with the highest success rates were disorders of lipoprotein metabolism (86.0%) and epilepsy (85.0%). Fields with the lowest success rates were schizophrenia (45.4%) and pancreatic cancer (46.0%). Our combined analyses suggest relevant differences in success rates between medical research fields. Based on the clinical trials, comparisons of practice, e.g., between epilepsy and schizophrenia, might identify factors that influence translational success.

Ultrasound-induced immune responses in tumors: A systematic review and meta-analysis

Ultrasound is widely used in the diagnosis and therapy of cancer. Tumors can be treated by thermal or mechanical tissue ablation. Furthermore, tumors can be manipulated by hyperthermia, sonodynamic therapy and sonoporation, e.g., by increasing tumor perfusion or the permeability of biological barriers to enhance drug delivery. These treatments induce various immune responses in tumors. However, conflicting data and high heterogeneity between experimental settings make it difficult to generalize the effects of ultrasound on tumor immunity. Therefore, we performed a systematic review to answer the question: "Does ultrasound alter the immune reaction of peripheral solid tumors in humans and animals compared to control conditions without ultrasound?" A systematic literature search was performed in PubMed, EMBASE, and Web of Science and 24,401 potentially relevant publications were identified. Of these, 96 publications were eligible for inclusion in the systematic review. Experiments were performed in humans, rats, and mice and focused on different tumor types, primarily breast and melanoma. We collected data on thermal and non-thermal ultrasound settings, the use of sono-sensitizers or sono-enhancers, and anti-tumor therapies. Six meta-analyses were performed to quantify the effect of ultrasound on tumor infiltration by T cells (cytotoxic, helper, and regulatory T cells) and on blood cytokines (interleukin-6, interferon-γ, tumor necrosis factor-α). We provide robust scientific evidence that ultrasound alters T cell infiltration into tumors and increases blood cytokine concentrations. Furthermore, we identified significant differences in immune cell infiltration based on tumor type, ultrasound settings, and mouse age. Stronger effects were observed using hyperthermia in combination with sono-sensitizers and in young mice. The latter may impair the translational impact of study results as most cancer patients are older. Thus, our results may help refining ultrasound parameters to enhance anti-tumor immune responses for therapeutic use and to minimize immune effects in diagnostic applications.

Pollutant exposure and myocardial injury: Protocol and progress report for a toxicological systematic mapping review

An increasing body of evidence identifies pollutant exposure as a risk factor for cardiovascular disease (CVD), while CVD incidence is rising steadily with the aging population. Although numerous experimental studies are now available, the mechanisms through which lifetime exposure to envi­ronmental pollutants can result in CVD are not fully understood. To comprehensively describe and understand the pathways through which pollutant exposure leads to cardiotoxicity, a systematic mapping review of the available toxicological evidence is needed. This protocol outlines a step-by-step framework for conducting this review. Using the National Toxicology Program (NTP) Health Assessment and Translation (HAT) approach for conducting toxicological systematic reviews, we selected 362 out of 8110 in vitro (17%), in vivo (67%), and combined (15%) studies for 129 potential cardiotoxic environmental pollutants, including heavy metals (29%), air pollutants (16%), pesticides (27%), and other chemicals (28%). The internal validity of included studies is being assessed with HAT and SYRCLE risk of bias tools. Tabular templates are being used to extract key study elements regarding study setup, methodology, techniques, and (qualitative and quantitative) outcomes. Subsequent synthesis will consist of an explorative meta-analysis of possible pollutant-related cardiotoxicity. Evidence maps and interactive knowledge graphs will illustrate evidence streams, cardiotoxic effects, and associated quality of evidence, helping researchers and regulators to efficiently identify pollutants of interest. The evidence will be integrated in novel adverse outcome pathways to facilitate regulatory acceptance of non-animal methods for cardiotoxicity testing. The current article describes the progress of the steps made in the systematic mapping review process.

A Systematic Review of the Effect of Cystic Fibrosis Treatments on the Nasal Potential Difference Test in Animals and Humans

To address unmet treatment needs in cystic fibrosis (CF), preclinical and clinical studies are warranted. Because it directly reflects the function of the Cystic Fibrosis Transmembrane conductance Regulator (CFTR), the nasal potential difference test (nPD) can not only be used as a reliable diagnostic test for CF but also to assess efficacy of experimental treatments. We performed a full comprehensive systematic review of the effect of CF treatments on the nPD compared to control conditions tested in separate groups of animal and human subjects. Our review followed a preregistered protocol. We included 34 references: 20 describing mouse studies, 12 describing human studies, and 2 describing both. We provide a comprehensive list of these studies, which assessed the effects of antibiotics, bone marrow transplant, CFTR protein, CFTR RNA, directly and indirectly CFTR-targeting drugs, non-viral and viral gene transfer, and other treatments. Our results support the nPD representing a reliable method for testing treatment effects in both animal models and human patients, as well as for diagnosing CF. However, we also observed the need for improved reporting to ensure reproducibility of the experiments and quantitative comparability of the results within and between species (e.g., with meta-analyses). Currently, data gaps warrant further primary studies.

Development of a Systematic Review Protocol and a Scoping Review of Ultrasound-Induced Immune Effects in Peripheral Tumors

PURPOSE

Publication numbers reporting that ultrasound can stimulate immune reactions in tumors steadily increase. However, the presented data are partially conflicting, and mechanisms are difficult to identify from single publications. These shortcomings can be addressed by a systematic review and meta-analysis of current literature. As a first step, we here present the methodology and protocol for a systematic review to answer the following research question: Does ultrasound alter the immune reaction of peripheral solid tumors in humans and animals compared to control conditions without ultrasound?

PROCEDURES

We designed a protocol to perform a systematic review and meta-analysis. The suitability of the protocol to detect and sort relevant literature was tested using a subset of publications. We extracted study characteristics, ultrasound parameters, and study outcomes to pre-evaluate the differences between publications and present the data as a scoping review.

RESULTS

From 6532 publications detected by our preliminary literature search, 320 were selected for testing our systematic review protocol. Of the latter, 15 publications were eligible for data extraction. There, we found large differences between study characteristics (e.g., tumor type, age) and ultrasound settings (e.g., wavelength 0.5-9.5 MHz, acoustic pressure 0.0001-15,000 W/cm2). Finally, study outcomes included reports on cells of the innate (e.g., dendritic cells, macrophages) and adaptive immune system (e.g., CD8-/CD4-positive T cells).

CONCLUSION

We designed a protocol to identify relevant literature and perform a systematic review and meta-analysis. The differences between extracted features between publications show the necessity for a comprehensive search and selection strategy in the systematic review to get a complete overview of the literature. Meta-analyses of the extracted outcomes can then enable evidence-based conclusions.