Emulating multicentre clinical stroke trials: a new paradigm for studying novel interventions in experimental models of stroke

Stroke of Consistency: Streamlining Multicenter Protocols for Enhanced Reproducibility of Infarct Volumes in Preclinical Stroke Research

BACKGROUND

The discrepancy between experimental research and clinical trial outcomes is a persistent challenge in preclinical studies, particularly in stroke research. A possible factor contributing to this issue is the lack of standardization across experimental stroke models, leading to poor reproducibility in multicenter studies. This study addresses this gap by aiming to enhance reproducibility and the efficacy of multicenter studies through the harmonization of protocols and training of involved personnel.

METHODS

We established a set of standard operating procedures for various stroke models and the Neuroscore. These standard operating procedures were implemented across multiple research centers, followed by specialized, in-person training for all participants. We measured the variability in infarct volume both before and after the implementation of these standardized protocols and training sessions.

RESULTS

The standardization process led to a significant reduction in variability of infarct volume across different stroke models (40%-50% reduction), demonstrating the effectiveness of our harmonized protocols and training. Additionally, the implementation of the Neuroscore system across centers showed low variability and consistent results up to 28 days poststroke, underscoring its utility in chronic phase evaluations.

CONCLUSIONS

The harmonization of protocols and surgeon training significantly reduced variability in experimental outcomes across different centers. This improvement can increase the comparability of data between research groups and enhance the statistical power of multicenter studies. Our findings also establish the Neuroscore as a reliable tool for long-term assessment in stroke research, paving the way for more consistent and impactful multicenter preclinical studies.

Successful harmonization in EpiBioS4Rx biomarker study on post-traumatic epilepsy paves the way towards powered preclinical multicenter studies

OBJECTIVE

Project 1 of the Preclinical Multicenter Epilepsy Bioinformatics Study for Antiepileptogenic Therapy (EpiBioS4Rx) consortium aims to identify preclinical biomarkers for antiepileptogenic therapies following traumatic brain injury (TBI). The international participating centers in Finland, Australia, and the United States have made a concerted effort to ensure protocol harmonization. Here, we evaluate the success of harmonization process by assessing the timing, coverage, and performance between the study sites.

METHOD

We collected data on animal housing conditions, lateral fluid-percussion injury model production, postoperative care, mortality, post-TBI physiological monitoring, timing of blood sampling and quality, MR imaging timing and protocols, and duration of video-electroencephalography (EEG) follow-up using common data elements. Learning effect in harmonization was assessed by comparing procedural accuracy between the early and late stages of the project.

RESULTS

The animal housing conditions were comparable between the study sites but the postoperative care procedures varied. Impact pressure, duration of apnea, righting reflex, and acute mortality differed between the study sites (p < 0.001). The severity of TBI on D2 post TBI assessed using the composite neuroscore test was similar between the sites, but recovery of acute somato-motor deficits varied (p < 0.001). A total of 99% of rats included in the final cohort in UEF, 100% in Monash, and 79% in UCLA had blood samples taken at all time points. The timing of sampling differed on day (D)2 (p < 0.05) but not D9 (p > 0.05). Plasma quality was poor in 4% of the samples in UEF, 1% in Monash and 14% in UCLA. More than 97% of the final cohort were MR imaged at all timepoints in all study sites. The timing of imaging did not differ on D2 and D9 (p > 0.05), but varied at D30, 5 months, and ex vivo timepoints (p < 0.001). The percentage of rats that completed the monthly high-density video-EEG follow-up and the duration of video-EEG recording on the 7th post-injury month used for seizure detection for diagnosis of post-traumatic epilepsy differed between the sites (p < 0.001), yet the prevalence of PTE (UEF 21%, Monash 22%, UCLA 23%) was comparable between the sites (p > 0.05). A decrease in acute mortality and increase in plasma quality across time reflected a learning effect in the TBI production and blood sampling protocols.

SIGNIFICANCE

Our study is the first demonstration of the feasibility of protocol harmonization for performing powered preclinical multi-center trials for biomarker and therapy discovery of post-traumatic epilepsy.

A multi-disciplinary commentary on preclinical research to investigate vascular contributions to dementia

Although dementia research has been dominated by Alzheimer's disease (AD), most dementia in older people is now recognised to be due to mixed pathologies, usually combining vascular and AD brain pathology. Vascular cognitive impairment (VCI), which encompasses vascular dementia (VaD) is the second most common type of dementia. Models of VCI have been delayed by limited understanding of the underlying aetiology and pathogenesis. This review by a multidisciplinary, diverse (in terms of sex, geography and career stage), cross-institute team provides a perspective on limitations to current VCI models and recommendations for improving translation and reproducibility. We discuss reproducibility, clinical features of VCI and corresponding assessments in models, human pathology, bioinformatics approaches, and data sharing. We offer recommendations for future research, particularly focusing on small vessel disease as a main underpinning disorder.

The implementation of target trial emulation for causal inference: a scoping review

OBJECTIVES

We aim to investigate the implementation of Target Trial Emulation (TTE) for causal inference, involving research topics, frequently used strategies, and issues indicating the need for future improvements.

STUDY DESIGN AND SETTING

We performed a scoping review by following the Joanna Briggs Institute (JBI) guidance and Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews (PRISMA-ScR) checklist. A health research-focused librarian searched multiple medical databases, and two independent reviewers completed screening and extraction within covidence review management software.

RESULTS

Our search resulted in 1,240 papers, of which 96 papers were eligible for data extraction. Results show a significant increase in the use of TTE in 2018 and 2021. The study topics varied and focused primarily on cancer, cardiovascular and cerebrovascular diseases, and infectious diseases. However, not all papers specified well all three critical components for generating robust causal evidence: time-zero, random assignment simulation, and comparison strategy. Some common issues were observed from retrieved papers, and key limitations include residual confounding, limited generalizability, and a lack of reporting guidance that need to be improved.

CONCLUSION

Uneven adherence to the TTE framework exists, and future improvements are needed to progress applications using causal inference with observational data.

A systematic assessment of preclinical multilaboratory studies and a comparison to single laboratory studies

Background

Multicentric approaches are widely used in clinical trials to assess the generalizability of findings, however, they are novel in laboratory-based experimentation. It is unclear how multilaboratory studies may differ in conduct and results from single lab studies. Here, we synthesized the characteristics of these studies and quantitatively compared their outcomes to those generated by single laboratory studies.

Methods

MEDLINE and Embase were systematically searched. Screening and data extractions were completed in duplicate by independent reviewers. Multilaboratory studies investigating interventions using in vivo animal models were included. Study characteristics were extracted. Systematic searches were then performed to identify single lab studies matched by intervention and disease. Difference in standardized mean differences (DSMD) was then calculated across studies to assess differences in effect estimates based on study design (>0 indicates larger effects in single lab studies).

Results

Sixteen multilaboratory studies met inclusion criteria and were matched to 100 single lab studies. The multicenter study design was applied across a diverse range of diseases, including stroke, traumatic brain injury, myocardial infarction, and diabetes. The median number of centers was four (range 2-6) and the median sample size was 111 (range 23-384) with rodents most frequently used. Multilaboratory studies adhered to practices that reduce the risk of bias significantly more often than single lab studies. Multilaboratory studies also demonstrated significantly smaller effect sizes than single lab studies (DSMD 0.72 [95% confidence interval 0.43-1]).

Conclusions

Multilaboratory studies demonstrate trends that have been well recognized in clinical research (i.e. smaller treatment effects with multicentric evaluation and greater rigor in study design). This approach may provide a method to robustly assess interventions and the generalizability of findings between laboratories.

Funding

uOttawa Junior Clinical Research Chair; The Ottawa Hospital Anesthesia Alternate Funds Association; Canadian Anesthesia Research Foundation; Government of Ontario Queen Elizabeth II Graduate Scholarship in Science and Technology.

Embracing Heterogeneity in The Multicenter Stroke Preclinical Assessment Network (SPAN) Trial

The Stroke Preclinical Assessment Network (SPAN) is a multicenter preclinical trial platform using rodent models of transient focal cerebral ischemia to address translational failure in experimental stroke. In addition to centralized randomization and blinding and large samples, SPAN aimed to introduce heterogeneity to simulate the heterogeneity embodied in clinical trials for robust conclusions. Here, we report the heterogeneity introduced by allowing the 6 SPAN laboratories to vary most of the biological and experimental model variables and the impact of this heterogeneity on middle cerebral artery occlusion (MCAo) performance. We included the modified intention-to-treat population of the control mouse cohort of the first SPAN trial (n=421) and examined the biological and procedural independent variables and their covariance. We then determined their impact on the dependent variables cerebral blood flow drop during MCAo, time to achieve MCAo, and total anesthesia duration using multivariable analyses. We found heterogeneity in biological and procedural independent variables introduced mainly by the site. Consequently, all dependent variables also showed heterogeneity among the sites. Multivariable analyses with the site as a random effect variable revealed filament choice as an independent predictor of cerebral blood flow drop after MCAo. Comorbidity, sex, use of laser Doppler flow to monitor cerebral blood flow, days after trial onset, and maintaining anesthesia throughout the MCAo emerged as independent predictors of time to MCAo. Total anesthesia duration was predicted by most independent variables. We present with high granularity the heterogeneity introduced by the biological and model selections by the testing sites in the first trial of cerebroprotection in rodent transient filament MCAo by SPAN. Rather than trying to homogenize all variables across all sites, we embraced the heterogeneity to better approximate clinical trials. Awareness of the heterogeneity, its sources, and how it impacts the study performance may further improve the study design and statistical modeling for future multicenter preclinical trials.

Key design elements of successful acute ischemic stroke treatment trials

PURPOSE

We review key design elements of positive randomized controlled trials (RCTs) in acute ischemic stroke (AIS) treatment and summarize their main characteristics.

METHOD

We searched Medline, Pubmed and Cochrane databases for positive RCTs in AIS treatment. Trials were included if (1) they had a randomized controlled design, with (at least partial) blinding for endpoints, (2) they tested against placebo (or on top of standard therapy in a superiority design) or against approved therapy; (3) the protocol was registered and/or published before trial termination and unblinding (if required at study commencement); (4) the primary endpoint was positive in the intention to treat analysis; and (5) the study findings led to approval of the investigational product and/or high ranked recommendations. A topical approach was used, therefore the findings were summarized as a narrative review.

FINDINGS

Seventeen positive RCTs met the inclusion criteria. The majority of trials included less than 1000 patients (n = 15), had highly selective inclusion criteria (n = 16), used the modified Rankin score as a primary endpoint (n = 15) and had a frequentist design (n = 16). Trials tended to be national (n = 12), investigator-initiated and performed with public funding (n = 11).

DISCUSSION

Smaller but selective trials are useful to identify efficacy in a particular subgroup of stroke patients. It may also be of advantage to limit the number of participating countries and centers to avoid heterogeneity in stroke management and bureaucratic burden.

CONCLUSION

The key characteristics of positive RCTs in AIS treatment described here may assist in the design of further trials investigating a single intervention with a potentially high effect size.

Robust preclinical evidence in somatic cell genome editing: A key driver of responsible and efficient therapeutic innovations

Somatic cell genome editing (SCGE) is highly promising for therapeutic innovation. This study demonstrates that the majority of 46 preclinical SCGE studies discussed in reviews as particularly promising for clinical translation do not report on key elements for robust and confirmatory research practices: randomization, blinding, sample size calculation, data handling, pre-registration, multi-centric study design, and independent confirmation. We present the here-examined reporting standards and the new National Institutes of Health (NIH) funding criteria for SCGE research as a viable solution to protect this promising field from backlashes. We argue that the implementation of the novel methodological standards provides the opportunity for SCGE research to become a lighthouse example for trustworthy and useful translational research.

Clinical relevance assessment of animal preclinical research (RAA) tool: development and explanation

Background

Only a small proportion of preclinical research (research performed in animal models prior to clinical trials in humans) translates into clinical benefit in humans. Possible reasons for the lack of translation of the results observed in preclinical research into human clinical benefit include the design, conduct, and reporting of preclinical studies. There is currently no formal domain-based assessment of the clinical relevance of preclinical research. To address this issue, we have developed a tool for the assessment of the clinical relevance of preclinical studies, with the intention of assessing the likelihood that therapeutic preclinical findings can be translated into improvement in the management of human diseases.

Methods

We searched the EQUATOR network for guidelines that describe the design, conduct, and reporting of preclinical research. We searched the references of these guidelines to identify further relevant publications and developed a set of domains and signalling questions. We then conducted a modified Delphi-consensus to refine and develop the tool. The Delphi panel members included specialists in evidence-based (preclinical) medicine specialists, methodologists, preclinical animal researchers, a veterinarian, and clinical researchers. A total of 20 Delphi-panel members completed the first round and 17 members from five countries completed all three rounds.

Results

This tool has eight domains (construct validity, external validity, risk of bias, experimental design and data analysis plan, reproducibility and replicability of methods and results in the same model, research integrity, and research transparency) and a total of 28 signalling questions and provides a framework for researchers, journal editors, grant funders, and regulatory authorities to assess the potential clinical relevance of preclinical animal research.

Conclusion

We have developed a tool to assess the clinical relevance of preclinical studies. This tool is currently being piloted.

Multicentre translational Trial of Remote Ischaemic Conditioning in Acute Ischaemic Stroke (TRICS): protocol of multicentre, parallel group, randomised, preclinical trial in female and male rat and mouse from the Italian Stroke Organization (ISO) Basic Science network

Introduction

Multicentre preclinical randomised controlled trials (pRCT) are emerging as a necessary step to confirm efficacy and improve translation into the clinic. The aim of this project is to perform two multicentre pRCTs (one in rats and one in mice) to investigate the efficacy of remote ischaemic conditioning (RIC) in an experimental model of severe ischaemic stroke.

Methods and analysis

Seven research laboratories within the Italian Stroke Organization (ISO) Basic Science network will participate in the study. Transient endovascular occlusion of the proximal right middle cerebral artery will be performed in two species (rats and mice) and in both sexes. Animals will be randomised to receive RIC by transient surgical occlusion of the right femoral artery, or sham surgery, after reperfusion. Blinded outcome assessment will be performed for dichotomised functional neuroscore (primary endpoint) and infarct volume (secondary endpoint) at 48 hours. A sample size of 80 animals per species will yield 82% power to detect a significant difference of 30% in the primary outcome in both pRCTs. Analyses will be performed in a blind status and according to an intention-to-treat paradigm. The results of this study will provide robust, translationally oriented, high-quality evidence on the efficacy of RIC in multiple species of rodents with large ischaemic stroke.

Ethics and dissemination

This is approved by the Animal Welfare Regulatory Body of the University of Milano Bicocca, under project license from the Italian Ministry of Health. Trial results will be subject to publication according to the definition of the outcome presented in this protocol.

Trial registration number

PCTE0000177.

The Hazard of Negative (Not Neutral) Trials on Treatment of Acute Stroke: A Review

Importance

While there are a limited number of beneficial treatments for acute stroke (eg, stroke units, reperfusion, aspirin, hemicraniectomy), there are more negative (as opposed to neutral) interventions spanning multiple different mechanisms of action. To reduce the risk of future negative studies, it is vital to understand why previous interventions appeared to cause harm.

Observations

The limited number of beneficial treatments for acute ischemic stroke are far outnumbered by negative (not neutral) interventions that worsened outcomes in randomized clinical trials (RCTs), including those with putative neuroprotectant, anticoagulant, anti-inflammatory, free radical-scavenging, hemorrhagic, or vasoactive activity. Other agents reduced thrombolytic efficiency or exhibited neuropsychiatric or cardiac toxicity. In intracerebral hemorrhage, platelet transfusion was hazardous. Although reperfusion treatments should be given as soon as possible, very early intervention with other strategies may instead be hazardous, as has been seen with physical therapy and vasodepressors.

Conclusions and Relevance

The lessons learned from negative stroke RCTs are vital for designing future studies. Multicenter preclinical studies are necessary, and animals that die must be included in analyses. Randomized clinical trials must assess multiple neurological, vascular, cardiac, and general safety effects, whether these are on target or off target. All preclinical trials and RCTs must be published in full. Learning from the past will help to reduce the number of negative stroke RCTs in the future.

UK consensus on pre-clinical vascular cognitive impairment functional outcomes assessment: Questionnaire and workshop proceedings

Assessment of outcome in preclinical studies of vascular cognitive impairment (VCI) is heterogenous. Through an ARUK Scottish Network supported questionnaire and workshop (mostly UK-based researchers), we aimed to determine underlying variability and what could be implemented to overcome identified challenges. Twelve UK VCI research centres were identified and invited to complete a questionnaire and attend a one-day workshop. Questionnaire responses demonstrated agreement that outcome assessments in VCI preclinical research vary by group and even those common across groups, may be performed differently. From the workshop, six themes were discussed: issues with preclinical models, reasons for choosing functional assessments, issues in interpretation of functional assessments, describing and reporting functional outcome assessments, sharing resources and expertise, and standardization of outcomes. Eight consensus points emerged demonstrating broadly that the chosen assessment should reflect the deficit being measured, and therefore that one assessment does not suit all models; guidance/standardisation on recording VCI outcome reporting is needed and that uniformity would be aided by a platform to share expertise, material, protocols and procedures thus reducing heterogeneity and so increasing potential for collaboration, comparison and replication. As a result of the workshop, UK wide consensus statements were agreed and future priorities for preclinical research identified.

Immune responses to stroke: mechanisms, modulation, and therapeutic potential

Stroke is the second leading cause of death worldwide and a leading cause of disability. Most strokes are caused by occlusion of a major cerebral artery, and substantial advances have been made in elucidating how ischemia damages the brain. In particular, increasing evidence points to a double-edged role of the immune system in stroke pathophysiology. In the acute phase, innate immune cells invade brain and meninges and contribute to ischemic damage, but may also be protective. At the same time, danger signals released into the circulation by damaged brain cells lead to activation of systemic immunity, followed by profound immunodepression that promotes life-threatening infections. In the chronic phase, antigen presentation initiates an adaptive immune response targeted to the brain, which may underlie neuropsychiatric sequelae, a considerable cause of poststroke morbidity. Here, we briefly review these pathogenic processes and assess the potential therapeutic value of targeting immunity in human stroke.

Grassroots Training for Reproducible Science: A Consortium-Based Approach to the Empirical Dissertation

There is a widely acknowledged need to improve the reliability and efficiency of scientific research to increase the credibility of the published scientific literature and accelerate discovery. Widespread improvement requires a cultural shift in both thinking and practice, and better education will be instrumental to achieve this. Here we argue that education in reproducible science should start at the grassroots. We present our model of consortium-based student projects to train undergraduates in reproducible team science. We discuss how with careful design we have aligned collaboration with the current conventions for individual student assessment. We reflect on our experiences of several years running the GW4 Undergraduate Psychology Consortium offering insights we hope will be of practical use to others wishing to adopt a similar approach. We consider the pedagogical benefits of our approach in equipping students with 21st-century skills. Finally, we reflect on the need to shift incentives to reward to team science in global research and how this applies to the reward structures of student assessment.

In vivo widefield calcium imaging of the mouse cortex for analysis of network connectivity in health and brain disease

The organization of brain areas in functionally connected networks, their dynamic changes, and perturbations in disease states are subject of extensive investigations. Research on functional networks in humans predominantly uses functional magnetic resonance imaging (fMRI). However, adopting fMRI and other functional imaging methods to mice, the most widely used model to study brain physiology and disease, poses major technical challenges and faces important limitations. Hence, there is great demand for alternative imaging modalities for network characterization. Here, we present a refined protocol for in vivo widefield calcium imaging of both cerebral hemispheres in mice expressing a calcium sensor in excitatory neurons. We implemented a stringent protocol for minimizing anesthesia and excluding movement artifacts which both imposed problems in previous approaches. We further adopted a method for unbiased identification of functional cortical areas using independent component analysis (ICA) on resting-state imaging data. Biological relevance of identified components was confirmed using stimulus-dependent cortical activation. To explore this novel approach in a model of focal brain injury, we induced photothrombotic lesions of the motor cortex, determined changes in inter- and intrahemispheric connectivity at multiple time points up to 56 days post-stroke and correlated them with behavioral deficits. We observed a severe loss in interhemispheric connectivity after stroke, which was partially restored in the chronic phase and associated with corresponding behavioral motor deficits. Taken together, we present an improved widefield calcium imaging tool accounting for anesthesia and movement artifacts, adopting an advanced analysis pipeline based on human fMRI algorithms and with superior sensitivity to recovery mechanisms in mouse models compared to behavioral tests. This tool will enable new studies on interhemispheric connectivity in murine models with comparability to human imaging studies for a wide spectrum of neuroscience applications in health and disease.

Small vessels, dementia and chronic diseases - molecular mechanisms and pathophysiology

Cerebral small vessel disease (SVD) is a major contributor to stroke, cognitive impairment and dementia with limited therapeutic interventions. There is a critical need to provide mechanistic insight and improve translation between pre-clinical research and the clinic. A 2-day workshop was held which brought together experts from several disciplines in cerebrovascular disease, dementia and cardiovascular biology, to highlight current advances in these fields, explore synergies and scope for development. These proceedings provide a summary of key talks at the workshop with a particular focus on animal models of cerebral vascular disease and dementia, mechanisms and approaches to improve translation. The outcomes of discussion groups on related themes to identify the gaps in knowledge and requirements to advance knowledge are summarized.

Refocusing Neuroprotection in Cerebral Reperfusion Era: New Challenges and Strategies

Pathophysiological processes of stroke have revealed that the damaged brain should be considered as an integral structure to be protected. However, promising neuroprotective drugs have failed when translated to clinical trials. In this review, we evaluated previous studies of neuroprotection and found that unsound patient selection and evaluation methods, single-target treatments, etc., without cerebral revascularization may be major reasons of failed neuroprotective strategies. Fortunately, this may be reversed by recent advances that provide increased revascularization with increased availability of endovascular procedures. However, the current improved effects of endovascular therapy are not able to match to the higher rate of revascularization, which may be ascribed to cerebral ischemia/reperfusion injury and lacking of neuroprotection. Accordingly, we suggest various research strategies to improve the lower therapeutic efficacy for ischemic stroke treatment: (1) multitarget neuroprotectant combinative therapy (cocktail therapy) should be investigated and performed based on revascularization; (2) and more efforts should be dedicated to shifting research emphasis to establish recirculation, increasing functional collateral circulation and elucidating brain–blood barrier damage mechanisms to reduce hemorrhagic transformation. Therefore, we propose that a comprehensive neuroprotective strategy before and after the endovascular treatment may speed progress toward improving neuroprotection after stroke to protect against brain injury.

Could age and aging change the host response to systemic parasitic infections? A systematic review of preclinical evidence

The impact of age and aging in the evolution of systemic parasitic infections remains poorly understood. We conducted a systematic review from preclinical models of Chagas disease, leishmaniasis, malaria, sleeping sickness and toxoplasmosis. From a structured and comprehensive search in electronic databases, 29 studies were recovered and included in the review. Beyond the characteristics of the experimental models, parasitological and immunological outcomes, we also discussed the quality of current evidence. Our findings indicated that throughout aging, parasitemia and mortality were consistently reduced in Chagas disease and malaria, but were similar or increased in leishmaniasis and highly variable in toxoplasmosis. While a marked humoral response in older animals was related to the anti-T. cruzi protective phenotype, cellular responses mediated by a polarized Th1 phenotype were associated with a more effective defense against Plasmodium infection. Conversely, in leishmaniasis, severe infections and high mortality rates were potentially related to attenuation of humoral response and an imbalance between Th1 and Th2 phenotypes. Due to the heterogeneous parasitological outcomes and limited immunological data, the role of aging on toxoplasmosis evolution remains unclear. From a detailed description of the methodological bias, more controlled researches could avoid the systematic reproduction of inconsistent and poorly reproducible experimental designs.

A manifesto for reproducible science

Improving the reliability and efficiency of scientific research will increase the credibility of the published scientific literature and accelerate discovery. Here we argue for the adoption of measures to optimize key elements of the scientific process: methods, reporting and dissemination, reproducibility, evaluation and incentives. There is some evidence from both simulations and empirical studies supporting the likely effectiveness of these measures, but their broad adoption by researchers, institutions, funders and journals will require iterative evaluation and improvement. We discuss the goals of these measures, and how they can be implemented, in the hope that this will facilitate action toward improving the transparency, reproducibility and efficiency of scientific research.

Cross-centre replication of suppressed burrowing behaviour as an ethologically relevant pain outcome measure in the rat: a prospective multicentre study

Burrowing, an ethologically relevant rodent behaviour, has been proposed as a novel outcome measure to assess the global impact of pain in rats. In a prospective multicentre study using male rats (Wistar, Sprague-Dawley), replication of suppressed burrowing behaviour in the complete Freund adjuvant (CFA)-induced model of inflammatory pain (unilateral, 1 mg/mL in 100 µL) was evaluated in 11 studies across 8 centres. Following a standard protocol, data from participating centres were collected centrally and analysed with a restricted maximum likelihood-based mixed model for repeated measures. The total population (TP-all animals allocated to treatment; n = 249) and a selected population (SP-TP animals burrowing over 500 g at baseline; n = 200) were analysed separately, assessing the effect of excluding "poor" burrowers. Mean baseline burrowing across studies was 1113 g (95% confidence interval: 1041-1185 g) for TP and 1329 g (1271-1387 g) for SP. Burrowing was significantly suppressed in the majority of studies 24 hours (7 studies/population) and 48 hours (7 TP, 6 SP) after CFA injections. Across all centres, significantly suppressed burrowing peaked 24 hours after CFA injections, with a burrowing deficit of -374 g (-479 to -269 g) for TP and -498 g (-609 to -386 g) for SP. This unique multicentre approach first provided high-quality evidence evaluating suppressed burrowing as robust and reproducible, supporting its use as tool to infer the global effect of pain on rodents. Second, our approach provided important informative value for the use of multicentre studies in the future.

Multicenter Evaluation of Geometric Accuracy of MRI Protocols Used in Experimental Stroke

It has recently been suggested that multicenter preclinical stroke studies should be carried out to improve translation from bench to bedside, but the accuracy of magnetic resonance imaging (MRI) scanners routinely used in experimental stroke has not yet been evaluated. We aimed to assess and compare geometric accuracy of preclinical scanners and examine the longitudinal stability of one scanner using a simple quality assurance (QA) protocol. Six 7 Tesla animal scanners across six different preclinical imaging centers throughout Europe were used to scan a small structural phantom and estimate linear scaling errors in all orthogonal directions and volumetric errors. Between-scanner imaging consisted of a standard sequence and each center's preferred sequence for the assessment of infarct size in rat models of stroke. The standard sequence was also used to evaluate the drift in accuracy of the worst performing scanner over a period of six months following basic gradient calibration. Scaling and volumetric errors using the standard sequence were less variable than corresponding errors using different stroke sequences. The errors for one scanner, estimated using the standard sequence, were very high (above 4% scaling errors for each orthogonal direction, 18.73% volumetric error). Calibration of the gradient coils in this system reduced scaling errors to within ±1.0%; these remained stable during the subsequent 6-month assessment. In conclusion, despite decades of use in experimental studies, preclinical MRI still suffers from poor and variable geometric accuracy, influenced by the use of miscalibrated systems and various types of sequences for the same purpose. For effective pooling of data in multicenter studies, centers should adopt standardized procedures for system QA and in vivo imaging.

Results of a preclinical randomized controlled multicenter trial (pRCT): Anti-CD49d treatment for acute brain ischemia

Numerous treatments have been reported to provide a beneficial outcome in experimental animal stroke models; however, these treatments (with the exception of tissue plasminogen activator) have failed in clinical trials. To improve the translation of treatment efficacy from bench to bedside, we have performed a preclinical randomized controlled multicenter trial (pRCT) to test a potential stroke therapy under circumstances closer to the design and rigor of a clinical randomized control trial. Anti-CD49d antibodies, which inhibit the migration of leukocytes into the brain, were previously investigated in experimental stroke models by individual laboratories. Despite the conflicting results from four positive and one inconclusive preclinical studies, a clinical trial was initiated. To confirm the preclinical results and to test the feasibility of conducting a pRCT, six independent European research centers investigated the efficacy of anti-CD49d antibodies in two distinct mouse models of stroke in a centrally coordinated, randomized, and blinded approach. The results pooled from all research centers revealed that treatment with CD49d-specific antibodies significantly reduced both leukocyte invasion and infarct volume after the permanent distal occlusion of the middle cerebral artery, which causes a small cortical infarction. In contrast, anti-CD49d treatment did not reduce lesion size or affect leukocyte invasion after transient proximal occlusion of the middle cerebral artery, which induces large lesions. These results suggest that the benefits of immune-targeted approaches may depend on infarct severity and localization. This study supports the feasibility of performing pRCTs.

The next step in translational research: lessons learned from the first preclinical randomized controlled trial

For years, low reproducibility of preclinical trials and poor translation of promising preclinical therapies to the clinic have posed major challenges to translational research in most biomedical fields. To overcome the limitations that stand between experimental and clinical research, international consortia have attempted to establish standardized guidelines for study design and for reporting the resulting data. In addition, multicenter preclinical randomized controlled trials (pRCTs) have been proposed as a suitable tool for 'bridging the gap' between experimental research and clinical trials. We recently reported the design and results of the first such pRCT in which we confirmed the feasibility of using a coordinated approach with standardized protocols in collaboration with independent multinational research centers. However, despite its successes, this first pRCT also had several difficulties, particularly with respect to following the protocols established in the study design and analyzing the data. Here, we review our experiences performing the study, and we analyze and discuss the lessons learned from performing the first pRCT. Moreover, we provide suggestions regarding how obstacles can be overcome to improve the performance and outcome of future pRCT studies. Translational research is hampered by low reproducibility of preclinical studies and countless failed clinical trials. International consortia have proposed preclinical multicenter trials as an intermediate step to overcome this 'translational roadblock'. We have recently performed the first such preclinical randomized controlled trial (pRCT) by adopting key elements of clinical study design to preclinical research. In this review, we discuss the lessons learned from this trial and provide suggestions how to optimize future pRCTs. This article is part of the 60th Anniversary special issue.

A cross-laboratory preclinical study on the effectiveness of interleukin-1 receptor antagonist in stroke

Stroke represents a global challenge and is a leading cause of permanent disability worldwide. Despite much effort, translation of research findings to clinical benefit has not yet been successful. Failure of neuroprotection trials is considered, in part, due to the low quality of preclinical studies, low level of reproducibility across different laboratories and that stroke co-morbidities have not been fully considered in experimental models. More rigorous testing of new drug candidates in different experimental models of stroke and initiation of preclinical cross-laboratory studies have been suggested as ways to improve translation. However, to our knowledge, no drugs currently in clinical stroke trials have been investigated in preclinical cross-laboratory studies. The cytokine interleukin 1 is a key mediator of neuronal injury, and the naturally occurring interleukin 1 receptor antagonist has been reported as beneficial in experimental studies of stroke. In the present paper, we report on a preclinical cross-laboratory stroke trial designed to investigate the efficacy of interleukin 1 receptor antagonist in different research laboratories across Europe. Our results strongly support the therapeutic potential of interleukin 1 receptor antagonist in experimental stroke and provide further evidence that interleukin 1 receptor antagonist should be evaluated in more extensive clinical stroke trials.

Feasibility of progesterone treatment for ischaemic stroke

Two multi-centre phase III clinical trials examining the protective potential of progesterone following traumatic brain injury have recently failed to demonstrate any improvement in outcome. Thus, it is timely to consider how this impacts on the translational potential of progesterone treatment for ischaemic stroke. A wealth of experimental evidence supports the neuroprotective properties of progesterone, and associated metabolites, following various types of central nervous system injury. In particular, for ischaemic stroke, studies have also begun to reveal possible mechanisms of such neuroprotection. However, the results in traumatic brain injury now question whether further clinical development of progesterone for ischaemic stroke is relevant.

Magnetic resonance imaging in experimental stroke and comparison with histology: systematic review and meta-analysis

BACKGROUND AND PURPOSE

Because the new era of preclinical stroke research demands improvements in validity and generalizability of findings, moving from single site to multicenter studies could be pivotal. However, the conduct of magnetic resonance imaging (MRI) in stroke remains ill-defined. We sought to assess the variability in the use of MRI for evaluating lesions post stroke and to examine the possibility as an alternative to gold standard histology for measuring the infarct size.

METHODS

We identified animal studies of ischemic stroke reporting lesion sizes using MRI. We assessed the degree of heterogeneity and reporting of scanning protocols, postprocessing methods, study design characteristics, and study quality. Studies performing histological evaluation of infarct size were further selected to compare with corresponding MRI using meta-regression.

RESULTS

Fifty-four articles undertaking a total of 78 different MRI scanning protocols met the inclusion criteria. T2-weighted imaging was most frequently used (83% of the studies), followed by diffusion-weighted imaging (43%). Reporting of the imaging parameters was adequate, but heterogeneity between studies was high. Twelve studies assessed the infarct size using both MRI and histology at corresponding time points, with T2-weighted imaging-based treatment effect having a significant positive correlation with histology (; P<0.001).

CONCLUSIONS

Guidelines for standardized use and reporting of MRI in preclinical stroke are urgently needed. T2-weighted imaging could be used as an effective in vivo alternative to histology for estimating treatment effects based on the extent of infarction; however, additional studies are needed to explore the effect of individual parameters.

Pharmacology should be at the centre of all preclinical and clinical studies on new psychoactive substances (recreational drugs)

Despite the publication of a substantial body of preclinical and clinical information on recent recreational drugs such as 3,4-methylenedioxymethamphetamine (MDMA, 'ecstasy') and cathinone compounds such as mephedrone there remains a disturbing lack of consensus as to how dangerous these compounds are to the health of the individual and to society in general. This perspective proposes that use of good pharmacological practice should be mandatory in all preclinical and clinical studies. Its use will assist both translation and reverse translation of information produced in animals and clinical subjects. We propose several basic rules to be followed in all future studies. Preclinical studies should employ pharmacokinetic-pharmacodynamic integration thereby exposing animals to known or calculable drug concentrations. This will provide results relevant to pharmacology rather than toxicology and, crucially, data relevant to human drug use. Full experimental detail should be routinely provided, to allow comparison with other similar work. In clinical studies evidence should be provided that the drug under investigation has been ingested by the subjects being examined, and details given of all other drugs being ingested. Drug-drug interactions are an unavoidable confound but studies of a size that allows reliable statistical evaluation and preferably allows sub-group analysis, particularly by using meta-analysis, should help with this problem. This may require greater collaboration between investigative groups, as routinely occurs during pharmaceutical clinical trials. Other proposals include greater integration of preclinical and clinical scientists in both preclinical and clinical studies and changes in the law regarding Good Manufacturing Process (GMP) sourcing of drug for human studies.

The need for randomization in animal trials: an overview of systematic reviews

Background and Objectives

Randomization, allocation concealment, and blind outcome assessment have been shown to reduce bias in human studies. Authors from the Collaborative Approach to Meta Analysis and Review of Animal Data from Experimental Studies (CAMARADES) collaboration recently found that these features protect against bias in animal stroke studies. We extended the scope the work from CAMARADES to include investigations of treatments for any condition.

Methods

We conducted an overview of systematic reviews. We searched Medline and Embase for systematic reviews of animal studies testing any intervention (against any control) and we included any disease area and outcome. We included reviews comparing randomized versus not randomized (but otherwise controlled), concealed versus unconcealed treatment allocation, or blinded versus unblinded outcome assessment.

Results

Thirty-one systematic reviews met our inclusion criteria: 20 investigated treatments for experimental stroke, 4 reviews investigated treatments for spinal cord diseases, while 1 review each investigated treatments for bone cancer, intracerebral hemorrhage, glioma, multiple sclerosis, Parkinson's disease, and treatments used in emergency medicine. In our sample 29% of studies reported randomization, 15% of studies reported allocation concealment, and 35% of studies reported blinded outcome assessment. We pooled the results in a meta-analysis, and in our primary analysis found that failure to randomize significantly increased effect sizes, whereas allocation concealment and blinding did not. In our secondary analyses we found that randomization, allocation concealment, and blinding reduced effect sizes, especially where outcomes were subjective.

Conclusions

Our study demonstrates the need for randomization, allocation concealment, and blind outcome assessment in animal research across a wide range of outcomes and disease areas. Since human studies are often justified based on results from animal studies, our results suggest that unduly biased animal studies should not be allowed to constitute part of the rationale for human trials.

Systematic review and meta-analysis of interventions tested in animal models of lacunar stroke

BACKGROUND AND PURPOSE

A total of 25% of strokes are lacunar, and these are pathophysiologically different from large artery strokes. Despite emerging evidence of a substantial impact on physical disability and dementia, little attention has been paid to the development of specific treatments. The optimal use of the animal models of lacunar stroke used to test candidate interventions is not known.

METHODS

We conducted a systematic review and meta-analysis of studies testing candidate interventions in animal models of lacunar stroke. We used random-effects meta-analysis to assess the impact of study characteristics and trim and fill to seek evidence of publication bias.

RESULTS

The efficacy of 43 distinct interventions was described in 57 publications. The median number of quality checklist items scored was 3 of 8 (interquartile range, 2-4). Many models reflected mechanisms of limited relevance to lacunar stroke. Meta-analysis of results from 27 studies showed that on average, infarct size and neurobehavioral outcome were improved by 34.2% (24.1-44.2) and 0.82 standardized mean difference (0.51-1.14), respectively. Four interventions improved both infarct size and neurobehavioral outcome but there were insufficient data for this finding to be considered robust. For infarct size, efficacy was lower in studies reporting blinding and higher in studies reporting randomization. For neurobehavior, efficacy was lower in randomized studies. For infarct size there was evidence of publication bias.

CONCLUSIONS

No intervention has yet been tested in sufficient range and depth to support translation to clinical trial. There is limited reporting of measures to reduce the risk of bias and evidence for a substantial publications bias.

Some salt with your statin, professor?

In this primer, Malcolm Macleod outlines the use of meta-analysis to assess the validity of the outcome reported for preclinical studies and explores the reasons why Lisa Bero and colleagues find that industry-funded studies show smaller effect sizes than non-industry-funded studies do.

We know that clinical trials sponsored by the pharmaceutical industry are likely to exaggerate benefit and minimise harms. But do these biases extend to their sponsorship of non-human animal research? Using systematic review and meta-analysis Bero and colleagues show that, in the case of statins, things are a little more complicated. While the conclusions of industry-sponsored studies were indeed more enthusiastic than warranted by their data, the data themselves painted a picture more conservative than was seen in non-industry-sponsored studies. This behaviour is consistent with maximising the return on investment, seeking robust data before embarking on a clinical trial, and, once that investment has been made, making every effort to “prove” that the drug is safe and effective if this is at all credible. The findings suggest that there is something different about industry-sponsored non-human animal research, perhaps reflecting higher standards than is the case elsewhere. Perhaps the academic community can learn something from our colleagues in the commercial sector.

Increasing value and reducing waste in research design, conduct, and analysis

Correctable weaknesses in the design, conduct, and analysis of biomedical and public health research studies can produce misleading results and waste valuable resources. Small effects can be difficult to distinguish from bias introduced by study design and analyses. An absence of detailed written protocols and poor documentation of research is common. Information obtained might not be useful or important, and statistical precision or power is often too low or used in a misleading way. Insufficient consideration might be given to both previous and continuing studies. Arbitrary choice of analyses and an overemphasis on random extremes might affect the reported findings. Several problems relate to the research workforce, including failure to involve experienced statisticians and methodologists, failure to train clinical researchers and laboratory scientists in research methods and design, and the involvement of stakeholders with conflicts of interest. Inadequate emphasis is placed on recording of research decisions and on reproducibility of research. Finally, reward systems incentivise quantity more than quality, and novelty more than reliability. We propose potential solutions for these problems, including improvements in protocols and documentation, consideration of evidence from studies in progress, standardisation of research efforts, optimisation and training of an experienced and non-conflicted scientific workforce, and reconsideration of scientific reward systems.

Edaravone Improves Functional and Structural Outcomes in Animal Models of Focal Cerebral Ischemia: A Systematic Review

Edaravone has been used in patients with acute ischemic stroke in Japan for over 10 years but does not have marketing authorization in Europe or America. Either patients in Europe and America are not receiving an effective treatment, or those in Asia are being given a treatment which is not effective. Finding out which of these is true will require further clinical trials, and a better understanding of its efficacy in animal models may help inform the design of those trials so that it might be tested under conditions where there is the greatest prospect of success. We systematically reviewed the efficacy of edaravone in animal models of focal ischemia and summarized data using weighted mean difference DerSimonian and Laird random-effects modeling. We used stratified meta-analysis and metaregression to assess the influence of study design and methodological quality. We identified 49 experiments describing outcome in 814 animals; 30 experiments (519 animals) reported functional and 35 experiments (503 animals) reported structural outcome. Edaravone improved functional and structural outcome by 30.3% (95% confidence interval 23.4–37.2%) and 25.5% (95% confidence interval, 21.1–29.9%), respectively. For functional outcome, there was an inverse relationship between study quality and effect size ( P < 0.0017). Effect sizes were larger in studies where randomization or blinded assessment was not reported. There was no evidence of publication bias. Edaravone is a promising treatment for stroke. However, because of the methodological weakness in current animal studies, no sufficient preclinical evidence is available to optimize the study design of clinical trials. Higher quality animal studies are expected to inform further clinical study.

Do stroke models model stroke?

Stroke is one of the leading causes of death worldwide and the biggest reason for long-term disability. Basic research has formed the modern understanding of stroke pathophysiology, and has revealed important molecular, cellular and systemic mechanisms. However, despite decades of research, most translational stroke trials that aim to introduce basic research findings into clinical treatment strategies - most notably in the field of neuroprotection - have failed. Among other obstacles, poor methodological and statistical standards, negative publication bias, and incomplete preclinical testing have been proposed as 'translational roadblocks'. In this article, we introduce the models commonly used in preclinical stroke research, discuss some of the causes of failed translational success and review potential remedies. We further introduce the concept of modeling 'care' of stroke patients, because current preclinical research models the disorder but does not model care or state-of-the-art clinical testing. Stringent statistical methods and controlled preclinical trials have been suggested to counteract weaknesses in preclinical research. We conclude that preclinical stroke research requires (1) appropriate modeling of the disorder, (2) appropriate modeling of the care of stroke patients and (3) an approach to preclinical testing that is similar to clinical testing, including Phase 3 randomized controlled preclinical trials as necessary additional steps before new therapies enter clinical testing.

Improving the efficiency of the development of drugs for stroke

The mortality and morbidity associated with stroke makes the development of new drugs a research priority. Recent unsuccessful clinical trials have reduced enthusiasm for the development of neuroprotective drugs. Here, we use empirical evidence derived from systematic reviews of stroke drug development to identify stages of drug development which might be improved. We then propose exemplar strategies which may be helpful, along with some basic economic modelling of what the impact of such strategies might be. This suggests that relatively straightforward measures might reduce the costs of drug development by $5·8 bn or 31%.

From basic to clinical neuropharmacology: targetophilia or pharmacodynamics?

Historically, much drug discovery and development in psychopharmacology tended to be empirical. However, over the last 20 years it has primarily been target oriented, with synthesis and selection of compounds designed to act at a specific neurochemical site. Such compounds are then examined in functional animal models of disease. There is little evidence that this approach (which we call 'targetophilia') has enhanced the discovery process and some indications that it may have retarded it. A major problem is the weakness of many animal models in mimicking the disease and the lack of appropriate biochemical markers of drug action in animals and patients. In this review we argue that preclinical studies should be conducted as if they were clinical studies in design, analysis, and reporting, and that clinical pharmacologists should be involved at the earliest stages, to help ensure that animal models reflect as closely as possible the clinical disease. In addition, their familiarity with pharmacokinetic-pharmacodynamic integration (PK-PD) would help ensure that appropriate dosing and drug measurement techniques are applied to the discovery process, thereby producing results with relevance to therapeutics. Better integration of experimental and clinical pharmacologists early in the discovery process would allow observations in animals and patients to be quickly exchanged between the two disciplines. This non-linear approach to discovery used to be the way research proceeded, and it resulted in productivity that has never been bettered. It also follows that occasionally 'look-see' studies, a proven technique for drug discovery, deserve to be reintroduced.

Translational neuropharmacology and the appropriate and effective use of animal models

This issue of the British Journal of Pharmacology is dedicated to reviews of the major animal models used in neuropharmacology to examine drugs for both neurological and psychiatric conditions. Almost all major conditions are reviewed. In general, regulatory authorities require evidence for the efficacy of novel compounds in appropriate animal models. However, the failure of many compounds in clinical trials following clear demonstration of efficacy in animal models has called into question both the value of the models and the discovery process in general. These matters are expertly reviewed in this issue and proposals for better models outlined. In this editorial, we further suggest that more attention be made to incorporate pharmacokinetic knowledge into the studies (quantitative pharmacology). We also suggest that more attention be made to ensure that full methodological details are published and recommend that journals should be more amenable to publishing negative data. Finally, we propose that new approaches must be used in drug discovery so that preclinical studies become more reflective of the clinical situation, and studies using animal models mimic the anticipated design of studies to be performed in humans, as closely as possible.

Can animal models of disease reliably inform human studies?

H. Bart van der Worp and colleagues discuss the controversies and possibilities of translating the results of animal experiments into human clinical trials.