Development and uptake of an online systematic review platform: the early years of the CAMARADES Systematic Review Facility (SyRF)

The effect of nitroglycerin treatment on cerebral ischaemia: A systematic review and meta-analysis of animal studies

BACKGROUND

Nitroglycerin has been of considerable interest as a treatment for ischaemic stroke. Recent clinical trials with nitroglycerin transdermal patches during the acute phase of stroke failed to improve functional outcomes. Systematic review and meta-analysis of the effectiveness of nitroglycerin in preclinical models of ischaemic stroke has not previously been reported, despite several clinical trials.

OBJECTIVE

To conduct a systematic review and meta-analysis of preclinical evidence regarding the effect of nitroglycerin on infarct volume in animal models of ischaemic stroke.

SUMMARY OF REVIEW

The protocol was registered in PROSPERO (CRD42023432644). Our search identified 238 publications. Three publications met inclusion criteria (including 10 comparisons of infarct size). Study quality was modest (median 6 out of 9), with no evidence of publication bias. Nitroglycerin did not significantly reduce infarct volume (NMD point estimate 20.2 % reduction, 95 % CI -1.52-52.7 %, p = 0.068). Subgroup analysis suggested greater efficacy of nitroglycerin with direct intracarotid administration to the ischaemic territory at the time of reperfusion.

CONCLUSIONS

A small number of studies (three) were included in this review. Overall, nitroglycerin did not reduce infarct volume in experimental stroke models. However, nitroglycerin may be of benefit when administered directly into the ischaemic territory. Given nitroglycerin's short half-life, we propose this route may minimise harmful reduction of cerebral perfusion pressure resulting from hypotension following systemic administration.

Omega-3 fatty acids as a treatment option in periodontitis: Systematic review of preclinical studies

Background: Periodontitis presents as a chronic inflammatory disease that affects the gingival tissues and structures surrounding the tooth. However, the existing approaches for periodontitis do not allow complete control of the disease. In this regard, an active search is being carried out both in preclinical and clinical studies for new approaches based, among other things, on nutraceuticals. Aim: This systematic review aimed to summarize and systematize data from preclinical studies on the effects of the use of polyunsaturated omega-3 fatty acids in experimentally induced periodontitis. Methods: A systematic search for research articles was performed using electronic scientific databases. Only original in vivo experimental studies investigating the use of omega-3 polyunsaturated fatty acids in experimentally induced periodontitis were included. Quality and risk of bias assessment (Systematic Review Centre for Laboratory Animal Experimentation) and quality of evidence assessment (using the modified Grading of Recommendations Assessment, Development and Evaluation approach) were performed. Results: Nineteen studies were included in this systematic review. It has been shown that omega-3 polyunsaturated fatty acids may decrease the progression of periodontitis with amelioration of alveolar bone loss along with decreased pro-inflammatory response and inhibition of osteoclasts. Despite the promising results, most of the analyzed studies were characterized by low to moderate quality and a significant risk of bias. Conclusion: Based on the retrieved data, the possibility of extrapolating the obtained results to humans is limited, indicating the need for additional studies to elucidate the key patterns and mechanisms of action of omega-3 polyunsaturated fatty acids and their endogenous metabolites in experimentally induced periodontitis.

Shared effects of electroconvulsive shocks and ketamine on neuroplasticity: A systematic review of animal models of depression

Electroconvulsive shocks (ECS) and ketamine are antidepressant treatments with a relatively fast onset of therapeutic effects compared to conventional medication and psychotherapy. While the exact neurobiological mechanisms underlying the antidepressant response of ECS and ketamine are unknown, both interventions are associated with neuroplasticity. Restoration of neuroplasticity may be a shared mechanism underlying the antidepressant efficacy of these interventions. In this systematic review, literature of animal models of depression is summarized to examine the possible role of neuroplasticity in ECS and ketamine on a molecular, neuronal, synaptic and functional level, and specifically to what extent these mechanisms are shared between both interventions. The results highlight that hippocampal neurogenesis and brain-derived neurotrophic factor (BDNF) levels are consistently increased after ECS and ketamine. Moreover, both interventions positively affect glutamatergic neurotransmission, astrocyte and neuronal morphology, synaptic density, vasculature and functional plasticity. However, a small number of studies investigated these processes after ECS. Understanding the shared fundamental mechanisms of fast-acting antidepressants can contribute to the development of novel therapeutic approaches for patients with severe depression.

A wide scope, pan-comparative, systematic meta-analysis of the efficacy of prophylactic strategies for cardiac surgery-associated acute kidney injury

Acute kidney injury (AKI) is the most common complication of cardiac surgery. Cardiac surgery-associated AKI (CSA-AKI) is caused by systemic and renal hemodynamic impairment and parenchymal injury. Prophylaxis of CSA-AKI remains an unmet priority, for which preventive strategies based on drug therapies, hydration procedures, and remote ischemic preconditioning (RIPC) have been tested in pre-clinical and clinical studies, with variable success. Contradicting reports and scarce or insufficiently pondered information have blurred conclusions. Therefore, with an aim to contribute to consolidating the available information, we carried out a wide scope, pan-comparative meta-analysis including the accessible information about the most relevant nephroprotective approaches assayed. After a thorough examination of 1892 documents retrieved from PubMed and Web of Science, 150 studies were used for the meta-analysis. Individual odds ratios of efficacy at reducing AKI incidence, need for dialysis, and plasma creatinine elevation were obtained for each alleged protectant. Also, the combined class effect of drug families and protective strategies was also meta-analyzed. Our results show that no drug family or procedure affords substantial protection against CSA-AKI. Only, a mild but significant reduction in the incidence of CSA-AKI by preemptive treatment with dopaminergic and adrenergic drugs, vasodilators, and the RIPC technique. The integrated analysis suggests that single-drug approaches are unlikely to cope with the variety of individual pathophysiological scenarios potentially underlying CSA-AKI. Accordingly, a theragnostic approach involving the etiopathological diagnosis of kidney frailty is necessary to guide research towards the development of pharmacological combinations concomitantly and effectively addressing the key mechanisms of CSA-AKI.

Timing of SMN replacement therapies in mouse models of spinal muscular atrophy: a systematic review and meta-analysis

Mutations in the Survival of Motor Neuron 1 gene lead to a loss of survival motor neuron protein in patients with spinal muscular atrophy. Revolutionary advances in gene therapy have led to survival motor neuron-replacement therapies that significantly prolong life expectancy and improve neuromuscular function. However, accumulating evidence suggests that the timing of survival motor neuron-replacement therapies is a critical determinant of success. We performed a systematic review and meta-analysis of all pre-clinical studies testing survival motor neuron replacement therapies in mouse models of spinal muscular atrophy to assess the impact of timing of delivery on therapeutic effectiveness. We incorporated four databases in this pre-registered study (PROSPERO 2020 CRD42020200180): EMBASE, PubMed, Scopus and Web of Science. Inclusion criteria were; primary research article, a measure of survival analysis, use of survival motor neuron mouse model and evaluation of survival motor neuron-targeting therapy. Exclusion criteria included; use of therapies not known to directly target survival motor neuron, genetic manipulations and/or lack of appropriate controls. We screened papers using the SyRF platform. The main outcome we assessed was survival in treated groups compared to untreated groups. We performed meta-analysis of survival using median survival ratio and the random effects model and measured heterogeneity using the I 2 statistic. Subgroup analyses were performed to assess treatment efficacy based on timing of intervention (embryonic delivery, day of birth, postnatal day 2 and postnatal day 3 or later) and treatment type. If detailed in the studies, body weight compared to untreated spinal muscular atrophy models and motor neuron number were included as secondary outcomes for meta-analysis. 3469 studies were initially identified, with 78 ultimately included. Survival motor neuron-replacement therapies significantly affected survival in favour of treatment by a factor of 1.20 (95% CI 1.10-1.30, P < 0.001) with high heterogeneity (I 2 = 95%). Timing of treatment was a significant source of heterogeneity (P < 0.01), with earlier treatment having a greater impact on survival. When stratified by type of treatment, earlier treatment continued to have the strongest effect with viral vector replacement therapy and antisense oligonucleotide therapy. Secondary outcome measures of body weight and spinal motor neuron counts were also positively associated with early treatment. Earlier delivery of survival motor neuron replacement therapies is therefore a key determinant of treatment efficacy in spinal muscular atrophy.

A meta-analysis of animal studies evaluating the effect of hydrogen sulfide on ischemic stroke: is the preclinical evidence sufficient to move forward?

Hydrogen sulfide (H2S) is a gasotransmitter that has been studied for its potential therapeutic effects, including its role in the pathophysiology and treatment of stroke. This systematic review and meta-analysis aimed to determine the sufficiency of overall preclinical evidence to guide the initiation of clinical stroke trials with H2S and provide tailored recommendations for their design. PubMed, Web of Science, Scopus, EMBASE, and MEDLINE were searched for studies evaluating the effect of any H2S donor on in vivo animal models of regional ischemic stroke, and 34 publications were identified. Pooling of the effect sizes using the random-effect model revealed that H2S decreased the infarct area by 34.5% (95% confidence interval (CI) 28.2-40.8%, p < 0.0001), with substantial variability among the studies (I2 = 89.8%). H2S also caused a 37.9% reduction in the neurological deficit score (95% CI 29.0-46.8%, p < 0.0001, I2 = 63.8%) and in the brain water content (3.2%, 95% CI 1.4-4.9%, p = 0.0014, I2 = 94.6%). Overall, the studies had a high risk of bias and low quality of evidence (median quality score 5/15, interquartile range 4-9). The majority of the included studies had a "high" or "unclear" risk of bias, and none of the studies overall had a "low" risk. In conclusion, H2S significantly improves structural and functional outcomes in in vivo animal models of ischemic stroke. However, the level of evidence from preclinical studies is not sufficient to proceed to clinical trials due to the low external validity, high risk of bias, and variable design of existing animal studies.

Analysis of animal-to-human translation shows that only 5% of animal-tested therapeutic interventions obtain regulatory approval for human applications

There is an ongoing debate about the value of animal experiments to inform medical practice, yet there are limited data on how well therapies developed in animal studies translate to humans. We aimed to assess 2 measures of translation across various biomedical fields: (1) The proportion of therapies which transition from animal studies to human application, including involved timeframes; and (2) the consistency between animal and human study results. Thus, we conducted an umbrella review, including English systematic reviews that evaluated the translation of therapies from animals to humans. Medline, Embase, and Web of Science Core Collection were searched from inception until August 1, 2023. We assessed the proportion of therapeutic interventions advancing to any human study, a randomized controlled trial (RCT), and regulatory approval. We meta-analyzed the concordance between animal and human studies. The risk of bias was probed using a 10-item checklist for systematic reviews. We included 122 articles, describing 54 distinct human diseases and 367 therapeutic interventions. Neurological diseases were the focus of 32% of reviews. The overall proportion of therapies progressing from animal studies was 50% to human studies, 40% to RCTs, and 5% to regulatory approval. Notably, our meta-analysis showed an 86% concordance between positive results in animal and clinical studies. The median transition times from animal studies were 5, 7, and 10 years to reach any human study, an RCT, and regulatory approval, respectively. We conclude that, contrary to widespread assertions, the rate of successful animal-to-human translation may be higher than previously reported. Nonetheless, the low rate of final approval indicates potential deficiencies in the design of both animal studies and early clinical trials. To ameliorate the efficacy of translating therapies from bench to bedside, we advocate for enhanced study design robustness and the reinforcement of generalizability.

The societal impact of Open Science: a scoping review

Open Science (OS) aims, in part, to drive greater societal impact of academic research. Government, funder and institutional policies state that it should further democratize research and increase learning and awareness, evidence-based policy-making, the relevance of research to society's problems, and public trust in research. Yet, measuring the societal impact of OS has proven challenging and synthesized evidence of it is lacking. This study fills this gap by systematically scoping the existing evidence of societal impact driven by OS and its various aspects, including Citizen Science (CS), Open Access (OA), Open/FAIR Data (OFD), Open Code/Software and others. Using the PRISMA Extension for Scoping Reviews and searches conducted in Web of Science, Scopus and relevant grey literature, we identified 196 studies that contain evidence of societal impact. The majority concern CS, with some focused on OA, and only a few addressing other aspects. Key areas of impact found are education and awareness, climate and environment, and social engagement. We found no literature documenting evidence of the societal impact of OFD and limited evidence of societal impact in terms of policy, health, and trust in academic research. Our findings demonstrate a critical need for additional evidence and suggest practical and policy implications.

The effects of sodium alendronate on socket healing after tooth extraction: a systematic review of animal studies

The aim of this systematic review was to answer the following question: "Does alendronate, a nitrogen-containing bisphosphonate, improve or impair alveolar socket healing after tooth extraction in animal models"? To this end, a systematic review of the literature was carried out in PubMed, Scopus, LILACS, Web of Science, as well as in the gray literature up to May 2023. Preclinical studies that evaluated alveolar healing after tooth extraction and the intake of sodium alendronate compared with placebo were included. Two investigators were responsible for screening the articles independently, extracting the data, and assessing their quality through the SYRCLE's RoB tool for randomized trials in animal studies. The study selection process, study characteristics, risk of bias in studies, impact of alendronate on bone healing, and certainty of evidence were described in text and table formats. Methodological differences among the studies were restricted to the synthesis methods. The synthesis of qualitative results followed the Synthesis Without Meta-analysis (SWiM) reporting guideline. From the 19 included studies, five were considered to have low risk, three were of unclear risk, and eleven presented a high risk of bias. The studies were considered heterogeneous regarding alendronate posology, including its dosage and route of administration. Furthermore, a variety of animal species, different age ranges, diverse teeth extracted, and exposure or not to ovariectomy contributed to the lack of parity of the selected studies. Our results indicated that alendronate monotherapy negatively affects the early phase of wound healing after tooth extraction in preclinical studies, suggesting that the bone resorption process after tooth extraction in animals treated with alendronate might impair the bone healing process of the extraction socket. In conclusion, alendronate administration restrains bone resorption, thereby delaying alveolar socket healing . Future studies should be conducted to validate these findings and to better understand the effects of alendronate therapy on oral tissues.

Spontaneous activity in peripheral sensory nerves: a systematic review

ABSTRACT

In the peripheral nervous system, spontaneous activity in sensory neurons is considered to be one of the 2 main drivers of chronic pain states, alongside neuronal sensitization. Despite this, the precise nature and timing of this spontaneous activity in neuropathic pain is not well-established. Here, we have performed a systematic search and data extraction of existing electrophysiological literature to shed light on which fibre types have been shown to maintain spontaneous activity and over what time frame. We examined both in vivo recordings of preclinical models of neuropathic pain, as well as microneurography recordings in humans. Our analyses reveal that there is broad agreement on the presence of spontaneous activity in neuropathic pain conditions, even months after injury or years after onset of neuropathic symptoms in humans. However, because of the highly specialised nature of the electrophysiological methods used to measure spontaneous activity, there is also a high degree of variability and uncertainty around these results. Specifically, there are very few directly controlled experiments, with less directly comparable data between human and animals. Given that spontaneous peripheral neuron activity is considered to be a key mechanistic feature of chronic pain conditions, it may be beneficial to conduct further experiments in this space.

Trace amine-associated receptor 1 (TAAR1) agonism for psychosis: a living systematic review and meta-analysis of human and non-human data

Background

Trace amine-associated receptor 1 (TAAR1) agonism shows promise for treating psychosis, prompting us to synthesise data from human and non-human studies.

Methods

We co-produced a living systematic review of controlled studies examining TAAR1 agonists in individuals (with or without psychosis/schizophrenia) and relevant animal models. Two independent reviewers identified studies in multiple electronic databases (until 17.11.2023), extracted data, and assessed risk of bias. Primary outcomes were standardised mean differences (SMD) for overall symptoms in human studies and hyperlocomotion in animal models. We also examined adverse events and neurotransmitter signalling. We synthesised data with random-effects meta-analyses.

Results

Nine randomised trials provided data for two TAAR1 agonists (ulotaront and ralmitaront), and 15 animal studies for 10 TAAR1 agonists. Ulotaront and ralmitaront demonstrated few differences compared to placebo in improving overall symptoms in adults with acute schizophrenia (N=4 studies, n=1291 participants; SMD=0.15, 95%CI: -0.05, 0.34), and ralmitaront was less efficacious than risperidone (N=1, n=156, SMD=-0.53, 95%CI: -0.86, -0.20). Large placebo response was observed in ulotaront phase-III trials. Limited evidence suggested a relatively benign side-effect profile for TAAR1 agonists, although nausea and sedation were common after a single dose of ulotaront. In animal studies, TAAR1 agonists improved hyperlocomotion compared to control (N=13 studies, k=41 experiments, SMD=1.01, 95%CI: 0.74, 1.27), but seemed less efficacious compared to dopamine D 2 receptor antagonists (N=4, k=7, SMD=-0.62, 95%CI: -1.32, 0.08). Limited human and animal data indicated that TAAR1 agonists may regulate presynaptic dopaminergic signalling.

Conclusions

TAAR1 agonists may be less efficacious than dopamine D 2 receptor antagonists already licensed for schizophrenia. The results are preliminary due to the limited number of drugs examined, lack of longer-term data, publication bias, and assay sensitivity concerns in trials associated with large placebo response. Considering their unique mechanism of action, relatively benign side-effect profile and ongoing drug development, further research is warranted.

Registration

PROSPERO-ID: CRD42023451628.

Meta-review on Perforation Model of Subarachnoid Hemorrhage in Mice: Filament Material as a Possible Moderator of Mortality

Robust preclinical models are inevitable for researchers to unravel pathomechanisms of subarachnoidal hemorrhage (SAH). For the mouse perforation model of SAH, the goal of this meta-review was the determination of variances in mortality, SAH severity grade, and vasospasm, and their experimental moderators, as many researchers are facing with incomparable results. We searched on the databases PubMed, Embase, and Web of Science for articles describing in vivo experiments using the SAH perforation mouse model and measuring mortality, SAH grade, and/or vasospasm. After screening, 42 articles (total of 1964 mice) were included into systematic review and meta-analysis. Certain model characteristics were insufficiently reported, e.g., perforation location (not reported in six articles), filament (material (n = 15) and tip texture (n = 25)), mouse age (n = 14), and weight (n = 10). Used injective anesthetics and location of perforation showed large variation. In a random-effects meta-analysis, the overall animal mortality following SAH was 21.3% [95% CI: 17.5%, 25.7%] and increased with longer observational periods. Filament material significantly correlated with animal mortality (p = 0.024) after exclusion of hyperacute studies (time after SAH induction < 24 h). Reported mean SAH grade was 10.7 [9.6, 11.7] on the scale of Sugawara (J Neurosci Methods 167:327-34, 2008). Furthermore, mean diameter of large cerebral arteries after SAH was reduced by 27.6% compared to sham-operated non-SAH mice. Uniforming standards of experimental procedures and their reporting are indispensable to increase overall comparability.

A systematic review and meta-analysis of thigmotactic behaviour in the open field test in rodent models associated with persistent pain

Thigmotaxis is an innate predator avoidance behaviour of rodents. To gain insight into how injury and disease models, and analgesic drug treatments affect thigmotaxis, we performed a systematic review and meta-analysis of studies that assessed thigmotaxis in the open field test. Systematic searches were conducted of 3 databases in October 2020, March and August 2022. Study design characteristics and experimental data were extracted and analysed using a random-effects meta-analysis. We also assessed the correlation between thigmotaxis and stimulus-evoked limb withdrawal. This review included the meta-analysis of 165 studies We report thigmotaxis was increased in injury and disease models associated with persistent pain and this increase was attenuated by analgesic drug treatments in both rat and mouse experiments. Its usefulness, however, may be limited in certain injury and disease models because our analysis suggested that thigmotaxis may be associated with the locomotor function. We also conducted subgroup analyses and meta-regression, but our findings on sources of heterogeneity are inconclusive because analyses were limited by insufficient available data. It was difficult to assess internal validity because reporting of methodological quality measures was poor, therefore, the studies have an unclear risk of bias. The correlation between time in the centre (type of a thigmotactic metric) and types of stimulus-evoked limb withdrawal was inconsistent. Therefore, stimulus-evoked and ethologically relevant behavioural paradigms should be viewed as two separate entities as they are conceptually and methodologically different from each other.

Trace amine-associated receptor 1 (TAAR1) agonists for psychosis: protocol for a living systematic review and meta-analysis of human and non-human studies

BACKGROUND

There is an urgent need to develop more effective and safer antipsychotics beyond dopamine 2 receptor antagonists. An emerging and promising approach is TAAR1 agonism. Therefore, we will conduct a living systematic review and meta-analysis to synthesize and triangulate the evidence from preclinical animal experiments and clinical studies on the efficacy, safety, and underlying mechanism of action of TAAR1 agonism for psychosis.

METHODS

Independent searches will be conducted in multiple electronic databases to identify clinical and animal experimental studies comparing TAAR1 agonists with licensed antipsychotics or other control conditions in individuals with psychosis or animal models for psychosis, respectively. The primary outcomes will be overall psychotic symptoms and their behavioural proxies in animals. Secondary outcomes will include side effects and neurobiological measures. Two independent reviewers will conduct study selection, data extraction using predefined forms, and risk of bias assessment using suitable tools based on the study design. Ontologies will be developed to facilitate study identification and data extraction. Data from clinical and animal studies will be synthesized separately using random-effects meta-analysis if appropriate, or synthesis without meta-analysis. Study characteristics will be investigated as potential sources of heterogeneity. Confidence in the evidence for each outcome and source of evidence will be evaluated, considering the summary of the association, potential concerns regarding internal and external validity, and reporting biases. When multiple sources of evidence are available for an outcome, an overall conclusion will be drawn in a triangulation meeting involving a multidisciplinary team of experts. We plan trimonthly updates of the review, and any modifications in the protocol will be documented. The review will be co-produced by multiple stakeholders aiming to produce impactful and relevant results and bridge the gap between preclinical and clinical research on psychosis.

PROTOCOL REGISTRATION

PROSPERO-ID: CRD42023451628.

Systematic online living evidence summaries: emerging tools to accelerate evidence synthesis

Systematic reviews and meta-analysis are the cornerstones of evidence-based decision making and priority setting. However, traditional systematic reviews are time and labour intensive, limiting their feasibility to comprehensively evaluate the latest evidence in research-intensive areas. Recent developments in automation, machine learning and systematic review technologies have enabled efficiency gains. Building upon these advances, we developed Systematic Online Living Evidence Summaries (SOLES) to accelerate evidence synthesis. In this approach, we integrate automated processes to continuously gather, synthesise and summarise all existing evidence from a research domain, and report the resulting current curated content as interrogatable databases via interactive web applications. SOLES can benefit various stakeholders by (i) providing a systematic overview of current evidence to identify knowledge gaps, (ii) providing an accelerated starting point for a more detailed systematic review, and (iii) facilitating collaboration and coordination in evidence synthesis.

Auto-STEED: A data mining tool for automated extraction of experimental parameters and risk of bias items from in vivo publications

Background

Systematic reviews, i.e., research summaries that address focused questions in a structured and reproducible manner, are a cornerstone of evidence-based medicine and research. However, certain systematic review steps such as data extraction are labour-intensive which hampers their applicability, not least with the rapidly expanding body of biomedical literature.

Objective

To bridge this gap, we aimed at developing a data mining tool in the R programming environment to automate data extraction from neuroscience in vivo publications. The function was trained on a literature corpus (n=45 publications) of animal motor neuron disease studies and tested in two validation corpora (motor neuron diseases, n=31 publications; multiple sclerosis, n=244 publications).

Results

Our data mining tool Auto-STEED (Automated and STructured Extraction of Experimental Data) was able to extract key experimental parameters such as animal models and species as well as risk of bias items such as randomization or blinding from in vivo studies. Sensitivity and specificity were over 85 and 80%, respectively, for most items in both validation corpora. Accuracy and F-scores were above 90% and 0.9 for most items in the validation corpora. Time savings were above 99%.

Conclusions

Our developed text mining tool Auto-STEED is able to extract key experimental parameters and risk of bias items from the neuroscience in vivo literature. With this, the tool can be deployed to probe a field in a research improvement context or to replace one human reader during data extraction resulting in substantial time-savings and contribute towards automation of systematic reviews. The function is available on Github.

Systematic, comprehensive, evidence-based approach to identify neuroprotective interventions for motor neuron disease: using systematic reviews to inform expert consensus

OBJECTIVES

Motor neuron disease (MND) is an incurable progressive neurodegenerative disease with limited treatment options. There is a pressing need for innovation in identifying therapies to take to clinical trial. Here, we detail a systematic and structured evidence-based approach to inform consensus decision making to select the first two drugs for evaluation in Motor Neuron Disease-Systematic Multi-arm Adaptive Randomised Trial (MND-SMART: NCT04302870), an adaptive platform trial. We aim to identify and prioritise candidate drugs which have the best available evidence for efficacy, acceptable safety profiles and are feasible for evaluation within the trial protocol.

METHODS

We conducted a two-stage systematic review to identify potential neuroprotective interventions. First, we reviewed clinical studies in MND, Alzheimer's disease, Huntington's disease, Parkinson's disease and multiple sclerosis, identifying drugs described in at least one MND publication or publications in two or more other diseases. We scored and ranked drugs using a metric evaluating safety, efficacy, study size and study quality. In stage two, we reviewed efficacy of drugs in MND animal models, multicellular eukaryotic models and human induced pluripotent stem cell (iPSC) studies. An expert panel reviewed candidate drugs over two shortlisting rounds and a final selection round, considering the systematic review findings, late breaking evidence, mechanistic plausibility, safety, tolerability and feasibility of evaluation in MND-SMART.

RESULTS

From the clinical review, we identified 595 interventions. 66 drugs met our drug/disease logic. Of these, 22 drugs with supportive clinical and preclinical evidence were shortlisted at round 1. Seven drugs proceeded to round 2. The panel reached a consensus to evaluate memantine and trazodone as the first two arms of MND-SMART.

DISCUSSION

For future drug selection, we will incorporate automation tools, text-mining and machine learning techniques to the systematic reviews and consider data generated from other domains, including high-throughput phenotypic screening of human iPSCs.

Screening for in vitro systematic reviews: a comparison of screening methods and training of a machine learning classifier

OBJECTIVE

Existing strategies to identify relevant studies for systematic review may not perform equally well across research domains. We compare four approaches based on either human or automated screening of either title and abstract or full text, and report the training of a machine learning algorithm to identify in vitro studies from bibliographic records.

METHODS

We used a systematic review of oxygen-glucose deprivation (OGD) in PC-12 cells to compare approaches. For human screening, two reviewers independently screened studies based on title and abstract or full text, with disagreements reconciled by a third. For automated screening, we applied text mining to either title and abstract or full text. We trained a machine learning algorithm with decisions from 2000 randomly selected PubMed Central records enriched with a dataset of known in vitro studies.

RESULTS

Full-text approaches performed best, with human (sensitivity: 0.990, specificity: 1.000 and precision: 0.994) outperforming text mining (sensitivity: 0.972, specificity: 0.980 and precision: 0.764). For title and abstract, text mining (sensitivity: 0.890, specificity: 0.995 and precision: 0.922) outperformed human screening (sensitivity: 0.862, specificity: 0.998 and precision: 0.975). At our target sensitivity of 95% the algorithm performed with specificity of 0.850 and precision of 0.700.

CONCLUSION

In this in vitro systematic review, human screening based on title and abstract erroneously excluded 14% of relevant studies, perhaps because title and abstract provide an incomplete description of methods used. Our algorithm might be used as a first selection phase in in vitro systematic reviews to limit the extent of full text screening required.

Recommendations for robust and reproducible preclinical research in personalised medicine

BACKGROUND

Personalised medicine is a medical model that aims to provide tailor-made prevention and treatment strategies for defined groups of individuals. The concept brings new challenges to the translational step, both in clinical relevance and validity of models. We have developed a set of recommendations aimed at improving the robustness of preclinical methods in translational research for personalised medicine.

METHODS

These recommendations have been developed following four main steps: (1) a scoping review of the literature with a gap analysis, (2) working sessions with a wide range of experts in the field, (3) a consensus workshop, and (4) preparation of the final set of recommendations.

RESULTS

Despite the progress in developing innovative and complex preclinical model systems, to date there are fundamental deficits in translational methods that prevent the further development of personalised medicine. The literature review highlighted five main gaps, relating to the relevance of experimental models, quality assessment practices, reporting, regulation, and a gap between preclinical and clinical research. We identified five points of focus for the recommendations, based on the consensus reached during the consultation meetings: (1) clinically relevant translational research, (2) robust model development, (3) transparency and education, (4) revised regulation, and (5) interaction with clinical research and patient engagement. Here, we present a set of 15 recommendations aimed at improving the robustness of preclinical methods in translational research for personalised medicine.

CONCLUSIONS

Appropriate preclinical models should be an integral contributor to interventional clinical trial success rates, and predictive translational models are a fundamental requirement to realise the dream of personalised medicine. The implementation of these guidelines is ambitious, and it is only through the active involvement of all relevant stakeholders in this field that we will be able to make an impact and effectuate a change which will facilitate improved translation of personalised medicine in the future.

Systematic review and meta-analysis of studies in which burrowing behaviour was assessed in rodent models of disease-associated persistent pain

ABSTRACT

Burrowing behaviour is used to assess pain-associated behaviour in laboratory rodents. To gain insight into how models of disease-associated persistent pain and analgesics affect burrowing behaviour, we performed a systematic review and meta-analysis of studies that assessed burrowing behaviour. A systematic search in March 2020 and update in September 2020 was conducted in 4 databases. Study design characteristics and experimental data were extracted, followed by a random-effects meta-analysis. We explored the association between burrowing and monofilament-induced limb withdrawal. Dose response relationship was investigated for some analgesics. Forty-five studies were included in the meta-analysis, in which 16 model types and 14 drug classes were used. Most experiments used rat (79%) and male (72%) animals. Somatic inflammation and trauma-induced neuropathy models were associated with reduced burrowing behaviour. Analgesics (nonsteroidal anti-inflammatory drug and gabapentinoids) attenuated burrowing deficits in these models. Reporting of measures to reduce risk of bias was unclear except for randomisation which was high. There was not a correlation ( R2 = 0.1421) between burrowing and monofilament-induced limb withdrawal. Opioids, gabapentin, and naproxen showed reduced burrowing behaviour at high doses, whereas ibuprofen and celecoxib showed opposite trend. The findings indicate that burrowing could be used to assess pain-associated behaviour. We support the use of a portfolio of composite measures including spontaneous and stimulus-evoked tests. The information collected here could help in designing experiments involving burrowing assessment in models of disease-associated pain.

Meta-analysis on reporting practices as a source of heterogeneity in in vitro cancer research

Objectives

Heterogeneity of results of exact same research experiments oppose a significant socioeconomic burden. Insufficient methodological reporting is likely to be one of the contributors to results heterogeneity; however, little knowledge on reporting habits of in vitro cancer research and their effects on results reproducibility is available. Exemplified by a commonly performed in vitro assay, we aim to fill this knowledge gap and to derive recommendations necessary for reproducible, robust and translational preclinical science.

Methods

Here, we use systematic review to describe reporting practices in in vitro glioblastoma research using the Uppsala-87 Malignant Glioma (U-87 MG) cell line and perform multilevel random-effects meta-analysis followed by meta-regression to explore sources of heterogeneity within that literature, and any associations between reporting characteristics and reported findings. Literature that includes experiments measuring the effect of temozolomide on the viability of U-87 MG cells is searched on three databases (Embase, PubMed and Web of Science).

Results

In 137 identified articles, the methodological reporting is incomplete, for example, medium glucose level and cell density are reported in only 21.2% and 16.8% of the articles. After adjustments for different drug concentrations and treatment durations, the results heterogeneity across the studies (I2=68.5%) is concerningly large. Differences in culture medium glucose level are a driver of this heterogeneity. However, infrequent reporting of most experimental parameters limits the analysis of reproducibility moderating parameters.

Conclusions

Our results further support the ongoing efforts of establishing consensus reporting practices to elevate durability of results. By doing so, this work can raise awareness of how stricter reporting may help to improve the frequency of successful translation of preclinical results into human application. The authors received no specific funding for this work. A preregistered protocol is available at the Open Science Framework (https://osf.io/9k3dq).

Efficacy of melatonin in term neonatal models of perinatal hypoxia-ischaemia

OBJECTIVE

Neonatal encephalopathy (NE) is an important cause of mortality and disability worldwide. Therapeutic hypothermia (HT) is an effective therapy, however not all babies benefit. Novel agents are urgently needed to improve outcomes. Melatonin in preclinical studies has promising neuroprotective properties. This meta-analysis assessed the efficacy of melatonin in term animal models of NE on cerebral infarct size, neurobehavioural tests and cell death.

METHODS

A literature search was carried out using Embase, MEDLINE and Web of Science (31 May 2021). We identified 14 studies and performed a meta-analysis with a random effects model using standardised mean difference (SMD) as the effect size. The risk of bias was assessed using the Systematic Review Centre for Laboratory animal Experimentation tool and publication bias was assessed with funnel plots, and adjusted using trim and fill analysis. Subgroup and meta-regression analyses were performed to assess the effects of study design variables.

RESULTS

We observed significant reduction in brain infarct size (SMD -2.05, 95% CI [-2.93, -1.16]), improved neurobehavioural outcomes (SMD -0.86, 95% CI [-1.23, -0.53]) and reduction in cell death (SMD -0.60, 95% CI [-1.06, -0.14]) favouring treatment with melatonin. Neuroprotection was evident as a single therapy and combined with HT. Subgroup analysis showed greater efficacy with melatonin given before or immediately after injury and with ethanol excipients. The overall effect size remained robust even after adjustment for publication bias.

INTERPRETATION

These studies demonstrate a significant neuroprotective efficacy of melatonin in term neonatal models of hypoxia-ischaemia, and suggest melatonin is a strong candidate for translation to clinical trials in babies with moderate-severe NE.

Protocol for a preclinical systematic review and meta-analysis of pharmacological targeting of peroxisome proliferator-activated receptors in experimental renal injury

INTRODUCTION

Impaired lipid metabolism in the renal tubule plays a prominent role in the progression of renal fibrosis following acute kidney injury (AKI) and in chronic kidney disease (CKD). Peroxisome proliferator-activated receptors (PPARs) are promising druggable targets to mitigate renal fibrosis by redirecting metabolism, including restoration of fatty acid oxidation (FAO) capacity. We aim to synthesise evidence from preclinical studies of pharmacological PPAR targeting in experimental renal injury, and inform the design of future studies evaluating PPAR-mediated restoration of FAO in AKI and CKD.

METHODS AND ANALYSIS

Studies reporting on the impact of pharmacological PPAR modulation in animal models of renal injury will be collected from MEDLINE (Ovid), Embase and Web of Science databases. Predefined eligibility criteria will exclude studies testing medications which are not specific ligands of one or more PPARs and studies involving multimodal pharmacological treatment. The Systematic Review Centre for Laboratory Animal Experimentation risk of bias tool and Collaborative Approach to Meta-Analysis and Review of Animal Experimental Studies checklist will be used to assess quality of the included studies. Data extraction will be followed by a narrative synthesis of the data and meta-analysis where feasible. Analysis will be performed separately for AKI, CKD and renal transplant models. Subgroup analyses will be performed based on study design characteristics, PPAR isotype(s) targeted, and classes of PPAR-targeting medications used. Risk of publication bias will be assessed using funnel plotting, Egger's regression and trim-and-fill analysis.

ETHICS AND DISSEMINATION

Ethical approval is not required. Findings will be published in a peer-reviewed journal and presented at scientific meetings.

PROSPERO REGISTRATION NUMBER

CRD42021265550.

Risk of bias assessment in preclinical literature using natural language processing

We sought to apply natural language processing to the task of automatic risk of bias assessment in preclinical literature, which could speed the process of systematic review, provide information to guide research improvement activity, and support translation from preclinical to clinical research. We use 7840 full‐text publications describing animal experiments with yes/no annotations for five risk of bias items. We implement a series of models including baselines (support vector machine, logistic regression, random forest), neural models (convolutional neural network, recurrent neural network with attention, hierarchical neural network) and models using BERT with two strategies (document chunk pooling and sentence extraction). We tune hyperparameters to obtain the highest F1 scores for each risk of bias item on the validation set and compare evaluation results on the test set to our previous regular expression approach. The F1 scores of best models on test set are 82.0% for random allocation, 81.6% for blinded assessment of outcome, 82.6% for conflict of interests, 91.4% for compliance with animal welfare regulations and 46.6% for reporting animals excluded from analysis. Our models significantly outperform regular expressions for four risk of bias items. For random allocation, blinded assessment of outcome, conflict of interests and animal exclusions, neural models achieve good performance; for animal welfare regulations, BERT model with a sentence extraction strategy works better. Convolutional neural networks are the overall best models. The tool is publicly available which may contribute to the future monitoring of risk of bias reporting for research improvement activities.