A new network to promote evidence-based research

Adrian Grant's pioneering use of evidence synthesis in perinatal medicine, 1980-1992

Systematic reviews of existing research are needed to help reduce the enormous amount of wasted resources in biomedical research. Whether already available or needed but unavailable, systematic reviews are a key element in prioritising questions for new research, and for informing the design of additional studies. One of the most important of Adrian Grant’s many contributions was to recognise this a decade before it began to become more widely accepted. In this sphere, as well as in many others, he was a real pioneer.

Are bisphosphonates efficacious in knee osteoarthritis? A meta-analysis of randomized controlled trials

OBJECTIVE

To clarify the effects of bisphosphonates in knee osteoarthritis (OA) using an up-to-date meta-analysis of randomized controlled trials (RCTs).

DESIGN

The protocol is registered in PROSPERO (CRD42017073449). We searched MEDLINE, EMBASE, Google Scholar, Web of Science, and Cochrane Database from inception until August 2017. We included only RCTs comparing any bisphosphonates vs placebo in knee OA patients and reporting validated pain and function scales, radiographic progression, and adverse events (AEs) outcomes. We excluded studies using active comparators or concomitant medications besides non-steroidal anti-inflammatory drugs (NSAIDs) and acetaminophen. We calculated standardized mean differences (SMDs) to account for variation in outcome scales. Random effects meta-analyses were performed.

RESULTS

We included seven RCTs (3013 patients, 69% female); most patients (N = 2767) received oral risedronate. No pain or function outcomes, regardless of dose, route, time point or measuring instrument, revealed statistically significant results (end of trial pain SMD = -0.16 [95% confidence interval (CI): -0.34, 0.02]). Similarly, we found no statistically significant effect on radiographic progression (risk ratio = 0.98 [95% CI: 0.77, 1.26]). One small RCT in patients with bone marrow lesions (BMLs) suggested a reduction in BML size at 6 months. Bisphosphonates displayed good tolerability, with no statistically significant differences in AE outcomes vs placebo.

CONCLUSIONS

Contrary to prior reviews, our analysis showed that bisphosphonates neither provide symptomatic relief nor defer radiographic progression in knee OA. However, these agents may still be beneficial in certain subsets of patients who display high rates of subchondral bone turnover. Future studies should be directed at defining such OA subsets and investigating the effects of bisphosphonates in those patients.

The quality of reports of medical and public health research from Palestinian institutions: a systematic review

OBJECTIVE

Over the past decade, there has been an increase in reports of health research from Palestine, but no assessment of their quality. We have assessed the quality of reports of Palestinian health research and factors associated with it.

DESIGN

This is a systematic review.

INCLUSION CRITERIA

We searched Medline and Scopus for reports of original research relevant to human health or healthcare authored by researchers affiliated with Palestinian institutions and published between January 2000 and August 2015 inclusive.

OUTCOMES

We used international guidelines to assess report quality, classifying as adequate those with ≥50% of items completely addressed.

RESULTS

Of 2383 reports identified, 497 met our inclusion criteria. Just over half (264; 55%) of these were published after 2010. 354 (71%) of first authors were affiliated with Palestinian institutions; 261 (53%) reports had coauthors from outside Palestine. The majority of the reports in our study were inadequately reported (342; 69%), and none had adequately reported all items. Of 439 observational studies, 11 (2.5%) reports provided adequate descriptions of eligibility criteria and selection procedures; 35 (8%) reported efforts to address potential sources of bias; 50 (11.4%) reported the basis for the study sample size; and funding sources were mentioned in 74 reports (17%). Higher reporting quality was associated with international affiliation of the first author (prevalence ratio (PR) 1.6 (95% CI 1.2 to 2.1)), international collaboration (PR 2.9 (95% CI 1.7 to 5.0)), international funding (PR 1.9 (95% CI1.5 to 2.5)), publication after 2005 (PR 3.9 (95% CI 1.8 to 8.5)) and four or more coauthors (PR 1.5 (95% CI 1.1 to 2.1)).

CONCLUSION

Although the quality of reports of Palestinian research has improved in recent years, it remains well below an acceptable standard. International reporting guidelines should be used to guide research design and improve the quality of reports of research.

TRIAL REGISTRATION NUMBER

The systematic review protocol was registered in the International Prospective Register of Systematic Reviews (PROSPERO) registery (registration number: CRD42015027553).

Imaging retina to study dementia and stroke

With increase in life expectancy, the number of persons suffering from common age-related brain diseases, including neurodegenerative (e.g., dementia) and cerebrovascular (e.g., stroke) disease is expected to rise substantially. As current neuro-imaging modalities such as magnetic resonance imaging may not be able to detect subtle subclinical changes (resolution <100-500 μm) in dementia and stroke, there is an urgent need for other complementary techniques to probe the pathophysiology of these diseases. The retina - due to its anatomical, embryological and physiological similarities with the brain - offers a unique and accessible "window" to study correlates and consequences of subclinical pathology in the brain. Retinal components such as the microvasculature and retinal ganglion cell axons can now be visualized non-invasively using different retinal imaging techniques e.g., ocular fundus photography and optical coherence tomography. Advances in retinal imaging may provide new and potentially important insights into cerebrovascular neurodegenerative processes in addition to what is currently possible with neuro-imaging. In this review, we present an overview of the current literature on the application of retinal imaging in the study of dementia and stroke. We discuss clinical implications of these studies, novel state-of-the-art retinal imaging techniques and future directions aimed at evaluating whether retinal imaging can be an additional investigation tool in the study of dementia and stroke.

Optimizing literature search in systematic reviews - are MEDLINE, EMBASE and CENTRAL enough for identifying effect studies within the area of musculoskeletal disorders?

BACKGROUND

When conducting systematic reviews, it is essential to perform a comprehensive literature search to identify all published studies relevant to the specific research question. The Cochrane Collaborations Methodological Expectations of Cochrane Intervention Reviews (MECIR) guidelines state that searching MEDLINE, EMBASE and CENTRAL should be considered mandatory. The aim of this study was to evaluate the MECIR recommendations to use MEDLINE, EMBASE and CENTRAL combined, and examine the yield of using these to find randomized controlled trials (RCTs) within the area of musculoskeletal disorders.

METHODS

Data sources were systematic reviews published by the Cochrane Musculoskeletal Review Group, including at least five RCTs, reporting a search history, searching MEDLINE, EMBASE, CENTRAL, and adding reference- and hand-searching. Additional databases were deemed eligible if they indexed RCTs, were in English and used in more than three of the systematic reviews. Relative recall was calculated as the number of studies identified by the literature search divided by the number of eligible studies i.e. included studies in the individual systematic reviews. Finally, cumulative median recall was calculated for MEDLINE, EMBASE and CENTRAL combined followed by the databases yielding additional studies.

RESULTS

Deemed eligible was twenty-three systematic reviews and the databases included other than MEDLINE, EMBASE and CENTRAL was AMED, CINAHL, HealthSTAR, MANTIS, OT-Seeker, PEDro, PsychINFO, SCOPUS, SportDISCUS and Web of Science. Cumulative median recall for combined searching in MEDLINE, EMBASE and CENTRAL was 88.9% and increased to 90.9% when adding 10 additional databases.

CONCLUSION

Searching MEDLINE, EMBASE and CENTRAL was not sufficient for identifying all effect studies on musculoskeletal disorders, but additional ten databases did only increase the median recall by 2%. It is possible that searching databases is not sufficient to identify all relevant references, and that reviewers must rely upon additional sources in their literature search. However further research is needed.

Why should ethics approval be required prior to publication of health promotion research?

ISSUE ADDRESSED

Most academic journals that publish studies involving human participants require evidence that the research has been approved by a human research ethics committee (HREC). Yet journals continue to receive submissions from authors who have failed to obtain such approval. In this paper, we provide an ethical justification of why journals should not, in general, publish articles describing research that has no ethics approval, with particular attention to the health promotion context.

METHODS

Using theoretical bioethical reasoning and drawing on a case study, we first rebut some potential criticisms of the need for research ethics approval. We then outline four positive claims to justify a presumption that research should, in most instances, be published only if it has been undertaken with HREC approval.

RESULTS

We present four justifications for requiring ethics approval before publication: (1) HREC approval adds legitimacy to the research; (2) the process of obtaining HREC approval can improve the quality of an intervention being investigated; (3) obtaining HREC approval can help mitigate harm; and (4) obtaining HREC approval demonstrates respect for persons.

CONCLUSION

This paper provides a systematic and comprehensive assessment of why research ethics approval should generally be obtained before publishing in the health promotion context. So what? Journals such as the Health Promotion Journal of Australia have recently begun to require research ethics approval for publishing research. Health promotion researchers will be interested in learning the ethical justification for this change.

Increasing value and reducing waste in biomedical research: who's listening?

The biomedical research complex has been estimated to consume almost a quarter of a trillion US dollars every year. Unfortunately, evidence suggests that a high proportion of this sum is avoidably wasted. In 2014, The Lancet published a series of five reviews showing how dividends from the investment in research might be increased from the relevance and priorities of the questions being asked, to how the research is designed, conducted, and reported. 17 recommendations were addressed to five main stakeholders-funders, regulators, journals, academic institutions, and researchers. This Review provides some initial observations on the possible effects of the Series, which seems to have provoked several important discussions and is on the agendas of several key players. Some examples of individual initiatives show ways to reduce waste and increase value in biomedical research. This momentum will probably move strongly across stakeholder groups, if collaborative relationships evolve between key players; further important work is needed to increase research value. A forthcoming meeting in Edinburgh, UK, will provide an initial forum within which to foster the collaboration needed.

Systematic review of interventions to reduce illicit drug use in female drug-dependent street sex workers

OBJECTIVES

Most female street-based sex workers (SSWs) are drug users and this group experience particularly poor outcomes in achieving and maintaining abstinence. In 2010 the UK adopted a recovery-orientated Drug Strategy. This strategy did not specifically highlight the complex drug treatment needs of SSWs. Therefore we sought to synthesise and critically appraise existing evidence of interventions to reduce illicit drug use in this group, in order to guide service change toward better provision for the drug treatment needs of SSWs.

METHODS

A systematic review of evidence on the effectiveness of interventions to reduce illicit drug use in female SSWs. Following the PRISMA guidelines, a structured search strategy was used. Searches included databases, organisational and government websites to identify published and grey literature, as well as contacting experts in the field, and hand-searching reference lists and journals.

RESULTS

Six studies, one experimental and five observational, were identified which met review inclusion criteria. Intervention approaches evaluated included substitute prescribing, educational sessions and motivational interviewing. All studies reported a positive intervention effect but the five observational studies were all subject to a relatively high risk of bias. By contrast, the experimental study provided little or no evidence of positive effect (OR for reduction of illicit drug in intervention compared to controls 1.17 95%CI 0.84-1.66 at 3 months and 1.14 (95% CI 0.8 to 1.61) at 6 months follow-up). All six studies described challenges and solutions to study recruitment, retention and follow-up, which were influenced by issues affecting SSWs' health and social stability.

CONCLUSIONS

There is currently no strong evidence for effectiveness of interventions to reduce illicit drug use in female SSWs with problematic drug use. Thus, the development and robust evaluation of effective interventions should be a priority if recovery-orientated goals are to become more achievable for this group.

Contour plot assessment of existing meta-analyses confirms robust association of statin use and acute kidney injury risk

OBJECTIVES

Robustness of an existing meta-analysis can justify decisions on whether to conduct an additional study addressing the same research question. We illustrate the graphical assessment of the potential impact of an additional study on an existing meta-analysis using published data on statin use and the risk of acute kidney injury.

STUDY DESIGN AND SETTING

A previously proposed graphical augmentation approach is used to assess the sensitivity of the current test and heterogeneity statistics extracted from existing meta-analysis data. In addition, we extended the graphical augmentation approach to assess potential changes in the pooled effect estimate after updating a current meta-analysis and applied the three graphical contour definitions to data from meta-analyses on statin use and acute kidney injury risk.

RESULTS

In the considered example data, the pooled effect estimates and heterogeneity indices demonstrated to be considerably robust to the addition of a future study. Supportingly, for some previously inconclusive meta-analyses, a study update might yield statistically significant kidney injury risk increase associated with higher statin exposure.

CONCLUSIONS

The illustrated contour approach should become a standard tool for the assessment of the robustness of meta-analyses. It can guide decisions on whether to conduct additional studies addressing a relevant research question.

Making randomised trials more efficient: report of the first meeting to discuss the Trial Forge platform

Randomised trials are at the heart of evidence-based healthcare, but the methods and infrastructure for conducting these sometimes complex studies are largely evidence free. Trial Forge ( www.trialforge.org ) is an initiative that aims to increase the evidence base for trial decision making and, in doing so, to improve trial efficiency.This paper summarises a one-day workshop held in Edinburgh on 10 July 2014 to discuss Trial Forge and how to advance this initiative. We first outline the problem of inefficiency in randomised trials and go on to describe Trial Forge. We present participants' views on the processes in the life of a randomised trial that should be covered by Trial Forge.General support existed at the workshop for the Trial Forge approach to increase the evidence base for making randomised trial decisions and for improving trial efficiency. Agreed upon key processes included choosing the right research question; logistical planning for delivery, training of staff, recruitment, and retention; data management and dissemination; and close down. The process of linking to existing initiatives where possible was considered crucial. Trial Forge will not be a guideline or a checklist but a 'go to' website for research on randomised trials methods, with a linked programme of applied methodology research, coupled to an effective evidence-dissemination process. Moreover, it will support an informal network of interested trialists who meet virtually (online) and occasionally in person to build capacity and knowledge in the design and conduct of efficient randomised trials.Some of the resources invested in randomised trials are wasted because of limited evidence upon which to base many aspects of design, conduct, analysis, and reporting of clinical trials. Trial Forge will help to address this lack of evidence.