Optimizing literature search in systematic reviews - are MEDLINE, EMBASE and CENTRAL enough for identifying effect studies within the area of musculoskeletal disorders?

Literature Searches in Medical Informatics Systematic Reviews: Suggested Approaches

This study explores database selection for systematic reviews in medical informatics, addressing challenges researchers face in maximizing relevant article retrieval. Systematic reviews from top medical informatics journals in 2021 were analyzed, divided into randomized control trials and non-randomized control trials groups. Four databases were evaluated based on Recall, Precision, and Unique references. Findings revealed that for randomized control trials, the best combination was PubMed, Embase, and Web of Science, while for the non-restricted group, recommended combination included PubMed, Embase, Web of Science, and Scopus, highlighting effective literature search strategies.

Rapid review: A review of methods and recommendations based on current evidence

Rapid review (RR) could accelerate the traditional systematic review (SR) process by simplifying or omitting steps using various shortcuts. With the increasing popularity of RR, numerous shortcuts had emerged, but there was no consensus on how to choose the most appropriate ones. This study conducted a literature search in PubMed from inception to December 21, 2023, using terms such as "rapid review" "rapid assessment" "rapid systematic review" and "rapid evaluation". We also scanned the reference lists and performed citation tracking of included impact studies to obtain more included studies. We conducted a narrative synthesis of all RR approaches, shortcuts and studies assessing their effectiveness at each stage of RRs. Based on the current evidence, we provided recommendations on utilizing certain shortcuts in RRs. Ultimately, we identified 185 studies focusing on summarizing RR approaches and shortcuts, or evaluating their impact. There was relatively sufficient evidence to support the use of the following shortcuts in RRs: limiting studies to those published in English-language; conducting abbreviated database searches (e.g., only searching PubMed/MEDLINE, Embase, and CENTRAL); omitting retrieval of grey literature; restricting the search timeframe to the recent 20 years for medical intervention and the recent 15 years for reviewing diagnostic test accuracy; conducting a single screening by an experienced screener. To some extent, the above shortcuts were also applicable to SRs. This study provided a reference for future RR researchers in selecting shortcuts, and it also presented a potential research topic for methodologists.

The impact of the medical school admissions interview: a systematic review

Background

Interviews are considered an important part of the medical school admissions process but have been critiqued based on bias and reliability concerns since the 1950s. To determine the impact of the interview, this systematic review investigated the characteristics and outcomes of medical students admitted with and without interviews.

Methods

We searched four literature databases from inception through August 2022; all studies comparing medical students admitted with and without interviews were included. We excluded studies from outside the medical school setting and non-research reports. We reviewed interview type, study design, quality, and outcomes.

Results

Eight studies from five institutions across five countries were included. Six reported no demographic differences between students admitted with and without interviews; one found that more men were admitted without than with semi-structured interviews, and both cohorts had similar academic and clinical performance. Structured interviews admitted students who scored higher on clinical exams and social competence and lower on academic exams. Cohorts admitted with and without structured interviews had similar mental health issues by their final year of medical school.

Discussion

This review suggests that students admitted with and without unstructured and semi-structured interviews were similar demographically, academically, and clinically. Moreover, structured interviews selected more socially competent students who performed better clinically but worse academically. Further research is needed to determine the impact of the selection interview in medical school admissions.

Methodological quality of systematic reviews in dentistry including animal studies: a cross-sectional study

BACKGROUND

The overall confidence in the results of systematic reviews including animal models can be heterogeneous. We assessed the methodological quality of systematic reviews including animal models in dentistry as well as the overall confidence in the results of those systematic reviews.

MATERIAL & METHODS

PubMed, Web of Science and Scopus were searched for systematic reviews including animal studies in dentistry published later than January 2010 until 18th of July 2022. Overall confidence in the results was assessed using a modified version of the A MeaSurement Tool to Assess systematic Reviews (AMSTAR-2) checklist. Checklist items were rated as yes, partial yes, no and not applicable. Linear regression analysis was used to investigate associations between systematic review characteristics and the overall adherence to the AMSTAR-2 checklist. The overall confidence in the results was calculated based on the number of critical and non-critical weaknesses presented in the AMSTAR-2 items and rated as high, moderate, low and critical low.

RESULTS

Of initially 951 retrieved systematic reviews, 190 were included in the study. The overall confidence in the results was low in 43 (22.6%) and critically low in 133 (70.0%) systematic reviews. While some AMSTAR-2 items were regularly reported (e.g. conflict of interest, selection in duplicate), others were not (e.g.

FUNDING

n = 1; 0.5%). Multivariable linear regression analysis showed that the adherence scores of AMSTAR-2 was significantly associated with publication year, journal impact factor (IF), topic, and the use of tools to assess risk of bias (RoB) of the systematic reviews.

CONCLUSION

Although the methodological quality of dental systematic reviews of animal models improved over the years, it is still suboptimal. The overall confidence in the results was mostly low or critically low. Systematic reviews, which were published later, published in a journal with a higher IF, focused on non-surgery topics, and used at least one tool to assess RoB correlated with greater adherence to the AMSTAR-2 guidelines.

Fracture risk reduction and safety by osteoporosis treatment compared with placebo or active comparator in postmenopausal women: systematic review, network meta-analysis, and meta-regression analysis of randomised clinical trials

OBJECTIVE

To review the comparative effectiveness of osteoporosis treatments, including the bone anabolic agents, abaloparatide and romosozumab, on reducing the risk of fractures in postmenopausal women, and to characterise the effect of antiosteoporosis drug treatments on the risk of fractures according to baseline risk factors.

DESIGN

Systematic review, network meta-analysis, and meta-regression analysis of randomised clinical trials.

DATA SOURCES

Medline, Embase, and Cochrane Library to identify randomised controlled trials published between 1 January 1996 and 24 November 2021 that examined the effect of bisphosphonates, denosumab, selective oestrogen receptor modulators, parathyroid hormone receptor agonists, and romosozumab compared with placebo or active comparator.

ELIGIBILITY CRITERIA FOR SELECTING STUDIES

Randomised controlled trials that included non-Asian postmenopausal women with no restriction on age, when interventions looked at bone quality in a broad perspective. The primary outcome was clinical fractures. Secondary outcomes were vertebral, non-vertebral, hip, and major osteoporotic fractures, all cause mortality, adverse events, and serious cardiovascular adverse events.

RESULTS

The results were based on 69 trials (>80 000 patients). For clinical fractures, synthesis of the results showed a protective effect of bisphosphonates, parathyroid hormone receptor agonists, and romosozumab compared with placebo. Compared with parathyroid hormone receptor agonists, bisphosphonates were less effective in reducing clinical fractures (odds ratio 1.49, 95% confidence interval 1.12 to 2.00). Compared with parathyroid hormone receptor agonists and romosozumab, denosumab was less effective in reducing clinical fractures (odds ratio 1.85, 1.18 to 2.92 for denosumab v parathyroid hormone receptor agonists and 1.56, 1.02 to 2.39 for denosumab v romosozumab). An effect of all treatments on vertebral fractures compared with placebo was found. In the active treatment comparisons, denosumab, parathyroid hormone receptor agonists, and romosozumab were more effective than oral bisphosphonates in preventing vertebral fractures. The effect of all treatments was unaffected by baseline risk indicators, except for antiresorptive treatments that showed a greater reduction of clinical fractures compared with placebo with increasing mean age (number of studies=17; β=0.98, 95% confidence interval 0.96 to 0.99). No harm outcomes were seen. The certainty in the effect estimates was moderate to low for all individual outcomes, mainly because of limitations in reporting, nominally indicating a serious risk of bias and imprecision.

CONCLUSIONS

The evidence indicated a benefit of a range of treatments for osteoporosis in postmenopausal women for clinical and vertebral fractures. Bone anabolic treatments were more effective than bisphosphonates in the prevention of clinical and vertebral fractures, irrespective of baseline risk indicators. Hence this analysis provided no clinical evidence for restricting the use of anabolic treatment to patients with a very high risk of fractures.

SYSTEMATIC REVIEW REGISTRATION

PROSPERO CRD42019128391.

Under-representation of low-income countries in the literature - targeting the bummock of neglected tropical diseases

More than 50% of the world's youth and many economies with the greatest growth rates are in tropical and subtropical regions of Africa, Asia, and Latin America. Many prevailing diseases in these areas comprise neglected tropical diseases (NTDs) - the 13 bacterial and parasitic infections that predominantly affect the poorest one-sixth of the world's population. The lack of published data, heightened by the disregard of researchers of developed countries, amounts to the 'missing piece' when attempting to draw a global picture of such diseases using systematic reviews or meta-analyses because of the imbalance in distribution. Defining and measuring the problem, evaluating the effectiveness and cost of interventions, and assessing cost-effectiveness are all necessary steps in determining health priorities for eradicating these NTDs.

Database coverage and their use in systematic reviews regarding spinal manipulative therapy: an exploratory study

BACKGROUND

Systematic reviews (SRs) of randomized controlled trials (RCTs) are considered one of the most reliable study types. Through a systematic and thorough literature search, researchers aim to collect all research relevant to their purpose. The selection of databases can be challenging and depend on the topic of interest. The Cochrane Handbook suggests searching at least the following three databases: Cochrane Library, MEDLINE, and EMBASE. However, this is not always sufficient for reviews on the musculoskeletal field in general. This study aimed to examine the frequency and choice of databases used by researchers in SRs of spinal manipulative therapy (SMT). Secondly, to analyze the RCTs included in the SRs to determine the optimal combination of databases needed to conduct efficient literature searches for SRs of SMT.

METHODS

SRs investigating the effect of SMT on any patient-reported outcome measure were identified through searches in PubMed and Epistemonikos (all entries till date of search February 25, 2022). For each SR, databases searched and included RCTs were collected. RCTs were searched individually in nine databases (Cochrane Library, MEDLINE/PubMed, EMBASE, Google Scholar, CINAHL, Web of Science, Index to Chiropractic Literature, PEDro, and AMED). Coverage rates were calculated using the number of retrieved RCTs by the database or combinations of databases divided by the total number of RCTs.

RESULTS

Eighty-five SRs published met the inclusion criteria, and 442 unique RCTs were retrieved. The most frequently searched database was MEDLINE/PubMed. Cochrane Library had the highest overall coverage rate and contained the third most unique RCTs. While a 100% retrieval was not possible, as 18 RCTs could not be retrieved in any of the nine databases, the combination of Cochrane Library, Google Scholar, and PEDro retrieved all possible RCTs with a combined coverage rate of 95.9%.

CONCLUSIONS

For SRs on SMT, we recommend using the combination suggested by the Cochrane Handbook of Cochrane Library, MEDLINE/PubMed, Embase, and in addition, PEDro and Index to Chiropractic Literature. Google Scholar might be used additionally as a tool for searching gray literature and quality assurance.

A Tailored Approach: A model for literature searching in complex systematic reviews

Our previous work identified that nine leading guidance documents for seven different types of systematic review advocated the same process of literature searching. We defined and illustrated this process and we named it ‘the Conventional Approach’. The Conventional Approach appears to meet the needs of researchers undertaking literature searches for systematic reviews of clinical interventions. In this article, we report a new and alternate process model of literature searching called ‘A Tailored Approach’. A Tailored Approach is indicated as a search process for complex reviews which do not focus on the evaluation of clinical interventions. The aims of this article are to (1) explain the rationale for, and the theories behind, the design of A Tailored Approach; (2) report the current conceptual illustration of A Tailored Approach and to describe a user’s interaction with the process model; and (3) situate the elements novel to A Tailored Approach (when compared with the Conventional Approach) in the relevant literature. A Tailored Approach suggests investing time at the start of a review, to develop the information needs from the research objectives, and to tailor the search approach to studies or data. Tailored Approaches should be led by the information specialist (librarian) but developed by the research team. The aim is not necessarily to focus on comprehensive retrieval. Further research is indicated to evaluate the use of supplementary search methods, methods of team-working to define search approaches, and to evaluate the use of conceptual models of information retrieval for testing and evaluation.

Systematic reviews: Not always a pain

Systematic reviews analyze the evidence surrounding a specific intervention within a population. High quality systematic reviews can help clinicians and policymakers accurately understand a treatment intervention. This article outlines the basic principles of systematic review development, including assembling a research team, defining the research question, publishing a protocol, designing and executing the search, study selection, extracting the data, assessing risk of bias, synthesizing the data and conducting a certainty assessment. In addition, we will address common pitfalls and highlight special considerations for the field of interventional pain medicine. Understanding systematic review methodology will help investigators improve their primary research and in turn, better primary literature will improve the value of high quality reviews.

Searching two or more databases decreased the risk of missing relevant studies: a metaresearch study

OBJECTIVE

Assessing changes in coverage, recall, review conclusions and references not found when searching fewer databases.

STUDY DESIGN AND SETTING

In 60 randomly selected Cochrane reviews, we checked included study publications' coverage (indexation) and recall (findability) using different search approaches with MEDLINE, Embase, and CENTRAL and related them to authors' conclusions and certainty. We assessed characteristics of unfound references.

RESULTS

1989/2080 included references, were indexed in ≥1 database (coverage=96%). In reviews where using one of our search approaches would not change conclusions and certainty (n=44-54), median coverage and recall were highest (range 87.9-100.0% and 78.2-93.3%, respectively). Here, searching ≥2 databases reached >95% coverage and ≥87.9% recall. In reviews with unchanged conclusions but less certainty (n=2-8): 63.3-79.3% coverage and 45.0-75.0% recall. In reviews with opposite conclusions (n=1-3): 63.3-96.6% and 52.1-78.7%. In reviews where a conclusion was no longer possible (n=3-7): 60.6%-86.0% and 20.0-53.8%. The 265 references that were indexed but unfound were more often abstractless (30% vs 11%) and older (28% vs. 17% published before 1991) than found references.

CONCLUSION

Searching ≥2 databases improves coverage and recall and decreases the risk of missing eligible studies. If researchers suspect that relevant articles are difficult to find, supplementary search methods should be used.

Literature searching methods or guidance and their application to public health topics: A narrative review

Background

Information specialists conducting searches for systematic reviews need to consider key questions around which and how many sources to search. This is particularly important for public health topics where evidence may be found in diverse sources.

Objectives

The objective of this review is to give an overview of recent studies on information retrieval guidance and methods that could be applied to public health evidence and used to guide future searches.

Methods

A literature search was performed in core databases and supplemented by browsing health information journals and citation searching. Results were sifted and reviewed.

Results

Seventy‐two papers were found and grouped into themes covering sources and search techniques. Public health topics were poorly covered in this literature.

Discussion

Many researchers follow the recommendations to search multiple databases. The review topic influences decisions about sources. Additional sources covering grey literature eliminate bias but are time‐consuming and difficult to search systematically. Public health searching is complex, often requiring searches in multidisciplinary sources and using additional methods.

Conclusions

Search planning is advisable to enable decisions about which and how many sources to search. This could improve with more work on modelling search scenarios, particularly in public health topics, to examine where publications were found and guide future research.

Femoroacetabular impingement syndrome and labral injuries: grading the evidence on diagnosis and non-operative treatment-a statement paper commissioned by the Danish Society of Sports Physical Therapy (DSSF)

This statement summarises and appraises the evidence on diagnostic tests and clinical information, and non-operative treatment of femoroacetabular impingement (FAI) syndrome and labral injuries. We included studies based on the highest available level of evidence as judged by study design. We evaluated the certainty of evidence using the Grading of Recommendations Assessment Development and Evaluation framework. We found 29 studies reporting 23 clinical tests and 14 different forms of clinical information, respectively. Restricted internal hip rotation in 0° hip flexion with or without pain was best to rule in FAI syndrome (low diagnostic effectiveness; low quality of evidence; interpretation of evidence: may increase post-test probability slightly), whereas no pain in Flexion Adduction Internal Rotation test or no restricted range of motion in Flexion Abduction External Rotation test compared with the unaffected side were best to rule out (very low to high diagnostic effectiveness; very low to moderate quality of evidence; interpretation of evidence: very uncertain, but may reduce post-test probability slightly). No forms of clinical information were found useful for diagnosis. For treatment of FAI syndrome, 14 randomised controlled trials were found. Prescribed physiotherapy, consisting of hip strengthening, hip joint manual therapy techniques, functional activity-specific retraining and education showed a small to medium effect size compared with a combination of passive modalities, stretching and advice (very low to low quality of evidence; interpretation of evidence: very uncertain, but may slightly improve outcomes). Prescribed physiotherapy was, however, inferior to hip arthroscopy (small effect size; moderate quality of evidence; interpretation of evidence: hip arthroscopy probably increases outcome slightly). For both domains, the overall quality of evidence ranged from very low to moderate indicating that future research on diagnosis and treatment may alter the conclusions from this review.

Database selection and data gathering methods in systematic reviews of qualitative research regarding diabetes mellitus - an explorative study

BACKGROUND

Systematic reviews (SRs) are considered one of the most reliable types of studies in evidence-based medicine. SRs rely on a comprehensive and systematic data gathering, including the search of academic literature databases. This study aimed to investigate which combination of databases would result in the highest overall recall rate of references when conducting SRs of qualitative research regarding diabetes mellitus. Furthermore, we aimed to investigate the current use of databases and other sources for data collection.

METHODS

Twenty-six SRs (published between 2010 and 2020) of qualitative research regarding diabetes mellitus, located through PubMed, met the inclusion criteria. References of the SRs were systematically hand searched in the six academic literature databases CINAHL, MEDLINE/PubMed, PsycINFO, Embase, Web of Science, and Scopus and the academic search engine Google Scholar. Recall rates were calculated using the total number of included references retrieved by the database or database combination divided by the total number of included references, given in percentage.

RESULTS

The SRs searched five databases on average (range two to nine). MEDLINE/PubMed was the most commonly searched database (100% of SRs). In addition to academic databases, 18 of the 26 (69%) SRs hand searched the reference lists of included articles. This technique resulted in a median (IQR) of 2.5 (one to six) more references being included per SR than by database searches alone. 27 (5.4%) references were found only in one of six databases (when Google Scholar was excluded), with CINAHL retrieving the highest number of unique references (n = 15). The combinations of MEDLINE/PubMed and CINAHL (96.4%) and MEDLINE/PubMed, CINAHL, and Embase (98.8%) yielded the highest overall recall rates, with Google Scholar excluded.

CONCLUSIONS

We found that the combinations of MEDLINE/PubMed and CINAHL and MEDLINE/PubMed, CINAHL, and Embase yielded the highest overall recall rates of references included in SRs of qualitative research regarding diabetes mellitus. However, other combinations of databases yielded corresponding recall rates and are expected to perform comparably. Google Scholar can be a useful supplement to traditional scientific databases to ensure an optimal and comprehensive retrieval of relevant references.

Overlaps of multiple database retrieval and citation tracking in dementia care research: a methodological study

OBJECTIVE

We aimed to determine overlaps and optimal combination of multiple database retrieval and citation tracking for evidence synthesis, based on a previously conducted scoping review on facilitators and barriers to implementing nurse-led interventions in dementia care.

METHODS

In our 2019 scoping review, we performed a comprehensive literature search in eight databases (CENTRAL, CINAHL, Embase, Emcare, MEDLINE, Ovid Nursing Database, PsycINFO, and Web of Science Core Collection) and used citation tracking. We retrospectively analyzed the coverage and overlap of 10,527 retrieved studies published between 2015 and 2019. To analyze database overlap, we used cross tables and multiple correspondence analysis (MCA).

RESULTS

Of the retrieved studies, 6,944 were duplicates and 3,583 were unique references. Using our search strategies, considerable overlaps can be found in some databases, such as between MEDLINE and Web of Science Core Collection or between CINAHL, Emcare, and PsycINFO. Searching MEDLINE, CINAHL, and Web of Science Core Collection and using citation tracking were necessary to retrieve all included studies of our scoping review.

CONCLUSIONS

Our results can contribute to enhancing future search practice related to database selection in dementia care research. However, due to limited generalizability, researchers and librarians should carefully choose databases based on the research question. More research on optimal database retrieval in dementia care research is required for the development of methodological standards.

Using Embase as a supplement to PubMed in Cochrane reviews differed across fields

OBJECTIVE

Medline/PubMed is often first choice for health science researchers when doing literature searches. However, Medline/PubMed does not cover the health science research literature equally well across specialties. Embase is often considered an important supplement to Medline/PubMed in health sciences. The present study analyzes the coverage of Embase as a supplement to PubMed, and the aim of the study is to investigate if searching Embase can compensate for low PubMed retrieval.

STUDY DESIGN AND SETTING

The population in this study is all the included studies in all Cochrane reviews from 2012 to 2016 across the 53 Cochrane groups. The analyses were performed using two units of analysis (study and publication). We are examining the coverage in Embase of publications and studies not covered by PubMed (25,119 publications and 9,420 studies).

RESULTS

The results showed that using Embase as a supplement to PubMed resulted in a coverage of 66,994 publications out of 86,167 and a coverage rate of 77.7, 95% CI [75.05, 80.45] of all the included publications. Embase combined with PubMed covered 48,326 out of 54,901 studies and thus had a coverage rate of 88.0%, 95% CI [86.2, 89.9] of studies. The results also showed that supplementing PubMed with Embase increased coverage of included publications by 6.8 percentage points, and the coverage of studies increased by 5.5 percentage points. Substantial differences were found across and within review groups over time.

CONCLUSION

The included publications and studies in some groups are covered considerably better by supplementing with Embase, whereas in other groups, the difference in coverage is negligible. However, due to the variation over time, one should be careful predicting the benefit from supplementing PubMed with Embase to retrieve relevant publications to include in a review.

Use of a search summary table to improve systematic review search methods, results, and efficiency

BACKGROUND

Systematic reviews are comprehensive, robust, inclusive, transparent, and reproducible when bringing together the evidence to answer a research question. Various guidelines provide recommendations on the expertise required to conduct a systematic review, where and how to search for literature, and what should be reported in the published review. However, the finer details of the search results are not typically reported to allow the search methods or search efficiency to be evaluated.

CASE PRESENTATION

This case study presents a search summary table, containing the details of which databases were searched, which supplementary search methods were used, and where the included articles were found. It was developed and published alongside a recent systematic review. This simple format can be used in future systematic reviews to improve search results reporting.

CONCLUSIONS

Publishing a search summary table in all systematic reviews would add to the growing evidence base about information retrieval, which would help in determining which databases to search for which type of review (in terms of either topic or scope), what supplementary search methods are most effective, what type of literature is being included, and where it is found. It would also provide evidence for future searching and search methods research.

Safety and Outcomes of Different Surgical Techniques for Cubital Tunnel Decompression: A Systematic Review and Network Meta-analysis

IMPORTANCE

Cubital tunnel syndrome is the second most common compressive neuropathy, affecting 6% of the population. Numerous different operations are performed globally to treat it; however, prior conventional (pairwise) meta-analyses have been unable to determine which procedure is associated with the best outcomes and fewest complications.

OBJECTIVE

To evaluate which operation for cubital tunnel syndrome is associated with the greatest likelihood of symptomatic cure.

DATA SOURCES

PubMed, EMBASE, and CENTRAL were searched from database inception to March 2, 2019, with no restrictions on the setting or design of studies.

STUDY SELECTION

Experimental and observational studies directly comparing the outcomes of at least 2 surgical treatments for adults with primary cubital tunnel syndrome were included. Case reports were excluded, and when comparative studies had subgroups with 1 participant, the single-participant subgroup was excluded. The treatments had to be in situ decompression with or without medial epicondylectomy or an anterior subcutaneous, subfascial, intramuscular, or submuscular transposition. The access could be open, minimally invasive, or endoscopic. The comparator could be sham surgery or any operation mentioned earlier.

DATA EXTRACTION AND SYNTHESIS

Data were extracted by 2 independent reviewers, following the Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA) reporting guideline and the PRISMA Network Meta-analysis extension statement. Network meta-analysis was used to estimate the relative efficacy and safety associated with interventions using relative risks. Surgical techniques were ranked by their probability of being the best (P score) and interpreted in terms of their clinical impact.

MAIN OUTCOMES AND MEASURES

The primary outcome was response to treatment (ie, symptomatic improvement). The secondary outcomes were perioperative complications, reoperation, and recurrence.

RESULTS

A total of 30 studies of 2894 limbs undergoing 8 different operations were included. Across the studies, 56% of participants were men, the mean (SD) age was 48 (8) years, and patients had symptoms for a mean (SD) of 15 (7) months. Overall, 87% (95% CI, 92%-91%) of patients improved with surgery; all forms of in situ decompression were more effective than any type of transposition procedure; for example, open in situ decompression with epicondylectomy was associated with higher success rates than subcutaneous transposition (relative risk, 1.13; 95% CI, 1.01-1.25). Postoperatively, 3% (95% CI, 2%-4%) of patients developed complications, and in situ decompressions were ranked as the least risky, although there was considerable uncertainty in this outcome. Overall, 2% (95% CI, 1%-3%) of patients required reoperation; open in situ decompression was associated with the fewest reoperations; in comparison, submuscular transposition was associated with 5 times the risk of reoperation (relative risk, 5.08; 95% CI, 2.06-12.52). During surveillance, 3% (95% CI, 1%-4%) of patients developed recurrence, and open in situ decompression with epicondylectomy was ranked as the safest operation, although there was uncertainty in the estimates.

CONCLUSIONS AND RELEVANCE

In this network meta-analysis, open in situ decompression (with or without medial epicondylectomy) appeared to be the safest operation and also was associated with the best outcomes for patients with primary cubital tunnel syndrome. Future research should focus on better defining this disorder and developing core outcome measures.

Abbreviated and comprehensive literature searches led to identical or very similar effect estimates: a meta-epidemiological study

OBJECTIVES

The objective of this study was to assess the agreement of treatment effect estimates from meta-analyses based on abbreviated or comprehensive literature searches.

STUDY DESIGN AND SETTING

This was a meta-epidemiological study. We abbreviated 47 comprehensive Cochrane review searches and searched MEDLINE/Embase/CENTRAL alone, in combination, with/without checking references (658 new searches). We compared one meta-analysis from each review with recalculated ones based on abbreviated searches.

RESULTS

The 47 original meta-analyses included 444 trials (median 6 per review [interquartile range (IQR) 3-11]) with 360045 participants (median 1,371 per review [IQR 685-8,041]). Depending on the search approach, abbreviated searches led to identical effect estimates in 34-79% of meta-analyses, to different effect estimates with the same direction and level of statistical significance in 15-51%, and to opposite effects (or effects could not be estimated anymore) in 6-13%. The deviation of effect sizes was zero in 50% of the meta-analyses and in 75% not larger than 1.07-fold. Effect estimates of abbreviated searches were not consistently smaller or larger (median ratio of odds ratio 1 [IQR 1-1.01]) but more imprecise (1.02-1.06-fold larger standard errors).

CONCLUSION

Abbreviated literature searches often led to identical or very similar effect estimates as comprehensive searches with slightly increased confidence intervals. Relevant deviations may occur.

Diagnosis, prevention and treatment of common lower extremity muscle injuries in sport - grading the evidence: a statement paper commissioned by the Danish Society of Sports Physical Therapy (DSSF)

This statement summarises and appraises the evidence on diagnosis, prevention and treatment of the most common lower extremity muscle injuries in sport. We systematically searched electronic databases, and included studies based on the highest available evidence. Subsequently, we evaluated the quality of evidence using the Grading of Recommendations Assessment, Development and Evaluation framework, grading the quality of evidence from high to very low. Most clinical tests showed very low to low diagnostic effectiveness. For hamstring injury prevention, programmes that included the Nordic hamstring exercise resulted in a hamstring injury risk reduction when compared with usual care (medium to large effect size; moderate to high quality of evidence). For prevention of groin injuries, both the FIFA 11+programme and the Copenhagen adductor strengthening programme resulted in a groin injury risk reduction compared with usual care (medium effect size; low to moderate quality of evidence). For the treatment of hamstring injuries, lengthening hamstring exercises showed the fastest return to play with a lower reinjury rate compared with conventional hamstring exercises (large effect size; very low to low quality of evidence). Platelet-rich plasma had no effect on time to return-to-play and reinjury risk (trivial effect size; moderate quality of evidence) after a hamstring injury compared with placebo or rehabilitation. At this point, most outcomes for diagnosis, prevention and treatment were graded as very low to moderate quality of evidence, indicating that further high-quality research is likely to have an important impact on the confidence in the effect estimates.

Searching for qualitative health research required several databases and alternative search strategies: a study of coverage in bibliographic databases

OBJECTIVE

Retrieving the qualitative literature can be challenging, but the number and specific choice of databases are key factors. The aim of the present study is to provide guidance for the choice of databases for retrieving qualitative health research.

STUDY DESIGN AND SETTING

Seventy-one qualitative systematic reviews, from the Cochrane Database of Systematic Reviews and JBI database of Systematic Reviews and Implementation Reports, including 927 qualitative studies, were used to analyze the coverage of the qualitative literature in nine bibliographic databases.

RESULTS

The results show that 94.4% of the qualitative studies are indexed in at least one database, with a lower coverage for publication types other than journal articles. Maximum recall with two databases is 89.1%, with three databases recall increases to 92% and maximum recall with four databases is 93.1%. The remaining 6.9% of the publications consists of 1.3% scattered across five databases and 5.6% that are not indexed in any of the nine databases used in this study.

CONCLUSION

Retrieval in one or a few-although well selected-databases does not provide all the relevant qualitative studies. The remaining studies needs to be located using several other databases and alternative search strategies.

WHICH DATABASES SHOULD BE USED TO IDENTIFY STUDIES FOR SYSTEMATIC REVIEWS OF ECONOMIC EVALUATIONS?

Objectives:

This study investigated which databases and which combinations of databases should be used to identify economic evaluations (EEs) to inform systematic reviews. It also investigated the characteristics of studies not identified in database searches and evaluated the success of MEDLINE search strategies used within typical reviews in retrieving EEs in MEDLINE.

Methods:

A quasi-gold standard (QGS) set of EEs was collected from reviews of EEs. The number of QGS records found in nine databases was calculated and the most efficient combination of databases was determined. The number and characteristics of QGS records not retrieved from the databases were collected. Reproducible MEDLINE strategies from the reviews were rerun to calculate the sensitivity and precision for each strategy in finding QGS records.

Results:

The QGS comprised 351 records. Across all databases, 337/351 (96 percent) QGS records were identified. Embase yielded the most records (314; 89 percent). Four databases were needed to retrieve all 337 references: Embase + Health Technology Assessment database + (MEDLINE or PubMed) + Scopus. Four percent (14/351) of records could not be found in any database. Twenty-nine of forty-one (71 percent) reviews reported a reproducible MEDLINE strategy. Ten of twenty-nine (34.5 percent) of the strategies missed at least one QGS record in MEDLINE. Across all twenty-nine MEDLINE searches, 25/143 records were missed (17.5 percent). Mean sensitivity was 89 percent and mean precision was 1.6 percent.

Conclusions:

Searching beyond key databases for published EEs may be inefficient, providing the search strategies in those key databases are adequately sensitive. Additional search approaches should be used to identify unpublished evidence (grey literature).

Effectiveness of computed tomography scanning to detect blunt bowel and mesenteric injuries requiring surgical intervention: A systematic literature review

BACKGROUND

Computed tomography (CT) diagnostic accuracy for blunt bowel and mesenteric injuries (BBMI) is controversial.

DATA SOURCES

A literature review to compute aggregate CT performance and individual CT sign sensitivity, specificity, and positive predictive value (PPV) for operative BBMI.

CONCLUSIONS

Sensitivity, specificity, and PPV were: overall CT performance 85.3%, 96.1%, 51.4%; abnormal wall enhancement 30.1%, 95.7%, 64.0%; bowel wall discontinuity 22.3%, 99.0%, 87.9%; bowel wall hematoma 22.5%, 100%, 19.5%; bowel wall thickening 35.2%, 96.5%, 32.1%; free air 32.0%, 98.7%, 57.1%; free fluid 65.6%, 85.0%, 25.5%; mesenteric air 27.6%, 99.1%, 85.3%; mesenteric extravasation 22.9%, 99.6%, 73.9%; mesenteric hematoma/fluid 33.9%, 98.7%, 52.8%; mesenteric stranding/streaking 34.3%, 91.8%, 31.6%; mesenteric vessel beading 32.1%, 97.2%, 60.4%; mesenteric vessel termination 31.6%, 97.2%, 63.5%; oral contrast extravasation 10.0%, 100%, 100%; retroperitoneal air 9.4%, 94.9%, 55.6%; and retroperitoneal fluid 44.2%, 49.4%, 38.5%. Sensitivity, specificity, and PPV vary substantially among known signs. Other clinical factors are necessary for comprehensive BBMI identification.

Defining the process to literature searching in systematic reviews: a literature review of guidance and supporting studies

BACKGROUND

Systematic literature searching is recognised as a critical component of the systematic review process. It involves a systematic search for studies and aims for a transparent report of study identification, leaving readers clear about what was done to identify studies, and how the findings of the review are situated in the relevant evidence. Information specialists and review teams appear to work from a shared and tacit model of the literature search process. How this tacit model has developed and evolved is unclear, and it has not been explicitly examined before. The purpose of this review is to determine if a shared model of the literature searching process can be detected across systematic review guidance documents and, if so, how this process is reported in the guidance and supported by published studies.

METHOD

A literature review. Two types of literature were reviewed: guidance and published studies. Nine guidance documents were identified, including: The Cochrane and Campbell Handbooks. Published studies were identified through 'pearl growing', citation chasing, a search of PubMed using the systematic review methods filter, and the authors' topic knowledge. The relevant sections within each guidance document were then read and re-read, with the aim of determining key methodological stages. Methodological stages were identified and defined. This data was reviewed to identify agreements and areas of unique guidance between guidance documents. Consensus across multiple guidance documents was used to inform selection of 'key stages' in the process of literature searching.

RESULTS

Eight key stages were determined relating specifically to literature searching in systematic reviews. They were: who should literature search, aims and purpose of literature searching, preparation, the search strategy, searching databases, supplementary searching, managing references and reporting the search process.

CONCLUSIONS

Eight key stages to the process of literature searching in systematic reviews were identified. These key stages are consistently reported in the nine guidance documents, suggesting consensus on the key stages of literature searching, and therefore the process of literature searching as a whole, in systematic reviews. Further research to determine the suitability of using the same process of literature searching for all types of systematic review is indicated.

Effects of supervised exercise compared to non-supervised exercise early after total hip replacement on patient-reported function, pain, health-related quality of life and performance-based function – a systematic review and meta-analysis of randomized controlled trials

Background:

The rehabilitation after a total hip replacement varies in degree of supervision; however, it remains unknown whether supervised programmes are more effective than non-supervised.

Objective:

This study compared the effectiveness of supervised exercise compared to non-supervised home-based exercise after total hip replacement on patient-reported function, hip-pain, health-related quality of life and performance-based function.

Methods:

A systematic review and meta-analysis of randomized controlled trials investigating the effect of supervised exercise compared to non-supervised home-based exercise. An electronic search was performed in Medline, Embase and CINAHL on 14 March 2018. The methodological quality was assessed using the Cochrane Risk of Bias tool.

Results:

Seven studies were included with a total of 389 participants. A small and non-significant difference in favour of the supervised groups was found in patient-reported function (standardized mean difference (SMD) −0.22 (95% confidence interval (CI) −0.46 to 0.02)), hip-related pain (SMD −0.03 (95% CI −0.27 to 0.21)), health-related quality of life (mean difference (MD) −3.08 (95% CI −6.29 to 0.14)) and performance-based function (SMD −0.26 (95% CI −0.68 to 0.17)) at end of treatment and in patient-reported function (MD −1.31 (95% CI −3.79 to 1.16)) at the 6- to 12-month follow-up.

Limitations:

The literature search was systematic, but limited to three databases. The overall quality of evidence was downgraded to moderate due to lack of blinding in included studies.

Conclusion:

Supervised exercise was not significantly effective compared to non-supervised home-based exercise on patient-reported function, pain, health-related quality of life and performance-based function after primary total hip replacement.

Others:

PROSPERO registration number: CRD42017055604.

Development and validation of a MEDLINE search filter/hedge for degenerative cervical myelopathy

Background

Degenerative cervical myelopathy (DCM) is a common condition with many unmet clinical needs. Pooled analysis of studies is an important tool for advancing medical understanding. This process starts with a systematic search of the literature. Identification of studies in DCM is challenged by a number of factors, including non-specific terminology and index terms. Search filters or HEDGEs, are search strings developed and validated to optimise medical literature searches. We aimed to develop a search filter for DCM for the MEDLINE database.

Methods

The diagnostic test assessment framework of a “development dataset” and seperate “validation dataset” was used. The development dataset was formed by hand searching four leading spinal journals (Spine, Journal of Neurosurgery Spine, Spinal Cord and Journal of Spinal Disorders and Techniques) in 2005 and 2010. The search filter was initially developed focusing on sensitivity and subsequently refined using NOT functions to improve specificity. One validation dataset was formed from DCM narrative and systematic review articles and the second, articles published in April of 1989, 1993, 1997, 2001, 2005, 2009, 2013 and 2017 retrieved via the search MeSH term ‘Spine’. Metrics of sensitivity, specificity, precision and accuracy were used to test performance.

Results

Hand searching identified 77/1094 relevant articles for 2005 and 55/1199 for 2010. We developed a search hedge with 100% sensitivity and a precision of 30 and 29% for the 2005 and 2010 development datasets respectively. For the selected time periods, EXP Spine returned 2113 publications and 30 were considered relevant. The search filter identified all 30 relevant articles, with a specificity of 94% and precision of 20%. Of the 255 references listed in the narrative index reviews, 225 were indexed in MEDLINE and 165 (73%) were relevant articles. All relevant articles were identified and accuracy ranged from 67 to 97% over the three reviews. Of the 42 articles returned from 3 recent systematic reviews, all were identified by the filter.

Conclusions

We have developed a highly sensitive hedge for the research of DCM. Whilst precision is similarly low as other hedges, this search filter can be used as an adjunct for DCM search strategies.

Electronic supplementary material

The online version of this article (10.1186/s12874-018-0529-3) contains supplementary material, which is available to authorized users.

Optimal database combinations for literature searches in systematic reviews: a prospective exploratory study

BACKGROUND

Within systematic reviews, when searching for relevant references, it is advisable to use multiple databases. However, searching databases is laborious and time-consuming, as syntax of search strategies are database specific. We aimed to determine the optimal combination of databases needed to conduct efficient searches in systematic reviews and whether the current practice in published reviews is appropriate. While previous studies determined the coverage of databases, we analyzed the actual retrieval from the original searches for systematic reviews.

METHODS

Since May 2013, the first author prospectively recorded results from systematic review searches that he performed at his institution. PubMed was used to identify systematic reviews published using our search strategy results. For each published systematic review, we extracted the references of the included studies. Using the prospectively recorded results and the studies included in the publications, we calculated recall, precision, and number needed to read for single databases and databases in combination. We assessed the frequency at which databases and combinations would achieve varying levels of recall (i.e., 95%). For a sample of 200 recently published systematic reviews, we calculated how many had used enough databases to ensure 95% recall.

RESULTS

A total of 58 published systematic reviews were included, totaling 1746 relevant references identified by our database searches, while 84 included references had been retrieved by other search methods. Sixteen percent of the included references (291 articles) were only found in a single database; Embase produced the most unique references (n = 132). The combination of Embase, MEDLINE, Web of Science Core Collection, and Google Scholar performed best, achieving an overall recall of 98.3 and 100% recall in 72% of systematic reviews. We estimate that 60% of published systematic reviews do not retrieve 95% of all available relevant references as many fail to search important databases. Other specialized databases, such as CINAHL or PsycINFO, add unique references to some reviews where the topic of the review is related to the focus of the database.

CONCLUSIONS

Optimal searches in systematic reviews should search at least Embase, MEDLINE, Web of Science, and Google Scholar as a minimum requirement to guarantee adequate and efficient coverage.