Systematic review search methods evaluated using the Preferred Reporting of Items for Systematic Reviews and Meta-Analyses and the Risk Of Bias In Systematic reviews tool

Effectiveness of constraint-induced movement therapy (CIMT)-Telerehabilitation compared to traditional CIMT on upper extremity dysfunction of adult chronic stroke patients-A systematic review and meta-analysis

BACKGROUND/OBJECTIVE

Constraint-induced movement therapy (CIMT), a therapy that encourages the use of the affected upper limb through intensive functional tasks, effectively promotes upper limb function in patients with chronic stroke. This study determined the effectiveness of CIMT using telerehabilitation compared with traditional CIMT in improving mild to moderate upper limb motor function in adult patients with chronic stroke.

METHODS

Eligible studies were identified by searching electronic databases and scanning the reference lists of articles. Review Manager 5.4 was used to determine the pooled mean effect size of the standardized mean difference and 95% confidence interval for the group comparison. Visual heterogeneity, I2 statistic, and chi-square test were used to measure the heterogeneity between the included studies. We evaluated the quality of evidence using GRADEpro GDT, software for creating evidence summaries and healthcare recommendations.

RESULTS

Two randomized controlled trials were included in this review. A total of 109 participants (70 male, 39 female) were evaluated. The time since the stroke was ≥6 months in one study and ≥1 year in another study. Improvements in upper limb motor function while performing functional movements were measured using the Wolf Motor Function Test. The evidence for the effectiveness of CIMT using telerehabilitation compared with traditional CIMT in improving the upper extremity function in patients with chronic stroke is of moderate quality. This suggests no significant difference between the groups (mean difference [95% CI]: -0.04 [-0.42, 0.33]).

CONCLUSIONS

CIMT using telerehabilitation is not superior to traditional CIMT in improving patients' upper extremity motor function with chronic stroke. CIMT using telerehabilitation may improve access to treatment, minimize SARS-CoV-2 risk, and reduce travel in patients with chronic stroke.

Systematic review search strategies are poorly reported and not reproducible: a cross-sectional metaresearch study

OBJECTIVES

To determine the reproducibility of biomedical systematic review search strategies.

STUDY DESIGN AND SETTING

A cross-sectional reproducibility study was conducted on a random sample of 100 systematic reviews indexed in MEDLINE in November 2021. The primary outcome measure is the percentage of systematic reviews for which all database searches can be reproduced, operationalized as fulfilling six key Preferred Reporting Items for Systematic reviews and Meta-Analyses literature search extension (PRISMA-S) reporting guideline items and having all database searches reproduced within 10% of the number of original results. Key reporting guideline items included database name, multi-database searching, full search strategies, limits and restrictions, date(s) of searches, and total records.

RESULTS

The 100 systematic review articles contained 453 database searches. Only 22 (4.9%) database searches reported all six PRISMA-S items. Forty-seven (10.4%) database searches could be reproduced within 10% of the number of results from the original search; six searches differed by more than 1,000% between the originally reported number of results and the reproduction. Only one systematic review article provided the necessary search details to be fully reproducible.

CONCLUSION

Systematic review search reporting is poor. To correct this will require a multifaceted response from authors, peer reviewers, journal editors, and database providers.

An appraisal of the methodology and quality of evidence of systematic reviews on the efficacy of prone positional ventilation in adult patients with acute respiratory distress syndrome: an umbrella review

The objective of the study was to evaluate all available systematic reviews on the use of prone positional ventilation in adult patients with acute respiratory distress syndrome (ARDS). An umbrella review on the efficacy of prone positional ventilation in adult patients ventilation in adult patients with acute respiratory distress syndrome was conducted. We performed a systematic search in the database of Medline (Pubmed), Scopus, Cochrane Library, Web of Science, and Epistemonikos. The ROBIS tools and GRADE methodology were used to assess the risk of bias and certainty of evidence. We estimated the necessary number of patients to be treated to have benefit. For the synthesis of the result, we selected the review with the lowest risk of bias. Sixteen systematic reviews including 64 randomized clinical trials and evaluating the effect of prone positional ventilation, with or without other ventilation strategies were included. Aoyama 2019 observed prone positioning, without complementary ventilation strategies, leading to a reduction in the 28-day mortality only when compared to high-frequency oscillatory ventilation (RR 0.61; 95% CI 0.39-0.95) and lung-protective ventilation in the supine position (RR 0.69; 95% CI 0.48-0.98), with an ARR of 9.32% and 14.94%, an NNTB of 5.89 and 8.04, and a low and moderate certainty of evidence, respectively. Most reviews had severe methodological flaws that led to results with very low certainty of evidence. The review with the lowest risk of bias presented results in favor of prone positional ventilation compared with high-frequency oscillatory ventilation and lung-protective ventilation. There is a need to update the available reviews to obtain more accurate results.

A suggested data structure for transparent and repeatable reporting of bibliographic searching

Academic searching is integral to research activities: (1) searching to retrieve specific information, (2) to expand our knowledge iteratively, (3) and to collate a representative and unbiased selection of the literature. Rigorous searching methods are vital for reliable, repeatable and unbiased searches needed for these second and third forms of searches (exploratory and systematic searching, respectively) that form a core part of evidence syntheses. Despite the broad awareness of the importance of transparency in reporting search activities in evidence syntheses, the importance of searching has been highlighted only recently and has been the explicit focus of reporting guidance (PRISMA-S). Ensuring bibliographic searches are reported in a way that is transparent enough to allow for full repeatability or evaluation is challenging for a number of reasons. Here, we detail these reasons and provide for the first time a standardised data structure for transparent and comprehensive reporting of search histories. This data structure was produced by a group of international experts in informatics and library sciences. We explain how the data structure was produced and describe its components in detail. We also demonstrate its practical applicability in tools designed to support literature review authors and explain how it can help to improve interoperability across tools used to manage literature reviews. We call on the research community and developers of reference and review management tools to embrace the data structure to facilitate adequate reporting of academic searching in an effort to raise the standard of evidence syntheses globally.

An analysis of data sources and study registries used in systematic reviews

BACKGROUND

Reporting standards for data sources in systematic reviews (SRs) have been developed, yet research shows varying compliance in the methods section. When this happens, replication of search results is difficult and creates ambiguous and biased data sources.

AIMS

This study captured author practices in choosing English and non-English-language databases, listing all the databases searched, and incorporating study registries as part of the search strategy.

METHODS

Using an analytic, cross-sectional, study design, volunteer data collectors (n = 107) searched one of two assigned English language platforms for SRs on specified health conditions. All the data sources found in the methods section of each SR were documented and analyzed for patterns using bibliographic techniques.

RESULTS

The final sample size of the SRs reviewed was N = 199. The mean number of data sources seen in the SRs was 3.9 (SD 2), with a range of 1-10. Eighteen records (9%) used a single data source to conduct the SRs. Four leading language platforms were seen in the SRs: English (100% of occurrences), up to 8% used Chinese data sources, and 4% included Spanish or Portuguese. The four most frequently used data sources were: (1) Medline (98%), (2) Embase (65%), (3) Cochrane Library (56%), and (4) Web of Science (33%). The percentage of SRs listing study registries was 30%.

LINKING EVIDENCE TO ACTION

Strategies to reduce bias and increase the rigor and reliability of SRs include comprehensive search practices by exploring non-English-language databases, using multiple data sources, and searching study registries. By following PRISMA-S guidelines to report data sources correctly, reproducibility can be accomplished.

Suicide risk and mortality among patients with cancer

Despite substantial progress in cancer therapy in recent decades, patients with cancer remain at high suicide risk. Data from individual studies have not been comprehensively quantified and specific risk factors are ill-defined. We assessed suicide mortality risk according to cancer prognosis, stage, time since diagnosis, gender, ethnicity, marital status, year of recruitment and geographic region. We searched EMBASE, MEDLINE, PsycINFO, Web of Science, CINAHL and Google Scholar for relevant articles up to February 2021. We used a random effects model, performed meta-regression meta-analysis and assessed heterogeneity and publication bias using I², funnel plots and Egger's and Begg's tests. We performed a systematic review including 62 studies and 46,952,813 patients. To avoid patient sample overlap, the meta-analysis was performed on 28 studies, involving 22,407,690 patients with cancer. Suicide mortality was significantly increased compared with the general population (standardized mortality ratio = 1.85, 95% confidence interval = 1.55-2.20). Risk was strongly related to cancer prognosis, cancer stage, time since diagnosis and geographic region. Patients with cancer, particularly those with specific risk factors, should be closely monitored for suicidality and need specialized care to reduce short- and long-term risks of suicide.

Literature searching methods or guidance and their application to public health topics: A narrative review

Background

Information specialists conducting searches for systematic reviews need to consider key questions around which and how many sources to search. This is particularly important for public health topics where evidence may be found in diverse sources.

Objectives

The objective of this review is to give an overview of recent studies on information retrieval guidance and methods that could be applied to public health evidence and used to guide future searches.

Methods

A literature search was performed in core databases and supplemented by browsing health information journals and citation searching. Results were sifted and reviewed.

Results

Seventy‐two papers were found and grouped into themes covering sources and search techniques. Public health topics were poorly covered in this literature.

Discussion

Many researchers follow the recommendations to search multiple databases. The review topic influences decisions about sources. Additional sources covering grey literature eliminate bias but are time‐consuming and difficult to search systematically. Public health searching is complex, often requiring searches in multidisciplinary sources and using additional methods.

Conclusions

Search planning is advisable to enable decisions about which and how many sources to search. This could improve with more work on modelling search scenarios, particularly in public health topics, to examine where publications were found and guide future research.