Systematic Reviews and Meta-Analysis in Spine Surgery-How Good Are They in Methodological Quality? A Systematic Review

Natural Experiments as a Study Method in Spinal Trauma Surgery: A Systematic Review

STUDY DESIGN

Systematic review.

OBJECTIVES

To determine if the natural experiment design is a useful research methodology concept in spinal trauma care, and to determine if this methodology can be a viable alternative when randomized controlled trials are either infeasible or unethical.

METHODS

A Medline, Embase and Cochrane database search was performed between 2004 and 2023 for studies comparing different treatment modalities of spinal trauma. All observational studies with a natural experiment design comparing different treatment modalities of spinal trauma were included. Data extraction and quality assessment with the MINORS criteria was performed.

RESULTS

Four studies with a natural experiment design regarding patients with traumatic spinal fractures were included. All studies were retrospective, one study collected follow-up data prospectively. Three studies compared different operative treatment modalities, whereas one study compared different antibiotic treatment strategies. Two studies compared preferred treatment modalities between expertise centers, one study between departments (neuro- and orthopedic surgery) and one amongst surgeons. For the included retrospective studies, MINORS scores (maximum score 18) were high ranging from 12-17 and with a mean (SD) of 14.6 (1.63).

CONCLUSIONS

Since 2004 only four studies using a natural experiment design have been conducted in spinal trauma. In the included studies, comparability of patient groups was high emphasizing the potential of natural experiments in spinal trauma research. Natural experiments design should be considered more frequently in future research in spinal trauma as they may help to address difficult clinical problems when RCT's are infeasible or unethical.

Evaluating the quality of systematic reviews of comparative studies in autograft-based anterior cruciate ligament reconstruction using the AMSTAR-2 tool: A systematic umbrella review

PURPOSE

There remains a lack of consensus around autograft selection in anterior cruciate ligament reconstruction (ACLR), though there is a large body of overlapping systematic reviews and meta-analyses. Systematic reviews and their methodological quality were aimed to be further assessed, using a validated tool known as assessing the methodological quality of systematic reviews (AMSTAR-2).

METHODS

MEDLINE, Embase and CENTRAL were searched from inception to 23 April 2023 for systematic reviews (with/without meta-analysis) comparing primary ACLR autografts. A final quality rating from AMSTAR-2 was provided for each study ('critically low', 'low', 'moderate' or 'high' quality). Correlational analyses were conducted for ratings in relation to study characteristics.

RESULTS

Two thousand five hundred and ninety-eight studies were screened, and 50 studies were ultimately included. Twenty-four studies (48%) were rated as 'critically low', 17 (34%) as 'low', seven (14%) as 'moderate' and two (4%) as 'high' quality. The least followed domains were reporting on sources of funding (1/50 studies), the impact of risk of bias on results of meta-analyses (11/36 studies) and publication bias (17/36 studies). There was a significant increase in the frequency of studies graded as 'moderate' compared to 'low' or 'critically low' quality over time (p = 0.020).

CONCLUSION

The methodological quality of systematic reviews comparing autografts in ACLR is low, with many studies being rated lower due to commonly absent aspects of systematic review methodology such as investigating sources of funding and publication bias. More recent studies were generally more likely to be of higher quality. Authors are advised to consult AMSTAR-2 prior to conducting systematic reviews in ACLR.

LEVEL OF EVIDENCE

Level IV.

A Century of Evolution in Spine Surgery Publications: A Bibliometric Analysis of the Field From 1900 to 2023

BACKGROUND AND OBJECTIVES

Spine surgery has advanced in concert with our deeper understanding of its elements. Narrowly focused bibliometric analyses have been conducted previously, but never on the entire corpus of the field. Using big data and bibliometrics, we appraised the entire corpus of spine surgery publications to study the evolution of the specialty as a scholarly field since 1900.

METHODS

We queried Web of Science for all contents from 13 major publications dedicated to spine surgery. We next queried by topic [topic = (spine OR spinal OR vertebrae OR vertebral OR intervertebral OR disc OR disk)]; these results were filtered to include articles published by 49 other publications that were manually determined to contain pertinent articles. Articles, along with their metadata, were exported. Statistical and bibliometric analyses were performed using the Bibliometrix R package and various Python packages.

RESULTS

Eighty-five thousand five hundred articles from 62 journals and 134 707 unique authors were identified. The annual growth rate of publications was 2.78%, with a surge after 1980, concurrent with the growth of specialized journals. International coauthorship, absent before 1970, increased exponentially with the formation of influential spine study groups. Reference publication year spectroscopy allowed us to identify 200 articles that comprise the historical roots of modern spine surgery and each of its subdisciplines. We mapped the emergence of new topics and saw a recent lexical evolution toward outcomes- and patient-centric terms. Female and minority coauthorship has increased since 1990, but remains low, and disparities across major publications persist.

CONCLUSION

The field of spine surgery was borne from pioneering individuals who published their findings in a variety of journals. The renaissance of spine surgery has been powered by international collaboration and is increasingly outcomes focused. While spine surgery is gradually becoming more diverse, there is a clear need for further promotion and outreach to under-represented populations.

Quality assessment of systematic reviews with meta-analysis in undergraduate nursing education

BACKGROUND

Little attention has been given to the methodological quality of meta-analyses in nursing education. This warrants further improvements in meta-analyses in nursing education.

OBJECTIVE

This study aimed to assess the methodological quality of meta-analysis in the field of undergraduate nursing education.

DESIGN

This was a methodological study to review the methodological quality of systematic reviews (SRs) with meta-analysis.

METHODS

Exhaustive literature searches were performed using five comprehensive databases. Between 1994 and 2022, 11,827 studies were identified, and 41 full-text articles met the inclusion criteria. Two researchers extracted data using A Measurement Tool to Assess Systematic Reviews (AMSTAR)-2. The Chi-square test was conducted to make comparisons before and after 2017, the year AMSTAR-2 was released.

RESULTS

A comprehensive literature retrieval strategy, inclusion and exclusion criteria, literature selection, and data extraction were observed in nursing education more than in other disciplines. Improvements to be made include pre-specifying the protocol, providing a list of excluded studies with their exclusion reasons, reporting the source of funding for the included studies, assessing and discussing the potential impact of risk of bias, as well as investigating and discussing publication bias and its impact.

CONCLUSIONS

The number of SRs with meta-analyses in nursing education is increasing. This warrants efforts to improve the quality of research. In addition, guidelines for reporting SRs in the field of nursing education should be constantly updated.

The efficiency of machine learning-assisted platform for article screening in systematic reviews in orthopaedics

PURPOSE

With the development of machine learning and artificial intelligence, various platforms were developed to aid in the time-consuming process of article screening in systematic reviews. We aim to analyze the efficiency of a machine learning-assisted platform as an end-user to aid in the screening of the articles for selection into systematic review in orthopaedic surgery.

METHODS

We included three previously published systematic reviews in the field of orthopaedics of increasing levels of difficulty in the structure of the research question to assess the efficiency of a platform with active-learning technology for article screening. We compared the efficiency of the platform compared to the traditional screening and also across the various scenarios tested. We performed five iterations for each review analyzed. The outcome parameters analyzed were the work saved at 95% recall (WSS-95), work saved at 100% recall (WSS-100), and relevant records found after screening the first 30% of the total records (RRF-30).

RESULTS

The machine learning-assisted screening significantly improved the rate of identifying the relevant records compared to the traditional screening method (p<0.001). The WSS-95 for the easy, intermediate, and advanced screening scenarios were 78%, 59%, and 38%, respectively. The WSS-100 for the easy, intermediate, and advanced screening scenarios were 75%, 48%, and 7%, respectively. The RRF-30 for the easy, intermediate, and advanced screening scenarios were 97%, 86%, and 64%, respectively. We noted a significant reduction (p<0.001) in the efficiency with the increasing level of difficulty of the screening scenarios.

CONCLUSION

The machine learning platform is significantly better than the traditional method as an assistive technology to aid in article screening. However, the efficiency of the platform significantly decreases as the complexity of the research question increases.

Evidence analysis on the utilization of platelet-rich plasma as an adjuvant in the repair of rotator cuff tears

BACKGROUND

Platelet-rich plasma has been gaining popularity as an agent for biological augmentation either as the sole treatment modality or as an adjunct to surgical repair. There is substantial discrepancy in the results of the published meta-analyses; and the true efficacy and role of using autologous platelet-rich plasma (PRP) at the time of rotator cuff repair is still ambiguous.

AIM

To performed this systematic overview on the overlapping meta-analyses that analyzed autologous PRP as an adjuvant in the repair of rotator cuff tears and identify the studies which provide the current best evidence on this subject and generate recommendations for the same.

METHODS

We conducted independent and duplicate electronic database searches in PubMed, Web of Science, Scopus, Embase, Cochrane Database of Systematic Reviews, Reference Citation Analysis and the Database of Abstracts of Reviews of Effects on September 8, 2021 to identify meta-analyses that analyzed the efficacy of PRP as an adjuvant in the repair of rotator cuff tears. Methodological quality assessment was made using Oxford Levels of Evidence, AMSTAR scoring and AMSTAR 2 grades. We then utilized the Jadad decision algorithm to identify the study with the highest quality to represent the current best evidence to generate the recommendation.

RESULTS

Twenty meta-analyses fulfilling the eligibility criteria were included. The AMSTAR scores of the included studies varied from 6-10 (mean: 7.9). All the included studies had critically low reliability in their summary of results due to their methodological flaws according to AMSTAR 2 grades. Significant heterogeneity was observed in the reporting of VAS, function outcome scores (long-term UCLA score, ASES score, SST score), operative time and long-term re-tear rates. Recent meta-analyses are more supportive of the role of intra-operative administration of PRPs at the bone-tendon interface in improving the overall healing and re-tear rates, functional outcome and pain. The initial size of the tear and type of repair performed do not seem to affect the benefit of PRPs. Among the different preparations used, leucocyte poor (LP)-PRP possibly offers the greatest benefit as a biological augment in these situations.

CONCLUSION

Based on this systematic overview, we give a level II recommendation that intra-operative use of PRPs at the bone-tendon interface can augment the healing rate, reduce re-tears, enhance functional outcome and mitigate pain in patients undergoing arthroscopic rotator cuff repair. LP-PRP possibly offers the greatest benefit in terms of healing rates, as compared with other platelet preparations.

Is Platelet-Rich Plasma Effective in Enhancing Spinal Fusion? Systematic Overview of Overlapping Meta-Analyses

STUDY DESIGN

Systematic review.

OBJECTIVES

We performed this systematic overview on overlapping meta-analyses that analyzed the role of platelet-rich plasma(PRP) in enhancing spinal fusion and identify which study provides the current best evidence on the topic and generate recommendations for the same.

MATERIALS AND METHODS

We conducted independent and duplicate electronic database searches in PubMed, Web of Science, Embase, Cochrane Database of Systematic Reviews, and Database of Abstracts of Reviews of Effects till October-2020 for meta-analyses that analyzed the role of PRP in spinal fusion procedures. Methodological quality assessment was made using Oxford Levels of Evidence, AMSTAR scoring, and AMSTAR 2 grades. We then utilized the Jadad decision algorithm to identify the study with highest quality to represent the current best evidence to generate recommendations.

RESULTS

3 meta-analyses fulfilling the eligibility criteria were included. The AMSTAR scores of included studies varied from 5-8(mean:6.3) and all included studies had critically low reliability in their summary of results due to their methodological flaws according to AMSTAR 2 grades. The current best evidence showed that utilization of PRP was not associated with significant improvement in patient-reported outcomes such as Visual Analog Score for pain compared to the standard fusion procedure. Moreover, PRP was found to be associated with lower fusion rates.

CONCLUSION

Based on this systematic overview, the effectiveness of PRP as a biological agent in augmenting spinal fusion is limited. Current evidence does not support the use of PRP as an adjuvant to enhance spinal fusion.

Menopausal hormone therapy and women's health: An umbrella review

BACKGROUND

There remains uncertainty about the impact of menopausal hormone therapy (MHT) on women's health. A systematic, comprehensive assessment of the effects on multiple outcomes is lacking. We conducted an umbrella review to comprehensively summarize evidence on the benefits and harms of MHT across diverse health outcomes.

METHODS AND FINDINGS

We searched MEDLINE, EMBASE, and 10 other databases from inception to November 26, 2017, updated on December 17, 2020, to identify systematic reviews or meta-analyses of randomized controlled trials (RCTs) and observational studies investigating effects of MHT, including estrogen-alone therapy (ET) and estrogen plus progestin therapy (EPT), in perimenopausal or postmenopausal women in all countries and settings. All health outcomes in previous systematic reviews were included, including menopausal symptoms, surrogate endpoints, biomarkers, various morbidity outcomes, and mortality. Two investigators independently extracted data and assessed methodological quality of systematic reviews using the updated 16-item AMSTAR 2 instrument. Random-effects robust variance estimation was used to combine effect estimates, and 95% prediction intervals (PIs) were calculated whenever possible. We used the term MHT to encompass ET and EPT, and results are presented for MHT for each outcome, unless otherwise indicated. Sixty systematic reviews were included, involving 102 meta-analyses of RCTs and 38 of observational studies, with 102 unique outcomes. The overall quality of included systematic reviews was moderate to poor. In meta-analyses of RCTs, MHT was beneficial for vasomotor symptoms (frequency: 9 trials, 1,104 women, risk ratio [RR] 0.43, 95% CI 0.33 to 0.57, p < 0.001; severity: 7 trials, 503 women, RR 0.29, 95% CI 0.17 to 0.50, p = 0.002) and all fracture (30 trials, 43,188 women, RR 0.72, 95% CI 0.62 to 0.84, p = 0.002, 95% PI 0.58 to 0.87), as well as vaginal atrophy (intravaginal ET), sexual function, vertebral and nonvertebral fracture, diabetes mellitus, cardiovascular mortality (ET), and colorectal cancer (EPT), but harmful for stroke (17 trials, 37,272 women, RR 1.17, 95% CI 1.05 to 1.29, p = 0.027) and venous thromboembolism (23 trials, 42,292 women, RR 1.60, 95% CI 0.99 to 2.58, p = 0.052, 95% PI 1.03 to 2.99), as well as cardiovascular disease incidence and recurrence, cerebrovascular disease, nonfatal stroke, deep vein thrombosis, gallbladder disease requiring surgery, and lung cancer mortality (EPT). In meta-analyses of observational studies, MHT was associated with decreased risks of cataract, glioma, and esophageal, gastric, and colorectal cancer, but increased risks of pulmonary embolism, cholelithiasis, asthma, meningioma, and thyroid, breast, and ovarian cancer. ET and EPT had opposite effects for endometrial cancer, endometrial hyperplasia, and Alzheimer disease. The major limitations include the inability to address the varying effects of MHT by type, dose, formulation, duration of use, route of administration, and age of initiation and to take into account the quality of individual studies included in the systematic reviews. The study protocol is publicly available on PROSPERO (CRD42017083412).

CONCLUSIONS

MHT has a complex balance of benefits and harms on multiple health outcomes. Some effects differ qualitatively between ET and EPT. The quality of available evidence is only moderate to poor.

Is Use of Topical Vancomycin in Pediatric Spine Surgeries a Safe Option in the Prevention of Surgical Site Infections? A Meta-analysis and Systematic Review of the Literature

STUDY DESIGN

Systematic review and meta-analysis.

OBJECTIVE

To systematically review the available articles on topical vancomycin powder (TVP) use in pediatric spine surgeries exploring the usefulness and safety of such practice.

METHODS

We conducted an independent and duplicate electronic database search in PubMed, EMBASE, and Cochrane Library till March 2020 to identify all relevant literature on the use of TVP for pediatric spine surgeries. Surgical site infection (SSI) rate, specific reported complications, reoperation rate, microbial flora pattern in reported SSIs, and safety profile were the outcomes analyzed. Analysis was performed with the R platform using OpenMeta[Analyst] software.

RESULTS

No prospective studies were available to evaluate the use of TVP in pediatric spine surgeries for the prevention of SSIs. Neither standardized protocol, nor drug dosage, nor safety profile was established for pediatric use. Three retrospective cohort studies including 824 patients (TVP/control: 400/424) were included in the meta-analysis. There was low-quality evidence suggesting no significant difference between the 2 groups in SSI rate (RR = 0.474; 95% CI = [0.106,2.112]; P = .327) with significant heterogeneity (I² = 70.14; P = .035). The TVP group showed a significant benefit on cost analysis in one of the included studies. However, TVP did not prevent gram-negative coinfection on SSI in the TVP group.

CONCLUSION

From the literature available at present, TVP does not qualify to be recommended as a safe and useful option to prevent SSI following pediatric spine surgeries. High-quality prospective interventional studies are needed to arrive at a consensus on its use along with appropriate dosage and method of application.

Autologous bone marrow derived mesenchymal stem cell therapy for osteonecrosis of femoral head: A systematic overview of overlapping meta-analyses

STUDY DESIGN

Systematic Review.

OBJECTIVES

We performed this systematic overview on the overlapping meta-analyses that analyzed autologous bone marrow-derived mesenchymal stem cell(BM-MSC) therapy along with core decompression(CD) for the management of osteonecrosis of the femoral head(ONFH) and identify which study provides the current best evidence on the topic and generate recommendations for the same.

MATERIALS AND METHODS

We conducted independent and duplicate electronic database searches in PubMed, Web of Science, Embase, Cochrane Database of Systematic Reviews, and the Database of Abstracts of Reviews of Effects till September 2020 for meta-analyses that analyzed the efficacy of BM-MSC therapy along with CD for ONFH. Methodological quality assessment was made using Oxford Levels of Evidence, AMSTAR scoring, and AMSTAR 2 grades. We then utilized the Jadad decision algorithm to identify the study with the highest quality to represent the current best evidence to generate the recommendation.

RESULTS

6 meta-analyses fulfilling the eligibility criteria were included. The AMSTAR scores of the included studies varied from 4 to 9 (mean:7) and all the included studies had critically low reliability in their summary of results due to their methodological flaws according to AMSTAR 2 grades. The current best evidence showed that utilization of BM-MSC therapy along with CD for ONFH resulted in significant improvement in Harris hip scores at 12 and 24 months along with a significant reduction in the necrotic area of the femoral head and the rate of conversion to total hip arthroplasty(THA) without a significant rise in adverse events due to the procedure.

CONCLUSION

Based on this systematic overview, we give a Level II recommendation that BM-MSC therapy is more efficacious along with CD in the management of ONFH compared to CD alone. BM-MSC therapy provides better pain relief with significant functional improvement and delaying the collapse of the femoral head thereby preventing further treatment such as THA.

Bibliometric Study of Technology and Occupational Health in Healthcare Sector: A Worldwide Trend to the Future

Since the eighties, technological tools have modified how people interact in their environment. At the same time, occupational safety and health measures have been widely applied. The European Agency for Safety and Health at Work considers that information and communication technologies are the main methods to achieve the goals proposed to improve working life and the dissemination of good practices. The principal objective was to determine the trends of publications focused on these technologies and occupational safety in the healthcare sector during the last 30 years. A bibliometric study was carried out. The 1021 documents showed an increased trend per country, especially for the United States (p < 0.001) and year (p < 0.001). The citations per year showed significant differences between citations of articles published before 2007 (p < 0.001). The year was also linked to the increase or decrease of articles (72.2%) and reviews (14.9%) (p < 0.001). The analysis of journal co-citations also showed that the main journals (such as Infection Control and Hospital Epidemiology) were linked to other important journals and had a major part in the clusters formed. All these findings were discussed in the manuscript and conclusions were drawn.