1
|
Sritharan P, Milantoni V, Abdel Khalik H, Kay J, Slawaska-Eng D, Johnson J, de Sa D. Evaluating the quality of systematic reviews of comparative studies in autograft-based anterior cruciate ligament reconstruction using the AMSTAR-2 tool: A systematic umbrella review. Knee Surg Sports Traumatol Arthrosc 2024; 32:583-598. [PMID: 38372015 DOI: 10.1002/ksa.12062] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/09/2023] [Revised: 01/04/2024] [Accepted: 01/09/2024] [Indexed: 02/20/2024]
Abstract
PURPOSE There remains a lack of consensus around autograft selection in anterior cruciate ligament reconstruction (ACLR), though there is a large body of overlapping systematic reviews and meta-analyses. Systematic reviews and their methodological quality were aimed to be further assessed, using a validated tool known as assessing the methodological quality of systematic reviews (AMSTAR-2). METHODS MEDLINE, Embase and CENTRAL were searched from inception to 23 April 2023 for systematic reviews (with/without meta-analysis) comparing primary ACLR autografts. A final quality rating from AMSTAR-2 was provided for each study ('critically low', 'low', 'moderate' or 'high' quality). Correlational analyses were conducted for ratings in relation to study characteristics. RESULTS Two thousand five hundred and ninety-eight studies were screened, and 50 studies were ultimately included. Twenty-four studies (48%) were rated as 'critically low', 17 (34%) as 'low', seven (14%) as 'moderate' and two (4%) as 'high' quality. The least followed domains were reporting on sources of funding (1/50 studies), the impact of risk of bias on results of meta-analyses (11/36 studies) and publication bias (17/36 studies). There was a significant increase in the frequency of studies graded as 'moderate' compared to 'low' or 'critically low' quality over time (p = 0.020). CONCLUSION The methodological quality of systematic reviews comparing autografts in ACLR is low, with many studies being rated lower due to commonly absent aspects of systematic review methodology such as investigating sources of funding and publication bias. More recent studies were generally more likely to be of higher quality. Authors are advised to consult AMSTAR-2 prior to conducting systematic reviews in ACLR. LEVEL OF EVIDENCE Level IV.
Collapse
Affiliation(s)
- Praveen Sritharan
- Michael G. DeGroote School of Medicine, McMaster University, Hamilton, Ontario, Canada
| | - Vincent Milantoni
- Faculty of Health Sciences, McMaster University, Hamilton, Ontario, Canada
| | - Hassaan Abdel Khalik
- Department of Surgery, Division of Orthopedic Surgery, McMaster University, Hamilton, Ontario, Canada
| | - Jeffrey Kay
- Department of Surgery, Division of Orthopedic Surgery, McMaster University, Hamilton, Ontario, Canada
| | - David Slawaska-Eng
- Department of Surgery, Division of Orthopedic Surgery, McMaster University, Hamilton, Ontario, Canada
| | - Jansen Johnson
- Department of Surgery, Division of Orthopedic Surgery, McMaster University, Hamilton, Ontario, Canada
| | - Darren de Sa
- Department of Surgery, Division of Orthopedic Surgery, McMaster University, Hamilton, Ontario, Canada
| |
Collapse
|
2
|
Menne MC, Su N, Faggion CM. Methodological quality of systematic reviews in dentistry including animal studies: a cross-sectional study. Ir Vet J 2023; 76:33. [PMID: 38098065 PMCID: PMC10720166 DOI: 10.1186/s13620-023-00261-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/28/2023] [Accepted: 11/06/2023] [Indexed: 12/18/2023] Open
Abstract
BACKGROUND The overall confidence in the results of systematic reviews including animal models can be heterogeneous. We assessed the methodological quality of systematic reviews including animal models in dentistry as well as the overall confidence in the results of those systematic reviews. MATERIAL & METHODS PubMed, Web of Science and Scopus were searched for systematic reviews including animal studies in dentistry published later than January 2010 until 18th of July 2022. Overall confidence in the results was assessed using a modified version of the A MeaSurement Tool to Assess systematic Reviews (AMSTAR-2) checklist. Checklist items were rated as yes, partial yes, no and not applicable. Linear regression analysis was used to investigate associations between systematic review characteristics and the overall adherence to the AMSTAR-2 checklist. The overall confidence in the results was calculated based on the number of critical and non-critical weaknesses presented in the AMSTAR-2 items and rated as high, moderate, low and critical low. RESULTS Of initially 951 retrieved systematic reviews, 190 were included in the study. The overall confidence in the results was low in 43 (22.6%) and critically low in 133 (70.0%) systematic reviews. While some AMSTAR-2 items were regularly reported (e.g. conflict of interest, selection in duplicate), others were not (e.g. FUNDING n = 1; 0.5%). Multivariable linear regression analysis showed that the adherence scores of AMSTAR-2 was significantly associated with publication year, journal impact factor (IF), topic, and the use of tools to assess risk of bias (RoB) of the systematic reviews. CONCLUSION Although the methodological quality of dental systematic reviews of animal models improved over the years, it is still suboptimal. The overall confidence in the results was mostly low or critically low. Systematic reviews, which were published later, published in a journal with a higher IF, focused on non-surgery topics, and used at least one tool to assess RoB correlated with greater adherence to the AMSTAR-2 guidelines.
Collapse
Affiliation(s)
- Max C Menne
- Department of Prosthodontics and Biomaterials, University Hospital Münster, Waldeyerstraße 30, Münster, 48149, Germany
- Department of Oral and Maxillofacial Surgery, Fachklinik Hornheide, Dorbaumstraße 300, Münster, 48157, Germany
| | - Naichuan Su
- Department of Oral Public Health, Academic Centre for Dentistry Amsterdam (ACTA), University of Amsterdam and Vrije Universiteit Amsterdam, Amsterdam, 1081LA, The Netherlands
| | - Clovis M Faggion
- Department of Periodontology and Operative Dentistry, University Hospital Münster, Waldeyerstraße 30, Münster, 48149, Germany.
| |
Collapse
|
3
|
Deblois S, Zhu L, Mastropasqua B, Thibaudeau S, Ziegler D, Pomp A. The clinical effectiveness and safety of intravenous unfractionated heparin following digital replantation and revascularization: A narrative systematic review. Microsurgery 2022; 42:622-630. [PMID: 35553450 DOI: 10.1002/micr.30895] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/14/2021] [Revised: 02/16/2022] [Accepted: 04/29/2022] [Indexed: 11/07/2022]
Abstract
BACKGROUND Digital replants and revascularization (DRV) have been performed since the 1960s but there are no recognized standard peri-operative anticoagulation practices. A narrative systematic review of the clinical effectiveness and safety of therapeutic peri-operative unfractionated heparin following DRV was undertaken. METHODS A review of the literature from 1985 to March 2022 was conducted using Medline, Embase, CINAHL and EBM reviews. Unfractionated heparin (UFH) use following DRV was compared to low-molecular weight heparin, other anticoagulants or no anticoagulation. Randomized trials, observational studies as well as guidelines were selected and independently screened. The Revised Cochrane risk-of-bias (RoB 2) tool and ROBINS-I were used to appraise risk of bias. RESULTS While the search strategy identified 1490 references, only six studies met the inclusion criteria. Significant heterogeneity and the low methodological quality of the evidence precluded a meta-analysis. Among the four studies that documented the surgical success rate associated with the use of a therapeutic dose of UFH post DRV, only two reported improved clinical outcomes. Evidence of a higher complication rate related to UFH use was found in four studies. Low quality evidence suggests that a therapeutic dose of unfractionated heparin leads to a higher risk of complications when compared with heparin given as an intermittent bolus of unfractionated heparin or subcutaneous heparin, or prostaglandin E1 or no heparin. CONCLUSIONS Current evidence suggests that IV UFH use following DRV has no significant impact on the success of the intervention. Heparin use may not be innocuous as some studies showed increased bleeding complications.
Collapse
Affiliation(s)
- Simon Deblois
- Health Technology Assessment Professional, Centre Hospitalier de l'Université de Montréal (CHUM), Montréal, Québec, Canada
| | - Linda Zhu
- Faculty of Medicine, McGill University, Montréal, Québec, Canada
| | - Bruno Mastropasqua
- Department of Surgery, Faculty of Medicine, Université de Montréal, Montréal, Québec, Canada
| | - Stephanie Thibaudeau
- Plastic Surgery Division McGill, University Health Center, Montréal, Québec, Canada
| | - Daniela Ziegler
- Library, Centre hospitalier de l'Université de Montréal (CHUM), Montréal, Québec, Canada
| | - Alfons Pomp
- Health Technology Assessment Professional, Centre Hospitalier de l'Université de Montréal (CHUM), Montréal, Québec, Canada.,Department of Surgery, Faculty of Medicine, Université de Montréal, Montréal, Québec, Canada
| |
Collapse
|
4
|
Flowers H, Guitard P, King J, Fitzpatrick E, Bérubé D, Barette JA, Cardinal D, Cavallo S, O’Neil J, Charette M, Côté L, Gurgel-Juarez NC, Toupin-April K, Shallwani SM, Dorion M, Rahman P, Potvin-Gilbert M, Bartolini V. Traduction franco-canadienne de l’ Assessment of Systematic Reviews Revised (AMSTAR 2) : validation transculturelle et fidélité interjuges. Physiother Can 2022; 74:15-24. [PMID: 35185243 PMCID: PMC8816359 DOI: 10.3138/ptc-2019-0104] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/15/2020] [Revised: 07/29/2020] [Accepted: 07/30/2020] [Indexed: 01/03/2023]
Abstract
Objective: Produce a French-Canadian translation of AMSTAR 2, affirm its content validity, and examine interrater reliability. Methods: Based on Vallerand's methodological approach, we conducted forward and parallel inverse-translations. Subsequently, an expert panel evaluated the translations to create a preliminary experimental French-Canadian version. A second expert panel examined this version and proposed additional modifications. Twenty future health professionals then rated the second experimental version for ambiguity on a scale (from 1 to 7). The principal co-investigators then reviewed the problematic elements and proposed a pre-official version. To ascertain content validity, a final back-translation was conducted resulting in the official version. Four judges evaluated 13 systematic reviews using the official French-Canadian version of AMSTAR 2. The Kappa coefficient was used to evaluate interrater reliability. Results: This rigorous adaptation enabled the development of a Franco-Canadian version of AMSTAR 2. Its application demonstrated low ambiguity (mean 1.15; SD 0.26) as well as good overall interrater reliability (total κ > 0.64) across all items. Conclusion: The French-Canadian version of AMSTAR 2 can now support francophone clinicians, educators, and managers in Canada as they undertake evidence-based practice.
Collapse
Affiliation(s)
- Heather Flowers
- Programme d’audiologie et d’orthophonie, École des sciences de la réadaptation, Université d’Ottawa, Ottawa (Ontario) Canada
| | - Paulette Guitard
- Programme d’ergothérapie, École des sciences de la réadaptation, Université d’Ottawa, Ottawa (Ontario) Canada
| | - Judy King
- Programme de physiothérapie, École des sciences de la réadaptation, Université d’Ottawa, Ottawa (Ontario) Canada
| | - Elizabeth Fitzpatrick
- Programme d’audiologie et d’orthophonie, École des sciences de la réadaptation, Université d’Ottawa, Ottawa (Ontario) Canada
| | - Daniel Bérubé
- Programme d’audiologie et d’orthophonie, École des sciences de la réadaptation, Université d’Ottawa, Ottawa (Ontario) Canada
| | | | - Dominique Cardinal
- Consortium national de formation en santé (CNFS), Université d’Ottawa, Ottawa (Ontario) Canada
| | - Sabrina Cavallo
- Programme d’ergothérapie, École de réadaptation, Université de Montréal, Montréal (Québec) Canada
| | - Jennifer O’Neil
- École des sciences de la réadaptation, Université d’Ottawa, Ottawa (Ontario) Canada
| | - Marylène Charette
- École interdisciplinaire des sciences de la santé, Université d’Ottawa, Ottawa (Ontario) Canada
| | - Laurence Côté
- École des sciences de la réadaptation, Université d’Ottawa, Ottawa (Ontario) Canada
| | | | - Karine Toupin-April
- Institut de recherche du Centre hospitalier pour enfants de l’est de l’Ontario, Ottawa (Ontario) Canada
- Faculté de médecine et Faculté des sciences de la santé, Université d’Ottawa, Ottawa (Ontario) Canada
| | - Shirin M. Shallwani
- École des sciences de la réadaptation, Université d’Ottawa, Ottawa (Ontario) Canada
| | - Michelle Dorion
- École des sciences de la réadaptation, Université d’Ottawa, Ottawa (Ontario) Canada
| | - Prinon Rahman
- École des sciences de la réadaptation, Université d’Ottawa, Ottawa (Ontario) Canada
| | - Maude Potvin-Gilbert
- École des sciences de la réadaptation, Université d’Ottawa, Ottawa (Ontario) Canada
| | - Vanessa Bartolini
- École des sciences de la réadaptation, Université d’Ottawa, Ottawa (Ontario) Canada
| |
Collapse
|
5
|
Nascimento DP, Gonzalez GZ, Araujo AC, Costa LOP. Journal impact factor is associated with PRISMA endorsement, but not with the methodological quality of low back pain systematic reviews: a methodological review. EUROPEAN SPINE JOURNAL : OFFICIAL PUBLICATION OF THE EUROPEAN SPINE SOCIETY, THE EUROPEAN SPINAL DEFORMITY SOCIETY, AND THE EUROPEAN SECTION OF THE CERVICAL SPINE RESEARCH SOCIETY 2019; 29:462-479. [DOI: 10.1007/s00586-019-06206-8] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/12/2019] [Revised: 09/30/2019] [Accepted: 11/02/2019] [Indexed: 12/28/2022]
|
6
|
Giang HTN, Ahmed AM, Fala RY, Khattab MM, Othman MHA, Abdelrahman SAM, Thao LP, Gabl AEAE, Elrashedy SA, Lee PN, Hirayama K, Salem H, Huy NT. Methodological steps used by authors of systematic reviews and meta-analyses of clinical trials: a cross-sectional study. BMC Med Res Methodol 2019; 19:164. [PMID: 31349805 PMCID: PMC6659247 DOI: 10.1186/s12874-019-0780-2] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/29/2017] [Accepted: 06/19/2019] [Indexed: 12/16/2022] Open
Abstract
Background The quality of systematic reviews and meta-analyses (SR/MAs) depends on the extent of the methods used. We investigated the methodological steps used by authors of SR/MAs of clinical trials via an author survey. Methods We conducted an email-based cross-sectional study by contacting corresponding authors of SR/MAs that were published in 2015 and 2016 and retrieved through the PubMed database. The 27-item questionnaire was developed to study the methodological steps used by authors when conducting a SR/MA and the demographic characteristics of the respondent. Besides the demographic characteristics, methodological questions regarding the source, extraction and synthesis of data were included. Results From 10,292 emails sent, 384 authors responded and were included in the final analysis. Manual searches were carried out by 69.2% of authors, while 87.3% do updated searches, 49.2% search grey literature, 74.9% use the Cochrane tool for risk of bias assessment, 69.8% assign more than two reviewers for data extraction, 20.5% use digital software to extract data from graphs, 57.9% use raw data in the meta-analysis, and 43.8% meta-analyze both adjusted and non-adjusted data. There was a positive correlation of years of experience in conducting of SR/MAs with both searching grey literature (P = 0.0003) and use of adjusted and non-adjusted data (P = 0.006). Conclusions Many authors still do not carry out many of the vital methodological steps to be taken when performing any SR/MA. The experience of the authors in SR/MAs is highly correlated with use of the recommended tips for SR/MA conduct. The optimal methodological approach for researchers conducting a SR/MA should be standardized. Electronic supplementary material The online version of this article (10.1186/s12874-019-0780-2) contains supplementary material, which is available to authorized users.
Collapse
Affiliation(s)
- Hoang Thi Nam Giang
- Faculty of Medicine and Pharmacy, The University of Da Nang, Da Nang, Vietnam.,Online Research Club
| | - Ali Mahmoud Ahmed
- Online Research Club.,Faculty of Medicine, Al-Azhar University, Cairo, Egypt
| | - Reem Yousry Fala
- Online Research Club.,Faculty of Medicine, Al-Azhar University, Damitta, Egypt
| | | | | | | | - Le Phuong Thao
- Online Research Club.,University of Medicine and Pharmacy, Ho Chi Minh City, Viet Nam
| | | | | | - Peter N Lee
- P.N.Lee Statistics and Computing Ltd, 17 Cedar Road, Sutton, Surrey, SM2 5DA, UK
| | - Kenji Hirayama
- Department of Immunogenetics, Institute of Tropical Medicine (NEKKEN), Leading Graduate School Program, and Graduate School of Biomedical Sciences, Nagasaki University, Nagasaki, 852-8523, Japan
| | - Hosni Salem
- Faculty of Medicine, Cairo University, Cairo, Egypt
| | - Nguyen Tien Huy
- Evidence Based Medicine Research Group, Ton Duc Thang University, Ho Chi Minh City, 70000, Vietnam. .,Faculty of Applied Sciences, Ton Duc Thang University, Ho Chi Minh City, 70000, Vietnam.
| |
Collapse
|