1
|
Makaram NS, Liang N, Wu S, Roberts SB, Ngwayi J, Statham P, Porter DE. A Critical Appraisal of the Congress of Neurological Surgeons Evidence-Based Guidelines on the Evaluation and Treatment of Patients With Thoracolumbar Spine Trauma. Cureus 2024; 16:e58641. [PMID: 38770456 PMCID: PMC11104276 DOI: 10.7759/cureus.58641] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 04/20/2024] [Indexed: 05/22/2024] Open
Abstract
Background and objective Thoracolumbar spine trauma (TST) is frequently associated with spinal cord injury and other soft tissue and bony injuries. The management of such injuries requires an evidence-based approach. This study used the Appraisal of Guidelines for Research and Evaluation (AGREE) II instrument to assess the methodological quality of clinical guidelines for the management of TST published by the Congress of Neurological Surgeons (CNS). Methods All clinical guidelines on TST published by CNS until 2020 were assessed. Five appraisers from three international centers evaluated the quality of eligible clinical guidelines by using AGREE II. Mean AGREE II scores for each domain were determined. In higher-quality domains, the scores for individual items were analyzed. Results A total of 12 guidelines published by CNS on TST were assessed. Mean scores for all six domains were as follows: Scope and Purpose (75.2%), Stakeholder Involvement (45.4%), Rigor of Development (57.0%), Clarity of Presentation (58.7%), Applicability (16.9%), and Editorial Independence (64.1%). The mean score for the overall quality of all CNS guidelines was 52.9% [95% confidence interval (CI): 52.2-53.5%]. The overall agreement among appraisers was excellent [intra-class correlation coefficients (ICCs) for each guideline ranged from 0.903 to 0.963]. Conclusions CNS guidelines for the management of TST demonstrated acceptable quality across most domains; however, the domains of Applicability and Stakeholder Involvement could be further improved in future guideline updates. The assessors concluded that all guidelines could still be recommended for clinical practice with or without modifications.
Collapse
Affiliation(s)
- Navnit S Makaram
- Department of Orthopaedics and Traumatology, Royal Infirmary of Edinburgh, Edinburgh, GBR
| | - Ning Liang
- Department of Orthopaedics, Beijing Huaxin Hospital, School of Clinical Medicine, Tsinghua University, Beijing, CHN
| | - Sizhan Wu
- Department of Orthopaedics, School of Clinical Medicine, Tsinghua University, Beijing, CHN
| | - Simon B Roberts
- Department of Orthopaedics, Leeds General Infirmary, Leeds, GBR
| | - James Ngwayi
- Department of Orthopaedics, School of Clinical Medicine, Tsinghua University, Beijing, CHN
| | - Patrick Statham
- Department of Neurosurgery, Western General Hospital, Edinburgh, GBR
| | - Daniel E Porter
- Department of Orthopaedics, Beijing Huaxin Hospital, School of Clinical Medicine, Tsinghua University, Beijing, CHN
| |
Collapse
|
2
|
Fritz C, Monos S, Ng J, Romeo D, Xu K, Moreira A, Rajasekaran K. Management of the Difficult Airway: An Appraisal of Clinical Practice Guidelines. Otolaryngol Head Neck Surg 2024; 170:112-121. [PMID: 37538005 DOI: 10.1002/ohn.466] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/14/2023] [Revised: 07/12/2023] [Accepted: 07/14/2023] [Indexed: 08/05/2023]
Abstract
OBJECTIVE Management of the difficult airway can be a challenging process, which necessitates actionable recommendations from well-established guidelines. Herein, clinical practice guideline (CPG) quality is evaluated using the Appraisal of Guidelines for Research and Evaluation (AGREE II) instrument. STUDY DESIGN A systematic literature search was performed using Scopus, EMBASE, and MEDLINE via PubMed. SETTING Literature database. METHODS Data were abstracted from relevant guidelines and appraised by 4 expert reviewers in the 6 domains of quality defined by AGREE II. Intraclass correlation coefficients (ICC) were calculated across domains to quantify interrater reliability. RESULTS Twelve guidelines met the inclusion criteria. With a mean quality score of 83.1%, the highest quality guideline was authored by the American Society of Anesthesiologists (ASA). Low-quality content was observed in CPGs authored by the Japanese Society of Anesthesiologists (JSA) and the Chinese Collaboration Group for Emergency Airway Management (CCGEAM). Overall, deficits were most pronounced in domains describing the involvement of stakeholders, developmental rigor, and editorial independence. These findings were consistent among the panel of independent reviewers, with high ICC inter-rater reliability scores of 58.0% to 70.0% for the referenced domains. CONCLUSION By providing a comprehensive appraisal of guidelines, this report may serve as a reference for clinicians seeking to understand and improve upon the developmental quality of difficult airway management resources. According to AGREE II criteria for the quality of the guideline creation process, the 2022 ASA guideline outperforms its predecessors.
Collapse
Affiliation(s)
- Christian Fritz
- Department of Otorhinolaryngology-Head & Neck Surgery, University of Pennsylvania, Philadelphia, Pennsylvania, USA
| | - Stylianos Monos
- Lewis Katz School of Medicine at Temple University, Philadelphia, Pennsylvania, USA
| | - Jinggang Ng
- Perelman School of Medicine, University of Pennsylvania, Philadelphia, Pennsylvania, USA
| | - Dominic Romeo
- Perelman School of Medicine, University of Pennsylvania, Philadelphia, Pennsylvania, USA
| | - Katherine Xu
- Perelman School of Medicine, University of Pennsylvania, Philadelphia, Pennsylvania, USA
| | - Alvaro Moreira
- Department of Pediatrics, University of Texas Health Science Center at San Antonio, San Antonio, Texas, USA
| | - Karthik Rajasekaran
- Department of Otorhinolaryngology-Head & Neck Surgery, University of Pennsylvania, Philadelphia, Pennsylvania, USA
- Leonard Davis Institute of Health Economics, University of Pennsylvania, Philadelphia, Pennsylvania, USA
| |
Collapse
|
3
|
A critical appraisal of clinical practice guidelines for the diagnosis and management of benign paroxysmal positional vertigo. J Laryngol Otol 2023; 137:121-126. [PMID: 35713113 DOI: 10.1017/s0022215122001414] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/06/2023]
Abstract
BACKGROUND Delays in the diagnosis and therapy of benign paroxysmal positional vertigo can greatly impact quality of life and increase healthcare costs for patients. This study aimed to appraise the quality of clinical practice guidelines for the diagnosis and management of benign paroxysmal positional vertigo. METHODS A comprehensive database search of clinical practice guidelines was completed up to 30 October 2021. Four independent reviewers used the Appraisal of Guidelines for Research and Evaluation II instrument in the quality appraisal. RESULTS The highest score was in 'clarity and presentation' (58.33 ± 22.7). The lowest score was in 'applicability' (13.96 ± 30.1). Overall, four clinical practice guidelines were 'low quality' and only one guideline was 'high quality'. CONCLUSION This review identified a significant lack of quality in clinical practice guideline development for benign paroxysmal positional vertigo, highlighting the need for a more rigorous approach for future guideline development.
Collapse
|
4
|
Clinical practice guidelines for the management of recurrent head and neck cancer: a systematic review and quality appraisal. Eur Arch Otorhinolaryngol 2023; 280:297-305. [PMID: 35960350 DOI: 10.1007/s00405-022-07519-z] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/14/2022] [Accepted: 06/18/2022] [Indexed: 01/07/2023]
Abstract
PURPOSE Recurrent head and neck cancer (HNC) has a significant global disease burden and its treatment is complex. Multiple clinical practice guidelines (CPGs) have been developed to improve management of these patient populations; however, no study has systematically reviewed the quality and rigor in development of these guidelines. Here, we identify and systematically appraise existing recommendations for the management of recurrent HNC and assess their clinical applicability, methodologic rigor, and transparency of development. METHODS A systematic search of the PubMed, Embase, and Scopus databases was conducted for recurrent HNC CPGs. Each guideline was scored independently by four reviewers trained in the Appraisal of Guidelines for Research and Evaluation, 2nd edition (AGREE II) methodology. Salient recommendations from the selected guidelines were summarized. RESULTS Our literature search yielded 1799 articles; after iterative title/abstract and full text screening, five remaining guidelines met inclusion criteria. CPGs received the lowest scores in 'Applicability' and 'Rigor of development,' with scores of 12.9% and 22.3%, respectively. Overall quality of available guidelines for management of recurrent HNC is poor, with an average overall scaled domain score of 40.9% (± 11.0), and with four guidelines (80.0%) receiving an overall quality rating of 'low'. CONCLUSION We found significant variability in quality and overall lack of methodologic rigor among available guidelines for the management of recurrent HNC. Future groups developing recommendations for this purpose should implement the AGREE II framework to improve quality and standardization of their guidelines.
Collapse
|
5
|
Assessment of clinical guidelines for medication-related osteonecrosis of the jaw: current status and future directions. Oral Surg Oral Med Oral Pathol Oral Radiol 2022; 134:717-724. [PMID: 36241597 DOI: 10.1016/j.oooo.2022.06.014] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/13/2022] [Revised: 06/26/2022] [Accepted: 06/27/2022] [Indexed: 12/13/2022]
Abstract
OBJECTIVE To evaluate the current quality and utility of clinical practice guidelines (CPGs) issued for the diagnosis, prevention, and treatment of medication-related osteonecrosis of the jaw (MRONJ). STUDY DESIGN We performed a systematic literature search of guidelines for MRONJ diagnosis, staging, prevention, or management. An appraisal of guidelines was completed using the Appraisal of Guidelines for Research and Evaluation (AGREE II) instrument. Scaled domain scores were calculated for each domain. Key recommendations were abstracted from guidelines distinguished as "high" quality. RESULTS Six CPGs were identified from systematic review. Four of 6 (66.7%) guidelines were published within the last 2 years. Each guideline discussed management of antiresorptive and antiangiogenic therapy-associated osteonecrosis of the jaw. The highest-scoring domain was domain 1: "Scope and purpose," with an average score of 85.0% (range: 76.4%-100.0%). The lowest domain score was in domain 5: "Applicability," with an average score of 41.7% (range: 22.9%-92.7%). Only 2 guidelines (33.3%) met the quality threshold of > 60% in 5 or more AGREE II domains, distinguishing them as "high"-quality guidelines. The average kappa statistic calculated across domains was 0.77, suggesting substantial interrater correlation in the CPG appraisal process. CONCLUSIONS Despite the increasing recognition of MRONJ as a debilitating consequence of antiresorptive and antiangiogenic therapy, clinical guideline recommendations may be lacking in overall quality and clinical utility.
Collapse
|
6
|
De Ravin E, Suresh N, Romeo D, Lu J, Shah M, Karakousis G, Moreira A, Rajasekaran K. Clinical Practice Guidelines on Sentinel Lymph Node Biopsy for Melanoma: A Systematic Review and Quality Appraisal Using the AGREE II Instrument. Ann Surg Oncol 2022; 29:8364-8372. [PMID: 36121581 DOI: 10.1245/s10434-022-12525-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/02/2022] [Accepted: 08/29/2022] [Indexed: 11/18/2022]
Abstract
Sentinel lymph node biopsy (SLNB) is a minimally invasive surgical procedure that is standard of care for the evaluation of clinically negative regional lymph nodes in patients with cutaneous melanoma. As the presence of metastases dictates patient prognosis and determines the need for further regional disease control or adjuvant therapy, SLNB is invaluable to clinical decision-making in patients presenting with melanoma. However, the indications for SLNB, specifically among patients with thin (<1 mm) or thick (>4 mm) melanomas, remain unclear. A number of clinical practice guidelines (CPGs) have been developed outlining recommendations for the role of lymph node biopsy in the management of melanoma. However, to date, their quality has not been critically appraised. Our objective was to systematically evaluate all available CPGs on this topic using the validated Appraisal of Guidelines for Research and Evaluation (AGREE II) instrument. Four total guidelines met the inclusion criteria and underwent appraisal. Only one CPG achieved a "high" quality rating, indicating scores of >60% in at least five of the six AGREE II domains. Across all CPGs, the lowest scoring domains were "Applicability" and "Stakeholder involvement," which had average scores of 41.2% and 48.3%, respectively. Based on the AGREE II instrument, the quality of existing CPGs for the indications of SLNB for melanoma is low. Future guidelines should be pilot tested to evaluate barriers to application and should utilize multidisciplinary guideline development teams that include patients and key stakeholders in addition to clinical experts from all relevant disciplines.
Collapse
Affiliation(s)
- Emma De Ravin
- Department of Otorhinolaryngology-Head and Neck Surgery, University of Pennsylvania, Philadelphia, PA, USA.,Perelman School of Medicine at the University of Pennsylvania, Philadelphia, PA, USA
| | - Neeraj Suresh
- Department of Otorhinolaryngology-Head and Neck Surgery, University of Pennsylvania, Philadelphia, PA, USA
| | - Dominic Romeo
- Perelman School of Medicine at the University of Pennsylvania, Philadelphia, PA, USA
| | - Joseph Lu
- Sidney Kimmel Medical College, Thomas Jefferson University, Philadelphia, PA, USA
| | - Mitali Shah
- Drexel University College of Medicine, Drexel University, Philadelphia, PA, USA
| | - Giorgos Karakousis
- Department of Surgical Oncology, University of Pennsylvania, Philadelphia, PA, USA
| | - Alvaro Moreira
- Department of Pediatrics, University of Texas Health-San Antonio, San Antonio, TX, USA
| | - Karthik Rajasekaran
- Department of Otorhinolaryngology-Head and Neck Surgery, University of Pennsylvania, Philadelphia, PA, USA. .,Leonard Davis Institute of Health Economics, University of Pennsylvania, Philadelphia, PA, USA.
| |
Collapse
|
7
|
O'Shaughnessy SM, Dimagli A, Kachulis B, Rahouma M, Demetres M, Govea N, Rong LQ. Evaluation of the Quality of COVID-19 Guidance Documents in Anaesthesia using the Appraisal of Guidelines for Research & Evaluation II (AGREE II) Instrument. Br J Anaesth 2022; 129:851-860. [PMID: 36273932 PMCID: PMC9485431 DOI: 10.1016/j.bja.2022.09.008] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/01/2022] [Revised: 08/31/2022] [Accepted: 09/03/2022] [Indexed: 11/30/2022] Open
Abstract
Background Methods Results Conclusions
Collapse
Affiliation(s)
| | | | | | | | - Michelle Demetres
- Information, Technology and Services, Weill Cornell Medicine, New York, NY, USA
| | | | - Lisa Q Rong
- Department of Anesthesiology, New York, NY, USA
| |
Collapse
|
8
|
Fritz C, De Ravin E, Suresh N, Romeo D, Shah M, Rajasekaran K. Clinical practice guidelines for management of medullary thyroid carcinoma: An AGREE II appraisal. Am J Otolaryngol 2022; 43:103606. [PMID: 36037729 DOI: 10.1016/j.amjoto.2022.103606] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/07/2022] [Accepted: 08/09/2022] [Indexed: 11/01/2022]
Abstract
PURPOSE Medullary thyroid carcinoma (MTC) is a rare and aggressive form of thyroid neoplasia that requires multidisciplinary collaboration for effective management. We systematically appraise the quality of clinical practice guidelines (CPG) for the diagnosis and treatment of MTC using the Appraisal of Guidelines for Research and Evaluation (AGREE II) instrument. MATERIALS AND METHODS A systematic literature search was performed to identify CPGs pertaining to the diagnosis and treatment of MTC. Data were abstracted from guidelines meeting inclusion criteria and appraised by four independent reviewers in the six domains of quality defined by the AGREE II. Intraclass correlation coefficients (ICC) were calculated across domains to qualify interrater reliability. RESULTS Fourteen guidelines met inclusion criteria. No guideline achieved a score of >60 % in five or more AGREE II quality domains, which is required to gain designation as 'high' quality. One "average quality" guideline authored by the British Thyroid Association achieved a score of >60 % in three quality domains. The remaining thirteen (92.9 %) CPGs demonstrated low quality content, with deficits most pronounced in domains 3, 5, and 6, suggesting a lack of rigorously developed, clinically applicable, and transparent information. CONCLUSIONS As the diagnosis and treatment of MTC continues to evolve, the development of high-quality guidelines becomes increasingly important; few existing meet appropriate standards.
Collapse
Affiliation(s)
- Christian Fritz
- Department of Otorhinolaryngology - Head & Neck Surgery, University of Pennsylvania, Philadelphia, PA, United States of America
| | - Emma De Ravin
- Department of Otorhinolaryngology - Head & Neck Surgery, University of Pennsylvania, Philadelphia, PA, United States of America; Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, United States of America
| | - Neeraj Suresh
- Department of Otorhinolaryngology - Head & Neck Surgery, University of Pennsylvania, Philadelphia, PA, United States of America
| | - Dominic Romeo
- Department of Otorhinolaryngology - Head & Neck Surgery, University of Pennsylvania, Philadelphia, PA, United States of America; Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, United States of America
| | - Mitali Shah
- Department of Otorhinolaryngology - Head & Neck Surgery, University of Pennsylvania, Philadelphia, PA, United States of America; Drexel University College of Medicine, Philadelphia, PA, United States of America
| | - Karthik Rajasekaran
- Department of Otorhinolaryngology - Head & Neck Surgery, University of Pennsylvania, Philadelphia, PA, United States of America; Leonard Davis Institute of Health Economics, University of Pennsylvania, Philadelphia, PA, United States of America.
| |
Collapse
|