Clinical Practice Guidelines Registry: Toward Reducing Duplication, Improving Collaboration, and Increasing Transparency

Adapting Evidence-Based Practice Guidelines for Emergency Management of Seizures in Children Beyond the Neonatal Period

BACKGROUND

The presented evidence-based clinical practice guideline (CPG) is proposed as a National CPG where we adapted the international recommendations for the emergency management of seizures in children beyond the neonatal period to suit the health care in Egypt. The quality of evidence and the strength of recommendations are indicated. This study aimed to standardize the treatment of acute epileptic seizures and to provide an easy-to-apply acute treatment protocol that will allow immediate and appropriate seizure control.

METHODS

This is part of a larger program by the Egyptian Pediatric Clinical Practice Guidelines Committee (EPG) in collaboration with the staff of pediatric departments of 15 Egyptian universities and the National Research Centre. EPG was affiliated later to the Supreme Council of the Egyptian University Hospitals aiming to define the topics of, assign authors to, and assist in the adaptation of pediatric evidence-based CPGs according to a national strategic plan (http://epg.edu.eg). The committee is guided by a formal CPG adaptation methodology: the "Adapted ADAPTE."

RESULTS

The Egyptian Childhood Seizure Group (ECSG) reviewed the results of the Appraisal of Guidelines for Research and Evaluation II assessment and decided to adapt the recommendations of three source CPGs: American Epilepsy Society, Italian League Against Epilepsy, Neurocritical Care Society, and Neurologic & Psychiatric Society of Zambia. Eight implementation tools were included. A comprehensive set of multifaceted CPG implementation strategies was provided for the clinicians, patients, nurses, and other relevant stakeholders contextualized to the national settings.

CONCLUSIONS

Our experience with this adaptation methodology provides useful insight into its national utilization in Egypt.

Egyptian Pediatric Guidelines for the Management of Children with Isolated Thrombocytopenia Using the Adapted ADAPTE Methodology-A Limited-Resource Country Perspective

BACKGROUND

Thrombocytopenia is a prevalent presentation in childhood with a broad spectrum of etiologies, associated findings, and clinical outcomes. Establishing the cause of thrombocytopenia and its proper management have obvious clinical repercussions but may be challenging. This article provides an adaptation of the high-quality Clinical Practice Guidelines (CPGs) of pediatric thrombocytopenia management to suit Egypt's health care context.

METHODS

The Adapted ADAPTE methodology was used to identify the high-quality CPGs published between 2010 and 2020. An expert panel screened, assessed and reviewed the CPGs and formulated the adapted consensus recommendations based on the best available evidence.

DISCUSSION

The final CPG document provides consensus recommendations and implementation tools on the management of isolated thrombocytopenia in children and adolescents in Egypt. There is a scarcity of evidence to support recommendations for various management protocols. In general, complete clinical assessment, full blood count, and expert analysis of the peripheral blood smear are indicated at initial diagnosis to confirm a bleeding disorder, exclude secondary causes of thrombocytopenia and choose the type of work up required. The International Society of Hemostasis and thrombosis-Bleeding assessment tool (ISTH-SCC BAT) could be used for initial screening of bleeding manifestations. The diagnosis of immune thrombocytopenic purpura (ITP) is based principally on the exclusion of other causes of isolated thrombocytopenia. Future research should report the outcome of this adapted guideline and include cost-analysis evaluations.

Transfusion of blood components in pediatric age groups: an evidence-based clinical practice guideline adapted for the use in Egypt using 'Adapted ADAPTE'

Pediatric transfusion is a complex area of medicine covering a wide age range, from neonates to young adults. Compared to adult practice, there is a relative lack of high-quality research to inform evidence-based guidelines. We aimed to adapt the pre-existing high-quality practice guidelines for the transfusion of blood components in different pediatric age groups to be available for national use by general practitioners, pediatricians, and other health care professionals. The guideline panel included 17 key leaders from different Egyptian institutions. The panel used the Adapted ADAPTE methodology. The panel prioritized the health questions and recommendations according to their importance for clinicians and patients. The procedure included searching for existing guidelines, quality appraisal, and adaptation of the recommendations to the target context of use. The guideline covered all important aspects of the indications, dosing, and administration of packed red cells, platelets, and fresh frozen plasma. It also included transfusion in special situations, e.g., chronic hemolytic anemia and aplastic anemia, management of massive blood loss, malignancies, surgery, recommendations for safe transfusion practices, and recommendations for modifications of cellular blood components. The final version of the adapted clinical practice guideline (CPG) has been made after a thorough review by an external review panel and was guided by their official recommendations and modifications. A set of implementation tools included algorithms, tables, and flow charts to aid decision-making in practice. This adapted guideline serves as a tool for safe transfusion practices in different pediatric age groups.

Just give the contrast? Appraisal of guidelines on intravenous iodinated contrast media use in patients with kidney disease

OBJECTIVE

To appraise the quality of guidelines on intravenous iodinated contrast media (ICM) use in patients with kidney disease, and to compare the recommendations among them.

METHODS

We searched four literature databases, eight guideline libraries, and ten homepages of radiological societies to identify English and Chinese guidelines on intravenous ICM use in patients with kidney disease published between January 2018 and June 2023. The quality of the guidelines was assessed with the Scientific, Transparent, and Applicable Rankings (STAR) tool.

RESULTS

Ten guidelines were included, with a median STAR score of 46.0 (range 28.5-61.5). The guidelines performed well in "Recommendations" domain (31/40, 78%), while poor in "Registry" (0/20, 0%) and "Protocol" domains (0/20, 0%). Nine guidelines recommended estimated glomerular filtration rate (eGFR) < 30 mL/min/1.73 m2 as the cutoff for referring patients to discuss the risk-benefit balance of ICM administration. Three guidelines further suggested that patients with an eGFR < 45 mL/min/1.73 m2 and high-risk factors also need referring. Variable recommendations were seen in the acceptable time interval between renal function test and ICM administration, and that between scan and repeated scan. Nine guidelines recommended to use iso-osmolar or low-osmolar ICM, while no consensus has been reached for the dosing of ICM. Nine guidelines supported hydration after ICM use, but their protocols varied. Drugs or blood purification therapy were not recommended as preventative means.

CONCLUSION

Guidelines on intravenous ICM use in patients with kidney disease have heterogeneous quality. The scientific societies may consider joint statements on controversial recommendations for variable timing and protocols.

CRITICAL RELEVANCE STATEMENT

The heterogeneous quality of guidelines, and their controversial recommendations, leave gaps in workflow timing, dosing, and post-administration hydration protocols of contrast-enhanced CT scans for patients with kidney diseases, calling for more evidence to establish a safer and more practicable workflow.

KEY POINTS

• Guidelines concerning iodinated contrast media use in kidney disease patients vary. • Controversy remains in workflow timing, contrast dosing, and post-administration hydration protocols. • Investigations are encouraged to establish a safer iodinated contrast media use workflow.

The reporting checklist for Chinese patent medicine guidelines: RIGHT for CPM

Existing reporting checklists lack the necessary level of detail and comprehensiveness to be used in guidelines on Chinese patent medicines (CPM). This study aims to develop a reporting guidance for CPM guidelines based on the Reporting Items of Practice Guidelines in Healthcare (RIGHT) statement. We extracted information from CPM guidelines, existing reporting standards for traditional Chinese medicine (TCM), and the RIGHT statement and its extensions to form the initial pool of reporting items for CPM guidelines. Seventeen experts from diverse disciplines participated in two rounds of Delphi process to refine and clarify the items. Finally, 18 authoritative consultants in the field of TCM and reporting guidelines reviewed and approved the RIGHT for CPM checklist. We added 16 new items and modified two items of the original RIGHT statement to form the RIGHT for CPM checklist, which contains 51 items grouped into seven sections and 23 topics. The new and revised items are distributed across four sections (Basic information, Background, Evidence, and Recommendations) and seven topics: title/subtitle (one new and one revised item), Registration information (one new item), Brief description of the health problem (four new items), Guideline development groups (one revised item), Health care questions (two new items), Recommendations (two new items), and Rationale/explanation for recommendations (six new items). The RIGHT for CPM checklist is committed to providing users with guidance for detailed, comprehensive and transparent reporting, and help practitioners better understand and implement CPM guidelines.

Development, Evaluation, and impLemenTation for guideline adaptation: a quality improvement protocol for the DELTA study in global health practice

BACKGROUND

Guideline adaptation is an emerging field to provide more appropriate recommendations for local clinical practice quality and to promote global health equity. However, its utilization status, adaptation procedures, and related materials remain to be studied.

METHODS

This study developed a quality improvement protocol for a study as the Development, Evaluation, and impLemenTation for guideline Adaptation (DELTA) study. Current adapted clinical practice guidelines (CPGs) will be systematically searched. Their characteristics, utilization status, and adaptation procedures will be extracted, compared, and analyzed. Whether these adapted CPGs rigorously followed the instruments and steps of adaptation frameworks will also be appraised. In addition, the advantages and limitations of current adaptation methods and their suitable application situations will be analyzed. In addition, future perspectives as DELTA series and DELTA system, aiming for comprehensively evaluating current needs for guideline adaptation and developing a unified framework and related materials were proposed to improve the acceptability, applicability, and implementation of guideline adaptation in clinical practice. The DELTA series are divided into four phases: phase I in analyzing status, characteristics, and procedures and completeness of adapted CPGs; phase II in analyzing differences, heterogeneity, and implementation between adapted and original CPGs; and phase III in collecting, analyzing, and comparing all available adaptation materials. With these research bases, an international working group will be established in phase IV and will develop unified guideline adaptation materials after Delphi consensus, including adaptation frameworks, appraisal tools and checklists, registries, and databases.

DISCUSSION

Guideline adaptation has been advanced as an efficient way to guide local clinical practice. However, it still faces several major challenges. The proposed DELTA study, series, and system will further contribute to this emerging topic.

TRIAL REGISTRATION

 This study has been registered by the PROSPERO international database. https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=400170 .

[Concepts to support dynamic updating processes of guidelines and their practical implementation-Systematic literature review]

BACKGROUND

Clinical practice guidelines (CPG), which are crucial for evidence-based healthcare, should be kept up to date, especially on topics where emerging evidence could modify one of the recommendations with implications for the healthcare service; however, an updating process, which is practicable for guideline developers as well as users represents a challenge.

OBJECTIVE

This article provides an overview of the currently discussed methodological approaches for the dynamic updating of guidelines and systematic reviews.

MATERIAL AND METHODS

As part of a scoping review, a literature search was conducted in the databases MEDLINE, EMBASE (via Ovid), Scopus, Epistemonikos, medRxiv, as well as in study and guideline registers. Concepts on the dynamic updating of guidelines and systematic reviews or dynamically updated guidelines and systematic reviews or their protocols published in English or German were included.

RESULTS

The publications included most frequently described the following main processes that must be adapted in dynamic updating processes 1) the establishment of continuously working guideline groups, 2) networking between guidelines, 3) the formulation and application of prioritization criteria, 4) the adaptation of the systematic literature search and 5) the use of software tools for increased efficiency and digitalization of the guidelines.

CONCLUSION

The transformation to living guidelines requires a change in the needs for temporal, personnel and structural resources. The digitalization of guidelines and the use of software to increase efficiency are necessary instruments, but alone do not guarantee the realization of living guidelines. A process in which dissemination and implementation must also be integrated is necessary. Standardized best practice recommendations on the updating process are still lacking.

Development of the Scientific, Transparent and Applicable Rankings (STAR) tool for clinical practice guidelines

BACKGROUND

This study aimed to develop a comprehensive instrument for evaluating and ranking clinical practice guidelines, named Scientific, Transparent and Applicable Rankings tool (STAR), and test its reliability, validity, and usability.

METHODS

This study set up a multidisciplinary working group including guideline methodologists, statisticians, journal editors, clinicians, and other experts. Scoping review, Delphi methods, and hierarchical analysis were used to develop the STAR tool. We evaluated the instrument's intrinsic and interrater reliability, content and criterion validity, and usability.

RESULTS

STAR contained 39 items grouped into 11 domains. The mean intrinsic reliability of the domains, indicated by Cronbach's α coefficient, was 0.588 (95% confidence interval [CI]: 0.414, 0.762). Interrater reliability as assessed with Cohen's kappa coefficient was 0.774 (95% CI: 0.740, 0.807) for methodological evaluators and 0.618 (95% CI: 0.587, 0.648) for clinical evaluators. The overall content validity index was 0.905. Pearson's r correlation for criterion validity was 0.885 (95% CI: 0.804, 0.932). The mean usability score of the items was 4.6 and the median time spent to evaluate each guideline was 20 min.

CONCLUSION

The instrument performed well in terms of reliability, validity, and efficiency, and can be used for comprehensively evaluating and ranking guidelines.

Development of an international glossary for clinical guidelines collaboration

OBJECTIVES

Clinical practice guidelines (CPGs) are often created through collaboration among organizations. The use of inconsistent terminology may cause poor communication and delays. This study aimed to develop a glossary of terms related to collaboration in guideline development.

STUDY DESIGN AND SETTING

A literature review of collaborative guidelines was performed to develop an initial list of terms related to guideline collaboration. The list of terms was presented to the members of the Guideline International Network Guidelines Collaboration Working Group, who provided presumptive definitions for each term and proposed additional terms to be included. The revised list was subsequently reviewed by an international, multidisciplinary panel of expert stakeholders. Recommendations received during this pre-Delphi review were implemented to augment an initial draft glossary. The glossary was then critically evaluated and refined through two rounds of Delphi surveys and a virtual consensus meeting with all panel members as Delphi participants.

RESULTS

Forty-nine experts participated in the pre-Delphi survey, and 44 participated in the two-round Delphi process. Consensus was reached for 37 terms and definitions.

CONCLUSION

Uptake and utilization of this guideline collaboration glossary by key organizations and stakeholder groups may facilitate collaboration among guideline-producing organizations by improving communication, minimizing conflicts, and increasing guideline development efficiency.

Developing TCM clinical practice guidelines: A comparison between traditional Chinese medicine and western medicine

Clinical practice guidelines in Traditional Chinese Medicine (CPG-TCM) is the recommendation that aims to provide the best service to users by identifying and summarizing the rules of prevention, diagnosis, treatment, rehabilitation, and regression of diseases based on systematic reviews of evidence and balancing the advantages and disadvantages of different interventions for clinical questions of Traditional Chinese Medicine. Over the past 30 years, the concept and methods of evidence-based medicine have had a significant impact on the development of clinical practice guidelines in Western Medicine (CPG-WM), and their standardized guideline development methods are being adapted and used in the development of CPG-TCM. However, the quality of CPG-TCM is far from CPG-WM, and the methodological system for developing CPG-TCM is not yet fully established. Therefore, this study aims to explore the methodological differences between CPG-TCM and CPG-WM and to inform the development of high-quality CPGTCM.

Clinical practice guidelines for neonatal hypoxic-ischemic encephalopathy: A systematic review using the appraisal of guidelines for research and evaluation (AGREE) II instrument

Background and Objective

To systematically review, critically appraise the quality of recent clinical practice guidelines (CPGs) for neonatal hypoxic ischemic encephalopathy (HIE), and map their recommendations.

Data Sources

CPG databases (GIN, ECRI, NICE, SIGN, DynaMed), Bibliographic databases (PubMed, Embase, CINAHL), and related specialized professional societies (e.g., AAP, CPS, BAPM, RCPCH, and SNS).

Study Selection

Original de-novo developed evidence-based CPGs for HIE, group authorship, Arabic or English languages, and international or national scope. The systematic review was drafted according to the Preferred Reporting Items for Systematic reviews and Meta-Analyses (PRISMA) statement and Johnston et al methodological guide.

Data Extraction

Quality assessment of the included HIE CPGs by the Appraisal of Guidelines for REsearch & Evaluation II (AGREE II) Instrument and report their characteristics, AGREE II ratings, and recommendations.

Data Synthesis

Our search retrieved 2,489 citations, of which two recent HIE CPGs were eligible and appraised: Canadian Paediatric Society (CPS) and Queensland Maternity and Neonatal Services (QMN). The overall assessment of the QMN CPG was superior (83%). Domain 1 (Scope & Purpose) scored (47%, 63%), Domain 2 (Stakeholder Involvement) (72%, 39%), Domain 3 (Rigour of Development) (48%, 43%), Domain 4 (Clarity & Presentation) (100%, 96%), Domain 5 (Applicability) (59%, 9%), and Domain 6 (Editorial Independence) (67%, 17%) for the QMN and CPS CPGs respectively. All appraisers recommended the QMN CPG for use in practice.

Conclusion

The methodological quality of the QMN CPG was superior with the relevant recommendations for its use in neonatal practice.

Limitations

limited to Arabic and English languages.

Systematic Review Registration

https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=258291, identifier: CRD42021258291.

Promoting the quality and transparency of health research in China

BACKGROUND AND OBJECTIVES

To review the efforts and progress in promoting quality and transparency of health research in China and to discuss how to improve.

METHODS

We focused on three different types of health research: clinical trials, systematic reviews, and clinical practice guidelines, and summarized China's progress from their registration, implementation, and reporting stages.

RESULTS

In the last 3 decades, China's major works include the following: 1) For registration, the trials and CPGs registries have been set up, and released policies to mandate registration and submission of protocols for trials. 2) For implementation, multiple clinical research and EBM centers have been established. The ResMan platform for data management has been created and required researchers to share results data. 3) For reporting, the Chinese EQUATOR Center has been set up. Translations and extensions of the CONSORT, PRISMA, and RIGHT have been published. 4) For traditional Chinese medicine (TCM), specific guidelines for the registration and reporting of TCM research have been developed.

CONCLUSION

China has made progress in promoting research quality and transparency, especially in research registration and reporting. Nevertheless, more can be done in data management and sharing for research implementation, and good publication practices in TCM.

Publishing clinical prActice GuidelinEs (PAGE): Recommendations from editors and reviewers

Transparency Ecosystem for Research and Journals in Medicine (TERM) working group summarized the essential recommendations that should be considered to review and publish a high-quality guideline. These recommendations from editors and reviewers included 10 components of essential requirements: systematic review of existing relevant guidelines, guideline registration, guideline protocol, stakeholders, conflicts of interest, clinical questions, systematic reviews, recommendation consensus, guideline reporting and external review. TERM working group abbreviates them as PAGE (essential requirements for Publishing clinical prActice GuidelinEs), and recommends guideline authors, editors, and peer reviewers to use them for high-quality guidelines.

Core Outcome Sets in Child Health: A Systematic Review

IMPORTANCE

Developing core outcome sets is essential to ensure that results of clinical trials are comparable and useful. A number of core outcome sets in pediatrics have been published, but a comprehensive in-depth understanding of core outcome sets in this field is lacking.

OBJECTIVE

To systematically identify core outcome sets in child health, collate the diseases to which core outcome sets have been applied, describe the methods used for development and stakeholder participation, and evaluate the methodological quality of existing core outcome sets.

EVIDENCE REVIEW

MEDLINE, SCOPUS, Cochrane Library, and CINAHL were searched using relevant search terms, such as clinical trials, core outcome, and children, along with relevant websites, such as Core Outcome Measures in Effectiveness Trials (COMET). Four researchers worked in teams of 2, performed literature screening and data extraction, and evaluated the methodological quality of core outcome sets using the Core Outcome Set-Standards for Development (COS-STAD).

FINDINGS

A total of 77 pediatric core outcome sets were identified, mainly developed by organizations or researchers in Europe, North America, and Australia and mostly from the UK (22 [29%]) and the US (22 [29%]). A total of 77 conditions were addressed; the most frequent International Classification of Diseases, 11th Revision category was diseases of the digestive system (14 [18%]). Most of the outcomes in pediatric core outcome sets were unordered (34 [44%]) or presented in custom classifications (29 [38%]). Core outcome sets used 1 or more of 8 development methods; the most frequent combination of methods was systematic review/literature review/scoping review, together with the Delphi approach and consensus for decision-making (10 [14%]). Among the 6 main types of stakeholders, clinical experts were the most frequently involved (74 [100%]), while industry representatives were rarely involved (4 [5%]). Only 6 core outcome sets (8%) met the 12 criteria of COS-STAD.

CONCLUSIONS AND RELEVANCE

Future quality of pediatric core outcome sets should be improved based on the standards proposed by the COMET initiative, while core outcome sets methodology and reporting standards should be extended to pediatric populations to help improve the quality of core outcome sets in child health. In addition, the COMET outcome taxonomy should also add items applicable to children.

Publishing clinical prActice GuidelinEs (PAGE): Recommendations from editors and reviewers

Transparency Ecosystem for Research and Journals in Medicine (TERM) Working Group summarized the essential recommendations that should be considered to review and publish a high-quality guideline. These recommendations from editors and reviewers included the ten components of essential requirements: systematic review of existing relevant guidelines, guideline registration, guideline protocol, stakeholders, conflicts of interest, clinical questions, systematic reviews, recommendation consensus, guideline reporting, and external review. TERM Working Group abbreviates them as PAGE (essential requirements for Publishing clinical prActice GuidelinEs), recommends guideline authors, editors, and peer reviewers use them for high-quality guidelines.

AGREE-S: AGREE II extension for surgical interventions - United European Gastroenterology and European Association for Endoscopic Surgery methodological guide

BACKGROUND

The Appraisal of Guidelines for Research and Evaluation (AGREE) II instrument has been developed to inform the methodology, reporting and appraisal of clinical practice guidelines. Evidence suggests that the quality of surgical guidelines can be improved, and the structure and content of AGREE II can be modified to help enhance the quality of guidelines of surgical interventions.

OBJECTIVE

To develop an extension of AGREE II specifically designed for guidelines of surgical interventions.

METHODS

In the tripartite Guideline Assessment Project (GAP) funded by United European Gastroenterology and the European Association for Endoscopic Surgery, (i) we assessed the quality of surgical guidelines and we identified factors associated with higher quality (GAP I); (ii) we applied correlation analysis, factor analysis and the item response theory to inform an adaption of AGREE II for the purposes of surgical guidelines (GAP II); and (iii) we developed an AGREE II extension for surgical interventions, informed by the results of GAP I, GAP II, and a Delphi process of stakeholders, including representation from interventional and surgical disciplines; the Guideline International Network (GIN); the Grading of Recommendations Assessment, Development and Evaluation (GRADE) Working Group; the Enhancing the QUAlity and Transparency Of health Research (EQUATOR) initiative; and representation of surgical journal editors and patient/public.

RESULTS

We developed AGREE-S, an AGREE II extension for surgical interventions, which comprises 24 items organized in 6 domains; Scope and purpose, Stakeholders, Evidence synthesis, Development of recommendations, Editorial independence, and Implementation and update. The panel of stakeholders proposed 3 additional items: development of a guideline protocol, consideration of practice variability and surgical/interventional expertise in different settings, and specification of infrastructures required to implement the recommendations. Three of the existing items were amended, 7 items were rearranged among the domains, and one item was removed. The domain Rigour of Development was divided into domains on Evidence Synthesis and Development of Recommendations. The new domain Development of Recommendations incorporates items from the original AGREE II domain Clarity of Presentation.

CONCLUSION

AGREE-S is an evidence-based and stakeholder-informed extension of the AGREE II instrument, that can be used as a guide for the development and adaption of guidelines on surgical interventions.

Methodology and experiences of rapid advice guideline development for children with COVID-19: responding to the COVID-19 outbreak quickly and efficiently

Background

Rapid Advice Guidelines (RAG) provide decision makers with guidance to respond to public health emergencies by developing evidence-based recommendations in a short period of time with a scientific and standardized approach. However, the experience from the development process of a RAG has so far not been systematically summarized. Therefore, our working group will take the experience of the development of the RAG for children with COVID-19 as an example to systematically explore the methodology, advantages, and challenges in the development of the RAG. We shall propose suggestions and reflections for future research, in order to provide a more detailed reference for future development of RAGs.

Result

The development of the RAG by a group of 67 researchers from 11 countries took 50 days from the official commencement of the work (January 28, 2020) to submission (March 17, 2020). A total of 21 meetings were held with a total duration of 48 h (average 2.3 h per meeting) and an average of 16.5 participants attending. Only two of the ten recommendations were fully supported by direct evidence for COVID-19, three recommendations were supported by indirect evidence only, and the proportion of COVID-19 studies among the body of evidence in the remaining five recommendations ranged between 10 and 83%. Six of the ten recommendations used COVID-19 preprints as evidence support, and up to 50% of the studies with direct evidence on COVID-19 were preprints.

Conclusions

In order to respond to public health emergencies, the development of RAG also requires a clear and transparent formulation process, usually using a large amount of indirect and non-peer-reviewed evidence to support the formation of recommendations. Strict following of the WHO RAG handbook does not only enhance the transparency and clarity of the guideline, but also can speed up the guideline development process, thereby saving time and labor costs.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12874-022-01545-5.

Developing the RIGHT extension statement for practice guideline protocols: the RIGHT-P statement protocol

Background: A protocol for a practice guideline can facilitate the guideline development process, ensure its transparency, and improve the quality of the guidelines. However, there are currently no reporting guideline for guideline protocols. Methods: We intend to develop an extension of the Reporting Items for Practice Guidelines in HealThcare (RIGHT) statement for guideline protocols (RIGHT-P). We will follow the toolkit for developing a reporting guideline developed by the Enhancing the QUAlity and Transparency Of health Research (EQUATOR) network. We will form a multidisciplinary international team of experts. The development of RIGHT-P will be conducted in 12 steps grouped in three stages over a two-year period. Results: The results of RIGHT-P statement will be presented in an article to be published later. Conclusion: This report describes the process of RIGHT-P statement development. We believe RIGHT-P will help guideline developers improve the reporting of guideline protocols and indirectly improve their quality and the quality of guidelines. Registration: We registered the protocol on the EQUATOR network.

Quality assessment of clinical practice guidelines for neonatal sepsis using the Appraisal of Guidelines for Research and Evaluation (AGREE) II Instrument: A systematic review of neonatal guidelines

BACKGROUND AND OBJECTIVE

Neonatal sepsis (NS) continues to be a critical healthcare priority for the coming decades worldwide. The aim of this study was to critically appraise the quality of recent clinical practice guidelines (CPGs) for neonatal sepsis and to summarize and compare their recommendations.

METHODS

This study involves a systematic review of CPGs. We identified clinical questions and eligibility criteria and searched and screened for CPGs using bibliographic and CPG databases and professional societies. Each included CPG was assessed by four independent appraisers using the Appraisal of Guidelines for REsearch & Evaluation II (AGREE II) instrument. We summarized the recommendations in a comparison practical table. The systematic review was drafted according to the Preferred Reporting Items for Systematic reviews and Meta-Analyses (PRISMA) statement. Its protocol was registered in the PROSPERO International Prospective Register of Systematic Reviews (ID: CRD42021258732).

RESULTS

Our search retrieved 4,432 citations; of which five CPGs were eligible and appraised: American Academy of Pediatrics (AAP 2018) (35 and 34 weeks); Canadian Pediatric Society (CPS 2017); National Institute for Health and Care Excellence (NICE 2021); and Queensland Maternity and Neonatal Services (QH 2020). Among these, the overall assessment of two evidence-based CPGs scored > 70% (NICE and QH), which was consistent with their higher scores in the six domains of the AGREE II instrument. In domain 3 (rigor of development), NICE and QH scored 99 and 60%, respectively. In domain 5 (applicability), they scored 96 and 74%, respectively, and in domain 6 (editorial independence), they scored 90 and 71%, respectively.

CONCLUSION

The methodological quality of the NICE CPG was superior followed by the QH CPG with relevant recommendations for use in practice.

SYSTEMATIC REVIEW REGISTRATION

https://www.crd.york.ac.uk/prospero/display_record.php?ID=CRD42021258732, PROSPERO (CRD42021258732).

Guideline registries and libraries: a mixed-methods approach identified issues to be addressed with content: Guideline registries and libraries must address the tension between comprehensiveness, quality assurance and ease of use

OBJECTIVE

To establish what GIN guideline community members see as the desirable features of a guidelines library and registry of guidelines in development Study Design and Setting: An explorative mixed-methods study was undertaken, including scoping activity and semi-structured interviews with guideline developers and endorsers from nine member organisations of the Guidelines International Network.

RESULTS

A small number of desirable features of a guideline library were identified: comprehensiveness; single source of information to avoid searching multiple sites; inclusion of related materials; being up to date; searchability and ease of use. No existing library of guidelines was considered to have all of these features. A number of issues arose out of the desire to have a comprehensive library of guidelines, including inclusion of 'high quality guidelines' and limiting the scope to include only national guidelines. For registries of guidelines in development, the data set should be limited to avoid placing undue burden on those entering information.

CONCLUSION

Our findings identify ongoing issues for the guideline community, including the tension between comprehensiveness and ease of use, which can result in limited uptake, reporting of guideline quality and the need for clarity on the purpose of any library or registry.

Clinical Epidemiology in China series. Paper 4: The reporting and methodological quality of Chinese clinical practice guidelines published between 2014 and 2018: A systematic review

OBJECTIVE

This study aimed to systematically review the methodological and reporting quality of clinical practice guidelines (CPGs) developed in China and published in medical journals between 2014 and 2018.

STUDY DESIGN AND SETTING

We conducted a comprehensive search in multiple databases: MEDLINE (via PubMed), Embase, CBM (China Biology Medicine), CNKI (China National Knowledge Infrastructure) and Wanfang Data. We included all clinical practice guidelines developed in China between 2014 and 2018. The AGREE II tool and the RIGHT checklist were used to appraise the methodological quality and reporting quality of the included guidelines, respectively.

RESULTS

We identified 17,188 records, and included finally 573 CPGs. Most (n=507, 88.5%) were published in Chinese, and 508 (88.7%) were about Western medicine. Only 62 (10.8%) of the guidelines used the GRADE approach. The mean overall score of methodological quality over all guidelines was 19.4%, and the mean scores for the AGREE II domains were 28.6% (Scope and purpose), 17.0% (Stakeholder involvement), 11.7% (Rigor of development), 32.2% (Clarity of presentation), 14.2% (Applicability) and 12.8% (Editorial independence). The mean overall score for reporting quality over all guidelines was 30.2%, with the following mean scores for each RIGHT domain: 55.6% (Basic information), 43.8% (Background), 14.5% (Evidence), 29.2% (Recommendations), 10.7% (Review and quality assurance), 12.6% (Funding and declaration of interest) and 8.4% (Other information). Subgroup analyses found that both the methodological and reporting quality were generally higher among CPGs that used evidence grading systems or reported receiving funding.

CONCLUSION

Both the methodological quality and the reporting quality of CPGs developed in China have improved over time, but are still below the international average.

Analysis of COVID-19 Guideline Quality and Change of Recommendations: A Systematic Review

Background

Hundreds of coronavirus disease 2019 (COVID-19) clinical practice guidelines (CPGs) and expert consensus statements have been developed and published since the outbreak of the epidemic. However, these CPGs are of widely variable quality. So, this review is aimed at systematically evaluating the methodological and reporting qualities of COVID-19 CPGs, exploring factors that may influence their quality, and analyzing the change of recommendations in CPGs with evidence published.

Methods

We searched five electronic databases and five websites from 1 January to 31 December 2020 to retrieve all COVID-19 CPGs. The assessment of the methodological and reporting qualities of CPGs was performed using the AGREE II instrument and RIGHT checklist. Recommendations and evidence used to make recommendations in the CPGs regarding some treatments for COVID-19 (remdesivir, glucocorticoids, hydroxychloroquine/chloroquine, interferon, and lopinavir-ritonavir) were also systematically assessed. And the statistical inference was performed to identify factors associated with the quality of CPGs.

Results

We included a total of 92 COVID-19 CPGs developed by 19 countries. Overall, the RIGHT checklist reporting rate of COVID-19 CPGs was 33.0%, and the AGREE II domain score was 30.4%. The overall methodological and reporting qualities of COVID-19 CPGs gradually improved during the year 2020. Factors associated with high methodological and reporting qualities included the evidence-based development process, management of conflicts of interest, and use of established rating systems to assess the quality of evidence and strength of recommendations. The recommendations of only seven (7.6%) CPGs were informed by a systematic review of evidence, and these seven CPGs have relatively high methodological and reporting qualities, in which six of them fully meet the Institute of Medicine (IOM) criteria of guidelines. Besides, a rapid advice CPG developed by the World Health Organization (WHO) of the seven CPGs got the highest overall scores in methodological (72.8%) and reporting qualities (83.8%). Many CPGs covered the same clinical questions (it refers to the clinical questions on the effectiveness of treatments of remdesivir, glucocorticoids, hydroxychloroquine/chloroquine, interferon, and lopinavir-ritonavir in COVID-19 patients) and were published by different countries or organizations. Although randomized controlled trials and systematic reviews on the effectiveness of treatments of remdesivir, glucocorticoids, hydroxychloroquine/chloroquine, interferon, and lopinavir-ritonavir for patients with COVID-19 have been published, the recommendations on those treatments still varied greatly across COVID-19 CPGs published in different countries or regions, which may suggest that the CPGs do not make sufficient use of the latest evidence.

Conclusions

Both the methodological and reporting qualities of COVID-19 CPGs increased over time, but there is still room for further improvement. The lack of effective use of available evidence and management of conflicts of interest were the main reasons for the low quality of the CPGs. The use of formal rating systems for the quality of evidence and strength of recommendations may help to improve the quality of CPGs in the context of the COVID-19 pandemic. During the pandemic, we suggest developing a living guideline of which recommendations are supported by a systematic review for it can facilitate the timely translation of the latest research findings to clinical practice. We also suggest that CPG developers should register the guidelines in a registration platform at the beginning for it can reduce duplication development of guidelines on the same clinical question, increase the transparency of the development process, and promote cooperation among guideline developers all over the world. Since the International Practice Guideline Registry Platform has been created, developers could register guidelines prospectively and internationally on this platform.