Methodological approaches for developing, reporting, and assessing evidence-based clinical practice guidelines: A systematic survey

A systematic review for the evidence of recommendations and guidelines in hybrid nuclear cardiovascular imaging

OBJECTIVES

This study aimed to evaluate the level of evidence of expert recommendations and guidelines for clinical indications and procedurals in hybrid nuclear cardiovascular imaging.

METHODS

From inception to August 2023, a PubMed literature analysis of the latest version of guidelines for clinical hybrid cardiovascular imaging techniques including SPECT(/CT), PET(/CT), and PET(/MRI) was performed in two categories: (1) for clinical indications for all-in primary diagnosis; subgroup in prognosis and therapy evaluation; and for (2) imaging procedurals. We surveyed to what degree these followed a standard methodology to collect the data and provide levels of evidence, and for which topic systematic review evidence was executed.

RESULTS

A total of 76 guidelines, published between 2013 and 2023, were included. The evidence of guidelines was based on systematic reviews in 7.9% of cases, non-systematic reviews in 47.4% of cases, a mix of systematic and non-systematic reviews in 19.7%, and 25% of guidelines did not report any evidence. Search strategy was reported in 36.8% of cases. Strengths of recommendation were clearly reported in 25% of guidelines. The notion of external review was explicitly reported in 23.7% of cases. Finally, the support of a methodologist was reported in 11.8% of the included guidelines.

CONCLUSION

The use of evidence procedures for developing for evidence-based cardiovascular hybrid imaging recommendations and guidelines is currently suboptimal, highlighting the need for more standardized methodological procedures.

"Going into the black box": a policy analysis of how the World Health Organization uses evidence to inform guideline recommendations

Background

The World Health Organization (WHO) plays a crucial role in producing global guidelines. In response to previous criticism, WHO has made efforts to enhance the process of guideline development, aiming for greater systematicity and transparency. However, it remains unclear whether these changes have effectively addressed these earlier critiques. This paper examines the policy process employed by WHO to inform guideline recommendations, using the update of the WHO Consolidated HIV Testing Services (HTS) Guidelines as a case study.

Methods

We observed guideline development meetings and conducted semi-structured interviews with key participants involved in the WHO guideline-making process. The interviews were recorded, transcribed, and analysed thematically. The data were deductively coded and analysed in line with the main themes from a published conceptual framework for context-based evidence-based decision making: introduction, interpretation, and application of evidence.

Results

The HTS guideline update was characterized by an inclusive and transparent process, involving a wide range of stakeholders. However, it was noted that not all stakeholders could participate equally due to gaps in training and preparation, particularly regarding the complexity of the Grading Recommendations Assessment Development Evaluation (GRADE) framework. We also found that WHO does not set priorities for which or how many guidelines should be produced each year and does not systematically evaluate the implementation of their recommendations. Our interviews revealed disconnects in the evidence synthesis process, starting from the development of systematic review protocols. While GRADE prioritizes evidence from RCTs, the Guideline Development Group (GDG) heavily emphasized "other" GRADE domains for which little or no evidence was available from the systematic reviews. As a result, expert judgements and opinions played a role in making recommendations. Finally, the role of donors and their presence as observers during GDG meetings was not clearly defined.

Conclusion

We found a need for a different approach to evidence synthesis due to the diverse range of global guidelines produced by WHO. Ideally, the evidence synthesis should be broad enough to capture evidence from different types of studies for all domains in the GRADE framework. Greater structure is required in formulating GDGs and clarifying the role of donors through the process.

A systematic review of clinical practice guidelines and recommendations for the management of pain, sedation, delirium and iatrogenic withdrawal syndrome in pediatric intensive care

Introduction

This systematic review aimed to evaluate the quality of clinical practice guidelines (CPGs) and recommendations for managing pain, sedation, delirium, and iatrogenic withdrawal syndrome in pediatric intensive care (PICU). The objectives included evaluating the quality of recommendations, synthesizing recommendations, harmonizing the strength of the recommendation (SoR) and the certainty of evidence (CoE), and assessing the relevance of supporting evidence.

Methods

A comprehensive search in four electronic databases (Medline, Embase.com, CINAHL and JBI EBP Database), 9 guideline repositories, and 13 professional societies was conducted to identify CPGs published from January 2010 to the end of May 2023 in any language. The quality of CPGs and recommendations was assessed using the AGREE II and AGREE-REX instruments. Thematic analysis was used to synthesize recommendations, and the GRADE SoR and CoE harmonization method was used to interpret the credibility of summary recommendations.

Results

A total of 18 CPGs and 170 recommendations were identified. Most CPGs were of medium-quality, and three were classified as high. A total of 30 summary recommendations were synthesized across each condition, focused on common management approaches. There was inconsistency in the SoRs and CoE for summary recommendations, those for assessment showed the highest consistency, the remaining were conditional, inconsistent, inconclusive, and lacked support from evidence.

Conclusion

This systematic review provides an overview of the quality of CPGs for these four conditions in the PICU. While three CPGs achieved high-quality ratings, the overall findings reveal gaps in the evidence base of recommendations, patient and family involvement, and resources for implementation. The findings highlight the need for more rigorous and evidence-based approaches in the development and reporting of CPGs to enhance their trustworthiness. Further research is necessary to enhance the quality of recommendations for this setting. The results of this review can provide a valuable foundation for future CPG development.

Systematic Review Registration

https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=274364, PROSPERO (CRD42021274364).

Adapting global evidence-based practice guidelines to the Egyptian healthcare context: the Egyptian Pediatric Clinical Practice Guidelines Committee (EPG) initiative

Background

In Egypt, academic organizations, professional societies, and research groups develop clinical practice guidelines (CPGs) in order to improve patient quality care and safety. Although important improvements have been made over the past years, many of these consensus-based guideline documents still lack the transparency and methodological rigor of international standards and methodologies recommended by reference evidence-based healthcare and guideline organizations like the Guidelines International Network.

Main body of the abstract

In the Egyptian Pediatric Clinical Practice Guidelines Committee (EPG), we have adopted one of the CPG formal adaptation methodological frameworks named the 'Adapted ADAPTE', relevant CPG resources (e.g., the Appraisal of Guidelines for Research and Evaluation or AGREE II Instrument), and involved key stakeholders including clinical and healthcare topic experts and guideline methodologists in producing 32 trustworthy national evidence-based CPGs and one protocol customized to the healthcare context and services provided for Egyptian children. An EPG online website was launched to make these CPGs available and accessible as CPG summaries for pediatricians and relevant healthcare providers.

Short conclusion

The lessons learned, enablers, challenges, and solutions relevant to Egyptian National Pediatric CPGs identified in this paper could be used to address and enrich the debate on pediatric high-quality CPGs, especially for countries of similar contexts and systems.

Supplementary Information

The online version contains supplementary material available at 10.1186/s42269-023-01059-0.