Assessment of the quality and content of national and international guidelines on hypertensive disorders of pregnancy using the AGREE II instrument

Quality and Content Concordance of International Clinical Guidelines on Hypertensive Disorders of Pregnancy Using the AGREE II Instrument: An Updated Systematic Review

Utilization of high-quality clinical practice guidelines has the potential to positively impact health outcomes. This study aimed to assess the quality and content concordance of national and international recommendations on hypertensive disorders of pregnancy (HDPs). Searches were conducted of the MEDLINE database and reference lists generated from national and international agencies. Covidence software was used for the management of the systematic review process, the Appraisal of Guidelines for Research and Evaluation II (AGREE II) tool was used to assess guidelines for quality, and three reviewers independently screened records. The research team identified and screened a total of 399 records of which 10 were deemed high quality. Guidelines were assessed and compared regarding the treatment, prevention, and categorization of disorders. The quality of guidelines varied across different domains, with significant variation in domain scores even within individual guidelines. Not all recommendations showed a high level of methodologic rigor, and the highest-rated guidelines were from the American Heart Association, the World Health Organization, and South Africa national guidelines. Classification of hypertension differed among the guidelines, particularly in defining chronic hypertension, severe hypertension, and preeclampsia. Prevention modalities varied across guidelines, with recommendations for aspirin, calcium supplementation, and against the use of certain approaches. Treatment modalities highlighted the importance of delivery as the definitive way to terminate hypertensive disorders of pregnancy, with other management strategies provided for symptom control. The variability in guidelines and consensus statements across different contexts may reflect regional differences in healthcare practices, available resources, and research evidence. There is potential to harmonize guidelines for HDP globally while considering the unique needs of individual countries. Where guidelines may be synthesized and condensed into an accessible format, doing so could improve their use in clinical decision-making.

Lessons for and from the COVID-19 pandemic response - An appraisal of guidance for the public health management of Invasive Meningococcal Disease

BACKGROUND

COVID-19 has focussed public attention on the management of communicable disease like never before. Surveillance, contact tracing, and case management are recognised as key components of outbreak prevention. Development of guidance for COVID-19 has drawn from existing management of other communicable diseases, including Invasive Meningococcal Disease (IMD). IMD is a rare but severe outcome of Neisseria meningitidis infection that can be prevented through vaccination. Cases still occur sporadically, requiring ongoing surveillance and consistent management. To this end, national and international public health agencies have developed and published guidance for identification and management of IMD cases.

AIM

To assess national and international guidelines for the public health management of IMD, with a focus on the recommendations for identification and management of "close contacts" to IMD cases.

METHODS

Guidelines from six national and international public health agencies were assessed using a modified version of the Appraisal of Guidelines, Research and Evaluation (AGREE II) Instrument in four key domains: stakeholder involvement, developmental rigour, clarity, and applicability. A direct comparison of terminology and recommendations for identification and management of close contacts to IMD cases was also conducted.

RESULTS

Guidelines from Europe and the United Kingdom rated most highly using the AGREE II Instrument, both presenting a clear, critical assessment of the strength of the available evidence, and the risks, costs, and benefits behind recommendations for management of close contacts. Direct comparison of guidelines identified inconsistencies in the language defining close contacts to IMD cases.

CONCLUSION

Discrepancies between guidelines could be due to limited evidence concerning mechanisms behind disease transmission, along with the lack of a consistent process for development and review of guideline recommendations. COVID-19 management has demonstrated that international collaboration for development of public health guidance is possible, a practice that should be extended to management of other communicable diseases.

International clinical practice guidelines for gender minority/trans people: systematic review and quality assessment

OBJECTIVES

To identify and critically appraise published clinical practice guidelines (CPGs) regarding healthcare of gender minority/trans people.

DESIGN

Systematic review and quality appraisal using AGREE II (Appraisal of Guidelines for Research and Evaluation tool), including stakeholder domain prioritisation.

SETTING

Six databases and six CPG websites were searched, and international key opinion leaders approached.

PARTICIPANTS

CPGs relating to adults and/or children who are gender minority/trans with no exclusions due to comorbidities, except differences in sex development.

INTERVENTION

Any health-related intervention connected to the care of gender minority/trans people.

MAIN OUTCOME MEASURES

Number and quality of international CPGs addressing the health of gender minority/trans people, information on estimated changes in mortality or quality of life (QoL), consistency of recommended interventions across CPGs, and appraisal of key messages for patients.

RESULTS

Twelve international CPGs address gender minority/trans people's healthcare as complete (n=5), partial (n=4) or marginal (n=3) focus of guidance. The quality scores have a wide range and heterogeneity whichever AGREE II domain is prioritised. Five higher-quality CPGs focus on HIV and other blood-borne infections (overall assessment scores 69%-94%). Six lower-quality CPGs concern transition-specific interventions (overall assessment scores 11%-56%). None deal with primary care, mental health or longer-term medical issues. Sparse information on estimated changes in mortality and QoL is conflicting. Consistency between CPGs could not be examined due to unclear recommendations within the World Professional Association for Transgender Health Standards of Care Version 7 and a lack of overlap between other CPGs. None provide key messages for patients.

CONCLUSIONS

A paucity of high-quality guidance for gender minority/trans people exists, largely limited to HIV and transition, but not wider aspects of healthcare, mortality or QoL. Reference to AGREE II, use of systematic reviews, independent external review, stakeholder participation and patient facing material might improve future CPG quality.

PROSPERO REGISTRATION NUMBER

CRD42019154361.

Protocol of an interdisciplinary consensus project aiming to develop an AGREE II extension for guidelines in surgery

INTRODUCTION

Appraisal of Guidelines for Research and Evaluation (AGREE II) is an instrument that informs development, reporting and assessment of clinical practice guidelines. Previous research has demonstrated the need for improvement in methodological and reporting quality of clinical practice guidelines specifically in surgery. We aimed to develop an AGREE II extension document for application in surgical guidelines.

METHODS AND ANALYSIS

We have performed a structured literature review and assessment of guidelines in surgery using the AGREE II instrument. In exploratory analyses, we have identified factors associated with guideline quality. We have performed reliability and factor analyses to inform the development of an extension document. We will summarise this information and present it to a Delphi panel of stakeholders. We will perform iterative Delphi rounds and we will summarise the final results to develop the extension instrument in a dedicated consensus conference.

ETHICS AND DISSEMINATION

Funding bodies will not be involved in the development of the instrument. Research ethics committee and Health Research Authority approval was waived, since this is a professional staff study only and no duty of care lies with the National Health Service to any of the participants. Conflicts of interest, if any, will be addressed by reassigning functions or replacing participants with relevant conflicts. The results will be disseminated through publication in peer reviewed journals, the funders' websites, social media and direct contact with guideline development organisations and peer-reviewed journals that publish guidelines.

Melhoria da qualidade do cuidado à hipertensão gestacional em terapia intensiva

Objetivo: avaliar o efeito de um ciclo de melhoria da qualidade na implementação de práticas baseadas em evidências no tratamento de mulheres com doenças hipertensivas gestacionais admitidas em Unidade de Terapia Intensiva Materna (UTIM).Métodos: estudo quase-experimental, sem grupo de controle, realizado numa UTIM de um hospital universitário que seguiu as etapas de um ciclo de melhoria da qualidade. Avaliaram-se nove critérios de processo em todas as mulheres admitidas com diagnóstico de doenças hipertensivas gestacionais nos períodos anterior (n = 50) e posterior à intervenção (n = 50) em 2015. Estimou-se a conformidade com intervalo de confiança de 95 %, as não conformidades com gráficos de Pareto e a significância da melhoria com teste do valor Z unilateral (α = 5 %).Resultados: o nível de qualidade inicial foi alto em seis dos nove critérios (amplitude: 94-100 %), as práticas com menor adesão foram a “manutenção de sulfato de magnésio” (54 %), “solicitação de ultrassom fetal” (72 %) e “restrição hídrica intravenosa” (78 %). Houve melhoria absoluta em cinco dos nove critérios (amplitude: 2-16 %), que foi significativa para a solicitação de ultrassom fetal (melhoria absoluta: 16 %; p = 0,023) e para o total de critérios (4 %; p = 0,01).Conclusão: a intervenção de melhoria da qualidade proposta aumentou a adesão às recomendações baseadas em evidência para o tratamento de pacientes com doenças hipertensivas gestacionais admitidas em uma UTIM.

A novel method of rapid appraisal of clinical practice guidelines for children with enuresis

BACKGROUND

Enuresis (bedwetting) is a common but variably managed pediatric condition. Despite an abundance of published documents which provide recommendations for clinical evaluation and management of enuresis, no formal appraisal of their methodological quality has been undertaken.

OBJECTIVE

The objective of the study is to evaluate the quality of current pediatric guidelines for enuresis (bedwetting) using a novel method of appraisal.

STUDY DESIGN

A comprehensive gray literature search was undertaken to identify guideline documents that provided recommendations for management of enuresis in children and adolescents. The search strategy included guideline databases, targeted websites, Google search engines, and MEDLINE. Guideline documents included clinical practice guidelines, consensus documents, position statements, and other clinical review documents. Each document underwent basic appraisal by two independent assessors using the International Centre for Allied Health Evidence (iCAHE) Guideline Quality Checklist. Those documents which (1) had an iCAHE quality score of ≥10; (2) used a systematic search strategy; and (3) linked evidence to their recommendations underwent further detailed appraisal using the Appraisal of Guidelines for Research and Evaluation (AGREE) II instrument.

RESULTS

Eighteen documents were shortlisted for basic appraisal. The iCAHE highlighted a lack of information regarding underlying evidence and dates (mean score 36% and 41%, respectively). Only three documents met basic quality criteria and progressed to detailed appraisal using the AGREE II. These included guidelines produced by the Paediatric Society of New Zealand and National Clinical Guideline Centre and a position statement from the Canadian Paediatric Society. All three guidelines presented clear and unambiguous recommendations (mean score 80%). However, information regarding stakeholder involvement was lacking (mean score 50%).

CONCLUSIONS

Several guidelines exist for the evaluation and management of children with enuresis, but many lack appropriate methodological quality standards. The guideline produced by the National Clinical Guideline Centre achieved the highest quality rating and is recommended for future adaptation and implementation in relevant clinical settings.

Appraisal of clinical practice guidelines for the management of attention deficit hyperactivity disorder (ADHD) using the AGREE II Instrument: A systematic review

BACKGROUND AND OBJECTIVE

High quality evidence-based clinical practice guidelines (CPGs) have a major impact on the appropriate diagnosis and management and positive outcomes. The evidence-based healthcare for patients with attention deficit hyperactive disorder (ADHD) is challenging. The objective of this study was to appraise the quality of published CPGs for ADHD.

METHODS

A systematic review was conducted for ADHD CPGs using CPG databases, DynaMed, PubMed, and Google Scholar. The quality of each included CPG was appraised by three independent appraisers using the Appraisal of Guidelines for Research & Evaluation II (AGREE II) instrument.

RESULTS

Six CPGs were critically reviewed. The AGREE II standardized domain scores revealed variation between the quality of these CPGs with the National Institute of Health and Care Excellence (NICE), University of Michigan Health System, and American Academy of Pediatrics CPGs as the top three. Overall, the recommendations for management of ADHD were similar in these CPGs.

CONCLUSIONS

Reporting of CPG development is often poorly documented. Guideline development groups should aim to follow the AGREE II criteria to improve the standards and quality of CPGs. The NICE CPG showed the best quality. Embedding the AGREE II appraisal of CPGs in the training and education of healthcare providers is recommended. The protocol for this study was published in PROSPERO (International prospective register of systematic reviews). Link: http://www.crd.york.ac.uk/PROSPERO/display_record.php?ID=CRD42017078712 and is additionally available from protocols.io. Link: https://dx.doi.org/10.17504/protocols.io.q27dyhn.

Quality assessment of clinical practice guidelines using the AGREE instrument in Japan: A time trend analysis

Background

Clinical practice guidelines (CPGs) are representative methods for promoting the standardization of healthcare and improvement of its quality. Few studies have investigated changes in the quality of CPGs published in a country over time. Our aim was to investigate changes in the quality of CPGs over time in the context of the available infrastructure for CPG development, public interest in healthcare quality, and healthcare providers’ responses to this interest.

Methods

All CPGs pertaining to evidence-based medicine (EBM) issued between 2000 and 2014 in Japan (n = 373) were evaluated using the Japanese version of the Appraisal of Guidelines for Research and Evaluation (AGREE) I. Additionally, time trends in quality were analyzed. Using a cut-off point based on the publication year of CPG development literature, the evaluated CPGs were classified into those published until 2008 (pre-2008) and those published since 2009 (post-2008). Subsequently, we compared these groups in terms of 1) first edition CPGs and its second editions, and 2) patients’ version of CPGs.

Results

Scores on all six domains of AGREE I improved each year. A comparison of the first- and second-edition of CPGs (n = 64) showed that scores on all domains improved significantly after revision. Significant improvement was observed in three domains (#2 stakeholder involvement, #3 rigor of development, and #4 clarity of presentation) in the pre-2008 group and in all domains in the post-2008 group. The comparison between the pre- and post-2008 groups in terms of CPGs for patients showed that the score increased in only one domain (#1 scope and purpose).

Conclusions

The number of published CPGs has been increasing and the quality of CPGs, as assessed using the AGREE I instrument, has been improving. These changes seem to be influenced by improvements in social infrastructure, such as the publication of CPG development procedures, availability of CPG preparation methodology training, and increase in CPG-related skills.

Appraising of the Clinical Practice Guidelines Quality in the Non-Pharmacological Management of Chemotherapy-Induced Febrile Neutropenia; A Review

Background:

Febrile neutropenia is a common and serious chemotherapy side effect, is associated with increased mortality, morbidity, and treatment expenditures. Several CPGs (Clinical practice guidelines) have been released for managing chemotherapy-induced febrile neutropenia. The aim of this study is Appraisal of the clinical practice Guidelines quality in the management of chemotherapy-induced febrile neutropenia.

Methods:

A review study with a systematic search of the present CPGs for the management of chemotherapy-induced febrile neutropenia. After screening the CPGs based on eligibility criteria, three CPGs were selected and 5 independent reviewers appraised them for methodological quality by using the AGREE II Instrument.

Results:

Three CPGs were included; all of them were evidence-based guidelines. The clarity of presentation domain scored the highest and the applicability domain has the lowest score among all domains of AGREE instrument and the rest of domains scored as descending respectively; Scope and purpose, stakeholder involvement, editorial independence, rigor of development. In general, the intra-class correlation coefficient (ICC) scores of all domains were very good according to the Landis and Koch’s scale, except the Applicability domain scored as substantial.

Conclusions:

This study showed the quality of appraised CPGs. Three domains of these CPGs based on the AGREE instrument scored less than other domains and were in relatively unfavorable status: applicability, rigor of development, editorial independence. Given the importance of these domains in guideline implementation, it is necessary to take actions for reducing these defects.

AGREEing on Guidelines for Nutrition Management of Adult Severe Burn Patients

BACKGROUND

Severe burns are associated with a plethora of profound metabolic, immunologic, and physiologic responses, demanding prompt and adequate management. The objective of the present study was to review, compare, and critically appraise medical nutrition therapy guidelines for adult patients with severe burns, and produce salient points for the future update of relevant guidelines.

METHODS

A total of 8 clinical practice guidelines developed by the American Burn Association (ABA), the European Burn Association (EBA), the European Society for Parenteral and Enteral Nutrition (ESPEN), the Midlands National Health Service, the Society for Critical Care Medicine (SCCM)/American Society for Parenteral and Enteral Nutrition (ASPEN), the Spanish Society of Intensive Care Medicine and Coronary Units and Spanish Society of Parenteral and Enteral Nutrition, the Indian Association for Parenteral and Enteral Nutrition (IAPEN), and the International Society for Burn Injury regarding medical nutrition therapy in burn patients was independently reviewed by a team of 4 multidisciplinary researchers using the Appraisal of Guidelines for Research & Evaluation (AGREE II) instrument.

RESULTS

From the appraised guidelines, the SCCM/ASPEN guidelines received the greatest scoring in the majority of AGREE domains compared with ABA, EBA, and IAPEN, which obtained the lowest scores. On the other hand, the ESPEN guidelines provided the majority of information concerning nutrition support and medical nutrition therapy.

CONCLUSION

Our study identified gaps in most nutrition guidelines and emphasized methodologic issues that could improve the quality of future guidelines concerning nutrition support among adult severe burn patients.

Economic assessment of the use of the sFlt-1/PlGF ratio test to predict preeclampsia in Germany

Background

The PRediction of short-term Outcome in preGNant wOmen with Suspected preeclampsIa Study (PROGNOSIS) demonstrated that a soluble fms-like tyrosine kinase 1/placental growth factor (sFlt-1/PlGF) ratio ≤ 38 ruled out the occurrence of preeclampsia in the next week with a negative predictive value of 99.3%; a ratio > 38 indicates an increased risk of developing preeclampsia in the next 4 weeks. We performed an assessment of the economic impact of the sFlt-1/PlGF ratio test for short-term prediction of preeclampsia in Germany.

Methods

We adapted a cost-effectiveness model, which had been developed to estimate the incremental value of adding the sFlt-1/PlGF ratio test with a cut-off ratio of 38 to standard diagnostic procedures for guiding the management of women with suspected preeclampsia in the UK. We used the adapted model to estimate the incremental value of the sFlt-1/PlGF ratio test (cut-off 38) for guiding the management of women with suspected preeclampsia from a German Diagnosis-Related Group (DRG) payer perspective. The economic model estimated costs associated with diagnosis and management of preeclampsia in women managed in either a ‘no-test’ scenario in which clinical decisions are based on standard diagnostic procedures alone, or a ‘test’ scenario in which the sFlt-1/PlGF test is used in addition to standard diagnostic procedures. Test characteristics and rates of hospitalization were derived from patient-level data from PROGNOSIS. The main outcome measure from the economic model was the total cost per patient.

Results

In the model adapted to the German DRG payer system, introduction of the sFlt-1/PlGF ratio test with a cut-off value of 38 could reduce the proportion of women hospitalized in Germany from 44.6 to 24.0%, resulting in an expected cost saving of €361 per patient.

Conclusions

The sFlt-1/PlGF ratio test is likely to reduce unnecessary hospitalization of women with a low risk of developing preeclampsia, and identify those at high risk to ensure appropriate management. Even within the restrictions of the DRG system in Germany, this results in substantial cost savings for women with suspected preeclampsia.

Electronic supplementary material

The online version of this article (10.1186/s12913-018-3406-1) contains supplementary material, which is available to authorized users.

The quality of guidelines in non-pharmacological prevention and management of chemotherapy-induced neuropathy: A review

Chemotherapy-induced peripheral neuropathy is a common adverse effect occurring in patients undergoing neurotoxic chemotherapy. However, there is no FDA-approved treatment option for it. Given the importance of clinical practice guidelines in this area, this study aimed to determine the methodological quality of extant CIPN guidelines. The study was done as part of the adaptation process of CIPN related CPGs at Isfahan University of Medical Sciences, Iran. A systematic search of published CPGs about chemotherapy-induced CIPN in which the AGREE II instrument was applied for appraising CPGs of CIPN was performed. In general, amongst all of the AGREE II Instrument’s domains in the evaluated CPGs, the clarity of presentation and stakeholder involvement domains took favorable scores; and other domains obtained unfavorable and relatively favorable scores. The quality of cancer therapy-induced neuropathy CPGs needs to be improved and designing high-quality CPGs must be considered.

Appraising the quality of clinical practice guidelines in traditional Chinese medicine using AGREE II instrument: A systematic review

OBJECTIVES

The aim of this study was to investigate the quality of clinical practice guidelines (CPGs) of traditional Chinese medicine (TCM) published in journals and books using AGREE II instrument for further enhancing TCM CPG development.

METHODS

A systematic search of relevant guideline websites and literature databases (including Chinese Guideline Clearinghouse, PubMed Wanfang Data Knowledge Service Platform, VIP Online Publishing Platform, China National Knowledge Infrastructure and SinoMed) was undertaken from inception to December, 2015 to identify and select CPGs related to TCM. Four independent reviewers assessed the eligible TCM CPGs using the Appraisal of Guidelines for Research and Evaluation (AGREE II) instrument. Their degree of agreement was evaluated by intra-class correlation coefficient (ICC).

RESULTS

From 2380 citations, 115 TCM CPGs were included. The mean scores for each AGREE II domain were as follows: (i) scope and purpose (mean±SD=41.1±19.6); (ii) stakeholder involvement (mean±SD=37.6±15.1); (iii) rigour of development (mean±SD=20.1±10.9); (iv) clarity and presentation (mean±SD=33.3±15.4); (v) applicability (mean±SD=10.5±4.5) and (vi) editorial independence (mean±SD=11.4±7.6). Only 10% (n=12) TCM CPGs were rated as "recommended". The ICC values for TCM CPGs appraisal using the AGREE II ranged from 0.76 to 0.93.

CONCLUSIONS

The quality of TCM CPGs has remained suboptimal according to AGREE II instrument evaluation. The use of AGREE II in the development process ensures that these considerations are incorporated, and more efforts must be made to improve the quality of TCM CPGs. Therefore, an evidence-based method should be used, and reporting the full texts according to AGREE II checklists for the further TCM CPGs development to ensure the translation of evidence into practice.

Pharmacological guidelines for schizophrenia: a systematic review and comparison of recommendations for the first episode

OBJECTIVES

Clinical practice guidelines (CPGs) support the translation of research evidence into clinical practice. Key health questions in CPGs ensure that recommendations will be applicable to the clinical context in which the guideline is used. The objectives of this study were to identify CPGs for the pharmacological treatment of first-episode schizophrenia; assess the quality of these guidelines using the Appraisal of Guidelines for Research and Evaluation II (AGREE II) instrument; and compare recommendations in relation to the key health questions that are relevant to the pharmacological treatment of first-episode schizophrenia.

METHODS

A multidisciplinary group identified key health questions that are relevant to the pharmacological treatment of first-episode schizophrenia. The MEDLINE and EMBASE databases, websites of professional organisations and international guideline repositories, were searched for CPGs that met the inclusion criteria. The AGREE II instrument was applied by three raters and data were extracted from the guidelines in relation to the key health questions.

RESULTS

In total, 3299 records were screened. 10 guidelines met the inclusion criteria. 3 guidelines scored well across all domains. Recommendations varied in specificity. Side effect concerns, rather than comparative efficacy benefits, were a key consideration in antipsychotic choice. Antipsychotic medication is recommended for maintenance of remission following a first episode of schizophrenia but there is a paucity of evidence to guide duration of treatment. Clozapine is universally regarded as the medication of choice for treatment resistance. There is less evidence to guide care for those who do not respond to clozapine.

CONCLUSIONS

An individual's experience of using antipsychotic medication for the initial treatment of first-episode schizophrenia may have implications for future engagement, adherence and outcome. While guidelines of good quality exist to assist in medicines optimisation, the evidence base required to answer key health questions relevant to the pharmacological treatment of first-episode schizophrenia is limited.