The systematic guideline review: method, rationale, and test on chronic heart failure

Recommendations for managing adults with chronic non-cancer pain in primary care: A systematic clinical guideline review

RATIONALE

Chronic non-cancer pain (CNCP) is a leading driver of disability. Primary care clinicians treat most patients with CNCP. Yet, they are often unable to identify appropriate pain treatments, mainly due to concerns about the safety and effectiveness of available medications. Clinical practice guidelines (CPGs) can be useful tools to guide primary care clinicians in selecting pain treatments based on the best available evidence.

OBJECTIVES

To undertake a systematic review of CPGs that address the management of adults with CNCP, regardless of underlying condition type, in primary care.

METHOD

We systematically reviewed and synthesised current CPGs for managing adults with CNCP in primary care (2013-2023). We followed a stepwise systematic process to synthesise key CPG recommendations: extracted and analysed each recommendation, synthesised by compiling similar recommendations using a thematic analysis approach, and assessed the strength of CPG recommendations to create a final, unified set of recommendations. We focused on identifying CPGs containing recommendations on the following topics: (a) opioid pain management, (b) non-opioid pharmacological pain management, (c) non-pharmacological pain management, and (d) patient-centred communication around pain management, prevention, and organisation of care.

RESULTS

We included 13 CPGs, 8 of which focused solely on use of opioids, emphasising the lack of long-term effectiveness and safety concerns, being mainly based on the expert consensus. As an exception, high-quality evidence recommended referring patients with suspected opioid use disorder to specialist addiction services for medication-assisted treatment. Recommendations for non-opioid pain management were often contradictory and based on the expert consensus. Patient-centred pain management combined with exercise-based interventions and psychological therapies are appropriate strategies for managing patients with CNCP.

CONCLUSION

Most CPGs focused on opioid management, with contradictory recommendations for non-opioid management based on low-quality evidence. Additional research is needed to strengthen the evidence for using non-opioid and non-pharmacological interventions to manage patients with CNCP.

Recommendations for the primary prevention of atherosclerotic cardiovascular disease in primary care: study protocol for a systematic guideline review

INTRODUCTION

Atherosclerotic cardiovascular disease (ASCVD) was the main cause of death in Germany in 2021, with major risk factors (ie, hypertension, diabetes, dyslipidaemia, obesity and certain lifestyle factors) being highly prevalent. Preventing ASCVD by assessment and modification of these risk factors is an important challenge for general practitioners. This study aims to systematically review and synthesise recent recommendations of national and international guidelines regarding the primary prevention of ASCVD in adults in primary care.

METHODS AND ANALYSIS

We will conduct a systematic review of clinical practice guidelines (CPGs) to evaluate primary prevention strategies for ASCVD. CPGs will be retrieved from MEDLINE and the Turning Research Into Practice database, guideline-specific databases and websites of guidelines-producing societies, with searches limited to publications from 2016 onwards. We will include CPGs in English, Spanish, German or Dutch languages that provide evidence-based recommendations for ASCVD prevention. The study population will include adults without diagnosed ASCVD. Two independent reviewers will assess guideline eligibility and quality by means of the mini-checklist MiChe, and extract study characteristics and relevant recommendations for further consistency analysis. A third reviewer will resolve disagreements. Findings will be presented as a narrative synthesis and in tabular form.

ETHICS AND DISSEMINATION

This review does not require ethical approval. Our systematic review will inform the CPG of the German College of General Practitioners and Family Physicians on the primary prevention of ASCVD. The review results will also be disseminated through publications in peer-reviewed journals and presentations at local, national and international conferences.

PROSPERO REGISTRATION NUMBER

CRD42023394605.

Development, Evaluation, and impLemenTation for guideline adaptation: a quality improvement protocol for the DELTA study in global health practice

BACKGROUND

Guideline adaptation is an emerging field to provide more appropriate recommendations for local clinical practice quality and to promote global health equity. However, its utilization status, adaptation procedures, and related materials remain to be studied.

METHODS

This study developed a quality improvement protocol for a study as the Development, Evaluation, and impLemenTation for guideline Adaptation (DELTA) study. Current adapted clinical practice guidelines (CPGs) will be systematically searched. Their characteristics, utilization status, and adaptation procedures will be extracted, compared, and analyzed. Whether these adapted CPGs rigorously followed the instruments and steps of adaptation frameworks will also be appraised. In addition, the advantages and limitations of current adaptation methods and their suitable application situations will be analyzed. In addition, future perspectives as DELTA series and DELTA system, aiming for comprehensively evaluating current needs for guideline adaptation and developing a unified framework and related materials were proposed to improve the acceptability, applicability, and implementation of guideline adaptation in clinical practice. The DELTA series are divided into four phases: phase I in analyzing status, characteristics, and procedures and completeness of adapted CPGs; phase II in analyzing differences, heterogeneity, and implementation between adapted and original CPGs; and phase III in collecting, analyzing, and comparing all available adaptation materials. With these research bases, an international working group will be established in phase IV and will develop unified guideline adaptation materials after Delphi consensus, including adaptation frameworks, appraisal tools and checklists, registries, and databases.

DISCUSSION

Guideline adaptation has been advanced as an efficient way to guide local clinical practice. However, it still faces several major challenges. The proposed DELTA study, series, and system will further contribute to this emerging topic.

TRIAL REGISTRATION

 This study has been registered by the PROSPERO international database. https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=400170 .

Evidence-Based Decision Support for a Structured Care Program on Polypharmacy in Multimorbidity: A Guideline Upgrade Based on a Realist Synthesis

Evidence-based clinical guidelines generally consider single conditions, and rarely multimorbidity. We developed an evidence-based guideline for a structured care program to manage polypharmacy in multimorbidity by using a realist synthesis to update the German polypharmacy guideline including the following five methods: formal prioritization in focus groups; systematic guideline review of evidence-based multimorbidity/polypharmacy guidelines; evidence search/synthesis and recommendation development; multidisciplinary consent of recommendations; feasibility test of updated guideline. We identified the need for a better description of the target group, decision support, prioritization of medication, consideration of patient preferences and anticholinergic properties, and of healthcare interfaces. We conducted a systematic guideline review of eight guidelines and extracted and synthesized recommendations using the Ariadne principles. We also included 48 systematic reviews. We formulated and agreed upon 34 recommendations for the revised guideline. During the feasibility test, guideline use enabled 57% of GPs to identify problems, leading to medication changes in 49% and self-assessed improvement in 56% of patients. Although 58% of GPs felt that it was too long, 92% recommended it. Polypharmacy should be systematically reviewed at least annually. Patients, family members, and healthcare professionals should monitor and adjust it using prospective process validation, taking into account patient preferences and agreed treatment goals.

Current practices and challenges in adaptation of clinical guidelines: a qualitative study based on semistructured interviews

OBJECTIVE

This study aims to better understand the current practice of clinical guideline adaptation and identify challenges raised in this process, given that published adapted clinical guidelines are generally of low quality, poorly reported and not based on published frameworks.

DESIGN

A qualitative study based on semistructured interviews. We conducted a framework analysis for the adaptation process, and thematic analysis for participants' views and experiences about adaptation process.

SETTING

Nine guideline development organisations from seven countries.

PARTICIPANTS

Guideline developers who have adapted clinical guidelines within the last 3 years. We identified potential participants through published adapted clinical guidelines, recommendations from experts, and a review of the Guideline International Network Conference attendees' list.

RESULTS

We conducted ten interviews and identified nine adaptation methodologies. The reasons for adapting clinical guidelines include developing de novo clinical guidelines, implementing source clinical guidelines, and harmonising and updating existing clinical guidelines. We identified the following core steps of the adaptation process (1) selection of scope and source guideline(s), (2) assessment of source materials (guidelines, recommendations and evidence level), (3) decision-making process and (4) external review and follow-up process. Challenges on the adaptation of clinical guidelines include limitations from source clinical guidelines (poor quality or reporting), limitations from adaptation settings (lacking resources or skills), adaptation process intensity and complexity, and implementation barriers. We also described how participants address the complexities and implementation issues of the adaptation process.

CONCLUSIONS

Adaptation processes have been increasingly used to develop clinical guidelines, with the emergence of different purposes. The identification of core steps and assessment levels could help guideline adaptation developers streamline their processes. More methodological research is needed to develop rigorous international standards for adapting clinical guidelines.

Do the Clinical Management Guidelines for Covid-19 in African Countries Reflect the African Quality Palliative Care Standards? A Review of Current Guidelines

CONTEXT

Palliative care should be a component of COVID-19 management to relieve suffering, improve patient outcomes and save cost.

OBJECTIVES

We aimed to identify and critically appraise the palliative care recommendations within COVID-19 case management guidelines in African countries.

METHODS

The study employed systematic guideline review design. All guidelines from any country in Africa, of any language, published between December 2019 and June 2020 were retrieved through online search and email to in-country key contacts. We conducted a content analysis of the palliative care recommendations within the guidelines and appraised the recommendations using African Palliative Care Association standards for providing quality palliative care.

RESULTS

We retrieved documents from 29 of 54 African countries. Fifteen documents from 15 countries were included in the final analysis, of which eight countries have identifiable PC recommendations in their COVID-19 management guidelines. Of these eight, only one country (South Sudan) provided comprehensive palliative care recommendations covering the domains of physical, psychological, social and spiritual wellbeing, two (Namibia and Uganda) addressed only physical and psychological wellbeing while the remaining five countries addressed only physical symptom management.

CONCLUSIONS

Comprehensive palliative care which addresses physical, psychological, social and spiritual concerns must be prioritized within case management guidelines in African countries.

Developing a Data-driven Medication Indication Knowledge Base using a Large Scale Medical Claims Database

Medication-indication knowledge base (KB) is useful for clinical care and also a key enabler for secondary use of observational health data. Over the years there are several indication KBs being developed, however, they were built based on curated data sources and thus may not reflect actual clinical practice. The longitudinal observational health data contain information about real world practice of medication indication, but were rarely used in KB construc- tion. A major challenge of leveraging them is the confounders in multi-medication multi-diagnoses relations. In this study, we proposed a sampling based approach that could explicitly handle the aforementioned confounders, and consequently detect more accurate medication-indication relations. Based on this method, we created a medication- indication KB that reflects actual clinical practice and has broad medication and indication coverages. Our work represents the first attempt to develop a medication-indication KB from a large scale observational health data in an automated and unsupervised manner.

Evidence supporting the best clinical management of patients with multimorbidity and polypharmacy: a systematic guideline review and expert consensus

The complexity and heterogeneity of patients with multimorbidity and polypharmacy renders traditional disease-oriented guidelines often inadequate and complicates clinical decision making. To address this challenge, guidelines have been developed on multimorbidity or polypharmacy. To systematically analyse their recommendations, we conducted a systematic guideline review using the Ariadne principles for managing multimorbidity as analytical framework. The information synthesis included a multistep consensus process involving 18 multidisciplinary experts from seven countries. We included eight guidelines (four each on multimorbidity and polypharmacy) and extracted about 250 recommendations. The guideline addressed (i) the identification of the target population (risk factors); (ii) the assessment of interacting conditions and treatments: medical history, clinical and psychosocial assessment including physiological status and frailty, reviews of medication and encounters with healthcare providers highlighting informational continuity; (iii) the need to incorporate patient preferences and goal setting: eliciting preferences and expectations, the process of shared decision making in relation to treatment options and the level of involvement of patients and carers; (iv) individualized management: guiding principles on optimization of treatment benefits over possible harms, treatment communication and the information content of medication/care plans; (v) monitoring and follow-up: strategies in care planning, self-management and medication-related aspects, communication with patients including safety instructions and adherence, coordination of care regarding referral and discharge management, medication appropriateness and safety concerns. The spectrum of clinical and self-management issues varied from guiding principles to specific recommendations and tools providing actionable support. The limited availability of reliable risk prediction models, feasible interventions of proven effectiveness and decision aids, and limited consensus on appropriate outcomes of care highlight major research deficits. An integrated approach to both multimorbidity and polypharmacy should be considered in future guidelines.

The advantages and limitations of guideline adaptation frameworks

BACKGROUND

The implementation of evidence-based guidelines can improve clinical and public health outcomes by helping health professionals practice in the most effective manner, as well as assisting policy-makers in designing optimal programs. Adaptation of a guideline to suit the context in which it is intended to be applied can be a key step in the implementation process. Without taking the local context into account, certain interventions recommended in evidence-based guidelines may be infeasible under local conditions. Guideline adaptation frameworks provide a systematic way of approaching adaptation, and their use may increase transparency, methodological rigor, and the quality of the adapted guideline. This paper presents a number of adaptation frameworks that are currently available. We aim to compare the advantages and limitations of their processes, methods, and resource implications. These insights into adaptation frameworks can inform the future development of guidelines and systematic methods to optimize their adaptation.

ANALYSIS

Recent adaptation frameworks show an evolution from adapting entire existing guidelines, to adapting specific recommendations extracted from an existing guideline, to constructing evidence tables for each recommendation that needs to be adapted. This is a move towards more recommendation-focused, context-specific processes and considerations. There are still many gaps in knowledge about guideline adaptation. Most of the frameworks reviewed lack any evaluation of the adaptation process and outcomes, including user satisfaction and resources expended. The validity, usability, and health impact of guidelines developed via an adaptation process have not been studied. Lastly, adaptation frameworks have not been evaluated for use in low-income countries.

CONCLUSION

Despite the limitations in frameworks, a more systematic approach to adaptation based on a framework is valuable, as it helps to ensure that the recommendations stay true to the evidence while taking local needs into account. The utilization of frameworks in the guideline implementation process can be optimized by increasing the understanding and upfront estimation of resource and time needed, capacity building in adaptation methods, and increasing the adaptability of the source recommendation document.

Methods used in adaptation of health-related guidelines: A systematic survey

Background

Adaptation refers to the systematic approach for considering the endorsement or modification of recommendations produced in one setting for application in another as an alternative to de novo development.

Objective

To describe and assess the methods used for adapting health-related guidelines published in peer-reviewed journals, and to assess the quality of the resulting adapted guidelines.

Methods

We searched Medline and Embase up to June 2015. We assessed the method of adaptation, and the quality of included guidelines.

Results

Seventy-two papers were eligible. Most adapted guidelines and their source guidelines were published by professional societies (71% and 68% respectively), and in high-income countries (83% and 85% respectively). Of the 57 adapted guidelines that reported any detail about adaptation method, 34 (60%) did not use a published adaptation method. The number (and percentage) of adapted guidelines fulfilling each of the ADAPTE steps ranged between 2 (4%) and 57 (100%). The quality of adapted guidelines was highest for the "scope and purpose" domain and lowest for the "editorial independence" domain (respective mean percentages of the maximum possible scores were 93% and 43%). The mean score for "rigor of development" was 57%.

Conclusion

Most adapted guidelines published in peer-reviewed journals do not report using a published adaptation method, and their adaptation quality was variable.

Adapting clinical guidelines in low-resources countries: a study on the guideline on the management and prevention of type 2 diabetes mellitus in Indonesia

RATIONALE, AIMS AND OBJECTIVES

Most of the clinical guidelines in low-resource countries are adaptations from preexisting international guidelines. This adaptation can be problematic when those international guidelines are not based on current evidence or original evidence-based international guidelines are not followed. This study aims to evaluate the quality of an Indonesian type 2 diabetes mellitus guideline adapted from selected international guidelines.

METHODS

The "Consensus on the Management and Prevention of type 2 Diabetes in Indonesia 2011" is a guideline by the Indonesian Society of Endocrinology (Perkeni). Four parent guidelines identified from its list of references were from the International Diabetes Federation (IDF), American Association of Clinical Endocrinologist (AACE), American Diabetes Association (ADA), and one jointly released by ADA and European Association for the Study of Diabetes (EASD). Two reviewers independently assessed its quality using the Appraisal of Guidelines, Research and Evaluation Collaboration (AGREE II) instrument. Six recommendations were compared: (1) screening for diabetes; (2) diagnosis; (3) control of hyperglycemia; (4) target blood glucose; (5) target blood pressure; and (6) treatment of dyslipidemia.

RESULTS

Perkeni's guideline satisfied 55% of the AGREE II items, while its parent guidelines satisfied 59% to 74%. Perkeni's shows low score on "rigor of development" and "applicability" and the lowest score in the "scope and purpose" domain. Differences were found in 4 recommendations: the screening of diabetes, control of hyperglycemia, target blood glucose, and treatment of dyslipidemia. In 3 of 4, Perkeni followed the ADA's recommendation.

CONCLUSION

Derivation of recommendations from parent guidelines and their adaptation to the context of Indonesian health care lacks transparency. When guidelines are either derived from other guidelines or adapted for use in different context, evidence-based practice principles should be followed and adhered to.

Chronic Heart Failure Clinical Practice Guidelines' Class 1-A Pharmacologic Recommendations: Start-to-End Synergistic Drug Therapy?

BACKGROUND

Chronic heart failure (HF) disease as an emerging epidemic has a high economic-psycho-social burden, hospitalization, readmission, morbidity and mortality rates despite many clinical practice guidelines' evidenced-based and consensus driven recommendations that include trials' initial-baseline data.

OBJECTIVE

To show that the survival and hospitalization-free event rates in the reviewed chronic HF clinical practice guidelines' class I-A recommendations as initial HF drug therapy (IDT) is possibly a combination and 'start-to-end' synergistic effect of the add-on ('end') HF drug therapy (ADT) to the baseline ('start') HF drug therapy (BDT).

METHODOLOGY

The references cited in the chronic HF clinical practice guidelines of the 2005, 2009, and 2013 American Heart Association/American College of Cardiology (AHA/ACC), the 2006 Heart Failure Society of America (HFSA), and the 2005, 2008, and 2012 European Society of Cardiology (ESC) were reviewed and compared with the respective guidelines' and other countries' recommendations.

RESULTS

The BDT using glycosides and diuretics is 79%-100% in the cited HF trials. The survival rates attributed to the BDT ('start') is 46%-89% and IDT ('end') 61%-92.8%, respectively. The hospitalization-free event rate of the BDT group: 47.1% to 85.3% and IDT group 61.8%-90%, respectively. Thus, the survival and hospitalization-free event rates of the ADT is 0.4%-15% and 4.6% to 14.7%, respectively. The extrapolated BDT survival is 8%-51% based on a 38% estimated natural HF survival rate for the time period109.

CONCLUSION

The contribution of baseline HF drug therapy (BDT) is relevant in terms of survival and hospitalization-free event rates compared to the HF class 1-A guidelines initial drug therapy recommendations (IDT). Further, the proposed initial HF drug ('end') therapy (IDT) has possible synergistic effects with the baseline HF drug ('start') therapy (BDT) and is essentially the add on HF drug therapy (ADT) in our analysis. The polypharmacy HF treatment is a synergistic effect due to BDT and ADT.

Nurse Practitioner Practice Patterns for Management of Heart Failure in Long-Term Care Facilities

Purpose: This study examined nurse practitioners’ (NPs) practice patterns for heart failure (HF) management, specifically regarding the use of angiotensin-converting enzyme inhibitors (ACEIs), beta antagonists, diuretic monotherapy, and echocardiograms for older adults residing in long-term care facilities. Methodology: A Web-based survey was developed to identify NP practice patterns for HF management in long-term care settings. The Checklist for Reporting Results of Internet E-Surveys and expert opinion guided the survey design. The survey was distributed via e-mail to Gerontological Advanced Practice Nurses Association members. Results: Most NPs used ACEIs for ongoing therapy, initiated appropriate therapy for symptomatic patients, continued beta-antagonist therapy in patients with HF, used echocardiograms in the diagnosis and evaluation of HF, and prescribed monotherapy diuretics in accordance with HF care standards. Implications for Practice: Based on these findings, NP practice patterns for management of HF in the long-term care setting are in alignment with national standard of care regardless of certification or level of physician oversight. NPs need to be cognizant of the cardiovascular risk factors for HF and adjust treatment to add an ACEI or beta antagonist to diuretic monotherapy when the clinical diagnosis of HF is suspected or established.

Guideline for primary care management of headache in adults

OBJECTIVE

To increase the use of evidence-informed approaches to diagnosis, investigation, and treatment of headache for patients in primary care.

QUALITY OF EVIDENCE

A comprehensive search was conducted for relevant guidelines and systematic reviews published between January 2000 and May 2011. The guidelines were critically appraised using the AGREE (Appraisal of Guidelines for Research and Evaluation) tool, and the 6 highest-quality guidelines were used as seed guidelines for the guideline adaptation process.

MAIN MESSAGE

A multidisciplinary guideline development group of primary care providers and other specialists crafted 91 specific recommendations using a consensus process. The recommendations cover diagnosis, investigation, and management of migraine, tension-type, medication-overuse, and cluster headache.

CONCLUSION

A clinical practice guideline for the Canadian health care context was created using a guideline adaptation process to assist multidisciplinary primary care practitioners in providing evidence-informed care for patients with headache.

[Experiences with synopses of clinical guidelines using the example of synopses for Disease Management Programmes (DMP)]

Guideline synopses, i.e. the systematic synthesis of clinical practice guidelines, are used as a basis for Disease Management Programmes (DMPs) in Germany. One of the responsibilities of the German Institute for Quality and Efficiency in Health Care (IQWiG) is the preparation of guideline synopses for DMPs. The article describes the experiences with this methodology.

METHODS

For the preparation of guideline synopses, a systematic search for evidence-based guidelines is conducted, and their recommendations are extracted and synthesised. In parallel, the quality of the guidelines is assessed using the AGREE instrument. The need for updating or supplementing a DMP is justified by means of the Grade of Recommendation (GoR) or, alternatively, the Level of Evidence (LoE).

EXPERIENCES

Since 2006 IQWiG has synthesised recommendations from 256 evidence-based guidelines in 12 guideline synopses for DMPs. The results are then used by the Federal Joint Committee (G-BA) to update DMPs. Using the example of the 12 synopses, several analyses were conducted. It was determined that a search for guidelines in guideline databases is sufficient and that a search in bibliographic databases can be dispensed with. Furthermore, the analyses showed that a large proportion of recommendations in evidence-based guidelines are not clearly linked to a GoR or LoE. If GoR and LoE are provided, only about 42% of recommendations with a strong GoR also refer to a strong LoE. It was also shown that only 21 % of the analysed guideline providers supplied information on the handling of unpublished data. With consistent average to high values, the assessment of the methodological quality across all of the prepared synopses allows for the conclusion of a basically acceptable guideline quality, but with a need for improvement.

OUTLOOK

A guideline synopsis is an established tool for identifying health care standards as a basis for developing and updating DMPs. Further methodological development, particularly in collaboration with guideline providers, appears to be reasonable. It should be examined whether guideline synopses are suitable not only for guideline and DMP development, but also for other health care issues.

Adapting low back pain guidelines within a multidisciplinary context: a process evaluation

RATIONALE, AIMS AND OBJECTIVES

The Alberta Ambassador Program (AAP) adapted seven clinical practice guidelines on low back pain (LBP) into a single guideline spanning the continuum of care from prevention and diagnosis through to treatment. The Ambassador adaptation process was evaluated to 1 Identify the major challenges encountered and successful strategies utilized; 2 Assess strengths and weaknesses by benchmarking it with the ADAPTE framework; and 3 Identify opportunities for improvement.

METHOD

External consultants reviewed the Ambassador and ADAPTE materials and conducted semi-structured telephone interviews with 29 participants from the AAP committees. All participants were asked about the major challenges encountered and potential areas for improvement.

RESULTS

The response rate was 83% (29/35). There was strong consensus that the Ambassador guideline adaptation process was sound and rigorous all respondents indicated willingness to participate in further iterations of the Program. Key elements of success were identified. The main steps and sequence of the process were closely aligned with the ADAPTE framework, although the AAP incorporated additional enhancements which augmented the process. The main divergences between the two frameworks centred on the organizational structure and the methods used to overcome methodological difficulties.

CONCLUSION

The AAP successfully utilized existing stakeholder interest to create an overarching guideline for managing LBP across multiple primary care disciplines. The study highlighted the strengths and weaknesses of the Program, and identified practical strategies for improvement. Evaluating guideline adaptation processes is pivotal to ensuring that they continue to be an efficient, rigorous and practicable option for producing contextualized, clinically relevant guidelines.

Remarkable differences between three evidence-based guidelines on management of obstructive sleep apnea-hypopnea syndrome

OBJECTIVES/HYPOTHESIS

The aim of this study was to compare available guidelines for the diagnosis and treatment of patients with obstructive sleep apnea-hypopnea syndrome (OSAHS) regarding their content, conclusions on the available evidence, and recommendations.

STUDY DESIGN

Literature review/systematic review.

METHODS

We retrieved guidelines from Embase, PubMed, Web of Science, and Web sites of several health care improvement centers and with a Google Scholar search. We appraised the quality of selected guidelines according to the Appraisal of Guidelines for Research and Evaluation instrument. For similar clinical questions we compared the conclusions, the attached levels of evidence, and the references used. If differences were found, we checked search strategies, appraisal criteria, and publication date as possible sources for these differences.

RESULTS

We selected the guidelines on diagnosis and treatment of OSAHS of the Scottish Scottish Intercollegiate Guidelines Network, the Dutch Institute for Healthcare Improvement, and the Institute for Clinical Systems Improvement in the United States for this comparison. For similar clinical questions these three guidelines showed conflicting conclusions (11%-18%), differences in attached levels of evidence (32%-62%), and remarkable discrepancies in cited studies. A plausible reason for these differences is the citation preference for articles from members of the guidelines workgroup and from their own country. Despite different publication dates, more recent guidelines fail to cite earlier published guidelines.

CONCLUSIONS

Despite the generally accepted approach regarding the development of evidence-based guidelines, remarkable differences exist between guidelines from different countries on the same clinical subject.

Challenges in developing national HIV guidelines: experience from the eastern Mediterranean

OBJECTIVE

To appraise the process of development and clinical content of national human immunodeficiency virus (HIV) clinical practice guidelines of countries in the eastern Mediterranean and to formulate recommendations for future guideline development and adaptation.

METHODS

Twenty-three countries in the World Health Organization (WHO) Eastern Mediterranean and United Nations Children's Fund Middle East and North Africa regions were invited to submit national HIV clinical practice guidelines for review. The guideline development methodology was assessed using an adaptation of the Appraisal of Guidelines Research and Evaluation (AGREE) instrument and guideline content, using a checklist to evaluate concordance with WHO 2006 generic guidelines.

FINDINGS

Twelve countries submitted 20 guidelines developed between 2004 and 2009. Median scores were poor (i.e. < 0.6) for the methodological quality domains of rigour of development, stakeholder involvement and applicability and flexibility. Scores were better for the domains of scope and purpose (median: 0.82, interquartile range, IQR: 0.58-0.89) and clarity and presentation (median: 0.67, IQR: 0.50-0.78). Concerning guideline content, recommended first-line treatment and eligibility criteria for antiretroviral therapy (ART) in adults were in line with WHO recommendations in most guidelines. However, recommendations on antiretroviral prophylaxis for the prevention of vertical HIV transmission, diagnosis and treatment of HIV infection in infants, monitoring patients on ART, treatment failure and co-morbidities were often lacking.

CONCLUSION

The large majority of national HIV clinical practice guidelines had methodological weaknesses and content inaccuracies. Countries require assistance with the adaptation process to ensure that guidelines are valid and up to date and accurately reflect WHO global clinical care recommendations for patients with HIV.

Evidence-based guidelines in the evaluation of work disability: an international survey and a comparison of quality of development

Background

In social insurance, the evaluation of work disability is becoming stricter as priority is given to the resumption of work, which calls for a guarantee of quality for these evaluations. Evidence-based guidelines have become a major instrument in the quality control of health care, and the quality of these guidelines' development can be assessed using the AGREE instrument. In social insurance medicine, such guidelines are relatively new. We were interested to know what guidelines have been developed to support the medical evaluation of work disability and the quality of these guidelines.

Methods

Five European countries that were reported to use guidelines were approached, using a recent inventory of evaluations of work disability in Europe. We focused on guidelines that are disease-oriented and formally prescribed in social insurance medicine. Using the AGREE instrument, these guidelines were appraised by two researchers. We asked two experts involved in guideline development to indicate if they agreed with our results and to provide explanations for insufficient scores.

Results

We found six German and sixteen Dutch sets of disease-oriented guidelines in official use. The AGREE instrument was applicable, requiring minor adaptations. The appraisers reached consensus on all items. Each guideline scored well on 'scope and purpose' and 'clarity and presentation'. The guidelines scored moderately on 'stakeholder involvement' in the Netherlands, but insufficiently in Germany, due mainly to the limited involvement of patients' representatives in this country. All guidelines had low scores on 'rigour of development', which was due partly to a lack of documentation and of existing evidence. 'Editorial independence' and 'applicability' had low scores in both countries as a result of how the production was organised.

Conclusion

Disease-oriented guidelines in social insurance medicine for the evaluation of work disability are a recent phenomenon, so far restricted to Germany and the Netherlands. The AGREE instrument is suitably applicable to assess the quality of guideline development in social insurance medicine, but some of the scoring rules need to be adapted to the context of social insurance. Existing guidelines do not meet the AGREE criteria to a sufficient level. The way patients' representatives can be involved needs further discussion. The guidelines would profit from more specific recommendations and, for providing evidence, more research is needed on the functional capacity of people with disabilities.