What is the quality of clinical practice guidelines accessible on the world wide web for the treatment of musculoskeletal conditions in physiotherapy?

A systematic critical appraisal of non-pharmacological management of rheumatoid arthritis with Appraisal of Guidelines for Research and Evaluation II

Clinical practice guidelines (CPGs) have been developed to summarize evidence about the management of rheumatoid arthritis (RA) and facilitate the uptake of evidence-based knowledge by consumers, health professionals, health administrators and policy makers. The objectives of this review was to assess the quality of CPGS on non-pharmacological management of RA with a standardized and validated instrument--the Appraisal of Guidelines for Research and Evaluation (AGREE II) tool and summarize the key recommendations from these CPGs. Scientific literature databases from 2001 to 2013 were systematically searched and a total of 13 CPGs for RA was identified. Only a minority of AGREE II domains were effectively addressed by the CPGS. Scope and purpose was effectively addressed in 10 out of 13 CPGs, stakeholder involvement in 11 CPGs, rigor of development in 6 CPGs, clarity/presentation in 9 CPGs, editorial independence in 1 CPGs, and applicability in none of the CPGs. The overall quality of the included CPGs according to the 7-point AGREE II scoring system was 4.8 ± 1.04. Patient education/self-management, aerobic, dynamic and stretching exercises were the commonly recommended for the non-pharmacological management of RA by the high-quality CPGs. The general clinical management recommendations tended to be similar among high-quality CPGs. Non-pharmacological management interventions were superficially addressed in more than half of the selected CPGs. CPGs creators should use the AGREE II criteria when developing guidelines. Innovative and effective methods of CPGs implementation to users are needed to ultimately enhance the quality of life of arthritic individuals. In addition, it was difficult to establish between strongly recommended, recommended and weakly recommended, as there is no consensus between the strength of the recommendations between the appraised CPGs.

Making the AGREE tool more user-friendly: the feasibility of a user guide based on Boolean operators

Rationale, aims and objectives The Appraisal of Guidelines Research and Evaluation (AGREE) instrument is a generic tool for assessing guideline quality. This feasibility study aimed to reduce the ambiguity and subjectivity associated with AGREE item scoring, and to augment the tool's capacity to differentiate between good- and poor-quality guidelines. Methods A literature review was conducted to ascertain what AGREE instrument adjustments had been reported to date. The AGREE User Guide was then modified by: 1 constructing a detailed set of instructions, or dictionary, using Boolean operators, and 2 overlaying seven criteria to categorize guideline quality. The feasibility of the Boolean-based dictionary was tested by three appraisers using three randomly selected guidelines on low back pain management. The dictionary was then revised and re-tested. Results Of the 52 published studies identified, 14% had modified the instrument by adding or deleting items and 35% had adopted strategies, such as using a consensus approach, to overcome inconsistencies and ensure identical item scoring among appraisers. For the feasibility test, Pearson correlation coefficients ranged from 0.27 to 0.81. Revision and re-testing of the dictionary increased the level of agreement (range 0.41 to 0.94). Application of the revised dictionary not only decreased the variability of the domain scores, but also reduced the tool's reliability among inexperienced appraisers. Conclusion Appraisers found the Boolean-based AGREE User Guide easier to use than the original, which improved their confidence in the tool. Good reliability was achieved in the feasibility test, but the reliability and validity of some of the changes will require further evaluation.

Quality of Australian clinical guidelines and relevance to the care of older people with multiple comorbid conditions

OBJECTIVE

To assess the quality of Australian clinical guidelines for chronic diseases and their relevance to older people with multiple comorbid conditions.

DESIGN

Selection and assessment of national clinical guidelines for chronic conditions listed as National Health Priority Areas: cardiovascular health, diabetes mellitus, mental health, asthma, arthritis and musculoskeletal conditions, and cancer.

MAIN OUTCOME MEASURES

Standardised mean scores obtained with the Appraisal of Guidelines Research and Evaluation (AGREE) instrument (criteria grouped into six domains: scope and purpose; stakeholder involvement; rigour of development; clarity and presentation; applicability; and editorial independence). Relevance of guidelines for older people with multiple comorbid conditions.

RESULTS

17 guidelines were included in the study. Guidelines approved by the National Health and Medical Research Council (NHMRC) scored significantly better than those not approved by the NHMRC in all domains except for editorial independence and clarity and presentation. The mean quality of guidelines not approved by the NHMRC was below 50% in all domains except clarity and presentation. Half of the guidelines addressed treatment for older patients or for patients with one comorbid condition, but only one addressed treatment for older patients with multiple comorbid conditions.

CONCLUSIONS

Professional societies and charities should be encouraged and supported to develop clinical guidelines in compliance with NHMRC requirements. Future guidelines should place more emphasis on the management of older people with multiple comorbid conditions.

Quality of stroke rehabilitation clinical practice guidelines

BACKGROUND AND PURPOSE

Clinical practice guidelines (CPGs) are systematically developed statements that assist practitioners to provide appropriate evidence-based care. The purpose of this study was to evaluate the quality of currently published CPGs for stroke care and to examine the reliability and validity of the appraisal of guidelines, research and evaluation (AGREE) instrument.

METHODS

Multiple databases and Internet resources were searched for stroke care CPGs. Guidelines included were published in English or French from 1998 to 2004 and developed by a group process. Four appraisers evaluated each CPG using the AGREE instrument. The AGREE consists of 23 items, ranked on a 4-point Likert scale, that is organized into six domains. A standardized score is calculated separately for each domain and ranges from 0 to 100.

RESULTS

Eight guidelines were identified. The AGREE quality scores were high for the 'scope and purpose' domain (mean +/- SE = 71.2 +/- 5.48, intra-class correlation (ICC) = 0.66), and 'clarity and presentation' (mean +/- SE = 70.6 +/- 4.43, ICC = 0.66). There was wide variation in ratings of 'rigour of development' (mean +/- SE = 60.7 +/- 7.1, ICC = 0.75) and 'stakeholder involvement' (mean +/- SE = 52.6 +/- 7.14, ICC = 0.89). The 'editorial independence' (mean +/- SE = 38.1 +/- 8.72, ICC = 0.88) and 'applicability' (mean +/- SE = 35.1 +/- 4.93, ICC = 0.75) had the lowest scores.

CONCLUSIONS

There is considerable variability in quality of stroke care guidelines but stroke guidelines score higher on the AGREE rigour of development domain than CPGs from other medical fields. The Scottish Intercollegiate Guideline Network, Veterans Affairs/Department of Defence, Royal College of Physicians, and the New Zealand Guidelines Group consistently scored the highest across the domains. Stroke rehabilitation clinicians should consider these results in selecting a guideline. CPG development groups can improve their AGREE scores by considering the cost of implementing their CPGs, pilot testing their CPGs, recording conflict of interest of development panel members and providing tools supporting application of their CPGs.