Grading evidence from test accuracy studies: what makes it challenging compared with the grading of effectiveness studies?

Extending the Grading of Recommendations Assessment, Development and Evaluation (GRADE) in Traditional Chinese Medicine (TCM): The GRADE-TCM

AIM

To extend and form the "Grading of Recommendations Assessment, Development and Evaluation in Traditional Chinese Medicine" (GRADE-TCM).

METHODS

Methodologies were systematically reviewed and analyzed concerning evidence-based TCM guidelines worldwide. A survey questionnaire was developed based on the literature review and open-end expert interviews. Then, we performed expert consensus, discussion meeting, opinion collection, external examination, and the GRADE-TCM was formed eventually.

RESULTS

265 Chinese and English TCM guidelines were included and analyzed. Five experts completed the open-end interviews. Ten methodological entries were summarized, screened and selected. One round of consensus was conducted, including a total of 22 experts and 220 valid questionnaire entries, concerning 1) selection of the GRADE, 2) GRADE-TCM upgrading criteria, 3) GRADE-TCM evaluation standard, 4) principles of consensus and recommendation, and 5) presentation of the GRADE-TCM and recommendation. Finally, consensus was reached on the above 10 entries, and the results were of high importance (with voting percentages ranging from 50 % to 81.82 % for "very important" rating) and strong reliability (with the Cr ranging from 0.93 to 0.99). Expert discussion meeting (with 40 experts), opinion collection (in two online platforms) and external examination (with 14 third-party experts) were conducted, and the GRADE-TCM was established eventually.

CONCLUSION

GRADE-TCM provides a new extended evidence-based evaluation standard for TCM guidelines. In GRADE-TCM, international evidence-based norms, characteristics of TCM intervention, and inheritance of TCM culture were combined organically and followed. This is helpful for localization of the GRADE in TCM and internationalization of TCM guidelines.

Diagnostic test guidelines based on high-quality evidence had greater rates of adherence: a meta-epidemiological study

OBJECTIVES

To determine the association between the quality of guidelines for diagnostic tests (both the quality and reporting and the quality of the evidence underpinning recommendations) and nonadherence.

STUDY DESIGN AND SETTING

We conducted a meta-epidemiological study. We previously published a systematic review that quantified the percentage of test use that was nonadherent with guidelines. For the present study, we assessed these guidelines using the Appraisal of Guidelines for Research & Evaluation (AGREE) II tool. We then assessed the quality of evidence underpinning recommendations within these guidelines using Grading of Recommendations Assessment, Development, and Evaluation (GRADE). Linear models were then constructed to determine the association between guideline nonadherence and (1) AGREE II score and (2) GRADE score.

RESULTS

There was no significant association between AGREE II score and nonadherent testing (P = 0.09). There was a significant association between GRADE score and nonadherence: recommendations based on low-quality and very low-quality evidence had 38% (P < 0.01) and 24% (P = 0.02) more nonadherent testing, compared with recommendations based on high-quality evidence.

CONCLUSION

Diagnostic test guideline recommendations based on high-quality evidence are adhered to more frequently.