Applying GRADE for diagnosis revealed methodological challenges: an illustrative example for guideline developers

Co-creation of a step-by-step guide for specifying the test-management pathway to formulate focused guideline questions about healthcare related tests

BACKGROUND

Guideline development on testing is known to be difficult for guideline developers. It requires consideration of various aspects, such as accuracy, purpose of testing, and consequences on management and people-important outcomes. This can be outlined in a test-management pathway. We aimed to create and user-test a step-by-step guide for guideline developers for designing a test-management pathway.

METHODS

Developmental design with a co-creative strategy. We created a draft step-by-step guide, that was user tested in a workshop with 19 experts, and by interviewing 7 guideline panel members.

RESULTS

Our proposed guide consists of five blocks of signalling questions: patients/population, index test(s), current practice/comparison/control, people-important outcomes, and the link between testing and outcome(s). The user testing led to refinement of the signalling questions, the use of inclusive terminology, and addition of a test-management pathway figure with detailed explanation.

CONCLUSIONS

The step-by-step guide for formulating focused guideline questions regarding healthcare related testing can help in identifying relevant characteristics of the population, tests, and outcomes and to create a test management pathway. This should facilitate the formulation of evidence-based guideline recommendations about healthcare related testing.

Required knowledge for guideline panel members to develop healthcare related testing recommendations: a developmental study

OBJECTIVES

To define the minimum knowledge required for guideline panel members (healthcare professionals and consumers) involved in developing recommendations about healthcare related testing.

STUDY DESIGN AND SETTING

A developmental study with a multistaged approach. We derived a first set of knowledge components from literature and subsequently performed semistructured interviews with 9 experts. We refined the set of knowledge components and checked it with the interviewees for final approval.

RESULTS

Understanding the test-management pathway, for example, how test results should be used in context of decisions about interventions, is the key knowledge component. The final list includes 26 items on the following topics: health question, test-management pathway, target population, test, test result, interpretation of test results and subsequent management, and impact on people important outcomes. For each item, the required level of knowledge is defined.

CONCLUSION

We developed a list of knowledge components required for guideline panels to formulate recommendations on healthcare related testing. The list could be used to design specific training programs for guideline panel members when developing recommendations about tests and testing strategies in healthcare.

Do clinical practice guidelines consider evidence about diagnostic test consequences on patient-relevant outcomes? A critical document analysis

RATIONALE, AIMS AND OBJECTIVES

Supporting evidence for diagnostic test recommendations in clinical practice guidelines (CPGs) should not only include diagnostic accuracy, but also downstream consequences of the test result on patient-relevant outcomes. The aim of this study is to assess the extent to which evidence-based CPGs about diagnostic tests cover all relevant test-treatment pathway components.

METHODS

We performed a systematic document analysis and quality assessment of publicly accessible CPGs about three common diagnostic tests: C-reactive protein, colonoscopy and fractional exhaled nitric oxide. Evaluation of the impact of the full test-treatment pathway (diagnostic accuracy, burden of the test, natural course of target condition, treatment effectiveness, and link between test result and administration of treatment) on patient relevant outcomes was considered best practice for developing medical test recommendations.

RESULTS

We retrieved 15 recommendations in 15 CPGs. The methodological quality of the CPGs varied from poor to excellent. Ten recommendations considered diagnostic accuracy. Four of these were funded on a systematic review and rating of the certainty in the evidence. None of the CPGs evaluated all steps of the test-treatment pathway. Burden of the test was considered in three CPGs, but without systematically reviewing the evidence. Natural course was considered in two CPGs, without a systematic review of the evidence. In three recommendations, treatment effectiveness was considered, supported with a systematic review and rating of the certainty in the evidence in one CPG. The link between test result and treatment administration was not considered in any CPG.

CONCLUSIONS

The included CPGs hardly seem to consider evidence about test consequences on patient-relevant outcomes. This might be explained by reporting issues and challenging methodology. Future research is needed to investigate how to facilitate guideline developers in explicit reliable consideration of all steps of a test-treatment pathway when developing diagnostic test recommendations.