Process Evaluation of the Diabetes Canada Guidelines Dissemination Strategy Using the Reach Effectiveness Adoption Implementation Maintenance (RE-AIM) Framework

Effective web-based clinical practice guidelines resources: recommendations from a mixed methods usability study

BACKGROUND

Clinical practice guidelines (CPG) are an important knowledge translation resource to help clinicians stay up to date about relevant clinical knowledge. Effective communication of guidelines, including format, facilitates its implementation. Despite the digitalization of healthcare, there is little literature to guide CPG website creation for effective dissemination and implementation. Our aim was to assess the effectiveness of the content and format of the Diabetes Canada CPG website, and use our results to inform recommendations for other CPG websites.

METHODS

Fourteen clinicians (family physicians, nurses, pharmacists, and dieticians) in diabetes care across Canada participated in this mixed-methods study (questionnaires, usability testing and interviews). Participants "thought-aloud" while completing eight usability tasks on the CPG website. Outcomes included task success rate, completion time, click per tasks, resource used, paths, search attempts and success rate, and error types. Participants were then interviewed.

RESULTS

The Diabetes Canada CPG website was found to be usable. Participants had a high task success rate of 79% for all tasks and used 144 (standard deviation (SD) = 152) seconds and 4.6 (SD = 3.9) clicks per task. Interactive tools were most frequently used compared to full guidelines and static tools. Misinterpretation accounted for 48% of usability errors. Participants overall found the website intuitive, with effective content and design elements.

CONCLUSION

Different versions of CPG information (e.g. interactive tools, quick reference guide, static tools) can help answer clinical questions more quickly. Effective web design should be assessed during CPG website creation for effective guideline dissemination and implementation.

Process Evaluation in Health Communication Media Campaigns: A Systematic Review

Objective. The objective is to examine the scope of health communication media campaign process evaluation methods, findings, and dissemination practices. Data Source. A systematic review of peer-reviewed literature was conducted using database searches. Study Inclusion and Exclusion Criteria. Published studies on process and implementation evaluation of health campaigns with a media component were included. Exclusion criteria included not health, non-empirical, no media campaign, or a focus on other evaluation types. Data Extraction. Articles were assessed for general campaign information, theory use, and details about process evaluation plan and procedures. Data Synthesis. A coding scheme based on 9 process evaluation best practice elements (e.g., fidelity and context) was applied. Process evaluation methods, measures, and reporting themes were synthesized. Results. Among 691 unique records, 46 articles were included. Process evaluation was the main focus for 71.7% of articles, yet only 39.1% reported how process evaluation informed campaign implementation strategy. Articles reported 4.39 elements on average (SD = 1.99; range 1-9), with reach (87.0%) and recruitment (73.9%) described most frequently, yet reporting was inconsistent. Further, the level of detail in reporting methods, theory, and analysis varied. Conclusions. Process evaluation provides insight about mechanisms and intervening variables that could meaningfully impact interpretations of outcome evaluations; however, process evaluations are less often included in literature. Recommendations for evidence-based process evaluation components to guide evaluation are discussed.

Potential diabetes overtreatment and risk of adverse events among older adults in Ontario: a population-based study

AIMS/HYPOTHESIS

More than 25% of older adults (age ≥75 years) have diabetes and may be at risk of adverse events related to treatment. The aim of this study was to assess the prevalence of intensive glycaemic control in this group, potential overtreatment among older adults and the impact of overtreatment on the risk of serious events.

METHODS

We conducted a retrospective, population-based cohort study of community-dwelling older adults in Ontario using administrative data. Participants were ≥75 years of age with diagnosed diabetes treated with at least one anti-hyperglycaemic agent between 2014 and 2015. Individuals were categorised as having intensive or conservative glycaemic control (HbA_1c <53 mmol/mol [<7%] or 54-69 mmol/mol [7.1-8.5%], respectively), and as undergoing treatment with high-risk (i.e. insulin, sulfonylureas) or low-risk (other) agents. We measured the composite risk of emergency department visits, hospitalisations, or death within 30 days of reaching intensive glycaemic control with high-risk agents.

RESULTS

Among 108,620 older adults with diagnosed diabetes in Ontario, the mean (± SD) age was 80.6 (±4.5) years, 49.7% were female, and mean (± SD) diabetes duration was 13.7 (±6.3) years. Overall, 61% of individuals were treated to intensive glycaemic control and 21.6% were treated to intensive control using high-risk agents. Using inverse probability treatment weighting with propensity scores, intensive control with high-risk agents was associated with nearly 50% increased risk of the composite outcome compared with conservative glycaemic control with low-risk agents (RR 1.49, 95% CI 1.08, 2.05).

CONCLUSIONS/INTERPRETATION

Our findings underscore the need to re-evaluate glycaemic targets in older adults and to reconsider the use of anti-hyperglycaemic medications that may lead to hypoglycaemia, especially in setting of intensive glycaemic control.

Impact of Clinical Practice Guidelines on Blood Glucose Test Strip Prescription Rates in Manitoba and Saskatchewan (Canada): An Interrupted Time-Series Analysis

OBJECTIVES

Our aim in this study was to assess the impact of the Diabetes Canada Dissemination & Implementation strategy on population-level prescription rates of blood glucose test strips.

METHODS

We extracted all diabetes-related drugs and test strip claims in Manitoba and Saskatchewan between January 1, 2000 and September 30, 2015 from the Canadian Institute for Health Information's National Prescription Drug Utilization Information System. The primary outcome was the proportion of the cohort in each quarter who had been dispensed strips in accordance with the Diabetes Canada 2013 guidelines. We conducted an interrupted time-series analysis examining prescribing trends overall and by drug groups.

RESULTS

The overall average sample size per quarter was 57,576 (standard deviation [SD]=12,320) and 49,533 (SD=10,206) individuals; the average age was 62.1 (SD=0.3) and 63.8 (SD=0.3) years, and the average proportion of total beneficiaries in the sample was 12.7% (SD=1.9%) and 12.6% (SD=1.7%) for Manitoba and Saskatchewan, respectively. On average preintervention, 27.9% (SD=0.68%, Manitoba) and 31.9% (SD=0.73%, Saskatchewan) of the sampled patients used strips according to the guidelines. On average postintervention, 26.5% (SD=0.29%, Manitoba) and 30.6% (SD=0.53%, Saskatchewan) of the patients used strips according to the guidelines. None of the interrupted time-series models reached statistical significance (p values ranging from 0.44 to 0.98 for Manitoba and 0.13 to 0.81 for Saskatchewan, depending on drug group).

CONCLUSIONS

The guideline and its Dissemination & Implementation strategy did not change strip prescribing. Potential reasons include complexity of the recommendations, lack of penetrance to primary care physicians and/or disagreement with recommendations.

Impact of a Comprehensive Guideline Dissemination Strategy on Diabetes Diagnostic Test Rates: an Interrupted Time Series

BACKGROUND

Diabetes Canada launched a comprehensive Dissemination and Implementation (D&I) strategy to optimize uptake of their 2013 Clinical Practice Guidelines; the strategy involved continuing professional development courses, webinars, an interactive website, applications for mobile devices, point-of-care decision support tools, and media awareness campaigns. It included a focus on promoting HbA1c as the recommended diagnostic test for diabetes.

OBJECTIVE

To determine the impact of Diabetes Canada's 2013 D&I strategy on physician test-ordering behavior, specifically HbA1c testing, for the diagnosis of diabetes, using provincial healthcare administrative data.

DESIGN

Population-based interrupted time series.

SETTING

Ontario, Canada.

PARTICIPANTS

Ontario residents aged 40-79 not previously diagnosed with diabetes.

MEASUREMENTS

For each quarter between January 2005 and December 2014, we conducted an interrupted time series analysis on the first-order difference of the proportion of patients receiving HbA1c tests per quarter with an autoregressive integrated moving average model with the intervention step occurring in quarter 2 of 2013. Subgroup analyses by rurality, physician graduation year, and practice size were also conducted.

RESULTS

There were 32 quarters pre-intervention and 6 post-intervention; average sample size per quarter was 5,298,686 individuals. Pre-intervention, the quarter-to-quarter growth was 1.51 HbA1c tests per quarter per 1000 people. Post-intervention, the quarter-to-quarter growth increased by 8.45 tests per 1000 people (p < 0.005). Growth of HbA1c ordering differed significantly by region, years since physician graduation, and practice size.

LIMITATIONS

Incomplete data collection, inadequate stratification, and other unidentified confounders.

CONCLUSION

The D&I strategy resulted in a significant increase in the growth of HbA1c tests. The successful uptake of this recommendation may be due to its simplicity; guideline developers should consider this when drafting recommendations. Furthermore, differential uptake by user groups suggests that future strategies should include targeted barrier analysis and interventions to these groups.

Environmental Scan on Canadian Interactive Knowledge Translation Tools to Prevent Diabetes Complications in Patients With Diabetes

In this study, we identify existing interactive knowledge translation tools that could help patients and health-care professionals to prevent diabetes complications in the Canadian context. We conducted an environmental scan in collaboration with researchers and 4 patient partners across Canada. We conducted searches among the research team members, their networks and Twitter, and through searches in databases and Google. To be included, interactive knowledge translation tools had to meet the following criteria: used to prevent diabetes complications; used in a real-life setting; used any instructional method or material; had relevance in the Canadian context, written in English or French; developed and/or published by experts in diabetes complications or by a recognized organization; created in 2013 or after; and accessibility online or on paper. Two reviewers independently screened each record for selection and extracted the following data: authorship, objective(s), patients' characteristics, type of diabetes complications targeted, type of knowledge users targeted and tool characteristics. We used simple descriptive statistics to summarize our results. Thirty-one of the 1,700 potentially eligible interactive knowledge translation tools were included in the scan. Tool formats included personal notebook, interactive case study, risk assessment tool, clinical pathway, decision support tool, knowledge quiz and checklist. Diabetes complications targeted by the tools included foot-related neuropathy, cardiovascular diseases, mental disorders and distress and any complications related to diabetes and kidney disease. Our results inform Canadian stakeholders interested in the prevention of diabetes complications to avoid unnecessary duplication, identify gaps in knowledge and support implementation of these tools in clinical and patients' decision-making.