Teleconferenced educational detailing: diabetes education for primary care physicians

Quality improvement strategies for diabetes care: Effects on outcomes for adults living with diabetes

BACKGROUND

There is a large body of evidence evaluating quality improvement (QI) programmes to improve care for adults living with diabetes. These programmes are often comprised of multiple QI strategies, which may be implemented in various combinations. Decision-makers planning to implement or evaluate a new QI programme, or both, need reliable evidence on the relative effectiveness of different QI strategies (individually and in combination) for different patient populations.

OBJECTIVES

To update existing systematic reviews of diabetes QI programmes and apply novel meta-analytical techniques to estimate the effectiveness of QI strategies (individually and in combination) on diabetes quality of care.

SEARCH METHODS

We searched databases (CENTRAL, MEDLINE, Embase and CINAHL) and trials registers (ClinicalTrials.gov and WHO ICTRP) to 4 June 2019. We conducted a top-up search to 23 September 2021; we screened these search results and 42 studies meeting our eligibility criteria are available in the awaiting classification section.

SELECTION CRITERIA

We included randomised trials that assessed a QI programme to improve care in outpatient settings for people living with diabetes. QI programmes needed to evaluate at least one system- or provider-targeted QI strategy alone or in combination with a patient-targeted strategy. - System-targeted: case management (CM); team changes (TC); electronic patient registry (EPR); facilitated relay of clinical information (FR); continuous quality improvement (CQI). - Provider-targeted: audit and feedback (AF); clinician education (CE); clinician reminders (CR); financial incentives (FI). - Patient-targeted: patient education (PE); promotion of self-management (PSM); patient reminders (PR). Patient-targeted QI strategies needed to occur with a minimum of one provider or system-targeted strategy.

DATA COLLECTION AND ANALYSIS

We dual-screened search results and abstracted data on study design, study population and QI strategies. We assessed the impact of the programmes on 13 measures of diabetes care, including: glycaemic control (e.g. mean glycated haemoglobin (HbA1c)); cardiovascular risk factor management (e.g. mean systolic blood pressure (SBP), low-density lipoprotein cholesterol (LDL-C), proportion of people living with diabetes that quit smoking or receiving cardiovascular medications); and screening/prevention of microvascular complications (e.g. proportion of patients receiving retinopathy or foot screening); and harms (e.g. proportion of patients experiencing adverse hypoglycaemia or hyperglycaemia). We modelled the association of each QI strategy with outcomes using a series of hierarchical multivariable meta-regression models in a Bayesian framework. The previous version of this review identified that different strategies were more or less effective depending on baseline levels of outcomes. To explore this further, we extended the main additive model for continuous outcomes (HbA1c, SBP and LDL-C) to include an interaction term between each strategy and average baseline risk for each study (baseline thresholds were based on a data-driven approach; we used the median of all baseline values reported in the trials). Based on model diagnostics, the baseline interaction models for HbA1c, SBP and LDL-C performed better than the main model and are therefore presented as the primary analyses for these outcomes. Based on the model results, we qualitatively ordered each QI strategy within three tiers (Top, Middle, Bottom) based on its magnitude of effect relative to the other QI strategies, where 'Top' indicates that the QI strategy was likely one of the most effective strategies for that specific outcome. Secondary analyses explored the sensitivity of results to choices in model specification and priors.  Additional information about the methods and results of the review are available as Appendices in an online repository. This review will be maintained as a living systematic review; we will update our syntheses as more data become available.

MAIN RESULTS

We identified 553 trials (428 patient-randomised and 125 cluster-randomised trials), including a total of 412,161 participants. Of the included studies, 66% involved people living with type 2 diabetes only. Participants were 50% female and the median age of participants was 58.4 years. The mean duration of follow-up was 12.5 months. HbA1c was the commonest reported outcome; screening outcomes and outcomes related to cardiovascular medications, smoking and harms were reported infrequently. The most frequently evaluated QI strategies across all study arms were PE, PSM and CM, while the least frequently evaluated QI strategies included AF, FI and CQI. Our confidence in the evidence is limited due to a lack of information on how studies were conducted.  Four QI strategies (CM, TC, PE, PSM) were consistently identified as 'Top' across the majority of outcomes. All QI strategies were ranked as 'Top' for at least one key outcome. The majority of effects of individual QI strategies were modest, but when used in combination could result in meaningful population-level improvements across the majority of outcomes. The median number of QI strategies in multicomponent QI programmes was three.  Combinations of the three most effective QI strategies were estimated to lead to the below effects:  - PR + PSM + CE: decrease in HbA1c by 0.41% (credibility interval (CrI) -0.61 to -0.22) when baseline HbA1c < 8.3%; - CM + PE + EPR: decrease in HbA1c by 0.62% (CrI -0.84 to -0.39) when baseline HbA1c > 8.3%;  - PE + TC + PSM: reduction in SBP by 2.14 mmHg (CrI -3.80 to -0.52) when baseline SBP < 136 mmHg; - CM + TC + PSM: reduction in SBP by 4.39 mmHg (CrI -6.20 to -2.56) when baseline SBP > 136 mmHg;  - TC + PE + CM: LDL-C lowering of 5.73 mg/dL (CrI -7.93 to -3.61) when baseline LDL < 107 mg/dL; - TC + CM + CR: LDL-C lowering by 5.52 mg/dL (CrI -9.24 to -1.89) when baseline LDL > 107 mg/dL. Assuming a baseline screening rate of 50%, the three most effective QI strategies were estimated to lead to an absolute improvement of 33% in retinopathy screening (PE + PR + TC) and 38% absolute increase in foot screening (PE + TC + Other).

AUTHORS' CONCLUSIONS

There is a significant body of evidence about QI programmes to improve the management of diabetes. Multicomponent QI programmes for diabetes care (comprised of effective QI strategies) may achieve meaningful population-level improvements across the majority of outcomes. For health system decision-makers, the evidence summarised in this review can be used to identify strategies to include in QI programmes. For researchers, this synthesis identifies higher-priority QI strategies to examine in further research regarding how to optimise their evaluation and effects. We will maintain this as a living systematic review.

Rethinking Context in Continuing Professional Development: From Identifying Barriers to Understanding Social Dynamics

INTRODUCTION

For continuing professional development (CPD) to reach its potential to improve outcomes requires an understanding of the role of context and the influencing conditions that enable interventions to succeed. We argue that the heuristic use of frameworks to design and implement interventions tends to conceptualize context as defined lists of barriers, which may obscure consideration of how different contextual factors interact with and intersect with each other.

METHODS

We suggest a framework approach that would benefit from postmodernist theory that explores how ideologies, meanings, and social structures in health care settings shape social practices. As an illustrative example, we conducted a Foucauldian discourse analysis of diabetes care to make visible how the social, historical, and political conditions in which clinicians experience, practice, and shape possibilities for behavior change.

RESULTS

The discursive construction of continuing education as a knowledge translation mechanism assumes and is contingent on family physicians to implement guidelines. However, they enact other discursively constituted roles that may run in opposition. This paradoxical position creates a tension that must be navigated by family physicians, who may perceive it possible to provide good care without necessarily implementing guidelines.

DISCUSSION

We suggest marrying "framework" thinking with postmodernist theory that explores how ideologies, meanings, and social structures shape practice behavior change. Such a proposed reconceptualization of context in the design of continuing professional development interventions could provide a more robust and nuanced understanding of how the dynamic relationships and interactions between clinicians, patients, and their work environments shape educational effectiveness.

The Educational Impact of Web-Based, Faculty-Led Continuing Medical Education Programs in Type 2 Diabetes: A Survey Study to Analyze Changes in Knowledge, Competence, and Performance of Health Care Professionals

BACKGROUND

The treatment landscape for type 2 diabetes (T2D) is continually evolving; therefore, ongoing education of health care professionals (HCPs) is essential. There is growing interest in measuring the impact of educational activities, such as through use of the Moore framework; however, data on the benefits of continuing medical education (CME) in the management of T2D remain limited.

OBJECTIVE

This study aimed to evaluate HCP satisfaction; measure improvements in knowledge, competence, and performance following short, case-based, multidisciplinary web-based CME activities; and identify the remaining educational gaps.

METHODS

Two faculty-led, CME-accredited, web-based educational activities on T2D and obesity, touchIN CONVERSATION and touch MultiDisciplinary Team, were developed and made available on a free-to-access medical education website. Each activity comprised 3 videos lasting 10 to 15 minutes, which addressed learning objectives developed based on a review of published literature and faculty feedback. Participant satisfaction (Moore level 2) was evaluated using a postactivity questionnaire. For both activities, changes in knowledge and competence (Moore levels 3 and 4) were assessed using questionnaires completed by representative HCPs before or after participation in the activities. A second set of HCPs completed a questionnaire before and after engaging in activities that assessed changes in self-reported performance (Moore level 5).

RESULTS

Each activity was viewed by approximately 6000 participants within 6 months. The participants expressed high levels of satisfaction (>80%) with both activities. Statistically significant improvements from baseline in knowledge and competence were reported following participation in touchIN CONVERSATION (mean score, SD before vs after activity: 4.36, 1.40 vs 5.42, 1.37; P<.001), with the proportion of learners answering at least six of 7 questions correctly, increasing from 22% (11/50) to 60% (30/50). A nonsignificant improvement in knowledge and competence was observed following participation in touch MultiDisciplinary Team (mean score, SD 4.36, 1.24 vs 4.58, 1.07; P=.35); however, baseline knowledge and competence were relatively high, where 80% of the respondents (40/50) answered at least four of 6 questions correctly. A significant improvement in HCP self-reported performance was observed in a combined analysis of both activities (mean score, SD 2.65, 1.32 vs 3.15, 1.26; P=.03), with the proportion of learners selecting the answer representing the best clinical option for all 4 questions increasing from 32% (11/34) to 59% (20/34) after the activity. Several unmet educational needs were self-reported or identified from the analysis of incorrectly answered questions, including setting individualized glycemic targets and the potential benefits of sodium-glucose cotransporter 2 inhibitor therapies.

CONCLUSIONS

Short, case-based, web-based CME activities designed for HCPs to fit their clinical schedules achieved improvements in knowledge, competence, and self-reported performance in T2D management. Ongoing educational needs identified included setting individualized glycemic targets and the potential benefits of sodium-glucose cotransporter 2 inhibitor therapies.

What works to increase attendance for diabetic retinopathy screening? An evidence synthesis and economic analysis

BACKGROUND

Diabetic retinopathy screening (DRS) is effective but uptake is suboptimal.

OBJECTIVES

To determine the effectiveness of quality improvement (QI) interventions for DRS attendance; describe the interventions in terms of QI components and behaviour change techniques (BCTs); identify theoretical determinants of attendance; investigate coherence between BCTs identified in interventions and determinants of attendance; and determine the cost-effectiveness of QI components and BCTs for improving DRS.

DATA SOURCES AND REVIEW METHODS

Phase 1 - systematic review of randomised controlled trials (RCTs) evaluating interventions to increase DRS attendance (The Cochrane Library, MEDLINE, EMBASE and trials registers to February 2017) and coding intervention content to classify QI components and BCTs. Phase 2 - review of studies reporting factors influencing attendance, coded to theoretical domains (MEDLINE, EMBASE, PsycINFO and sources of grey literature to March 2016). Phase 3 - mapping BCTs (phase 1) to theoretical domains (phase 2) and an economic evaluation to determine the cost-effectiveness of BCTs or QI components.

RESULTS

Phase 1 - 7277 studies were screened, of which 66 RCTs were included in the review. Interventions were multifaceted and targeted patients, health-care professionals (HCPs) or health-care systems. Overall, interventions increased DRS attendance by 12% [risk difference (RD) 0.12, 95% confidence interval (CI) 0.10 to 0.14] compared with usual care, with substantial heterogeneity in effect size. Both DRS-targeted and general QI interventions were effective, particularly when baseline attendance levels were low. All commonly used QI components and BCTs were associated with significant improvements, particularly in those with poor attendance. Higher effect estimates were observed in subgroup analyses for the BCTs of 'goal setting (outcome, i.e. consequences)' (RD 0.26, 95% CI 0.16 to 0.36) and 'feedback on outcomes (consequences) of behaviour' (RD 0.22, 95% CI 0.15 to 0.29) in interventions targeting patients and of 'restructuring the social environment' (RD 0.19, 95% CI 0.12 to 0.26) and 'credible source' (RD 0.16, 95% CI 0.08 to 0.24) in interventions targeting HCPs. Phase 2 - 3457 studies were screened, of which 65 non-randomised studies were included in the review. The following theoretical domains were likely to influence attendance: 'environmental context and resources', 'social influences', 'knowledge', 'memory, attention and decision processes', 'beliefs about consequences' and 'emotions'. Phase 3 - mapping identified that interventions included BCTs targeting important barriers to/enablers of DRS attendance. However, BCTs targeting emotional factors around DRS were under-represented. QI components were unlikely to be cost-effective whereas BCTs with a high probability (≥ 0.975) of being cost-effective at a societal willingness-to-pay threshold of £20,000 per QALY included 'goal-setting (outcome)', 'feedback on outcomes of behaviour', 'social support' and 'information about health consequences'. Cost-effectiveness increased when DRS attendance was lower and with longer screening intervals.

LIMITATIONS

Quality improvement/BCT coding was dependent on descriptions of intervention content in primary sources; methods for the identification of coherence of BCTs require improvement.

CONCLUSIONS

Randomised controlled trial evidence indicates that QI interventions incorporating specific BCT components are associated with meaningful improvements in DRS attendance compared with usual care. Interventions generally used appropriate BCTs that target important barriers to screening attendance, with a high probability of being cost-effective. Research is needed to optimise BCTs or BCT combinations that seek to improve DRS attendance at an acceptable cost. BCTs targeting emotional factors represent a missed opportunity to improve attendance and should be tested in future studies.

STUDY REGISTRATION

This study is registered as PROSPERO CRD42016044157 and PROSPERO CRD42016032990.

FUNDING

The National Institute for Health Research Health Technology Assessment programme.

Interventions to increase attendance for diabetic retinopathy screening

BACKGROUND

Despite evidence supporting the effectiveness of diabetic retinopathy screening (DRS) in reducing the risk of sight loss, attendance for screening is consistently below recommended levels.

OBJECTIVES

The primary objective of the review was to assess the effectiveness of quality improvement (QI) interventions that seek to increase attendance for DRS in people with type 1 and type 2 diabetes.Secondary objectives were:To use validated taxonomies of QI intervention strategies and behaviour change techniques (BCTs) to code the description of interventions in the included studies and determine whether interventions that include particular QI strategies or component BCTs are more effective in increasing screening attendance;To explore heterogeneity in effect size within and between studies to identify potential explanatory factors for variability in effect size;To explore differential effects in subgroups to provide information on how equity of screening attendance could be improved;To critically appraise and summarise current evidence on the resource use, costs and cost effectiveness.

SEARCH METHODS

We searched the Cochrane Library, MEDLINE, Embase, PsycINFO, Web of Science, ProQuest Family Health, OpenGrey, the ISRCTN, ClinicalTrials.gov, and the WHO ICTRP to identify randomised controlled trials (RCTs) that were designed to improve attendance for DRS or were evaluating general quality improvement (QI) strategies for diabetes care and reported the effect of the intervention on DRS attendance. We searched the resources on 13 February 2017. We did not use any date or language restrictions in the searches.

SELECTION CRITERIA

We included RCTs that compared any QI intervention to usual care or a more intensive (stepped) intervention versus a less intensive intervention.

DATA COLLECTION AND ANALYSIS

We coded the QI strategy using a modification of the taxonomy developed by Cochrane Effective Practice and Organisation of Care (EPOC) and BCTs using the BCT Taxonomy version 1 (BCTTv1). We used Place of residence, Race/ethnicity/culture/language, Occupation, Gender/sex, Religion, Education, Socioeconomic status, and Social capital (PROGRESS) elements to describe the characteristics of participants in the included studies that could have an impact on equity of access to health services.Two review authors independently extracted data. One review author entered the data into Review Manager 5 and a second review author checked them. Two review authors independently assessed risks of bias in the included studies and extracted data. We rated certainty of evidence using GRADE.

MAIN RESULTS

We included 66 RCTs conducted predominantly (62%) in the USA. Overall we judged the trials to be at low or unclear risk of bias. QI strategies were multifaceted and targeted patients, healthcare professionals or healthcare systems. Fifty-six studies (329,164 participants) compared intervention versus usual care (median duration of follow-up 12 months). Overall, DRS attendance increased by 12% (risk difference (RD) 0.12, 95% confidence interval (CI) 0.10 to 0.14; low-certainty evidence) compared with usual care, with substantial heterogeneity in effect size. Both DRS-targeted (RD 0.17, 95% CI 0.11 to 0.22) and general QI interventions (RD 0.12, 95% CI 0.09 to 0.15) were effective, particularly where baseline DRS attendance was low. All BCT combinations were associated with significant improvements, particularly in those with poor attendance. We found higher effect estimates in subgroup analyses for the BCTs 'goal setting (outcome)' (RD 0.26, 95% CI 0.16 to 0.36) and 'feedback on outcomes of behaviour' (RD 0.22, 95% CI 0.15 to 0.29) in interventions targeting patients, and 'restructuring the social environment' (RD 0.19, 95% CI 0.12 to 0.26) and 'credible source' (RD 0.16, 95% CI 0.08 to 0.24) in interventions targeting healthcare professionals.Ten studies (23,715 participants) compared a more intensive (stepped) intervention versus a less intensive intervention. In these studies DRS attendance increased by 5% (RD 0.05, 95% CI 0.02 to 0.09; moderate-certainty evidence).Fourteen studies reporting any QI intervention compared to usual care included economic outcomes. However, only five of these were full economic evaluations. Overall, we found that there is insufficient evidence to draw robust conclusions about the relative cost effectiveness of the interventions compared to each other or against usual care.With the exception of gender and ethnicity, the characteristics of participants were poorly described in terms of PROGRESS elements. Seventeen studies (25.8%) were conducted in disadvantaged populations. No studies were carried out in low- or middle-income countries.

AUTHORS' CONCLUSIONS

The results of this review provide evidence that QI interventions targeting patients, healthcare professionals or the healthcare system are associated with meaningful improvements in DRS attendance compared to usual care. There was no statistically significant difference between interventions specifically aimed at DRS and those which were part of a general QI strategy for improving diabetes care. This is a significant finding, due to the additional benefits of general QI interventions in terms of improving glycaemic control, vascular risk management and screening for other microvascular complications. It is likely that further (but smaller) improvements in DRS attendance can also be achieved by increasing the intensity of a particular QI component or adding further components.

InsuOnline, an Electronic Game for Medical Education on Insulin Therapy: A Randomized Controlled Trial With Primary Care Physicians

BACKGROUND

Most patients with diabetes mellitus (DM) are followed by primary care physicians, who often lack knowledge or confidence to prescribe insulin properly. This contributes to clinical inertia and poor glycemic control. Effectiveness of traditional continuing medical education (CME) to solve that is limited, so new approaches are required. Electronic games are a good option, as they can be very effective and easily disseminated.

OBJECTIVE

The objective of our study was to assess applicability, user acceptance, and educational effectiveness of InsuOnline, an electronic serious game for medical education on insulin therapy for DM, compared with a traditional CME activity.

METHODS

Primary care physicians (PCPs) from South of Brazil were invited by phone or email to participate in an unblinded randomized controlled trial and randomly allocated to play the game InsuOnline, installed as an app in their own computers, at the time of their choice, with minimal or no external guidance, or to participate in a traditional CME session, composed by onsite lectures and cases discussion. Both interventions had the same content and duration (~4 h). Applicability was assessed by the number of subjects who completed the assigned intervention in each group. Insulin-prescribing competence (factual knowledge, problem-solving skills, and attitudes) was self-assessed through a questionnaire applied before, immediately after, and 3 months after the interventions. Acceptance of the intervention (satisfaction and perceived importance for clinical practice) was also assessed immediately after and 3 months after the interventions, respectively.

RESULTS

Subjects' characteristics were similar between groups (mean age 38, 51.4% [69/134] male). In the game group, 69 of 88 (78%) completed the intervention, compared with 65 of 73 (89%) in the control group, with no difference in applicability. Percentage of right answers in the competence subscale, which was 52% at the baseline in both groups, significantly improved immediately after both interventions to 92% in the game group and to 85% in control (P<.001). After 3 months, it remained significantly higher than that at the baseline in both groups (80% in game, and 76% in control; P<.001). Absolute increase in competence score was better with the game (40%) than with traditional CME (34%; P=.01). Insulin-related attitudes were improved both after the game (significant improvement in 4 of 9 items) and after control activity (3 of 9). Both interventions were very well accepted, with most subjects rating them as "fun or pleasant," "useful," and "practice-changing."

CONCLUSIONS

The game InsuOnline was applicable, very well accepted, and highly effective for medical education on insulin therapy. In view of its flexibility and easy dissemination, it is a valid option for large-scale CME, potentially helping to reduce clinical inertia and to improve quality of care for DM patients.

TRIAL REGISTRATION

Clinicaltrials.gov NCT001759953; https://clinicaltrials.gov/ct2/show/NCT01759953 (Archived by WebCite at http://www.webcitation.org/6oeHoTrBf).

Impact of a primary healthcare quality improvement program on diabetes in Canada: evaluation of the Quality Improvement and Innovation Partnership (QIIP)

OBJECTIVE

Primary healthcare (PHC) quality improvement (QI) initiatives are designed to improve patient care and health outcomes. We evaluated the Quality Improvement and Innovation Partnership (QIIP), an Ontario-wide PHC QI program on access to care, diabetes management and colorectal cancer screening. This manuscript highlights the impact of QIIP on diabetes outcomes and associated vascular risk factors.

RESEARCH DESIGN AND METHODS

A cluster matched-control, retrospective prechart and postchart audit was conducted. One physician per QIIP-PHC team (N=34) and control (N=34) were recruited for the audit. Eligible charts were reviewed for prespecified type 2 diabetes mellitus clinical process and outcome data at baseline, during (intervention range: 15-17.5 months) and post. Primary outcome measures were the A1c of patients above study target and proportion of patients with an annual foot exam. Secondary outcome measures included glycemic, hypertension and lipid outcomes and management, screening for diabetes-related complications, healthcare utilization, and diabetes counseling, education and self-management goal setting.

RESULTS

More patients in the QIIP group achieved statistically improved lipid testing, eye examinations, peripheral neuropathy exams, and documented body mass index. No statistical differences in A1c, low-density lipoprotein or systolic/diastolic blood pressure values were noted, with no significant differences in medication prescription, specialist referrals, or chart-reported diabetes counseling, education or self-management goals. Patients of QIIP physicians had significantly more PHC visits.

CONCLUSION

The QIIP-learning collaborative program evaluation using stratified random selection of participants and the inclusion of a control group makes this one of the most rigorous and promising efforts to date evaluating the impact of a QI program in PHC. The chart audit component of this evaluation highlighted that while QIIP improved some secondary diabetes measures, no improvements in clinical outcomes were noted. This study highlights the importance of formalized evaluation of QI initiatives to provide an evidence base to inform future program planning and scale-up.

Cluster-randomized trial to improve the quality of diabetes management: The study for the efficacy assessment of the standard diabetes manual (SEAS-DM)

Aims/Introduction

‘The Standard Diabetes Manual’ has been developed by clinical researchers from multiple major institutions in Japan, such as the National Center for Global Health and Medicine, as a comprehensive disease management program, including collaboration between primary care physicians (PCPs) and specialist services. The present study evaluated the efficacy of the manual as a quality improvement strategy in diabetes care by PCPs.

Materials and Methods

A total of 42 PCPs in eight domestic districts of the Japan Medical Association were allocated to either the intervention group or the control group in a cluster‐randomized design. The PCPs in both groups were provided with a copy of the Diabetes Treatment Guide published by the Japan Diabetes Society, and the PCPs in the intervention group additionally received a copy of the manual and a 30‐min relevant seminar at the inception of the intervention. The primary end‐point was the adherence to the following performances as quality indicators: evaluation of retinopathy, and urinary albumin excretion measurements and serum creatinine measurements, as recommended by the Japan Medical Association.

Results

A total of 416 patients were enrolled by 36 PCPs. During the 1‐year follow‐up period, the proportion of PCPs who adhered to recommendation‐concordant measurements of urinary albumin excretion was significantly higher in the intervention group than in the control group (adherence: 17.9% vs 5.3%, P = 0.016). The other parameters were not statistically different between the two groups.

Conclusions

Implementation of ‘The Standard Diabetes Manual’ potentially leads to an improved quality of diabetes management by PCPs.

Interventions to improve adherence to cardiovascular disease guidelines: a systematic review

BACKGROUND

Successful management of cardiovascular disease (CVD) is impaired by poor adherence to clinical practice guidelines. The objective of our review was to synthesize evidence about the effectiveness of interventions that target healthcare providers to improve adherence to CVD guidelines and patient outcomes.

METHODS

We searched PubMed, EMBASE, Cochrane Library, PsycINFO, Web of Science and CINAHL databases from inception to June 2014, using search terms related to adherence and clinical practice guidelines. Studies were limited to randomized controlled trials testing an intervention to improve adherence to guidelines that measured both a patient and adherence outcome. Descriptive summary tables were created from data extractions. Meta-analyses were conducted on clinically homogeneous comparisons, and sensitivity analyses and subgroup analyses were carried out where possible. GRADE summary of findings tables were created for each comparison and outcome.

RESULTS AND DISCUSSION

We included 38 RCTs in our review. Interventions included guideline dissemination, education, audit and feedback, and academic detailing. Meta-analyses were conducted for several outcomes by intervention type. Many comparisons favoured the intervention, though only the adherence outcome for the education intervention showed statistically significant improvement compared to usual care (standardized mean difference = 0.58 [95 % confidence interval 0.35 to 0.8]).

CONCLUSIONS

Many interventions show promise to improve practitioner adherence to CVD guidelines. The quality of evidence and number of trials limited our ability to draw conclusions.

Type 2 diabetes continuing medical education for general practitioners: what works? A systematic review

AIMS

To perform a systematic review of studies that have assessed the effectiveness of interventions designed to improve healthcare professionals' care of patients with diabetes and to assess the effects of educational interventions targeted at general practitioners' diabetes management.

METHODS

A computer search was conducted using the Cochrane Library, PubMed, Ovid MEDLINE, Scopus, EMBASE, Informit, Google scholar and ERIC from the earliest date of each database up until 2013. A supplementary review of reference lists from each article obtained was also carried out. Measured changes in general practitioners' satisfaction, knowledge, practice behaviours and patient outcomes were recorded.

RESULTS

Thirteen out of 1255 studies met the eligibility criteria, but none was specifically conducted in rural or remote areas. Ten studies were randomized trials. Fewer than half of the studies (5/13, 38.5%) reported a significant improvement in at least one of the following outcome categories: satisfaction with the programme, knowledge and practice behaviour. There was little evidence of the impact of general practitioner educational interventions on patient outcomes. Of the five studies that examined patient outcomes, only one reported a positive impact: a reduction in patient HbA1c levels.

CONCLUSIONS

Few studies examined the effectiveness of general practitioner Type 2 diabetes education in improving general practitioner satisfaction, knowledge, practices and/or patient outcomes. Evidence to support the effectiveness of education is partial and weak. To determine effective strategies for general practitioner education related to Type 2 diabetes, further well designed studies, accompanied by valid and reliable evaluation methods, are needed.

Shared care combined with telecare improves glycemic control of diabetic patients in a rural underserved community

OBJECTIVE

To investigate the effectiveness of shared care combined with telecare in type 2 diabetic patients in an underserved community in Asia.

RESEARCH DESIGN AND METHODS

In total, 95 patients with type 2 diabetes who had a glycosylated hemoglobin (HbA1c) level of >7% were recruited from six community health centers in remote areas in Changhua County, Taiwan. All patients were randomly divided into intervention (shared care combined with telecare) and usual-care groups and followed up for 6 months.

RESULTS

The decrease in HbA1c level was significantly greater in the intervention group than in the usual-care group (0.7 ± 1.3% versus 0.1 ± 1.0%, p=0.03). There were no significant differences in lipid profiles and blood pressure changes between the two groups.

CONCLUSIONS

Shared care combined with telecare could significantly reduce HbA1c levels in type 2 diabetic patients with poor glycemic control in underserved rural communities. Further studies should be conducted to clarify the target users and to develop cost-effective interventions.

InsuOnline, a Serious Game to Teach Insulin Therapy to Primary Care Physicians: Design of the Game and a Randomized Controlled Trial for Educational Validation

Background

Physicians´ lack of knowledge contributes to underuse of insulin and poor glycemic control in adults with diabetes mellitus (DM). Traditional continuing medical education have limited efficacy, and new approaches are required.

Objective

We report the design of a trial to assess the educational efficacy of InsuOnline, a game for education of primary care physicians (PCPs). The goal of InsuOnline was to improve appropriate initiation and adjustment of insulin for the treatment of DM. InsuOnline was designed to be educationally adequate, self-motivating, and attractive.

Methods

A multidisciplinary team of endocrinologists, experts in medical education, and programmers, was assembled for the design and development of InsuOnline. Currently, we are conducting usability and playability tests, with PCPs and medical students playing the game on a desktop computer. Adjustments will be made based on these results. An unblinded randomized controlled trial with PCPs who work in the city of Londrina, Brazil, will be conducted to assess the educational validity of InsuOnline on the Web. In this trial, 64 PCPs will play InsuOnline, and 64 PCPs will undergo traditional instructional activities (lecture and group discussion). Knowledge on how to initiate and adjust insulin will be assessed by a Web-based multiple choice questionnaire, and attitudes regarding diabetes/insulin will be assessed by Diabetes Attitude Scale 3 at 3 time points—before, immediately after, and 6 months after the intervention. Subjects´ general impressions on the interventions will be assessed by a questionnaire. Software logs will be reviewed.

Results

To our knowledge, this is the first research with the aim of assessing the educational efficacy of a computer game for teaching PCPs about insulin therapy in DM. We describe the development criteria used for creating InsuOnline. Evaluation of the game using a randomized controlled trial design will be done in future studies.

Conclusions

We demonstrated that the design and development of a game for PCPs education on insulin is possible with a multidisciplinary team. InsuOnline can be an attractive option for large-scale continuous medical education to help improving PCPs´ knowledge on insulin therapy and potentially improving DM patients´ care.

Trial Registration

Clinicaltrials.gov: NCT01759953; http://clinicaltrials.gov/show/NCT01759953 (Archived by WebCite at http://www.webcitation.org/6Dq8Vc7a6).

Web-based self-management support training for health professionals: a pilot study

OBJECTIVE

To evaluate a web-based self-management training for health professionals. Patients spend 99% of their time outside the healthcare system. Thus self-management support from health professionals is central to optimal care. Our objective was to teach health professionals the skills to provide this support.

METHODS

Primary care residents and practicing providers enrolled in six groups. Each group received four web-based interactive training sessions derived from self-efficacy theory. Retrospective-pre/post assessed changes in self-management beliefs and confidence. Wilcoxon signed-rank tests with Bonferroni correction compared responses. Focus groups solicited qualitative feedback.

RESULTS

Fifty-seven residents and providers across the United States enrolled. Residents demonstrated positive changes on all belief questions (P 0.001-0.012). Practicing providers had a non-significant positive change on one and significant changes on the remainder (P 0.001-0.018). Both types of participants demonstrated significant increases on confidence questions regarding their ability to support self-management (P<0.01 for all). Participants described learned techniques as being useful, reducing burnout, and increasing acceptance of patient involvement in care planning.

CONCLUSION

The web-based self-management support training for health professionals was feasible and changed beliefs and confidence.

PRACTICE IMPLICATIONS

The program may maximize patient self-management by increasing provider self-efficacy and skill for self-management support.

Audit and feedback: effects on professional practice and healthcare outcomes

BACKGROUND

Audit and feedback is widely used as a strategy to improve professional practice either on its own or as a component of multifaceted quality improvement interventions. This is based on the belief that healthcare professionals are prompted to modify their practice when given performance feedback showing that their clinical practice is inconsistent with a desirable target. Despite its prevalence as a quality improvement strategy, there remains uncertainty regarding both the effectiveness of audit and feedback in improving healthcare practice and the characteristics of audit and feedback that lead to greater impact.

OBJECTIVES

To assess the effects of audit and feedback on the practice of healthcare professionals and patient outcomes and to examine factors that may explain variation in the effectiveness of audit and feedback.

SEARCH METHODS

We searched the Cochrane Central Register of Controlled Trials (CENTRAL) 2010, Issue 4, part of The Cochrane Library. www.thecochranelibrary.com, including the Cochrane Effective Practice and Organisation of Care (EPOC) Group Specialised Register (searched 10 December 2010); MEDLINE, Ovid (1950 to November Week 3 2010) (searched 09 December 2010); EMBASE, Ovid (1980 to 2010 Week 48) (searched 09 December 2010); CINAHL, Ebsco (1981 to present) (searched 10 December 2010); Science Citation Index and Social Sciences Citation Index, ISI Web of Science (1975 to present) (searched 12-15 September 2011).

SELECTION CRITERIA

Randomised trials of audit and feedback (defined as a summary of clinical performance over a specified period of time) that reported objectively measured health professional practice or patient outcomes. In the case of multifaceted interventions, only trials in which audit and feedback was considered the core, essential aspect of at least one intervention arm were included.

DATA COLLECTION AND ANALYSIS

All data were abstracted by two independent review authors. For the primary outcome(s) in each study, we calculated the median absolute risk difference (RD) (adjusted for baseline performance) of compliance with desired practice compliance for dichotomous outcomes and the median percent change relative to the control group for continuous outcomes. Across studies the median effect size was weighted by number of health professionals involved in each study. We investigated the following factors as possible explanations for the variation in the effectiveness of interventions across comparisons: format of feedback, source of feedback, frequency of feedback, instructions for improvement, direction of change required, baseline performance, profession of recipient, and risk of bias within the trial itself. We also conducted exploratory analyses to assess the role of context and the targeted clinical behaviour. Quantitative (meta-regression), visual, and qualitative analyses were undertaken to examine variation in effect size related to these factors.

MAIN RESULTS

We included and analysed 140 studies for this review. In the main analyses, a total of 108 comparisons from 70 studies compared any intervention in which audit and feedback was a core, essential component to usual care and evaluated effects on professional practice. After excluding studies at high risk of bias, there were 82 comparisons from 49 studies featuring dichotomous outcomes, and the weighted median adjusted RD was a 4.3% (interquartile range (IQR) 0.5% to 16%) absolute increase in healthcare professionals' compliance with desired practice. Across 26 comparisons from 21 studies with continuous outcomes, the weighted median adjusted percent change relative to control was 1.3% (IQR = 1.3% to 28.9%). For patient outcomes, the weighted median RD was -0.4% (IQR -1.3% to 1.6%) for 12 comparisons from six studies reporting dichotomous outcomes and the weighted median percentage change was 17% (IQR 1.5% to 17%) for eight comparisons from five studies reporting continuous outcomes. Multivariable meta-regression indicated that feedback may be more effective when baseline performance is low, the source is a supervisor or colleague, it is provided more than once, it is delivered in both verbal and written formats, and when it includes both explicit targets and an action plan. In addition, the effect size varied based on the clinical behaviour targeted by the intervention.

AUTHORS' CONCLUSIONS

Audit and feedback generally leads to small but potentially important improvements in professional practice. The effectiveness of audit and feedback seems to depend on baseline performance and how the feedback is provided. Future studies of audit and feedback should directly compare different ways of providing feedback.

Interventions in primary care to improve cardiovascular risk factors and glycated haemoglobin (HbA1c) levels in patients with diabetes: a systematic review

Most patients with diabetes are treated in primary care (PC). We performed a systematic review to assess the effect of single and combined interventions on cardiovascular risk factors (CVRFs) and glycated haemoglobin (HbA1c) levels in patients with diabetes in PC settings. We searched the MEDLINE database from January 1990 to October 2008. According to the Cochrane Effective Practice and Organization of Care Group (EPOC) criteria, (cluster-)randomized control studies and controlled before-and-after studies were selected and reviewed. Identified interventions were classified according to a modified EPOC intervention taxonomy. We included 68 studies. Forty-five studies evaluated the effect of any intervention on HbA1c. Seventeen studies presented a significant improvement in HbA1c. Nine out of 27 studies evaluating CVRFs [cholesterol, blood pressure (BP)] and HbA1c showed a significant improvement in at least two of these factors. Audit and feedback on performance, clinical decision support systems, multi-professional teams and patient education seemed to be successful strategies. The increasing evidence regarding the treatment of persons with chronic illnesses, summarized in the Chronic Care Model (CCM), is not reflected in most recent studies about diabetes treatment in PC. Most interventions still seem only partly adapted to the CCM. The methodological quality of many studies is still poor and often the pivotal outcomes, CVRFs and HbA1c, are not appropriately addressed. As a consequence, the potential of PC in the care of patients with diabetes may still be underestimated.

Theory in practice: helping providers address depression in diabetes care

INTRODUCTION

A continuing education (CE) program based on the theory of planned behavior was designed to understand and improve health care providers' practice patterns in screening, assessing, and treating and/or referring patients with diabetes for depression treatment.

METHODS

Participants completed assessments of attitudes, confidence, intentions, and behaviors regarding depression management at 3 time points: immediately prior to the CE program (baseline), immediately after the CE program (posttest) and 6 weeks after the CE program (follow-up).

RESULTS

Ninety-eight providers attended the CE program: 71 completed the baseline assessment, 66 completed the posttest assessment, and 37 completed the 6-week follow-up. Compared to baseline, at posttest providers reported significantly more favorable attitudes, fewer negative attitudes, greater confidence, and greater intention to address depression with their diabetes patients. At the 6-week follow-up, participants reported a marginally significant increase in educating patients about depression, but no other depression management practices changed. Intention to change and confidence predicted some depression practice patterns at follow-up. Fewer barriers were a consistent predictor of depression practice patterns at follow-up.

DISCUSSION

In the short term, provider attitudes, confidence, and intentions to address depression with their patients improved. Intentions, confidence, and especially barriers are important intervention targets.

Continuing medical education effect on practice performance: effectiveness of continuing medical education: American College of Chest Physicians Evidence-Based Educational Guidelines

BACKGROUND

There has been sizable debate and widespread skepticism about the effect of continuing medical education (CME) on the performance of physicians in the practice setting. This portion of the review was undertaken to examine that effect.

METHODS

The guideline panel used data from a comprehensive review of the effectiveness of CME developed by The Johns Hopkins Evidence-based Practice Center, focusing on the effect of CME on clinical performance.

RESULTS

The review found 105 studies, which evaluated the impact of CME on short- and long-term physician practice performance. Nearly 60% met objectives relative to changing clinical performance in prescribing; screening; counseling about smoking cessation, diet, and sexual practices; guideline adherence; and other topics. Single live and multiple media appeared to be generally positive in their effect, print media much less so. Multiple educational techniques were more successful at changing provider performance than single techniques. The amount or frequency of exposure to CME activities appeared to have little effect on behavior change.

CONCLUSIONS

Overall, CME, especially using live or multiple media and multiple educational techniques, is generally effective in changing physician performance. More research, however, is needed that focuses on the specific types of media and educational techniques that lead to the greatest improvements in performance.

Videoconferencing a stroke assessment training workshop: effectiveness, acceptability, and cost

INTRODUCTION

Videoconferencing (VC) is becoming a common method for the delivery of continuing education (CE) to clinicians in remote locations. The purpose of this study was to compare the effectiveness, acceptability, and costs of a full-day training workshop (TW) delivered through two different formats: face-to-face (FTF) and VC. The TW was designed to teach administration and scoring guidelines for the Chedoke-McMaster Stroke Assessment, an outcome measure used by rehabilitation professionals.

METHODS

The TW was delivered simultaneously in FTF and VC formats to a total of five remote communities on two separate occasions. Participants completed a test of scoring competency at the beginning (pretest) and end (posttest) of the TW as well as a feedback questionnaire. A cost comparison was also undertaken.

RESULTS

Forty-four physical and occupational therapists participated. No significant between-group differences were found in posttest scoring competency related to delivery format (FTF or VC): (F(1,38) = 0.6, MSE = 3.6, p > 0.4), or for the two workshops: (F(1,38) = 1.4, MSE = 3.6, p > 0.2). Despite technical difficulties, participant experience was rated as "good" to "excellent." The VC method offered considerable cost savings to participants and their organizations, at a minimum of $7,437 (Canadian).

CONCLUSION

Clinicians participating in the TW via VC performed as well as those in the FTF group on the competency test. Videoconferencing improves access to CE, is well received by participants, and provides a cost-effective method of course delivery. Further evaluation of other CE events delivered through VC is indicated.