Practice Doesn't Always Make Perfect: A Qualitative Study Explaining Why a Trial of an Educational Toolkit Did Not Improve Quality of Care

Impact of the MEESSI-AHF tool to guide disposition decision-making in patients with acute heart failure in the emergency department: a before-and-after study

OBJECTIVES

To determine the impact of risk stratification using the MEESSI-AHF (Multiple Estimation of risk based on the Emergency department Spanish Score In patients with acute heart failure) scale to guide disposition decision-making on the outcomes of ED patients with acute heart failure (AHF), and assess the adherence of emergency physicians to risk stratification recommendations.

METHODS

This was a prospective quasi-experimental study (before/after design) conducted in eight Spanish EDs which consecutively enrolled adult patients with AHF. In the pre-implementation stage, the admit/discharge decision was performed entirely based on emergency physician judgement. During the post-implementation phase, emergency physicians were advised to 'discharge' patients classified by the MEESSI-AHF scale as low risk and 'admit' patients classified as increased risk. Nonetheless, the final decision was left to treating emergency physicians. The primary outcome was 30-day all-cause mortality. Secondary outcomes were days alive and out of hospital, in-hospital mortality and 30-day post-discharge combined adverse event (ED revisit, hospitalisation or death).

RESULTS

The pre-implementation and post-implementation cohorts included 1589 and 1575 patients, respectively (median age 85 years, 56% females) with similar characteristics, and 30-day all-cause mortality was 9.4% and 9.7%, respectively (post-implementation HR=1.03, 95% CI=0.82 to 1.29). There were no differences in secondary outcomes or in the percentage of patients entirely managed in the ED without hospitalisation (direct discharge from the ED, 23.5% vs 24.4%, OR=1.05, 95% CI=0.89 to 1.24). Adjusted models did not change these results. Emergency physicians followed the MEESSI-AHF-based recommendation on patient disposition in 70.9% of cases (recommendation over-ruling: 29.1%). Physicians were more likely to over-rule the recommendation when 'discharge' was recommended (56.4%; main reason: need for hospitalisation for a second diagnosis) than when 'admit' was recommended (12.8%; main reason: no appreciation of severity of AHF decompensation by emergency physician), with an OR for over-ruling the 'discharge' compared with the 'admit' recommendation of 8.78 (95% CI=6.84 to 11.3).

CONCLUSIONS

Implementing the MEESSI-AHF risk stratification tool in the ED to guide disposition decision-making did not improve patient outcomes.

Printed educational materials directed at Ontario family physicians do not improve adherence to guideline recommendations for diabetes management: a pragmatic, factorial, cluster randomized controlled trial [ISRCTN72772651]

BACKGROUND

Printed educational materials (PEMs) have long been used to inform clinicians on evidence-based practices. However, the evidence for their effects on patient care and outcomes is unclear. In Ontario, despite widely available clinical practice guidelines recommending antihypertensives and cholesterol-lowering agents for patients with diabetes, prescriptions remain low. We aimed to determine whether PEMs can influence physicians to intensify prescribing of these medications.

METHODS

A pragmatic, 2 × 2 factorial, cluster randomized controlled trial was designed to ascertain the effect of two PEM formats on physician prescribing: a postcard-sized message ("outsert") or a longer narrative article ("insert"). Ontario family physician practices (clusters) were randomly allocated to receive the insert, outsert, both or neither. Physicians were eligible if they were in active practice and their patients were included if they were over 65 years with a diabetes diagnosis; both were unaware of the trial. Administrative databases at ICES (formerly the Institute for Clinical Evaluative Sciences) were used to link patients to their physician and to analyse prescribing patterns at baseline and 1 year following PEM mailout. The primary outcome was intensification defined as the addition of a new antihypertensive or cholesterol-lowering agent, or dose increase of a current drug, measured at the patient level. Analyses were by intention-to-treat and accounted for the clustering of patients to physicians.

RESULTS

We randomly assigned 4231 practices (39% of Ontario family physicians) with a total population of 185,526 patients (20% of patients with diabetes in Ontario primary care) to receive the insert, outsert, both, and neither; among these, 4118 practices were analysed (n = 1025, n = 1037, n = 1031, n = 1025, respectively). No significant treatment effect was found for the outsert (odds ratio (OR) 1.01, 95% confidence interval (CI) 0.98 to 1.04) or the insert (OR 0.99, 95% CI 0.96 to 1.02). Percent of intensification in the four arms was similar (approximately 46%). Adjustment for physician characteristics (e.g., age, sex, practice location) had no impact on these findings.

CONCLUSIONS

PEMs have no effect on physician's adherence to recommendations for the management of diabetes-related complications in Ontario. Further research should investigate the effect of other strategies to narrow this evidence-to-practice gap.

TRIAL REGISTRATION

ISRCTN72772651 . Retrospectively registered 21 July 2005.

Population Health Management in Diabetes Care: Combining Clinical Audit, Risk Stratification, and Multidisciplinary Virtual Clinics in a Community Setting to Improve Diabetes Care in a Geographically Defined Population. An Integrated Diabetes Care Pilot in the North East Locality, Oxfordshire, UK

BACKGROUND

Disparities in diabetes care are prevalent, with significant inequalities observed in access to, and outcomes of, healthcare. A population health approach offers a solution to improve the quality of care for all with systematic ways of assessing whole population requirements and treating and monitoring sub-groups in need of additional attention.

DESCRIPTION OF THE CARE PRACTICE

Collaborative working between primary, secondary and community care was introduced in seven primary care practices in one locality in England, UK, caring for 3560 patients with diabetes and sharing the same community and secondary specialist diabetes care providers. Three elements of the intervention included 1) clinical audit, 2) risk stratification, and 3) the multi-disciplinary virtual clinics in the community.

METHODS

This paper evaluates the acceptability, feasibility and short-term impact on primary care of implementing a population approach intervention using direct observations of the clinics and surveys of participating clinicians.

RESULTS AND DISCUSSION

Eighteen virtual clinics across seven teams took place over six months between March and July 2017 with organisation, resources, policies, education and approximately 150 individuals discussed. The feedback from primary care was positive with growing knowledge and confidence managing people with complex diabetes in primary care.

CONCLUSION

Taking a population health approach helped to identify groups of people in need of additional diabetes care and deliver a collaborative health intervention across traditional organisational boundaries.

Testing an audit and feedback-based intervention to improve glycemic control after transfer to adult diabetes care: protocol for a quasi-experimental pre-post design with a control group

BACKGROUND

When young adults transfer from pediatric to adult diabetes care they are at risk for deterioration of glycemic control, putting them at an increased risk of developing both acute and chronic complications. Despite increased awareness of these risks, there are gaps in care delivery during this vulnerable time and variability in the implementation of recommended transition practice. Audit and feedback (AF) interventions have a positive but variable effect on implementation of best practices. An expert group identified specific suggestions for optimizing the effectiveness of AF interventions. We aim to test an AF-based intervention incorporating these specific suggestions to improve transition practices and glycemic control in the first year after transfer from pediatric to adult diabetes care.

METHODS

This is a pragmatic quasi-experimental study; a series of three cohort studies (pre-implementation, early-implementation, and post-implementation) to compare the baseline adjusted hemoglobin A1c (HbA1c) in the 12 months after the final pediatric visit in five pediatric diabetes centres within the Ontario Pediatric Diabetes Network in Ontario, Canada. The intervention includes three components: 1) centre-level feedback reports compiling data from chart abstraction, linked provincial administrative datasets, and patient-reported experience measures; 2) webinars for facilitated conversations/coaching about the feedback; and 3) online repository of curated transition resources for providers. The primary outcome will be analyzed using a multivariable linear regression model. We will conduct a qualitative process evaluation to understand intervention fidelity and to provide insight into the mechanisms of action of our results.

DISCUSSION

There is a need to develop an innovative system-level approach to improve outcomes and the quality of care for young adults with type 1 diabetes during the vulnerable time when they transfer to adult care. Our research team, a collaboration of health services, implementation science, and quality improvement researchers, are designing, implementing, and evaluating an AF-based intervention using recommendations about how to optimize effectiveness. This knowledge will be generalizable to other care networks that aim to deliver uniformly high-quality care in diverse care settings.

TRIAL REGISTRATION

ClinicalTrials.gov NCT03781973. Registered 13 December 2018. Date of enrolment of the first participant to the trial: June 1, 2019.

Healthcare Professionals' Perceptions of Type 2 Diabetes Mellitus Care in the Mediterranean Region

INTRODUCTION

This study aimed to assess the adherence to guidelines by practitioners working in the Mediterranean region and to identify the reasons for non-compliance.

METHODS

A opportunistic self-administered questionnaire was circulated among members of the Mediterranean Group for the Study of Diabetes (MGSD) and regional diabetic associations. The study was limited to the Mediterranean region; 2841 medical practitioners participated in the study. Intervention involved a self-administered questionnaire enabling demographic and personal details to be correlated to relevant information related to practice and continuing health professional education (CHPE) attitudes, perceptions related to diabetes and healthcare systems in the community, and physicians' attitudes to healthcare practices and target goals relevant to type 2 diabetes mellitus (T2DM). The main outcome measure was adherence to evidence-based guidelines.

RESULTS

While the majority of respondents (69.9%) reported being confident in managing these patients, and 79.2% reported being aware of the availability of local guidelines; only a fifth opted to manage patients by strictly targeting an HbA1c value below 6.5%, while 3.3% were happy to maintain an HbA1c value of up to 8.0%. These goals appeared to be tempered by fear of eliciting hypoglycaemia in the belief that patients and their families do not have the skills to manage the complication. Endocrinologists/internists preferred more rigid control.

CONCLUSION

It is clear that the promulgation of evidence-based guidelines cannot assume automatic adoption in clinical practice since adoption is tempered by on-the-ground practice circumstances that make the practitioner reluctant to fully endorse and adopt the targets defined by the guidelines. The evidence-based guidelines need to be modified for local or regional circumstances.

FUNDING

This study and the Rapid Service Fee were supported by a financial grant from the Mediterranean Group for the Study of Diabetes which is supported by an unrestricted educational grant from Servier.

Impact of the Canadian Diabetes Association guideline dissemination strategy on clinician knowledge and behaviour change outcomes

AIM

Implementation of clinical practice guideline (CPG) into clinical practice remains limited. Using the Knowledge-To-Action framework, a guideline dissemination and implementation strategy for the Canadian Diabetes Association's 2013 CPG was developed and launched to clinicians and people with diabetes.

METHODS

The RE-AIM framework guided evaluation of this strategy clinician; we report here one aspect of the effectiveness dimension using mixed methods. We measured impact of the strategy on clinican knowledge and behaviour change constructs using evaluation forms, national online survey and individual interviews.

RESULTS

After attending a lecture, clinician confidence (n = 915) increased (3.7(SD 0.7) to 4.5 (SD 0.6) on a 5-point scale (p < 0.001)), with 55% (n = 505) intending to make a practice change (e.g. clinical management regarding glycemic control). Ninety-four percent of survey respondents (n = 907) were aware of the guidelines, attributed to communications from professional associations, continuing professional development events, and colleagues. Forty to 98% of respondents (total n 462-485) were correct in their interpretation of CPG messages, and 33-65%(total n 351-651) reported that they had made changes to their practice. Interviews with 28 clinicians revealed that organizational credibility, online access to tools, clarity of tool content, and education sessions facilitated uptake; lack of time, team-based consensus, and seamless integration into care and patient complexity were barriers.

CONCLUSION

The complexity of diabetes care requires systemic adoption of organization of care interventions, including interprofessional collaboration and consensus. Augmenting our strategy to include scalable models for professional development, integration of guidelines into electronic medical records, and expansion of our target audience to include health care teams and patients, may optimize guideline uptake.