Attributes of clinical recommendations that influence change in practice following audit and feedback

Audit and feedback to reduce unwarranted clinical variation at scale: a realist study of implementation strategy mechanisms

BACKGROUND

Unwarranted clinical variation in hospital care includes the underuse, overuse, or misuse of services. Audit and feedback is a common strategy to reduce unwarranted variation, but its effectiveness varies widely across contexts. We aimed to identify implementation strategies, mechanisms, and contextual circumstances contributing to the impact of audit and feedback on unwarranted clinical variation.

METHODS

Realist study examining a state-wide value-based healthcare program implemented between 2017 and 2021 in New South Wales, Australia. Three initiatives within the program included audit and feedback to reduce unwarranted variation in inpatient care for different conditions. Multiple data sources were used to formulate the initial audit and feedback program theory: a systematic review, realist review, program document review, and informal discussions with key program stakeholders. Semi-structured interviews were then conducted with 56 participants to refute, refine, or confirm the initial program theories. Data were analysed retroductively using a context-mechanism-outcome framework for 11 transcripts which were coded into the audit and feedback program theory. The program theory was validated with three expert panels: senior health leaders (n = 19), Agency for Clinical Innovation (n = 11), and Ministry of Health (n = 21) staff.

RESULTS

The program's audit and feedback implementation strategy operated through eight mechanistic processes. The strategy worked well when clinicians (1) felt ownership and buy-in, (2) could make sense of the information provided, (3) were motivated by social influence, and (4) accepted responsibility and accountability for proposed changes. The success of the strategy was constrained when the audit process led to (5) rationalising current practice instead of creating a learning opportunity, (6) perceptions of unfairness and concerns about data integrity, 7) development of improvement plans that were not followed, and (8) perceived intrusions on professional autonomy.

CONCLUSIONS

Audit and feedback strategies may help reduce unwarranted clinical variation in care where there is engagement between auditors and local clinicians, meaningful audit indicators, clear improvement plans, and respect for clinical expertise. We contribute theoretical development for audit and feedback by proposing a Model for Audit and Feedback Implementation at Scale. Recommendations include limiting the number of audit indicators, involving clinical staff and local leaders in feedback, and providing opportunities for reflection.

Selective acceptance of acute whiplash guidelines: a qualitative analysis of perceptions of health professionals in Australia

PURPOSE

To explore health professionals' acceptance of the guidelines for acute whiplash associated disorders (WAD), and to identify barriers and facilitators to adherence.

MATERIALS AND METHODS

Qualitative descriptive study involving focus group discussions among health professionals who treat people with WAD in primary and secondary care settings in New South Wales and Queensland, Australia. Twenty-eight health professionals (physiotherapists = 19; chiropractors = 6; osteopaths = 3) participated in six semi-structured focus group discussions that were held in independent offices in Sydney and Brisbane, Australia between September and December 2015. Discussions were audio recorded and verbatim, de-identified transcripts produced. Thematic analysis was conducted using an inductive approach to identify commonly held beliefs.

RESULTS

Acceptance of guideline recommendations appeared to be influenced by factors related to the guideline itself, practitioner and practice characteristics, and patient-related factors. Specifically, acceptance was hindered by conflicting belief systems, ambiguity in guideline recommendations, and patient characteristics and expectations.

CONCLUSIONS

Practitioners demonstrated a positive attitude towards the use of the guidelines in general; however, in some cases, acceptance of key recommendations appeared selective. Future guideline revision and implementation might focus on explaining the underlying principles of the guidelines, providing more detailed recommendations, and involving strategies that challenge inconsistent beliefs and promote informed decision-making. IMPLICATIONS FOR REHABILITATIONSelective acceptance of guideline recommendations in favour of those not requiring practice change may present a challenge for the implementation of evidence-based practice in the management of whiplash.Participants demonstrated variable, sometimes polar attitudes to guideline key messages and recommendations.Guideline developers need to focus more strongly on changing practitioner beliefs and attitudes, as well as better explaining the underlying principles of the guidelines, and providing more detailed recommendations.

The effect of transactional analysis training on emotional intelligence in health professions students

BACKGROUND

Emotional intelligence (EI) is considered to present a significant predictor of work performance whereas Transactional analysis (TA) is the relational perspective in communication in managing emotions. We evaluated the effect of psycho-educational training in EI and TA (TEITA) on EI among health professions undergraduates, with post-training, and at 1-month follow-up.

METHODS

A total of 34 participants participated in the study where 17 participants were in the TEITA group and another 17 were in the control group. A quasi-experimental non-randomised, controlled cohort study was conducted, in which participants in the TEITA group were introduced to EI and TA concepts on a weekly basis for four weeks, at 90 min each time, and provided with opportunities for experiential sharing of emotions and coping mechanisms experienced in the previous week. Both TEITA and control groups received weekly EI and TA reading materials. All completed the 16-item Wong and Law EI Scale at baseline and post-training. The training group also completed the questionnaire at a 1-month follow-up. Wilcoxon Signed Ranks and Mann Whitney tests were used to analyse within a group and between group changes in EI scores.

RESULTS

Baseline EI scores in the TEITA group were lower than the control group. On completion of TEITA, EI scores in the TEITA group increased, and differences were not detected between groups. Within the TEITA group, paired increases in all domains were statistically significant, whereas, in the control group, the paired increase was only detected in the domain addressing regulations of emotion (ROE). Pre to post-training increases in EI scores were statically significantly greater in TEITA compared to control groups. At the 1-month follow-up, EI scores were sustained.

CONCLUSION

The psycho-educational training based on EI and TA is effective in enhancing EI among health professions undergraduates. Future research should investigate the effect of such training on observable inter-personal and socio-economic behaviours.

Practice patterns for chronic hypoparathyroidism: data from patients and physicians in France

CONTEXT

Recent guidelines have provided recommendations for the care of patients with chronic hypoparathyroidism. Very little is known about actual physicians' practices or their adherence to such guidelines.

OBJECTIVE

To describe the physicians' practice patterns and their compliance with international guidelines.

DESIGN

The cohort studies included were Épi-Hypo (118 physicians and 107 patients, from September 2016 to December 2019) and ePatients (110 patients, November 2019).

METHODS

Internet-based cohorts involving all settings at a nationwide level (France). Participants were (i) physicians treating patients with chronic hypoparathyroidism and patients with chronic hypoparathyroidism either participating in the (ii) Épi-Hypo study (Épi-Hypo 2019 patients), or (iii) Hypoparathyroidism France, the national representative association (ePatients).

RESULTS

The physicians' specialties were mainly endocrinology (61%), nephrology (28%), family medicine (2.5%), pediatrics (2.5%), rheumatology (2%), or miscellaneous (4%) and 45% were practicing in public universities. The median number of pharmaceutical drug classes prescribed was three per patient. The combination of active vitamin D and calcium salt was given to 59 and 58% of ePatients and Épi-Hypo 2019 patients, respectively. Eighty-five percent of ePatients and 87% of physicians reported monitoring plasma calcium concentrations at a steady state at least twice a year. In 32 and 26% of cases, respectively, ePatients and physicians reported being fully in accordance with international guidelines that recommend targeting symptoms, plasma calcium and phosphate values, and urine calcium excretion.

CONCLUSIONS

The care of patients with chronic hypoparathyroidism involves physicians with very different practices, so guidelines should include and target other specialists as well as endocrinologists. Full adherence to the guidelines is low in France.

Use of antihyperglycaemic therapy with cardiovascular benefit in patients with type 2 diabetes who require hospitalisation: A cross-sectional study

OBJECTIVE

To evaluate the use of therapy with cardiovascular benefit in patients with type 2 diabetes mellitus admitted to internal medicine departments.

METHODS

One day, cross-sectional study of patients with type 2 diabetes mellitus hospitalised in internal medicine departments. We recorded demographic and anthropometric variables, laboratory data and use of antihyperglycaemic drugs. The endpoint was the proportion and determinants of the use of sodium-glucose cotransporter-2 inhibitors (SGLT2i) and glucagon-like peptide-1 receptor agonists (GLP1-RA).

RESULTS

We included 928 patients belonging to 74 hospitals, with a mean age of 78.9 years (SD, 10.86 years), 50% of whom were men. A total of 557 (60%) patients had ischaemic heart disease, 189 (20.4%) had cerebrovascular disease, 293 (31.6%) had heart failure, 274 (29.5%) had chronic kidney disease, and 129 (13.9%) had peripheral arterial disease. Prior to their hospital admission, the patients were taking sulfonylureas (5.7%), biguanides (49.1%), alpha-glucosidase inhibitors (0.2%), pioglitazone (0%), dipeptidyl peptidase 4 inhibitors (39%), SGLT2i (5.8%), GLP1-RA (2.6%) and basal insulin analogues (24%). An age over 75 years was the main determinant for not taking SGLT2i (adjusted OR, 0.28; 95% CI 0.10-0.74; p = .039) or GLP1-RA (adjusted OR, 0.09; 95% CI 0.02-0.46; p = .006).

DISCUSSION

A large proportion of elderly patients with type 2 diabetes mellitus at very high cardiovascular risk are not treated with antihyperglycemic drugs with proven cardiovascular benefit. The most commonly used drugs were metformin and DPP4i. There is room for improvement in the treatment of this very high-risk population.

Use of prescribing safety quality improvement reports in UK general practices: a qualitative assessment

Background

Quality improvement (QI) initiatives are increasingly used to improve the quality of care and reduce prescribing errors. The Royal College of General Practitioners (RCGP) and Clinical Practice Research Datalink (CPRD) QI initiative uses routinely collected electronic primary care data to provide bespoke practice-level reports on prescribing safety. The aim of this study was to explore how the QI reports were used, barriers and facilitators to use, long-term culture change and perceived impact on patient care and practices systems as a result of receiving the reports.

Methods

A qualitative study using purposive sampling of practices contributing to the CPRD, semi-structured interviews and inductive thematic analysis. We interviewed general practitioners, pharmacists, practice managers and research nurses.

Results

We conducted 18 interviews, and organised themes summarising the use of QI reports in practice: receiving the report, facilitators and barriers to acting upon the reports, acting upon the report, and how the reports contribute to a quality culture. Effective dissemination of reports, and a positive attitude to audit and the perceived relevance of the clinical topic facilitated use. Lack of time and failure to see or act upon the reports meant they were not used. Factors influencing use of the reports included the structure of the report, ease of identifying cases, and perceptions about coding accuracy. GPs and pharmacists used the reports to conduct case reviews and directly contact patients to discuss unsafe prescribing and patient medication preferences. Finally, the reports contributed to the development of a quality culture within practices through promoting audit activity and acting as a reminder of good prescribing behaviours, promoting future patient safety initiatives, contributing to continuing professional development and improving local networks.

Conclusions

This study found the reports facilitated individual case review leading to an enhanced sense of quality culture in practices where they were utilised. Our findings demonstrate that the reports were generally considered useful and have been used to support patient safety and clinical practice in specific cases.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12913-021-06417-0.

Development, Implementation, and Evaluation of Treatment Guidelines for Herpes Simplex Keratitis in Sydney, Australia

PURPOSE

To develop and measure the uptake of a local guideline for herpes simplex keratitis (HSK) and to standardize initial antiviral therapy in Australia.

METHODS

The Registered Nurses' Association of Ontario Toolkit: "Implementation of Best Practice Guidelines" was used to develop, implement, and evaluate the guideline at Sydney Eye Hospital. An implementation team was established to reach consensus on antiviral therapy guidelines through review of available evidence, identifying stakeholders, facilitators and barriers, creating strategies for implementation, and developing a sustainability plan. An audit of all adult HSK cases during a 6-month postguideline implementation period was conducted, and the results were compared with a preimplementation audit. A web-based survey was created to assess clinician awareness, usage, and level of knowledge of the guideline.

RESULTS

Clinicians, pharmacists, and administrative staff were identified as stakeholders. Changing clinician's behavior was the major barrier to implementation. Implementation strategies included printed and online materials and lectures to clinicians. A postimplementation audit included 85 patients, and 95 clinicians received a web-based survey. The dose of the prescribed antiviral medication was in alignment with the local guideline in 80% (51/64) of the patients compared with 73% (163/223) before implementation (P = 0.331). Stromal HSK with ulceration and keratouveitis were excluded because there were no recommendations before implementation. Over 70% of clinicians (30/41) were aware of the guideline and accessed them through educational resources.

CONCLUSIONS

Guidelines for the management of HSK may improve standardization of initial antiviral therapy in HSK. In practice, most clinicians were aware of and adhered to the local guideline.

Printed educational materials: effects on professional practice and healthcare outcomes

BACKGROUND

Printed educational materials are widely used dissemination strategies to improve the quality of healthcare professionals' practice and patient health outcomes. Traditionally they are presented in paper formats such as monographs, publication in peer-reviewed journals and clinical guidelines. This is the fourth update of the review.

OBJECTIVES

To assess the effect of printed educational materials (PEMs) on the practice of healthcare professionals and patient health outcomes. To explore the influence of some of the characteristics of the printed educational materials (e.g. source, content, format) on their effect on healthcare professionals' practice and patient health outcomes.

SEARCH METHODS

We searched MEDLINE, Embase, the Cochrane Central Register of Controlled Trials (CENTRAL), HealthStar, CINAHL, ERIC, CAB Abstracts, Global Health, and EPOC Register from their inception to 6 February 2019. We checked the reference lists of all included studies and relevant systematic reviews.

SELECTION CRITERIA

We included randomised trials (RTs), controlled before-after studies (CBAs) and interrupted time series studies (ITSs) that evaluated the impact of PEMs on healthcare professionals' practice or patient health outcomes. We included three types of comparisons: (1) PEM versus no intervention, (2) PEM versus single intervention, (3) multifaceted intervention where PEM is included versus multifaceted intervention without PEM. Any objective measure of professional practice (e.g. prescriptions for a particular drug), or patient health outcomes (e.g. blood pressure) were included.

DATA COLLECTION AND ANALYSIS

Two reviewers undertook data extraction independently. Disagreements were resolved by discussion. For analyses, we grouped the included studies according to study design, type of outcome and type of comparison. For controlled trials, we reported the median effect size for each outcome within each study, the median effect size across outcomes for each study and the median of these effect sizes across studies. Where data were available, we re-analysed the ITS studies by converting all data to a monthly basis and estimating the effect size from the change in the slope of the regression line between before and after implementation of the PEM. We reported median changes in slope for each outcome, for each study, and then across studies. We standardised all changes in slopes by their standard error, allowing comparisons and combination of different outcomes. We categorised each PEM according to potential effects modifiers related to the source of the PEMs, the channel used for their delivery, their content, and their format. We assessed the risks of bias of all the included studies.

MAIN RESULTS

We included 84 studies: 32 RTs, two CBAs and 50 ITS studies. Of the 32 RTs, 19 were cluster RTs that used various units of randomisation, such as practices, health centres, towns, or areas. The majority of the included studies (82/84) compared the effectiveness of PEMs to no intervention. Based on the RTs that provided moderate-certainty evidence, we found that PEMs distributed to healthcare professionals probably improve their practice, as measured with dichotomous variables, compared to no intervention (median absolute risk difference (ARD): 0.04; interquartile range (IQR): 0.01 to 0.09; 3,963 healthcare professionals randomised within 3073 units). We could not confirm this finding using the evidence gathered from continuous variables (standardised mean difference (SMD): 0.11; IQR: -0.16 to 0.52; 1631 healthcare professionals randomised within 1373 units ), from the ITS studies (standardised median change in slope = 0.69; 35 studies), or from the CBA study because the certainty of this evidence was very low. We also found, based on RTs that provided moderate-certainty evidence, that PEMs distributed to healthcare professionals probably make little or no difference to patient health as measured using dichotomous variables, compared to no intervention (ARD: 0.02; IQR: -0.005 to 0.09; 935,015 patients randomised within 959 units). The evidence gathered from continuous variables (SMD: 0.05; IQR: -0.12 to 0.09; 6,737 patients randomised within 594 units) or from ITS study results (standardised median change in slope = 1.12; 8 studies) do not strengthen these findings because the certainty of this evidence was very low. Two studies (a randomised trial and a CBA) compared a paper-based version to a computerised version of the same PEM. From the RT that provided evidence of low certainty, we found that PEM in computerised versions may make little or no difference to professionals' practice compared to PEM in printed versions (ARD: -0.02; IQR: -0.03 to 0.00; 139 healthcare professionals randomised individually). This finding was not strengthened by the CBA study that provided very low certainty evidence (SMD: 0.44; 32 healthcare professionals). The data gathered did not allow us to conclude which PEM characteristics influenced their effectiveness. The methodological quality of the included studies was variable. Half of the included RTs were at risk of selection bias. Most of the ITS studies were conducted retrospectively, without prespecifying the expected effect of the intervention, or acknowledging the presence of a secular trend.

AUTHORS' CONCLUSIONS

The results of this review suggest that, when used alone and compared to no intervention, PEMs may slightly improve healthcare professionals' practice outcomes and patient health outcomes. The effectiveness of PEMs compared to other interventions, or of PEMs as part of a multifaceted intervention, is uncertain.

Use of antihyperglycaemic therapy with cardiovascular benefit in patients with type 2 diabetes who require hospitalisation: A cross-sectional study

OBJECTIVE

To evaluate the use of therapy with cardiovascular benefit in patients with type 2 diabetes mellitus admitted to internal medicine departments.

METHODS

One day, cross-sectional study of patients with type 2 diabetes mellitus hospitalised in internal medicine departments. We recorded demographic and anthropometric variables, laboratory data and use of antihyperglycaemic drugs. The endpoint was the proportion and determinants of the use of sodium-glucose cotransporter-2 inhibitors (SGLT2i) and glucagon-like peptide-1 receptor agonists (GLP1-RA).

RESULTS

We included 928 patients belonging to 74 hospitals, with a mean age of 78.9 years (SD, 10.86 years), 50% of whom were men. A total of 557 (60%) patients had ischaemic heart disease, 189 (20.4%) had cerebrovascular disease, 293 (31.6%) had heart failure, 274 (29.5%) had chronic kidney disease, and 129 (13.9%) had peripheral arterial disease. Prior to their hospital admission, the patients were taking sulfonylureas (5.7%), biguanides (49.1%), alpha-glucosidase inhibitors (0.2%), pioglitazone (0%), dipeptidyl peptidase 4 inhibitors (39%), SGLT2i (5.8%), GLP1-RA (2.6%) and basal insulin analogues (24%). An age over 75 years was the main determinant for not taking SGLT2i (adjusted OR, 0.28; 95% CI 0.10-0.74; P=.039) or GLP1-RA (adjusted OR, 0.09; 95% CI 0.02-0.46; P=.006).

DISCUSSION

A large proportion of elderly patients with type 2 diabetes mellitus at very high cardiovascular risk are not treated with antihyperglycemic drugs with proven cardiovascular benefit. The most commonly used drugs were metformin and DPP4i. There is room for improvement in the treatment of this very high-risk population.

A study of guidelines for respiratory tract infections and their references from Swedish GPs: a qualitative analysis

Background: National guidelines are important instruments in reducing inappropriate antibiotic prescriptions. Low adherence to guidelines is an acknowledged problem that needs to be addressed.Method: We evaluated established characteristics for guidelines in the guidelines for lower respiratory tract infection, acute otitis media and pharyngotonsillitis in primary care. We studied how doctors used these guidelines by analysing interviews with 29 general practitioners (GPs) in Sweden.Results: We found important between-guidelines differences, which we believe affects adherence. The GPs reported persistent preconceptions about diagnosis and treatment, which we believe reduces their adherence to the guidelines.Conclusion: To increase adherence, it is important to consider doctors' preconceptions when creating new guidelines.

Effectiveness of an audit programme for dyslipidaemia management in a primary care setting in Macau: a quality improvement study

Objective

The objective of this study was to test the effectiveness of an audit programme for dyslipidaemia management in a primary care setting in Macau.

Design

A quality improvement study based on an evaluation of a before-after intervention trial was conducted in 2017–2018. Interventions comprising feedback from an audit, general practitioner (GP) training via interactive workshops and one-on-one case discussions were implemented. The primary outcome measure was the proportion of patients with reasonable management of dyslipidaemia, and the secondary outcome measure was the proportion of patients with low-density lipoprotein cholesterol (LDL-C) meeting the target recommended by the Adult Treatment Panel III guidelines.

Setting

This study was conducted at the Sao Lourenco Health Center, one of the health centres in the Macau primary care system; this centre provides primary care services to one-tenth of the residents of Macau.

Participants

All GPs who worked in the Sao Lourenco Health Center participated in the study. We systematically reviewed 100 patient records from each participating physician’s patient list. In total, 1200 and 1100 patient records were reviewed before and after the intervention, respectively.

Results

At baseline, 390 (43.5%) patients were eligible for statin therapy, while 411 (47.7%) patients were eligible for statin therapy in the reaudit group (p=0.08). After intervention, the proportion of patients with reasonable management of dyslipidaemia increased from 83.9% to 88.5% (p=0.005), and the proportion of eligible patients with LDL-C levels meeting the target increased from 55.1% to 65% (p=0.004).

Conclusions

The audits and feedback significantly improved dyslipidaemia management in the Macau primary care setting.

Context, complexity and process in the implementation of evidence-based innovation: a realist informed review

Background

This review of scholarly work in health care knowledge translation advances understanding of implementation components that support the complete and timely integration of new knowledge. We adopt a realist approach to investigate what is known from the current literature about the impact of, and the potential relationships between, context, complexity and implementation process.

Methods

Informed by two distinct pathways, knowledge utilization and knowledge translation, we utilize Rogers’ Diffusion of Innovations theory (DOI) and Harvey and Kitson’s integrated- Promoting Action on Research Implementation in Health Service framework (PARIHS) to ground this review. Articles from 5 databases; Medline, Scopus, PsycInfo, Web of Science, and Google Scholar and a search of authors were retrieved. Themes and patterns related to these implementation components were extracted. Literature was selected for inclusion by consensus. Data extraction was iterative and was moderated by the authors.

Results

A total of 67 articles were included in the review. Context was a central component to implementation. It was not clear how and to what extent context impacted implementation. Complexity was found to be a characteristic of context, implementation process, innovations and a product of the relationship between these three elements. Social processes in particular were reported as influential however; descriptions of how these social process impact were limited. Multiple theoretical and operational models were found to ground implementation processes. We offer an emerging conceptual model to illustrate the key discoveries.

Conclusions

The review findings indicate there are dynamic relationship between context, complexity and implementation process for enhancing uptake of evidence-based knowledge in hospital settings. These are represented in a conceptual model. Limited empiric evidence was found to explain the nature of the relationships.

Diffusion of Excellence: Accelerating the Spread of Clinical Innovation and Best Practices across the Nation's Largest Health System

The time it takes for clinical innovation and evidence-based practices to reach patients remains a major challenge for the health care sector. In 2015, the Veterans Health Administration (VHA) launched the Diffusion of Excellence Initiative aimed at aligning organizational resources with early-stage to midstage promising practices and innovations to replicate, scale, and eventually spread those with greatest potential for impact and positive outcomes. Using a 5-step systematic approach refined over time, frontline VHA staff have submitted more than 1676 practices since the initiative's inception, 47 of which have been selected as high-impact, Gold Status practices. These Gold Status practices have been replicated more than 412 times in Veterans Affairs hospitals across the country, improving care for more than 100,000 veterans and approximately $22.6 million in cost avoidance for the VHA. More importantly, practices such as Project HAPPEN (Hospital-Acquired Pneumonia Prevention by Engaging Nurses to complete oral care) and rapid availability of intranasal naloxone have saved veterans' lives. Several practices are now being implemented across the country, and the Diffusion of Excellence Initiative is playing a pivotal role as the VHA works to modernize its health care system. This initiative serves as a promising model for other health care systems seeking to accelerate the spread and adoption of clinical innovation and evidence-based practices.

What motivates general practitioners to change practice behaviour? A qualitative study of audit and feedback group sessions in Dutch general practice

OBJECTIVES

Adopting an attributional perspective, the current article investigates how audit and feedback group sessions contribute to general practitioners' (GPs) motivation to change their practice behaviour to improve care. We focus on the contributions of the audit and feedback itself (content) and the group discussion (process).

METHODS

Four focus groups, comprising a total of 39 participating Dutch GPs, discussed and compared audit and feedback of their practices. The focus groups were analysed thematically.

RESULTS

Audit and feedback contributed to GPs' motivation to change in two ways: by raising awareness about aspects of their current care practice and by providing indications of the possible impact of change. For these contributions to play out, the audit and feedback should be reliable and valid, specific, recent and recurrent and concern GPs' own practices or practices within their own influence sphere. Care behaviour attributed to external, uncontrollable or unstable causes would not induce change. The added value of the group is twofold as well: group discussion contributed to GPs' motivation to change by providing a frame of reference and by affording insights that participants would not have been able to achieve on their own.

CONCLUSIONS

In audit and feedback group sessions, both audit and feedback information and group discussion can valuably contribute to GPs' motivation to change care practice behaviour. Peer interaction can positively contribute to explore alternative practices and avenues for improvement. Local or regional peer meetings would be beneficial in facilitating reflection and discussion. An important avenue for future studies is to explore the contribution of audit and feedback and small-group discussion to actual practice change.

Clinical Performance Feedback Intervention Theory (CP-FIT): a new theory for designing, implementing, and evaluating feedback in health care based on a systematic review and meta-synthesis of qualitative research

BACKGROUND

Providing health professionals with quantitative summaries of their clinical performance when treating specific groups of patients ("feedback") is a widely used quality improvement strategy, yet systematic reviews show it has varying success. Theory could help explain what factors influence feedback success, and guide approaches to enhance effectiveness. However, existing theories lack comprehensiveness and specificity to health care. To address this problem, we conducted the first systematic review and synthesis of qualitative evaluations of feedback interventions, using findings to develop a comprehensive new health care-specific feedback theory.

METHODS

We searched MEDLINE, EMBASE, CINAHL, Web of Science, and Google Scholar from inception until 2016 inclusive. Data were synthesised by coding individual papers, building on pre-existing theories to formulate hypotheses, iteratively testing and improving hypotheses, assessing confidence in hypotheses using the GRADE-CERQual method, and summarising high-confidence hypotheses into a set of propositions.

RESULTS

We synthesised 65 papers evaluating 73 feedback interventions from countries spanning five continents. From our synthesis we developed Clinical Performance Feedback Intervention Theory (CP-FIT), which builds on 30 pre-existing theories and has 42 high-confidence hypotheses. CP-FIT states that effective feedback works in a cycle of sequential processes; it becomes less effective if any individual process fails, thus halting progress round the cycle. Feedback's success is influenced by several factors operating via a set of common explanatory mechanisms: the feedback method used, health professional receiving feedback, and context in which feedback takes place. CP-FIT summarises these effects in three propositions: (1) health care professionals and organisations have a finite capacity to engage with feedback, (2) these parties have strong beliefs regarding how patient care should be provided that influence their interactions with feedback, and (3) feedback that directly supports clinical behaviours is most effective.

CONCLUSIONS

This is the first qualitative meta-synthesis of feedback interventions, and the first comprehensive theory of feedback designed specifically for health care. Our findings contribute new knowledge about how feedback works and factors that influence its effectiveness. Internationally, practitioners, researchers, and policy-makers can use CP-FIT to design, implement, and evaluate feedback. Doing so could improve care for large numbers of patients, reduce opportunity costs, and improve returns on financial investments.

TRIAL REGISTRATION

PROSPERO, CRD42015017541.

The Safe Hands Study: Implementing aseptic techniques in the operating room: Facilitating mechanisms for contextual negotiation and collective action

BACKGROUND

Even though hand hygiene and aseptic techniques are essential to provide safe care in the operating room, several studies have found a lack of successful implementation. The aim of this study was to describe facilitative mechanisms supporting the implementation of hand hygiene and aseptic techniques.

METHODS

This study was set in a large operating room suite in a Swedish university hospital. The theory-driven implementation process was informed by the literature on organizational change and dialogue. Data were collected using interviews and participant observations and analyzed using a thematic approach. The normalization process theory served as a frame of interpretation during the analysis.

RESULTS

Three facilitating mechanisms were identified: (1) commitment through a sense of urgency, requiring extensive communication between the managers, operating room professionals, and facilitators in building commitment to change and putting the issues on the agenda; (2) dialogue for co-creation, increasing and sustaining commitment and resource mobilization; and (3) tailored management support, including helping managers to develop their leadership role, progressively involving staff, and retaining focus during the implementation process.

CONCLUSIONS

The facilitating mechanisms can be used in organizing implementation processes. Putting the emphasis on help and support to managers seems to be a crucial condition in complex implementation processes, from preparation of the change process to stabilization of the new practice.

Application of Unit-Level Cost Transparency, Education, Enhanced Audit, and Feedback of Anonymized Peer Ranking to Promote Judicious Use of 25% Albumin in Critical Care Units

Objective: Hyperoncotic 25% albumin is widely used for fluid resuscitation in intensive care units. However, this practice remains controversial. By 2012 in our intensive care unit, annual 25% albumin expenditures had steadily increased to exceed $1 million. This prompted efforts to promote more judicious use. Design: Prospective time series cohort analysis using statistical process control charts. Setting: Seventy-six-bed quaternary level cardiovascular surgical intensive care unit (CVICU), organized into 6 adjacent units. Patients: Adult cardiac, thoracic, and vascular surgery patients admitted postoperatively to the CVICU during the study period. Interventions: Over 12 months starting March 2013, we sequentially implemented unit-level 25% albumin cost transparency, provider education, and individualized audit and feedback of anonymized peer ranking of albumin prescriptions. Measurements and Main Results: C control charts were used for analysis of monthly unit-level direct albumin costs for 20 months. Balance measures including red cell transfusions, number of diagnoses of pleural effusions, and length of stay were also tracked. Monthly average albumin expenditures had decreased 61% by December 2014, and there was no evidence of adverse changes in any of the balance measures. These reductions have been sustained. Conclusion: Sequential implementation of multimodal strategies can alter clinician practices to achieve substantial unit-level reduction in 25% albumin utilization without harm to patients.

Seeding long-term, sustainable change in teacher preparation programs: the case of PhysTEC

BACKGROUND

The continuation of teacher preparation activities after a 3-year Physics Teacher Education Coalition (PhysTEC) grant is used as a case study to examine multi-faceted aspects of sustainable change in higher education. Since teacher preparation is outside typical physics departmental activities, success is highly dependent on finding a department and institution who values this cause. Throughout the history of providing grants, PhysTEC has identified ten components of successful sites that they consider during the selection process. In this paper, we retrospectively analyze characteristics of six comprehensive PhysTEC sites, to see how department histories, values, and activities affect long-term sustainability as sites moved from grant funding to matched institutional funding and beyond.

RESULTS

The most important components required to sustain these programs were (1) institutional commitment-both financial support as well as intellectual and cultural support for potential teachers-(2) champion, a respected change agent at the university who ensures program success through advocacy and support, and (3) activities that enhance not only the production of teachers but also the undergraduate education activities of the department. Of the six PhysTEC sites, three sites were able to institutionalize the majority of PhysTEC activities into departmental routine. These three sites have departmental leadership and administrators who valued and invested in physics teacher preparation. At these sites, PhysTEC symbiotically supported typical departmental activities including increasing majors, improving courses, and involving undergraduates to support teaching. Two sites were sustaining activities at the time of study but attitudes toward teaching as a profession were mixed so continued sustainability is precarious and reliant on external funding. One site discontinued the majority of PhysTEC activities because of a lack of alignment with a different physics teacher initiative on campus.

CONCLUSIONS

Because physics teacher preparation is not often prioritized as a part of undergraduate departmental activities, success emerges when departmental and institutional value systems align with this goal. PhysTEC funding is not enough to create this culture; it must exist prior to funding. Sustaining PhysTEC activities is easier when they are seen as enhancing the undergraduate experience as a whole. The PhysTEC grant helped bring physics teacher preparation to the forefront, and a well-respected champion in a leadership position can help set this tone and advance departmental activities accordingly. This study has implications for sustaining reforms of typically undervalued activities in higher education or secondary teacher preparation programs in any discipline.

Using a common data platform to facilitate audit and feedback on the quality of hospital care provided to sick newborns in Kenya

Essential interventions to reduce neonatal deaths that can be effectively delivered in hospitals have been identified. Improving information systems may support routine monitoring of the delivery of these interventions and outcomes at scale. We used cycles of audit and feedback (A&F) coupled with the use of a standardised newborn admission record (NAR) form to explore the potential for creating a common inpatient neonatal data platform and illustrate its potential for monitoring prescribing accuracy. Revised NARs were introduced in a high volume, neonatal unit in Kenya together with 13 A&F meetings over a period of 3  years from January 2014 to November 2016. Data were abstracted from medical records for 15 months before introduction of the revised NAR and A&F and during the 3 years of A&F. We calculated, for each patient, the percentage of documented items from among the total recommended for documentation and trends calculated over time. Gentamicin prescribing accuracy was also tracked over time. Records were examined for 827 and 7336 patients in the pre-A&F and post-A&F periods, respectively. Documentation scores improved overall. Documentation of gestational age improved from <15% in 2014 to >75% in 2016. For five recommended items, including temperature, documentation remained <50%. 16.7% (n=1367; 95%  CI 15.9 to 17.6) of the admitted babies had a diagnosis of neonatal sepsis needing antibiotic treatment. In this group, dosing accuracy of gentamicin improved over time for those under 2  kg from 60% (95%36.1 to 80.1) in 2013 to 83% (95% CI 69.2 to 92.3) in 2016. We report that it is possible to improve routine data collection in neonatal units using a standardised neonatal record linked to relatively basic electronic data collection tools and cycles of A&F. This can be useful in identifying potential gaps in care and tracking outcomes with an aim of improving the quality of care.

Paediatricians underuse recommended genetic tests in children with global developmental delay

Objectives

To assess paediatricians' use of genetic testing for children with global developmental delay (GDD).

Study Design

We developed and piloted a questionnaire assessing the use of genetic tests in children with GDD and awareness of relevant guidelines. All practicing Quebec paediatricians were contacted. Paediatricians who did not evaluate children with GDD in their practice were excluded. Descriptive and statistical analyses were performed with SPSS.

Results

Of the 651 paediatricians, 225 answered (34.5%) and 141 were eligible. Only 31.9% were familiar with at least one guideline about genetic tests for the investigation of children with GDD, but 93.6% had ordered genetic testing for children with GDD (Fragile X testing [92.9%], karyotype [87.2%] and chromosomal microarray [63.8%]). Based on vignettes, 20.6% of participants would order genetic tests for isolated GDD and 95.0% for GDD with dysmorphic features and microcephaly. Only 56.7% ordered Fragile X testing for a girl with GDD and a known family history of Fragile X syndrome. Use of tests for isolated GDD was increased in presence of maternal pregnancy, compared with absence of pregnancy (44.7% and 27.7%, respectively). More participants would order genetic tests for a child with GDD and fetal exposure to alcohol (69.5%) than isolated GDD (20.6%).

Conclusions

Even though paediatricians often order genetic testing for children with GDD, practices and knowledge regarding testing are not optimal. As new and more complex genetic tests are developed, up-to-date training about the use of genetic tests for children with GDD needs to be integrated into paediatrics residency programs and continuous medical education.

Engaging Stakeholders and Promoting Uptake of OMERACT Core Outcome Instrument Sets

OBJECTIVE

While there has been substantial progress in the development of core outcomes sets, the degree to which these are used by researchers is variable. We convened a special workshop on knowledge translation at the Outcome Measures in Rheumatology (OMERACT) 2016 with 2 main goals. The first focused on the development of a formal knowledge translation framework and the second on promoting uptake of recommended core outcome domain and instrument sets.

METHODS

We invited all 189 OMERACT 2016 attendees to the workshop; 86 attended, representing patient research partners (n = 15), healthcare providers/clinician researchers (n = 52), industry (n = 4), regulatory agencies (n = 4), and OMERACT fellows (n = 11). Participants were given an introduction to knowledge translation and were asked to propose and discuss recommendations for the OMERACT community to (1) strengthen stakeholder involvement in the core outcome instrument set development process, and (2) promote uptake of core outcome sets with a specific focus on the potential role of post-regulatory decision makers.

RESULTS

We developed the novel "OMERACT integrated knowledge translation" framework, which formalizes OMERACT's knowledge translation strategies. We produced strategies to improve stakeholder engagement throughout the process of core outcome set development and created a list of creative and innovative ways to promote the uptake of OMERACT's core outcome sets.

CONCLUSION

The guidance provided in this paper is preliminary and is based on the views of the participants. Future work will engage OMERACT groups, "post-regulatory decision makers," and a broad range of different stakeholders to identify and evaluate the most useful methods and processes, and to revise guidance accordingly.

A qualitative study of the determinants of HIV guidelines implementation in two south-eastern districts of Tanzania

Current HIV policies in Tanzania have adopted the three long-term impact results of zero new infections, zero HIV deaths and zero stigma and discrimination. Strategies to reach these results include scaling-up HIV Testing and Counselling (HTC); Preventing Mother-To-Child Transmission (PMTCT); and strengthening Care and Treatment Clinic (CTC) services. Previous studies showed that HIV policy and guideline recommendations were not always implemented in rural South Tanzania. This study aims to identify the determinants of HIV guideline implementation. A qualitative study of 23 semi-structured interviews with facility in-charges; healthcare workers; district, regional and national HIV coordinators was conducted. Five health facilities were purposively selected by level, ownership and proximity to district headquarters. Interviews were analysed according to Fleuren's five determinants of innovation uptake related to: strategies used in guideline development and dissemination; guideline characteristics; the guideline implementing organization; guideline users; and the socio-cultural and regulatory context. None of the facilities had the HTC national guideline document. Non-involvement of providers in revisions and weak planning for guideline dissemination impeded their implementation. Lengthy guidelines and those written in English were under-used, and activities perceived to be complicated, like WHO-staging, were avoided. Availability of staff and lack of supplies like test kits and medication impeded implementation. Collaboration between facilities enhanced implementation, as did peer-support among providers. Provider characteristics including education level, knowledge of, and commitment to the guideline influenced implementation. According to providers, determinants of clients' service use included gender norms, stigma, trust and perceived benefits. The regulatory context prohibited private hospitals from buying HIV supplies. Being tools for bringing policies to practice, national guidelines are crucial in the efforts towards the three zeros. Strategies to improve providers' adherence to guidelines should include development of clearer guideline dissemination plans, strengthening of the health system, and possibly addressing of provider-perceived patient-level barriers to utilizing HIV services.

Advanced Hysteroscopic Surgery: Quality Assurance in Teaching Hospitals

Advanced hysteroscopic surgery (AHS) is a vitally important technique in the armamentarium for the management of many day-to-day clinical problems, such as menorrhagia, surgical excision of uterine myomata and septa in the management of female infertility, hysteroscopic excision of chronically retained products of conception (placenta accreta), and surgical removal of intramural ectopic pregnancy. In today's climate of accountability, it is necessary that gynecologists take a more active role in assuring the quality of their work. In this article, we discuss the quality assurance system from the point of view of the surgical audit meetings in some of the major teaching hospitals affiliated with the University of Queensland (Brisbane, Queensland, Australia).

Effect of a web-based audit and feedback intervention with outreach visits on the clinical performance of multidisciplinary teams: a cluster-randomized trial in cardiac rehabilitation

BACKGROUND

The objective of this study was to assess the effect of a web-based audit and feedback (A&F) intervention with outreach visits to support decision-making by multidisciplinary teams.

METHODS

We performed a multicentre cluster-randomized trial within the field of comprehensive cardiac rehabilitation (CR) in the Netherlands. Our participants were multidisciplinary teams in Dutch CR centres who were enrolled in the study between July 2012 and December 2013 and received the intervention for at least 1 year. The intervention included web-based A&F with feedback on clinical performance, facilities for goal setting and action planning, and educational outreach visits. Teams were randomized either to receive feedback that was limited to psychosocial rehabilitation (study group A) or to physical rehabilitation (study group B). The main outcome measure was the difference in performance between study groups in 11 care processes and six patient outcomes, measured at patient level. Secondary outcomes included effects on guideline concordance for the four main CR therapies.

RESULTS

Data from 18 centres (14,847 patients) were analysed, of which 12 centres (9353 patients) were assigned to group A and six (5494 patients) to group B. During the intervention, a total of 233 quality improvement goals was identified by participating teams, of which 49 (21%) were achieved during the study period. Except for a modest improvement in data completeness (4.5% improvement per year; 95% CI 0.65 to 8.36), we found no effect of our intervention on any of our primary or secondary outcome measures.

CONCLUSIONS

Within a multidisciplinary setting, our web-based A&F intervention engaged teams to define local performance improvement goals but failed to support them in actually completing the improvement actions that were needed to achieve those goals. Future research should focus on improving the actionability of feedback on clinical performance and on addressing the socio-technical perspective of the implementation process.

TRIAL REGISTRATION

NTR3251.

The Case for Using Evidence-Based Guidelines in Setting Hospital and Public Health Policy

Objective

Hospital systems and regulating agencies enforce strict guidelines barring personal items from entering the operating room (OR) – touting surgical site infections (SSIs) and patient safety as the rationale. We sought to determine whether or not evidence supporting this recommendation exists by reviewing available literature.

Background data

Rules and guidelines that are not evidence based may lead to increased hospital expenses and limitations on healthcare provider autonomy.

Methods

PubMed, Embase, Scopus, Cochrane Library, Web of Science, and CINAHL were searched in order to find articles that correlated personal items in the OR to documented SSIs. Articles that satisfied the following criteria were included: (1) studies looking at personal items in the OR, such as handbags, purses, badges, pagers, backpacks, jewelry phones, and eyeglasses, but not just OR equipment; and (2) the primary outcome measure was infection at the surgical site.

Results

Seventeen articles met inclusion criteria and were evaluated. Of the 17, the majority did not determine if personal items increased risk for SSIs. Only one article examined the correlation between a personal item near the operative site and SSI, concluding that wedding rings worn in the OR had no impact on SSIs. Most studies examined colonization rates on personal items as potential infection risk; however, no personal items were causally linked to SSI in any of these studies.

Conclusion

There is no objective evidence to suggest that personal items in the OR increase risk for SSIs.

The Many Organisational Factors Relevant to Planning Change in Emergency Care Departments: A Qualitative Study to Inform a Cluster Randomised Controlled Trial Aiming to Improve the Management of Patients with Mild Traumatic Brain Injuries

BACKGROUND

The Neurotrauma Evidence Translation (NET) Trial aims to design and evaluate the effectiveness of a targeted theory-and evidence-informed intervention to increase the uptake of evidence-based recommended practices for the management of patients who present to an emergency department (ED) with mild head injuries. When designing interventions to bring about change in organisational settings such as the ED, it is important to understand the impact of the context to ensure successful implementation of practice change. Few studies explicitly use organisational theory to study which factors are likely to be most important to address when planning change processes in the ED. Yet, this setting may have a unique set of organisational pressures that need to be taken into account when implementing new clinical practices. This paper aims to provide an in depth analysis of the organisational context in which ED management of mild head injuries and implementation of new practices occurs, drawing upon organisational level theory.

METHODS

Semi-structured interviews were conducted with ED staff in Australia. The interviews explored the organisational context in relation to change and organisational factors influencing the management of patients presenting with mild head injuries. Two researchers coded the interview transcripts using thematic content analysis. The "model of diffusion in service organisations" was used to guide analyses and organisation of the results.

RESULTS

Nine directors, 20 doctors and 13 nurses of 13 hospitals were interviewed. With regard to characteristics of the innovation (i.e. the recommended practices) the most important factor was whether they were perceived as being in line with values and needs. Tension for change (the degree to which stakeholders perceive the current situation as intolerable or needing change) was relatively low for managing acute mild head injury symptoms, and mixed for managing longer-term symptoms (higher change commitment, but relatively low change efficacy). Regarding implementation processes, the importance of (visible) senior leadership for all professions involved was identified as a critical factor. An unpredictable and hectic environment brings challenges in creating an environment in which team-based and organisational learning can thrive (system antecedents for innovation). In addition, the position of the ED as the entry-point of the hospital points to the relevance of securing buy-in from other units.

CONCLUSIONS

We identified several organisational factors relevant to realising change in ED management of patients who present with mild head injuries. These factors will inform the intervention design and process evaluation in a trial evaluating the effectiveness of our implementation intervention.

A Multifaceted Strategy to Implement Brief Smoking Cessation Counseling During Antenatal Care in Argentina and Uruguay: A Cluster Randomized Trial

INTRODUCTION

Argentina and Uruguay have a high prevalence of smoking during pregnancy. However, and despite national recommendations, pregnant women are not routinely receiving cessation counseling during antenatal care (ANC). We evaluated a multifaceted strategy designed to increase the frequency of pregnant women who received a brief smoking cessation counseling based on the 5As (Ask, Advise, Assess, Assist, and Arrange).

METHODS

We randomly assigned (1:1) 20 ANC clusters in Buenos Aires, Argentina and Montevideo, Uruguay to receive a multifaceted intervention to implement brief smoking cessation counseling into routine ANC, or to receive no intervention. The primary outcome was the frequency of women who recalled receiving the 5As during ANC at more than one visit. Frequency of women who smoked until the end of pregnancy, and attitudes and readiness of ANC providers towards providing counseling were secondary outcomes. Women's outcomes were measured at baseline and at the end of the 14- to 18-month intervention, by administering questionnaires at the postpartum hospital stay. Self-reported cessation was verified with saliva cotinine. The trial took place between October 03, 2011 and November 29, 2013.

RESULTS

The rate of women who recalled receiving the 5As increased from 14.0% to 33.6% in the intervention group (median rate change, 22.1%), and from 10.8% to 17.0% in the control group (median rate change, 4.6%; P = .001 for the difference in change between groups). The effect of the intervention was larger in Argentina than in Uruguay. The proportion of women who continued smoking during pregnancy was unchanged at follow-up in both groups and the relative difference between groups was not statistically significant (ratio of odds ratios 1.16, 95% CI: 0.98-1.37; P = .086). No significant changes were observed in knowledge, attitudes, and self-confidence of ANC providers.

CONCLUSIONS

The intervention showed a moderate effect in increasing the proportion of women who recalled receiving the 5As, with a third of women receiving counseling in more than one visit. However, the frequency of women who smoked until the end of the pregnancy was not significantly reduced by the intervention.

IMPLICATIONS

No implementation trials of smoking cessation interventions for pregnant women have been carried out in Latin American or in middle-income countries where health care systems or capacities may differ. We evaluated a multifaceted strategy designed to increase the frequency of pregnant women who receive brief smoking cessation counseling based on the 5As in Argentina and Uruguay. We found that the intervention showed a moderate effect in increasing the proportion of women receiving the 5As, with a third of women receiving counseling in more than one visit. However, the frequency of women who smoked until the end of the pregnancy was not significantly reduced by the intervention.

Integrating an EMR-based Transition Planning Tool for CYSHCN at a Children's Hospital: A Quality Improvement Project to Increase Provider Use and Satisfaction

An electronic medical record (EMR)-based transition planning tool (TPT) designed to facilitate transition from pediatric to adult-based health care for youth (16-25 years) with special health care needs was introduced at a large children's hospital. Activities to increase provider use were implemented in five plan-do-study-act cycles. Overall, 22 of 25 (88%) consenting providers in four pediatric subspecialty services used the TPT during 303 patient encounters, with nurses and case-managers the top users and physicians the least likely users. Use was highest with intensive technical assistance and following the introduction of an upgraded tool. Provider satisfaction with the TPT and self-reported transition planning activities notably increased across the PDSA cycles.

Using multifaceted education to improve management in acute viral bronchiolitis

OBJECTIVE

To establish current bronchiolitis management across hospitals in Wales, improve compliance with national guidelines and standardise evidence-based clinical practice.

DESIGN

A complete audit cycle with implementation of a multifaceted education bundle prior to the follow-up audit.

SETTING

Twelve acute paediatric departments between 1 November and 31 December in 2012 and 2013.

PATIENTS

All infants under 12 months with a clinical diagnosis of bronchiolitis.

INTERVENTIONS

The first audit assessed management of bronchiolitis with reference to both the Scottish Intercollegiate Guideline Network (SIGN) guidelines and local hospital guidelines. Following analysis and dissemination of these results, an education bundle was implemented nationwide, with completion of the audit cycle to assess change.

MAIN OUTCOME MEASURES

Compliance with SIGN recommendations for investigation, treatment and discharge. Compliance with the education bundle requirements also assessed in 2013.

RESULTS

Data were collected for 1599 infants. The education bundle was delivered in all hospitals. The level of severity, defined by oxygen saturations in air at presentation, length of stay and paediatric intensive care unit transfers, was equivalent for both years. Mean compliance percentage (95% CI) across Wales significantly improved between 2012 and 2013, with compliance with investigations increasing from 50% (46% to 53%) to 71% (68% to 74%), with management increasing from 65% (61% to 68%) to 74% (71% to 77%), and overall compliance improving from 38% (37% to 39%) to 59% (56% to 62%) in 2013.

CONCLUSIONS

This audit demonstrated a significant improvement in compliance following implementation of our educational bundle. This has enabled improvement in standardised and evidence-based patient care across Wales.

Making sense of implementation theories, models and frameworks

BACKGROUND

Implementation science has progressed towards increased use of theoretical approaches to provide better understanding and explanation of how and why implementation succeeds or fails. The aim of this article is to propose a taxonomy that distinguishes between different categories of theories, models and frameworks in implementation science, to facilitate appropriate selection and application of relevant approaches in implementation research and practice and to foster cross-disciplinary dialogue among implementation researchers.

DISCUSSION

Theoretical approaches used in implementation science have three overarching aims: describing and/or guiding the process of translating research into practice (process models); understanding and/or explaining what influences implementation outcomes (determinant frameworks, classic theories, implementation theories); and evaluating implementation (evaluation frameworks). This article proposes five categories of theoretical approaches to achieve three overarching aims. These categories are not always recognized as separate types of approaches in the literature. While there is overlap between some of the theories, models and frameworks, awareness of the differences is important to facilitate the selection of relevant approaches. Most determinant frameworks provide limited "how-to" support for carrying out implementation endeavours since the determinants usually are too generic to provide sufficient detail for guiding an implementation process. And while the relevance of addressing barriers and enablers to translating research into practice is mentioned in many process models, these models do not identify or systematically structure specific determinants associated with implementation success. Furthermore, process models recognize a temporal sequence of implementation endeavours, whereas determinant frameworks do not explicitly take a process perspective of implementation.

Trialability, observability and risk reduction accelerating individual innovation adoption decisions

Purpose

– The purpose of this paper is to provide a retrospective analysis of computer simulation’s role in accelerating individual innovation adoption decisions. The process innovation examined is Lean Systems Thinking, and the organizational context is the imaging department of an Australian public hospital.

Design/methodology/approach

– Intrinsic case study methods including observation, interviews with radiology and emergency personnel about scheduling procedures, mapping patient appointment processes and document analysis were used over three years and then complemented with retrospective interviews with key hospital staff. The multiple data sources and methods were combined in a pragmatic and reflexive manner to explore an extreme case that provides potential to act as an instructive template for effective change.

Findings

– Computer simulation of process change ideas offered by staff to improve patient-flow accelerated the adoption of the process changes, largely because animated computer simulation permitted experimentation (trialability), provided observable predictions of change results (observability) and minimized perceived risk.

Research limitations/implications

– The difficulty of making accurate comparisons between time periods in a health care setting is acknowledged.

Practical implications

– This work has implications for policy, practice and theory, particularly for inducing the rapid diffusion of process innovations to address challenges facing health service organizations and national health systems.

Originality/value

– The research demonstrates the value of animated computer simulation in presenting the need for change, identifying options, and predicting change outcomes and is the first work to indicate the importance of trialability, observability and risk reduction in individual adoption decisions in health services.

Standards of practice for the adult mental health workforce: meeting the needs of families where a parent has a mental illness

This article outlines the development of practice standards for the adult mental health workforce for addressing the needs of families where a parent has a mental illness (FaPMI). The practice standards recommended here were formulated using a modified cooperative inquiry process with a group of senior clinical leaders in adult mental health services in Australia, following consultation with the available literature and policy documents. The aim of the project was to generate, align, and operationalize family-inclusive practice standards within the core activities of the adult mental health workforce and integrate into the continuum of care and recovery for service users who are parents of dependent children. As part of a modified Delphi method, the standards were also ranked by the senior clinical leaders to determine what they believe to be essential and recommended practices for the adult mental health workforce they manage. We argue that developing practice standards that provide practical and realistic expectations of the adult mental health service workforce enable services and workers to better adapt practice to respond to FaPMI.

Evaluation of a tailored, multi-component intervention for implementation of evidence-based clinical practice guidelines in primary care physical therapy: a non-randomized controlled trial

Background

Clinical practice guidelines are important for transmitting research findings into practice and facilitating the application of evidence-based practice (EBP). There is a paucity of knowledge about the impact of guideline implementation strategies in primary care physical therapy. The aim of this study was to evaluate the effect of a guideline implementation intervention in primary care physical therapy in western Sweden.

Methods

An implementation strategy based on theory and current evidence was developed. A tailored, multi-component implementation intervention, addressing earlier identified determinants, was carried out in three areas comprising 28 physical therapy practices including 277 physical therapists (PTs) (intervention group). In two adjacent areas, 171 PTs at 32 practices received no intervention (control group). The core component of the intervention was an implementation seminar with group discussions. Among other components were a website and email reminders. Data were collected at baseline and follow-up with a web-based questionnaire. Primary outcomes were the self-reported awareness of, knowledge of, access to, and use of guidelines. Secondary outcomes were self-reported attitudes toward EBP and guidelines. Analyses were performed using Pearson’s χ² test and approximative z-test.

Results

168 PTs (60.6%) in the intervention group and 88 PTs (51.5%) in the control group responded to the follow-up questionnaire. 186/277 PTs (67.1%) participated in the implementation seminars, of which 97 (52.2%) responded. The proportions of PTs reporting awareness of (absolute difference in change 20.6%, p = 0.023), knowledge where to find (20.4%, p = 0.007), access to (21.7%, p < 0.001), and frequent use of (9.5%, NS) guidelines increased more in the intervention group than in the control group. The proportion of PTs reporting frequent guideline use after participation in the implementation seminar was 15.2% (p = 0.043) higher than the proportion in the control group. A higher proportion considered EBP helpful in decision making (p = 0.018). There were no other significant differences in secondary outcomes.

Conclusions

A tailored, theory- and evidence-informed, multi-component intervention for the implementation of clinical practice guidelines had a modest, positive effect on awareness of, knowledge of, access to, and use of guidelines, among PTs in primary care in western Sweden. In general, attitudes to EBP and guidelines were not affected.

Future directions of evidence-based practice in athletic training: perceived strategies to enhance the use of evidence-based practice

CONTEXT

The shift to a culture of evidence-based practice (EBP) in athletic training is a necessary step in both the optimization of patient care and the advancement of athletic trainers (ATs) as health care professionals. Whereas individuals have gained knowledge in this area, most ATs still are not practicing in an evidence-based manner. Exploring perceived strategies to enhance the use of EBP will help to determine the best approaches to assist ATs in applying EBP concepts to practice to improve patient care.

OBJECTIVE

To explore beneficial strategies and techniques ATs perceived would promote successful implementation of EBP within athletic training education and clinical practice.

DESIGN

Qualitative study.

SETTING

Individual telephone interviews.

PATIENTS OR OTHER PARTICIPANTS

Twenty-five ATs (12 educators, 13 clinicians; athletic training experience = 16.00 ± 9.41 years) were interviewed.

DATA COLLECTION AND ANALYSIS

One phone interview was conducted with each participant. After the interview was transcribed, the data were analyzed and coded into common themes and categories. Triangulation of the data occurred via the use of multiple researchers and member checking to confirm the accuracy of the data.

RESULTS

Participants identified several components they perceived as essential for enhancing the use of EBP within the athletic training profession. These components included the need for more EBP resources, more processed information, focused workshops, peer discussion and mentorship, and continual repetition and exposure. Participants also indicated that ATs need to accept their professional responsibilities to foster EBP in their daily practices.

CONCLUSIONS

The proper shift to a culture of EBP in athletic training will take both time and a persistent commitment by ATs to create strategies that will enhance the implementation of EBP across the profession. Researchers should focus on continuing to identify effective educational interventions for ATs and to determine successful strategies to implement EBP into didactic curricula and clinical practice. Additional focus should be given to which strategies most effectively produce changes in clinical practice.

No more 'business as usual' with audit and feedback interventions: towards an agenda for a reinvigorated intervention

Background

Audit and feedback interventions in healthcare have been found to be effective, but there has been little progress with respect to understanding their mechanisms of action or identifying their key ‘active ingredients.’

Discussion

Given the increasing use of audit and feedback to improve quality of care, it is imperative to focus further research on understanding how and when it works best. In this paper, we argue that continuing the ‘business as usual’ approach to evaluating two-arm trials of audit and feedback interventions against usual care for common problems and settings is unlikely to contribute new generalizable findings. Future audit and feedback trials should incorporate evidence- and theory-based best practices, and address known gaps in the literature.

Summary

We offer an agenda for high-priority research topics for implementation researchers that focuses on reviewing best practices for designing audit and feedback interventions to optimize effectiveness.

Appraisal tools for clinical practice guidelines: a systematic review

INTRODUCTION

Clinical practice guidelines can improve healthcare processes and patient outcomes, but are often of low quality. Guideline appraisal tools aim to help potential guideline users in assessing guideline quality. We conducted a systematic review of publications describing guideline appraisal tools in order to identify and compare existing tools.

METHODS

Among others we searched MEDLINE, EMBASE and the Cochrane Database of Systematic Reviews from 1995 to May 2011 for relevant primary and secondary publications. We also handsearched the reference lists of relevant publications. On the basis of the available literature we firstly generated 34 items to be used in the comparison of appraisal tools and grouped them into thirteen quality dimensions. We then extracted formal characteristics as well as questions and statements of the appraisal tools and assigned them to the items.

RESULTS

We identified 40 different appraisal tools. They covered between three and thirteen of the thirteen possible quality dimensions and between three and 29 of the possible 34 items. The main focus of the appraisal tools were the quality dimensions "evaluation of evidence" (mentioned in 35 tools; 88%), "presentation of guideline content" (34 tools; 85%), "transferability" (33 tools; 83%), "independence" (32 tools; 80%), "scope" (30 tools; 75%), and "information retrieval" (29 tools; 73%). The quality dimensions "consideration of different perspectives" and "dissemination, implementation and evaluation of the guideline" were covered by only twenty (50%) and eighteen tools (45%) respectively.

CONCLUSIONS

Most guideline appraisal tools assess whether the literature search and the evaluation, synthesis and presentation of the evidence in guidelines follow the principles of evidence-based medicine. Although conflicts of interest and norms and values of guideline developers, as well as patient involvement, affect the trustworthiness of guidelines, they are currently insufficiently considered. Greater focus should be placed on these issues in the further development of guideline appraisal tools.

The demonstration of a theory-based approach to the design of localized patient safety interventions

BACKGROUND

There is evidence of unsafe care in healthcare systems globally. Interventions to implement recommended practice often have modest and variable effects. Ideally, selecting and adapting interventions according to local contexts should enhance effects. However, the means by which this can happen is seldom systematic, based on theory, or made transparent. This work aimed to demonstrate the applicability, feasibility, and acceptability of a theoretical domains framework implementation (TDFI) approach for co-designing patient safety interventions.

METHODS

We worked with three hospitals to support the implementation of evidence-based guidance to reduce the risk of feeding into misplaced nasogastric feeding tubes. Our stepped process, informed by the TDF and key principles from implementation literature, entailed: involving stakeholders; identifying target behaviors; identifying local factors (barriers and levers) affecting behavior change using a TDF-based questionnaire; working with stakeholders to generate specific local strategies to address key barriers; and supporting stakeholders to implement strategies. Exit interviews and audit data collection were undertaken to assess the feasibility and acceptability of this approach.

RESULTS

Following audit and discussion, implementation teams for each Trust identified the process of checking the positioning of nasogastric tubes prior to feeding as the key behavior to target. Questionnaire results indicated differences in key barriers between organizations. Focus groups generated innovative, generalizable, and adaptable strategies for overcoming barriers, such as awareness events, screensavers, equipment modifications, and interactive learning resources. Exit interviews identified themes relating to the benefits, challenges, and sustainability of this approach. Time trend audit data were collected for 301 patients over an 18-month period for one Trust, suggesting clinically significant improved use of pH and documentation of practice following the intervention.

CONCLUSIONS

The TDF is a feasible and acceptable framework to guide the implementation of patient safety interventions. The stepped TDFI approach engages healthcare professionals and facilitates contextualization in identifying the target behavior, eliciting local barriers, and selecting strategies to address those barriers. This approach may be of use to implementation teams and policy makers, although our promising findings confirm the need for a more rigorous evaluation; a balanced block evaluation is currently underway.

The use of a quality indicator to reduce elective repeat Caesarean section for low-risk women before 39 weeks' gestation: the Eastern Ontario experience

OBJECTIVE

Elective repeat Caesarean section (ERCS) for low-risk women at < 39 weeks' gestation has consistently been associated with increased risks to the neonate, including respiratory morbidity, NICU admission, and lengthier hospital stays than ERCS at 39 to 40 weeks' gestation. The objective of this quality improvement project was to reduce high rates of ERCS < 39 weeks across the Eastern Ontario region.

METHODS

All hospitals within the region providing care during labour and birth (n = 10) were asked to participate. Representatives from each hospital received information about their site-specific rates and knowledge-translation resources to assist them with the project. A benchmark rate for ERCS < 39 weeks was set at 30%. The rates of ERCS < 39 weeks were calculated for two different times (the 2009-2010 and 2010-2011 fiscal years) and the relative difference and 95% confidence intervals were calculated to quantify the magnitude and statistical significance of any change. Qualitative interviews were completed with key informants from each hospital.

RESULTS

The proportion of ERCS at < 39 weeks' gestation across the region in the fiscal year 2010-2011 (n = 197/497; 39.6%) was significantly decreased (relative difference: -21%; 95% CI -31% to -8%, P = 0.002) from the previous fiscal year 2009-2010 (n = 229/459; 49.9%). A number of barriers to, and facilitators of, practice change were identified.

CONCLUSION

A reduction in the rate of ERCS < 39 weeks among low-risk women was achieved across the region. Awareness of the issue, possession of site-specific data, and agreement about the evidence and the need for change are critical first steps to improving practice.

Exploring the feasibility of Conjoint Analysis as a tool for prioritizing innovations for implementation

Background

In an era of scarce and competing priorities for implementation, choosing what to implement is a key decision point for many behavioural change projects. The values and attitudes of the professionals and managers involved inevitably impact the priority attached to decision options. Reliably capturing such values is challenging.

Methods

This paper presents an approach for capturing and incorporating professional values into the prioritization of healthcare innovations being considered for adoption. Conjoint Analysis (CA) was used in a single UK Primary Care Trust to measure the priorities of healthcare professionals working with women with postnatal depression. Rating-based CA data was gathered using a questionnaire and then mapped onto 12 interventions being considered as a means of improving the management of postnatal depression.

Results

The ‘impact on patient care’ and the ‘quality of supporting evidence’ associated with the potential innovations were the most influential in shaping priorities. Professionals were least influenced by whether an innovation was an existing national or local priority, or whether current practice in the Trust was meeting minimum standards. Ranking the 12 innovations by the preferences of potential adopters revealed ‘guided self help’ was the top priority for implementation and ‘screening questions for post natal depression’ the least. When other factors were considered (such as the presence of routine data or planned implementation activity elsewhere in the Trust), the project team chose to combine the eight related treatments and implement these as a single innovation referred to as ‘psychological therapies’.

Conclusions

Using Conjoint Analysis to prioritise potential innovation implementation options is a feasible means of capturing the utility of stakeholders and thus increasing the chances of an innovation being adopted. There are some practical barriers to overcome such as increasing response rates to conjoint surveys before routine and unevaluated use of this technique should be considered.