Knowledge translation studies in paediatric emergency medicine: A systematic review of the literature

International variation in evidence-based emergency department management of bronchiolitis: a retrospective cohort study

OBJECTIVES

We aimed to evaluate the international variation in the use of evidence-based management (EBM) in bronchiolitis. We hypothesised that management consistent with full-EBM practices is associated with the research network of care, adjusted for patient-level characteristics. Secondary objectives were to determine the association between full-EBM and (1) hospitalisation and (2) emergency department (ED) revisits resulting in hospitalisation within 21 days.

DESIGN

A secondary analysis of a retrospective cohort study.

SETTING

38 paediatric EDs belonging to the Paediatric Emergency Research Network in Canada, USA, Australia/New Zealand UK/Ireland and Spain/Portugal.

PATIENTS

Otherwise healthy infants 2-11 months old diagnosed with bronchiolitis between 1 January 2013 and 31 December, 2013.

OUTCOME MEASURES

Primary outcome was management consistent with full-EBM, that is, no bronchodilators/corticosteroids/antibiotics, no chest radiography or laboratory testing. Secondary outcomes included hospitalisations during the index and subsequent ED visits.

RESULTS

1137/2356 (48.3%) infants received full-EBM (ranging from 13.2% in Spain/Portugal to 72.3% in UK/Ireland). Compared with the UK/Ireland, the adjusted ORs (aOR) of full-EBM receipt were lower in Spain/Portugal (aOR 0.08, 95% CI 0.02 to 0.29), Canada (aOR 0.13 (95% CI 0.06 to 0.31) and USA (aOR 0.16 (95% CI 0.07 to 0.35). EBM was less likely in infants with dehydration (aOR 0.49 (95% CI 0.33 to 0.71)), chest retractions (aOR 0.69 (95% CI 0.52 to 0.91)) and nasal flaring (aOR 0.69 (95% CI 0.52 to 0.92)). EBM was associated with reduced odds of hospitalisation at the index visit (aOR 0.77 (95% CI 0.60 to 0.98)) but not at revisits (aOR 1.17 (95% CI 0.74 to 1.85)).

CONCLUSIONS

Infants with bronchiolitis frequently do not receive full-EBM ED management, particularly those outside of the UK/Ireland. Furthermore, there is marked variation in full-EBM between paediatric emergency networks, and full-EBM delivery is associated with lower likelihood of hospitalisation. Given the global bronchiolitis burden, international ED-focused deimplementation of non-indicated interventions to enhance EBM is needed.

Review article: A primer for clinical researchers in the emergency department: Part XII. Sustainability of improvements in care: An introduction

Despite an increased focus on ways to improve implementation of evidence and de-implementation of practices with no known benefit, there is limited guidance on how to sustain these improvements. This review provides an introduction to sustainability of improvements in care and sustainability research, discussing how to support sustainability in practice and detailing a sustainability research agenda for the emergency medicine setting.

Sustainability of evidence-based practices in the management of infants with bronchiolitis in hospital settings - a PREDICT study protocol

Background

Understanding how and why de-implementation of low-value practices is sustained remains unclear. The Paediatric Research in Emergency Departments International CollaboraTive (PREDICT) Bronchiolitis Knowledge Translation (KT) Study was a cluster randomised controlled trial conducted in 26 Australian and New Zealand hospitals (May-November 2017). Results showed targeted, theory-informed interventions (clinical leads, stakeholder meetings, train-the-trainer workshop, targeted educational package, audit/feedback) were effective at reducing use of five low-value practices for bronchiolitis (salbutamol, glucocorticoids, antibiotics, adrenaline and chest x-ray) by 14.1% in acute care settings. The primary aim of this study is to determine the sustainability (continued receipt of benefits) of these outcomes at intervention hospitals two-years after the removal of study supports. Secondary aims are to determine sustainability at one-year after removal of study support at intervention hospitals; improvements one-and-two years at control hospitals; and explore factors that influence sustainability at intervention hospitals and contribute to improvements at control hospitals.

Methods

A mixed-methods study design. The quantitative component is a retrospective medical record audit of bronchiolitis management within 24 hours of emergency department (ED) presentations at 26 Australian (n = 20) and New Zealand (n = 6) hospitals, which participated in the PREDICT Bronchiolitis KT Study. Data for a total of 1800 infants from intervention and control sites (up to 150 per site) will be collected to determine if improvements (i.e., no use of all five low-value practices) were sustained two- years (2019) post-trial (primary outcome; composite score); and a further 1800 infants from intervention and control sites will be collected to determine sustained improvements one- year (2018) post-trial (secondary outcome). An a priori definition of sustainability will be used. The qualitative component will consist of semi-structured interviews with three to five key emergency department and paediatric inpatient medical and nursing staff per site (total n = 78-130). Factors that may have contributed to sustaining outcomes and/or interventions will be explored and mapped to an established sustainability framework.

Discussion

This study will improve our understanding of the sustainability of evidence-based bronchiolitis management in infants. Results will also advance implementation science research by informing future de-implementation strategies to reduce low-value practices and sustain practice change in paediatric acute care.

Trial registration

Australian and New Zealand Clinical Trials Registry No: ACTRN12621001287820.

Twitter as a Knowledge Translation Tool to Increase Awareness of the OpenHEARTSMAP Psychosocial Assessment and Management Tool in the Field of Pediatric Emergency Mental Health

Rationale

The increasing prevalence of pediatric mental health presentations in pediatric emergency departments (PED) requires improved integration of evidence-based management strategies. Social media, specifically Twitter, has shown potential to aid in closing the knowledge translation (KT) gap between these evidence-based management strategies and pediatric emergency medicine (PEM) providers.

Aims and objectives

The primary outcome of this study is to evaluate the effectiveness of Twitter as a KT dissemination tool in PEM. The exploratory outcomes were to assess how to effectively implement Twitter in KT, explore ways in which Twitter can maximize the global reach of OpenHEARTSMAP and whether Twitter can lead to increased adoption of OpenHEARTSMAP.

Methods

A one-week prospective promotion on Twitter was conducted to disseminate the OpenHEARTSMAP tool using 15 topic-related hashtags (arm 1, 15 Tweets) versus one post wherein 15 different Twitter users were mentioned in 15 different comments (arm 2, 1 Tweet). A one-week control period immediately prior to posting was employed for comparisons.

Results

During the Twitter week, visits per day to OpenHEARTSMAP increased by 175%; mean time spent on the website increased by 212%; and mean page actions per visit increased by 130%. The greatest increase in visits occurred on the first day of Tweeting. Arm 2 received the greatest engagements. Within arm 1, the category of pediatrics received the most engagements (hashtag #Peds was most popular). Arm 1 received 455 impressions compared to 2071 in arm 2. No new users registered an account on the OpenHEARTSMAP website, which is required to physically use the tool.

Conclusion

Twitter can be an effective KT tool to increase awareness of research, the first step of KT, in the domain of PEM mental health care. Strategies for success include building a robust Twitter following; posting during peak healthcare-related Twitter traffic times; employing hashtags coinciding with current events; and targeting posts by tagging users who need not necessarily be generally well-known opinion leaders.

Implementation strategies for knowledge products in primary healthcare: a systematic review of systematic reviews (Preprint)

Background

The underuse or overuse of knowledge products leads to waste in health care, and primary care is no exception.

Objective

This study aimed to characterize which knowledge products are frequently implemented, the implementation strategies used in primary care, and the implementation outcomes that are measured.

Methods

We performed a systematic review (SR) of SRs using the Cochrane systematic approach to include eligible SRs. The inclusion criteria were any primary care contexts, health care professionals and patients, any Effective Practice and Organization of Care implementation strategies of specified knowledge products, any comparators, and any implementation outcomes based on the Proctor framework. We searched the MEDLINE, EMBASE, CINAHL, Ovid PsycINFO, Web of Science, and Cochrane Library databases from their inception to October 2019 without any restrictions. We searched the references of the included SRs. Pairs of reviewers independently performed selection, data extraction, and methodological quality assessment by using A Measurement Tool to Assess Systematic Reviews 2. Data extraction was informed by the Effective Practice and Organization of Care taxonomy for implementation strategies and the Proctor framework for implementation outcomes. We performed a descriptive analysis and summarized the results by using a narrative synthesis.

Results

Of the 11,101 records identified, 81 (0.73%) SRs were included. Of these 81, a total of 47 (58%) SRs involved health care professionals alone. Moreover, 15 SRs had a high or moderate methodological quality. Most of them addressed 1 type of knowledge product (56/81, 69%), common clinical practice guidelines (26/56, 46%) or management, and behavioral or pharmacological health interventions (24/56, 43%). Mixed strategies were used for implementation (67/81, 83%), predominantly education-based (meetings in 60/81, 74%; materials distribution in 59/81, 73%; and academic detailing in 45/81, 56%), reminder (53/81, 36%), and audit and feedback (40/81, 49%) strategies. Education meetings (P=.13) and academic detailing (P=.11) seemed to be used more when the population was composed of health care professionals alone. Improvements in the adoption of knowledge products were the most commonly measured outcome (72/81, 89%). The evidence level was reported in 12% (10/81) of SRs on 62 outcomes (including 48 improvements in adoption), of which 16 (26%) outcomes were of moderate or high level.

Conclusions

Clinical practice guidelines and management and behavioral or pharmacological health interventions are the most commonly implemented knowledge products and are implemented through the mixed use of educational, reminder, and audit and feedback strategies. There is a need for a strong methodology for the SR of randomized controlled trials to explore their effectiveness and the entire cascade of implementation outcomes.

Development of targeted, theory-informed interventions to improve bronchiolitis management

BACKGROUND

Despite international guidelines providing evidence-based recommendations on appropriate management of infants with bronchiolitis, wide variation in practice occurs. This results in infants receiving care of no benefit, with associated cost and is potentially harmful. Theoretical frameworks are increasingly used to develop interventions, utilising behaviour change techniques specifically chosen to target factors contributing to practice variation, with de-implementation often viewed as harder than implementing. This paper describes the stepped process using the Theoretical Domains Framework (TDF) to develop targeted, theory-informed interventions which subsequently successfully improved management of infants with bronchiolitis by de-implementing ineffective therapies. Explicit description of the process and rationale used in developing de-implementation interventions is critical to dissemination of these practices into real world clinical practice.

METHODS

A stepped approach was used: (1) Identify evidence-based recommendations and practice variation as targets for change, (2) Identify factors influencing practice change (barriers and enablers) to be addressed, and (3) Identification and development of interventions (behaviour change techniques and methods of delivery) addressing influencing factors, considering evidence of effectiveness, feasibility, local relevance and acceptability. The mode of delivery for the intervention components was informed by evidence from implementation science systematic reviews, and setting specific feasibility and practicality.

RESULTS

Five robust evidence-based management recommendations, targeting the main variation in bronchiolitis management were identified: namely, no use of chest x-ray, salbutamol, glucocorticoids, antibiotics, and adrenaline. Interventions developed to target recommendations addressed seven TDF domains (identified following qualitative clinician interviews (n = 20)) with 23 behaviour change techniques chosen to address these domains. Final interventions included: (1) Local stakeholder meetings, (2) Identification of medical and nursing clinical leads, (3) Train-the-trainer workshop for all clinical leads, (4) Local educational materials for delivery by clinical leads, (5) Provision of tools and materials targeting influencing factors, and prompting recommended behaviours, and (6) Audit and feedback.

CONCLUSION

A stepped approach based on theory, evidence and issues of feasibility, local relevance and acceptability, was successfully used to develop interventions to improve management of infants with bronchiolitis. The rationale and content of interventions has been explicitly described allowing others to de-implement unnecessary bronchiolitis management, thereby improving care.

Effectiveness of Targeted Interventions on Treatment of Infants With Bronchiolitis: A Randomized Clinical Trial

IMPORTANCE

In developed countries, bronchiolitis is the most common reason for infants to be admitted to the hospital, and all international bronchiolitis guidelines recommend supportive care; however, significant variation in practice continues with infants receiving non-evidence-based therapies. Deimplementation research aims to reduce the use of low-value care, and advancing science in this area is critical to delivering evidence-based care.

OBJECTIVE

To determine the effectiveness of targeted interventions vs passive dissemination of an evidence-based bronchiolitis guideline in improving treatment of infants with bronchiolitis.

DESIGN, SETTING, AND PARTICIPANTS

This international, multicenter cluster randomized clinical trial included 26 hospitals (clusters) in Australia and New Zealand providing tertiary or secondary pediatric care (13 randomized to intervention, 13 to control) during the 2017 bronchiolitis season. Data were collected on 8003 infants for the 3 bronchiolitis seasons (2014-2016) before the implementation period and 3727 infants for the implementation period (2017 bronchiolitis season, May 1-November 30). Data were analyzed from November 16, 2018, to December 9, 2020.

INTERVENTIONS

Interventions were developed using theories of behavior change to target key factors that influence bronchiolitis management. These interventions included site-based clinical leads, stakeholder meetings, a train-the-trainer workshop, targeted educational delivery, other educational and promotional materials, and audit and feedback.

MAIN OUTCOMES AND MEASURES

The primary outcome was compliance during the first 24 hours of care with no use of chest radiography, albuterol, glucocorticoids, antibiotics, and epinephrine, measured retrospectively from medical records of randomly selected infants with bronchiolitis who presented to the hospital. There were no patient-level exclusions.

RESULTS

A total of 26 hospitals were randomized without dropouts. Analysis was by intention to treat. Baseline data collected on 8003 infants for 3 bronchiolitis seasons (2014-2016) before the implementation period were similar between intervention and control hospitals. Implementation period data were collected on 3727 infants, including 2328 boys (62%) and 1399 girls (38%), with a mean (SD) age of 6.0 (3.2) months. A total of 459 (12%) were Māori (New Zealand), and 295 (8%) were Aboriginal/Torres Strait Islander (Australia). Compliance with recommendations was 85.1% (95% CI, 82.6%-89.7%) in intervention hospitals vs 73.0% (95% CI, 65.3%-78.8%) in control hospitals (adjusted risk difference, 14.1%; 95% CI, 6.5%-21.7%; P < .001).

CONCLUSIONS AND RELEVANCE

Targeted interventions led to improved treatment of infants with bronchiolitis. This study has important implications for bronchiolitis management and the development of effective interventions to deimplement low-value care.

TRIAL REGISTRATION

Australian and New Zealand Clinical Trials Registry: ACTRN12616001567415.

Measuring organizational context in Australian emergency departments and its impact on stroke care and patient outcomes

BACKGROUND

Emergency departments (ED) are challenging environments but critical for early management of patients with stroke.

PURPOSE

To identify how context affects the provision of stroke care in 26 Australian EDs.

METHOD

Nurses perceptions of ED context was assessed with the Alberta Context Tool. Medical records were audited for quality of stroke care and patient outcomes.

FINDINGS

Collectively, emergency nurses (n = 558) rated context positively with several nurse and hospital characteristics impacting these ratings. Despite these positive ratings, regression analysis showed no significant differences in the quality of stroke care (n = 1591 patients) and death or dependency (n = 1165 patients) for patients in EDs with high or low rated context.

DISCUSSION

Future assessments of ED context may need to examine contextual factors beyond the scope of the Alberta Context Tool which may play an important role for the understanding of stroke care and patient outcomes in EDs.

Knowledge translation in Western Australia tertiary paediatric emergency department: An audit cycle of effectiveness of guideline dissemination on bronchiolitis management

AIM

Bronchiolitis is the commonest cause of hospitalisation for infants. Evidence-based Australasian bronchiolitis guideline was developed and introduced in 2017. This audit was to determine if the knowledge translation process of the updated local tertiary hospital bronchiolitis guideline (based on the Australasian guideline) reduced unnecessary interventions.

METHODS

A retrospective chart review of infants with bronchiolitis diagnosis during the pre-guideline (1 July to 31 August 2015) and post-guideline (1 July to 31 August 2017) period, with the primary outcome of the number/proportion of unnecessary interventions.

RESULTS

Presentations between 1 July to 31 August 2015 (n = 465) were compared with 2017 (n = 343). There was no difference in undertaking chest X-ray (24 (5.2%) vs. 17 (5.0%), odds ratio (OR) 0.98 (95% confidence interval (CI) 0.71-1.35), P = 0.911), salbutamol (23 (4.9%) vs. 10 (2.9%), OR 0.86 (95% CI 0.65-1.13), P = 0.279), glucocorticoids (2 (0.4%) vs. 5 (1.5%), OR 1.89 (95% CI 0.83-4.31), p = 0.129), antibiotics (11 (2.4%) vs. 5 (1.5%), OR 0.86 (95% CI 0.65-1.15), P = 0.307) or nasopharyngeal aspirate (172 (37%) vs. 124 (36.2%), OR 1.00 (95% CI 0.87-1.67), P = 0.937) in hospital. Adrenaline was not administered in both years. There was reduced hospital admissions (303 (65.2%) vs. 192 (56.0%), OR 0.82 (95% CI 0.71-0.95), P = 0.008) with no difference in paediatric intensive care unit admissions (10 (2.2%) vs. 8 (2.3%), OR 1.04 (95% CI 0.65-1.67), P = 0.863).

CONCLUSION

The dissemination process of the updated local hospital bronchiolitis guideline did not show any statistically significant reduction of unnecessary interventions in the hospital. Further studies are required to determine the effective process to instigate changes in health services.

Understanding factors that contribute to variations in bronchiolitis management in acute care settings: a qualitative study in Australia and New Zealand using the Theoretical Domains Framework

Background

Bronchiolitis is the most common reason for infants under one year of age to be hospitalised. Despite management being well defined with high quality evidence of no efficacy for salbutamol, adrenaline, glucocorticoids, antibiotics or chest x-rays, substantial variation in practice occurs. Understanding factors that influence practice variation is vital in order to tailor knowledge translation interventions to improve practice. This study explores factors influencing the uptake of five evidence-based guideline recommendations using the Theoretical Domains Framework.

Methods

Semi-structured interviews were undertaken with clinicians in emergency departments and paediatric inpatient areas across Australia and New Zealand exploring current practice, and factors that influence this, based on the Theoretical Domains Framework. Interview transcripts were coded using thematic content analysis.

Results

Between July and October 2016, 20 clinicians (12 doctors, 8 nurses) were interviewed. Most clinicians believed chest x-rays were not indicated and caused radiation exposure (beliefs about consequences). However, in practice their decisions were influenced by concerns about misdiagnosis, severity of illness, lack of experience (knowledge) and confidence in managing infants with bronchiolitis (skills), and parental pressure influencing practice (social influences). Some senior clinicians believed trialling salbutamol might be of benefit for some infants (beliefs about consequences) but others strongly discounted this, believing salbutamol to be ineffective, with high quality evidence supporting this (knowledge). Most were concerned about antibiotic resistance and did not believe in antibiotic use in infants with bronchiolitis (beliefs about consequences) but experienced pressure from parents to prescribe (social influences). Glucocorticoid use was generally believed to be of no benefit (knowledge) with concerns surrounding frequency of use in primary care, and parental pressure (social influences). Nurse’s reinforced evidence-based management of bronchiolitis with junior clinicians (social/professional role and identity). Regular turnover of medical staff, a lack of ‘paediatric confident’ nurses and doctors, reduced senior medical coverage after hours, and time pressure in emergency departments were factors influencing practice (environmental context and resources).

Conclusions

Factors influencing the management of infants with bronchiolitis in the acute care period were identified using the Theoretical Domains Framework. These factors will inform the development of tailored knowledge translation interventions.

To Choose or Not To Choose: Evaluating the Effect of a Choosing Wisely Knowledge Translation Initiative for Imaging in Low Back Pain by Emergency Physicians

Introduction: We aimed to quantify the baseline familiarity of emergency medicine (EM) physicians with the Choosing Wisely Canada (CWC)-EM recommendations. We then assessed whether a structured knowledge translation (KT) initiative affected awareness, knowledge, and practice patterns for imaging in low back pain.

Methods: We completed a two-center, before and after practice evaluation study. Physicians working in two Canadian emergency departments (EDs) were asked to participate in a survey before a KT initiative, and were surveyed again at a six-month follow up period post-intervention. The primary outcome of physician practice was determined by analyzing the frequency of lumbar X-ray imaging for back pain.

Results: A total of 37 physicians were asked to complete the pre- and post-intervention survey. Awareness of the CWC-EM recommendations increased following the intervention (63%; 95%CI: 43-79 at baseline vs. 86%; 66-96 post-intervention). Knowledge increased with 58% (39-76) of physicians responding correctly initially, and 86% (66-96) after the intervention. Despite increases in awareness and knowledge of the guidelines, the lumbar X-ray imaging rate increased from a baseline of 12% (9.9-14.5) to 16.2% (13.6-19.2; p = 0.023) following the intervention.

Conclusion: We demonstrated some improvements in physician awareness and knowledge of the CWC-EM recommendations following our intervention. Despite these improvements, our KT intervention was associated with an increased frequency of imaging for low back pain, contrary to our expectations.

Implementing evidence-based practices in the care of infants with bronchiolitis in Australasian acute care settings: study protocol for a cluster randomised controlled study

BACKGROUND

Bronchiolitis is the most common reason for admission to hospital for infants less than one year of age. Although management is well defined, there is substantial variation in practice, with infants receiving ineffective therapies or management. This study will test the effectiveness of tailored, theory informed knowledge translation (KT) interventions to decrease the use of five clinical therapies or management processes known to be of no benefit, compared to usual dissemination practices in infants with bronchiolitis. The primary objective is to establish whether the KT interventions are effective in increasing compliance to five evidence based recommendations in the first 24 h following presentation to hospital. The five recommendations are that infants do not receive; salbutamol, antibiotics, glucocorticoids, adrenaline, or a chest x-ray.

METHODS/DESIGN

This study is designed as a cluster randomised controlled trial. We will recruit 24 hospitals in Australia and New Zealand, stratified by country and provision of tertiary or secondary paediatric care. Hospitals will be randomised to either control or intervention groups. Control hospitals will receive a copy of the recent Australasian Bronchiolitis Guideline. Intervention hospitals will receive KT interventions informed by a qualitative analysis of factors influencing clinician care of infants with bronchiolitis. Key interventions include, local stakeholder meetings, identifying medical and nursing clinical leads in both emergency departments and paediatric inpatient areas who will attend a single education train-the-trainer day to then deliver standardised staff education with the training materials provided and coordinate audit and feedback reports locally over the study period. Data will be extracted retrospectively for three years prior to the study intervention year, and for seven months of the study intervention year bronchiolitis season following intervention delivery to determine compliance with the five evidence-based recommendations. Data will be collected to assess fidelity to the implementation strategies and to facilitate an economic evaluation.

DISCUSSION

This study will contribute to the body of knowledge to determine the effectiveness of tailored, theory informed interventions in acute care paediatric settings, with the aim of reducing the evidence to practice gaps in the care of infants with bronchiolitis.

TRIAL REGISTRATION

Australian New Zealand Clinical Trials Registry ACTRN12616001567415 (retrospectively registered on 14 November 2016).