Impact of the SIGN head injury guidelines and NHS 4-hour emergency target on hospital admissions for head injury in Scotland: an interrupted times series

Printed educational materials: effects on professional practice and healthcare outcomes

BACKGROUND

Printed educational materials are widely used dissemination strategies to improve the quality of healthcare professionals' practice and patient health outcomes. Traditionally they are presented in paper formats such as monographs, publication in peer-reviewed journals and clinical guidelines. This is the fourth update of the review.

OBJECTIVES

To assess the effect of printed educational materials (PEMs) on the practice of healthcare professionals and patient health outcomes. To explore the influence of some of the characteristics of the printed educational materials (e.g. source, content, format) on their effect on healthcare professionals' practice and patient health outcomes.

SEARCH METHODS

We searched MEDLINE, Embase, the Cochrane Central Register of Controlled Trials (CENTRAL), HealthStar, CINAHL, ERIC, CAB Abstracts, Global Health, and EPOC Register from their inception to 6 February 2019. We checked the reference lists of all included studies and relevant systematic reviews.

SELECTION CRITERIA

We included randomised trials (RTs), controlled before-after studies (CBAs) and interrupted time series studies (ITSs) that evaluated the impact of PEMs on healthcare professionals' practice or patient health outcomes. We included three types of comparisons: (1) PEM versus no intervention, (2) PEM versus single intervention, (3) multifaceted intervention where PEM is included versus multifaceted intervention without PEM. Any objective measure of professional practice (e.g. prescriptions for a particular drug), or patient health outcomes (e.g. blood pressure) were included.

DATA COLLECTION AND ANALYSIS

Two reviewers undertook data extraction independently. Disagreements were resolved by discussion. For analyses, we grouped the included studies according to study design, type of outcome and type of comparison. For controlled trials, we reported the median effect size for each outcome within each study, the median effect size across outcomes for each study and the median of these effect sizes across studies. Where data were available, we re-analysed the ITS studies by converting all data to a monthly basis and estimating the effect size from the change in the slope of the regression line between before and after implementation of the PEM. We reported median changes in slope for each outcome, for each study, and then across studies. We standardised all changes in slopes by their standard error, allowing comparisons and combination of different outcomes. We categorised each PEM according to potential effects modifiers related to the source of the PEMs, the channel used for their delivery, their content, and their format. We assessed the risks of bias of all the included studies.

MAIN RESULTS

We included 84 studies: 32 RTs, two CBAs and 50 ITS studies. Of the 32 RTs, 19 were cluster RTs that used various units of randomisation, such as practices, health centres, towns, or areas. The majority of the included studies (82/84) compared the effectiveness of PEMs to no intervention. Based on the RTs that provided moderate-certainty evidence, we found that PEMs distributed to healthcare professionals probably improve their practice, as measured with dichotomous variables, compared to no intervention (median absolute risk difference (ARD): 0.04; interquartile range (IQR): 0.01 to 0.09; 3,963 healthcare professionals randomised within 3073 units). We could not confirm this finding using the evidence gathered from continuous variables (standardised mean difference (SMD): 0.11; IQR: -0.16 to 0.52; 1631 healthcare professionals randomised within 1373 units ), from the ITS studies (standardised median change in slope = 0.69; 35 studies), or from the CBA study because the certainty of this evidence was very low. We also found, based on RTs that provided moderate-certainty evidence, that PEMs distributed to healthcare professionals probably make little or no difference to patient health as measured using dichotomous variables, compared to no intervention (ARD: 0.02; IQR: -0.005 to 0.09; 935,015 patients randomised within 959 units). The evidence gathered from continuous variables (SMD: 0.05; IQR: -0.12 to 0.09; 6,737 patients randomised within 594 units) or from ITS study results (standardised median change in slope = 1.12; 8 studies) do not strengthen these findings because the certainty of this evidence was very low. Two studies (a randomised trial and a CBA) compared a paper-based version to a computerised version of the same PEM. From the RT that provided evidence of low certainty, we found that PEM in computerised versions may make little or no difference to professionals' practice compared to PEM in printed versions (ARD: -0.02; IQR: -0.03 to 0.00; 139 healthcare professionals randomised individually). This finding was not strengthened by the CBA study that provided very low certainty evidence (SMD: 0.44; 32 healthcare professionals). The data gathered did not allow us to conclude which PEM characteristics influenced their effectiveness. The methodological quality of the included studies was variable. Half of the included RTs were at risk of selection bias. Most of the ITS studies were conducted retrospectively, without prespecifying the expected effect of the intervention, or acknowledging the presence of a secular trend.

AUTHORS' CONCLUSIONS

The results of this review suggest that, when used alone and compared to no intervention, PEMs may slightly improve healthcare professionals' practice outcomes and patient health outcomes. The effectiveness of PEMs compared to other interventions, or of PEMs as part of a multifaceted intervention, is uncertain.

Evaluation of the impact of the NICE head injury guidelines on inpatient mortality from traumatic brain injury: an interrupted time series analysis

OBJECTIVE

To evaluate the impact of National Institute for Health and Care Excellence (NICE) head injury guidelines on deaths and hospital admissions caused by traumatic brain injury (TBI).

SETTING

All hospitals in England between 1998 and 2017.

PARTICIPANTS

Patients admitted to hospital or who died up to 30 days following hospital admission with International Classification of Diseases (ICD) coding indicating the reason for admission or death was TBI.

INTERVENTION

An interrupted time series analysis was conducted with intervention points when each of the three guidelines was introduced. Analysis was stratified by guideline recommendation specific age groups (0-15, 16-64 and 65+).

OUTCOME MEASURES

The monthly population mortality and admission rates for TBI.

STUDY DESIGN

An interrupted time series analysis using complete Office of National Statistics cause of death data linked to hospital episode statistics for inpatient admissions in England.

RESULTS

The monthly TBI mortality and admission rates in the 65+ age group increased from 0.5 to 1.5 and 10 to 30 per 100 000 population, respectively. The increasing mortality rate was unaffected by the introduction of any of the guidelines.The introduction of the second NICE head injury guideline was associated with a significant reduction in the monthly TBI mortality rate in the 16-64 age group (-0.005; 95% CI: -0.002 to -0.007).In the 0-15 age group the TBI mortality rate fell from around 0.05 to 0.01 per 100 000 population and this trend was unaffected by any guideline.

CONCLUSION

The introduction of NICE head injury guidelines was associated with a reduced admitted TBI mortality rate after specialist care was recommended for severe TBI. The improvement was solely observed in patients aged 16-64 years.The cause of the observed increased admission and mortality rates in those 65+ and potential treatments for TBI in this age group require further investigation.