Improving quality and outcomes of stroke care in hospitals: Protocol and statistical analysis plan for the Stroke123 implementation study

Conducting Implementation Research in Stroke Rehabilitation: A Case Example and Considerations for Study Design

As neurorehabilitation research continues to grow, the field must ensure its scientific discoveries are implemented into routine clinical care. Without targeted efforts to increase the implementation of evidence into practice, patients may never see the benefits of interventions, assessments, and technologies developed in the confines of empirical studies. This article serves as a response to Lynch et al's 2018 Point of View piece in Neurorehabilitation and Neural Repair that underscored the urgent need for implementation studies to expedite the application of neurorehabilitation evidence in practice. To address this need, we provide the following 4 considerations investigators should contemplate when designing their own studies at the intersection of implementation and neurorehabilitation research: (a) consideration of guiding theories, models, and frameworks, (b) consideration of implementation strategies, (c) considerations of target outcomes, and (d) consideration of hybrid effectiveness-implementation designs. To conclude, we also provide a study exemplar to depict how these considerations can be integrated into the neurorehabilitation research field to narrow the evidence-to-practice gap.

Understanding the Role of External Facilitation to Drive Quality Improvement for Stroke Care in Hospitals

The use of external facilitation within the context of multicomponent quality improvement interventions (mQI) is growing. We aimed to evaluate the influence of external facilitation for improving the quality of acute stroke care. Clinicians from hospitals participating in mQI (Queensland, Australia) as part of the Stroke123 study were supported by external facilitators in a single, on-site workshop to review hospital performance against eight clinical processes of care (PoCs) collected in the Australian Stroke Clinical Registry (AuSCR) and develop an action plan. Remote support (i.e., telephone/email) after the workshop was provided. As part of a process evaluation for Stroke123, we recorded the number and mode of contacts between clinicians and facilitators; type of support provided; and frequency of self-directed, hospital-level stroke registry data reviews. Analysis: We measured the association between amount/type of external facilitation, (i) development of action plans, and (ii) adherence to PoCs before and after the intervention using AuSCR data from 2010 to 2015. In total, 14/19 hospitals developed an action plan. There was no significant difference in amount or type of external facilitator support provided between hospitals that did, and did not, develop an action plan. There was no relationship between the amount of external facilitation and change in adherence to PoCs. Most (95%) hospitals accessed stroke registry performance data. In the Stroke123 study, the amount or type of external facilitation did not influence action plan development, and the amount of support did not influence the changes achieved in adherence to PoCs. Remote support may not add value for mQI.

Implementation of regional Acute Stroke Care Map increases thrombolysis rates for acute ischaemic stroke in Chinese urban area in only 3 months

Background

The rate of intravenous thrombolysis for acute ischaemic stroke remains low in China. We investigated whether the implementation of a citywide Acute Stroke Care Map (ASCaM) is associated with an improvement of acute stroke care quality in a Chinese urban area.

Methods

The ASCaM comprises 10 improvement strategies and has been implemented through a network consisting of 20 tertiary hospitals. We identified 7827 patients with ischaemic stroke admitted from April to October 2017, and 506 patients underwent thrombolysis were finally included for analysis.

Results

Compared with ‘pre-ASCaM period’, we observed an increased rate of administration of tissue plasminogen activator within 4.5 hours (65.4% vs 54.5%; adjusted OR, 1.724; 95% CI 1.21 to 2.45; p=0.003) during ‘ASCaM period’. In multivariate analysis models, ‘ASCaM period’ was associated with a significant reduction in onset-to-door time (114.1±55.7 vs 135.7±58.4 min, p=0.0002) and onset-to-needle time (ONT) (169.2±58.1 vs 195.6±59.3 min, p<0.0001). Yet no change was found in door-to-needle time. Clinical outcomes such as symptomatic intracranial haemorrhage, favourable functional outcome (modified Rankin Scale ≤2) and in-hospital mortality remained unchanged.

Conclusion

The implementation of ASCaM was significantly associated with increased rates of intravenous thrombolysis and shorter ONT. The ASCaM may, in proof-of-principle, serve as a model to reduce treatment delay and increase thrombolysis rates in Chinese urban areas and possibly other highly populated Asian regions.

The use of the PARIHS framework in implementation research and practice-a citation analysis of the literature

BACKGROUND

The Promoting Action on Research Implementation in Health Services (PARIHS) framework was developed two decades ago and conceptualizes successful implementation (SI) as a function (f) of the evidence (E) nature and type, context (C) quality, and the facilitation (F), [SI = f (E,C,F)]. Despite a growing number of citations of theoretical frameworks including PARIHS, details of how theoretical frameworks are used remains largely unknown. This review aimed to enhance the understanding of the breadth and depth of the use of the PARIHS framework.

METHODS

This citation analysis commenced from four core articles representing the key stages of the framework's development. The citation search was performed in Web of Science and Scopus. After exclusion, we undertook an initial assessment aimed to identify articles using PARIHS and not only referencing any of the core articles. To assess this, all articles were read in full. Further data extraction included capturing information about where (country/countries and setting/s) PARIHS had been used, as well as categorizing how the framework was applied. Also, strengths and weaknesses, as well as efforts to validate the framework, were explored in detail.

RESULTS

The citation search yielded 1613 articles. After applying exclusion criteria, 1475 articles were read in full, and the initial assessment yielded a total of 367 articles reported to have used the PARIHS framework. These articles were included for data extraction. The framework had been used in a variety of settings and in both high-, middle-, and low-income countries. With regard to types of use, 32% used PARIHS in planning and delivering an intervention, 50% in data analysis, 55% in the evaluation of study findings, and/or 37% in any other way. Further analysis showed that its actual application was frequently partial and generally not well elaborated.

CONCLUSIONS

In line with previous citation analysis of the use of theoretical frameworks in implementation science, we also found a rather superficial description of the use of PARIHS. Thus, we propose the development and adoption of reporting guidelines on how framework(s) are used in implementation studies, with the expectation that this will enhance the maturity of implementation science.

Protocol for evaluation of enhanced models of primary care in the management of stroke and other chronic disease (PRECISE): A data linkage healthcare evaluation study

INTRODUCTION

The growing burden of chronic diseases means some governments have been providing financial incentives for multidisciplinary care and self-management support delivered within primary care. Currently, population-based evaluations of the effectiveness of these policies are lacking.

AIM

To outline the methodological approach for our study that is designed to evaluate the effectiveness (including cost) of primary care policies for chronic diseases in Australia using stroke as a case study.

METHODS

Person-level linkages will be undertaken between registrants from the Australian Stroke Clinical Registry (AuSCR) and (i) Government-held Medicare Australia claims data, to identify receipt or not of chronic disease management and care coordination primary care items; (ii) state government-held hospital data, to define outcomes; and (iii) government-held pharmaceutical and aged care claims data, to define covariates. N=1500 randomly selected AuSCR registrants will be sent surveys to obtain patient experience information. In Australia, unique identifiers are unavailable. Therefore, personal-identifiers will be submitted to government data linkage units. Researchers will merge the de-identified datasets for analysis using a project identifier. An economic evaluation will also be undertaken.

ANALYSIS

The index event will be the first stroke recorded in the AuSCR. Multivariable competing risks Poisson regression for multiple events, adjusted by a propensity score, will be used to test for differences in the rates of hospital presentations and medication adherence for different care (policy) types. Our estimated sample size of 25,000 patients will provide 80% estimated power (ɑ>0.05) to detect a 6-8% difference in rates. The incremental costs per Quality-adjusted life years gained of community-based care following the acute event will be estimated from a health sector perspective.

CONCLUSION

Completion of this study will provide a novel and comprehensive evaluation of the effectiveness and cost-effectiveness of Australian primary care policies. Its success will enable us to highlight the value of data-linkage for this type of research.

Multicenter, Prospective, Controlled, Before-and-After, Quality Improvement Study (Stroke123) of Acute Stroke Care

Supplemental Digital Content is available in the text.

Background and Purpose—

Hospital uptake of evidence-based stroke care is variable. We aimed to determine the impact of a multicomponent program involving financial incentives and quality improvement interventions, on stroke care processes.

Methods—

A prospective study of interventions to improve clinical care quality indicators at 19 hospitals in Queensland, Australia, during 2010 to 2015, compared with historical controls and 23 other Australian hospitals. After baseline routine audit and feedback (control phase, 30 months), interventions involving financial incentives (21 months) and then addition of externally facilitated quality improvement workshops with action plan development (9 months) were implemented. Postintervention phase was 13 months. Data were obtained for the analysis from a previous continuous audit in Queensland and subsequently the Australian Stroke Clinical Registry. Primary outcome: change in median composite score for adherence to ≤8 indicators. Secondary outcomes: change in adherence to self-selected indicators addressed in action plans and 4 national indicators compared with other Australian hospitals. Multivariable analyses with adjustment for clustered data.

Results—

There were 17 502 patients from the intervention sites (median age, 74 years; 46% women) and 20 484 patients from other Australian hospitals. Patient characteristics were similar between groups. There was an 18% improvement in the primary outcome across the study periods (95% CI, 12%–24%). The largest improvement was following introduction of financial incentives (14%; 95% CI, 8%–20%), while indicators addressed in action plans provided an 8% improvement (95% CI, 1%–17%). The national score (4 indicators) improved by 17% (95% CI, 13%–20%) versus 0% change in other Australian hospitals (95% CI, −0.03 to 0.03). Access to stroke units improved more in Queensland than in other Australian hospitals (P<0.001).

Conclusions—

The quality improvement interventions significantly improved clinical practice. The findings were primarily driven by financial incentives, but were also contributed to by the externally facilitated, quality improvement workshops. Assessment in other regions is warranted.

Validating the Alberta Context Tool in a multi-site Australian Emergency Department nurse population

The organisational context of healthcare settings has an essential role in how research evidence is used in clinical practice. The Alberta Context Tool (ACT) measures 10 concepts of organisational context with higher scores indicating a more positive work environment and potentially better use of research evidence in patient care. We assessed the psychometric properties of the ACT in Emergency Departments (EDs). This validation study was conducted as part of a multi-centre trial of triage, treatment and transfer (T³ Trial) of patients with stroke admitted to EDs. Stratified sampling with proportional allocation was used to recruit ED nurses from 26 participating hospitals at baseline. Nurses completed a survey containing the ACT. Structural validity was investigated by exploratory and confirmatory factor analysis. Reliability was assessed using Cronbach’s alpha and intraclass correlation coefficients. Item-rest correlations and the average inter-item correlations were also assessed. 558 ED nurses completed the survey, comprised of 433 surveys without missing data. Our exploratory factor analysis produced a 14-factor structure, explaining 62% of variance of organisational context. For eight of ten concepts, item loadings matched the factor structure of the original ACT. Confirmatory factor analysis of the 10 ACT concepts showed moderate model fit (p = 0.001, root mean square error of approximation: 0.049, standardised root mean squared residual: 0.048). Cronbach’s alphas showed very good internal consistency for nine of ten ACT concepts (α>0.7; 0.45–0.90). Item-rest correlations indicated that most ACT items (50 of 56 items) within any concept related well to the total score of the concept. Average inter-item correlations indicated potential redundant items for three concepts (feedback processes, leadership, staffing) that were above the threshold of 0.5. While identifying a few shortcomings for some ACT concepts in an ED context, the majority of findings confirm reliability and validity of the original ACT in an Australian population of ED nurses.

Chest infection within 30 days of acute stroke, associated factors, survival and the benefits of stroke unit care: Analysis using linked data from the Australian Stroke Clinical Registry

INTRODUCTION

Chest infections following acute stroke contribute to increased morbidity and mortality. We aimed to investigate factors associated with chest infections that occur within 30 days of stroke, the impact on 90-day survival, and the role of stroke unit care.

METHODS

Patient-level data from the Australian Stroke Clinical Registry (2010-13; 23 Queensland hospitals), were linked with Queensland hospital admission, emergency department (ED), and national death registry data. Acute chest infections were determined using ICD-10 codes from the stroke admission, hospital readmissions, ED contacts, and cause of death data. Patients aged ≥18 years without a prior stroke or chronic respiratory condition were included. Multilevel (hospital and patient) multivariable regression and survival analysis were used to identify associated factors and the influence on 90-day survival.

RESULTS

Overall, 3149 patients (77% ischemic stroke, 47% female, median age 74 years) were included; 3.1% developed a chest infection within 30 days. Associated factors included: admission to intensive care (OR: 8.26, 95% CI: 4.07, 16.76); and urinary tract infection (OR: 3.09, 95% CI: 1.89, 5.04). Patients not treated in stroke units had a two-fold greater odds of chest infections (OR: 1.96, 95% CI: 1.25, 3.05). Chest infection afforded a greater hazard of death at 90 days (HR: 1.42, 95% CI 1.04, 1.93). This was reduced for those admitted to a stroke unit (HR: 1.31, 95% CI 0.99, 1.75).

CONCLUSION

Results emphasize the need for active prevention and highlight the importance of stroke unit care in mitigating risk and improving survival in those with stroke-related chest infections.

Hospital organizational context and delivery of evidence-based stroke care: a cross-sectional study

Background

Organizational context is one factor influencing the translation of evidence into practice, but data pertaining to patients with acute stroke are limited. We aimed to determine the associations of organizational context in relation to four important evidence-based stroke care processes.

Methods

This was a mixed methods cross-sectional study. Among 19 hospitals in Queensland, Australia, a survey was conducted of the perceptions of stroke clinicians about their work using the Alberta Context Tool (ACT), a validated measure covering 10 concepts of organizational context, and with additional stroke-specific contextual questions. These data were linked to the Australian Stroke Clinical Registry (AuSCR) to determine the relationship with receipt of evidence-based acute stroke care (acute stroke unit admission, use of thrombolysis for those with acute ischemic stroke, receipt of a written care plan on discharge, and prescription of antihypertensive medications on discharge) using quantile regression. Exploratory cluster analysis was used to categorize hospitals into high and low context groups based on all of the 10 ACT concepts. Differences in adherence to care processes between the two groups were examined.

Results

A total of 215 clinicians completed the survey (50% nurses, 37% allied health staff, 10% medical practitioners), with 81% being in their current role for at least 1 year. There was good reliability (∞ 0.83) within the cohort to allow pooling of professional groups. Greater ACT scores, especially for social capital (μ 9.00, 95% confidence interval [CI] 4.86 to 13.14) and culture (μ 7.33, 95% CI 2.05 to 12.62), were associated with more patients receiving stroke unit care. There was no correlation between ACT concepts and other care processes. Working within higher compared to lower context environments was associated with greater proportions of patients receiving stroke unit care (88.5% vs. 69.0%) and being prescribed antihypertensive medication at discharge (62.5% vs. 52.0%). Staff from higher context hospitals were more likely to value medical and/or nursing leadership and stroke care protocols.

Conclusions

Overall organizational context, and in particular aspects of culture and social capital, are associated with the delivery of some components of evidence-based stroke care, offering insights into potential pathways for improving the implementation of proven therapies.

Electronic supplementary material

The online version of this article (10.1186/s13012-018-0849-z) contains supplementary material, which is available to authorized users.

How to do health services research in stroke: A focus on performance measurement and quality improvement

The objective of this "How to" research series article is to provide guidance on getting started in Health Services Research. The purpose of health services research is to contribute knowledge that can be used to help improve health systems and clinical services through influencing policy and practice. The methods used are broad, have varying levels of rigor, and may require different specialist skills. This paper sets out practical steps for undertaking health services research. Importantly, use of the highlighted techniques can identify solutions to address inadequate knowledge translation or promote greater access to evidence-based stroke care to optimize patient outcomes.