Introducing the new CONSORT extension for stepped-wedge cluster randomised trials

Effectiveness evaluation of an organisational intervention, targeting pregnancy and addiction care professionals, among women who have just given birth in maternity wards and smoked tobacco during pregnancy (5A-QUIT-N): study protocol for a stepped-wedge cluster randomised trial

INTRODUCTION

In 2021, among French women who smoked when they knew they were pregnant, 59% still smoked at the end of pregnancy. Support for pregnant women to stop smoking must include a structured organisational perspective. The main objective of the study is to evaluate the effectiveness of the 5A-QUIT-N organisational intervention on smoking cessation at delivery among pregnant women who smoke during pregnancy.

METHODS AND ANALYSIS

The overarching goal of the 5A-QUIT-N intervention, which aims to organise the healthcare professionals monitoring pregnancy, specialists in addiction and tobacco use, and clinical and training tools, using the 5As method. The 5A-QUIT-N intervention will be evaluated in a pragmatic stepped-wedge cluster randomised trial. Within each cluster, during the 6 months before (control) and after (intervention) the intervention, women who smoke tobacco during pregnancy will be enrolled during their maternity stay after delivery. A transition period is planned between the control and intervention periods to deploy the intervention. All participating women will be interviewed using a heteroquestionnaire to assess smoking cessation, tobacco use monitoring by healthcare professionals and individual factors associated with tobacco use during pregnancy. The primary outcome was the point prevalence of abstinence at delivery, which is the proportion of women reporting abstinence from smoking for at least 7 days at delivery. 4200 women who smoked tobacco during pregnancy will be recruited over the entire study period (33 months) to evaluate the effectiveness. An estimated 4585 participants will be included for all aims.

ETHICS AND DISSEMINATION

The study will be implemented in accordance with French regulations. The study including the consent process has been independently reviewed and approved by the French ethical board 'CPP Ile de France I' on 10 February 2022 (No CPPIDF1-2022-DI08-cat.2). The results will be disseminated on various academic and non-academic platforms. The results will be reported in international peer-reviewed journals and presented at international and national conferences.

Impact of implementing the critical-care pain observation tool in the adult intensive care unit: A nonrandomised stepped-wedge trial

BACKGROUND

Approximately 70% of patients in intensive care units (ICUs) experience untreated pain, often due to severe patient conditions and communication barriers.

AIM

The aim of this study was to implement the Critical-Care Pain Observation Tool (CPOT) to improve pain assessment in patients unable to self-report pain in the ICU.

METHOD

A stepped-wedge trial was conducted in six adult ICUs in Saudi Arabia between February and June 2022. The sequential transition of ICU clusters occurred in February 2022, from control to intervention, until all ICUs were exposed to the intervention. The primary outcome was the number of pain assessments, whereas the secondary outcomes were reassessments. Other outcomes were length of stay, mechanical ventilation duration, and administered doses of sedatives and analgesic agents. Statistical analyses were performed using the Statistical Analysis Software v9.4.

RESULTS

A total of 725 patients unable to self-report pain were included; 65% (n = 469) were male with an average age of 55 years. Implementing CPOT showed a significant increase in the number of pain assessments (rate ratio: 1.77, 95% confidence interval: 1.45, 2.16, p < 0.001) and reassessments (rate ratio: 13.99, 95% confidence interval: 8.14, 24.02, p < 0.001) between intervention and control conditions. There was no significant effect on the ICU length of stay, mechanical ventilation duration, and the amount of sedation (midazolam, propofol, and ketamine) and analgesia (fentanyl) administered.

CONCLUSION

The study indicates that the implementation of the CPOT increased the frequency of pain assessment and reassessment. However, the impact on patient outcomes remains inconclusive. Further investigations focussing on CPOT as the primary pain scale are necessary to determine its holistic impact on patient outcomes over the long term.

TRIAL REGISTRATION

NCT05488834.

CLINICAL TRIAL REGISTRATION NUMBER

This study was registered with the U.S. National Library of Medicine (ClinicalTrial.gov, NCT05488834).

Trimodal skin health programme for childhood impetigo control in remote Western Australia (SToP): a cluster randomised, stepped-wedge trial

BACKGROUND

Skin infections affect physical health and, through stigma, social-emotional health. When untreated, they can cause life-threatening conditions. We aimed to assess the effect of a holistic, co-designed, region-wide skin control programme on the prevalence of impetigo.

METHODS

The SToP (See, Treat, and Prevent Skin Sores and Scabies) trial is a pragmatic, open-cohort, stepped-wedge cluster randomised trial involving participants aged 0-18 years in nine remote communities of the Kimberley, Western Australia. The trial involves programmatic interventions in three domains: See (skin checks and skin infection recognition training), Treat (skin infection treatment training, sulfamethoxazole-trimethoprim for impetigo, and ivermectin for scabies), and Prevent (co-designed health promotion and environmental health). Four clusters, defined as pragmatic aggregations of communities, were randomised in two steps to progressively receive the activities during ten visits. The primary outcome was the proportion of school-aged children (aged 5-9 years) with impetigo. We adopted an intention-to-treat analysis and compared the intervention with the control (usual care before the start of intervention) states to derive a time and cluster averaged effect using Bayesian modelling. This study is registered with Australian New Zealand Clinical Trials Registry, ACTRN12618000520235.

FINDINGS

Between Sept 19, 2018, and Nov 22, 2022, 915 children were consented and 777 (85%) had skin checks performed on at least one of ten possible visits between May 5, 2019, and Nov 22, 2022. Of the participants, 448 (58%) of 777 were aged 5-9 years at one or more of the visit timepoints and were eligible for primary outcome assessment. A decline in impetigo occurred across all clusters, with the greatest decline during the observational period of baseline skin checks before commencement of the interventional trial activities activities. The mean (95% credible interval) for the conditional posterior odds ratio for observing impetigo in the intervention compared with the control period was 1·13 (0·71-1·70). The probability that the intervention reduced the odds of observing impetigo was 0·33.

INTERPRETATION

A decreased prevalence of impetigo during the observational period before the commencement of trial activities was sustained across the trial, attributable to the trimodal skin health initiative. Although the prevalence of impetigo reduced, there is no direct evidence to attribute this to the individual effects of the trial activities. The wholistic approach inclusive of skin checks collectively contributed to the sustained reduction in impetigo.

FUNDING

Western Australia Department of Health, Australian National Health and Medical Research Council, and Healthway.

The application of stepped-wedge cluster-randomized controlled trial study designs in oncology settings: A systematic review

Stepped-wedge cluster-randomized trials (SW-CRTs) offer advantages for implementation research in healthcare and have been increasingly utilised in the oncology setting. Cancer-related SW-CRTs need to be robust to deliver impactful trial outcomes and support effective translation into practice. This review aimed to examine the application of the SW-CRT design in oncology settings including the trial design features and protocol deviations, the interventions tested, and the implementation aspects of those interventions. Five databases were searched from database inception to July 2023 for SW-CRTs which evaluated interventions in adults with cancer. Intervention characteristics, design features, protocol deviations, statistical approach, implementation strategies, and outcomes were described and evaluated narratively. The search yielded 3395 unique records with representing 15 trials which are reported over 49 publications. The 15 trials (n = 8 efficacy trials and n = 7 implementation trials) described diverse interventions in healthcare settings. Trials supported implementation of the intervention via educating and training healthcare professionals (n = 12; 80 %), met or exceeded recruitment targets (n = 10, 67 %) and evaluated a new model of care (n = 7; 47 %). Despite implementation outcomes being reported in 14 (93 %) trials, 12 (86 %) did not use an established evaluation framework to guide the selection and reporting of implementation outcomes. SW-CRTs were a utilised design for implementing diverse and complex healthcare interventions in the oncology setting. Trialists should consider the need to incorporate implementation frameworks, strategies and outcomes into their trial planning and resource allocation. This strategic approach can enhance the design and impact of SW-CRTs, leading to improved patient outcomes and advancements in cancer care.

A community case detection tool to promote help-seeking for mental health care among children and adolescents in Ugandan refugee settlements: a stepped wedge cluster randomised trial

BACKGROUND

Strategies to promote mental health care help-seeking among children are needed, especially in low-income and middle-income countries and in complex settings. The aim of this trial was to compare a vignette-based, community-level, proactive case detection tool (CCDT) against standard awareness raising for promoting mental health help-seeking among children and adolescents.

METHODS

This stepped wedge cluster randomised trial was conducted in the Bidi Bidi, Kyaka II, Kyangwali, Omugo, and Rhino refugee settlements in Uganda. Community gatekeepers received a 2-day training session on using the CCDT to proactively detect children with mental health concerns and encourage children (or their caregivers) to use the mental health-care service run by Transcultural Psychosocial Organization Uganda. At baseline, organisations implemented routine detection or mental health awareness-raising activities. At cross-over to CCDT implementation, gatekeepers used the tool in their daily activities. The primary outcome was mental health-care service use by children and adolescents. Child population size estimates at the zone level were not available. Therefore, service use was calculated using total population size. We report the effect of CCDT implementation as an incidence rate ratio (IRR), which we produced from a model that accounts for calendar time, exposure time, and person-time. IRRs were estimated for the analysis of effect over time in the per-protocol and intention-to-treat populations. The trial is registered with the ISRCTN registry, number ISRCTN19056780.

FINDINGS

28 administrative zones were selected for trial participation by October, 2021. Between Jan 1, and Nov 8, 2022, seven clusters of four zones sequentially crossed over from routine care to CCDT implementation in 1-month intervals. The CCDT was implemented by 177 trained community gatekeepers. In 9 months, 2385 children visited a mental health-care service; of these, 1118 (47%) were girls and 1267 (53%) were boys (mean age 12·18 years [SD 4.03]). 1998 children made a first or re-entry visit to a service; of these, 937 (47%) were girls and 1061 (53%) were boys (mean age 12·08 years [SD 4·06]). Compared to standard awareness-raising activities, CCDT implementation was associated with an increase in mental health-care service use in the first month after implementation (20·91-fold change [95% CI 12·87-33·99]). Despite a slight decline in service use over time in both the CCDT and pre-CCDT zones, CCDT zones maintained a time-average 16·89-fold increase (95% CI 8·15-34·99) in mental health service use.

INTERPRETATION

The CCDT enabled community gatekeepers to increase mental health-care service use by children and adolescents. Vignette-based strategies rooted in the community could become a valuable contribution towards reducing the mental health-care gap among children, especially when accompanied by accessible mental health-care services.

FUNDING

Sint Antonius Stichting Projects.

TRANSLATIONS

For the Arabic, French and Spanish translations of the abstract see Supplementary Materials section.

Effect of the 1-h bundle on mortality in patients with suspected sepsis in the emergency department: a stepped wedge cluster randomized clinical trial

PURPOSE

The efficacy of the 1-h bundle for emergency department (ED) patients with suspected sepsis, which includes lactate measurement, blood culture, broad-spectrum antibiotics administration, administration of 30 mL/kg crystalloid fluid for hypotension or lactate ≥ 4 mmol/L, remains controversial.

METHODS

We carried out a pragmatic stepped-wedge cluster-randomized trial in 23 EDs in France and Spain. Adult patients with Sepsis-3 criteria or a quick sequential organ failure assessment (SOFA) score ≥ 2 or a lactate > 2 mmol/L were eligible. The intervention was the implementation of the 1-h sepsis bundle. The primary outcome was in-hospital mortality truncated at 28 days. Secondary outcomes included volume of fluid resuscitation at 24 h, acute heart failure at 24 h, SOFA score at 72 h, intensive care unit (ICU) length of stay, number of days on mechanical ventilation or renal replacement therapy, vasopressor free days, unnecessary antibiotic administration, and mortality at 28 days. 1148 patients were planned to be analysed; the study period ended after 873 patients were included.

RESULTS

872 patients (mean age 66, 42% female) were analyzed: 387 (44.4%) in the intervention group and 485 (55.6%) in the control group. Median SOFA score was 3 [1-5]. Median time to antibiotic administration was 40 min in the intervention group vs 113 min in the control group (difference - 73 [95% confidence interval (CI) - 93 to - 53]). There was a significantly higher rate, volume, and shorter time to fluid resuscitation within 3 h in the intervention group. There were 47 (12.1%) in-hospital deaths in the intervention group compared to 61 (12.6%) in the control group (difference in percentage - 0.4 [95% CI - 5.1 to 4.2], adjusted relative risk (aRR) 0.81 [95% CI 0.48 to 1.39]). There were no differences between groups for other secondary endpoints.

CONCLUSIONS

Among patients with suspected sepsis in the ED, the implementation of the 1-h sepsis bundle was not associated with significant difference in in-hospital mortality. However, this study may be underpowered to report a statistically significant difference between groups.

Barriers and co-designed strategies for the implementation of negative pressure wound therapy in acute pediatric burn care in Australia: A mixed method study

PURPOSE

Pediatric burn injuries are a global clinical issue causing significant morbidity. Early adjunctive negative pressure wound therapy improves re-epithelialization rates in children with burns, yet adoption in acute burn care is inconsistent. This investigation aimed to determine barriers to the implementation of adjunctive negative pressure wound therapy for the acute management of pediatric burns and co-design targeted implementation strategies.

METHODS

A sequential mixed methods design was used explore barriers to adjunctive negative pressure wound therapy implementation in acute pediatric burn care. An online questionnaire was disseminated to healthcare professionals within four major Australian pediatric hospitals, each with a dedicated burns service. Barriers were coded according to the Consolidated Framework for Implementation Research (CFIR). Semi-structured interviews with senior clinicians tailored implementation strategies to local contexts. A stakeholder consensus meeting consolidated implementation strategies and local processes.

RESULTS

Sixty-three healthcare professionals participated in the questionnaire, and semi-structured interviews involved nine senior burn clinicians. We identified eight implementation barriers across all five CFIR domains then co-designed targeted strategies to address identified barriers. Barriers included lack of available resources, limited access to knowledge and information, individual stage of change, patient needs and resources, limited knowledge and beliefs about the intervention, lack of external policies, intervention complexity, and poor implementation planning.

CONCLUSION

Multiple contextual factors affect negative pressure wound therapy uptake in acute pediatric burn settings. Results will inform a multi-state stepped-wedge cluster randomized controlled trial. Additional resources, education, training, updated policies, and guidelines are required for successful implementation. It is anticipated that adjunctive negative pressure wound therapy, in conjunction with tailored implementation strategies, will enhance adoption and sustainability.

TRIAL REGISTRATION

Australian and New Zealand Clinical Trials Registry: ACTRN12622000166774. Registered 1 February 2022.

Implementation of an enhanced recovery after surgery protocol for colorectal cancer in a regional hospital network supported by audit and feedback: a stepped wedge, cluster randomised trial

BACKGROUND

Enhanced recovery after surgery (ERAS) protocols are known to potentially improve the management and outcomes of patients undergoing colorectal surgery, with limited evidence of their implementation in hospital networks and in a large population. We aimed to assess the impact of the implementation of an ERAS protocol in colorectal cancer surgery in the entire region of Piemonte, Italy, supported by an audit and feedback (A&F) intervention.

METHODS

A large, stepped wedge, cluster randomised trial enrolled patients scheduled for elective surgery at 29 general surgery units (clusters). At baseline (first 3 months), standard care was continued in all units. Thereafter, four groups of clusters began to adopt the ERAS protocol successively. By the end of the study, each cluster had a period in which standard care was maintained (control) and a period in which the protocol was applied (experimental). ERAS implementation was supported by initial training and A&F initiatives. The primary endpoint was length of stay (LOS) without outliers (>94th percentile), and the secondary endpoints were outliers for LOS, postoperative medical and surgical complications, quality of recovery and compliance with ERAS items.

RESULTS

Of 2626 randomised patients, 2397 were included in the LOS analysis (1060 in the control period and 1337 in the experimental period). The mean LOS without outliers was 8.5 days during the control period (SD 3.9) and 7.5 (SD 3.5) during the experimental one. The adjusted difference between the two periods was a reduction of -0.58 days (95% CI -1.07, -0.09; p=0.021). The compliance with ERAS items increased from 52.4% to 67.3% (estimated absolute difference +13%; 95% CI 11.4%, 14.7%). No difference in the occurrence of complications was evidenced (OR 1.22; 95% CI 0.89, 1.68).

CONCLUSION

Implementation of the ERAS protocol for colorectal cancer, supported by A&F approach, led to a substantial improvement in compliance and a reduction in LOS, without meaningful effects on complications. Trial registration number NCT04037787.

Effect and Process Evaluation of an Intervention to Improve Hand Hygiene Compliance in Long-Term Care Facilities

OBJECTIVES

This study evaluated the effect of a tailored, multifaceted improvement strategy on hand hygiene compliance in long-term care facilities (LTCFs). We also performed a process evaluation to explore the mechanisms through which our strategy brought about change.

DESIGN

We conducted a stepped-wedge cluster-randomized controlled trial with a sequential rollout of the improvement strategy to all participating LTCFs. The strategy consisted of education, training, reminders, observation sessions (including feedback), and team meetings (including feedback).

SETTING AND PARTICIPANTS

The study included nursing professionals from 14 LTCFs (23 wards) in the Netherlands.

METHODS

Hand hygiene compliance was observed during 5 measurement periods using WHO's "Five Moments for Hand Hygiene." Multilevel analyses and corresponding tests were completed on an intention-to-treat basis.

RESULTS

The absolute intervention effect of overall hand hygiene compliance (primary outcome measure) was 13% (95% CI 9.3-16.7, P < .001), adjusted for time and clustering. The adjusted absolute effect was 23% (95% CI 7-39, P < .002) before a clean and aseptic procedure, 18% (95% CI 10-26, P < .001) after touching a resident, 14% (95% CI 7-22, P < .003) before touching a resident, 10% (95% CI 5-15, P < .001) after contact with body fluid, and 1% (95% CI -11 to 13, P = .8) after touching a resident's surroundings. With the exception of leadership, participants at LTCFs with more exposure to the intervention components showed statistically significantly more improvement than those at facilities with lower exposure scores.

CONCLUSIONS AND IMPLICATIONS

Our strategy was successful in improving hand hygiene compliance. LTCFs with more team members exposed to the different intervention components, demonstrated a greater effect from the intervention. To strengthen the impact of our intervention, we recommend that future improvement strategies provide more support to managers to ensure they are better equipped to take on their leadership roles and enable their teams to improve and maintain hand hygiene compliance.

Stir-up Regimen After General Anesthesia in the Postanesthesia Care Unit: A Nurse Led Stepped Wedge Cluster Randomized Control Trial

PURPOSE

To implement a standardized Stir-up Regimen (deep breathing, coughing, repositioning, mobilization [moving arms/legs], assessing and managing pain and nausea) within the first 30 minutes of arrival in the postanesthesia care unit (PACU), with a goal of decreasing recovery time in the immediate postanesthesia period (Phase I).

DESIGN

A pragmatic stepped wedge cluster randomized control trial. Initially, data were collected on time in Phase I in three PACUs (control). Subsequently, the same three units were randomized to sequentially transition to the Stir-up Regimen (intervention).

METHODS

A stepped wedge cluster randomized control trial design was used to implement a standardized Stir-up Regimen in three PACUs in an academic hospital for adult patients who received at least 30 minutes of general anesthesia. The measured outcome was the PACU time in minutes from patient arrival to when the patient met Phase I discharge criteria. Differences between intervention and control groups were evaluated using a generalized mixed-effects model. Nurses were educated about the Stir-up Regimen in team huddles, in-services, video demonstrations, email notifications and reminders, and immediate feedback at the bedside. Implementation science principles were used to assess the adoption of the Stir-up Regimen through a presurvey, postsurvey and spot-check observations in all three PACUs.

FINDINGS

A total of 5,809 PACU adult patient admissions were included: control group (n = 2,860); intervention group (n = 2,949); males (n = 2,602), and females (n = 3,206). The intervention was associated with a reduction in overall mean Phase I recovery time of 4.9 minutes (95% CI: -8.4 to -1.4, P = .007). One PACU decreased time by 9.6 minutes (95% CI: -15.3 to -4.0, P < .001). The other units also reduced Phase I recovery time, but this did not reach statistical significance. The spot-check observations confirmed the intervention was adopted by the nurses, as most interventions were nurse-initiated versus patient-initiated during the first 30 minutes in PACU.

CONCLUSIONS

Standardization of a Stir-up Regimen within 30 minutes of patient PACU arrival resulted in decreased Phase I recovery time.

Targeted prophylactic anticoagulation based on the TRiP(cast) score in patients with lower limb immobilisation: a multicentre, stepped wedge, randomised implementation trial

BACKGROUND

Prophylactic anticoagulation in emergency department patients with lower limb trauma requiring immobilisation is controversial. The Thrombosis Risk Prediction for Patients with Cast Immobilisation-TRiP(cast)-score could identify a large subgroup of patients at low risk of venous thromboembolism for whom prophylactic anticoagulation can be safely withheld. We aimed to prospectively assess the safety of withholding anticoagulation for patients with lower limb trauma at low risk of venous thromboembolism, defined by a TRiP(cast) score of less than 7.

METHODS

CASTING was a stepped-wedge, multicentre, cluster-randomised trial with blinded outcome assessment. 15 emergency departments in France and Belgium were selected and randomly assigned staggered start dates for switching from the control phase (ie, anticoagulation prescription according to the physician's usual practice) to the intervention phase (ie, targeted anticoagulation according to TRiP(cast) score: no prescription if score <7 and anticoagulation if score was ≥7). Patients were included if they presented to a participating emergency department with lower limb trauma requiring immobilisation for at least 7 days and were aged 18 years or older. The primary outcome was the 3-month cumulative rate of symptomatic venous thromboembolism during the intervention phase in patients with a TRiP(cast) score of less than 7. The targeted strategy was considered safe if this rate was less than 1% with an upper 95% CI of less than 2%. The primary analysis was performed in the intention-to-treat population. This study is registered at ClinicalTrials.gov (NCT04064489).

FINDINGS

Between June 16, 2020, and Sept 15, 2021, 15 clusters and 2120 patients were included. Of the 1505 patients analysed in the intervention phase, 1159 (77·0%) had a TRiP(cast) score of less than 7 and did not receive anticoagulant treatment. The symptomatic venous thromboembolism rate was 0·7% (95% CI 0·3-1·4, n=8/1159). There was no difference between the control and the intervention phases in the cumulative rate of symptomatic venous thromboembolism or in bleeding rates.

INTERPRETATION

Patients with a TRiP(cast) score of less than 7 who are not receiving anticoagulation have a very low risk of venous thromboembolism. A large proportion of patients with lower limb trauma and immobilisation could safely avoid thromboprophylaxis.

FUNDING

French Ministry of Health.

Alarm with care-a de-implementation strategy to reduce fall prevention alarm use in US hospitals: a study protocol for a hybrid 2 effectiveness-implementation trial

BACKGROUND

Fall prevention alarms are commonly used among US hospitals as a fall prevention strategy despite limited evidence of effectiveness. Further, fall prevention alarms are harmful to healthcare staff (e.g., alarm fatigue) and patients (e.g., sleep disturbance, mobility restriction). There is a need for research to develop and test strategies for reducing use of fall prevention alarms in US hospitals.

METHODS

To address this gap, we propose testing the effectiveness and implementation of Alarm with Care, a de-implementation strategy to reduce fall prevention alarm use using a stepped-wedge randomized controlled trial among 30 adult medical or medical surgical units from nonfederal US acute care hospitals. Guided by the Choosing Wisely De-Implementation Framework, we will (1) identify barriers to fall prevention alarm de-implementation and develop tailored de-implementation strategies for each unit and (2) compare the implementation and effectiveness of high- versus low-intensity coaching to support site-specific de-implementation of fall prevention alarms. We will evaluate effectiveness and implementation outcomes and examine the effect of multi-level (e.g., hospital, unit, and patient) factors on effectiveness and implementation. Rate of fall prevention alarm use is the primary outcome. Balancing measures will include fall rates and fall-related injuries. Implementation outcomes will include feasibility, acceptability, appropriateness, and fidelity.

DISCUSSION

Findings from this line of research could be used to support scale-up of fall prevention alarm de-implementation in other healthcare settings. Further, research generated from this proposal will advance the field of de-implementation science by determining the extent to which low-intensity coaching is an effective and feasible de-implementation strategy.

TRIAL REGISTRATION

ClinicalTrials.gov identifier: NCT06089239 . Date of registration: October 17, 2023.

Implementation Research at NHLBI: Methodological and Design Challenges and Lessons Learned from the DECIPHeR Initiative

NHLBI funded seven projects as part of the Disparities Elimination through Coordinated Interventions to Prevent and Control Heart and Lung Disease Risk (DECIPHeR) Initiative. They were expected to collaborate with community partners to (1) employ validated theoretical or conceptual implementation research frameworks, (2) include implementation research study designs, (3) include implementation measures as primary outcomes, and (4) inform our understanding of mediators and mechanisms of action of the implementation strategy. Several projects focused on late-stage implementation strategies that optimally and sustainably delivered two or more evidence-based multilevel interventions to reduce or eliminate cardiovascular and/or pulmonary health disparities and to improve population health in high-burden communities. Projects that were successful in the three-year planning phase transitioned to a 4-year execution phase. NHLBI formed a Technical Assistance Workgroup during the planning phase to help awardees refine study aims, strengthen research designs, detail analytic plans, and to use valid sample size methods. This paper highlights methodological and study design challenges encountered during this process. Important lessons learned included (1) the need for greater emphasis on implementation outcomes, (2) the need to clearly distinguish between intervention and implementation strategies in the protocol, (3) the need to address clustering due to randomization of groups or clusters, (4) the need to address the cross-classification that results when intervention agents work across multiple units of randomization in the same arm, (5) the need to accommodate time-varying intervention effects in stepped-wedge designs, and (6) the need for data-based estimates of the parameters required for sample size estimation.

Protocol and statistical analysis plan for the identification and treatment of hypoxemic respiratory failure and acute respiratory distress syndrome with protection, paralysis, and proning: A type-1 hybrid stepped-wedge cluster randomised effectiveness-implementation study

Objective

To describe a study protocol and statistical analysis plan (SAP) for the identification and treatment of hypoxemic respiratory failure (HRF) and acute respiratory distress syndrome (ARDS) with protection, paralysis, and proning (TheraPPP) study prior to completion of recruitment, electronic data retrieval, and analysis of any data.

Design

TheraPPP is a stepped-wedge cluster randomised study evaluating a care pathway for HRF and ARDS patients. This is a type-1 hybrid effectiveness-implementation study design evaluating both intervention effectiveness and implementation; however primarily powered for the effectiveness outcome.

Setting

Seventeen adult intensive care units (ICUs) across Alberta, Canada.

Participants

We estimate a sample size of 18816 mechanically ventilated patients, with 11424 patients preimplementation and 7392 patients postimplementation. We estimate 2688 sustained ARDS patients within our study cohort.

Intervention

An evidence-based, stakeholder-informed, multidisciplinary care pathway called Venting Wisely that standardises diagnosis and treatment of HRF and ARDS patients.

Main outcome measures

The primary outcome is 28-day ventilator-free days (VFDs). The primary analysis will compare the mean 28-day VFDs preimplementation and postimplementation using a mixed-effects linear regression model. Prespecified subgroups include sex, age, HRF, ARDS, COVID-19, cardiac surgery, body mass index, height, illness acuity, and ICU volume.

Results

This protocol and SAP are reported using the Standard Protocol Items: Recommendations for Interventional Trials guidance and the Guidelines for the Content of Statistical Analysis Plans in Clinical Trials. The study received ethics approval and was registered (ClinicalTrials.gov-NCT04744298) prior to patient enrolment.

Conclusions

TheraPPP will evaluate the effectiveness and implementation of an HRF and ARDS care pathway.

Design, implementation, and inferential issues associated with clinical trials that rely on data in electronic medical records: a narrative review

Real world evidence is now accepted by authorities charged with assessing the benefits and harms of new therapies. Clinical trials based on real world evidence are much less expensive than randomized clinical trials that do not rely on "real world evidence" such as contained in electronic health records (EHR). Consequently, we can expect an increase in the number of reports of these types of trials, which we identify here as 'EHR-sourced trials.' 'In this selected literature review, we discuss the various designs and the ethical issues they raise. EHR-sourced trials have the potential to improve/increase common data elements and other aspects of the EHR and related systems. Caution is advised, however, in drawing causal inferences about the relationships among EHR variables. Nevertheless, we anticipate that EHR-CTs will play a central role in answering research and regulatory questions.

Estimating intra-cluster correlation coefficients for planning longitudinal cluster randomized trials: a tutorial

It is well-known that designing a cluster randomized trial (CRT) requires an advance estimate of the intra-cluster correlation coefficient (ICC). In the case of longitudinal CRTs, where outcomes are assessed repeatedly in each cluster over time, estimates for more complex correlation structures are required. Three common types of correlation structures for longitudinal CRTs are exchangeable, nested/block exchangeable and exponential decay correlations-the latter two allow the strength of the correlation to weaken over time. Determining sample sizes under these latter two structures requires advance specification of the within-period ICC and cluster autocorrelation coefficient as well as the intra-individual autocorrelation coefficient in the case of a cohort design. How to estimate these coefficients is a common challenge for investigators. When appropriate estimates from previously published longitudinal CRTs are not available, one possibility is to re-analyse data from an available trial dataset or to access observational data to estimate these parameters in advance of a trial. In this tutorial, we demonstrate how to estimate correlation parameters under these correlation structures for continuous and binary outcomes. We first introduce the correlation structures and their underlying model assumptions under a mixed-effects regression framework. With practical advice for implementation, we then demonstrate how the correlation parameters can be estimated using examples and we provide programming code in R, SAS, and Stata. An Rshiny app is available that allows investigators to upload an existing dataset and obtain the estimated correlation parameters. We conclude by identifying some gaps in the literature.

Comparing analytical strategies for balancing site-level characteristics in stepped-wedge cluster randomized trials: a simulation study

BACKGROUND

Stepped-wedge cluster randomized trials (SWCRTs) are a type of cluster-randomized trial in which clusters are randomized to cross-over to the active intervention sequentially at regular intervals during the study period. For SWCRTs, sequential imbalances of cluster-level characteristics across the random sequence of clusters may lead to biased estimation. Our study aims to examine the effects of balancing cluster-level characteristics in SWCRTs.

METHODS

To quantify the level of cluster-level imbalance, a novel imbalance index was developed based on the Spearman correlation and rank regression of the cluster-level characteristic with the cross-over timepoints. A simulation study was conducted to assess the impact of sequential cluster-level imbalances across different scenarios varying the: number of sites (clusters), sample size, number of cross-over timepoints, site-level intra-cluster correlation coefficient (ICC), and effect sizes. SWCRTs assumed either an immediate "constant" treatment effect, or a gradual "learning" treatment effect which increases over time after crossing over to the active intervention. Key performance metrics included the relative root mean square error (RRMSE) and relative mean bias.

RESULTS

Fully-balanced designs almost always had the highest efficiency, as measured by the RRMSE, regardless of the number of sites, ICC, effect size, or sample sizes at each time for SWCRTs with learning effect. A consistent decreasing trend of efficiency was observed by increasing RRMSE as imbalance increased. For example, for a 12-site study with 20 participants per site/timepoint and ICC of 0.10, between the most balanced and least balanced designs, the RRMSE efficiency loss ranged from 52.5% to 191.9%. In addition, the RRMSE was decreased for larger sample sizes, larger number of sites, smaller ICC, and larger effect sizes. The impact of pre-balancing diminished when there was no learning effect.

CONCLUSION

The impact of pre-balancing on preventing efficiency loss was easily observed when there was a learning effect. This suggests benefit of pre-balancing with respect to impacting factors of treatment effects.

Prehospital screening of acute stroke with the National Institutes of Health Stroke Scale (ParaNASPP): a stepped-wedge, cluster-randomised controlled trial

BACKGROUND

Timely treatment of acute stroke depends on early identification and triage. Improved methods for recognition of stroke in the prehospital setting are needed. We aimed to assess whether use of the National Institutes of Health Stroke Scale (NIHSS) by paramedics in the ambulance could improve communication with the hospital, augment triage, and enhance diagnostic accuracy of acute stroke.

METHODS

The Paramedic Norwegian Acute Stroke Prehospital Project (ParaNASPP) was a stepped-wedge, single-blind, cluster-randomised controlled trial. Patients with suspected acute stroke, who were evaluated by paramedics from five ambulance stations in Oslo, Norway, were eligible for inclusion. The five ambulance stations (defined as clusters) all initially managed patients according to a standard stroke protocol (control group), with randomised sequential crossover of each station to the intervention group. The intervention consisted of supervised training on NIHSS scoring, a mobile application to aid scoring, and standardised communication with stroke physicians. Random allocation was done via a simple lottery draw by administrators at Oslo University Hospital, who were independent of the research team. Allocation concealment was not possible due to the nature of the intervention. The primary outcome was the positive predictive value (PPV) for prehospital identification of patients with a final discharge diagnosis of acute stroke, analysed by intention to treat. Prespecified secondary safety outcomes were median prehospital on-scene time and median door-to-needle time. This trial is registered with ClinicalTrials.gov, NCT04137874, and is completed.

FINDINGS

Between June 3, 2019, and July 1, 2021, 935 patients were evaluated by paramedics for suspected acute stroke. 134 patients met exclusion criteria or did not consent to participate. The primary analysis included 447 patients in the intervention group and 354 in the control group. There was no difference in PPV for prehospital identification of patients with a final discharge diagnosis of acute stroke between the intervention group (48·1%, 95% CI 43·4-52·8) and control group (45·8%, 40·5-51·1), with an estimated percentage points difference between groups of 2·3 (95% CI -4·6 to 9·3; p=0·51). Median prehospital on-scene time increased by 5 min in the intervention group (29 min [IQR 23-36] vs 24 min [19-31]; p<0·0001), whereas median door-to-needle time was similar between groups (26 min [21-36] vs 27 min [20-36]; p=0·90). No prehospital deaths were reported in either group.

INTERPRETATION

The intervention did not improve diagnostic accuracy in patients with suspected stroke. A general increase in prehospital time during the pandemic and the identification of smaller strokes that require more deliberation are possible explanations for the increased on-scene time. The ParaNASPP model is to be implemented in Norway from 2023, and will provide real-life data for further research.

FUNDING

Norwegian Air Ambulance Foundation and Oslo University Hospital.

Repurposing the Ordering of Routine Laboratory Tests in Hospitalised Medical Patients (RePORT): results of a cluster randomised stepped-wedge quality improvement study

BACKGROUND

Low-value use of laboratory tests is a global challenge. Our objective was to evaluate an intervention bundle to reduce repetitive use of routine laboratory testing in hospitalised patients.

METHODS

We used a stepped-wedge design to implement an intervention bundle across eight medical units. Our intervention included educational tools and social comparison reports followed by peer-facilitated report discussion sessions. The study spanned October 2020-June 2021, divided into control, feasibility testing, intervention and a follow-up period. The primary outcomes were the number and costs of routine laboratory tests ordered per patient-day. We used generalised linear mixed models, and analyses were by intention to treat.

RESULTS

We included a total of 125 854 patient-days. Patient groups were similar in age, sex, Charlson Comorbidity Index and length of stay during the control, intervention and follow-up periods. From the control to the follow-up period, there was a 14% (incidence rate ratio (IRR)=0.86, 95% CI 0.79 to 0.92) overall reduction in ordering of routine tests with the intervention, along with a 14% (β coefficient=-0.14, 95% CI -0.07 to -0.21) reduction in costs of routine testing. This amounted to a total cost savings of $C1.15 per patient-day. There was also a 15% (IRR=0.85, 95% CI 0.79, 0.92) reduction in ordering of all common tests with the intervention and a 20% (IRR=1.20, 95% CI 1.10 to 1.30) increase in routine test-free patient-days. No worsening was noted in patient safety endpoints with the intervention.

CONCLUSIONS

A multifaceted intervention bundle using education and facilitated multilevel social comparison was associated with a safe and effective reduction in use of routine daily laboratory testing in hospitals. Further research is needed to understand how system-level interventions may increase this effect and which intervention elements are necessary to sustain results.

Structured Mobilization for Critically Ill Patients: A Pragmatic Cluster-randomized Trial

Rationale: Small trials and professional recommendations support mobilization interventions to improve recovery among critically ill patients, but their real-world effectiveness is unknown. Objective: To evaluate a low-cost, multifaceted mobilization intervention. Methods: We conducted a stepped-wedge cluster-randomized trial across 12 ICUs with diverse case mixes. The primary and secondary samples included patients mechanically ventilated for ⩾48 hours who were ambulatory before admission, and all patients with ICU stays ⩾48 hours, respectively. The mobilization intervention included 1) designation and posting of daily mobilization goals; 2) interprofessional closed-loop communication coordinated by each ICU's facilitator; and 3) performance feedback. Measurements and Main Results: From March 4, 2019 through March 15, 2020, 848 and 1,069 patients were enrolled in the usual care and intervention phases in the primary sample, respectively. The intervention did not increase the primary outcome, patient's maximal Intensive Care Mobility Scale (range, 0-10) score within 48 hours before ICU discharge (estimated mean difference, 0.16; 95% confidence interval, -0.31 to 0.63; P = 0.51). More patients in the intervention (37.2%) than usual care (30.7%) groups achieved the prespecified secondary outcome of ability to stand before ICU discharge (odds ratio, 1.48; 95% confidence interval, 1.02 to 2.15; P = 0.04). Similar results were observed among the 7,115 patients in the secondary sample. The percentage of days on which patients received physical therapy mediated 90.1% of the intervention effect on standing. ICU mortality (31.5% vs. 29.0%), falls (0.7% vs. 0.4%), and unplanned extubations (2.0% vs. 1.8%) were similar between groups (all P > 0.3). Conclusions: A low-cost, multifaceted mobilization intervention did not improve overall mobility but improved patients' odds of standing and was safe. Clinical trial registered with www.clinicaltrials.gov (NCT03863470).

A scoping review described diversity in methods of randomization and reporting of baseline balance in stepped-wedge cluster randomized trials

OBJECTIVES

In stepped-wedge cluster randomized trials (SW-CRTs), clusters are randomized not to treatment and control arms but to sequences dictating the times of crossing from control to intervention conditions. Randomization is an essential feature of this design but application of standard methods to promote and report on balance at baseline is not straightforward. We aimed to describe current methods of randomization and reporting of balance at baseline in SW-CRTs.

STUDY DESIGN AND SETTING

We used electronic searches to identify primary reports of SW-CRTs published between 2016 and 2022.

RESULTS

Across 160 identified trials, the median number of clusters randomized was 11 (Q1-Q3: 8-18). Sixty-three (39%) used restricted randomization-most often stratification based on a single cluster-level covariate; 12 (19%) of these adjusted for the covariate(s) in the primary analysis. Overall, 50 (31%) and 134 (84%) reported on balance at baseline on cluster- and individual-level characteristics, respectively. Balance on individual-level characteristics was most often reported by condition in cross-sectional designs and by sequence in cohort designs. Authors reported baseline imbalances in 72 (45%) trials.

CONCLUSION

SW-CRTs often randomize a small number of clusters using unrestricted allocation. Investigators need guidance on appropriate methods of randomization and assessment and reporting of balance at baseline.

Sample size calculators for planning stepped-wedge cluster randomized trials: a review and comparison

Recent years have seen a surge of interest in stepped-wedge cluster randomized trials (SW-CRTs). SW-CRTs include several design variations and methodology is rapidly developing. Accordingly, a variety of power and sample size calculation software for SW-CRTs has been developed. However, each calculator may support only a selected set of design features and may not be appropriate for all scenarios. Currently, there is no resource to assist researchers in selecting the most appropriate calculator for planning their trials. In this paper, we review and classify 18 existing calculators that can be implemented in major platforms, such as R, SAS, Stata, Microsoft Excel, PASS and nQuery. After reviewing the main sample size considerations for SW-CRTs, we summarize the features supported by the available calculators, including the types of designs, outcomes, correlation structures and treatment effects; whether incomplete designs, cluster-size variation or secular trends are accommodated; and the analytical approach used. We then discuss in more detail four main calculators and identify their strengths and limitations. We illustrate how to use these four calculators to compute power for two real SW-CRTs with a continuous and binary outcome and compare the results. We show that the choice of calculator can make a substantial difference in the calculated power and explain these differences. Finally, we make recommendations for implementing sample size or power calculations using the available calculators. An R Shiny app is available for users to select the calculator that meets their requirements (https://douyang.shinyapps.io/swcrtcalculator/).

A Stepped-Wedge Cluster-Randomized Trial to Improve Adherence to Evidence-Based Practices for Acute Stroke Management

BACKGROUND

There is limited evidence regarding the optimal design and composition of multifaceted quality improvement programs to improve acute stroke care. The researchers aimed to test the effectiveness of a co-designed multifaceted intervention (STELAR: Shared Team Efforts Leading to Adherence Results) directed at hospital clinicians for improving acute stroke care tailored to the local context using feedback of national registry indicator data.

METHODS

STELAR was a stepped-wedge cluster trial (partial randomization) using routinely collected Australian Stroke Clinical Registry data from Victorian hospitals segmented in two-month blocks. Each hospital (cluster) contributed control data from May 2017 and data for the intervention phase from July 2017 until September 2018. The intervention was multifaceted, delivered predominantly in two educational outreach workshops by experienced, external improvement facilitators, consisting of (1) feedback of registry data to identify practice gaps and (2) interprofessional education, barrier assessment, and documentation of an agreed action plan initiated by local clinical leaders appointed as change champions for prioritized clinical indicators. The researchers provided additional outreach support by e-mail/telephone for two months. Multilevel, multivariable regression models were used to assess change in a composite outcome of indicators selected for actions plans (primary outcome) and individual indicators (secondary outcome). Patient survival and disability 90-180 days after stroke were also compared.

RESULTS

Nine hospitals (clusters) participated, and 144 clinicians attended 18 intervention workshops. The control phase included 1,001 patients (median age 76.7 years; 47.4% female, 64.7% ischemic stroke), and the intervention phase 2,146 patients (median age 74.9 years; 44.2% female, 73.8% ischemic stroke). Compared to the control phase, the median score for the composite outcome for the intervention phase was 17% greater for the indicators included in the hospitals' action plans (range 3% to 30%, p = 0.016) and overall for the 10 indicators 6% greater (range 3% to 10%, p < 0.001). Compared to the control phase, patients in the intervention phase more often received stroke unit care (odds ratio [OR] 1.39, 95% confidence interval [CI] 1.05-1.84), were discharged on antithrombotic medications (OR 1.87, 95% CI 1.50-2.33), and received a discharge care plan (OR 1.27, 95% CI 1.05-1.53). Patient outcomes were unchanged.

CONCLUSION

External quality improvement facilitation using workshops and remote support, aligned with routine monitoring via registries, can improve acute stroke care.

Effect of Implementation Facilitation to Promote Adoption of Medications for Addiction Treatment in US HIV Clinics: A Randomized Clinical Trial

Importance

Medications for addiction treatment (MAT) are inconsistently offered in HIV clinics.

Objective

To evaluate the impact of implementation facilitation (hereafter referred to as "facilitation"), a multicomponent implementation strategy, on increasing provision of MAT for opioid use disorder (MOUD), alcohol use disorder (MAUD), and tobacco use disorder (MTUD).

Design, Setting, and Participants

Conducted from July 26, 2016, through July 25, 2020, the Working with HIV Clinics to adopt Addiction Treatment using Implementation Facilitation (WHAT-IF?) study used an unblinded, stepped wedge design to sequentially assign each of 4 HIV clinics in the northeastern US to cross over from control (ie, baseline practices) to facilitation (ie, intervention) and then evaluation and maintenance periods every 6 months. Participants were adult patients with opioid, alcohol, or tobacco use disorder. Data analysis was performed from August 2020 to September 2022.

Interventions

Multicomponent facilitation.

Main Outcomes and Measures

Outcomes, assessed using electronic health record data, were provision of MAT among patients with opioid, alcohol, or tobacco use disorder during the evaluation (primary outcome) and maintenance periods compared with the control period.

Results

Among 3647 patients, the mean (SD) age was 49 (12) years, 1814 (50%) were Black, 781 (22%) were Hispanic, and 1407 (39%) were female; 121 (3%) had opioid use disorder, 126 (3%) had alcohol use disorder, and 420 (12%) had tobacco use disorder. Compared with the control period, there was no increase in provision of MOUD with facilitation during the evaluation period (243 patients [27%; 95% CI, 22%-32%] vs 135 patients [28%; 95% CI, 22%-35%]; P = .59) or maintenance period (198 patients [29%; 95% CI, 22%-36%]; P = .48). The change in provision of MAUD from the control period to the evaluation period was not statistically significant (251 patients [8%; 95% CI, 5%-12%] vs 112 patients [13%; 95% CI, 8%-21%]; P = .11); however, the difference increased and became significant during the maintenance period (180 patients [17%; 95% CI, 12%-24%]; P = .009). There were significant increases in provision of MTUD with facilitation during both the evaluation (810 patients [33%; 95% CI, 30%-36%] vs 471 patients [40%; 95% CI, 36%-45%]; P = .005) and maintenance (643 patients [38%; 95% CI, 34%-41%]; P = .047) periods.

Conclusions and Relevance

In this randomized clinical trial, facilitation led to increased provision of MTUD, delayed improvements in MAUD, and no improvements in MOUD in HIV clinics. Enhanced strategies, potentially including clinic and patient incentives, especially for MOUD, may be needed to further increase provision of MAT in HIV clinics.

Trial Registration

ClinicalTrials.gov Identifier: NCT02907944.

A nurse-led intervention to reduce the incidence and duration of delirium among adults admitted to intensive care: A stepped-wedge cluster randomised trial

BACKGROUND

Delirium is an acute change in behaviour, characterised by a fluctuating course, inattention, and disorganised thinking. For critically ill adults in the intensive care, the incidence of delirium has been reported to be at least 30% and is associated with both short-term and long-term complications, longer hospital stay, increased risk of mortality, and long-term cognitive problems.

AIM

The objective of this study was to determine the effectiveness of a nurse-led delirium-prevention protocol in reducing the incidence and duration of delirium among adults admitted to intensive care.

METHODS

A hybrid stepped-wedge cluster randomised controlled trial was conducted to assess the effectiveness of the implementation and dissemination of the nurse-led intervention to reduce the incidence and duration of delirium among adults admitted to the four adults intensive care units in the southwest of Sydney, Australia.

RESULTS

Between May 2019 and February 2020, over a 10-month period, 2618 admissions, among 2566 patients, were included in the study. After an initial 3-month baseline period, each month there was a random crossover to the nurse-led intervention in one of the four intensive care units, and by the 7th month of the trial, all units were exposed to the intervention for at least 3 months. The incidence of acute delirium was observed to be 10.7% (95% confidence interval [CI] = 9.1-12.4%), compared to 14.1% (95% CI = 12.2-16.2%) during the preintervention (baseline) period (adjusted rate ratio [adjRR] = 0.78, 95% CI = 0.57-1.08, p = 0.134). The average delirium-free-days for these preintervention and postintervention periods were 4.1 days (95% CI = 3.9-4.3) and 4.4 days (95% CI = 4.2-4.5), respectively (adjusted difference = 0.24 days [95% CI = -0.12 to 0.60], p = 0.199).

CONCLUSION

Following the introduction of a nurse-led, nonpharmacological intervention to reduce the burden of delirium, among adults admitted to intensive care, we observed no statistically significant decrease in the incidence of delirium or the duration of delirium.

Reducing malaria transmission in forest-going mobile and migrant populations in Lao PDR and Cambodia: protocol for stepped-wedge cluster-randomised controlled trial

Background

Countries of the Greater Mekong Sub-region aim to achieve malaria elimination by 2030. In the region, malaria is concentrated in high-risk areas and populations such as forest-going mobile and migrant populations (MMPs). However, routine protective measures such as long-lasting insecticidal nets do not prevent all infectious bites in these high-risk populations. Evidence for the effectiveness of a personal protection package tailored to forest-going MMPs which is acceptable, feasible, and cost-effective for reducing malaria transmission is required to inform the malaria elimination toolkit in the region.

Methods

A personal protection package consisting of long-lasting insecticidal hammock net, insect repellent and health communication pamphlet was developed in consultation with relevant implementing partners from Cambodia and Lao PDR. An open stepped-wedge cluster-randomised controlled trial will be conducted over a period of 12 months in a minimum of 488 villages (~ 428 in Lao PDR and ~ 60 in Cambodia) to evaluate the effectiveness of the personal protection package. Villages will be randomised into 11 blocks, with blocks transitioned in random order from control to intervention states at monthly intervals, following a 1-month baseline period. The primary outcome of the trial is the prevalence of Plasmodium spp. infection diagnosed by rapid diagnostic test. Difference in prevalence of malaria infection will be estimated across intervention and control periods using generalized linear mixed modelling. Nested within the stepped-wedge cluster-randomised controlled trial is a mixed-methods study to explore the acceptability of the personal protection package, feasibility of implementing a personal protection package as a vector control intervention, and knowledge, attitude and practice of MMPs regarding malaria prevention; and cost-analysis to determine the cost-effectiveness of implementing a personal protection package.

Discussion

This study, using a rigorous design and mixed-methods methodology, will evaluate whether a personal protection package can reduce residual malaria transmission among forest-going MMPs in Cambodia and Lao PDR. It will also measure implementation research outcomes such as effectiveness of the intervention package, cost-effectiveness, acceptability, and feasibility, in order to inform potential national and regional policy.

Trial registration This trial was prospectively registered on ClinicalTrials.gov (NCT05117567) on 11th November 2021

Supplementary Information

The online version contains supplementary material available at 10.1186/s12879-022-07724-5.

Applying dissemination and implementation research methods to translate a school-based asthma program

Our school-based asthma program has reduced asthma exacerbations for youth with health disparities in the Denver metropolitan area, due partly to addressing social determinants of health, such as access to health care and medications. Dissemination and implementation (D&I) science approaches accelerate the translation of evidence-based programs into routine practice. D&I methods are being applied more commonly to improve health equity. The purpose of this publication was to give an overview of D&I research methods, using our school-based asthma program as an example. To successfully scale out our program across the state of Colorado, we are applying a D&I framework that guides the adaptation of our existing implementation approach to better meet our stakeholders' local context-the Exploration, Preparation, Implementation, Sustainment framework. In a pragmatic trial design, we will evaluate the outcomes of implementing the program across 5 Colorado regions, with attention to health equity, using a second commonly used D&I framework-Reach, Effectiveness, Adoption, Implementation, and Maintenance. Our central hypothesis is that our program will have broad and equitable reach to eligible students (primary outcome) and will reduce asthma attacks and symptoms. This D&I approach accelerates dissemination of our program and is an applicable process for translating other effective allergy/asthma programs to address asthma and allergy-related disparities.

Influential methods reports for group-randomized trials and related designs

BACKGROUND

This article identifies the most influential methods reports for group-randomized trials and related designs published through 2020. Many interventions are delivered to participants in real or virtual groups or in groups defined by a shared interventionist so that there is an expectation for positive correlation among observations taken on participants in the same group. These interventions are typically evaluated using a group- or cluster-randomized trial, an individually randomized group treatment trial, or a stepped wedge group- or cluster-randomized trial. These trials face methodological issues beyond those encountered in the more familiar individually randomized controlled trial.

METHODS

PubMed was searched to identify candidate methods reports; that search was supplemented by reports known to the author. Candidate reports were reviewed by the author to include only those focused on the designs of interest. Citation counts and the relative citation ratio, a new bibliometric tool developed at the National Institutes of Health, were used to identify influential reports. The relative citation ratio measures influence at the article level by comparing the citation rate of the reference article to the citation rates of the articles cited by other articles that also cite the reference article.

RESULTS

In total, 1043 reports were identified that were published through 2020. However, 55 were deemed to be the most influential based on their relative citation ratio or their citation count using criteria specific to each of the three designs, with 32 group-randomized trial reports, 7 individually randomized group treatment trial reports, and 16 stepped wedge group-randomized trial reports. Many of the influential reports were early publications that drew attention to the issues that distinguish these designs from the more familiar individually randomized controlled trial. Others were textbooks that covered a wide range of issues for these designs. Others were "first reports" on analytic methods appropriate for a specific type of data (e.g. binary data, ordinal data), for features commonly encountered in these studies (e.g. unequal cluster size, attrition), or for important variations in study design (e.g. repeated measures, cohort versus cross-section). Many presented methods for sample size calculations. Others described how these designs could be applied to a new area (e.g. dissemination and implementation research). Among the reports with the highest relative citation ratios were the CONSORT statements for each design.

CONCLUSIONS

Collectively, the influential reports address topics of great interest to investigators who might consider using one of these designs and need guidance on selecting the most appropriate design for their research question and on the best methods for design, analysis, and sample size.

Study protocol for a type III hybrid effectiveness-implementation trial to evaluate scaling interoperable clinical decision support for patient-centered chronic pain management in primary care

Background

The US continues to face public health crises related to both chronic pain and opioid overdoses. Thirty percent of Americans suffer from chronic noncancer pain at an estimated yearly cost of over $600 billion. Most patients with chronic pain turn to primary care clinicians who must choose from myriad treatment options based on relative risks and benefits, patient history, available resources, symptoms, and goals. Recently, with attention to opioid-related risks, prescribing has declined. However, clinical experts have countered with concerns that some patients for whom opioid-related benefits outweigh risks may be inappropriately discontinued from opioids. Unfortunately, primary care clinicians lack usable tools to help them partner with their patients in choosing pain treatment options that best balance risks and benefits in the context of patient history, resources, symptoms, and goals. Thus, primary care clinicians and patients would benefit from patient-centered clinical decision support (CDS) for this shared decision-making process.

Methods

The objective of this 3-year project is to study the adaptation and implementation of an existing interoperable CDS tool for pain treatment shared decision making, with tailored implementation support, in new clinical settings in the OneFlorida Clinical Research Consortium. Our central hypothesis is that tailored implementation support will increase CDS adoption and shared decision making. We further hypothesize that increases in shared decision making will lead to improved patient outcomes, specifically pain and physical function. The CDS implementation will be guided by the Exploration, Preparation, Implementation, Sustainment (EPIS) framework. The evaluation will be organized by the Reach, Effectiveness, Adoption, Implementation, and Maintenance (RE-AIM) framework. We will adapt and tailor PainManager, an open source interoperable CDS tool, for implementation in primary care clinics affiliated with the OneFlorida Clinical Research Consortium. We will evaluate the effect of tailored implementation support on PainManager’s adoption for pain treatment shared decision making. This evaluation will establish the feasibility and obtain preliminary data in preparation for a multi-site pragmatic trial targeting the effectiveness of PainManager and tailored implementation support on shared decision making and patient-reported pain and physical function.

Discussion

This research will generate evidence on strategies for implementing interoperable CDS in new clinical settings across different types of electronic health records (EHRs). The study will also inform tailored implementation strategies to be further tested in a subsequent hybrid effectiveness-implementation trial. Together, these efforts will lead to important new technology and evidence that patients, clinicians, and health systems can use to improve care for millions of Americans who suffer from pain and other chronic conditions.

Trial registration

ClinicalTrials.gov, NCT05256394, Registered 25 February 2022.

Supplementary Information

The online version contains supplementary material available at 10.1186/s13012-022-01217-4.

Encouraging older adults with pre-frailty and frailty to "MoveStrong": an analysis of secondary outcomes for a pilot randomized controlled trial

BACKGROUND

This 8-week pilot stepped-wedge randomized controlled trial evaluated the MoveStrong program for teaching adults who have frailty/pre-frailty about balance and functional strength training and sufficient protein intake to prevent falls and improve mobility.

METHODS

We recruited individuals aged 60 years and over, with a FRAIL scale score of 1 or higher and at least one chronic condition, who were not currently strength training. The program included 16 exercise physiologist-led hour-long group sessions and two dietitian-led hour-long nutrition sessions. We analyzed secondary outcomes-weight, gait speed, grip strength, physical capacity (fatigue levels), sit-to-stand functioning, dynamic balance, health-related quality of life (HRQoL), physical activity levels and protein intake-using a paired t test and a generalized estimating equation (GEE).

RESULTS

Of 44 participants (mean [SD] age 79 [9.82] years), 35 were pre-frail and 9 were frail. At follow-up, participants had significantly improved grip strength (1.63 kg, 95% CI: 0.62 to 2.63); sit-to-stand functioning (2 sit-to-stands, 95% CI: 1 to 3); and dynamic balance (1.68 s, 95% CI: 0.47 to 2.89). There were no significant improvements in gait speed, HRQoL index scores, self-rated health, physical activity levels (aerobic activity and strength training) or protein intake. GEE analysis revealed an interaction between exposure to MoveStrong and gait speed, sit-to-stand functioning, dynamic balance and HRQoL index scores. The total cost to administer the program and purchase equipment was CAD 14 700, equivalent to CAD 377 per participant.

CONCLUSION

Exploratory analyses suggest MoveStrong exercises may improve gait speed, sit-to-stand functioning, dynamic balance and HRQoL index scores in older individuals who are frail and pre-frail.

A multimodal intervention to optimise antimicrobial use in residential aged care facilities (ENGAGEMENT): protocol for a stepped-wedge cluster randomised trial

BACKGROUND

Inappropriate antibiotic use can cause harm and promote antimicrobial resistance, which has been declared a major health challenge by the World Health Organization. In Australian residential aged care facilities (RACFs), the most common indications for antibiotic prescribing are for infections of the urinary tract, respiratory tract and skin and soft tissue. Studies indicate that a high proportion of these prescriptions are non-compliant with best prescribing guidelines. To date, a variety of interventions have been reported to address inappropriate prescribing and overuse of antibiotics but with mixed outcomes. This study aims to identify the impact of a set of sustainable, multimodal interventions in residential aged care targeting three common infection types.

METHODS

This protocol details a 20-month stepped-wedge cluster-randomised trial conducted across 18 RACFs (as 18 clusters). A multimodal multi-disciplinary set of interventions, the 'AMS ENGAGEMENT bundle', will be tailored to meet the identified needs of participating RACFs. The key elements of the intervention bundle include education for nurses and general practitioners, telehealth support and formation of an antimicrobial stewardship team in each facility. Prior to the randomised sequential introduction of the intervention, each site will act as its own control in relation to usual care processes for antibiotic use and stewardship. The primary outcome for this study will be antibiotic consumption measured using defined daily doses (DDDs). Cluster-level rates will be calculated using total occupied bed numbers within each RACF during the observation period as the denominator. Results will be expressed as rates per 1000 occupied bed days. An economic analysis will be conducted to compare the costs associated with the intervention to that of usual care. A comprehensive process evaluation will be conducted using the REAIM Framework, to enable learnings from the trial to inform sustainable improvements in this field.

DISCUSSION

A structured AMS model of care, incorporating targeted interventions to optimise antimicrobial use in the RACF setting, is urgently needed and will be delivered by our trial. The trial will aim to empower clinicians, residents and families by providing a robust AMS programme to improve antibiotic-related health outcomes.

TRIAL REGISTRATION

US National Library of Medicine Clinical Trials.gov ( NCT04705259 ). Prospectively registered in 12th of January 2021.

Considerations Before Selecting a Stepped-Wedge Cluster Randomized Trial Design for a Practice Improvement Study

PURPOSE

Despite the growing popularity of stepped-wedge cluster randomized trials (SW-CRTs) for practice-based research, the design's advantages and challenges are not well documented. The objective of this study was to identify the advantages and challenges of the SW-CRT design for large-scale intervention implementations in primary care settings.

METHODS

The EvidenceNOW: Advancing Heart Health initiative, funded by the Agency for Healthcare Research and Quality, included a large collection of SW-CRTs. We conducted qualitative interviews with 17 key informants from EvidenceNOW grantees to identify the advantages and challenges of using SW-CRT design.

RESULTS

All interviewees reported that SW-CRT can be an effective study design for large-scale intervention implementations. Advantages included (1) incentivized recruitment, (2) staggered resource allocation, and (3) statistical power. Challenges included (1) time-sensitive recruitment, (2) retention, (3) randomization requirements and practice preferences, (4) achieving treatment schedule fidelity, (5) intensive data collection, (6) the Hawthorne effect, and (7) temporal trends.

CONCLUSIONS

The challenges experienced by EvidenceNOW grantees suggest that certain favorable real-world conditions constitute a context that increases the odds of a successful SW-CRT. An existing infrastructure can support the recruitment of many practices. Strong retention plans are needed to continue to engage sites waiting to start the intervention. Finally, study outcomes should be ones already captured in routine practice; otherwise, funders and investigators should assess the feasibility and cost of data collection.VISUAL ABSTRACT.

Ethical and epistemic issues in the design and conduct of pragmatic stepped-wedge cluster randomized clinical trials

Stepped-wedge cluster randomized trial (SW-CRT) designs are increasingly employed in pragmatic research; they differ from traditional parallel cluster randomized trials in which an intervention is delivered to a subset of clusters, but not to all. In a SW-CRT, all clusters receive the intervention under investigation by the end of the study. This approach is thought to avoid ethical concerns about the denial of a desired intervention to participants in control groups. Such concerns have been cited in the literature as a primary motivation for choosing SW-CRT design, however SW-CRTs raise additional ethical concerns related to the delayed implementation of an intervention and consent. Yet, PCT investigators may choose SW-CRT designs simply because they are concerned that other study designs are infeasible. In this paper, we examine justifications for the use of SW-CRT study design, over other designs, by drawing on the experience of the National Institutes of Health's Health Care Systems Research Collaboratory (NIH Collaboratory) with five pragmatic SW-CRTs. We found that decisions to use SW-CRT design were justified by practical and epistemic reasons rather than ethical ones. These include concerns about feasibility, the heterogeneity of cluster characteristics, and the desire for simultaneous clinical evaluation and implementation. In this paper we compare the potential benefits of SW-CRTs against the ethical and epistemic challenges brought forth by the design and suggest that the choice of SW-CRT design must balance epistemic, feasibility and ethical justifications. Moreover, given their complexity, such studies need rigorous and informed ethical oversight.

Promoting deceased organ and tissue donation registration in family physician waiting rooms (RegisterNow-1): a pragmatic stepped-wedge, cluster randomized controlled registry trial

BACKGROUND

The shortage of available organs for life-saving transplants persists worldwide. While a majority support donating their organs or tissue when they die, many have not registered their wish to do so. When registered, next of kin are much more likely to follow-through with the decision to donate. In many countries, most people visit their family physician office each year and this setting is a promising, yet underused, site where more people could register for deceased organ donation. Our primary aim was to evaluate the effectiveness of an intervention to promote organ donation registration in family physician's offices.

METHODS

We developed an intervention to address barriers and enablers to organ donation registration that involved physician office reception staff inviting patients to register on a tablet in the waiting room while they waited for their appointment. We conducted a cross-sectional stepped-wedge cluster randomized controlled registry trial to evaluate the intervention. We recruited six family physician offices in Canada. All offices began with usual care and then every two weeks, one office (randomly assigned) started the intervention until all offices delivered the intervention. The primary outcome was registration for deceased organ donation in the provincial organ registration registry, assessed within the 7 days of the physician visit. At the end of the trial, we also conducted interviews with clinic staff to assess any barriers and enablers to delivering the intervention.

RESULTS

The trial involved 24,616 patient visits by 13,562 unique patients: 12,484 visits in the intervention period and 12,132 in the control period. There was no statistically significant difference in the percentage of patients registered for deceased organ donation in the intervention versus control period (48.0% vs 46.2%; absolute difference after accounting for the secular trend: 0.12%; 95% CI: - 2.30, 2.54; p=0.92). Interviews with clinic staff indicated location of the tablet within a waiting room, patient rapport, existing registration, confidence and motivation to deliver the intervention and competing priorities as barriers and enablers to delivery.

CONCLUSIONS

Our intervention did not increase donor registration. Nonetheless, family physician offices may still remain a promising setting to develop and evaluate better interventions to increase organ donation registration.

TRIAL REGISTRATION

NCT03213171.

Increased adherence to perioperative safety guidelines associated with improved patient safety outcomes: a stepped-wedge, cluster-randomised multicentre trial

BACKGROUND

National Dutch guidelines have been introduced to improve suboptimal perioperative care. A multifaceted implementation programme (IMPlementatie Richtlijnen Operatieve VEiligheid [IMPROVE]) has been developed to support hospitals in applying these guidelines. This study evaluated the effectiveness of IMPROVE on guideline adherence and the association between guideline adherence and patient safety.

METHODS

Nine hospitals participated in this unblinded, superiority, stepped-wedge, cluster RCT in patients with major noncardiac surgery (mortality risk ≥1%). IMPROVE consisted of educational activities, audit and feedback, reminders, organisational, team-directed, and patient-mediated activities. The primary outcome of the study was guideline adherence measured by nine patient safety indicators on the process (stop moments from the composite STOP bundle, and timely administration of antibiotics) and on the structure of perioperative care. Secondary safety outcomes included in-hospital complications, postoperative wound infections, mortality, length of hospital stay, and unplanned care.

RESULTS

Data were analysed for 1934 patients. The IMPROVE programme improved one stop moment: 'discharge from recovery room' (+16%; 95% confidence interval [CI], 9-23%). This stop moment was related to decreased mortality (-3%; 95% CI, -4% to -1%), fewer complications (-8%; 95% CI, -13% to -3%), and fewer unscheduled transfers to the ICU (-6%; 95% CI, -9% to -3%). IMPROVE negatively affected one other stop moment - 'discharge from the hospital' - possibly because of the limited resources of hospitals to improve all stop moments together.

CONCLUSIONS

Mixed implementation effects of IMPROVE were found. We found some positive associations between guideline adherence and patient safety (i.e. mortality, complications, and unscheduled transfers to the ICU) except for the timely administration of antibiotics.

CLINICAL TRIAL REGISTRATION

NTR3568 (Dutch Trial Registry).

Effects of Implementing the Short-Term Assessment of Risk and Treatability for Mechanical Restraint in a Forensic Male Population: A Stepped-Wedge, Cluster-Randomized Design

The assessment and formulation of the risk of violence and other unwanted behaviors at forensic psychiatric facilities have been attempted for decades. Structured professional judgment tools, such as the Short-Term Assessment of Risk and Treatability (START), are among the recent attempts to overcome the challenge of accomplishing these goals. This study examined the effect of implementing START in clinical practice for the most serious adverse events among the target group of severely mentally ill forensic psychiatric inpatients. Results were based on the use of mechanical restraints as an outcome. This study is a pragmatic, stepped-wedge, cluster-randomized controlled trial and was conducted over 5 years. It included eight forensic psychiatric units. Fifty out of 156 patients who had a basic aggression score of more than 0 were included in the study. We found that the rate of mechanical restraint use within the START period were 82% [relative risk (RR) = 0.18], lower than those outside of the START period. Patients evaluated within the START period were also found to have a 36% (RR = 0.64) lower risk of having higher Brøset Violence Checklist scores than patients evaluated outside the START period. Previous studies on START have primarily focused on validation, the predictive capability of the assessment, and implementation. We were only able to identify one study that aimed to identify the benefits and outcomes of START in a forensic setting. This study showed a significant reduction in the chance for inpatients in a forensic psychiatric facility to become mechanically restrained during periods where the START was used as risk assessment.

swdpwr: A SAS macro and an R package for power calculations in stepped wedge cluster randomized trials

BACKGROUND AND OBJECTIVE

The stepped wedge cluster randomized trial is a study design increasingly used in a wide variety of settings, including public health intervention evaluations, clinical and health service research. Previous studies presenting power calculation methods for stepped wedge designs have focused on continuous outcomes and relied on normal approximations for binary outcomes. These approximations for binary outcomes may or may not be accurate, depending on whether or not the normal approximation to the binomial distribution is reasonable. Although not always accurate, such approximation methods have been widely used for binary outcomes. To improve the approximations for binary outcomes, two new methods for stepped wedge designs (SWDs) of binary outcomes have recently been published. However, these new methods have not been implemented in publicly available software. The objective of this paper is to present power calculation software for SWDs in various settings for both continuous and binary outcomes.

METHODS

We have developed a SAS macro %swdpwr, an R package swdpwr and a Shiny app for power calculations in SWDs. Different scenarios including cross-sectional and cohort designs, binary and continuous outcomes, marginal and conditional models, three link functions, with and without time effects under exchangeable, nested exchangeable and block exchangeable correlation structures are accommodated in this software. Unequal numbers of clusters per sequence are also allowed. Power calculations for a closed cohort employ a block exchangeable within-cluster correlation structure that accounts for three intracluster (intraclass) correlations: the within-period, between-period, and within-individual correlations. Cross-sectional cohorts allow for nested exchangeable or exchangeable correlation structures defined by the within-period and the between-period intracluster correlations only. Our software assumes a complete design and equal cluster-period sizes. While the methods accommodate correlation structures of constant within-period intracluster correlation coefficient (ICC) as well as a different within- and between-period ICC, it does not allow the between-period ICC to decay.

RESULTS

swdpwr provides an efficient tool to support investigators in the design and analysis of stepped wedge cluster randomized trials. swdpwr addresses the implementation gap between newly proposed methodology and their application to obtain more accurate power calculations in SWDs.

CONCLUSIONS

In an effort to make computationally efficient (and non-simulation-based) power methods under both the cross-sectional and closed-cohort designs for continuous and binary outcomes more accessible, we have developed this user-friendly software. swdpwr is implemented under two platforms: SAS and R, satisfying the needs of investigators from various backgrounds. Additionally, the Shiny app enables users who are not able to use SAS or R to implement these methods online straightforwardly.

The MoveStrong program for promoting balance and functional strength training and adequate protein intake in pre-frail older adults: A pilot randomized controlled trial

BACKGROUND

Balance and functional strength training can improve muscle strength and physical functioning outcomes and decrease the risk of falls in older adults. To maximize the benefits of strength training, adequate protein intake is also important. However, the number of older individuals that consume enough protein or routinely engage in strength training remains low at less than 5% and even lower for activities that challenge balance. Our primary aim was to assess the feasibility of implementing a model (MoveStrong) of service delivery to teach older adults about balance and functional strength training and methods to increase protein intake.

METHODS

This study was a closed cohort stepped wedge randomized controlled trial. We recruited individuals ≥60 years considered pre-frail or frail with at least one chronic condition who were not currently engaging in regular strength training from Northern (rural) and Southern (urban) Ontario sites in Canada. The primary outcome was feasibility of implementation, defined by recruitment, retention, and adherence, and safety (defined by monitoring adverse events). We also reported participants' and providers' experience with MoveStrong, adaptations to the model based on participant's and provider's experience, and program fidelity.

RESULTS

We recruited 44 participants to the study and the average adherence rate was 72% with a retention of 71%. The program had a high-fidelity score. One person experienced a fall-related injury during exercise, while two other participants reported pain during certain activities. Five individuals experienced injuries or health problems that were not related to the program. Suggestions for future trials include modifying some exercises, exploring volunteer assistance, increasing the diversity of participants enrolled, and considering a different study design.

CONCLUSIONS

Our pilot trial demonstrates the feasibility of recruitment and adherence for a larger multisite RCT of balance and functional strength training with attention to protein intake in pre-frail and frail older adults.

SYMptom monitoring with Patient-Reported Outcomes using a web application among patients with Lung cancer in the Netherlands (SYMPRO-Lung): study protocol for a stepped-wedge randomised controlled trial

INTRODUCTION

Lung cancer and its treatment cause a wide range of symptoms impacting the patients' health-related quality of life (HRQoL). The use of patient-reported outcomes (PRO) to monitor symptoms during and after cancer treatment has been shown not only to improve symptom management but also to improve HRQoL and overall survival (OS). Collectively, these results favour implementation of PRO-symptom monitoring in daily clinical care. However, these promising outcomes have been obtained under trial conditions in which patients were selected based on stringent inclusion criteria, and in countries with a dissimilar healthcare system than in the Netherlands.The primary aim of the SYMptom monitoring with Patient-Reported Outcomes using a web application among patients with Lung cancer in the Netherlands (SYMPRO-Lung) study is to evaluate the effect of PRO-symptom monitoring during and after lung cancer treatment on HRQoL in daily clinical practice. Secondary objectives include assessing the effect of PRO-symptom monitoring on progression-free survival, OS, the incidence and grade of PRO symptoms, medication adherence, implementation fidelity and cost-effectiveness.

METHODS AND ANALYSIS

The SYMPRO-Lung study is a prospective, multicentre trial with a stepped wedge cluster randomised design. Study participants (n=292 intervention, n=292 controls) include patients with lung cancer (stages I-IV) starting treatment with surgery, systemic treatment, targeted treatment and/or radiotherapy.Every participating centre will consecutively switch from the control period to the intervention period, in which patients report their symptoms weekly via an online tool. In the intervention group, we evaluate two alert approaches: the active and reactive approach. If the symptoms exceed a predefined threshold, an alert is sent to the healthcare provider (active approach) or to the patient (reactive approach). Both the control and intervention group complete HRQoL questionnaires at 4 time points: at baseline, 15 weeks, 6 months and 1-year post treatment). Differences in HRQoL between the groups will be compared using linear mixed modelling analyses, accounting for within-centre clustering, potential time effects and confounding.

ETHICS AND DISSEMINATION

The study protocol was approved by the Institutional Review Board and the Medical Ethics Committee of the Amsterdam UMC (under number NL 68440.029.18) and the institutional review boards of the participating study sites. The dissemination of the results will be conducted through publication in peer-reviewed journals and through scientific conferences.

TRIAL REGISTRATION NUMBER

Trial register identifier: Netherlands Trial register Trial NL7897. Date of registration: 24 July 2019. https://www.trialregister.nl/trial/7897.

Prognosticating Outcomes and Nudging Decisions with Electronic Records in the Intensive Care Unit Trial Protocol

Expert recommendations to discuss prognosis and offer palliative options for critically ill patients at high risk of death are variably heeded by intensive care unit (ICU) clinicians. How to best promote such communication to avoid potentially unwanted aggressive care is unknown. The PONDER-ICU (Prognosticating Outcomes and Nudging Decisions with Electronic Records in the ICU) study is a 33-month pragmatic, stepped-wedge cluster randomized trial testing the effectiveness of two electronic health record (EHR) interventions designed to increase ICU clinicians' engagement of critically ill patients at high risk of death and their caregivers in discussions about all treatment options, including care focused on comfort. We hypothesize that the quality of care and patient-centered outcomes can be improved by requiring ICU clinicians to document a functional prognostic estimate (intervention A) and/or to provide justification if they have not offered patients the option of comfort-focused care (intervention B). The trial enrolls all adult patients admitted to 17 ICUs in 10 hospitals in North Carolina with a preexisting life-limiting illness and acute respiratory failure requiring continuous mechanical ventilation for at least 48 hours. Eligibility is determined using a validated algorithm in the EHR. The sequence in which hospitals transition from usual care (control), to intervention A or B and then to combined interventions A + B, is randomly assigned. The primary outcome is hospital length of stay. Secondary outcomes include other clinical outcomes, palliative care process measures, and nurse-assessed quality of dying and death.Clinical trial registered with clinicaltrials.gov (NCT03139838).

The impact of improved water supply on cholera and diarrhoeal diseases in Uvira, Democratic Republic of the Congo: a protocol for a pragmatic stepped-wedge cluster randomised trial and economic evaluation

INTRODUCTION

Diarrhoeal disease remains a leading cause of mortality and morbidity worldwide. Cholera alone is estimated to cause 95,000 deaths per year, most of which occur in endemic settings with inadequate water access. Whilst a global strategy to eliminate cholera by 2030 calls for investment in improved drinking water services, there is limited rigorous evidence for the impact of improved water supply on endemic cholera transmission in low-income urban settings. Our protocol is designed to deliver a pragmatic health impact evaluation of a large-scale water supply intervention in Uvira (Democratic Republic of the Congo), a cholera transmission hotspot.

METHODS/DESIGN

A stepped-wedge cluster randomised trial (SW-CRT) was designed to evaluate the impact of a large-scale drinking water supply intervention on cholera incidence among the 280,000 inhabitants of Uvira. The city was divided into 16 clusters, where new community and household taps will be installed following a randomised sequence over a transition period of up to 8 weeks in each cluster. The primary trial outcomes are the monthly incidence of "confirmed" cholera cases (patients testing positive by rapid detection kit) and of "suspected" cholera cases (patients admitted to the cholera treatment centre). Concurrent process and economic evaluations will provide further information on the context, costs, and efficiency of the intervention.

DISCUSSION

In this protocol, we describe a pragmatic approach to conducting rigorous research to assess the impacts of a complex water supply intervention on severe diarrhoeal disease and cholera in an unstable, low-resource setting representative of cholera-affected areas. In particular, we discuss a series of pre-identified risks and linked mitigation strategies as well as the value of combining different data collection methods and preparation of multiple analysis scenarios to account for possible deviations from the protocol. The study described here has the potential to provide robust evidence to support more effective cholera control in challenging, high-burden settings.

TRIAL REGISTRATION

This trial is registered on clinicaltrials.gov ( NCT02928341 , 10th October 2016) and has received ethics approval from the London School of Hygiene and Tropical Medicine (8913, 10603) and from the Ethics Committee from the School of Public Health, University of Kinshasa, Democratic Republic of the Congo (ESP/CE/088/2015).

Stepped Collaborative Care Targeting Posttraumatic Stress Disorder Symptoms and Comorbidity for US Trauma Care Systems: A Randomized Clinical Trial

Importance

To date, few multisite investigations have evaluated early interventions for injured patients with posttraumatic stress disorder (PTSD) symptoms.

Objective

To simultaneously assess the effectiveness and implementation of a brief stepped collaborative care intervention targeting PTSD and comorbidity.

Design, Setting, and Participants

A stepped-wedge cluster randomized clinical trial was conducted at 25 US level I trauma centers. Participants included hospitalized survivors of physical injury who underwent a 2-step evaluation for PTSD symptoms. Patients reporting high levels of distress on the PTSD Checklist (PCL-C) were randomized (N = 635) per the stepped-wedge protocol to enhanced usual care control (n = 370) or intervention (n = 265) conditions. The study was conducted from January 4, 2016, through November 2018. Data analysis was performed from November 4, 2019, to December 8, 2020.

Interventions

The Trauma Survivors Outcomes and Support collaborative care intervention included proactive injury case management that assisted patients transitioning from hospital inpatient to outpatient and community settings. The intervention also integrated evidence-based pharmacotherapy and psychotherapeutic elements targeting PTSD symptoms and comorbidity.

Main Outcomes and Measures

The primary study outcome was PTSD symptoms assessed with the PCL-C at baseline in the surgical ward and at 3, 6, and 12 months postinjury. Secondary outcomes included depressive symptoms, alcohol use, and physical function. Subgroup analyses examined the effect of baseline risk factors for enduring PTSD and quality of protocol implementation on study outcomes. Primary statistical analyses were conducted using the intent-to-treat sample.

Results

A total of 327 men (51.5%) were included in analysis; mean (SD) age was 39.0 (14.2) years. The investigation attained follow-up of 75% to 80% of the participants at 3 to 12 months. The intervention lasted a mean (SD) of 122 (132) minutes. Mixed model regression analyses revealed statistically significant changes in PCL-C scores for intervention patients compared with control patients at 6 months (difference, -2.57; 95% CI, -5.12 to -0.03; effect size, 0.18; P < .05) but not 12 months (difference, -1.27; 95% CI, -4.26 to 1.73; effect size, 0.08; P = .35). Subgroup analyses revealed larger PTSD treatment effects for patients with 3 or more baseline risk factors for enduring PTSD and for patients, including firearm injury survivors, treated at trauma centers with good or excellent protocol implementation. Intervention effects for secondary outcomes did not attain statistical significance.

Conclusions and Relevance

A brief stepped collaborative care intervention was associated with significant 6-month but not 12-month PTSD symptom reductions. Greater baseline PTSD risk and good or excellent trauma center protocol implementation were associated with larger PTSD treatment effects. Orchestrated efforts targeting policy and funding should systematically incorporate the study findings into national trauma center requirements and verification criteria.

Trial Registration

ClinicalTrials.gov Identifier: NCT02655354.

Impact of systematic early tuberculosis detection using Xpert MTB/RIF Ultra in children with severe pneumonia in high tuberculosis burden countries (TB-Speed pneumonia): a stepped wedge cluster randomized trial

Background

In high tuberculosis (TB) burden settings, there is growing evidence that TB is common in children with pneumonia, the leading cause of death in children under 5 years worldwide. The current WHO standard of care (SOC) for young children with pneumonia considers a diagnosis of TB only if the child has a history of prolonged symptoms or fails to respond to antibiotic treatments. As a result, many children with TB-associated severe pneumonia are currently missed or diagnosed too late. We therefore propose a diagnostic trial to assess the impact on mortality of adding the systematic early detection of TB using Xpert MTB/RIF Ultra (Ultra) performed on nasopharyngeal aspirates (NPA) and stool samples to the WHO SOC for children with severe pneumonia, followed by immediate initiation of anti-TB treatment in children testing positive on any of the samples.

Methods

TB-Speed Pneumonia is a pragmatic stepped-wedge cluster randomized controlled trial conducted in six countries with high TB incidence rate (Côte d’Ivoire, Cameroon, Uganda, Mozambique, Zambia and Cambodia). We will enrol 3780 children under 5 years presenting with WHO-defined severe pneumonia across 15 hospitals over 18 months. All hospitals will start managing children using the WHO SOC for severe pneumonia; one hospital will be randomly selected to switch to the intervention every 5 weeks. The intervention consists of the WHO SOC plus rapid TB detection on the day of admission using Ultra performed on 1 nasopharyngeal aspirate and 1 stool sample. All children will be followed for 3 months, with systematic trial visits at day 3, discharge, 2 weeks post-discharge, and week 12. The primary endpoint is all-cause mortality 12 weeks after inclusion. Qualitative and health economic evaluations are embedded in the trial.

Discussion

In addition to testing the main hypothesis that molecular detection and early treatment will reduce TB mortality in children, the strength of such pragmatic research is that it provides some evidence regarding the feasibility of the intervention as part of routine care. Should this intervention be successful, safe and well tolerated, it could be systematically implemented at district hospital level where children with severe pneumonia are referred.

Trial registration

ClinicalTrials.gov, NCT03831906. Registered 6 February 2019.

BLEND-A: blending internet treatment into conventional face-to-face treatment for alcohol use disorder - a study protocol

BACKGROUND

A major challenge to psychological treatment for alcohol use disorder (AUD) is patient non-compliance. A promising new treatment approach that is hypothesized to increase patient compliance is blended treatment, consisting of face-to-face contact with a therapist combined with modules delivered over the internet within the same protocol. While this treatment concept has been developed and proven effective for a variety of mental disorders, it has not yet been examined for AUD.

AIMS

The study described in this protocol aims to examine and evaluate patient compliance with blended AUD treatment as well as the clinical and cost effectiveness of such treatment compared to face-to-face treatment only.

METHODS

The study design is a pragmatic, stepped-wedge cluster randomized controlled trial. The included outpatient institutions (planned number of patients: n = 1800) will be randomized in clusters to implement either blended AUD treatment or face-to-face treatment only, i.e. treatment as usual (TAU). Both treatment approaches consist of motivational interviewing and cognitive behavioral therapy. Data on sociodemographics, treatment (e.g. intensity, duration), type of treatment conclusion (compliance vs. dropout), alcohol consumption, addiction severity, consequences of drinking, and quality of life, will be collected at treatment entry, at treatment conclusion, and 6 months after treatment conclusion. The primary outcome is compliance at treatment conclusion, and the secondary outcomes include alcohol consumption and quality of life at six-months follow-up. Data will be analyzed with an Intention-to-treat approach by means of generalized linear mixed models with a random effect for cluster and fixed effect for each step. Also, analyses evaluating cost-effectiveness will be conducted.

DISCUSSION

Blended treatment may increase treatment compliance and thus improve treatment outcomes due to increased flexibility of the treatment course. Since this study is conducted within an implementation framework it can easily be scaled up, and when successful, blended treatment has the potential to become an alternative offer in many outpatient clinics nationwide and internationally.

TRIAL REGISTRATION

Clinicaltrials.gov .: NCT04535258 , retrospectively registered 01.09.20.

Mixed-effects models for the design and analysis of stepped wedge cluster randomized trials: An overview

The stepped wedge cluster randomized design has received increasing attention in pragmatic clinical trials and implementation science research. The key feature of the design is the unidirectional crossover of clusters from the control to intervention conditions on a staggered schedule, which induces confounding of the intervention effect by time. The stepped wedge design first appeared in the Gambia hepatitis study in the 1980s. However, the statistical model used for the design and analysis was not formally introduced until 2007 in an article by Hussey and Hughes. Since then, a variety of mixed-effects model extensions have been proposed for the design and analysis of these trials. In this article, we explore these extensions under a unified perspective. We provide a general model representation and regard various model extensions as alternative ways to characterize the secular trend, intervention effect, as well as sources of heterogeneity. We review the key model ingredients and clarify their implications for the design and analysis. The article serves as an entry point to the evolving statistical literatures on stepped wedge designs.

Variance formulae for multiphase stepped wedge cluster randomized trial

In a multiphase stepped wedge cluster randomized trial (MSW-CRT), more than one intervention will be initiated on each sequence in a fixed order. Hence, with the MSW-CRT design, the effect of the first intervention can be evaluated when compared to control, as well as the added-on effects of the subsequent interventions. Studies that use MSW-CRT have been proposed, but properties of this design have not been explicitly studied. We derive closed-form variance formulae to test the interventions' effects, which can be readily used for sample size and power calculation. Additionally, we provide relationships between variances to test the interventions' effects and design parameters. Under special conditions, some important properties include: (i) the variances to test different interventions' effects (ie, the first intervention effect and the second intervention effect) may be same; (ii) as the cluster-period mean autocorrelation increases, the variance to test an intervention effect may first increase and then decrease; (iii) as the amount of periods between the initiations of two interventions (ie, lag) increases, the variance to test an intervention effect may remain unchanged. We illustrate the relationships between power and design parameters using the variance formulae. From a few illustrative examples, we observe that the statistical test that uses data only relevant to a specific intervention has inferior power (relative power loss <15%) compared to the test when using all the study data. Also, power is reduced when both the total number of periods and lag are decreased simultaneously (relative power loss <20%).

Propofol Target-Controlled Infusion in Emergency Department Sedation (ProTEDS): a multicentre, single-arm feasibility study

BACKGROUND

Procedural sedation is a core skill of the emergency physician. Bolus administration of propofol is widely used in UK EDs. Titrated to an end point of sedation, it has a rapid effect but has been associated with adverse incidents. The use of a target-controlled infusion (TCI) of propofol is not routine but may reduce the incidence of adverse incidents.The primary aims of this single-arm feasibility study were patient satisfaction and to establish recruitment rates for a randomised controlled trial comparing propofol TCI to bolus administration.

METHODS

Four EDs in Scotland, UK, participated. Patients aged 18-65 years, with anterior shoulder dislocation, weight ≥ 50kg, fasted ≥ 90 min were screened. Patients underwent reduction of their dislocated shoulder using TCI propofol. The primary end point was patient satisfaction recorded on a Visual Analogue Scale.

RESULTS

Between 3 April 2017 and 31 December 2018, 25 patients were recruited with a recruitment rate of 20% for the 16-month recruitment window, with a temporary pause to allow amendment of drug dosage.Two patients were excluded. Twenty achieved adequate sedation, defined as a Modified Observer's Assessment of Alertness/Sedation Scale (OAA/S) 3. Successful reduction was achieved in all adequately sedated. Patient satisfaction was documented in 14 patients, mean±SD of 97±9 and time to sedation was 25±8 min. No adverse events were recorded using the Society of Intravenous Anaesthesia adverse event reporting tool.

CONCLUSION

Propofol TCI was acceptable as a method of procedural sedation for patients. The lower than expected recruitment rates highlight the need for dedicated research support.

TRIAL REGISTRATION NUMBER

NCT03442803.

Effect of an Emergency Department Care Bundle on 30-Day Hospital Discharge and Survival Among Elderly Patients With Acute Heart Failure: The ELISABETH Randomized Clinical Trial

IMPORTANCE

Clinical guidelines for the early management of acute heart failure in the emergency department (ED) setting are based on only moderate levels of evidence, with subsequent low adherence to these guidelines.

OBJECTIVE

To test the effect of an early guideline-recommended care bundle on short-term prognosis in older patients with acute heart failure in the ED.

DESIGN, SETTING, AND PARTICIPANTS

Stepped-wedge cluster randomized trial in 15 EDs in France of 503 patients 75 years and older with a diagnosis of acute heart failure in the ED from December 2018 to September 2019 and followed up for 30 days until October 2019.

INTERVENTIONS

A care bundle that included early intravenous nitrate boluses; management of precipitating factors, such as acute coronary syndrome, infection, or atrial fibrillation; and moderate dose of intravenous diuretics (n = 200). In the control group, patient care was left to the discretion of the treating emergency physician (n = 303). Each center was randomized to the order in which they switched to the "intervention period." After the initial 4-week control period for all centers, 1 center entered in the intervention period every 2 weeks.

MAIN OUTCOMES AND MEASURES

The primary end point was the number of days alive and out of hospital at 30 days. Secondary outcomes included 30-day all-cause mortality, 30-day cardiovascular mortality, unscheduled readmission, length of hospital stay, and kidney impairment.

RESULTS

Among 503 patients who were randomized (median age, 87 years; 298 [59%] women), 502 were analyzed. In the intervention group, patients received a median (interquartile range) of 27.0 (9-54) mg of intravenous nitrates in the first 4 hours vs 4.0 (2.0-6.0) mg in the control group (adjusted difference, 23.8 [95% CI, 13.5-34.1]). There was a significantly higher percentage of patients in the intervention group treated for their precipitating factors than in the control group (58.8% vs 31.9%; adjusted difference, 31.1% [95% CI, 14.3%-47.9%]). There was no statistically significant difference in the primary end point of the number of days alive and out of hospital at 30 days (median [interquartile range], 19 [0- 24] d in both groups; adjusted difference, -1.9 [95% CI, -6.6 to 2.8]; adjusted ratio, 0.88 [95% CI, 0.64-1.21]). At 30 days, there was no significant difference between the intervention and control groups in mortality (8.0% vs 9.7%; adjusted difference, 4.1% [95% CI, -17.2% to 25.3%]), cardiovascular mortality (5.0% vs 7.4%; adjusted difference, 2.1% [95% CI, -15.5% to 19.8%]), unscheduled readmission (14.3% vs 15.7%; adjusted difference, -1.3% [95% CI, -26.3% to 23.7%]), median length of hospital stay (8 d in both groups; adjusted difference, 2.5 [95% CI, -0.9 to 5.8]), and kidney impairment (1% in both groups).

CONCLUSIONS AND RELEVANCE

Among older patients with acute heart failure, use of a guideline-based comprehensive care bundle in the ED compared with usual care did not result in a statistically significant difference in the number of days alive and out of the hospital at 30 days. Further research is needed to identify effective treatments for acute heart failure in older patients.

TRIAL REGISTRATION

ClinicalTrials.gov Identifier: NCT03683212.

Design, rationale and analysis plan for the Stand Up for Health trial in contact centres: a stepped wedge feasibility study

Background

Contact centres are one of the most sedentary workplaces, with employees spending a very high proportion of their working day sitting down. About a quarter of contact centre staff regularly experience musculoskeletal health problems due to high levels of sedentary behaviour, including lower back pain. There have been no previous randomised studies specifically aiming to reduce sedentary behaviour in contact centre staff. To address this gap, the Stand Up for Health (SUH) study aims to test the feasibility and acceptability of a complex theory-based intervention to reduce sedentary behaviour in contact centres.

Methods

The Stand Up for Health study has a stepped wedge cluster randomised trial design, which is a pragmatic design whereby clusters (contact centres) are randomised to time points at which they will begin to receive the intervention. All contact centre staff have the opportunity to experience the intervention. To minimise the resource burden in this feasibility study, data collection is not continuous, but undertaken on a selective number of occasions, so the stepped wedge design is “incomplete”. Eleven contact centres in England and Scotland have been recruited, and the sample size is approximately 27 per centre (270 in total). The statistical analysis will predominantly focus on assessing feasibility, including the calculation of recruitment rates and rates of attrition. Exploratory analysis will be performed to compare objectively measured sedentary time in the workplace (measured using an activPAL™ device) between intervention and control conditions using a linear mixed effects regression model.

Discussion

To our knowledge, this is the first stepped wedge feasibility study conducted in call centres. The rationale and justification of our novel staircase stepped wedge design has been presented, and we hope that by presenting our study design and statistical analysis plan, it will contribute to the literature on stepped wedge trials, and in particular feasibility stepped wedge trials. The findings of the study will also help inform whether this is a suitable design for other settings where data collection is challenging.

Trial registration

The trial has been registered on the ISRCTN database: http://www.isrctn.com/ISRCTN11580369