Stepped wedge randomised controlled trials: systematic review of studies published between 2010 and 2014

Effect of a small increase in off-premises trading hours on alcohol sales in Norway: A stepped-wedge cluster-randomized controlled trial

BACKGROUND AND AIMS

Evidence of the effect of limiting off-premises alcohol trading hours is still scarce. This study tested the effect of a small extension in trading hours on alcohol sales in alcohol monopoly outlets in Norway.

DESIGN

The extension of trading hours was implemented within a stepped-wedge cluster-randomized trial design. Eligible state monopoly outlets (n = 229) were clustered into trade districts (n = 62), which were block-randomized to one of three sequences regarding date of implementation: 1 September 2020 (n = 21 districts, 82 outlets), 1 December 2020 (n = 21 districts, 73 outlets) and 1 March 2021 (n = 20 districts, 74 outlets). Outcomes were followed-up for a 1-year period.

SETTING AND PARTICIPANTS

Study participants were state monopoly outlets in urban and rural trade districts in all parts of Norway.

MEASUREMENTS

Monthly alcohol sales in litres of pure alcohol per trade district and per outlet were measured from March 2020 to March 2022 (primary outcome). We applied a linear mixed-effect model with two-way fixed effects within a difference-in-difference framework. As a robustness check we considered the effects of cross-border trade and effects in subgroups of outlets. Trading hours in monopoly outlets were extended by 1 hour on Saturdays. The extension was permanent. Pre-intervention periods and not-yet-treated units served as control conditions.

FINDINGS

We did not find a statistically significant effect of the small extension in trading hours on monthly alcohol sales (i) per trade district [average treatment effect: -185.5 litres, 95% confidence interval (CI) = -1159.9, 788.9] and (ii) per outlet (-35.3 litres, 95% CI = -142.1, 72.0). These findings were consistent across estimation methods and model specifications.

CONCLUSION

There is no clear evidence that a small extension in off-premises trading hours affected alcohol sales in monopoly outlets in Norway.

A hybrid type II effectiveness-implementation trial of a positive emotion regulation intervention among people living with HIV engaged in Ryan White Medical Case Management: protocol and design for the ORCHID study

BACKGROUND

The Ryan White Medical Case Management System, which serves more than half of people living with HIV (PLWH) in the USA, is an opportune setting for identifying and addressing depression among PLWH. A growing body of research suggests that interventions that promote positive emotion may lessen symptoms of depression and improve physical and psychological well-being among people experiencing a variety of health-related stress, including living with HIV. Research on how best to integrate standardized mental health screening and referral to evidence-based interventions in Ryan White Medical Case Management settings has the potential to improve the health and wellbeing of PLWH.

METHODS

This mixed-methods study will enroll up to N = 300 Ryan White clients who screen positive for depressive symptoms in ORCHID (Optimizing Resilience and Coping with HIV through Internet Delivery), a web-based, self-guided positive emotion regulation intervention. The study will be conducted in 16 Ryan White Medical Case Management clinics in Chicago, IL. Following pre-implementation surveys and interviews with Medical Case Managers (MCMs) and Supervisors to develop an implementation facilitation strategy, we will conduct a hybrid type 2 implementation-effectiveness stepped wedge cluster randomized trial to iteratively improve the screening and referral process via interviews with MCMs in each wedge. We will test the effectiveness of ORCHID on depression and HIV care outcomes for PLWH enrolled in the program. RE-AIM is the implementation outcomes framework and the Consolidated Framework for Implementation Research is the implementation determinants framework.

DISCUSSION

Study findings have the potential to improve mental health and substance use screening of Ryan White clients, decrease depression and improve HIV care outcomes, and inform the implementation of other evidence-based interventions in the Ryan White Medical Case Management System.

TRIAL REGISTRATION

ClinicalTrials.gov NCT05123144. Trial registered 6/24/2021.

Multilevel Intervention Stepped Wedge Designs (MLI-SWDs)

Multilevel interventions (MLIs) hold promise for reducing health inequities by intervening at multiple types of social determinants of health consistent with the socioecological model of health. In spite of their potential, methodological challenges related to study design compounded by a lack of tools for sample size calculation inhibit their development. We help address this gap by proposing the Multilevel Intervention Stepped Wedge Design (MLI-SWD), a hybrid experimental design which combines cluster-level (CL) randomization using a Stepped Wedge design (SWD) with independent individual-level (IL) randomization. The MLI-SWD is suitable for MLIs where the IL intervention has a low risk of interference between individuals in the same cluster, and it enables estimation of the component IL and CL treatment effects, their interaction, and the combined intervention effect. The MLI-SWD accommodates cross-sectional and cohort designs as well as both incomplete (clusters are not observed in every study period) and complete observation patterns. We adapt recent work using generalized estimating equations for SWD sample size calculation to the multilevel setting and provide an R package for power and sample size calculation. Furthermore, motivated by our experiences with the ongoing NC Works 4 Health study, we consider how to apply the MLI-SWD when individuals join clusters over the course of the study. This situation arises when unemployment MLIs include IL interventions that are delivered while the individual is unemployed. This extension requires carefully considering whether the study interventions will satisfy additional causal assumptions but could permit randomization in new settings.

Implementation of Best Practices in Pancreatic Cancer Care in the Netherlands: A Stepped-Wedge Randomized Clinical Trial

Importance

Implementation of new cancer treatment strategies as recommended by evidence-based guidelines is often slow and suboptimal.

Objective

To improve the implementation of guideline-based best practices in the Netherlands in pancreatic cancer care and assess the impact on survival.

Design, setting, and participants

This multicenter, stepped-wedge cluster randomized trial compared enhanced implementation of best practices with usual care in consecutive patients with all stages of pancreatic cancer. It took place from May 22, 2018 through July 9, 2020. Data were analyzed from April 1, 2022, through February 1, 2023. It included all patients in the Netherlands with pathologically or clinically diagnosed pancreatic ductal adenocarcinoma. This study reports 1-year follow-up (or shorter in case of deceased patients).

Intervention

The 5 best practices included optimal use of perioperative chemotherapy, palliative chemotherapy, pancreatic enzyme replacement therapy (PERT), referral to a dietician, and use of metal stents in patients with biliary obstruction. A 6-week implementation period was completed, in a randomized order, in all 17 Dutch networks for pancreatic cancer care.

Main Outcomes and Measures

The primary outcome was 1-year survival. Secondary outcomes included adherence to best practices and quality of life (European Organisation for Research and Treatment of Cancer [EORTC] global health score).

Results

Overall, 5887 patients with pancreatic cancer (median age, 72.0 [IQR, 64.0-79.0] years; 50% female) were enrolled, 2641 before and 2939 after implementation of best practices (307 during wash-in period). One-year survival was 24% vs 23% (hazard ratio, 0.98, 95% CI, 0.88-1.08). There was no difference in the use of neoadjuvant chemotherapy (11% vs 11%), adjuvant chemotherapy (48% vs 51%), and referral to a dietician (59% vs 63%), while the use of palliative chemotherapy (24% vs 30%; odds ratio [OR], 1.38; 95% CI, 1.10-1.74), PERT (34% vs 45%; OR, 1.64; 95% CI, 1.28-2.11), and metal biliary stents increased (74% vs 83%; OR, 1.78; 95% CI, 1.13-2.80). The EORTC global health score did not improve (area under the curve, 43.9 vs 42.8; median difference, -1.09, 95% CI, -3.05 to 0.94).

Conclusions and Relevance

In this randomized clinical trial, implementation of 5 best practices in pancreatic cancer care did not improve 1-year survival and quality of life. The finding that most patients received no tumor-directed treatment paired with the poor survival highlights the need for more personalized treatment options.

Trial Registration

ClinicalTrials.gov Identifier: NCT03513705.

Adherence to key recommendations for design and analysis of stepped-wedge cluster randomized trials: A review of trials published 2016-2022

BACKGROUND/AIMS

The stepped-wedge cluster randomized trial (SW-CRT), in which clusters are randomized to a time at which they will transition to the intervention condition - rather than a trial arm - is a relatively new design. SW-CRTs have additional design and analytical considerations compared to conventional parallel arm trials. To inform future methodological development, including guidance for trialists and the selection of parameters for statistical simulation studies, we conducted a review of recently published SW-CRTs. Specific objectives were to describe (1) the types of designs used in practice, (2) adherence to key requirements for statistical analysis, and (3) practices around covariate adjustment. We also examined changes in adherence over time and by journal impact factor.

METHODS

We used electronic searches to identify primary reports of SW-CRTs published 2016-2022. Two reviewers extracted information from each trial report and its protocol, if available, and resolved disagreements through discussion.

RESULTS

We identified 160 eligible trials, randomizing a median (Q1-Q3) of 11 (8-18) clusters to 5 (4-7) sequences. The majority (122, 76%) were cross-sectional (almost all with continuous recruitment), 23 (14%) were closed cohorts and 15 (9%) open cohorts. Many trials had complex design features such as multiple or multivariate primary outcomes (50, 31%) or time-dependent repeated measures (27, 22%). The most common type of primary outcome was binary (51%); continuous outcomes were less common (26%). The most frequently used method of analysis was a generalized linear mixed model (112, 70%); generalized estimating equations were used less frequently (12, 8%). Among 142 trials with fewer than 40 clusters, only 9 (6%) reported using methods appropriate for a small number of clusters. Statistical analyses clearly adjusted for time effects in 119 (74%), for within-cluster correlations in 132 (83%), and for distinct between-period correlations in 13 (8%). Covariates were included in the primary analysis of the primary outcome in 82 (51%) and were most often individual-level covariates; however, clear and complete pre-specification of covariates was uncommon. Adherence to some key methodological requirements (adjusting for time effects, accounting for within-period correlation) was higher among trials published in higher versus lower impact factor journals. Substantial improvements over time were not observed although a slight improvement was observed in the proportion accounting for a distinct between-period correlation.

CONCLUSIONS

Future methods development should prioritize methods for SW-CRTs with binary or time-to-event outcomes, small numbers of clusters, continuous recruitment designs, multivariate outcomes, or time-dependent repeated measures. Trialists, journal editors, and peer reviewers should be aware that SW-CRTs have additional methodological requirements over parallel arm designs including the need to account for period effects as well as complex intracluster correlations.

Design, implementation, and inferential issues associated with clinical trials that rely on data in electronic medical records: a narrative review

Real world evidence is now accepted by authorities charged with assessing the benefits and harms of new therapies. Clinical trials based on real world evidence are much less expensive than randomized clinical trials that do not rely on "real world evidence" such as contained in electronic health records (EHR). Consequently, we can expect an increase in the number of reports of these types of trials, which we identify here as 'EHR-sourced trials.' 'In this selected literature review, we discuss the various designs and the ethical issues they raise. EHR-sourced trials have the potential to improve/increase common data elements and other aspects of the EHR and related systems. Caution is advised, however, in drawing causal inferences about the relationships among EHR variables. Nevertheless, we anticipate that EHR-CTs will play a central role in answering research and regulatory questions.

Cluster randomized trials in nursing homes should better be planned as open-cohort than as closed-cohort

OBJECTIVES

Two designs are frequently used in cluster randomized trials in nursing homes: closed cohort and open cohort. The former design includes residents at the beginning of the trial and then follows them. In the latter design, participants are enrolled at the beginning of the trial or although it is ongoing; at dates of assessment, all residents present in the nursing home are assessed. The open-cohort design is much less used than the closed-cohort design, but it offers several advantages such as less exposure to individual attrition. Objective was to assess whether an open-cohort design could have been feasible in trials with a closed-cohort design.

STUDY DESIGN AND SETTING

Twenty-two closed-cohort trials in nursing homes.

RESULTS

An open-cohort design was considered a relevant alternative for 20 trials. For 16 trials, a resident newly admitted could not opt out of the intervention, and for all trials, the resident could benefit from an intervention effect if it existed. For two trials, newly admitted residents could not benefit from the intervention effect, if it existed.

CONCLUSION

The open-cohort design is well-adapted for most of the interventions assessed in nursing homes by means of a cluster randomized trial and should be considered more often.

Pragmatic multicentre stepped-wedge cluster randomised trial to investigate the effectiveness of community-based falls prevention programme for older adults with falls risk in Singapore: a protocol paper

INTRODUCTION

Falls are an important public health issue with consequences that include injuries, quality of life reduction and high healthcare costs. Studies show that falls prevention strategies are effective in reducing falls rate among community-dwelling older adults. However, the evaluation for effectiveness was usually done in a controlled setting with homogeneous population, and thus may not be generalisable to a wider population. This study aims to evaluate the impact of community falls prevention programmes with group-based strength and balance exercises, on falls risk and health outcomes for older adults with falls risk in Singapore.

METHODS AND ANALYSIS

This is a pragmatic closed cohort stepped-wedge cluster randomised trial design study, which involves sequential crossover of clusters from the waitlist control condition to the intervention condition, with the sequence of crossover randomly determined. The intervention will be sequentially rolled out to 12 clusters (a minimum of 5 participants/cluster), over 6 time periods with 8-week intervals in Central and North regions of Singapore. The primary analysis will be conducted under the intention-to-treat principle. A general linear mixed model or generalised estimating equation analysis appropriate for a multilevel longitudinal study incorporating an appropriate error distribution and link function will be used. Markov model will be developed to estimate the incremental cost per quality-adjusted life years and incremental cost per fall prevented from the implementation of falls prevention strategies from a societal perspective. Conditional on there being clinically relevant differences in short-term outcomes, we will implement simulation modelling to project the long-term divergence in trajectories for outcomes and costs using the Markov model.

ETHICS AND DISSEMINATION

Ethics approval has been obtained. Results will be disseminated in publications and other relevant platforms.

TRIAL REGISTRATION NUMBER

NCT04788251.

A scoping review described diversity in methods of randomization and reporting of baseline balance in stepped-wedge cluster randomized trials

OBJECTIVES

In stepped-wedge cluster randomized trials (SW-CRTs), clusters are randomized not to treatment and control arms but to sequences dictating the times of crossing from control to intervention conditions. Randomization is an essential feature of this design but application of standard methods to promote and report on balance at baseline is not straightforward. We aimed to describe current methods of randomization and reporting of balance at baseline in SW-CRTs.

STUDY DESIGN AND SETTING

We used electronic searches to identify primary reports of SW-CRTs published between 2016 and 2022.

RESULTS

Across 160 identified trials, the median number of clusters randomized was 11 (Q1-Q3: 8-18). Sixty-three (39%) used restricted randomization-most often stratification based on a single cluster-level covariate; 12 (19%) of these adjusted for the covariate(s) in the primary analysis. Overall, 50 (31%) and 134 (84%) reported on balance at baseline on cluster- and individual-level characteristics, respectively. Balance on individual-level characteristics was most often reported by condition in cross-sectional designs and by sequence in cohort designs. Authors reported baseline imbalances in 72 (45%) trials.

CONCLUSION

SW-CRTs often randomize a small number of clusters using unrestricted allocation. Investigators need guidance on appropriate methods of randomization and assessment and reporting of balance at baseline.

[Development, Evaluation and Implementation of Digital Health Interventions (Part 1) - Discussion Paper of the Digital Health Working Group of the German Network for Health Services Research (DNVF)]

The development and application of digital interventions in health-related topics are gaining momentum in health service research. Digital interventions are often complex and need to be evaluated and implemented in complex settings. Due to their characteristics, this poses methodological challenges for health services research that have to be identified and addressed. Hence, the Working Group on Digital Health of the German Network for Health Services Research (DNVF) has prepared a discussion paper. This paper discusses methodological, practical and theoretical challenges associated with the development and evaluation of digital interventions from the perspective of health services research. Possible solutions are suggested and future research needs to address these methodological challenges are identified.

Public Policy Experiments without Equipoise: When Is Randomization Fair?

Government agencies and nonprofit organizations have increasingly turned to randomized controlled trials (RCTs) to evaluate public policy interventions. Random assignment is widely understood to be fair when there is equipoise; however, some scholars and practitioners argue that random assignment is also permissible when an intervention is reasonably expected to be superior to other trial arms. For example, some argue that random assignment to such an intervention is fair when the intervention is scarce, for it is sometimes fair to use a lottery to allocate scarce goods. We investigate the permissibility of randomization in public policy RCTs when there is no equipoise, identifying two sets of conditions under which it is fair to allocate access to a superior intervention via random assignment. We also reject oft-made claims that alternative study designs, including stepped-wedge designs and uneven randomization, offer fair ways to allocate beneficial interventions.

Implementation of a psychological online intervention for low to moderate depression in primary care: study protocol

BACKGROUND

Depression affects millions of people all over the world and implies a great socioeconomic burden. Despite there are different effective evidence-based interventions for treating depression, only a small proportion of these patients receives an appropriate treatment. In this regard, information and communication technologies (ICTs) can be used with therapeutic aims and this can contribute to make interventions more accessible. One example is "Smiling is fun", an internet-based treatment which has proved to be effective and cost-effective for treating depression in Spanish Primary Care (PC). However, the "know-do gap" between research and clinical settings implies that the actual implementation of such interventions could last up to 20 years. To overcome this obstacle, the implementation research establishes the methodology to implement the advances developed in the laboratories to the health care services maintaining the validity of the intervention and offering specific strategies for the implementation process.

OBJECTIVE

This is the protocol of an implementation study for the Internet-based program "Smiling is fun", which will be conducted on patients with mild-to-moderate depression of Spanish PC settings. In the implementation study, the feasibility, efficacy, cost-efficacy, acceptability, adoption, appropriateness, fidelity, penetration, normalization, and sustainability will be assessed.

METHODS

The current investigation is a Hybrid Effectiveness-Implementation Type II design. A Stepped Wedge randomized controlled trial design will be used, with a cohort of 420 adults diagnosed with depression (mild-to-moderate) who will undergo a first control phase (no treatment) followed by the intervention, which will last 16 weeks, and finishing with an optional use of the intervention. All patients will be assessed at baseline, during the treatment, and at post-treatment. The study will be conducted in three Spanish regions: Andalusia, Aragon, and the Balearic Islands. Two primary care centers of each region will participate, one located in the urban setting and the other in the rural setting. The primary outcome will be implementation success of the intervention assessing the reach, clinical effect, acceptability, appropriateness, adoption, feasibility, fidelity, penetration, implementation costs and sustainability services.

DISCUSSION

"Smiling is Fun", which has already been established as effective and cost-effective, will be adapted according to users' experiences and opinions, and the efficacy and cost-efficacy of the program will again be assessed. The study will point out barriers and facilitators to consider in the implementation process of internet-based psychological interventions in health services. The ultimate goal is to break the research-to-practice split, which would undoubtedly contribute to reduce the high burden of depression in our society.

TRIAL REGISTRATION

ClinicalTrials.gov, Identifier: NCT05294614.

Management of death-related noncompleters in cluster randomized trials carried out in nursing homes: a methodological review

BACKGROUND

A noncompleter is defined as a participant who leaves a trial before the end of the planned follow-up. Research in nursing homes is highly exposed to this problem because of high death rates.

OBJECTIVES

The aim of this trial is to assess the statistical management of noncompleters in cluster randomized trials carried out in nursing homes.

STUDY DESIGN AND SETTING

A methodological review of published cluster randomized trials.

RESULTS

We selected 37 articles. For 22 (59%) trials, the design was closed-cohort (i.e., participants included all at the same time when randomizing clusters). In those 22 closed-cohort trials, the median follow-up was 6.5 months (interquartile range 4-12). The median noncompleter rate was 19.5% and the median noncompletions due to death was 73.2%. In only one trial were the baseline characteristics of completers and noncompleters compared. Strategies to deal with noncompleters were an inflation of the planned sample size (11 trials), the use of repeated measurements of the outcome (12 trials), and the use of imputation methods when analyzing data (7 trials).

CONCLUSION

In cluster randomized trials of nursing homes, noncompleters are managed as for any missing data, but they are essentially due to death. Methodological and statistical developments and guidance are needed.

Effect of Implementation Facilitation to Promote Adoption of Medications for Addiction Treatment in US HIV Clinics: A Randomized Clinical Trial

Importance

Medications for addiction treatment (MAT) are inconsistently offered in HIV clinics.

Objective

To evaluate the impact of implementation facilitation (hereafter referred to as "facilitation"), a multicomponent implementation strategy, on increasing provision of MAT for opioid use disorder (MOUD), alcohol use disorder (MAUD), and tobacco use disorder (MTUD).

Design, Setting, and Participants

Conducted from July 26, 2016, through July 25, 2020, the Working with HIV Clinics to adopt Addiction Treatment using Implementation Facilitation (WHAT-IF?) study used an unblinded, stepped wedge design to sequentially assign each of 4 HIV clinics in the northeastern US to cross over from control (ie, baseline practices) to facilitation (ie, intervention) and then evaluation and maintenance periods every 6 months. Participants were adult patients with opioid, alcohol, or tobacco use disorder. Data analysis was performed from August 2020 to September 2022.

Interventions

Multicomponent facilitation.

Main Outcomes and Measures

Outcomes, assessed using electronic health record data, were provision of MAT among patients with opioid, alcohol, or tobacco use disorder during the evaluation (primary outcome) and maintenance periods compared with the control period.

Results

Among 3647 patients, the mean (SD) age was 49 (12) years, 1814 (50%) were Black, 781 (22%) were Hispanic, and 1407 (39%) were female; 121 (3%) had opioid use disorder, 126 (3%) had alcohol use disorder, and 420 (12%) had tobacco use disorder. Compared with the control period, there was no increase in provision of MOUD with facilitation during the evaluation period (243 patients [27%; 95% CI, 22%-32%] vs 135 patients [28%; 95% CI, 22%-35%]; P = .59) or maintenance period (198 patients [29%; 95% CI, 22%-36%]; P = .48). The change in provision of MAUD from the control period to the evaluation period was not statistically significant (251 patients [8%; 95% CI, 5%-12%] vs 112 patients [13%; 95% CI, 8%-21%]; P = .11); however, the difference increased and became significant during the maintenance period (180 patients [17%; 95% CI, 12%-24%]; P = .009). There were significant increases in provision of MTUD with facilitation during both the evaluation (810 patients [33%; 95% CI, 30%-36%] vs 471 patients [40%; 95% CI, 36%-45%]; P = .005) and maintenance (643 patients [38%; 95% CI, 34%-41%]; P = .047) periods.

Conclusions and Relevance

In this randomized clinical trial, facilitation led to increased provision of MTUD, delayed improvements in MAUD, and no improvements in MOUD in HIV clinics. Enhanced strategies, potentially including clinic and patient incentives, especially for MOUD, may be needed to further increase provision of MAT in HIV clinics.

Trial Registration

ClinicalTrials.gov Identifier: NCT02907944.

Influential methods reports for group-randomized trials and related designs

BACKGROUND

This article identifies the most influential methods reports for group-randomized trials and related designs published through 2020. Many interventions are delivered to participants in real or virtual groups or in groups defined by a shared interventionist so that there is an expectation for positive correlation among observations taken on participants in the same group. These interventions are typically evaluated using a group- or cluster-randomized trial, an individually randomized group treatment trial, or a stepped wedge group- or cluster-randomized trial. These trials face methodological issues beyond those encountered in the more familiar individually randomized controlled trial.

METHODS

PubMed was searched to identify candidate methods reports; that search was supplemented by reports known to the author. Candidate reports were reviewed by the author to include only those focused on the designs of interest. Citation counts and the relative citation ratio, a new bibliometric tool developed at the National Institutes of Health, were used to identify influential reports. The relative citation ratio measures influence at the article level by comparing the citation rate of the reference article to the citation rates of the articles cited by other articles that also cite the reference article.

RESULTS

In total, 1043 reports were identified that were published through 2020. However, 55 were deemed to be the most influential based on their relative citation ratio or their citation count using criteria specific to each of the three designs, with 32 group-randomized trial reports, 7 individually randomized group treatment trial reports, and 16 stepped wedge group-randomized trial reports. Many of the influential reports were early publications that drew attention to the issues that distinguish these designs from the more familiar individually randomized controlled trial. Others were textbooks that covered a wide range of issues for these designs. Others were "first reports" on analytic methods appropriate for a specific type of data (e.g. binary data, ordinal data), for features commonly encountered in these studies (e.g. unequal cluster size, attrition), or for important variations in study design (e.g. repeated measures, cohort versus cross-section). Many presented methods for sample size calculations. Others described how these designs could be applied to a new area (e.g. dissemination and implementation research). Among the reports with the highest relative citation ratios were the CONSORT statements for each design.

CONCLUSIONS

Collectively, the influential reports address topics of great interest to investigators who might consider using one of these designs and need guidance on selecting the most appropriate design for their research question and on the best methods for design, analysis, and sample size.

Patients' perspectives of medications for addiction treatment in HIV clinics: A qualitative study

BACKGROUND

While substance use disorders (SUD) disproportionately impact people with HIV (PWH), HIV clinics inconsistently provide evidence-based medications for addiction treatment (MAT). Patient receptivity to MAT is critical to enhance addiction treatment in these settings. However, we know little from patients about how to best integrate MAT into HIV clinics.

METHODS

This qualitative study used four focus groups informed by the Promoting Action on Research Implementation in Health Services framework to identify barriers and facilitators to receiving opioid, alcohol, and tobacco use disorder care in HIV clinics. The study population included 28 patients with HIV and SUD receiving care at one of four HIV clinics in the northeastern United States. Focus groups were recorded and transcribed for content analysis. The study also performed a brief survey assessing demographics and behaviors.

RESULTS

Focus groups revealed several major themes related to MAT in HIV clinics. Barriers included stigma around MAT, knowledge deficits about available MAT options and the impact of substance use on PWH, concerns about medication side effects, substance use screening without adequate clinician follow-up, and peers who discouraged MAT. Facilitators included recognition of substance use as a threat to overall health, integrated care from HIV clinicians, and support for addiction treatment from peers with lived experience.

CONCLUSIONS

Efforts to enhance MAT in HIV clinics should include patient education to help them recognize addiction as a chronic disease with available medication treatment options; clinician and staff training to promote integrated, multidisciplinary screening and treatment; and thoughtful inclusion of peers with lived experience.

A blended professional learning intervention for early childhood educators to target the promotion of physical activity and healthy eating: the HOPPEL cluster randomized stepped-wedge trial

BACKGROUND

Childcare centres are important environments for promoting physical activity and healthy eating. Blended approaches to professional learning may help overcome existing challenges for educators in promoting these behaviours. This study aimed to test the effect of a blended professional learning program on healthy eating and physical activity in childcare.

METHODS

Cluster randomized stepped-wedge trial in 15 childcare centres in Tasmania, Australia. Children aged 2-5y who attended at least two days per week were eligible to participate. Random assignment occurred at the centre level. Centre names were drawn out of a hat and then subsequently allocated to one of the three steps. The intervention comprised a 12-week blended professional learning program for educators. The main outcome was centre-level physical activity and healthy eating, assessed using the Environment and Policy Assessment Observation System (EPAO). All data collectors were blinded to step allocation. Analyses were according to intention to treat. The trial was registered with the Australian New Zealand Clinical Trial Registry (ACTRN12618000346279, date registered: 07/03/2018).

RESULTS

Centres were recruited between January 2016 and February 2016. All centres were retained for the duration of the study. A total of 313 children were recruited with 291 analysed at the completion of the study (93%). The difference between groups for the EPAO total score was significant at the end of the maintenance period (adjusted difference = 14.63, 95% CI [1.33, 27.92], p = 0.03). Significant differences were found for the percentage of time children spent in light-intensity physical activity at the end of the intervention (adjusted difference = 0.01, 95% CI [0.00,0.01], p = 0.02) and maintenance periods (adjusted difference = 0.01, 95% CI [0.00,0.02], p = 0.04). To the best of the authors knowledge, there were no adverse events.

CONCLUSION

This intervention achieved a sustained improvement in physical activity and healthy eating in childcare centres. Further, it can be easily integrated into existing service provision, especially among centres with limited access to professional learning.

TRIAL REGISTRATION

The study was registered with the Australian and New Zealand Clinical Trials Registry ( ACTRN12618000346279 , date registered: 07/03/2018).

Divergent confidence intervals among pre-specified analyses in the HiSTORIC stepped wedge trial: An exploratory post-hoc investigation

BACKGROUND

The high-sensitivity cardiac troponin on presentation to rule out myocardial infarction (HiSTORIC) study was a stepped-wedge cluster randomised trial with long before-and-after periods, involving seven hospitals across Scotland. Results were divergent for the binary safety endpoint (type 1 or type 4b myocardial infarction or cardiac death) across certain pre-specified analyses, which warranted further investigation. In particular, the calendar-matched analysis produced an odds ratio in the opposite direction to the primary logistic mixed-effects model analysis.

METHODS

Several post-hoc statistical models were fitted to each of the co-primary outcomes of length of hospital stay and safety events, which included adjusting for exposure time, incorporating splines, and fitting a random time effect. We improved control of patient characteristics over time by adjusting for multiple additional covariates using different methods: direct inclusion, regression adjustment for propensity score, and weighting. A data augmentation approach was also conducted aiming to reduce the effect of sparse data bias. Finally, the raw data was examined.

RESULTS

The new statistical models confirmed the results of the pre-specified trial analysis. In particular, the observed divergence between the calendar-matched and other analyses remained, even after performing the covariate adjustment methods, and after using data augmentation. Divergence was particularly acute for the safety endpoint, which had an event rate of 0.36% overall. Examining the raw data was particularly helpful to assess the sensitivity of the results to small changes in event rates and identify patterns in the data.

CONCLUSIONS

Our experience reveals the importance of conducting multiple pre-specified sensitivity analyses and examining the raw data, particularly for stepped wedge trials with low event rates or with a small number of sites. Before-and-after analytical approaches that adjust for differences in patient populations but avoid direct modelling of the time trend should be considered in future stepped wedge trials with similar designs.

A theory-driven exercise intervention among community-dwelling (pre)frail older adults: Protocol for a stepped-wedge cluster-randomized trial

AIM

This study is aimed to evaluate the effectiveness of a theory-driven exercise intervention for Chinese community-dwelling (pre)frail older adults, and to clarify the underlying mechanisms of the exercise intervention in this population.

DESIGN

A stepped-wedge cluster-randomized trial.

METHODS

A stepped-wedge cluster-randomized trial will be conducted among (pre)frail older adults at six communities in a county of central China. A 12-week multicomponent exercise intervention based on the integration of the Health Belief Model (HBM) and the Theory of Planned Behaviour (TPB) will be implemented to all participants during the study period. The primary outcomes are frailty, muscle mass, muscle strength and physical performance. Secondary outcomes include beliefs in exercise, exercise behaviours and other physical, mental and social functioning. Assessments will be conducted at baseline and at week 12, 24 and 36. A multilevel regression model will be used to evaluate the effectiveness of exercise interventions. A multilevel mediation model will be used to clarify the underlying mechanisms of this exercise intervention.

DISCUSSION

This study is expected to provide an effective and practical mode for exercise interventions among Chinese community-dwelling (pre)frail older adults, and contribute to the existing evidence in this field.

TRIAL REGISTRATION

Chinese Clinical Trial Registry ChiCTR2100041981.

Considerations Before Selecting a Stepped-Wedge Cluster Randomized Trial Design for a Practice Improvement Study

PURPOSE

Despite the growing popularity of stepped-wedge cluster randomized trials (SW-CRTs) for practice-based research, the design's advantages and challenges are not well documented. The objective of this study was to identify the advantages and challenges of the SW-CRT design for large-scale intervention implementations in primary care settings.

METHODS

The EvidenceNOW: Advancing Heart Health initiative, funded by the Agency for Healthcare Research and Quality, included a large collection of SW-CRTs. We conducted qualitative interviews with 17 key informants from EvidenceNOW grantees to identify the advantages and challenges of using SW-CRT design.

RESULTS

All interviewees reported that SW-CRT can be an effective study design for large-scale intervention implementations. Advantages included (1) incentivized recruitment, (2) staggered resource allocation, and (3) statistical power. Challenges included (1) time-sensitive recruitment, (2) retention, (3) randomization requirements and practice preferences, (4) achieving treatment schedule fidelity, (5) intensive data collection, (6) the Hawthorne effect, and (7) temporal trends.

CONCLUSIONS

The challenges experienced by EvidenceNOW grantees suggest that certain favorable real-world conditions constitute a context that increases the odds of a successful SW-CRT. An existing infrastructure can support the recruitment of many practices. Strong retention plans are needed to continue to engage sites waiting to start the intervention. Finally, study outcomes should be ones already captured in routine practice; otherwise, funders and investigators should assess the feasibility and cost of data collection.VISUAL ABSTRACT.

Evaluating the performance of Bayesian and restricted maximum likelihood estimation for stepped wedge cluster randomized trials with a small number of clusters

Background

Stepped wedge trials are an appealing and potentially powerful cluster randomized trial design. However, they are frequently implemented with a small number of clusters. Standard analysis methods for these trials such as a linear mixed model with estimation via maximum likelihood or restricted maximum likelihood (REML) rely on asymptotic properties and have been shown to yield inflated type I error when applied to studies with a small number of clusters. Small-sample methods such as the Kenward-Roger approximation in combination with REML can potentially improve estimation of the fixed effects such as the treatment effect. A Bayesian approach may also be promising for such multilevel models but has not yet seen much application in cluster randomized trials.

Methods

We conducted a simulation study comparing the performance of REML with and without a Kenward-Roger approximation to a Bayesian approach using weakly informative prior distributions on the intracluster correlation parameters. We considered a continuous outcome and a range of stepped wedge trial configurations with between 4 and 40 clusters. To assess method performance we calculated bias and mean squared error for the treatment effect and correlation parameters and the coverage of 95% confidence/credible intervals and relative percent error in model-based standard error for the treatment effect.

Results

Both REML with a Kenward-Roger standard error and degrees of freedom correction and the Bayesian method performed similarly well for the estimation of the treatment effect, while intracluster correlation parameter estimates obtained via the Bayesian method were less variable than REML estimates with different relative levels of bias.

Conclusions

The use of REML with a Kenward-Roger approximation may be sufficient for the analysis of stepped wedge cluster randomized trials with a small number of clusters. However, a Bayesian approach with weakly informative prior distributions on the intracluster correlation parameters offers a viable alternative, particularly when there is interest in the probability-based inferences permitted within this paradigm.

Supplementary Information

The online version contains supplementary material available at (10.1186/s12874-022-01550-8).

Ethical and epistemic issues in the design and conduct of pragmatic stepped-wedge cluster randomized clinical trials

Stepped-wedge cluster randomized trial (SW-CRT) designs are increasingly employed in pragmatic research; they differ from traditional parallel cluster randomized trials in which an intervention is delivered to a subset of clusters, but not to all. In a SW-CRT, all clusters receive the intervention under investigation by the end of the study. This approach is thought to avoid ethical concerns about the denial of a desired intervention to participants in control groups. Such concerns have been cited in the literature as a primary motivation for choosing SW-CRT design, however SW-CRTs raise additional ethical concerns related to the delayed implementation of an intervention and consent. Yet, PCT investigators may choose SW-CRT designs simply because they are concerned that other study designs are infeasible. In this paper, we examine justifications for the use of SW-CRT study design, over other designs, by drawing on the experience of the National Institutes of Health's Health Care Systems Research Collaboratory (NIH Collaboratory) with five pragmatic SW-CRTs. We found that decisions to use SW-CRT design were justified by practical and epistemic reasons rather than ethical ones. These include concerns about feasibility, the heterogeneity of cluster characteristics, and the desire for simultaneous clinical evaluation and implementation. In this paper we compare the potential benefits of SW-CRTs against the ethical and epistemic challenges brought forth by the design and suggest that the choice of SW-CRT design must balance epistemic, feasibility and ethical justifications. Moreover, given their complexity, such studies need rigorous and informed ethical oversight.

A Quality Improvement Emergency Department Surge Management Platform (SurgeCon): Protocol for a Stepped Wedge Cluster Randomized Trial

BACKGROUND

Despite many efforts, long wait times and overcrowding in emergency departments (EDs) have remained a significant health service issue in Canada. For several years, Canada has had one of the longest wait times among the Organisation for Economic Co-operation and Development countries. From a patient's perspective, this challenge has been described as "patients wait in pain or discomfort for hours before being seen at EDs." To overcome the challenge of increased wait times, we developed an innovative ED management platform called SurgeCon that was designed based on continuous quality improvement principles to maintain patient flow and mitigate the impact of patient surge on ED efficiency. The SurgeCon quality improvement intervention includes a protocol-driven software platform, restructures ED organization and workflow, and aims to establish a more patient-centric environment. We piloted SurgeCon at an ED in Carbonear, Newfoundland and Labrador, and found that there was a 32% reduction in ED wait times.

OBJECTIVE

The primary objective of this trial is to determine the effects of SurgeCon on ED performance by assessing its impact on length of stay, the time to a physician's initial assessment, and the number of patients leaving the ED without being seen by a physician. The secondary objectives of this study are to evaluate SurgeCon's effects on patient satisfaction and patient-reported experiences with ED wait times and its ability to create better-value care by reducing the per-patient cost of delivering ED services.

METHODS

The implementation of the intervention will be assessed using a comparative effectiveness-implementation hybrid design. This type of hybrid design is known to shorten the amount of time associated with transitioning interventions from being the focus of research to being used for practice and health care services. All EDs with 24/7 on-site physician support (category A hospitals) will be enrolled in a 31-month, pragmatic, stepped wedge cluster randomized trial. All clusters (hospitals) will start with a baseline period of usual care and will be randomized to determine the order and timing of transitioning to intervention care until all hospitals are using the intervention to manage and operationalize their EDs.

RESULTS

Data collection for this study is continuing. As of February 2022, a total of 570 randomly selected patients have participated in telephone interviews concerning patient-reported experiences and patient satisfaction with ED wait times. The first of the 4 EDs was randomly selected, and it is currently using SurgeCon's eHealth platform and applying efficiency principles that have been learned through training since September 2021. The second randomly selected site will begin intervention implementation in winter 2022.

CONCLUSIONS

By assessing the impact of SurgeCon on ED services, we hope to be able to improve wait times and create better-value ED care in this health care context.

TRIAL REGISTRATION

ClinicalTrials.gov NCT04789902; https://clinicaltrials.gov/ct2/show/NCT04789902.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

DERR1-10.2196/30454.

Effect of extended trading hours on alcohol sales in Norway: study protocol for a stepped wedge cluster-randomized trial

BACKGROUND AND AIMS

Norwegian alcohol policy measures include national restrictions on sales hours and a state monopoly on retail sales. A 1-hour extension of sales hours on Saturdays in the monopoly outlets took effect from September 2020. We aim to evaluate whether increase in sales hours results in (1) an increase in alcohol sales in the monopoly outlets and (2) an increase in total alcohol sales, including substitution effects from beer sales in grocery stores.

DESIGN

The extension of Saturday sales hours is implemented within a stepped wedge cluster-randomized trial design. Block randomization of 62 of the 66 Norwegian trade districts allocated monopoly outlets to one of three sequences regarding date of implementation.

SETTING AND PARTICIPANTS

A total of 228 of 335 in total Norwegian state monopoly outlets are eligible and included.

INTERVENTION

The extension of sales hours is from 3 p.m. to 4 p.m. starting on the first Saturday in (i) September 2020, (ii) December 2020 or (iii) March 2021.

MEASUREMENTS

Growth rates in monthly alcohol sales, measured in litres of pure alcohol, in eligible monopoly outlets (primary outcome) are obtained together with beverage-specific sales and alcohol sales in grocery stores (secondary outcomes). The observation period is set to 72 months prior to and 24 months after implementation.

FINDINGS

Power analyses indicate that this stepped wedge cluster-randomized controlled trial has a power above 90%, even at a high significance level (α = 0.01) and with other conservative model specifications. The planned trial offers a rare opportunity to study possible causal effects of a relatively small change in a widely used alcohol policy measure.

Effects of Implementing the Short-Term Assessment of Risk and Treatability for Mechanical Restraint in a Forensic Male Population: A Stepped-Wedge, Cluster-Randomized Design

The assessment and formulation of the risk of violence and other unwanted behaviors at forensic psychiatric facilities have been attempted for decades. Structured professional judgment tools, such as the Short-Term Assessment of Risk and Treatability (START), are among the recent attempts to overcome the challenge of accomplishing these goals. This study examined the effect of implementing START in clinical practice for the most serious adverse events among the target group of severely mentally ill forensic psychiatric inpatients. Results were based on the use of mechanical restraints as an outcome. This study is a pragmatic, stepped-wedge, cluster-randomized controlled trial and was conducted over 5 years. It included eight forensic psychiatric units. Fifty out of 156 patients who had a basic aggression score of more than 0 were included in the study. We found that the rate of mechanical restraint use within the START period were 82% [relative risk (RR) = 0.18], lower than those outside of the START period. Patients evaluated within the START period were also found to have a 36% (RR = 0.64) lower risk of having higher Brøset Violence Checklist scores than patients evaluated outside the START period. Previous studies on START have primarily focused on validation, the predictive capability of the assessment, and implementation. We were only able to identify one study that aimed to identify the benefits and outcomes of START in a forensic setting. This study showed a significant reduction in the chance for inpatients in a forensic psychiatric facility to become mechanically restrained during periods where the START was used as risk assessment.

A comparative study of R functions for clustered data analysis

Background

Clustered or correlated outcome data is common in medical research studies, such as the analysis of national or international disease registries, or cluster-randomized trials, where groups of trial participants, instead of each trial participant, are randomized to interventions. Within-group correlation in studies with clustered data requires the use of specific statistical methods, such as generalized estimating equations and mixed-effects models, to account for this correlation and support unbiased statistical inference.

Methods

We compare different approaches to estimating generalized estimating equations and mixed effects models for a continuous outcome in R through a simulation study and a data example. The methods are implemented through four popular functions of the statistical software R, “geese”, “gls”, “lme”, and “lmer”. In the simulation study, we compare the mean squared error of estimating all the model parameters and compare the coverage proportion of the 95% confidence intervals. In the data analysis, we compare estimation of the intervention effect and the intra-class correlation.

Results

In the simulation study, the function “lme” takes the least computation time. There is no difference in the mean squared error of the four functions. The “lmer” function provides better coverage of the fixed effects when the number of clusters is small as 10. The function “gls” produces close to nominal scale confidence intervals of the intra-class correlation. In the data analysis and the “gls” function yields a positive estimate of the intra-class correlation while the “geese” function gives a negative estimate. Neither of the confidence intervals contains the value zero.

Conclusions

The “gls” function efficiently produces an estimate of the intra-class correlation with a confidence interval. When the within-group correlation is as high as 0.5, the confidence interval is not always obtainable.

Supplementary Information

The online version contains supplementary material available at (10.1186/s13063-021-05900-7).

Power calculation for analyses of cross-sectional stepped-wedge cluster randomized trials with binary outcomes via generalized estimating equations

Power calculation for stepped-wedge cluster randomized trials (SW-CRTs) presents unique challenges, beyond those of standard parallel cluster randomized trials, due to the need to consider temporal within cluster correlations and background period effects. To date, power calculation methods specific to SW-CRTs have primarily been developed under a linear model. When the outcome is binary, the use of a linear model corresponds to assessing a prevalence difference; yet trial analysis often employs a nonlinear link function. We propose power calculation methods for cross-sectional SW-CRTs under a logistic model fitted by generalized estimating equations. Firstly, under an exchangeable correlation structure, we show the power based on a logistic model is lower than that from assuming a linear model in the absence of period effects. We then evaluate the impact of background prevalence changes over time on power. To allow the correlation among outcomes in the same cluster to change over time and with treatment status, we generalize the methods to more complex correlation structures. Our simulation studies demonstrate that the proposed power calculation methods perform well with the model-based variance under the true correlation structure and reveal that a working independence structure can result in substantial efficiency loss, while a working exchangeable structure performs well even when the underlying correlation structure deviates from exchangeable. An extension to our methods accounts for variable cluster sizes and reveals that unequal cluster sizes have a modest impact on power. We illustrate the approaches by application to a quality of care improvement trial for acute coronary syndrome.

Using a participatory method to test a strategy supporting the implementation of a state policy on screening children for adverse childhood experiences (ACEs) in a Federally Qualified Health Center system: a stepped-wedge cluster randomized trial

BACKGROUND

Adverse childhood experiences (ACEs) are potentially traumatic events occurring before age 18, such as maltreatment or exposure to violence. ACE screening is increasingly recommended to prevent and address physical and mental health conditions associated with ACEs. To promote ACE screening uptake, the state of California issued the "ACEs Aware" policy that provides Medicaid reimbursement for ACE screening annually for child primary care visits. However, policy directives alone often do not translate into effective screening efforts and greater access to care. Few rigorous studies have developed and tested implementation strategies for ACE pediatric screening policies. This study will fill this gap by testing a multifaceted implementation strategy in partnership with a Federally Qualified Health Center (FQHC) system serving low-income families in Southern California to support the ACE Aware policy.

METHODS

We will use Implementation Mapping, with study process and consideration of determinants and mechanisms guided by the EPIS framework, to co-create and refine an implementation strategy. The proposed strategy is comprised of online training videos, a customized algorithm and use of technology to improve workflow efficiency, implementation training to internal FQHC personnel, clinic support and coaching, and written implementation protocols. A hybrid type 2, stepped-wedge cluster randomized trial design with five primary care clinics will test whether a multifaceted implementation strategy improves (a) fidelity to the ACE screening protocol, (b) reach defined as the proportion of eligible children screened for ACEs, and (c) the impact of the ACE policy on child-level mental health referrals and symptom outcomes. The study will use mixed methods with data to include electronic health records, surveys, and interviews with clinic personnel and caregivers.

DISCUSSION

This study is designed to increase the capacity of FQHCs' inner context to successfully implement an outer context-initiated ACE policy designed to benefit pediatric patients. It capitalizes on a rare opportunity to use a co-creation approach to develop, adapt, refine, and pilot test an implementation strategy to maximize the impact of a new state-wide policy intended to improve ACE assessment and subsequent care to improve child health, particularly those from underserved communities.

TRIAL REGISTRATION

Trial # NCT04916587  registered at ClinicalTrials.gov on June 4, 2021.

Statistical analysis plan for the Steppedwedge Cluster Randomized trial of Electronic Early Notification of sepsis in hospitalized ward patients (SCREEN)

Background

It is unclear whether screening for sepsis using an electronic alert in hospitalized ward patients improves outcomes. The objective of the Stepped-wedge Cluster Randomized Trial of Electronic Early Notification of Sepsis in Hospitalized Ward Patients (SCREEN) trial is to evaluate whether an electronic screening for sepsis compared to no screening among hospitalized ward patients reduces all-cause 90-day in-hospital mortality.

Methods and design

This study is designed as a stepped-wedge cluster randomized trial in which the unit of randomization or cluster is the hospital ward. An electronic alert for sepsis was developed in the electronic medical record (EMR), with the feature of being active (visible to treating team) or masked (inactive in EMR frontend for the treating team but active in the backend of the EMR). Forty-five clusters in 5 hospitals are randomized into 9 sequences of 5 clusters each to receive the intervention (active alert) over 10 periods, 2 months each, the first being the baseline period. Data are extracted from EMR and are compared between the intervention (active alert) and control group (masked alert). During the study period, some of the hospital wards were allocated to manage patients with COVID-19. The primary outcome of all-cause hospital mortality by day 90 will be compared using a generalized linear mixed model with a binary distribution and a log-link function to estimate the relative risk as a measure of effect. We will include two levels of random effects to account for nested clustering within wards and periods and two levels of fixed effects: hospitals and COVID-19 ward status in addition to the intervention. Results will be expressed as relative risk with a 95% confidence interval.

Conclusion

The SCREEN trial provides an opportunity for a novel trial design and analysis of routinely collected and entered data to evaluate the effectiveness of an intervention (alert) for a common medical problem (sepsis in ward patients). In this statistical analysis plan, we outline details of the planned analyses in advance of trial completion. Prior specification of the statistical methods and outcome analysis will facilitate unbiased analyses of these important clinical data.

Trial registration

ClinicalTrials.gov NCT04078594. Registered on September 6, 2019

Supplementary Information

The online version contains supplementary material available at 10.1186/s13063-021-05788-3.

SaferBirths bundle of care protocol: a stepped-wedge cluster implementation project in 30 public health-facilities in five regions, Tanzania

Background

The burden of stillbirth, neonatal and maternal deaths are unacceptably high in low- and middle-income countries, especially around the time of birth. There are scarce resources and/or support implementation of evidence-based training programs. SaferBirths Bundle of Care is a well-proven package of innovative tools coupled with data-driven on-the-job training aimed at reducing perinatal and maternal deaths. The aim of this project is to determine the effect of scaling up the bundle on improving quality of intrapartum care and perinatal survival.

Methods

The project will follow a stepped-wedge cluster implementation design with well-established infrastructures for data collection, management, and analysis in 30 public health facilities in regions in Tanzania. Healthcare workers from selected health facilities will be trained in basic neonatal resuscitation, essential newborn care and essential maternal care. Foetal heart rate monitors (Moyo), neonatal heart rate monitors (NeoBeat) and skills trainers (NeoNatalie Live) will be introduced in the health facilities to facilitate timely identification of foetal distress during labour and improve neonatal resuscitation, respectively. Heart rate signal-data will be automatically collected by Moyo and NeoBeat, and newborn resuscitation training by NeoNatalie Live.

Given an average of 4000 baby-mother pairs per year per health facility giving an estimate of 240,000 baby-mother pairs for a 2-years duration, 25% reduction in perinatal mortality at a two-sided significance level of 5%, intracluster correlation coefficient (ICC) to be 0.0013, the study power stands at 0.99.

Discussion

Previous reports from small-scale Safer Births Bundle implementation studies show satisfactory uptake of interventions with significant improvements in quality of care and lives saved. Better equipped and trained birth attendants are more confident and skilled in providing care. Additionally, local data-driven feedback has shown to drive continuous quality of care improvement initiatives, which is essential to increase perinatal and maternal survival. Strengths of this research project include integration of innovative tools with existing national guidelines, local data-driven decision-making and training. Limitations include the stepwise cluster implementation design that may lead to contamination of the intervention, and/or inability to address the shortage of healthcare workers and medical supplies beyond the project scope.

Trial registration

Name of Trial Registry: ISRCTN Registry.

Trial registration number: ISRCTN30541755.

Date of Registration: 12/10/2020.

Type of registration: Prospectively Registered.

Inference for the treatment effect in longitudinal cluster randomized trials when treatment effect heterogeneity is ignored

In cluster-randomized trials, sometimes the effect of the intervention being studied differs between clusters, commonly referred to as treatment effect heterogeneity. In the analysis of stepped wedge and cluster-randomized crossover trials, it is possible to include terms in outcome regression models to allow for such treatment effect heterogeneity yet this is not frequently considered. Outside of some simulation studies of specific cases where the outcome is binary, the impact of failing to include terms for treatment effect heterogeneity on the variance of the treatment effect estimator is unknown. We analytically examine the impact of failing to include terms for treatment effect heterogeneity on the variance of the treatment effect estimator, when outcomes are continuous. Using analysis of variance and feasible generalized least squares we provide expressions for this variance. For both the cluster-randomized crossover design and the stepped wedge design, our analytic derivations indicate that failing to include treatment effect heterogeneity results in the estimates for variance of the treatment effect that are too small, leading to inflation of type I error rates. We therefore recommend assessing the sensitivity of sample size calculations and conclusions drawn from the analysis of cluster randomized trials to the inclusion of treatment effect heterogeneity.

Power and sample size calculation for stepped-wedge designs with discrete outcomes

BACKGROUND

Stepped-wedge designs (SWD) are increasingly used to evaluate the impact of changes to the process of care within health care systems. However, to generate definitive evidence, a correct sample size calculation is crucial to ensure such studies are properly powered. The seminal work of Hussey and Hughes (Contemp Clin Trials 28(2):182-91, 2004) provides an analytical formula for power calculations with normal outcomes using a linear model and simple random effects. However, minimal development and evaluation have been done for power calculation with non-normal outcomes on their natural scale (e.g., logit, log). For example, binary endpoints are common, and logistic regression is the natural multilevel model for such clustered data.

METHODS

We propose a power calculation formula for SWD with either normal or non-normal outcomes in the context of generalized linear mixed models by adopting the Laplace approximation detailed in Breslow and Clayton (J Am Stat Assoc 88(421):9-25, 1993) to obtain the covariance matrix of the estimated parameters.

RESULTS

We compare the performance of our proposed method with simulation-based sample size calculation and demonstrate its use on a study of patient-delivered partner therapy for STI treatment and a study that assesses the impact of providing additional benchmark prevalence information in a radiologic imaging report. To facilitate adoption of our methods we also provide a function embedded in the R package "swCRTdesign" for sample size and power calculation for multilevel stepped-wedge designs.

CONCLUSIONS

Our method requires minimal computational power. Therefore, the proposed procedure facilitates rapid dynamic updates of sample size calculations and can be used to explore a wide range of design options or assumptions.

Readiness to Provide Medications for Addiction Treatment in HIV Clinics: A Multisite Mixed-Methods Formative Evaluation

BACKGROUND

We sought to characterize readiness, barriers to, and facilitators of providing medications for addiction treatment (MAT) in HIV clinics.

SETTING

Four HIV clinics in the northeastern United States.

METHODS

Mixed-methods formative evaluation conducted June 2017-February 2019. Surveys assessed readiness [visual analog scale, less ready (0-<7) vs. more ready (≥7-10)]; evidence and context ratings for MAT provision; and preferred addiction treatment model. A subset (n = 37) participated in focus groups.

RESULTS

Among 71 survey respondents (48% prescribers), the proportion more ready to provide addiction treatment medications varied across substances [tobacco (76%), opioid (61%), and alcohol (49%) treatment medications (P values < 0.05)]. Evidence subscale scores were higher for those more ready to provide tobacco [median (interquartile range) = 4.0 (4.0, 5.0) vs. 4.0 (3.0, 4.0), P = 0.008] treatment medications, but not significantly different for opioid [5.0 (4.0, 5.0) vs. 4.0 (4.0, 5.0), P = 0.11] and alcohol [4.0 (3.0, 5.0) vs. 4.0 (3.0, 4.0), P = 0.42] treatment medications. Median context subscale scores ranged from 3.3 to 4.0 and generally did not vary by readiness status (P values > 0.05). Most favored integrating MAT into HIV care but preferred models differed across substances. Barriers to MAT included identification of treatment-eligible patients, variable experiences with MAT and perceived medication complexity, perceived need for robust behavioral services, and inconsistent availability of on-site specialists. Facilitators included knowledge of adverse health consequences of opioid and tobacco use, local champions, focus on quality improvement, and multidisciplinary teamwork.

CONCLUSIONS

Efforts to implement MAT in HIV clinics should address both gaps in perspectives regarding the evidence for MAT and contextual factors and may require substance-specific models.

Sample size determination for stepped wedge cluster randomized trials in pragmatic settings

The stepped-wedge cluster randomized design has been increasingly employed by pragmatic trials in health services research. In this study, based on the GEE approach, we present closed-form sample size calculation that is applicable to both closed-cohort and cross-sectional stepped wedge trials. Importantly, the proposed method is flexible to accommodate design issues routinely encountered in pragmatic trials, such as different within- and between-subject correlation structures, irregular crossover schedules for the switch to intervention, and missing data due to repeated measurements over prolonged follow-up. The closed-form formulas allow researchers to analytically assess the impact of different design factors on sample size requirement. We also recognize the potential issue of limited numbers of clusters in pragmatic stepped wedge trials and present an adjustment approach for underestimated variance of the treatment effect. We conduct extensive simulation to assess the performance of the proposed sample size method. An application example to a real clinical trial is presented.

Key concepts in clinical epidemiology: Stepped wedge trials

A stepped wedge trial evaluates an intervention that is implemented over a number of time periods according to a staggered timetable. Stepped wedge trials are usually cluster randomized, the intervention being delivered at some geographical, service or other cluster level. There is considerable variety in the design and conduct of stepped wedge trials in practice. The analysis of a stepped wedge trial often assumes that the effect of the intervention is maintained at a constant level once it has been implemented. It is important when estimating this effect to adjust for a period effect or underlying secular trend, since time is confounded with intervention, and to account for the clustering of outcomes. The advantage often cited for a stepped wedge design is that every cluster ends up getting the intervention, though in any trial design we can offer the intervention preferentially to control clusters after the trial has finished. The real advantage of a stepped wedge design is likely to be practicality or statistical efficiency.

Comparison of small-sample standard-error corrections for generalised estimating equations in stepped wedge cluster randomised trials with a binary outcome: A simulation study

Generalised estimating equations with the sandwich standard-error estimator provide a promising method of analysis for stepped wedge cluster randomised trials. However, they have inflated type-one error when used with a small number of clusters, which is common for stepped wedge cluster randomised trials. We present a large simulation study of binary outcomes comparing bias-corrected standard errors from Fay and Graubard; Mancl and DeRouen; Kauermann and Carroll; Morel, Bokossa, and Neerchal; and Mackinnon and White with an independent and exchangeable working correlation matrix. We constructed 95% confidence intervals using a t-distribution with degrees of freedom including clusters minus parameters (DFC-P), cluster periods minus parameters, and estimators from Fay and Graubard (DFFG), and Pan and Wall. Fay and Graubard and an approximation to Kauermann and Carroll (with simpler matrix inversion) were unbiased in a wide range of scenarios with an independent working correlation matrix and more than 12 clusters. They gave confidence intervals with close to 95% coverage with DFFG with 12 or more clusters, and DFC-P with 18 or more clusters. Both standard errors were conservative with fewer clusters. With an exchangeable working correlation matrix, approximated Kauermann and Carroll and Fay and Graubard had a small degree of under-coverage.

Variance formulae for multiphase stepped wedge cluster randomized trial

In a multiphase stepped wedge cluster randomized trial (MSW-CRT), more than one intervention will be initiated on each sequence in a fixed order. Hence, with the MSW-CRT design, the effect of the first intervention can be evaluated when compared to control, as well as the added-on effects of the subsequent interventions. Studies that use MSW-CRT have been proposed, but properties of this design have not been explicitly studied. We derive closed-form variance formulae to test the interventions' effects, which can be readily used for sample size and power calculation. Additionally, we provide relationships between variances to test the interventions' effects and design parameters. Under special conditions, some important properties include: (i) the variances to test different interventions' effects (ie, the first intervention effect and the second intervention effect) may be same; (ii) as the cluster-period mean autocorrelation increases, the variance to test an intervention effect may first increase and then decrease; (iii) as the amount of periods between the initiations of two interventions (ie, lag) increases, the variance to test an intervention effect may remain unchanged. We illustrate the relationships between power and design parameters using the variance formulae. From a few illustrative examples, we observe that the statistical test that uses data only relevant to a specific intervention has inferior power (relative power loss <15%) compared to the test when using all the study data. Also, power is reduced when both the total number of periods and lag are decreased simultaneously (relative power loss <20%).

Mobile Texting and Lay Health Supporters to Improve Schizophrenia Care in a Resource-Poor Community in Rural China (LEAN Trial): Randomized Controlled Trial Extended Implementation

BACKGROUND

Schizophrenia is a severe and disabling condition that presents a dire health equity challenge. Our initial 6-month trial (previously reported) using mobile texting and lay health supporters, called LEAN, significantly improved medication adherence from 0.48 to 0.61 (adjusted mean 0.11, 95% CI 0.03 to 0.20, P=.007) for adults with schizophrenia living in a resource-poor village in rural China.

OBJECTIVE

We explored the effectiveness of our texting program in improving participants' medication adherence, functioning, and symptoms in an extended implementation of the intervention after its initial phase.

METHODS

In an approximated stepped-wedge wait-list design randomized controlled trial, 277 community-dwelling villagers with schizophrenia were assigned 1:1 in phase 1 into intervention and wait-list control groups. The intervention group received (1) lay health supporters (medication or care supervisors), (2) e-platform (mobile-texting reminders and education message) access, (3) a token gift for positive behavioral changes, and (4) integration with the existing government community-mental health program (the 686 Program) while the wait-listed control group initially only received the 686 Program. Subsequently (in the extended period), both groups received the LEAN intervention plus the 686 Program. The primary outcome was antipsychotic medication adherence (percentage of dosages taken over the past month assessed by unannounced home-based pill counts). The secondary outcomes were symptoms measured during visits to 686 Program psychiatrists using the Clinical Global Impression scale for schizophrenia and functioning measured by trained student assessors using the World Health Organization Disability Assessment Schedule 2.0. Other outcomes included data routinely collected in the 686 Program system (refill records, rehospitalization due to schizophrenia, death for any reason, suicide, wandering, and violent behaviors). We used intention-to-treat analysis and missing data were imputed. A generalized estimating equation model was used to assess program effects on antipsychotics medication adherence, symptoms, and functioning.

RESULTS

Antipsychotics medication adherence improved from 0.48 in the control period to 0.58 in the extended intervention period (adjusted mean difference 0.11, 95% CI 0.04 to 0.19; P=.004). We also noted an improvement in symptoms (adjusted mean difference -0.26, 95% CI -0.50 to -0.02; P=.04; Cohen d effect size 0.20) and a reduction in rehospitalization (0.37, 95% CI 0.18 to 0.76; P=.007; number-needed-to-treat 8.05, 95% CI 4.61 to 21.41). There was no improvement in functioning (adjusted mean difference 0.02, 95% CI -0.01 to 0.06; P=.18; Cohen d effect size 0.04).

CONCLUSIONS

In an extended implementation, our intervention featuring mobile texting messages and lay health workers in a resource-poor community setting was more effective than the 686 Program alone in improving medication adherence, improving symptoms, and reducing rehospitalization.

TRIAL REGISTRATION

Chinese Clinical Trial Registry; ChiCTR-ICR-15006053 https://tinyurl.com/y5hk8vng.

Working with HIV clinics to adopt addiction treatment using implementation facilitation (WHAT-IF?): Rationale and design for a hybrid type 3 effectiveness-implementation study

BACKGROUND

Tobacco, alcohol and opioid misuse are associated with substantial morbidity and mortality among people with HIV (PWH). Despite existence of evidence-based counseling and medications for addiction, these treatments are infrequently offered in HIV clinics. The Working with HIV clinics to adopt Addiction Treatment using Implementation Facilitation (WHAT-IF?) study was conducted to address this implementation challenge. The study's goals were to conduct a formative evaluation of barriers to and facilitators of implementing addiction treatment for PWH followed by an evaluation of the impact of Implementation Facilitation (IF) on promoting adoption of addiction treatments and clinical outcomes.

METHODS

The study was conducted at four HIV clinics in the northeast United States, using a hybrid type 3 effectiveness-implementation stepped wedge design and guided by the Promoting Action on Research Implementation in Health Services Research (PARiHS) framework. A mixed-methods approach was used to identify evidence, context, and facilitation-related barriers to and facilitators of integration of addiction treatments into HIV clinics and to help tailor IF for each clinic. An evaluation was then conducted of the impact of IF on implementation outcomes, including provision of addiction treatment (primary outcome), organizational and clinician and staff readiness to adopt addiction treatment, and changes in organizational models of care used to deliver addiction treatment. The evaluation also included IF's impact on effectiveness outcomes, specifically HIV-related outcomes among patients eligible for addiction treatment.

CONCLUSIONS

Results will generate important information regarding the impact of IF as a reproducible strategy to promote addiction treatment in HIV clinics.

Effect of the Carer Support Needs Assessment Tool intervention (CSNAT-I) in the Danish specialised palliative care setting: a stepped-wedge cluster randomised controlled trial

BACKGROUND

The Carer Support Needs Assessment Tool intervention (CSNAT-I) has been shown to improve end-of-life care support for informal caregivers. This study investigated the impact of the CSNAT-I on caregivers of patients recently enrolled in specialised palliative care (SPC) at home in Denmark.

METHODS

A stepped-wedge cluster randomised controlled trial with nine clusters (ie, SPC teams). Outcome measures were collected using caregiver questionnaires at baseline (T0) and 2-week (T1) and 4-week (T2) follow-up.

RESULTS

A total of 437 caregivers were enrolled (control group, n=255; intervention group, n=182). No intervention effect was found on the primary outcome, caregiver strain at T1 (p=0.1865). However, positive effects were found at T1 and T2 on attention to caregivers' well-being (p<0.0001), quality of information and communication (p<0.0001), amount of information (T1: p=0.0002; T2: p<0.0001), involvement (T1: p=0.0045; T2: p<0.0001), talking about greatest burdens (p<0.0001) and assistance in managing greatest burdens (p<0.0001). The effect sizes of these differences were medium or large and seemed to increase from T1 to T2. At T1, positive effects were found on distress (p=0.0178) and home care responsibility (p=0.0024). No effect was found on the remaining outcomes.

CONCLUSION

Although no effect was found on caregiver strain, the CSNAT-I showed positive effects on caregiver distress, home care responsibility and key outcomes regarding caregivers' experience of the interaction with healthcare professionals.

TRIAL REGISTRATION NUMBER

NCT03466580.

Design, rationale and analysis plan for the Stand Up for Health trial in contact centres: a stepped wedge feasibility study

Background

Contact centres are one of the most sedentary workplaces, with employees spending a very high proportion of their working day sitting down. About a quarter of contact centre staff regularly experience musculoskeletal health problems due to high levels of sedentary behaviour, including lower back pain. There have been no previous randomised studies specifically aiming to reduce sedentary behaviour in contact centre staff. To address this gap, the Stand Up for Health (SUH) study aims to test the feasibility and acceptability of a complex theory-based intervention to reduce sedentary behaviour in contact centres.

Methods

The Stand Up for Health study has a stepped wedge cluster randomised trial design, which is a pragmatic design whereby clusters (contact centres) are randomised to time points at which they will begin to receive the intervention. All contact centre staff have the opportunity to experience the intervention. To minimise the resource burden in this feasibility study, data collection is not continuous, but undertaken on a selective number of occasions, so the stepped wedge design is “incomplete”. Eleven contact centres in England and Scotland have been recruited, and the sample size is approximately 27 per centre (270 in total). The statistical analysis will predominantly focus on assessing feasibility, including the calculation of recruitment rates and rates of attrition. Exploratory analysis will be performed to compare objectively measured sedentary time in the workplace (measured using an activPAL™ device) between intervention and control conditions using a linear mixed effects regression model.

Discussion

To our knowledge, this is the first stepped wedge feasibility study conducted in call centres. The rationale and justification of our novel staircase stepped wedge design has been presented, and we hope that by presenting our study design and statistical analysis plan, it will contribute to the literature on stepped wedge trials, and in particular feasibility stepped wedge trials. The findings of the study will also help inform whether this is a suitable design for other settings where data collection is challenging.

Trial registration

The trial has been registered on the ISRCTN database: http://www.isrctn.com/ISRCTN11580369

Safety and Health through Integrated, Facilitated Teams (SHIFT): stepped-wedge protocol for prospective, mixed-methods evaluation of the Healthy Workplace Participatory Program

BACKGROUND

Healthcare facilities are notorious for occupational health and safety problems. Multi-level interventions are needed to address interacting exposures and their overlapping origins in work organization features. Worker participation in problem identification and resolution is essential. This study evaluates the CPH-NEW Healthy Workplace Participatory Program (HWPP), a Total Worker Health® protocol to develop effective employee teams for worker safety, health, and wellbeing.

METHODS

Six public sector, unionized healthcare facilities are enrolled, in three pairs, matched by agency. The unit of intervention is a workplace health and safety committee, adapted here to a joint labor-management "Design Team" (DT). The DT conducts root cause analyses, prioritizes problems, identifies feasible interventions in light of the constraints and needs of the specific setting, makes business-case presentations to facility leadership, and assists in evaluation. Following a stepped-wedge (cross-over) design, one site in each pair is randomly assigned to "immediate intervention" status, receiving the full coached intervention at baseline; in the "lagged intervention" site, coaching begins about half-way through the study. Program effectiveness and cost-effectiveness outcomes are assessed at both organizational (e.g., workers' compensation claim and absenteeism rates, perceived management support of safety) and individual levels (e.g., self-rated health, sleep quality, leisure-time exercise). Targeted pre-post analyses will also examine specific outcomes appropriate to the topics selected for intervention. Process evaluation outcomes include fidelity of the HWPP intervention, extent of individual DT member activity, expansion of committee scope to include employee well-being, program obstacles and opportunities in each setting, and sustainability (within the available time frame).

DISCUSSION

This study aims for a quantitative evaluation of the HWPP over a time period long enough to accomplish multiple intervention cycles in each facility. The design seeks to achieve comparable study engagement and data quality between groups. We will also assess whether the HWPP might be further improved to meet the needs of U.S. public sector healthcare institutions. Potential challenges include difficulty in pooling data across study sites if Design Teams select different intervention topics, and follow-up periods too short for change to be observed.

TRIAL REGISTRATION

ClinicalTrials.gov NCT04251429 (retrospectively registered January 29, 2020), protocol version 1.

Assessing a WeChat-Based Integrative Family Intervention (WIFI) for Schizophrenia: Protocol for a Stepped-Wedge Cluster Randomized Trial

BACKGROUND

Schizophrenia is a persistent and debilitating mental illness, and its prognosis depends largely on supportive care and systematic treatment. In developing countries like China, families constitute the major caregiving force for schizophrenia and are faced with many challenges, such as lack of knowledge, skills, and resources. The approach to support family caregiving in an accessible, affordable, feasible, and cost-effective way remains unclear. The wide-spread use of WeChat provides a promising and cost-effective medium for support.

OBJECTIVE

We aim to present a protocol for assessing a WeChat-based integrative family intervention (WIFI) to support family caregiving for schizophrenia.

METHODS

We will develop a WIFI program that includes the following three core components: (1) psychoeducation (WeChat official account), (2) peer support (WeChat chat group), and (3) professional support (WeChat video chat). A rigorous stepped-wedge cluster randomized trial will be used to evaluate the implementation, effectiveness, and cost of the WIFI program. The WIFI program will be implemented in 12 communities affiliated with Changsha Psychiatric Hospital through the free medicine delivery process in the 686 Program. The 12 communities will be randomized to one of four fixed sequences every 2 months during an 8-month intervention period in four clusters of three communities each. Outcomes will be assessed for both family caregivers and people with schizophrenia. Family caregivers will be assessed for their knowledge and skills about caregiving, social support, coping, perceived stigma, caregiver burden, family functioning, positive feelings, and psychological distress. People with schizophrenia will be assessed for their symptoms, functioning, quality of life, recovery, and rehospitalization. Cost data, such as intervention costs, health care utilization costs, and costs associated with lost productivity, will be collected. Moreover, we will collect process data, including fidelity and quality of program implementation, as well as user attitude data. Treatment effects will be estimated using generalized linear maximum likelihood mixed modeling with clusters as a random effect and time as a fixed effect. Cost-effectiveness analysis will be performed from the societal perspective using incremental cost-effectiveness ratios. Qualitative analysis will use the grounded theory approach and immersion-crystallization process.

RESULTS

The study was funded in August 2018 and approved by the institutional review board on January 15, 2019. Preliminary baseline data collection was conducted in May 2019 and completed in September 2019. The WIFI program is expected to start in September 2020.

CONCLUSIONS

This is the first study to assess a WeChat-based mHealth intervention to support family caregiving for schizophrenia in China. The innovative study will contribute to the development of a more cost-effective and evidence-based family management model in the community for people with schizophrenia, and the approach could potentially be integrated into national policy and adapted for use in other populations.

TRIAL REGISTRATION

ClinicalTrials.gov NCT04393896; https://clinicaltrials.gov/ct2/show/NCT04393896.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

PRR1-10.2196/18538.

Failure in Systems and Culture: Barriers That Prevent Implementation of Evidence-Based Fasting Times for Patients in the Acute Care Setting

BACKGROUND

There is strong evidence supporting fasting guidelines of 6 hours' fast from solids and 2 hours' fast from fluids prior to surgery. Despite this, patients spend prolonged periods of time fasting for surgery with a lack of research to support translating this evidence into practice, particularly for emergency surgical theater lists. This study aims to explore barriers and enablers to reduce prolonged fasting for patients on emergency surgical lists in the acute care setting.

METHODS

Qualitative interviews were undertaken with 22 health professionals on acute surgical wards within a quaternary referral hospital in Sydney, Australia. Semistructured interviews explored barriers and enablers to implementing evidence-based fasting practices for patients on emergency surgical lists, using a theoretical domains framework. Interviews were transcribed verbatim and analyzed using an inductive thematic approach.

RESULTS

Key barriers to implementing reduced fasting included unpredictable, inflexible systems; cultural concerns; and gaps in knowledge. Major enablers to reducing fasting times are the recognition of patient distress caused by excessive fasting and desire by all 22 interviewees to address the problem.

CONCLUSIONS

This research is the first to explore barriers and enablers to implementing interventions to address excessive fasting. This research highlights the complexity of the issue and the need for a multifaceted translational intervention addressing limitations in systems and cultural barriers.

Effect of voluntary breathing exercises on stable coronary artery disease in heart rate variability and rate-pressure product: a study protocol for a single-blind, prospective, randomized controlled trial

Background

At present, China has more than 11 million patients with stable coronary heart disease and this is becoming a major public health problem. The pathological changes of coronary heart disease can lead to dysfunction of the cardiac autonomic nervous system, which increases the risk of complications such as malignant arrhythmia (ventricular flutter, ventricular fibrillation, etc.), heart rate, systolic blood pressure, and rate-pressure product (RPP), which is highly correlated with myocardial oxygen consumption and indirectly reflects myocardial blood supply and oxygen consumption. Although the guidelines recommend that such patients take drugs to reduce heart rate and myocardial oxygen consumption, the clinical control of heart rate is still not ideal. Thus, in this trial, we will use voluntary breathing exercises as the strategy of exercise rehabilitation for patients with stable coronary artery disease (SCAD), in order to increase the vagus nerve activity and/or reduce the sympathetic nervous activity, help maintain or rebuild the balance of plant nerve system, improve the time-domain index of heart rate variability, reduce the burden on the heart, and relieve patients’ anxiety and other negative emotions.

Methods

This is a 6-month single-blind, randomized controlled clinical trial that will be conducted in the First Affiliated Hospital of Soochow University. A total of 140 patients who fill out the Informed Consent Form are registered and randomized 1:1 into the Voluntary Breathing Exercises (VBE)-based clinical trial monitoring group (n = 70) or the Routine follow-up group (n = 70). The VBE-based clinical trial monitoring group is given VBE training on the basis of conventional treatment and health education, while the control group received conventional health education and follow-up. The primary outcomes will be measured heart rate variability and RPP. Secondary outcomes will include changes in Self-rating Anxiety Scale, total cholesterol, triglyceride, high-density lipoprotein, low-density lipoprotein, weight, and body mass index.

Discussion

This trial will carry out scientific respiratory exercise for patients with SCAD, which belongs to the category of active secondary prevention for patients, and changes from remedial to pre-protective. VBE is easy to operate and is not limited by time and place. It is important and meaningful to carry out VBE for patients with SCAD. This study will provide considerable evidence for further large-scale trials and alternative strategies for the rehabilitation nursing of patients with SCAD.

Trial registration

Chinese Clinical Trials Registry, 1900024043. Registered on 23 June 2019.

Implementation of a nurse-led self-management support intervention for patients with cancer-related pain: a cluster randomized phase-IV study with a stepped wedge design (EvANtiPain)

Background

Pain self-management support interventions were effective in controlled clinical trials and meta analyses. However, implementation of these complex interventions may not translate into identical effects. This paper evaluates the implementation of ANtiPain, a cancer pain self-management support intervention in routine clinical practice according to the Reach Efficacy-Adoption Implementation Maintenance framework.

Methods

In this cluster randomized study with a stepped wedge design, N = 153 adult patients with cancer-related pain were recruited from 01/17 to 05/18 on 17 wards of 3 hospitals in Vienna, Austria. ANtiPain entailed a face-to-face in-hospital session by a trained nurse to prepare discharge according to key strategies, information on pain self-management, and skills building. After discharge, cancer-pain self-management was coached via phone calls. Patient-level data were collected at recruitment, and 2, 4 and 8 weeks after discharge via postal or online questionnaire. Primary outcome was pain interference with daily activities. Secondary outcomes included pain intensity, self-efficacy, and patient satisfaction. Organizational-level data (e.g., on implementation procedures) were collected by study or intervention nurses. The mixed model to analyze patient-level data included a random intercept and a random slope for individual and a random intercept for ward.

Results

Recruitment was slower than expected and unevenly distributed over wards and hospitals. The face-to-face session was clinically feasible (mean duration = 33 min) as well as the mean amount (n = 2) and duration of phone calls (mean = 17 min). Only 16 (46%) of 35 trained nurses performed the intervention on nine wards. To deal with the loss of power, analyses were adapted. Overall effects on pain interference were not significant. However, effects were significant in sub analyses of the nine wards that recruited patients in the intervention period (p = .009). Regarding secondary outcomes, the group-by-time effect was significant for self-efficacy (p = .033), and patient satisfaction with information on pain-self-management (p = .002) and in-hospital pain management (p = .018).

Conclusions

The implementation of ANtiPain improved meaningful patient outcomes on wards that applied the intervention routinely. Our analyses showed that the implementation benefited from being embedded in larger scale projects to improve cancer pain management and that the selection of wards with a high percentage of oncology patients may be crucial.

Trial registration

ClinicalTrials.gov Identifier: NCT02891785 Date of registration: September 8, 2016.

A Stepped Wedge Cluster-Randomized Trial Assessing the Impact of a Riverbank Filtration Intervention to Improve Access to Safe Water on Health in Rural India

Sustainable and low-cost methods for delivery of safe drinking water in resource-limited settings remain suboptimal, which contributes to global diarrhea morbidity. We aimed to assess whether delivery of riverbank filtration-treated water to newly installed water storage tanks (improved quality and access, intervention condition) reduced reported diarrhea in comparison to delivery of unfiltered river water (improved access alone, control condition) in rural Indian villages. We used a stepped wedge cluster-randomized trial (SW-CRT) design involving four clusters (villages). Selection criteria included village size, proximity to a river, and lack of existing or planned community-level safe water sources. All adults and children were eligible for enrollment. All villages started in the control condition and were sequentially randomized to receive the intervention at 3-month intervals. Our primary outcome was 7-day-period prevalence of self- or caregiver-reported diarrhea, measured at 3-month intervals (five time points). Analysis was by intention to treat. Because blinding was not possible, we incorporated questions about symptoms unrelated to water consumption to check response validity (negative control symptoms). We measured outcomes in 2,222 households (9,836 participants). We did not find a measurable reduction in diarrhea post-intervention (RR: 0.98 [95% CI: 0.24-4.09]); possible explanations include low intervention uptake, availability of other safe water sources, low baseline diarrheal prevalence, and reporting fatigue. Our study highlights both the difficulties in evaluating the impact of real-world interventions and the potential for an optimized SW-CRT design to address budgetary, funding, and logistical constraints inherent in such evaluations.

Novel methods for the analysis of stepped wedge cluster randomized trials

Stepped wedge cluster randomized trials (SW-CRTs) have become increasingly popular and are used for a variety of interventions and outcomes, often chosen for their feasibility advantages. SW-CRTs must account for time trends in the outcome because of the staggered rollout of the intervention. Robust inference procedures and nonparametric analysis methods have recently been proposed to handle such trends without requiring strong parametric modeling assumptions, but these are less powerful than model-based approaches. We propose several novel analysis methods that reduce reliance on modeling assumptions while preserving some of the increased power provided by the use of mixed effects models. In one method, we use the synthetic control approach to find the best matching clusters for a given intervention cluster. Another method makes use of within-cluster crossover information to construct an overall estimator. We also consider methods that combine these approaches to further improve power. We test these methods on simulated SW-CRTs, describing scenarios in which these methods have increased power compared with existing nonparametric methods while preserving nominal validity when mixed effects models are misspecified. We also demonstrate theoretical properties of these estimators with less restrictive assumptions than mixed effects models. Finally, we propose avenues for future research on the use of these methods; motivation for such research arises from their flexibility, which allows the identification of specific causal contrasts of interest, their robustness, and the potential for incorporating covariates to further increase power. Investigators conducting SW-CRTs might well consider such methods when common modeling assumptions may not hold.