Design and analysis of stepped wedge cluster randomized trials

Bridging the knowledge gap of biomedical HIV prevention tools among sub-saharan african immigrants in France. Results from an empowerment-based intervention

Introduction

Biomedical HIV prevention tools are available in France to prevent new infections. However, evidence suggests a lack of knowledge of these tools among sub-Saharan African immigrants, who are particularly affected by HIV due to social hardship, an indirect factor of HIV acquisition. We analysed the impact of an empowerment-based intervention on the knowledge of treatment as prevention (TasP), pre-exposure prophylaxis (PrEP) and post-exposure prophylaxis (PEP) in a population of precarious sub-Saharan African immigrants.

Methods

Data were collected throughout the MAKASI project. Following an outreach approach, participants were recruited in public places based on their precarious situations and followed for six months (0, 3, 6 months) between 2018 and 2021. Participants were randomized into two groups and received an empowerment intervention sequentially (stepped wedge design). We used random-effects logistic regression models to evaluate the intervention effect on the knowledge of biomedical HIV prevention tools. ClinicalTrials.gov Identifier: NCT04468724.

Results

The majority of the participants were men (77.5%), and almost half of them had arrived in France within 2 years prior to inclusion (49.3%). At baseline, 56% of participants knew about TasP, 6% knew about PEP and 4% knew about PrEP. Receiving the intervention increased the odds of knowing about PEP (aOR = 2.02 [1.09-3.75]; p < 0.026). Intervention effects were observed for TasP and PrEP only after 6 months. We found significant time effects for PEP (at 3 months, aOR = 4.26 [2.33-7.80]; p < 0.001; at 6 months, aOR = 18.28 [7.39-45.24]; p < 0.001) and PrEP (at 3 months, aOR = 4.02 [2.10-7.72]; p < 0.001; at 6 months, aOR = 28.33 [11.16-71.91]; p < 0.001).

Conclusions

We showed that the intervention increased the knowledge of biomedical HIV prevention tools. The effect of the intervention was coupled with an important time effect. This suggested that exposure to the intervention together with other sources of information contributed to increased knowledge of biomedical HIV prevention tools among precarious sub-Saharan African immigrants.

Assessing exposure-time treatment effect heterogeneity in stepped-wedge cluster randomized trials

A stepped-wedge cluster randomized trial (CRT) is a unidirectional crossover study in which timings of treatment initiation for clusters are randomized. Because the timing of treatment initiation is different for each cluster, an emerging question is whether the treatment effect depends on the exposure time, namely, the time duration since the initiation of treatment. Existing approaches for assessing exposure-time treatment effect heterogeneity either assume a parametric functional form of exposure time or model the exposure time as a categorical variable, in which case the number of parameters increases with the number of exposure-time periods, leading to a potential loss in efficiency. In this article, we propose a new model formulation for assessing treatment effect heterogeneity over exposure time. Rather than a categorical term for each level of exposure time, the proposed model includes a random effect to represent varying treatment effects by exposure time. This allows for pooling information across exposure-time periods and may result in more precise average and exposure-time-specific treatment effect estimates. In addition, we develop an accompanying permutation test for the variance component of the heterogeneous treatment effect parameters. We conduct simulation studies to compare the proposed model and permutation test to alternative methods to elucidate their finite-sample operating characteristics, and to generate practical guidance on model choices for assessing exposure-time treatment effect heterogeneity in stepped-wedge CRTs.

An intervention to improve the self-efficacy of key workers to support parental wellbeing at an early childhood intervention service in Australia: a stepped wedged randomized cluster trial

PURPOSE

It is well documented parents of children who have a disability are at an increased risk of poor mental health and wellbeing. A capacity building program designed to build key worker self-efficacy to support the mental health of parents accessing early childhood intervention services (ECIS) for their child was trialled.

MATERIALS AND METHODS

A stepped-wedge cluster randomised trial design was utilised to deliver and evaluate a 12-month intervention program, comprising tailored professional development, resource development and sustainability measures. The repeated measurements on individuals in six clusters over three follow-up periods were analysed using linear mixed models. Comparison of the control and new program statistical means (adjusted for period effects) were assessed with an F test.

RESULTS

Key workers reported increased confidence to talk to parents about their own wellbeing (d = 0.51, F(1, 51.8) = 4.28, p = 0.044) and knowledge of parental mental wellbeing improved (p = 0.006). A reduction in staff sick leave partially offset the cost of the intervention.

CONCLUSIONS

A multi-pronged intervention targeted at key workers was found to be an effective way to ensure parental wellbeing is supported at an ECIS in Australia.

TRIAL REGISTRATION

ACTRN12617001530314Implications for RehabilitationThere are implications for the development of children whose parents are experiencing high stress and poor mental health, whereby parents of children with disability or developmental delays are at increased risk.Findings from this study support the recommendation that a key worker is provided to holistically support families who access Early Childhood Intervention Services to aid in reducing poor parental wellbeing and child outcomes.Improved confidence to support and initiate conversations regarding parental wellbeing by key workers, in combination with support from management and the organisation to undertake this as part of their role, is a positive finding from this intervention study.

Generalizing the information content for stepped wedge designs: A marginal modeling approach

Stepped wedge trials are increasingly adopted because practical constraints necessitate staggered roll-out. While a complete design requires clusters to collect data in all periods, resource and patient-centered considerations may call for an incomplete stepped wedge design to minimize data collection burden. To study incomplete designs, we expand the metric of information content to discrete outcomes. We operate under a marginal model with general link and variance functions, and derive information content expressions when data elements (cells, sequences, periods) are omitted. We show that the centrosymmetric patterns of information content can hold for discrete outcomes with the variance-stabilizing link function. We perform numerical studies under the canonical link function, and find that while the patterns of information content for cells are approximately centrosymmetric for all examined underlying secular trends, the patterns of information content for sequences or periods are more sensitive to the secular trend, and may be far from centrosymmetric.

Evaluation of randomized controlled trials: a primer and tutorial for mental health researchers

BACKGROUND

Considered one of the highest levels of evidence, results of randomized controlled trials (RCTs) remain an essential building block in mental health research. They are frequently used to confirm that an intervention "works" and to guide treatment decisions. Given their importance in the field, it is concerning that the quality of many RCT evaluations in mental health research remains poor. Common errors range from inadequate missing data handling and inappropriate analyses (e.g., baseline randomization tests or analyses of within-group changes) to unduly interpretations of trial results and insufficient reporting. These deficiencies pose a threat to the robustness of mental health research and its impact on patient care. Many of these issues may be avoided in the future if mental health researchers are provided with a better understanding of what constitutes a high-quality RCT evaluation.

METHODS

In this primer article, we give an introduction to core concepts and caveats of clinical trial evaluations in mental health research. We also show how to implement current best practices using open-source statistical software.

RESULTS

Drawing on Rubin's potential outcome framework, we describe that RCTs put us in a privileged position to study causality by ensuring that the potential outcomes of the randomized groups become exchangeable. We discuss how missing data can threaten the validity of our results if dropouts systematically differ from non-dropouts, introduce trial estimands as a way to co-align analyses with the goals of the evaluation, and explain how to set up an appropriate analysis model to test the treatment effect at one or several assessment points. A novice-friendly tutorial is provided alongside this primer. It lays out concepts in greater detail and showcases how to implement techniques using the statistical software R, based on a real-world RCT dataset.

DISCUSSION

Many problems of RCTs already arise at the design stage, and we examine some avoidable and unavoidable "weak spots" of this design in mental health research. For instance, we discuss how lack of prospective registration can give way to issues like outcome switching and selective reporting, how allegiance biases can inflate effect estimates, review recommendations and challenges in blinding patients in mental health RCTs, and describe problems arising from underpowered trials. Lastly, we discuss why not all randomized trials necessarily have a limited external validity and examine how RCTs relate to ongoing efforts to personalize mental health care.

Optimal allocation of clusters in stepped wedge designs with a decaying correlation structure

The cluster randomized stepped wedge design is a multi-period uni-directional switch design in which all clusters start in the control condition and at the beginning of each new period a random sample of clusters crosses over to the intervention condition. Such designs often use uniform allocation, with an equal number of clusters at each treatment switch. However, the uniform allocation is not necessarily the most efficient. This study derives the optimal allocation of clusters to treatment sequences in the cluster randomized stepped wedge design, for both cohort and cross-sectional designs. The correlation structure is exponential decay, meaning the correlation decreases with the time lag between two measurements. The optimal allocation is shown to depend on the intraclass correlation coefficient, the number of subjects per cluster-period and the cluster and (in the case of a cohort design) individual autocorrelation coefficients. For small to medium values of these autocorrelations those sequences that have their treatment switch earlier or later in the study are allocated a larger proportion of clusters than those clusters that have their treatment switch halfway the study. When the autocorrelation coefficients increase, the clusters become more equally distributed across the treatment sequences. For the cohort design, the optimal allocation is almost equal to the uniform allocation when both autocorrelations approach the value 1. For almost all scenarios that were studied, the efficiency of the uniform allocation is 0.8 or higher. R code to derive the optimal allocation is available online.

Trusted residents and housing assistance to decrease violence exposure in New Haven (TRUE HAVEN): a strengths-based and community-driven stepped-wedge intervention to reduce gun violence

BACKGROUND

We describe the rationale and study design for "TRUsted rEsidents and Housing Assistance to decrease Violence Exposure in New Haven (TRUE HAVEN)," a prospective type 1 hybrid effectiveness/implementation study of a multi-level intervention using a stepped wedge design. TRUE HAVEN aims to lower rates of community gun violence by fostering the stability, wealth, and well-being of individuals and families directly impacted by incarceration through the provision of stable housing and by breaking the cycle of trauma.

DESIGN

TRUE HAVEN is an ongoing, multi-level intervention with three primary components: financial education paired with housing support (individual level), trauma-informed counseling (neighborhood level), and policy changes to address structural racism (city/state level). Six neighborhoods with among the highest rates of gun violence in New Haven, Connecticut, will receive the individual and neighborhood level intervention components sequentially beginning at staggered 6-month steps. Residents of these neighborhoods will be eligible to participate in the housing stability and financial education component if they were recently incarcerated or are family members of currently incarcerated people; participants will receive intense financial education and follow-up for six months and be eligible for special down payment and rental assistance programs. In addition, trusted community members and organization leaders within each target neighborhood will participate in trauma-informed care training sessions to then be able to recognize when their peers are suffering from trauma symptoms, to support these affected peers, and to destigmatize accessing professional mental health services and connect them to these services when needed. Finally, a multi-stakeholder coalition will be convened to address policies that act as barriers to housing stability or accessing mental healthcare. Interventions will be delivered through existing partnerships with community-based organizations and networks. The primary outcome is neighborhood rate of incident gun violence. To inform future implementation and optimize the intervention package as the study progresses, we will use the Learn As You Go approach to optimize and assess the effectiveness of the intervention package on the primary study outcome.

DISCUSSION

Results from this protocol will yield novel evidence for whether and how addressing structural racism citywide leads to a reduction in gun violence.

TRIAL REGISTRATION

ClinicalTrials.gov Identifier: NCT05723614. Registration date: February 01, 2023. Please refer to https://clinicaltrials.gov/ct2/show/NCT05723614 for public and scientific inquiries.

A semi-Markov multistate cure model for estimating intervention effects in stepped wedge design trials

Multistate models are useful for studying exposures that affect transitions among a set of health states. However, they can be challenging to apply when exposures are time-varying. We develop a multistate model and a method of likelihood construction that allows application of the model to data in which interventions or other exposures can be time-varying and an individual may to be exposed to multiple intervention conditions while progressing through states. The model includes cure proportions, reflecting the possibility that some individuals will never leave certain states. We apply the approach to analyze patient vaccination data from a stepped wedge design trial evaluating two interventions to increase uptake of human papillomavirus vaccination. The states are defined as the number of vaccine doses the patient has received. We model state transitions as a semi-Markov process and include cure proportions to account for individuals who will never leave a given state (e.g. never receive their next dose). Multistate models typically quantify intervention effects as hazard ratios contrasting the intensities of transitions between states in intervention versus control conditions. For multistate processes, another clinically meaningful outcome is the change in the percentage of the study population that has achieved a specific state (e.g. completion of all required doses) by a specific point in time due to an intervention. We present a method for quantifying intervention effects in this manner. We apply the model to both simulated and real-world data and also explore some conditions under which such models may give biased results.

Glycemic control in gestational diabetes and impact on biomarkers in women and infants

BACKGROUND

Gestational diabetes mellitus (GDM) is linked to the dysregulation of inflammatory markers in women with GDM compared to women without. It is unclear whether the intensity of glycemic control influences these biomarkers. We aimed to assess whether different glycemic targets for women with GDM and compliance influence maternal and infant biomarkers.

METHODS

Maternity hospitals caring for women with GDM were randomized in the TARGET Trial to tight or less tight glycemic targets. Maternal blood was collected at study entry, 36 weeks' gestation, and 6 months postpartum, and cord plasma after birth. We assessed compliance to targets and concentrations of maternal serum and infant biomarkers.

RESULTS

Eighty-two women and infants were included in the study. Concentrations of maternal and infant biomarkers did not differ between women assigned to tighter and less tight glycemic targets; however, concentrations were altered in maternal serum leptin and CRP and infant cord C-peptide, leptin, and IGF in women who complied with tighter targets.

CONCLUSIONS

Use of tighter glycemic targets in women with GDM does not change the concentrations of maternal and infant biomarkers compared to less tight targets. However, when compliance is achieved to tighter targets, maternal and infant biomarkers are altered.

IMPACT

The use of tighter glycemic targets in gestational diabetes does not result in changes to maternal or cord plasma biomarkers. However, for women who complied with tighter targets, maternal serum leptin and CRP and infant cord C-peptide, leptin and IGF were altered compared with women who complied with the use of the less tight targets. This article adds to the current evidence base regarding the impact of gestational diabetes on maternal and infant biomarkers. This article highlights the need for further research to assess enablers to meet the tighter target recommendations and to assess the impact on relevant biomarkers.

Evaluation of combinatorial optimisation algorithms for c-optimal experimental designs with correlated observations

We show how combinatorial optimisation algorithms can be applied to the problem of identifying c-optimal experimental designs when there may be correlation between and within experimental units and evaluate the performance of relevant algorithms. We assume the data generating process is a generalised linear mixed model and show that the c-optimal design criterion is a monotone supermodular function amenable to a set of simple minimisation algorithms. We evaluate the performance of three relevant algorithms: the local search, the greedy search, and the reverse greedy search. We show that the local and reverse greedy searches provide comparable performance with the worst design outputs having variance < 10 % greater than the best design, across a range of covariance structures. We show that these algorithms perform as well or better than multiplicative methods that generate weights to place on experimental units. We extend these algorithms to identifying modle-robust c-optimal designs.

Supplementary Information

The online version contains supplementary material available at 10.1007/s11222-023-10280-w.

Using Palliative Leaders in Facilities to Transform Care for People with Alzheimer's Disease (UPLIFT-AD): protocol of a palliative care clinical trial in nursing homes

BACKGROUND

Palliative care is an effective model of care focused on maximizing quality of life and relieving the suffering of people with serious illnesses, including dementia. Evidence shows that many people receiving care in nursing homes are eligible for and would benefit from palliative care services. Yet, palliative care is not consistently available in nursing home settings. There is a need to test pragmatic strategies to implement palliative care programs in nursing homes.

METHODS/DESIGN

The UPLIFT-AD (Utilizing Palliative Leaders in Facilities to Transform care for people with Alzheimer's Disease) study is a pragmatic stepped wedge trial in 16 nursing homes in Maryland and Indiana, testing the effectiveness of the intervention while assessing its implementation. The proposed intervention is a palliative care program, including 1) training at least two facility staff as Palliative Care Leads, 2) training for all staff in general principles of palliative care, 3) structured screening for palliative care needs, and 4) on-site specialty palliative care consultations for a one-year intervention period. All residents with at least moderate cognitive impairment, present in the facility for at least 30 days, and not on hospice at baseline are considered eligible. Opt-out consent is obtained from legal decision-makers. Outcome assessments measuring symptoms and quality of care are obtained from staff and family proxy respondents at four time points: pre-implementation (baseline), six months after implementation, at 12 months (conclusion of implementation), and six months after the end of implementation. Palliative care attitudes and practices are assessed through surveys of frontline nursing home staff both pre- and post-implementation. Qualitative and quantitative implementation data, including fidelity assessments and interviews with Palliative Care Leads, are also collected. The study will follow the Declaration of Helsinki.

DISCUSSION

This trial assesses the implementation and effectiveness of a robust palliative care intervention for residents with moderate-to-advanced cognitive impairment in 16 diverse nursing homes. The intervention represents an innovative, pragmatic approach that includes both internal capacity-building of frontline nursing home staff, and support from external palliative care specialty consultants.

TRIAL REGISTRATION

The project is registered on ClinicalTrials.gov: NCT04520698.

Effect evaluation of a tele-neurologic intervention in primary care in a rural area in Germany-the NeTKoH study protocol of a stepped-wedge cluster randomized trial

BACKGROUND

Neurological disorders account for a large and increasing proportion of the global burden of disease. Therefore, it is important to strengthen the management of neurologic care, particularly in rural areas. The use of tele-neurology in primary care in rural areas is internationally considered to have the potential to increase access to health care services and improve the quality of care in these underserved areas. NeTKoH aims to address the existing knowledge gap regarding the effects of a tele-neurologic intervention in primary care under real-world conditions in a rural area in Germany.

METHODS

NeTKoH is a cluster-randomized controlled trial with a stepped-wedge design involving 33 outpatient general practitioner's (GP) offices (clusters) in a rural area in Northeast Germany. During 11 predetermined steps, all clusters are randomized before they cross over into groups from the control to the intervention arm. The targeted sample size is 1,089 patients with neurologic symptoms that are continuously being recruited. In the intervention arm, tele-neurologic consultations will be provided via a face-to-face video conferencing system with a neurologic expert at a university hospital. The control arm will receive usual care. The primary outcome is the proportion of neurologic problems being solved at the GP's office. Secondary outcomes will comprise hospital stays and days, time until neurologic specialist appointments and diagnostics, patients' health status and quality of life, outpatient and inpatient referrals. A concurrent observational study, together with a process, implementation, and health economic evaluation, will also be conducted.

DISCUSSION

Using a stepped-wedge cluster design in a real-life situation can help with logistic challenges and enhance the motivation of the participating GPs, as all, at some point, will be in the intervention phase. With the additional implementation evaluation pertaining to external validity, an observational study, and a health economic evaluation, NeTKoH will be able to provide an extensive evaluation for health policy decision-makers regarding the uptake into standard care.

TRIAL REGISTRATION

German Clinical Trials Register (DRKS00024492). Date registered: September 28, 2021. Date and protocol version: June 2023, version 1.

Study protocol for data to suppression (D2S): a cluster-randomised, stepped-wedge effectiveness trial of a reporting and capacity-building intervention to improve HIV viral suppression in housing and behavioural health programmes in New York City

INTRODUCTION

With progress in the 'diagnose', 'link' and 'retain' stages of the HIV care continuum, viral suppression (VS) gains increasingly hinge on antiretroviral adherence among people with HIV (PWH) retained in care. The Centers for Disease Control and Prevention estimate that unsuppressed viral load among PWH in care accounts for 20% of onward transmission. HIV intervention strategies include 'data to care' (D2C)-using surveillance to identify out-of-care PWH for follow-up. However, most D2C efforts target care linkage, not antiretroviral adherence, and limit client-level data sharing to medical (versus support-service) providers. Drawing on lessons learnt in D2C and successful local pilots, we designed a 'data-to-suppression' intervention that offers HIV support-service programmes surveillance-based reports listing their virally unsuppressed clients and capacity-building assistance for quality-improvement activities. We aimed to scale and test the intervention in agencies delivering Ryan White HIV/AIDS Programme-funded behavioural health and housing services.

METHODS AND ANALYSIS

To estimate intervention effects, this study applies a cross-sectional, stepped-wedge design to the intervention's rollout to 27 agencies randomised within matched pairs to early or delayed implementation. Data from three 12-month periods (pre-implementation, partial implementation and full implementation) will be examined to assess intervention effects on timely VS (within 6 months of a report listing the client as needing follow-up for VS). Based on projected enrolment (n=1619) and a pre-implementation outcome probability of 0.40-0.45, the detectable effect size with 80% power is an OR of 2.12 (relative risk: 1.41-1.46).

ETHICS AND DISSEMINATION

This study was approved by the New York City Department of Health and Mental Hygiene's institutional review board (protocol: 21-036) with a waiver of informed consent. Findings will be disseminated via publications, conferences and meetings including provider-agency representatives.

TRIAL REGISTRATION NUMBER

NCT05140421.

Restrictive versus Liberal Rate of Extracorporeal Volume Removal Evaluation in Acute Kidney Injury (RELIEVE-AKI): a pilot clinical trial protocol

INTRODUCTION

Observational studies have linked slower and faster net ultrafiltration (UFNET) rates during kidney replacement therapy (KRT) with mortality in critically ill patients with acute kidney injury (AKI) and fluid overload. To inform the design of a larger randomised trial of patient-centered outcomes, we conduct a feasibility study to examine restrictive and liberal approaches to UFNET during continuous KRT (CKRT).

METHODS AND ANALYSIS

This study is an investigator-initiated, unblinded, 2-arm, comparative-effectiveness, stepped-wedged, cluster randomised trial among 112 critically ill patients with AKI treated with CKRT in 10 intensive care units (ICUs) across 2 hospital systems. In the first 6 months, all ICUs started with a liberal UFNET rate strategy. Thereafter, one ICU is randomised to the restrictive UFNET rate strategy every 2 months. In the liberal group, the UFNET rate is maintained between 2.0 and 5.0 mL/kg/hour; in the restrictive group, the UFNET rate is maintained between 0.5 and 1.5 mL/kg/hour. The three coprimary feasibility outcomes are (1) between-group separation in mean delivered UFNET rates; (2) protocol adherence; and (3) patient recruitment rate. Secondary outcomes include daily and cumulative fluid balance, KRT and mechanical ventilation duration, organ failure-free days, ICU and hospital length of stay, hospital mortality and KRT dependence at hospital discharge. Safety endpoints include haemodynamics, electrolyte imbalance, CKRT circuit issues, organ dysfunction related to fluid overload, secondary infections and thrombotic and haematological complications.

ETHICS AND DISSEMINATION

The University of Pittsburgh Human Research Protection Office approved the study, and an independent Data and Safety Monitoring Board monitors the study. A grant from the United States National Institute of Diabetes and Digestive and Kidney Diseases sponsors the study. The trial results will be submitted for publication in peer-reviewed journals and presented at scientific conferences.

TRIAL REGISTRATION NUMBER

This trial has been prospectively registered with clinicaltrials.gov (NCT05306964). Protocol version identifier and date: 1.5; 13 June 2023.

The impact of iterative removal of low-information cluster-period cells from a stepped wedge design

BACKGROUND

Standard stepped wedge trials, where clusters switch from the control to the intervention condition in a staggered manner, can be costly and burdensome. Recent work has shown that the amount of information contributed by each cluster in each period differs, with some cluster-periods contributing a relatively small amount of information. We investigate the patterns of the information content of cluster-period cells upon iterative removal of low-information cells, assuming a model for continuous outcomes with constant cluster-period size, categorical time period effects, and exchangeable and discrete-time decay intracluster correlation structures.

METHODS

We sequentially remove pairs of "centrosymmetric" cluster-period cells from an initially complete stepped wedge design which contribute the least amount of information to the estimation of the treatment effect. At each iteration, we update the information content of the remaining cells, determine the pair of cells with the lowest information content, and repeat this process until the treatment effect cannot be estimated.

RESULTS

We demonstrate that as more cells are removed, more information is concentrated in the cells near the time of the treatment switch, and in "hot-spots" in the corners of the design. For the exchangeable correlation structure, removing the cells from these hot-spots leads to a marked reduction in study precision and power, however the impact of this is lessened for the discrete-time decay structure.

CONCLUSIONS

Removing cluster-period cells distant from the time of the treatment switch may not lead to large reductions in precision or power, implying that certain incomplete designs may be almost as powerful as complete designs.

Structured Mobilization for Critically Ill Patients: A Pragmatic Cluster-randomized Trial

Rationale: Small trials and professional recommendations support mobilization interventions to improve recovery among critically ill patients, but their real-world effectiveness is unknown. Objective: To evaluate a low-cost, multifaceted mobilization intervention. Methods: We conducted a stepped-wedge cluster-randomized trial across 12 ICUs with diverse case mixes. The primary and secondary samples included patients mechanically ventilated for ⩾48 hours who were ambulatory before admission, and all patients with ICU stays ⩾48 hours, respectively. The mobilization intervention included 1) designation and posting of daily mobilization goals; 2) interprofessional closed-loop communication coordinated by each ICU's facilitator; and 3) performance feedback. Measurements and Main Results: From March 4, 2019 through March 15, 2020, 848 and 1,069 patients were enrolled in the usual care and intervention phases in the primary sample, respectively. The intervention did not increase the primary outcome, patient's maximal Intensive Care Mobility Scale (range, 0-10) score within 48 hours before ICU discharge (estimated mean difference, 0.16; 95% confidence interval, -0.31 to 0.63; P = 0.51). More patients in the intervention (37.2%) than usual care (30.7%) groups achieved the prespecified secondary outcome of ability to stand before ICU discharge (odds ratio, 1.48; 95% confidence interval, 1.02 to 2.15; P = 0.04). Similar results were observed among the 7,115 patients in the secondary sample. The percentage of days on which patients received physical therapy mediated 90.1% of the intervention effect on standing. ICU mortality (31.5% vs. 29.0%), falls (0.7% vs. 0.4%), and unplanned extubations (2.0% vs. 1.8%) were similar between groups (all P > 0.3). Conclusions: A low-cost, multifaceted mobilization intervention did not improve overall mobility but improved patients' odds of standing and was safe. Clinical trial registered with www.clinicaltrials.gov (NCT03863470).

The third Intensive Care Bundle with Blood Pressure Reduction in Acute Cerebral Haemorrhage Trial (INTERACT3): an international, stepped wedge cluster randomised controlled trial

BACKGROUND

Early control of elevated blood pressure is the most promising treatment for acute intracerebral haemorrhage. We aimed to establish whether implementing a goal-directed care bundle incorporating protocols for early intensive blood pressure lowering and management algorithms for hyperglycaemia, pyrexia, and abnormal anticoagulation, implemented in a hospital setting, could improve outcomes for patients with acute spontaneous intracerebral haemorrhage.

METHODS

We performed a pragmatic, international, multicentre, blinded endpoint, stepped wedge cluster randomised controlled trial at hospitals in nine low-income and middle-income countries (Brazil, China, India, Mexico, Nigeria, Pakistan, Peru, Sri Lanka, and Viet Nam) and one high-income country (Chile). Hospitals were eligible if they had no or inconsistent relevant, disease-specific protocols, and were willing to implement the care bundle to consecutive patients (aged ≥18 years) with imaging-confirmed spontaneous intracerebral haemorrhage presenting within 6 h of the onset of symptoms, had a local champion, and could provide the required study data. Hospitals were centrally randomly allocated using permuted blocks to three sequences of implementation, stratified by country and the projected number of patients to be recruited over the 12 months of the study period. These sequences had four periods that dictated the order in which the hospitals were to switch from the control usual care procedure to the intervention implementation of the care bundle procedure to different clusters of patients in a stepped manner. To avoid contamination, details of the intervention, sequence, and allocation periods were concealed from sites until they had completed the usual care control periods. The care bundle protocol included the early intensive lowering of systolic blood pressure (target <140 mm Hg), strict glucose control (target 6·1-7·8 mmol/L in those without diabetes and 7·8-10·0 mmol/L in those with diabetes), antipyrexia treatment (target body temperature ≤37·5°C), and rapid reversal of warfarin-related anticoagulation (target international normalised ratio <1·5) within 1 h of treatment, in patients where these variables were abnormal. Analyses were performed according to a modified intention-to-treat population with available outcome data (ie, excluding sites that withdrew during the study). The primary outcome was functional recovery, measured with the modified Rankin scale (mRS; range 0 [no symptoms] to 6 [death]) at 6 months by masked research staff, analysed using proportional ordinal logistic regression to assess the distribution in scores on the mRS, with adjustments for cluster (hospital site), group assignment of cluster per period, and time (6-month periods from Dec 12, 2017). This trial is registered at Clinicaltrials.gov (NCT03209258) and the Chinese Clinical Trial Registry (ChiCTR-IOC-17011787) and is completed.

FINDINGS

Between May 27, 2017, and July 8, 2021, 206 hospitals were assessed for eligibility, of which 144 hospitals in ten countries agreed to join and were randomly assigned in the trial, but 22 hospitals withdrew before starting to enrol patients and another hospital was withdrawn and their data on enrolled patients was deleted because regulatory approval was not obtained. Between Dec 12, 2017, and Dec 31, 2021, 10 857 patients were screened but 3821 were excluded. Overall, the modified intention-to-treat population included 7036 patients enrolled at 121 hospitals, with 3221 assigned to the care bundle group and 3815 to the usual care group, with primary outcome data available in 2892 patients in the care bundle group and 3363 patients in the usual care group. The likelihood of a poor functional outcome was lower in the care bundle group (common odds ratio 0·86; 95% CI 0·76-0·97; p=0·015). The favourable shift in mRS scores in the care bundle group was generally consistent across a range of sensitivity analyses that included additional adjustments for country and patient variables (0·84; 0·73-0·97; p=0·017), and with different approaches to the use of multiple imputations for missing data. Patients in the care bundle group had fewer serious adverse events than those in the usual care group (16·0% vs 20·1%; p=0·0098).

INTERPRETATION

Implementation of a care bundle protocol for intensive blood pressure lowering and other management algorithms for physiological control within several hours of the onset of symptoms resulted in improved functional outcome for patients with acute intracerebral haemorrhage. Hospitals should incorporate this approach into clinical practice as part of active management for this serious condition.

FUNDING

Joint Global Health Trials scheme from the Department of Health and Social Care, the Foreign, Commonwealth & Development Office, and the Medical Research Council and Wellcome Trust; West China Hospital; the National Health and Medical Research Council of Australia; Sichuan Credit Pharmaceutic and Takeda China.

The effectiveness and health-economic evaluation of "Partner in Balance," a blended self-management program for early-stage dementia caregivers: study protocol for a cluster-randomized controlled trial

BACKGROUND

Informal caregivers of people with dementia are crucial in dementia care. However, they are insufficiently supported and report caregiver burdens, which urges the need for cost-effective interventions aimed at supporting caregivers. This paper presents the design of a study evaluating the effectiveness, cost-effectiveness, and cost-utility of a blended self-management program for early-stage dementia caregivers.

METHODS/DESIGN

A pragmatic, cluster randomized controlled trial with a shared control group will be conducted. Participants will be informal caregivers of people with early-stage dementia and will be recruited by local care professionals. Randomization will be carried out at the level of the care professional level in a ratio of 35% to 65% (control arm vs. intervention arm). Participants in the control arm will receive care as usual and the intervention arm will receive the blended care self-management program "Partner in Balance" within a usual care setting in the Netherlands. Data will be collected at baseline and at 3-, 6-, 12-, and 24-month follow-ups. The primary outcome for effectiveness (part 1) is care management self-efficacy. For the health-economic evaluation (part 2) total care costs and the quality of life for individuals with dementia (cost-effectiveness) and quality-adjusted life years (cost-utility) will be the base case analysis. Secondary outcomes (parts 1 and 2) will include depression, anxiety, perceived informal caregiving stress, service-use self-efficacy, quality of life, caregivers' gain, and perseverance time. A process evaluation (part 3) will investigate the internal and external validity of the intervention.

DISCUSSION

In this trial, we plan to evaluate the effectiveness, cost-effectiveness, and cost-utility of "Partner in Balance" among informal caregivers of people with dementia. We expect to find a significant increase in care management self-efficacy, and the program to be cost-effective, and provide valuable insights to stakeholders of "Partner in Balance."

TRIAL REGISTRATION

ClinicalTrials.gov, NCT05450146. Registered on 4 November 2022.

The Emergency nurse Protocols Initiating Care-Sydney Triage to Admission Risk Tool (EPIC-START) trial: protocol for a stepped wedge implementation trial

INTRODUCTION

Emergency department (ED) overcrowding is a global problem and a threat to the quality and safety of emergency care. Providing timely and safe emergency care therein is challenging. To address this in New South Wales (NSW), Australia, the Emergency nurse Protocol Initiating Care-Sydney Triage to Admission Risk Tool (EPIC-START) was developed. EPIC-START is a model of care incorporating EPIC protocols, the START patient admission prediction tool, and a clinical deterioration tool to support ED flow, timely care, and patient safety. The aim of this study is to evaluate the impact of EPIC-START implementation across 30 EDs on patient, implementation, and health service outcomes.

METHODS AND ANALYSIS

This study protocol adopts an effectiveness-implementation hybrid design (Med Care 50: 217-226, 2012) and uses a stepped-wedge cluster randomised control trial of EPIC-START, including uptake and sustainability, within 30 EDs across four NSW local health districts spanning rural, regional, and metropolitan settings. Each cluster will be randomised independently of the research team to 1 of 4 dates until all EDs have been exposed to the intervention. Quantitative and qualitative evaluations will be conducted on data from medical records and routinely collected data, and patient, nursing, and medical staff pre- and post-surveys.

ETHICS AND DISSEMINATION

Ethical approval for the research was received from the Sydney Local Health District Research Ethics Committee (Reference Number 2022/ETH01940) on 14 December 2022.

TRIAL REGISTRATION

Australian and New Zealand Clinical trial, ACTRN12622001480774p. Registered on 27 October 2022.

Pay-it-forward gonorrhea and chlamydia testing among men who have sex with men and male STD patients in China: the PIONEER pragmatic, cluster randomized controlled trial protocol

BACKGROUND

Gonorrhea and chlamydia are the most common sexually transmitted diseases (STDs) among men who have sex with men (MSM) in China. Previous studies have shown pay-it-forward (PIF) interventions to be associated with a substantial increase in gonorrhea and chlamydia test uptake compared to standard-of-care. We propose a 'pay-it-forward' gonorrhea and chlamydia testing randomized controlled trial (PIONEER). The trial would evaluate the effectiveness of two pay-it-forward strategies in promoting testing uptake compared to the standard of care (in which men pay for their tests out-of-pocket) among MSM and male STD patients in China.

METHODS

PIONEER will be a three-armed, pragmatic cluster randomized controlled trial (RCT), conducted across 12 clinics (six MSM-led and six public STD clinics) to compare the effectiveness of three implementation strategies. Each facility will be randomized to a standard pay-it-forward intervention of gonorrhea/ chlamydia testing with minimal encouragement for testing, a community-engaged pay-it-forward arm, or a control arm where men pay for their tests out-of-pockets. The primary outcome will be dual gonorrhea/chlamydia test uptake. Secondary outcomes will include syphilis testing, amount donated in pay-it-forward, number of positive gonorrhea and chlamydia tests, and measures of antimicrobial resistance. A sequential transformative mixed methods design will be used to evaluate the implementation process in type 2 effectiveness-implementation hybrid design. Data sources will include survey on acceptability, and feelings and attitudes towards the interventions among participants; testing and treatment uptake data from clinic records, WeChat records, and qualitative data to gain insights into men's perceptions and attitudes towards the pay-it-forward, mechanisms driving uptake, and donating behaviors. Implementers and organizers will be interviewed about fidelity and adherence to protocol, sustainability of pay-it-forward intervention, and barriers and facilitators of implementing the intervention.

DISCUSSION

PIONEER will substantially increase gonorrhea/chlamydia testing among MSM in China, providing an innovative and new financial mechanism to sustain STD screening among sexual minorities in low- and middle-income countries. This study will answer compelling scientific questions about how best to implement pay-it-forward and the individual and organizational characteristics that moderate it.

TRIAL REGISTRATION

The study with identification number NCT05723263 has been registered on clinicaltrials.gov/.

Evaluation of the prehospital use of a Valsalva assist device in the emergency treatment of supraventricular tachycardia (EVADE SVT): study protocol for a stepped wedge cluster randomised controlled trial

INTRODUCTION

Patients with episodes of supraventricular tachycardia (SVT), a common heart arrhythmia, are often attended by ambulance services. International guidelines advocate treatment with the Valsalva manoeuvre (VM), but this simple physical treatment has a low success rate, with most patients requiring conveyance to hospital. The Valsalva Assist Device (VAD) is a simple device that might help practitioners and patients perform a more effective VM and reduce the need for patients to be taken to hospital.

METHODS AND ANALYSIS

This stepped wedge cluster randomised controlled trial, conducted within a UK ambulance service, compares the current standard VM with a VAD-delivered VM in stable adult patients presenting to the ambulance service with SVT. The primary outcome is conveyance to hospital; secondary outcomes measures include cardioversion rates, duration of ambulance care and number of subsequent episodes of SVT requiring ambulance service care. We plan to recruit approximately 800 patients, to have 90% power to detect an absolute reduction in conveyance rate of 10% (from 90% to 80%) between the standard VM (control) and VAD-delivered VM (intervention). Such a reduction in conveyance would benefit patients, the ambulance service and receiving emergency departments. It is estimated potential savings would pay for devices for the entire ambulance trust within 7 months.

ETHICS AND DISSEMINATION

The study has been approved by the Oxford Research Ethics Committee (reference 22/SC/0032). Dissemination will be through peer-reviewed journal publication, presentation at national and international conferences and by the Arrhythmia Alliance, a patient support charity.

TRIAL REGISTRATION NUMBER

ISRCTN16145266.

Atmiyata, a community champion led psychosocial intervention for common mental disorders: A stepped wedge cluster randomized controlled trial in rural Gujarat, India

BACKGROUND

While effective lay-health worker models for mental health care have been demonstrated through efficacy trials, there is limited evidence of the effectiveness of these models implemented in rural LMIC settings.

AIM

To evaluate the impact of a volunteer community-led intervention on reduction in depression and anxiety symptoms and improvement in functioning, and social participation among people living in rural Gujarat, India.

METHODS

Stepped-wedge cluster randomized controlled trial was used to assess the effectiveness of delivery of psychosocial intervention across 645 villages in Mehsana district of Gujarat, India between April 2017 and August 2019. The primary outcome was an improvement in depression and/or anxiety symptoms assessed using GHQ-12 at 3-month follow-up. Secondary outcomes were improvement in (a) depression and anxiety (Patient Health Questionnaire, (PHQ-9), Generalized Anxiety Disorder (GAD-7) & Self-Reporting Questionnaire-20 (SRQ-20); b) quality of life (EQ- 5D); c) functioning (WHO-DAS-12), and social participation (Social Participation Scale SPS). Generalized linear mixed-effects models were used to assess the independent effect of the intervention.

RESULTS

Out of a total of 1191 trial participants (608- intervention & 583-control), 1014 (85%) completed 3-month follow-up. In an adjusted analysis, participants in the intervention condition showed significant recovery from symptoms of depression or anxiety (OR 2.2; 95% CI 1.2 to 4.6; p<0.05) at the end of 3-months, with effects sustained at 8-month follow-up (OR 3.0; 95% CI 1.6 to 5.9). Intervention participants had improved scores on the PHQ-9 (Adjusted mean difference (AMD) -1.8; 95%CI -3.0 to -0.6), and SRQ-20 (AMD -1.7; 95%CI -2.7 to -0.6), at 3-months and PHQ-9, GAD-7, SRQ-20, EQ-5D and WHO-DAS at 8 months follow-up.

CONCLUSION

Findings suggest that Atmiyata had a significant effect on recovery from symptoms of depression and anxiety with sustained effects at 8-month follow-up.

TRIAL REGISTRATION

Trial registration details. The trial was registered prospectively with the "Clinical Trial Registry in India" (registry number: CTRI/2017/03/008139).

Optimal allocation to treatment sequences in individually randomized stepped-wedge designs with attrition

BACKGROUND/AIMS

The stepped-wedge design has been extensively studied in the setting of the cluster randomized trial, but less so for the individually randomized trial. This article derives the optimal allocation of individuals to treatment sequences. The focus is on designs where all individuals start in the control condition and at the beginning of each time period some of them cross over to the intervention, so that at the end of the trial all of them receive the intervention.

METHODS

The statistical model that takes into account the nesting of repeated measurements within subjects is presented. It is also shown how possible attrition is taken into account. The effect of the intervention is assumed to be sustained so that it does not change after the treatment switch. An exponential decay correlation structure is assumed, implying that the correlation between any two time point decreases with the time lag. Matrix algebra is used to derive the relation between the allocation of units to treatment sequences and the variance of the treatment effect estimator. The optimal allocation is the one that results in smallest variance.

RESULTS

Results are presented for three to six treatment sequences. It is shown that the optimal allocation highly depends on the correlation parameter ρ and attrition rate r between any two adjacent time points. The uniform allocation, where each treatment sequence has the same number of individuals, is often not the most efficient. For 0 . 1 ≤ ρ ≤ 0 . 9 and r = 0 , 0 . 05 , 0 . 2 , its efficiency relative to the optimal allocation is at least 0.8. It is furthermore shown how a constrained optimal allocation can be derived in case the optimal allocation is not feasible from a practical point of view.

CONCLUSION

This article provides the methodology for designing individually randomized stepped-wedge designs, taking into account the possibility of attrition. As such it helps researchers to plan their trial in an efficient way. To use the methodology, prior estimates of the degree of attrition and intraclass correlation coefficient are needed. It is advocated that researchers clearly report the estimates of these quantities to help facilitate planning future trials.

Effects of Implementation of a Supervised Walking Program in Veterans Affairs Hospitals : A Stepped-Wedge, Cluster Randomized Trial

BACKGROUND

In trials, hospital walking programs have been shown to improve functional ability after discharge, but little evidence exists about their effectiveness under routine practice conditions.

OBJECTIVE

To evaluate the effect of implementation of a supervised walking program known as STRIDE (AssiSTed EaRly MobIlity for HospitalizeD VEterans) on discharge to a skilled-nursing facility (SNF), length of stay (LOS), and inpatient falls.

DESIGN

Stepped-wedge, cluster randomized trial. (ClinicalTrials.gov: NCT03300336).

SETTING

8 Veterans Affairs hospitals from 20 August 2017 to 19 August 2019.

PATIENTS

Analyses included hospitalizations involving patients aged 60 years or older who were community dwelling and admitted for 2 or more days to a participating medicine ward.

INTERVENTION

Hospitals were randomly assigned in 2 stratified blocks to a launch date for STRIDE. All hospitals received implementation support according to the Replicating Effective Programs framework.

MEASUREMENTS

The prespecified primary outcomes were discharge to a SNF and hospital LOS, and having 1 or more inpatient falls was exploratory. Generalized linear mixed models were fit to account for clustering of patients within hospitals and included patient-level covariates.

RESULTS

Patients in pre-STRIDE time periods (n = 6722) were similar to post-STRIDE time periods (n = 6141). The proportion of patients with any documented walk during a potentially eligible hospitalization ranged from 0.6% to 22.7% per hospital. The estimated rates of discharge to a SNF were 13% pre-STRIDE and 8% post-STRIDE. In adjusted models, odds of discharge to a SNF were lower among eligible patients hospitalized in post-STRIDE time periods (odds ratio [OR], 0.6 [95% CI, 0.5 to 0.8]) compared with pre-STRIDE. Findings were robust to sensitivity analyses. There were no differences in LOS (rate ratio, 1.0 [CI, 0.9 to 1.1]) or having an inpatient fall (OR, 0.8 [CI, 0.5 to 1.1]).

LIMITATION

Direct program reach was low.

CONCLUSION

Although the reach was limited and variable, hospitalizations occurring during the STRIDE hospital walking program implementation period had lower odds of discharge to a SNF, with no change in hospital LOS or inpatient falls.

PRIMARY FUNDING SOURCE

U.S. Department of Veterans Affairs Quality Enhancement Research Initiative (Optimizing Function and Independence QUERI).

Community paramedicine in Central Oregon: A promising model to reduce non-urgent emergency department utilization among medically complex Medicaid beneficiaries

Background

Community paramedicine has emerged as a promising model to redirect persons with nonmedically emergent conditions to more appropriate and less expensive community-based health care settings. Outreach through community paramedicine to patients with a history of high hospital emergency department (ED) use and chronic health conditions has been found to reduce ED use. This study examined the effect of community paramedicine implemented in 2 rural counties in reducing nonemergent ED use among a sample of Medicaid beneficiaries with complex medical conditions and a history of high ED utilization.

Methods

A cluster randomized trial approach with a stepped wedge design was used to test the effect of the community paramedicine intervention. ED utilization for non-urgent care was measured by emergency medicine ED visits and avoidable ED visits.

Results

The community paramedicine intervention reduced ED utilization among a sample of 102 medically complex Medicaid beneficiaries with a history of high ED utilization. In the unadjusted models, emergency medical ED visits decreased by 13.9% (incidence rate ratio [IRR], 0.86; 95% confidence interval [CI], 0.76-0.98) or 6.1 visits saved for every 100 people. Avoidable emergency department visits decreased by 38.9% (IRR, 0.61; 95% CI, 0.44-0.84) or 2.3 visits saved for every 100 people.

Conclusion

Our results suggest community paramedicine is a promising model to achieve a reduction in ED utilization among medically complex patients by managing complex health conditions in a home-based setting.

Strong Mind, Strong Body: The Promise of Mind-Body Interventions to Address Growing Mental Health Needs Among Youth

As the prevalence of childhood and adolescent anxiety, depression, and other mental health concerns continues to rise, there has been an unprecedented increase in support of mind-body practices like yoga, dance, meditation, mindfulness, aerobic exercise, and more-in part driven by the mental health burden imposed by the COVID-19 pandemic. While a growing body of evidence supports the safety and effectiveness of mind-body approaches, gaps in funding for and empirical research on mechanistic underpinnings, methodology development to assess multi-component therapeutic practices, dissemination and implementation, and diversity in researchers, practitioners, and recipients remain. As a consequence, the neurobiological impacts of mind-body techniques are not well understood nor broadly accepted as standard forms of care by clinicians and insurers-often being considered as 'alternative' rather than 'complementary' or 'integrative'. In this commentary, we summarize work from our labs and others highlighting the promise of mind-body approaches for improving mental health in youth, in line with the National Institute of Mental Health's strategic plan to address health disparities. We offer a potential framework for implementation and research-the Expressive Therapies Continuum. We also propose solutions to key research and policy gaps, that by could have positive public health impacts for those who are struggling and to prevent emergence of psychiatric illness, especially in developing youth.

Pragmatic multicentre stepped-wedge cluster randomised trial to investigate the effectiveness of community-based falls prevention programme for older adults with falls risk in Singapore: a protocol paper

INTRODUCTION

Falls are an important public health issue with consequences that include injuries, quality of life reduction and high healthcare costs. Studies show that falls prevention strategies are effective in reducing falls rate among community-dwelling older adults. However, the evaluation for effectiveness was usually done in a controlled setting with homogeneous population, and thus may not be generalisable to a wider population. This study aims to evaluate the impact of community falls prevention programmes with group-based strength and balance exercises, on falls risk and health outcomes for older adults with falls risk in Singapore.

METHODS AND ANALYSIS

This is a pragmatic closed cohort stepped-wedge cluster randomised trial design study, which involves sequential crossover of clusters from the waitlist control condition to the intervention condition, with the sequence of crossover randomly determined. The intervention will be sequentially rolled out to 12 clusters (a minimum of 5 participants/cluster), over 6 time periods with 8-week intervals in Central and North regions of Singapore. The primary analysis will be conducted under the intention-to-treat principle. A general linear mixed model or generalised estimating equation analysis appropriate for a multilevel longitudinal study incorporating an appropriate error distribution and link function will be used. Markov model will be developed to estimate the incremental cost per quality-adjusted life years and incremental cost per fall prevented from the implementation of falls prevention strategies from a societal perspective. Conditional on there being clinically relevant differences in short-term outcomes, we will implement simulation modelling to project the long-term divergence in trajectories for outcomes and costs using the Markov model.

ETHICS AND DISSEMINATION

Ethics approval has been obtained. Results will be disseminated in publications and other relevant platforms.

TRIAL REGISTRATION NUMBER

NCT04788251.

Study protocol: Type III hybrid effectiveness-implementation study implementing Age-Friendly evidence-based practices in the VA to improve outcomes in older adults

BACKGROUND

Unmet care needs among older adults accelerate cognitive and functional decline and increase medical harms, leading to poorer quality of life, more frequent hospitalizations, and premature nursing home admission. The Department of Veterans Affairs (VA) is invested in becoming an "Age-Friendly Health System" to better address four tenets associated with reduced harm and improved outcomes among the 4 million Veterans aged 65 and over receiving VA care. These four tenets focus on "4Ms" that are fundamental to the care of older adults, including (1) what Matters (ensuring that care is consistent with each person's goals and preferences); (2) Medications (only using necessary medications and ensuring that they do not interfere with what matters, mobility, or mentation); (3) Mentation (preventing, identifying, treating, and managing dementia, depression, and delirium); and (4) Mobility (promoting safe movement to maintain function and independence). The Safer Aging through Geriatrics-Informed Evidence-Based Practices (SAGE) Quality Enhancement Research Initiative (QUERI) seeks to implement four evidence-based practices (EBPs) that have shown efficacy in addressing these core tenets of an "Age-Friendly Health System," leading to reduced harm and improved outcomes in older adults.

METHODS

We will implement four EBPs in 9 VA medical centers and associated outpatient clinics using a type III hybrid effectiveness-implementation stepped-wedge trial design. We selected four EBPs that align with Age-Friendly Health System principles: Surgical Pause, EMPOWER (Eliminating Medications Through Patient Ownership of End Results), TAP (Tailored Activities Program), and CAPABLE (Community Aging in Place - Advancing Better Living for Elders). Guided by the Pragmatic Robust Implementation and Sustainability Model (PRISM), we are comparing implementation as usual vs. active facilitation. Reach is our primary implementation outcome, while "facility-free days" is our primary effectiveness outcome across evidence-based practice interventions.

DISCUSSION

To our knowledge, this is the first large-scale randomized effort to implement "Age-Friendly" aligned evidence-based practices. Understanding the barriers and facilitators to implementing these evidence-based practices is essential to successfully help shift current healthcare systems to become Age-Friendly. Effective implementation of this project will improve the care and outcomes of older Veterans and help them age safely within their communities.

TRIAL REGISTRATION

Registered 05 May 2021, at ISRCTN #60,657,985.

REPORTING GUIDELINES

Standards for Reporting Implementation Studies (see attached).

POWER Up-Improving pre-exposure prophylaxis (PrEP) uptake among Black cisgender women in the Southern United States: Protocol for a stepped-wedge cluster randomized trial (SW-CRT)

BACKGROUND

HIV disproportionately affects Black/African American cisgender women (hereafter women) in the United States. Despite its proven effectiveness, pre-exposure prophylaxis (PrEP) for HIV prevention remains vastly under-prescribed to women based on their need. Increasing PrEP uptake and persistence among women is crucial to reducing HIV transmission; however, there have been few studies designed specifically for women. This article describes the study protocol used to assess the feasibility, acceptability, and effectiveness of implementation strategies to improve PrEP uptake and persistence among Black women in the Midwest and South.

METHODS

PrEP Optimization among Women to Enhance Retention and Uptake (POWER Up) is an evidence-based, woman-focused set of five implementation science strategies that addresses barriers of PrEP utilization at the provider, patient, and clinic levels. POWER Up includes 1) routine PrEP education for patients, 2) standardized provider training, 3) electronic medical record (EMR) optimization, 4) PrEP navigation, and 5) PrEP clinical champions. These strategies will be adapted to specific clinics for implementation, tested via a stepped-wedge trial, and, if effective, packaged for further dissemination.

DISCUSSION

We will utilize a stepped-wedge cluster randomized trial (SW-CRT) to measure change in PrEP utilization across diverse geographic areas. Preparation for adapting and implementing the bundle of strategies is needed to determine how to tailor them to specific clinics. Implementation challenges will include adapting strategies with the available resources at each site, maintaining stakeholder involvement and staff buy-in, adjusting the study protocol and planned procedures as needed, and ensuring minimal crossover. Additionally, strengths and limitations of each strategy must be examined before, during, and after the adaptation and implementation processes. Finally, the implementation outcomes of the strategies must be evaluated to determine the real-world success of the strategies. This study is an important step toward addressing the inequity in PrEP service delivery and increasing PrEP utilization among Black women in the U.S.

TRUsted rEsidents and Housing Assistance to decrease Violence Exposure in New Haven (TRUE HAVEN): A strengths-based and community-driven stepped-wedge intervention to reduce gun violence

Background We describe the rationale and study design for " TRU sted r Esidents and H ousing A ssistance to decrease V iolence E xposure in N ew Haven (TRUE HAVEN)," a prospective type 1 hybrid effectiveness/implementation study of a multi-level intervention using a stepped wedge design. TRUE HAVEN aims to lower rates of community gun violence by fostering the stability, wealth, and well-being of individuals and families directly impacted by incarceration through the provision of stable housing and by breaking the cycle of trauma. Design: TRUE HAVEN is a multi-level intervention with three primary components: financial education paired with housing support (individual level), trauma-informed counseling (neighborhood level), and policy changes to address structural racism (city/state level). Six neighborhoods with among the highest rates of gun violence in New Haven, Connecticut, will receive the individual and neighborhood level intervention components sequentially beginning at staggered 6-month steps. Residents of these neighborhoods will be eligible to participate in the housing stability and financial education component if they were recently incarcerated or are family members of currently incarcerated people; participants will receive intense financial education and follow-up for six months and be eligible for special down payment and rental assistance programs. In addition, trusted community members and organization leaders within each target neighborhood will participate in trauma-informed care training sessions to then be able to recognize when their peers are suffering from trauma symptoms, to support these affected peers, and to destigmatize accessing professional mental health services and connect them to these services when needed. Finally, a multi-stakeholder coalition will be convened to address policies that act as barriers to housing stability or accessing mental healthcare. Interventions will be delivered through existing partnerships with community-based organizations and networks. The primary outcome is neighborhood rate of incident gun violence. To inform future implementation and optimize the intervention package as the study progresses, we will use the Learn As You Go approach to optimize and assess the effectiveness of the intervention package on the primary study outcome. Discussion Results from this protocol will yield novel evidence for whether and how addressing structural racism citywide leads to a reduction in gun violence. Trial registration ClinicalTrials.gov Identifier: NCT05723614. Registration date: February 01, 2023.

Evaluation of a community-based integrated care model (CIE) for frail older people in rural Foshan, China: study protocol for a stepped-wedge cluster randomized controlled trial {1}

BACKGROUND

While community-based eldercare has proven to be effective in qualitative studies, there is limited evidence on the effectiveness of this geriatric care model in rural communities where caring for older people is traditionally the responsibility of family members, but a formal long-term care was recently introduced in China. CIE is a rural community-embedded intervention using multidisciplinary team, to provide evidenced-based integrated care services for frail older people including social care services and allied primary healthcare and community-based rehabilitation services.

METHODS

CIE is a prospective stepped-wedge cluster randomized trial conducted at 5 community eldercare centers in rural China. The multifaceted CIE intervention, guided by chronic care model and integrated care model, consists of five components: comprehensive geriatric assessment, individualized care planning, community-based rehabilitation, interdisciplinary case management, and care coordination. The intervention is rolled out in a staggered manner in these clusters of centers at an interval of 1 month. The primary outcomes include functional status, quality of life, and social support. Process evaluation will also be conducted. Generalized linear mixed model is employed for binary outcomes.

DISCUSSION

This study is expected to provide important new evidence on clinical effectiveness and implementation process of an integrated care model for frail older people. The CIE model is also unique as the first registered trial implementing a community-based eldercare model using multidisciplinary team to promote individualized social care services integrated with primary healthcare and community-based rehabilitation services for frail older people in rural China, where formal long-term care was recently introduced. TRIAL REGISTRATION {2A}: China Clinical Trials Register ( http://www.chictr.org.cn/historyversionpub.aspx?regno=ChiCTR2200060326 ). May 28th, 2022.

A scoping review described diversity in methods of randomization and reporting of baseline balance in stepped-wedge cluster randomized trials

OBJECTIVES

In stepped-wedge cluster randomized trials (SW-CRTs), clusters are randomized not to treatment and control arms but to sequences dictating the times of crossing from control to intervention conditions. Randomization is an essential feature of this design but application of standard methods to promote and report on balance at baseline is not straightforward. We aimed to describe current methods of randomization and reporting of balance at baseline in SW-CRTs.

STUDY DESIGN AND SETTING

We used electronic searches to identify primary reports of SW-CRTs published between 2016 and 2022.

RESULTS

Across 160 identified trials, the median number of clusters randomized was 11 (Q1-Q3: 8-18). Sixty-three (39%) used restricted randomization-most often stratification based on a single cluster-level covariate; 12 (19%) of these adjusted for the covariate(s) in the primary analysis. Overall, 50 (31%) and 134 (84%) reported on balance at baseline on cluster- and individual-level characteristics, respectively. Balance on individual-level characteristics was most often reported by condition in cross-sectional designs and by sequence in cohort designs. Authors reported baseline imbalances in 72 (45%) trials.

CONCLUSION

SW-CRTs often randomize a small number of clusters using unrestricted allocation. Investigators need guidance on appropriate methods of randomization and assessment and reporting of balance at baseline.

Surmounting Withdrawal to Initiate Fast Treatment with Naltrexone (SWIFT): A stepped wedge hybrid type 1 effectiveness-implementation study

BACKGROUND

Extended-release injectable naltrexone (XR-NTX) is an effective treatment for opioid use disorder (OUD), but initiation remains a barrier to implementation. Standard practice requires a 10- to 15-day inpatient admission prior to XR-NTX initiation and involves a methadone or buprenorphine taper followed by a 7- to 10-day washout, as recommended in the Prescribing Information for XR-NTX. A 5- to 7-day rapid induction approach was developed that utilizes low-dose oral naltrexone and non-opioid medications.

METHODS

The CTN-0097 Surmounting Withdrawal to Initiate Fast Treatment with Naltrexone (SWIFT) study was a hybrid type I effectiveness-implementation trial that compared the effectiveness of the standard procedure (SP) to the rapid procedure (RP) for XR-NTX initiation across six community inpatient addiction treatment units, and evaluated the implementation process. Sites were randomized to RP every 14 weeks in an optimized stepped wedge design. Participants (target recruitment = 450) received the procedure (SP or RP) that the site was implementing at time of admission. The hypothesis was RP will be non-inferior to SP on proportion of inpatients who receive XR-NTX, with a shorter admission time for RP. Superiority testing of RP was planned if the null hypothesis of inferiority of RP to SP was rejected.

DISCUSSION

If RP for XR-NTX initiation is shown to be effective, the shorter inpatient stay could make XR-NTX more feasible and have an important public health impact expanding access to OUD pharmacotherapy. Further, a better understanding of facilitators and barriers to RP implementation can help with future translatability and uptake to other community programs.

TRIAL REGISTRATION

NCT04762537 Registered February 21, 2021.

Alberta Collaborative Quality Improvement Strategies to Improve Outcomes of Moderate and Late Preterm Infants (ABC-QI) Trial: a protocol for a multicentre, stepped-wedge cluster randomized trial

BACKGROUND

Evidence-based Practice for Improving Quality (EPIQ) is a collaborative quality improvement method adopted by the Canadian Neonatal Network that led to decreased mortality and morbidity in very preterm neonates. The Alberta Collaborative Quality Improvement Strategies to Improve Outcomes of Moderate and Late Preterm Infants (ABC-QI) Trial aims to evaluate the impact of EPIQ collaborative quality improvement strategies in moderate and late preterm neonates in Alberta, Canada.

METHODS

In a 4-year, multicentre, stepped-wedge cluster randomized trial involving 12 neonatal intensive care units (NICUs), we will collect baseline data with the current practices in the first year (all NICUs in the control arm). Four NICUs will transition to the intervention arm at the end of each year, with 1 year of follow-up after the last group transitions to the intervention arm. Neonates born at 32 + 0 to 36 + 6 weeks' gestation with primary admission to NICUs or postpartum units will be included. The intervention includes implementation of respiratory and nutritional care bundles using EPIQ strategies, including quality improvement team building, quality improvement education, bundle implementation, quality improvement mentoring and collaborative networking. The primary outcome is length of hospital stay; secondary outcomes include health care costs and short-term clinical outcomes. Neonatal intensive care unit staff will complete a survey in the first year to assess quality improvement culture in each unit, and a sample will be interviewed 1 year after implementation in each unit to evaluate the implementation process.

INTERPRETATION

The ABC-QI Trial will assess whether collaborative quality improvement strategies affect length of stay in moderate and late preterm neonates. It will provide detailed population-based data to support future research, benchmarking and quality improvement.

TRIAL REGISTRATION

ClinicalTrials.gov, no. NCT05231200.

Impact evaluation of the TAMANI project to improve maternal and child health in Tanzania

BACKGROUND

The Tabora Maternal and Newborn Health Initiative project was a multicomponent intervention to improve maternal and newborn health in the Tabora region of Tanzania. Components included training healthcare providers and community health workers, infrastructure upgrades, and improvements to health management. This study aimed to examine the impact of trainings on four key outcomes: skilled birth attendance, antenatal care, respectful maternity care and patient-provider communication.

METHODS

Trainings were delivered sequentially at four time points between 2018 and 2019 in eight districts (two districts at a time). Cross-sectional surveys were administered to a random sample of households in all districts at baseline and after each training wave. Due to practical necessities, the original stepped wedge cluster randomised design of the evaluation was altered mid-programme. Therefore, a difference-in-differences for multiple groups in multiple periods was adopted to compare outcomes in treated districts to not yet treated districts. Risk differences were estimated for the overall average treatment effect on the treated and group/time dynamic effects.

RESULTS

Respondents reported 3895 deliveries over the course of the study. The intervention was associated with a 12.9 percentage point increase in skilled birth attendance (95% CI 0.4 to 25.4), which began to increase 4 months after the end of training in each district. There was little evidence of impact on antenatal care visits, respectful treatment during delivery and patient-provider communication.

CONCLUSION

Interventions to train local healthcare workers in basic and comprehensive emergency obstetric and newborn care increased skilled birth attendance but had limited impact on other pregnancy-related outcomes.

Implementation Support for a Social Risk Screening and Referral Process in Community Health Centers

Evidence is needed about how to effectively support health care providers in implementing screening for social risks (adverse social determinants of health) and providing related referrals meant to address identified social risks. This need is greatest in underresourced care settings. The authors tested whether an implementation support intervention (6 months of technical assistance and coaching study clinics through a five-step implementation process) improved adoption of social risk activities in community health centers (CHCs). Thirty-one CHC clinics were block-randomized to six wedges that occurred sequentially. Over the 45-month study period from March 2018 to December 2021, data were collected for 6 or more months preintervention, the 6-month intervention period, and 6 or more months postintervention. The authors calculated clinic-level monthly rates of social risk screening results that were entered at in-person encounters and rates of social risk-related referrals. Secondary analyses measured impacts on diabetes-related outcomes. Intervention impact was assessed by comparing clinic performance based on whether they had versus had not yet received the intervention in the preintervention period compared with the intervention and postintervention periods. In assessing the results, the authors note that five clinics withdrew from the study for various bandwidth-related reasons. Of the remaining 26, a total of 19 fully or partially completed all 5 implementation steps, and 7 fully or partially completed at least the first 3 steps. Social risk screening was 2.45 times (95% confidence interval [CI], 1.32-4.39) higher during the intervention period compared with the preintervention period; this impact was not sustained postintervention (rate ratio, 2.16; 95% CI, 0.64-7.27). No significant difference was seen in social risk referral rates during the intervention or postintervention periods. The intervention was associated with greater blood pressure control among patients with diabetes and lower rates of diabetes biomarker screening postintervention. All results must be interpreted considering that the Covid-19 pandemic began midway through the trial, which affected care delivery generally and patients at CHCs particularly. Finally, the study results show that adaptive implementation support was effective at temporarily increasing social risk screening. It is possible that the intervention did not adequately address barriers to sustained implementation or that 6 months was not long enough to cement this change. Underresourced clinics may struggle to participate in support activities over longer periods without adequate resources, even if lengthier support is needed. As policies start requiring documentation of social risk activities, safety-net clinics may be unable to meet these requirements without adequate financial and coaching/technical support.

Integrating Alcohol-Related Prevention and Treatment Into Primary Care: A Cluster Randomized Implementation Trial

Importance

Unhealthy alcohol use is common and affects morbidity and mortality but is often neglected in medical settings, despite guidelines for both prevention and treatment.

Objective

To test an implementation intervention to increase (1) population-based alcohol-related prevention with brief interventions and (2) treatment of alcohol use disorder (AUD) in primary care implemented with a broader program of behavioral health integration.

Design, Setting, and Participants

The Sustained Patient-Centered Alcohol-Related Care (SPARC) trial was a stepped-wedge cluster randomized implementation trial, including 22 primary care practices in an integrated health system in Washington state. Participants consisted of all adult patients (aged ≥18 years) with primary care visits from January 2015 to July 2018. Data were analyzed from August 2018 to March 2021.

Interventions

The implementation intervention included 3 strategies: practice facilitation; electronic health record decision support; and performance feedback. Practices were randomly assigned launch dates, which placed them in 1 of 7 waves and defined the start of the practice's intervention period.

Main Outcomes and Measures

Coprimary outcomes for prevention and AUD treatment were (1) the proportion of patients who had unhealthy alcohol use and brief intervention documented in the electronic health record (brief intervention) for prevention and (2) the proportion of patients who had newly diagnosed AUD and engaged in AUD treatment (AUD treatment engagement). Analyses compared monthly rates of primary and intermediate outcomes (eg, screening, diagnosis, treatment initiation) among all patients who visited primary care during usual care and intervention periods using mixed-effects regression.

Results

A total of 333 596 patients visited primary care (mean [SD] age, 48 [18] years; 193 583 [58%] female; 234 764 [70%] White individuals). The proportion with brief intervention was higher during SPARC intervention than usual care periods (57 vs 11 per 10 000 patients per month; P < .001). The proportion with AUD treatment engagement did not differ during intervention and usual care (1.4 vs 1.8 per 10 000 patients; P = .30). The intervention increased intermediate outcomes: screening (83.2% vs 20.8%; P < .001), new AUD diagnosis (33.8 vs 28.8 per 10 000; P = .003), and treatment initiation (7.8 vs 6.2 per 10 000; P = .04).

Conclusions and Relevance

In this stepped-wedge cluster randomized implementation trial, the SPARC intervention resulted in modest increases in prevention (brief intervention) but not AUD treatment engagement in primary care, despite important increases in screening, new diagnoses, and treatment initiation.

Trial Registration

ClinicalTrials.gov Identifier: NCT02675777.

Connect-Home transitional care from skilled nursing facilities to home: A stepped wedge, cluster randomized trial

BACKGROUND

Skilled nursing facility (SNF) patients and their caregivers who transition to home experience complications and frequently return to acute care. We tested the efficacy of the Connect-Home transitional care intervention on patient and caregiver preparedness for care at home, and other patient and caregiver-reported outcomes.

METHODS

We used a stepped wedge, cluster-randomized trial design to test the intervention against standard discharge planning (control). The setting was six SNFs and six home health offices in one agency. Participants were 327 dyads of patients discharged from SNF to home and their caregivers; 11.1% of dyads in the control condition and 81.2% in the intervention condition were enrolled after onset of COVID-19. Patients were 63.9% female and mean age was 76.5 years. Caregivers were 73.7% female and mean age was 59.5 years. The Connect-Home intervention includes tools, training, and technical assistance to deliver transitional care in SNFs and patients' homes. Primary outcomes measured at 7 days included patient and caregiver measures of preparedness for care at home, the Care Transitions Measure-15 (patient) and the Preparedness for Caregiving Scale (caregiver). Secondary outcomes measured at 30 and 60 days included the McGill Quality of Life Questionnaire, Life Space Assessment, Zarit Caregiver Burden Scale, Distress Thermometer, and self-reported number of patient days in the ED or hospital in 30 and 60 days following SNF discharge.

RESULTS

The intervention was not associated with improvement in patient or caregiver outcomes in the planned analyses. Post-hoc analyses that distinguished between pre- and post-pandemic effects suggest the intervention may be associated with increased patient preparedness for discharge and decreased number of acute care days.

CONCLUSIONS

Connect-Home transitional care did not improve outcomes in the planned statistical analysis. Post-hoc findings accounting for COVID-19 impact suggest SNF transitional care has potential to increase patient preparedness and decrease return to acute care.

Nutrition Effects of a Family-Centered Health Promotion Program for Mexican-Heritage Children in the Lower Rio Grande Valley of Texas

Systemic and social factors, like poverty and food insecurity, negatively influence fruit and vegetable (FV) intake and body mass index (BMI) among Latino/a children. Behavioral programs are needed to support children’s nutrition. This study examined program effects on FV intake and BMI outcomes for Mexican-heritage children (9–11 years). The program used a modified stepped-wedge design in the Lower Rio Grande Valley of Texas (2019 and 2020). Promotoras led experiential nutrition education sessions and collected height, weight, and instant skin carotenoid scores (biomarker for FV intake) at pre-test (baseline), post-test (6 weeks), and maintenance (3–4 months after post-test). Mean changes and group differences in skin carotenoid scores, BMI z-scores and percentiles were obtained from analyses of variance. Linear mixed-effects models were used to determine overall program effects. Mexican-heritage children were enrolled (n = 57 and 52.6% female). An overall decrease in skin carotenoid scores was observed at post-test (−15.1; 95% CI: −24.95, −5.33). While scores varied widely (range: 17–498), an increase of 14.8 ± 23.8 points occurred in one intervention group. Compared to the control period, greater reductions in BMI outcomes occurred during the program. These findings provide evidence for the use of strengths-based approaches in behavioral nutrition programs.

Accounting for complex intracluster correlations in longitudinal cluster randomized trials: a case study in malaria vector control

BACKGROUND

The effectiveness of malaria vector control interventions is often evaluated using cluster randomized trials (CRT) with outcomes assessed using repeated cross-sectional surveys. A key requirement for appropriate design and analysis of longitudinal CRTs is accounting for the intra-cluster correlation coefficient (ICC). In addition to exchangeable correlation (constant ICC over time), correlation structures proposed for longitudinal CRT are block exchangeable (allows a different within- and between-period ICC) and exponential decay (allows between-period ICC to decay exponentially). More flexible correlation structures are available in statistical software packages and, although not formally proposed for longitudinal CRTs, may offer some advantages. Our objectives were to empirically explore the impact of these correlation structures on treatment effect inferences, identify gaps in the methodological literature, and make practical recommendations.

METHODS

We obtained data from a parallel-arm CRT conducted in Tanzania to compare four different types of insecticide-treated bed-nets. Malaria prevalence was assessed in cross-sectional surveys of 45 households in each of 84 villages at baseline, 12-, 18- and 24-months post-randomization. We re-analyzed the data using mixed-effects logistic regression according to a prespecified analysis plan but under five different correlation structures as well as a robust variance estimator under exchangeable correlation and compared the estimated correlations and treatment effects. A proof-of-concept simulation was conducted to explore general conclusions.

RESULTS

The estimated correlation structures varied substantially across different models. The unstructured model was the best-fitting model based on information criteria. Although point estimates and confidence intervals for the treatment effect were similar, allowing for more flexible correlation structures led to different conclusions based on statistical significance. Use of robust variance estimators generally led to wider confidence intervals. Simulation results showed that under-specification can lead to coverage probabilities much lower than nominal levels, but over-specification is more likely to maintain nominal coverage.

CONCLUSION

More flexible correlation structures should not be ruled out in longitudinal CRTs. This may be particularly important in malaria trials where outcomes may fluctuate over time. In the absence of robust methods for selecting the best-fitting correlation structure, researchers should examine sensitivity of results to different assumptions about the ICC and consider robust variance estimators.

Impact of a multifaceted early mobility intervention for critically ill children - the PICU Up! trial: study protocol for a multicenter stepped-wedge cluster randomized controlled trial

BACKGROUND

Over 50% of all critically ill children develop preventable intensive care unit-acquired morbidity. Early and progressive mobility is associated with improved outcomes in critically ill adults including shortened duration of mechanical ventilation and improved muscle strength. However, the clinical effectiveness of early and progressive mobility in the pediatric intensive care unit has never been rigorously studied. The objective of the study is to evaluate if the PICU Up! intervention, delivered in real-world conditions, decreases mechanical ventilation duration (primary outcome) and improves delirium and functional status compared to usual care in critically ill children. Additionally, the study aims to identify factors associated with reliable PICU Up! delivery.

METHODS

The PICU Up! trial is a stepped-wedge, cluster-randomized trial of a pragmatic, interprofessional, and multifaceted early mobility intervention (PICU Up!) conducted in 10 pediatric intensive care units (PICUs). The trial's primary outcome is days alive free of mechanical ventilation (through day 21). Secondary outcomes include days alive and delirium- and coma-free (ADCF), days alive and coma-free (ACF), days alive, as well as functional status at the earlier of PICU discharge or day 21. Over a 2-year period, data will be collected on 1,440 PICU patients. The study includes an embedded process evaluation to identify factors associated with reliable PICU Up! delivery.

DISCUSSION

This study will examine whether a multifaceted strategy to optimize early mobility affects the duration of mechanical ventilation, delirium incidence, and functional outcomes in critically ill children. This study will provide new and important evidence on ways to optimize short and long-term outcomes for pediatric patients.

TRIAL REGISTRATION

ClinicalTrials.gov NCT04989790. Registered on August 4, 2021.

Effect of systematic tuberculosis detection on mortality in young children with severe pneumonia in countries with high incidence of tuberculosis: a stepped-wedge cluster-randomised trial

BACKGROUND

Tuberculosis diagnosis might be delayed or missed in children with severe pneumonia because this diagnosis is usually only considered in cases of prolonged symptoms or antibiotic failure. Systematic tuberculosis detection at hospital admission could increase case detection and reduce mortality.

METHODS

We did a stepped-wedge cluster-randomised trial in 16 hospitals from six countries (Cambodia, Cameroon, Côte d'Ivoire, Mozambique, Uganda, and Zambia) with high incidence of tuberculosis. Children younger than 5 years with WHO-defined severe pneumonia received either the standard of care (control group) or standard of care plus Xpert MTB/RIF Ultra (Xpert Ultra; Cepheid, Sunnyvale, CA, USA) on nasopharyngeal aspirate and stool samples (intervention group). Clusters (hospitals) were progressively switched from control to intervention at 5-week intervals, using a computer-generated random sequence, stratified on incidence rate of tuberculosis at country level, and masked to teams until 5 weeks before switch. We assessed the effect of the intervention on primary (12-week all-cause mortality) and secondary (including tuberculosis diagnosis) outcomes, using generalised linear mixed models. The primary analysis was by intention to treat. We described outcomes in children with severe acute malnutrition in a post hoc analysis. This study is registered with ClinicalTrials.gov (NCT03831906) and the Pan African Clinical Trial Registry (PACTR202101615120643).

FINDINGS

From March 21, 2019, to March 30, 2021, we enrolled 1401 children in the control group and 1169 children in the intervention group. In the intervention group, 1140 (97·5%) children had nasopharyngeal aspirates and 942 (80·6%) had their stool collected; 24 (2·1%) had positive Xpert Ultra. At 12 weeks, 110 (7·9%) children in the control group and 91 (7·8%) children in the intervention group had died (adjusted odds ratio [OR] 0·986, 95% CI 0·597-1·630, p=0·957), and 74 (5·3%) children in the control group and 88 (7·5%) children in the intervention group had tuberculosis diagnosed (adjusted OR 1·238, 95% CI 0·696-2·202, p=0·467). In children with severe acute malnutrition, 57 (23·8%) of 240 children in the control group and 53 (17·8%) of 297 children in the intervention group died, and 36 (15·0%) of 240 children in the control group and 56 (18·9%) of 297 children in the intervention group were diagnosed with tuberculosis. The main adverse events associated with nasopharyngeal aspirates were samples with blood in 312 (27·3%) of 1147 children with nasopharyngeal aspirates attempted, dyspnoea or SpO₂ less than 95% in 134 (11·4%) of children, and transient respiratory distress or SpO₂ less than 90% in 59 (5·2%) children. There was no serious adverse event related to nasopharyngeal aspirates reported during the trial.

INTERPRETATION

Systematic molecular tuberculosis detection at hospital admission did not reduce mortality in children with severe pneumonia. High treatment and microbiological confirmation rates support more systematic use of Xpert Ultra in this group, notably in children with severe acute malnutrition.

FUNDING

Unitaid and L'Initiative.

TRANSLATION

For the French translation of the abstract see Supplementary Materials section.

Association of Standardized Radiology Reporting and Management of Abdominal CT and MRI With Diagnosis of Pancreatic Cancer

BACKGROUND & AIMS

Follow-up of abdominal computed tomography (CT) and magnetic resonance imaging (MRI) findings suspicious for pancreatic cancer may be delayed if documentation is unclear. We evaluated whether standardized reporting and follow-up of imaging results reduced time to diagnosis of pancreatic cancer.

METHODS

We used a quasi-experimental stepped-wedge cluster design to evaluate the effectiveness of newly implemented radiology reporting system. The system standardizes the reporting of CT and MRI reports using hashtags that classify pancreatic findings. The system also automates referral of patients with findings suspicious for pancreatic cancer to a multidisciplinary care team for rapid review and follow-up. The study examined 318,331 patients who underwent CT or MRI that included the abdomen from 2016 through 2019 who had not had an eligible CT or MRI in the preceding 24 months. We evaluated the association of the intervention with incidence of pancreatic cancer within 60 days and 120 days after imaging.

RESULTS

Thirty-eight percent of patients received the intervention, and 1523 patients (0.48%) were diagnosed with pancreatic cancer. In multivariable analysis accounting for age, race/ethnicity, sex, Charlson comorbidity, history of cancer, diabetes, and 4-month calendar period, the intervention was associated with nearly 50% greater odds of diagnosing pancreatic cancer within 60 days (adjusted odds ratio, 1.47; 95% confidence interval, 1.05-2.06) and 120 days (adjusted odds ratio, 1.46; 95% confidence interval, 1.04-2.06).

CONCLUSIONS

In this large quasi-experimental, community-based observational study, implementing standardized reporting of abdominal CT and MRI reports with clinical navigation was effective for increasing the detection and diagnosis of pancreatic cancer.

Sample size considerations for stepped wedge designs with subclusters

The stepped wedge cluster randomized trial (SW-CRT) is an increasingly popular design for evaluating health service delivery or policy interventions. An essential consideration of this design is the need to account for both within-period and between-period correlations in sample size calculations. Especially when embedded in health care delivery systems, many SW-CRTs may have subclusters nested in clusters, within which outcomes are collected longitudinally. However, existing sample size methods that account for between-period correlations have not allowed for multiple levels of clustering. We present computationally efficient sample size procedures that properly differentiate within-period and between-period intracluster correlation coefficients in SW-CRTs in the presence of subclusters. We introduce an extended block exchangeable correlation matrix to characterize the complex dependencies of outcomes within clusters. For Gaussian outcomes, we derive a closed-form sample size expression that depends on the correlation structure only through two eigenvalues of the extended block exchangeable correlation structure. For non-Gaussian outcomes, we present a generic sample size algorithm based on linearization and elucidate simplifications under canonical link functions. For example, we show that the approximate sample size formula under a logistic linear mixed model depends on three eigenvalues of the extended block exchangeable correlation matrix. We provide an extension to accommodate unequal cluster sizes and validate the proposed methods via simulations. Finally, we illustrate our methods in two real SW-CRTs with subclusters.

Power analyses for stepped wedge designs with multivariate continuous outcomes

Multivariate outcomes are common in pragmatic cluster randomized trials. While sample size calculation procedures for multivariate outcomes exist under parallel assignment, none have been developed for a stepped wedge design. In this article, we present computationally efficient power and sample size procedures for stepped wedge cluster randomized trials (SW-CRTs) with multivariate outcomes that differentiate the within-period and between-period intracluster correlation coefficients (ICCs). Under a multivariate linear mixed model, we derive the joint distribution of the intervention test statistics which can be used for determining power under different hypotheses and provide an example using the commonly utilized intersection-union test for co-primary outcomes. Simplifications under a common treatment effect and common ICCs across endpoints and an extension to closed-cohort designs are also provided. Finally, under the common ICC across endpoints assumption, we formally prove that the multivariate linear mixed model leads to a more efficient treatment effect estimator compared to the univariate linear mixed model, providing a rigorous justification on the use of the former with multivariate outcomes. We illustrate application of the proposed methods using data from an existing SW-CRT and present extensive simulations to validate the methods.

IMplementing Predictive Analytics towards efficient COPD Treatments (IMPACT): protocol for a stepped-wedge cluster randomized impact study

INTRODUCTION

Personalized disease management informed by quantitative risk prediction has the potential to improve patient care and outcomes. The integration of risk prediction into clinical workflow should be informed by the experiences and preferences of stakeholders, and the impact of such integration should be evaluated in prospective comparative studies. The objectives of the IMplementing Predictive Analytics towards efficient chronic obstructive pulmonary disease (COPD) treatments (IMPACT) study are to integrate an exacerbation risk prediction tool into routine care and to determine its impact on prescription appropriateness (primary outcome), medication adherence, quality of life, exacerbation rates, and sex and gender disparities in COPD care (secondary outcomes).

METHODS

IMPACT will be conducted in two phases. Phase 1 will include the systematic and user-centered development of two decision support tools: (1) a decision tool for pulmonologists called the ACCEPT decision intervention (ADI), which combines risk prediction from the previously developed Acute COPD Exacerbation Prediction Tool with treatment algorithms recommended by the Canadian Thoracic Society's COPD pharmacotherapy guidelines, and (2) an information pamphlet for COPD patients (patient tool), tailored to their prescribed medication, clinical needs, and lung function. In phase 2, we will conduct a stepped-wedge cluster randomized controlled trial in two outpatient respiratory clinics to evaluate the impact of the decision support tools on quality of care and patient outcomes. Clusters will be practicing pulmonologists (n ≥ 24), who will progressively switch to the intervention over 18 months. At the end of the study, a qualitative process evaluation will be carried out to determine the barriers and enablers of uptake of the tools.

DISCUSSION

The IMPACT study coincides with a planned harmonization of electronic health record systems across tertiary care centers in British Columbia, Canada. The harmonization of these systems combined with IMPACT's implementation-oriented design and partnership with stakeholders will facilitate integration of the tools into routine care, if the results of the proposed study reveal positive association with improvement in the process and outcomes of clinical care. The process evaluation at the end of the trial will inform subsequent design iterations before largescale implementation.

TRIAL REGISTRATION

NCT05309356.

Advanced practice physiotherapy care in emergency departments for patients with musculoskeletal disorders: a pragmatic cluster randomized controlled trial and cost analysis

BACKGROUND

Advanced practice physiotherapy (APP) models of care where physiotherapists are primary contact emergency department (ED) providers are promising models of care to improve access, alleviate physicians' burden, and offer efficient centered patient care for patients with minor musculoskeletal disorders (MSKD).

OBJECTIVES

To compare the effectiveness of an advanced practice physiotherapist (APPT)-led model of care with usual ED physician care for persons presenting with a minor MSKD, in terms of patient-related outcomes, health care resources utilization, and health care costs.

METHODS

This trial is a multicenter stepped-wedge cluster randomized controlled trial (RCT) with a cost analysis. Six Canadian EDs (clusters) will be randomized to a treatment sequence where patients will either be managed by an ED APPT or receive usual ED physician care. Seven hundred forty-four adults with a minor MSKD will be recruited. The main outcome measure will be the Brief Pain Inventory Questionnaire. Secondary measures will include validated self-reported disability questionnaires, the EQ-5D-5L, and other health care utilization outcomes such as prescription of imaging tests and medication. Adverse events and re-visits to the ED for the same complaint will also be monitored. Health care costs will be measured from the perspective of the public health care system using time-driven activity-based costing. Outcomes will be collected at inclusion, at ED discharge, and at 4, 12, and 26 weeks following the initial ED visit. Per-protocol and intention-to-treat analyses will be performed using linear mixed models with a random effect for cluster and fixed effect for time.

DISCUSSION

MSKD have a significant impact on health care systems. By providing innovative efficient pathways to access care, APP models of care could help relieve pressure in EDs while providing efficient care for adults with MSKD.

TRIAL REGISTRATION

ClinicalTrials.gov NCT05545917 . Registered on September 19, 2022.

Effectiveness of Self-guided Tailored Implementation Strategies in Integrating and Embedding Internet-Based Cognitive Behavioral Therapy in Routine Mental Health Care: Results of a Multicenter Stepped-Wedge Cluster Randomized Trial

BACKGROUND

Internet-based cognitive behavioral therapy (iCBT) services for common mental health disorders have been found to be effective. There is a need for strategies that improve implementation in routine practice. One-size-fits-all strategies are likely to be ineffective. Tailored implementation is considered as a promising approach. The self-guided integrated theory-based Framework for intervention tailoring strategies toolkit (ItFits-toolkit) supports local implementers in developing tailored implementation strategies. Tailoring involves identifying local barriers; matching selected barriers to implementation strategies; developing an actionable work plan; and applying, monitoring, and adapting where necessary.

OBJECTIVE

This study aimed to compare the effectiveness of the ItFits-toolkit with implementation-as-usual (IAU) in implementing iCBT services in 12 routine mental health care organizations in 9 countries in Europe and Australia.

METHODS

A stepped-wedge cluster randomized trial design with repeated measures was applied. The trial period lasted 30 months. The primary outcome was the normalization of iCBT delivery by service providers (therapists, referrers, IT developers, and administrators), which was measured with the Normalization Measure Development as a proxy for implementation success. A 3-level linear mixed-effects modeling was applied to estimate the effects. iCBT service uptake (referral and treatment completion rates) and implementation effort (hours) were used as secondary outcomes. The perceived satisfaction (Client Satisfaction Questionnaire), usability (System Usability Scale), and impact of the ItFits-toolkit by implementers were used to assess the acceptability of the ItFits-toolkit.

RESULTS

In total, 456 mental health service providers were included in this study. Compared with IAU, the ItFits-toolkit had a small positive statistically significant effect on normalization levels in service providers (mean 0.09, SD 0.04; P=.02; Cohen d=0.12). The uptake of iCBT by patients was similar to that of IAU. Implementers did not spend more time on implementation work when using the ItFits-toolkit and generally regarded the ItFits-toolkit as usable and were satisfied with it.

CONCLUSIONS

The ItFits-toolkit performed better than the usual implementation activities in implementing iCBT services in routine practice. There is practical utility in the ItFits-toolkit for supporting implementers in developing and applying effective tailored implementation strategies. However, the effect on normalization levels among mental health service providers was small. These findings warrant modesty regarding the effectiveness of self-guided tailored implementation of iCBT services in routine practice.

TRIAL REGISTRATION

ClinicalTrials.gov NCT03652883; https://clinicaltrials.gov/ct2/show/NCT03652883.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

RR2-10.1186/s13063-020-04686-4.

Effect of COVID-19 Vaccine Messaging Platforms in Emergency Departments on Vaccine Acceptance and Uptake: A Cluster Randomized Clinical Trial

IMPORTANCE

Large segments of the US population's primary health care access occurs in emergency departments (EDs). These groups have disproportionately high COVID-19 vaccine hesitancy and lower vaccine uptake.

OBJECTIVE

To determine whether provision of COVID-19 vaccine messaging platforms in EDs increases COVID-19 vaccine acceptance and uptake in unvaccinated patients.

DESIGN, SETTING, AND PARTICIPANTS

This prospective cluster randomized clinical trial was conducted at 7 hospital EDs in 4 US cities from December 6, 2021, to July 28, 2022. Noncritically ill adult patients who had not previously received COVID-19 vaccines were enrolled.

INTERVENTIONS

A 3-pronged COVID-19 vaccine messaging platform (an English- or Spanish-language 4-minute video; a 1-page informational flyer; and a brief, scripted message from an ED physician or nurse) was delivered during patient waiting times.

MAIN OUTCOMES AND MEASURES

The 2 primary outcomes were (1) COVID-19 vaccine acceptance, assessed by survey responses in the ED, and (2) receipt of a COVID-19 vaccine within 30 days, ascertained by ED confirmation of vaccination, electronic health record review, and telephone follow-up.

RESULTS

Of the 496 participants enrolled (221 during intervention weeks and 275 during control weeks), the median (IQR) age was 39 (30-54) years, 205 (41.3%) were female, 193 (38.9%) were African American, 97 (19.6%) were Latinx, and 218 (44.0%) lacked primary care physicians. More intervention group participants, compared with control participants, stated that they would accept the vaccine in the ED (57 [25.8%] vs 33 [12.0%]; adjusted difference, 11.9 [95% CI, 4.5-19.3] percentage points; number needed to treat [NNT], 8 [95% CI, 5-22]). More intervention group participants than control participants received a COVID-19 vaccine within 30 days of their ED visit (44 [20.0%] vs 24 [8.7%]; adjusted difference, 7.9 [95% CI, 1.7-14.1] percentage points; NNT, 13 [95% CI, 7-60]). The intervention group had greater outcome effect sizes than the control group in participants who lacked a primary care physician (acceptance, 38 of 101 [37.6%] vs 16 of 117 [13.7%] [P for interaction = .004]; uptake, 31 of 101 [30.7%] vs 11 of 117 [9.4%] [P for interaction = .006]), as well as in Latinx persons (acceptance, 23 of 52 [44.2%] vs 5 of 48 [10.4%] [P for interaction = .004]; uptake, 22 of 52 [42.3%] vs 4 of 48 [8.3%] [P for interaction < .001]).

CONCLUSIONS AND RELEVANCE

Results of this cluster randomized clinical trial showed that with low NNT, implementation of COVID-19 vaccine messaging platforms in EDs leads to greater vaccine acceptance and uptake in unvaccinated ED patients. Broad implementation in EDs could lead to greater COVID-19 vaccine delivery to underserved populations whose primary health care access occurs in EDs.

TRIAL REGISTRATION

ClinicalTrials.gov Identifier: NCT05142332.

Effect of a Predictive Analytics-Targeted Program in Patients on Opioids: a Stepped-Wedge Cluster Randomized Controlled Trial

BACKGROUND

Risk of overdose, suicide, and other adverse outcomes are elevated among sub-populations prescribed opioid analgesics. To address this, the Veterans Health Administration (VHA) developed the Stratification Tool for Opioid Risk Mitigation (STORM)-a provider-facing dashboard that utilizes predictive analytics to stratify patients prescribed opioids based on risk for overdose/suicide.

OBJECTIVE

To evaluate the impact of the case review mandate on serious adverse events (SAEs) and all-cause mortality among high-risk Veterans.

DESIGN

A 23-month stepped-wedge cluster randomized controlled trial in all 140 VHA medical centers between 2018 and 2020.

PARTICIPANTS

A total of 44,042 patients actively prescribed opioid analgesics with high STORM risk scores (i.e., percentiles 1% to 5%) for an overdose or suicide-related event.

INTERVENTION

A mandate requiring providers to perform case reviews on opioid analgesic-prescribed patients at high risk of overdose/suicide.

MAIN MEASURES

Nine serious adverse events (SAEs), case review completion, number of risk mitigation strategies, and all-cause mortality.

KEY RESULTS

Mandated review inclusion was associated with a significant decrease in all-cause mortality within 4 months of inclusion (OR: 0.78; 95% CI: 0.65-0.94). There was no detectable effect on SAEs. Stepped-wedge analyses found that mandated review patients were five times more likely to receive a case review than non-mandated patients with similar risk (OR: 5.1; 95% CI: 3.64-7.23) and received more risk mitigation strategies than non-mandated patients (0.498; CI: 0.39-0.61).

CONCLUSIONS

Among VHA patients prescribed opioid analgesics, identifying high risk patients and mandating they receive an interdisciplinary case review was associated with a decrease in all-cause mortality. Results suggest that providers can leverage predictive analytic-targeted population health approaches and interdisciplinary collaboration to improve patient outcomes.

TRIAL REGISTRATION

ISRCTN16012111.