Design and analysis of stepped wedge cluster randomized trials

A stepped wedge cluster randomized trial of graphical surveillance of kidney function data to reduce late presentation for kidney replacement therapy

Late presentation for kidney replacement therapy (KRT) is an important cause of avoidable morbidity and mortality. Here, we evaluated the effect of a complex intervention of graphical estimated glomerular filtration rate (eGFR) surveillance across 15% of the United Kingdom population on the rate of late presentation using data routinely collected by the United Kingdom Renal Registry. A stepped wedge cluster randomized trial was established across 19 sites with eGFR graphs generated from all routine blood tests (community and hospital) across the population served by each site. Graphs were reviewed by trained laboratory or clinical staff and high-risk graphs reported to family doctors. Due to delays outside the control of clinicians and researchers few laboratories activated the intervention in their randomly assigned time period, so the trial was converted to a quasi-experimental design. We studied 6,100 kidney failure events at 20 laboratories served by 17 main kidney units. A total of 63,981 graphs were sent out. After adjustment for calendar time there was no significant reduction in the rate of presentation during the intervention period. Therefore, implementation of eGFR graph surveillance did not reduce the rate of late presentation for KRT after adjustment for secular trends. Thus, graphical surveillance is an intervention aimed at reducing late presentation, but more evidence is required before adoption of this strategy can be recommended.

'Walk Buds': A walking intervention to increase physical activity, physical fitness, and emotional wellbeing, in 9-13 year old children with intellectual disabilities. Results of a clustered randomised feasibility trial

BACKGROUND

Children with intellectual disability are less physically active and more sedentary than typically developing peers. To date no studies have tested the feasibility of a school-based walking intervention for children with Intellectual Disability.

METHOD

A clustered randomised controlled trial (cRCT), with an embedded process evaluation, was used to test the feasibility of a school-based walking intervention. Eight schools (n = 161 pupils aged 9-13 years) were randomised into either an intervention arm or an 'exercise as usual' arm. Measures included physical activity, physical fitness and emotional wellbeing. Baseline and 3-month follow-up data were collected.

RESULTS

The 'Walk Buds' intervention was found to be acceptable to teaching staff and pupils, with an uptake rate of the walking sessions offered of 84%.

CONCLUSION

A number of challenges were experienced, relating to the COVID-19 pandemic, and difficulties collecting accelerometer data. Barriers, facilitators and required changes identified through the mixed methods process evaluation are discussed.

Best Case/Worst Case-ICU: protocol for a multisite, stepped-wedge, randomised clinical trial of scenario planning to improve communication in the ICU in US trauma centres for older adults with serious injury

INTRODUCTION

Poor communication about serious injury in older adults can lead to treatment that is inconsistent with patient preferences, create conflict and strain healthcare resources. We developed a communication intervention called Best Case/Worst Case-intensive care unit (ICU) that uses daily scenario planning, that is, a narrative description of plausible futures, to support prognostication and facilitate dialogue among patients, their families and the trauma ICU team. This article describes a protocol for a multisite, randomised, stepped-wedge study to test the effectiveness of the intervention on the quality of communication (QOC) in the ICU.

METHODS AND ANALYSIS

We will follow all patients aged 50 and older admitted to the trauma ICU for 3 or more days after a serious injury at eight high-volume level 1 trauma centres. We aim to survey one family or 'like family' member per eligible patient 5-7 days following their loved ones' admission and clinicians providing care in the trauma ICU. Using a stepped-wedge design, we will use permuted block randomisation to assign the timing for each site to begin implementation of the intervention and routine use of the Best Case/Worst Case-ICU tool. We will use a linear mixed-effects model to test the effect of the tool on family-reported QOC (using the QOC scale) as compared with usual care. Secondary outcomes include the effect of the tool on reducing clinician moral distress (using the Measure of Moral Distress for Healthcare Professionals scale) and patients' length of stay in the ICU.

ETHICS AND DISSEMINATION

Institutional review board (IRB) approval was granted at the University of Wisconsin, and all study sites ceded review to the primary IRB. We plan to report results in peer-reviewed publications and national meetings.

TRIAL REGISTRATION NUMBER

NCT05780918.

ENhancinG vAGinal dElivery in Greece through educational and behavioral interventions among maternity care providers regarding labor management: the ENGAGE stepped-wedge randomized prospective trial protocol

BACKGROUND

There is an emerging need to systematically investigate the causes for the increased cesarean section rates in Greece and undertake interventions so as to substantially reduce its rates. To this end, the ability of the participating Greek obstetricians to follow evidence-based guidelines and respond to other educational and behavioral interventions while managing labor will be explored, along with barriers and enablers. Herein discussed is the protocol of a stepped-wedge designed intervention trial in Greek maternity units with the aforementioned goals in mind, named ENGAGE (ENhancinG vAGinal dElivery in Greece).

METHODS

Twenty-two selected maternity units in Greece will participate in a multicenter stepped-wedge randomized prospective trial involving 20,000 to 25,000 births, with two of them entering the intervention period of the study each month (stepped randomization). The maternity care units entering the study will apply the suggested interventions for a period of 8-18 months depending on the time they enter the intervention stage of the study. There will also be an initial phase of the study lasting from 8 to 18 months including observation and recording of the routine practice (cesarean section, vaginal birth, and maternal and perinatal morbidity and mortality) in the participating units. The second phase, the intervention period, will include such interventions as the application of the HSOG (the Hellenic Society of Obstetrics and Gynecology) Guidelines on labor management, training on the correct interpretation of cardiotocography, and dealing with emergencies in vaginal deliveries, while the steering committee members will be available to discuss and implement organizational and behavioral changes, answer questions, clarify relevant issues, and provide practical instructions to the participating healthcare professionals during regular visits or video conferences. Furthermore, during the study, the results will be available for the participating units in order for them to monitor their own performance while also receiving feedback regarding their rates. Τhe final 2-month phase of the study will be devoted to completing follow-up questionnaires with data concerning maternal and neonatal morbidities that occurred after the completion of the intervention period. The total duration of the study is estimated at 28 months. The primary outcome assessed will be the cesarean section rate change and the secondary outcomes will be maternal and neonatal morbidity and mortality.

DISCUSSION

The study is expected to yield new information on the effects, advantages, possibilities, and challenges of consistent clinical engagement and implementation of behavioral, educational, and organizational interventions described in detail in the protocol on cesarean section practice in Greece. The results may lead to new insights into means of improving the quality of maternal and neonatal care, particularly since this represents a shared effort to reduce the high cesarean section rates in Greece and, moreover, points the way to their reduction in other countries.

TRIAL REGISTRATION

NCT04504500 (ClinicalTrials.gov). The trial was prospectively registered. Ethics Reference No: 320/23.6.2020, Bioethics and Conduct Committee, School of Medicine, National and Kapodistrian University of Athens, Athens, Greece.

A stepped wedge cluster randomized trial to evaluate the effectiveness of a multisite family caregiver skills training program

OBJECTIVE

To assess the effects of an evidence-based family caregiver training program (implementation of Helping Invested Families Improve Veteran Experiences Study [iHI-FIVES]) in the Veterans Affairs healthcare system on Veteran days not at home and family caregiver well-being.

DATA SOURCES AND STUDY SETTING

Participants included Veterans referred to home- and community-based services with an identified caregiver across 8 medical centers and confirmed family caregivers of eligible Veterans.

STUDY DESIGN

In a stepped wedge cluster randomized trial, sites were randomized to a 6-month time interval for starting iHI-FIVES and received standardized implementation support. The primary outcome, number of Veteran "days not at home," and secondary outcomes, changes over 3 months in measures of caregiver well-being, were compared between pre- and post-iHI-FIVES intervals using generalized linear models including covariates.

DATA COLLECTION/EXTRACTION METHODS

Patient data were extracted from the electronic health record. Caregiver data were collected from 2 telephone-based surveys.

PRINCIPAL FINDINGS

Overall, n = 898 eligible Veterans were identified across pre-iHI-FIVES (n = 327) and post-iHI-FIVES intervals (n = 571). Just under one fifth (17%) of Veterans in post-iHI-FIVES intervals had a caregiver enroll in iHI-FIVES. Veteran and caregiver demographics in pre-iHI-FIVES intervals were similar to those in post-iHI-FIVES intervals. In adjusted models, the estimated rate of days not at home over 6-months was 42% lower (rate ratio = 0.58 [95% confidence interval: 0.31-1.09; p = 0.09]) post-iHI-FIVES compared with pre-iHI-FIVES. The estimated mean days not at home over a 6-month period was 13.0 days pre-iHI-FIVES and 7.5 post-iHI-FIVES. There were no differences between pre- and post-iHI-FIVES in change over 3 months in caregiver well-being measures.

CONCLUSIONS

Reducing days not at home is consistent with effectiveness because more time at home increases quality of life. In this study, after adjusting for Veteran characteristics, we did not find evidence that implementation of a caregiver training program yielded a reduction in Veteran's days not at home.

School-level intra-cluster correlation coefficients and autocorrelations for children's accelerometer-measured physical activity in England by age and gender

BACKGROUND

Randomised, cluster-based study designs in schools are commonly used to evaluate children's physical activity interventions. Sample size estimation relies on accurate estimation of the intra-cluster correlation coefficient (ICC), but published estimates, especially using accelerometry-measured physical activity, are few and vary depending on physical activity outcome and participant age. Less commonly-used cluster-based designs, such as stepped wedge designs, also need to account for correlations over time, e.g. cluster autocorrelation (CAC) and individual autocorrelation (IAC), but no estimates are currently available. This paper estimates the school-level ICC, CAC and IAC for England children's accelerometer-measured physical activity outcomes by age group and gender, to inform the design of future school-based cluster trials.

METHODS

Data were pooled from seven large English datasets of accelerometer-measured physical activity data between 2002-18 (> 13,500 pupils, 540 primary and secondary schools). Linear mixed effect models estimated ICCs for weekday and whole week for minutes spent in moderate-to-vigorous physical activity (MVPA) and being sedentary for different age groups, stratified by gender. The CAC (1,252 schools) and IAC (34,923 pupils) were estimated by length of follow-up from pooled longitudinal data.

RESULTS

School-level ICCs for weekday MVPA were higher in primary schools (from 0.07 (95% CI: 0.05, 0.10) to 0.08 (95% CI: 0.06, 0.11)) compared to secondary (from 0.04 (95% CI: 0.03, 0.07) to (95% CI: 0.04, 0.10)). Girls' ICCs were similar for primary and secondary schools, but boys' were lower in secondary. For all ages, combined the CAC was 0.60 (95% CI: 0.44-0.72), and the IAC was 0.46 (95% CI: 0.42-0.49), irrespective of follow-up time. Estimates were higher for MVPA vs sedentary time, and for weekdays vs the whole week.

CONCLUSIONS

Adequately powered studies are important to evidence effective physical activity strategies. Our estimates of the ICC, CAC and IAC may be used to plan future school-based physical activity evaluations and were fairly consistent across a range of ages and settings, suggesting that results may be applied to other high income countries with similar school physical activity provision. It is important to use estimates appropriate to the study design, and that match the intended study population as closely as possible.

Linking inter-professional newborn and contraception care (LINCC) trial: Protocol for a stepped wedge cluster randomized trial to link postpartum contraception care with routine well-baby visits

BACKGROUND

Pregnancies conceived within 18 months of a prior delivery (termed short inter-pregnancy interval [IPI]) place mothers and infants at high risk for poor health outcomes. Despite this, nearly one third of U.S. women experience a short IPI.

OBJECTIVE

To address the gap in the current model of postpartum (PP) contraception care by developing and implementing a novel approach to link (co-schedule) PP contraception care with newborn well-baby care to improve access to timely PP contraception.

METHODS

The LINCC Trial will take place in seven clinical locations across five community health centers within the U.S. PP patients (planned n = 3150) who are attending a Well-Baby Visit between 0 and 6 months will be enrolled. The LINCC Trial aims to leverage the Electronic Health Record to prompt providers to ask PP patients attending a Well-Baby Visit about their PP contraception needs and facilitate co-scheduling of PP contraception care with routine newborn care visits. The study includes a cluster randomized, cross-sectional stepped wedge design to roll out the intervention across the seven sites. The outcomes of the study include receipt of most or moderately effective methods of contraception by two and six months PP; and rate of short IPI pregnancies. Implementation outcomes will be assessed at baseline and 6 months after site enters intervention period.

CONCLUSIONS

The LINCC Trial seeks to evaluate the effectiveness and feasibility of a linked care model in comparison to usual care.

A simple and effective method for simulating nested exchangeable correlated binary data for longitudinal cluster randomised trials

BACKGROUND

Simulation is an important tool for assessing the performance of statistical methods for the analysis of data and for the planning of studies. While methods are available for the simulation of correlated binary random variables, all have significant practical limitations for simulating outcomes from longitudinal cluster randomised trial designs, such as the cluster randomised crossover and the stepped wedge trial designs. For these trial designs as the number of observations in each cluster increases these methods either become computationally infeasible or their range of allowable correlations rapidly shrinks to zero.

METHODS

In this paper we present a simple method for simulating binary random variables with a specified vector of prevalences and correlation matrix. This method allows for the outcome prevalence to change due to treatment or over time, and for a 'nested exchangeable' correlation structure, in which observations in the same cluster are more highly correlated if they are measured in the same time period than in different time periods, and where different individuals are measured in each time period. This means that our method is also applicable to more general hierarchical clustered data contexts, such as students within classrooms within schools. The method is demonstrated by simulating 1000 datasets with parameters matching those derived from data from a cluster randomised crossover trial assessing two variants of stress ulcer prophylaxis.

RESULTS

Our method is orders of magnitude faster than the most well known general simulation method while also allowing a much wider range of correlations than alternative methods. An implementation of our method is available in an R package NestBin.

CONCLUSIONS

This simulation method is the first to allow for practical and efficient simulation of large datasets of binary outcomes with the commonly used nested exchangeable correlation structure. This will allow for much more effective testing of designs and inference methods for longitudinal cluster randomised trials with binary outcomes.

A Bayesian adaptive design approach for stepped-wedge cluster randomized trials

BACKGROUND

The Bayesian group sequential design has been applied widely in clinical studies, especially in Phase II and III studies. It allows early termination based on accumulating interim data. However, to date, there lacks development in its application to stepped-wedge cluster randomized trials, which are gaining popularity in pragmatic trials conducted by clinical and health care delivery researchers.

METHODS

We propose a Bayesian adaptive design approach for stepped-wedge cluster randomized trials, which makes adaptive decisions based on the predictive probability of declaring the intervention effective at the end of study given interim data. The Bayesian models and the algorithms for posterior inference and trial conduct are presented.

RESULTS

We present how to determine design parameters through extensive simulations to achieve desired operational characteristics. We further evaluate how various design factors, such as the number of steps, cluster size, random variability in cluster size, and correlation structures, impact trial properties, including power, type I error, and the probability of early stopping. An application example is presented.

CONCLUSION

This study presents the incorporation of Bayesian adaptive strategies into stepped-wedge cluster randomized trials design. The proposed approach provides the flexibility to stop the trial early if substantial evidence of efficacy or futility is observed, improving the flexibility and efficiency of stepped-wedge cluster randomized trials.

Robust analysis of stepped wedge trials using composite likelihood models

Stepped wedge trials (SWTs) are a type of cluster randomized trial that involve repeated measures on clusters and design-induced confounding between time and treatment. Although mixed models are commonly used to analyze SWTs, they are susceptible to misspecification particularly for cluster-longitudinal designs such as SWTs. Mixed model estimation leverages both "horizontal" or within-cluster information and "vertical" or between-cluster information. To use horizontal information in a mixed model, both the mean model and correlation structure must be correctly specified or accounted for, since time is confounded with treatment and measurements are likely correlated within clusters. Alternative non-parametric methods have been proposed that use only vertical information; these are more robust because between-cluster comparisons in a SWT preserve randomization, but these non-parametric methods are not very efficient. We propose a composite likelihood method that focuses on vertical information, but has the flexibility to recover efficiency by using additional horizontal information. We compare the properties and performance of various methods, using simulations based on COVID-19 data and a demonstration of application to the LIRE trial. We found that a vertical composite likelihood model that leverages baseline data is more robust than traditional methods, and more efficient than methods that use only vertical information. We hope that these results demonstrate the potential value of model-based vertical methods for SWTs with a large number of clusters, and that these new tools are useful to researchers who are concerned about misspecification of traditional models.

Implementing Montessori approaches after training: A mixed methods study to examine staff understanding and movement toward action

Background: This paper uses Normalization Process Theory (NPT) to examine staff impressions of Montessori-based program training and implementation at Veterans Affairs Community Living Centers (VA CLCs; nursing homes). Methods: We conducted a mixed-methods evaluation of Montessori Approaches to Person-Centered Care (MAP-VA) at eight VA CLCs. Trainings were conducted as either a live virtual course or a pre-recorded asynchronous class. Two NPT constructs, coherence building and cognitive participation, informed qualitative interview questions, surveys, and analyses focused on staff movement from knowledge to action during initial implementation. Data collection included staff-completed standardized post-training exams (N = 906), post-training evaluations (N = 761), and optional validated surveys on perceptions of Montessori training (N = 307). Champions (peer-leaders) from each CLC completed semi-structured qualitative interviews post-training (N = 22). Findings: The majority of staff (83%-90%) passed all courses. Staff evaluated the training highly (80%+ agreement) on learning relevant new knowledge and confidence applying new skills. On average, staff felt MAP-VA would become a normal part of their work (7.68/10 scale), and reported increased familiarity with Montessori approaches after training (p = .002). Qualitative interview data from staff trained in Montessori supported three themes concordant with the NPT dimensions of coherence building and cognitive participation. (1) Coherence regarding Montessori: staff demonstrated an understanding of the program and mentioned the benefits of Montessori compared to their previous usual routines. Cognitive participation or engagement with Montessori: (2) staff had positive feelings about Montessori principles/applications and demonstrated a willingness to try the Montessori approach, and (3) staff made sense of the new intervention through early rehearsal of Montessori principles/practices and recognized opportunities for using Montessori in future interactions. Conclusions: Montessori virtual training resulted in high levels of coherence and cognitive participation among multidisciplinary staff, evidenced by high knowledge, self-efficacy, and readiness to act. The asynchronous and synchronous trainings were accessible, relevant, and supported diverse learners.

Protocol paper for an implementation science approach to promoting colorectal cancer screening in Federally Qualified Health Center clinics: A stepped-wedge, multilevel intervention trial

Background

Colorectal cancer is the third leading cause of cancer-related deaths in the United States. Despite the Healthy People 2030 goal of 70.5%, colorectal cancer (CRC) screening rates in Federally Qualified Health Centers (FQHCs) are suboptimal at about 40%. The Colorectal Cancer Awareness, Research, Education and Screening-Rural Expansion, Access, and Capacity for Health (CARES-REACH) study seeks to address this disparity and accelerate the adoption and utilization of effective, evidence-based CRC screening practices. This paper describes the CARES-REACH study design and implementation methods.

Methods

Informed by a community-based participatory research (CBPR) framework and enriched by implementation science approaches, CARES-REACH features a stepped wedge design with extension for maintenance to support an implementation strategy focused on multiple levels: organizational, provider, and patient levels that entail processes to boost initial and repeat screening among average risk and age-eligible adults. This multilevel study entails the implementation of a core set of evidence-based interventions (EBIs) that include low literacy patient education (English, Spanish, and Haitian Creole language); provider education, system-wide electronic medical record (EMR) tools including provider prompts and patient reminders, FIT (fecal immunochemical test) kit distribution, plus an organization-wide cancer control champion who motivates providers, coaches and navigates patients, and monitors system-wide CRC screening activities.

Trial registration

NCT04464668.

Implementation of social needs screening for minoritized patients newly diagnosed with breast cancer: a mixed methods evaluation in a pragmatic patient navigation trial

BACKGROUND

Social needs inhibit receipt of timely medical care. Social needs screening is a vital part of comprehensive cancer care, and patient navigators are well-positioned to screen for and address social needs. This mixed methods project describes social needs screening implementation in a prospective pragmatic patient navigation intervention trial for minoritized women newly diagnosed with breast cancer.

METHODS

Translating Research Into Practice (TRIP) was conducted at five cancer care sites in Boston, MA from 2018 to 2022. The patient navigation intervention protocol included completion of a social needs screening survey covering 9 domains (e.g., food, transportation) within 90 days of intake. We estimated the proportion of patients who received a social needs screening within 90 days of navigation intake. A multivariable log binomial regression model estimated the adjusted rate ratios (aRR) and 95% confidence intervals (CI) of patient socio-demographic characteristics and screening delivery. Key informant interviews with navigators (n = 8) and patients (n = 21) assessed screening acceptability and factors that facilitate and impede implementation. Using a convergent, parallel mixed methods approach, findings from each data source were integrated to interpret study results.

RESULTS

Patients' (n = 588) mean age was 59 (SD = 13); 45% were non-Hispanic Black and 27% were Hispanic. Sixty-nine percent of patients in the navigators' caseloads received social needs screening. Patients of non-Hispanic Black race/ethnicity (aRR = 1.25; 95% CI = 1.06-1.48) and those with Medicare insurance (aRR = 1.13; 95% CI = 1.04-1.23) were more likely to be screened. Screening was universally acceptable to navigators and generally acceptable to patients. Systems-based supports for improving implementation were identified.

CONCLUSIONS

Social needs screening was acceptable, yet with modest implementation. Continued systems-based efforts to integrate social needs screening in medical care are needed.

Harnessing health information technology to promote equitable care for patients with limited English proficiency and complex care needs

BACKGROUND

Patients with language barriers encounter healthcare disparities, which may be alleviated by leveraging interpreter skills to reduce cultural, language, and literacy barriers through improved bidirectional communication. Evidence supports the use of in-person interpreters, especially for interactions involving patients with complex care needs. Unfortunately, due to interpreter shortages and clinician underuse of interpreters, patients with language barriers frequently do not get the language services they need or are entitled to. Health information technologies (HIT), including artificial intelligence (AI), have the potential to streamline processes, prompt clinicians to utilize in-person interpreters, and support prioritization.

METHODS

From May 1, 2023, to June 21, 2024, a single-center stepped wedge cluster randomized trial will be conducted within 35 units of Saint Marys Hospital & Methodist Hospital at Mayo Clinic in Rochester, Minnesota. The units include medical, surgical, trauma, and mixed ICUs and hospital floors that admit acute medical and surgical care patients as well as the emergency department (ED). The transitions between study phases will be initiated at 60-day intervals resulting in a 12-month study period. Units in the control group will receive standard care and rely on clinician initiative to request interpreter services. In the intervention group, the study team will generate a daily list of adult inpatients with language barriers, order the list based on their complexity scores (from highest to lowest), and share it with interpreter services, who will send a secure chat message to the bedside nurse. This engagement will be triggered by a predictive machine-learning algorithm based on a palliative care score, supplemented by other predictors of complexity including length of stay and level of care as well as procedures, events, and clinical notes.

DISCUSSION

This pragmatic clinical trial approach will integrate a predictive machine-learning algorithm into a workflow process and evaluate the effectiveness of the intervention. We will compare the use of in-person interpreters and time to first interpreter use between the control and intervention groups.

TRIAL REGISTRATION

NCT05860777. May 16, 2023.

Impact of a family support intervention on hospitalization costs and hospital readmissions among ICU patients at high risk of death or severe functional impairment

BACKGROUND

Patients with advanced critical illness often receive more intensive treatment than they would choose for themselves, which contributes to high health care costs near the end of life. The purpose of this study was to determine whether a family support intervention delivered by the interprofessional ICU team decreases hospitalization costs and hospital readmissions among critically ill patients at high risk of death or severe functional impairment.

RESULTS

We examined index hospitalization costs as well as post-discharge utilization of acute care hospitals, rehabilitation and skilled nursing facilities, and hospice services for the PARTNER trial, a multicenter, stepped-wedge, cluster randomized trial of an interprofessional ICU family support intervention. We determined patients' total controllable and direct variable costs using a computerized accounting system. We determined post-discharge resource utilization (as defined above) by structured telephone interview at 6-month follow-up. We used multiple variable regression modelling to compare outcomes between groups. Compared to usual care, the PARTNER intervention resulted in significantly lower total controllable costs (geometric mean: $26,529 vs $32,105; log-linear coefficient: - 0.30; 95% CI - 0.49, - 0.11) and direct variable costs ($3912 vs $6034; - 0.33; 95% CI - 0.56, - 0.10). A larger cost reduction occurred for decedents ($20,304 vs. $26,610; - 0.66; 95% CI - 1.01, - 0.31) compared to survivors ($31,353 vs. $35,015; - 0.15; 95% CI - 0.35,0.05). A lower proportion in the intervention arm were re-admitted to an acute care hospital (34.9% vs 45.1%; 0.66; 95% CI 0.56, 0.77) or skilled nursing facility (25.3% vs 31.6%; 0.63; 95% CI 0.47, 0.84).

CONCLUSIONS

A family support intervention delivered by the interprofessional ICU team significantly decreased index hospitalization costs and readmission rates over 6-month follow-up. Trial registration Trial registration number: NCT01844492.

Re-Purposing the Ordering of Routine Laboratory Tests in Hospitalized Medical Patients (RePORT): protocol for a multicenter stepped-wedge cluster randomised trial to evaluate the impact of a multicomponent intervention bundle to reduce laboratory test over-utilization

BACKGROUND

Laboratory test overuse in hospitals is a form of healthcare waste that also harms patients. Developing and evaluating interventions to reduce this form of healthcare waste is critical. We detail the protocol for our study which aims to implement and evaluate the impact of an evidence-based, multicomponent intervention bundle on repetitive use of routine laboratory testing in hospitalized medical patients across adult hospitals in the province of British Columbia, Canada.

METHODS

We have designed a stepped-wedge cluster randomized trial to assess the impact of a multicomponent intervention bundle across 16 hospitals in the province of British Columbia in Canada. We will use the Knowledge to Action cycle to guide implementation and the RE-AIM framework to guide evaluation of the intervention bundle. The primary outcome will be the number of routine laboratory tests ordered per patient-day in the intervention versus control periods. Secondary outcome measures will assess implementation fidelity, number of all common laboratory tests used, impact on healthcare costs, and safety outcomes. The study will include patients admitted to adult medical wards (internal medicine or family medicine) and healthcare providers working in these wards within the participating hospitals. After a baseline period of 24 weeks, we will conduct a 16-week pilot at one hospital site. A new cluster (containing approximately 2-3 hospitals) will receive the intervention every 12 weeks. We will evaluate the sustainability of implementation at 24 weeks post implementation of the final cluster. Using intention to treat, we will use generalized linear mixed models for analysis to evaluate the impact of the intervention on outcomes.

DISCUSSION

The study builds upon a multicomponent intervention bundle that has previously demonstrated effectiveness. The elements of the intervention bundle are easily adaptable to other settings, facilitating future adoption in wider contexts. The study outputs are expected to have a positive impact as they will reduce usage of repetitive laboratory tests and provide empirically supported measures and tools for accomplishing this work.

TRIAL REGISTRATION

This study was prospectively registered on April 8, 2024, via ClinicalTrials.gov Protocols Registration and Results System (NCT06359587). https://classic.

CLINICALTRIALS

gov/ct2/show/NCT06359587?term=NCT06359587&recrs=ab&draw=2&rank=1.

Design and Analytic Methods to Evaluate Multilevel Interventions to Reduce Health Disparities: Rigorous Methods Are Available

In June 2022, the NIH Office of Disease Prevention (ODP) issued a Call for Papers for a Supplemental Issue to Prevention Science on Design and Analytic Methods to Evaluate Multilevel Interventions to Reduce Health Disparities. ODP sought to bring together current thinking and new ideas about design and analytic methods for studies aimed at reducing health disparities, including strategies for balancing methodological rigor with design feasibility, acceptability, and ethical considerations. ODP was particularly interested in papers on design and analytic methods for parallel group- or cluster-randomized trials (GRTs), stepped-wedge GRTs, group-level regression discontinuity trials, and other methods appropriate for evaluating multilevel interventions. In this issue, we include 12 papers that report new methods, provide examples of strong applications of existing methods, or provide guidance on developing multilevel interventions to reduce health disparities. These papers provide examples showing that rigorous methods are available for the design and analysis of multilevel interventions to reduce health disparities.

Sample Size Calculations for Stepped Wedge Designs with Treatment Effects that May Change with the Duration of Time under Intervention

The stepped wedge design is often used to evaluate interventions as they are rolled out across schools, health clinics, communities, or other clusters. Most models used in the design and analysis of stepped wedge trials assume that the intervention effect is immediate and constant over time following implementation of the intervention (the "exposure time"). This is known as the IT (immediate treatment effect) assumption. However, recent research has shown that using methods based on the IT assumption when the treatment effect varies over exposure time can give extremely misleading results. In this manuscript, we discuss the need to carefully specify an appropriate measure of the treatment effect when the IT assumption is violated and we show how a stepped wedge trial can be powered when it is anticipated that the treatment effect will vary as a function of the exposure time. Specifically, we describe how to power a trial when the exposure time indicator (ETI) model of Kenny et al. (Statistics in Medicine, 41, 4311-4339, 2022) is used and the estimand of interest is a weighted average of the time-varying treatment effects. We apply these methods to the ADDRESS-BP trial, a type 3 hybrid implementation study designed to address racial disparities in health care by evaluating a practice-based implementation strategy to reduce hypertension in African American communities.

Multilevel Intervention Stepped Wedge Designs (MLI-SWDs)

Multilevel interventions (MLIs) hold promise for reducing health inequities by intervening at multiple types of social determinants of health consistent with the socioecological model of health. In spite of their potential, methodological challenges related to study design compounded by a lack of tools for sample size calculation inhibit their development. We help address this gap by proposing the Multilevel Intervention Stepped Wedge Design (MLI-SWD), a hybrid experimental design which combines cluster-level (CL) randomization using a Stepped Wedge design (SWD) with independent individual-level (IL) randomization. The MLI-SWD is suitable for MLIs where the IL intervention has a low risk of interference between individuals in the same cluster, and it enables estimation of the component IL and CL treatment effects, their interaction, and the combined intervention effect. The MLI-SWD accommodates cross-sectional and cohort designs as well as both incomplete (clusters are not observed in every study period) and complete observation patterns. We adapt recent work using generalized estimating equations for SWD sample size calculation to the multilevel setting and provide an R package for power and sample size calculation. Furthermore, motivated by our experiences with the ongoing NC Works 4 Health study, we consider how to apply the MLI-SWD when individuals join clusters over the course of the study. This situation arises when unemployment MLIs include IL interventions that are delivered while the individual is unemployed. This extension requires carefully considering whether the study interventions will satisfy additional causal assumptions but could permit randomization in new settings.

"We don't separate out these things. Everything is related": Partnerships with Indigenous Communities to Design, Implement, and Evaluate Multilevel Interventions to Reduce Health Disparities

Multilevel interventions (MLIs) are appropriate to reduce health disparities among Indigenous peoples because of their ability to address these communities' diverse histories, dynamics, cultures, politics, and environments. Intervention science has highlighted the importance of context-sensitive MLIs in Indigenous communities that can prioritize Indigenous and local knowledge systems and emphasize the collective versus the individual. This paradigm shift away from individual-level focus interventions to community-level focus interventions underscores the need for community engagement and diverse partnerships in MLI design, implementation, and evaluation. In this paper, we discuss three case studies addressing how Indigenous partners collaborated with researchers in each stage of the design, implementation, and evaluation of MLIs to reduce health disparities impacting their communities. We highlight the following: (1) collaborations with multiple, diverse tribal partners to carry out MLIs which require iterative, consistent conversations over time; (2) inclusion of qualitative and Indigenous research methods in MLIs as a way to honor Indigenous and local knowledge systems as well as a way to understand a health disparity phenomenon in a community; and (3) relationship building, maintenance, and mutual respect among MLI partners to reconcile past research abuses, prevent extractive research practices, decolonize research processes, and generate co-created knowledge between Indigenous and academic communities.

Respiratory support with standard low-flow oxygen therapy, high-flow oxygen therapy or continuous positive airway pressure in adults with acute hypoxaemic respiratory failure in a resource-limited setting: protocol for a randomised, open-label, clinical trial - the Acute Respiratory Intervention StudiEs in Africa (ARISE-AFRICA) study

RATIONALE

Acute hypoxaemic respiratory failure (AHRF) is associated with high mortality in sub-Saharan Africa. This is at least in part due to critical care-related resource constraints including limited access to invasive mechanical ventilation and/or highly skilled acute care workers. Continuous positive airway pressure (CPAP) and high-flow oxygen by nasal cannula (HFNC) may prove useful to reduce intubation, and therefore, improve survival outcomes among critically ill patients, particularly in resource-limited settings, but data in such settings are lacking. The aim of this study is to determine whether CPAP or HFNC as compared with standard oxygen therapy, could reduce mortality among adults presenting with AHRF in a resource-limited setting.

METHODS

This is a prospective, multicentre, randomised, controlled, stepped wedge trial, in which patients presenting with AHRF in Uganda will be randomly assigned to standard oxygen therapy delivered through a face mask, HFNC oxygen or CPAP. The primary outcome is all-cause mortality at 28 days. Secondary outcomes include the number of patients with criteria for intubation at day 7, the number of patients intubated at day 28, ventilator-free days at day 28 and tolerance of each respiratory support.

ETHICS AND DISSEMINATION

The study has obtained ethical approval from the Research and Ethics Committee, School of Biomedical Sciences, College of Health Sciences, Makerere University as well as the Uganda National Council for Science and Technology. Patients will be included after informed consent. The results will be submitted for publication in peer-reviewed journals.

TRIAL REGISTRATION NUMBER

NCT04693403.

PROTOCOL VERSION

8 September 2023; version 5.

Effect of Digital Early Warning Scores on Hospital Vital Sign Observation Protocol Adherence: Stepped-Wedge Evaluation

BACKGROUND

Early warning scores (EWS) are routinely used in hospitals to assess a patient's risk of deterioration. EWS are traditionally recorded on paper observation charts but are increasingly recorded digitally. In either case, evidence for the clinical effectiveness of such scores is mixed, and previous studies have not considered whether EWS leads to changes in how deteriorating patients are managed.

OBJECTIVE

This study aims to examine whether the introduction of a digital EWS system was associated with more frequent observation of patients with abnormal vital signs, a precursor to earlier clinical intervention.

METHODS

We conducted a 2-armed stepped-wedge study from February 2015 to December 2016, over 4 hospitals in 1 UK hospital trust. In the control arm, vital signs were recorded using paper observation charts. In the intervention arm, a digital EWS system was used. The primary outcome measure was time to next observation (TTNO), defined as the time between a patient's first elevated EWS (EWS ≥3) and subsequent observations set. Secondary outcomes were time to death in the hospital, length of stay, and time to unplanned intensive care unit admission. Differences between the 2 arms were analyzed using a mixed-effects Cox model. The usability of the system was assessed using the system usability score survey.

RESULTS

We included 12,802 admissions, 1084 in the paper (control) arm and 11,718 in the digital EWS (intervention) arm. The system usability score was 77.6, indicating good usability. The median TTNO in the control and intervention arms were 128 (IQR 73-218) minutes and 131 (IQR 73-223) minutes, respectively. The corresponding hazard ratio for TTNO was 0.99 (95% CI 0.91-1.07; P=.73).

CONCLUSIONS

We demonstrated strong clinical engagement with the system. We found no difference in any of the predefined patient outcomes, suggesting that the introduction of a highly usable electronic system can be achieved without impacting clinical care. Our findings contrast with previous claims that digital EWS systems are associated with improvement in clinical outcomes. Future research should investigate how digital EWS systems can be integrated with new clinical pathways adjusting staff behaviors to improve patient outcomes.

Advancing randomized controlled trial methodologies: The place of innovative trial design in eating disorders research

Randomized controlled trials can be used to generate evidence on the efficacy and safety of new treatments in eating disorders research. Many of the trials previously conducted in this area have been deemed to be of low quality, in part due to a number of practical constraints. This article provides an overview of established and more innovative clinical trial designs, accompanied by pertinent examples, to highlight how design choices can enhance flexibility and improve efficiency of both resource allocation and participant involvement. Trial designs include individually randomized, cluster randomized, and designs with randomizations at multiple time points and/or addressing several research questions (master protocol studies). Design features include the use of adaptations and considerations for pragmatic or registry-based trials. The appropriate choice of trial design, together with rigorous trial conduct, reporting and analysis, can establish high-quality evidence to advance knowledge in the field. It is anticipated that this article will provide a broad and contemporary introduction to trial designs and will help researchers make informed trial design choices for improved testing of new interventions in eating disorders. PUBLIC SIGNIFICANCE: There is a paucity of high quality randomized controlled trials that have been conducted in eating disorders, highlighting the need to identify where efficiency gains in trial design may be possible to advance the eating disorder research field. We provide an overview of some key trial designs and features which may offer solutions to practical constraints and increase trial efficiency.

[INTERPOLAR-prospective, interventional studies as part of the Medical Informatics Initiative to improve medication therapy safety in healthcare]

Medication analyses by ward pharmacists are an important measure of drug therapy safety (DTS). Medication-related problems (MRPs) are identified and resolved with the attending clinicians. However, staff resources for extended medication analyses and complete documentation are often limited. Until now, data required for the identification of risk patients and for an extended medication analysis often had to be collected from various parts of the institution's internal electronic medical record (EMR). This error-prone and time-consuming process is to be improved in the INTERPOLAR (INTERventional POLypharmacy-Drug interActions-Risks) project using an IT tool provided by the data integration centers (DIC).INTERPOLAR is a use case of the Medical Informatics Initiative (MII) that focuses on the topic of DTS. The planning phase took place in 2023, with routine implementation planned from 2024. DTS-relevant data from the EMR is to be presented and the documentation of MRPs in routine care is to be facilitated. The prospective multicenter, cluster-randomized INTERPOLAR‑1 study serves to evaluate the benefits of IT support in routine care. The aim is to show that more MRPs can be detected and resolved with the help of IT support. For this purpose, six normal wards will be selected at each of eight university hospitals, so that 48 clusters (with a total of at least 70,000 cases) are available for randomization.

Optimal designs using generalized estimating equations in cluster randomized crossover and stepped wedge trials

Cluster randomized crossover and stepped wedge cluster randomized trials are two types of longitudinal cluster randomized trials that leverage both the within- and between-cluster comparisons to estimate the treatment effect and are increasingly used in healthcare delivery and implementation science research. While the variance expressions of estimated treatment effect have been previously developed from the method of generalized estimating equations for analyzing cluster randomized crossover trials and stepped wedge cluster randomized trials, little guidance has been provided for optimal designs to ensure maximum efficiency. Here, an optimal design refers to the combination of optimal cluster-period size and optimal number of clusters that provide the smallest variance of the treatment effect estimator or maximum efficiency under a fixed total budget. In this work, we develop optimal designs for multiple-period cluster randomized crossover trials and stepped wedge cluster randomized trials with continuous outcomes, including both closed-cohort and repeated cross-sectional sampling schemes. Local optimal design algorithms are proposed when the correlation parameters in the working correlation structure are known. MaxiMin optimal design algorithms are proposed when the exact values are unavailable, but investigators may specify a range of correlation values. The closed-form formulae of local optimal design and MaxiMin optimal design are derived for multiple-period cluster randomized crossover trials, where the cluster-period size and number of clusters are decimal. The decimal estimates from closed-form formulae can then be used to investigate the performances of integer estimates from local optimal design and MaxiMin optimal design algorithms. One unique contribution from this work, compared to the previous optimal design research, is that we adopt constrained optimization techniques to obtain integer estimates under the MaxiMin optimal design. To assist practical implementation, we also develop four SAS macros to find local optimal designs and MaxiMin optimal designs.

Maintaining the validity of inference from linear mixed models in stepped-wedge cluster randomized trials under misspecified random-effects structures

Linear mixed models are commonly used in analyzing stepped-wedge cluster randomized trials. A key consideration for analyzing a stepped-wedge cluster randomized trial is accounting for the potentially complex correlation structure, which can be achieved by specifying random-effects. The simplest random effects structure is random intercept but more complex structures such as random cluster-by-period, discrete-time decay, and more recently, the random intervention structure, have been proposed. Specifying appropriate random effects in practice can be challenging: assuming more complex correlation structures may be reasonable but they are vulnerable to computational challenges. To circumvent these challenges, robust variance estimators may be applied to linear mixed models to provide consistent estimators of standard errors of fixed effect parameters in the presence of random-effects misspecification. However, there has been no empirical investigation of robust variance estimators for stepped-wedge cluster randomized trials. In this article, we review six robust variance estimators (both standard and small-sample bias-corrected robust variance estimators) that are available for linear mixed models in R, and then describe a comprehensive simulation study to examine the performance of these robust variance estimators for stepped-wedge cluster randomized trials with a continuous outcome under different data generators. For each data generator, we investigate whether the use of a robust variance estimator with either the random intercept model or the random cluster-by-period model is sufficient to provide valid statistical inference for fixed effect parameters, when these working models are subject to random-effect misspecification. Our results indicate that the random intercept and random cluster-by-period models with robust variance estimators performed adequately. The CR3 robust variance estimator (approximate jackknife) estimator, coupled with the number of clusters minus two degrees of freedom correction, consistently gave the best coverage results, but could be slightly conservative when the number of clusters was below 16. We summarize the implications of our results for the linear mixed model analysis of stepped-wedge cluster randomized trials and offer some practical recommendations on the choice of the analytic model.

Efficient designs for three-sequence stepped wedge trials with continuous recruitment

BACKGROUND/AIMS

The standard approach to designing stepped wedge trials that recruit participants in a continuous stream is to divide time into periods of equal length. But the choice of design in such cases is infinitely more flexible: each cluster could cross from the control to the intervention at any point on the continuous time-scale. We consider the case of a stepped wedge design with clusters randomised to just three sequences (designs with small numbers of sequences may be preferred for their simplicity and practicality) and investigate the choice of design that minimises the variance of the treatment effect estimator under different assumptions about the intra-cluster correlation.

METHODS

We make some simplifying assumptions in order to calculate the variance: in particular that we recruit the same number of participants, m , from each cluster over the course of the trial, and that participants present at regularly spaced intervals. We consider an intra-cluster correlation that decays exponentially with separation in time between the presentation of two individuals from the same cluster, from a value of ρ for two individuals who present at the same time, to a value of ρ τ for individuals presenting at the start and end of the trial recruitment interval. We restrict attention to three-sequence designs with centrosymmetry - the property that if we reverse time and swap the intervention and control conditions then the design looks the same. We obtain an expression for the variance of the treatment effect estimator adjusted for effects of time, using methods for generalised least squares estimation, and we evaluate this expression numerically for different designs, and for different parameter values.

RESULTS

There is a two-dimensional space of possible three-sequence, centrosymmetric stepped wedge designs with continuous recruitment. The variance of the treatment effect estimator for given ρ and τ can be plotted as a contour map over this space. The shape of this variance surface depends on τ and on the parameter m ρ / ( 1 - ρ ) , but typically indicates a broad, flat region of close-to-optimal designs. The 'standard' design with equally spaced periods and 1:1:1 allocation rarely performs well, however.

CONCLUSIONS

In many different settings, a relatively simple design can be found (e.g. one based on simple fractions) that offers close-to-optimal efficiency in that setting. There may also be designs that are robustly efficient over a wide range of settings. Contour maps of the kind we illustrate can help guide this choice. If efficiency is offered as one of the justifications for using a stepped wedge design, then it is worth designing with optimal efficiency in mind.

Design and rationale of the Botswana Smoking Abstinence Reinforcement Trial: a protocol for a stepped-wedge cluster randomized trial

BACKGROUND

With expanded and sustained availability of HIV treatment resulting in substantial improvements in life expectancy, the need to address modifiable risk factors associated with leading causes of death among people living with HIV/AIDS (PLWH), such as tobacco smoking, has increased. Tobacco use is highly prevalent among PLWH, especially in southern Africa, where HIV is heavily concentrated, and many people who smoke would like to quit but are unable to do so without assistance. SBIRT (Screening, Brief Intervention and Referral to Treatment) is a well-established evidence-based approach successful at supporting smoking cessation in a variety of settings. Varenicline is efficacious in supporting smoking cessation. We intend to assess the effectiveness of SBIRT and varenicline on smoking cessation among PLWH in Botswana and the effectiveness of our implementation.

METHODS

BSMART (Botswana Smoking Abstinence Reinforcement Trial) is a stepped-wedge, cluster randomized, hybrid Type 2 effectiveness-implementation study guided by the RE-AIM framework, to evaluate the effectiveness and implementation of an SBIRT intervention consisting of the 5As compared to an enhanced standard of care. SBIRT will be delivered by trained lay health workers (LHWs), followed by referral to treatment with varenicline prescribed and monitored by trained nurse prescribers in a network of outpatient HIV care facilities. Seven hundred and fifty people living with HIV who smoke daily and have been receiving HIV care and treatment at one of 15 health facilities will be recruited if they are up to 18 years of age and willing to provide informed consent to participate in the study.

DISCUSSION

BSMART tests a scalable approach to achieve and sustain smoking abstinence implemented in a sustainable way. Integrating an evidence-based approach such as SBIRT, into an HIV care system presents an important opportunity to establish and evaluate a modifiable cancer prevention strategy in a middle-income country (MIC) setting where both LHW and non-physician clinicians are widely used. The findings, including the preliminary cost-effectiveness, will provide evidence to guide the Botswanan government and similar countries as they strive to provide affordable smoking cessation support at scale.

CLINICAL TRIAL REGISTRATION

NCT05694637 Registered on 7 December 2022 on clinicaltrials.gov, https://clinicaltrials.gov/search?locStr=Botswana&country=Botswana&cond=Smoking%20Cessation&intr=SBIRT.

"Hypertension is such a difficult disease to manage": federally qualified health center staff- and leadership-perceived readiness to implement a technology-facilitated team-based hypertension model

BACKGROUND

Despite decades of evidence demonstrating the efficacy of hypertension care delivery in reducing morbidity and mortality, a majority of hypertension cases remain uncontrolled. There is an urgent need to elucidate and address multilevel facilitators and barriers clinical staff face in delivering evidence-based hypertension care, patients face in accessing it, and clinical systems face in sustaining it. Through a rigorous pre-implementation evaluation, we aimed to identify facilitators and barriers bearing the potential to affect the planned implementation of a multilevel technology-facilitated hypertension management trial across six primary care sites in a large federally qualified health center (FQHC) in New York City.

METHODS

During a dedicated pre-implementation period (3-9 months/site, 2021-2022), a capacity assessment was conducted by trained practice facilitators, including (1) online anonymous surveys (n = 124; 70.5% of eligible), (2) hypertension training analytics (n = 69; 94.5% of assigned), and (3) audio-recorded semi-structured interviews (n = 67; 48.6% of eligible) with FQHC leadership and staff. Surveys measured staff sociodemographic characteristics, adaptive reserve, evidence-based practice attitudes, and implementation leadership scores via validated scales. Training analytics, derived from end-of-course quizzes, included mean score and number attempts needed to pass. Interviews assessed staff-reported facilitators and barriers to current hypertension care delivery and uptake; following audio transcription, trained qualitative researchers employed a deductive coding approach, informed by the Consolidated Framework for Implementation Research (CFIR).

RESULTS

Most survey respondents reported moderate adaptive reserve (mean = 0.7, range = 0-1), evidence-based practice attitudes (mean = 2.7, range = 0-4), and implementation leadership (mean = 2.5, range = 0-4). Most staff passed training courses on first attempt and demonstrated high scores (means > 80%). Findings from interviews identified potential facilitators and barriers to implementation; specifically, staff reported that complex barriers to hypertension care, control, and clinical communication exist; there is a recognized need to improve hypertension care; in-clinic challenges with digital tool access imposes workflow delays; and despite high patient loads, staff are motivated to provide high-quality cares.

CONCLUSIONS

This study serves as one of the first to apply the CFIR to a rigorous pre-implementation evaluation within the understudied context of a FQHC and can serve as a model for similar trials seeking to identify and address contextual factors known to impact implementation success.

TRIAL REGISTRATION

ClinicalTrials.gov NCT03713515 , date of registration: October 19, 2018.

Rapid Initiation of Injection Naltrexone for Opioid Use Disorder: A Stepped-Wedge Cluster Randomized Clinical Trial

Importance

Injectable extended-release (XR)-naltrexone is an effective treatment option for opioid use disorder (OUD), but the need to withdraw patients from opioid treatment prior to initiation is a barrier to implementation.

Objective

To compare the effectiveness of the standard procedure (SP) with the rapid procedure (RP) for XR-naltrexone initiation.

Design, Setting, and Participants

The Surmounting Withdrawal to Initiate Fast Treatment with Naltrexone study was an optimized stepped-wedge cluster randomized trial conducted at 6 community-based inpatient addiction treatment units. Units using the SP were randomly assigned at 14-week intervals to implement the RP. Participants admitted with OUD received the procedure the unit was delivering at the time of their admission. Participant recruitment took place between March 16, 2021, and July 18, 2022. The last visit was September 21, 2022.

Interventions

Standard procedure, based on the XR-naltrexone package insert (approximately 5-day buprenorphine taper followed by a 7- to 10-day opioid-free period and RP, defined as 1 day of buprenorphine at minimum necessary dose, 1 opioid-free day, and ascending low doses of oral naltrexone and adjunctive medications (eg, clonidine, clonazepam, antiemetics) for opioid withdrawal.

Main Outcomes and Measures

Receipt of XR-naltrexone injection prior to inpatient discharge (primary outcome). Secondary outcomes included opioid withdrawal scores and targeted safety events and serious adverse events. All analyses were intention-to-treat.

Results

A total of 415 participants with OUD were enrolled (mean [SD] age, 33.6 [8.48] years; 205 [49.4%] identified sex as male); 54 [13.0%] individuals identified as Black, 91 [21.9%] as Hispanic, 290 [69.9%] as White, and 22 [5.3%] as multiracial. Rates of successful initiation of XR-naltrexone among the RP group (141 of 225 [62.7%]) were noninferior to those of the SP group (68 of 190 [35.8%]) (odds ratio [OR], 3.60; 95% CI, 2.12-6.10). Withdrawal did not differ significantly between conditions (proportion of days with a moderate or greater maximum Clinical Opiate Withdrawal Scale score (>12) for RP vs SP: OR, 1.25; 95% CI, 0.62-2.50). Targeted safety events (RP: 12 [5.3%]; SP: 4 [2.1%]) and serious adverse events (RP: 15 [6.7%]; SP: 3 [1.6%]) were infrequent but occurred more often with RP than SP.

Conclusions and Relevance

In this trial, the RP of XR-naltrexone initiation was noninferior to the standard approach and saved time, although it required more intensive medical management and safety monitoring. The results of this trial suggest that rapid initiation could make XR-naltrexone a more viable treatment for patients with OUD.

Trial Registration

ClinicalTrials.gov Identifier: NCT04762537.

Safety planning intervention and follow-up: A telehealth service model for suicidal individuals in emergency department settings: Study design and protocol

BACKGROUND

The Safety Planning Intervention with follow-up services (SPI+) is a promising suicide prevention intervention, yet many Emergency Departments (EDs) lack the resources for adequate implementation. Comprehensive strategies addressing structural and organizational barriers are needed to optimize SPI+ implementation and scale-up. This protocol describes a test of one strategy in which ED staff connect at-risk patients to expert clinicians from a Suicide Prevention Consultation Center (SPCC) via telehealth.

METHOD

This stepped wedge, cluster-randomized trial compares the effectiveness, implementation, cost, and cost offsets of SPI+ delivered by SPCC clinicians versus ED-based clinicians (enhanced usual care; EUC). Eight EDs will start with EUC and cross over to the SPCC phase. Blocks of two EDs will be randomly assigned to start dates 3 months apart. Approximately 13,320 adults discharged following a suicide-related ED visit will be included; EUC and SPCC samples will comprise patients from before and after SPCC crossover, respectively. Effectiveness data sources are electronic health records, administrative claims, and the National Death Index. Primary effectiveness outcomes are presence of suicidal behavior and number/type of mental healthcare visits and secondary outcomes include number/type of suicide-related acute services 6-months post-discharge. We will use the same data sources to assess cost offsets to gauge SPCC scalability and sustainability. We will examine preliminary implementation outcomes (reach, adoption, fidelity, acceptability, and feasibility) through patient, clinician, and health-system leader interviews and surveys.

CONCLUSION

If the SPCC demonstrates clinical effectiveness and health system cost reduction, it may be a scalable model for evidence-based suicide prevention in the ED.

Examining the Effectiveness of a Digital Media Campaign at Reducing the Duration of Untreated Psychosis in New York State: Results From a Stepped-wedge Randomized Controlled Trial

BACKGROUND AND HYPOTHESIS

Longer duration of untreated psychosis (DUP) predicts worse outcomes in First Episode Psychosis (FEP). Searching online represents one of the first proactive step toward treatment initiation for many, yet few studies have informed how best to support FEP youth as they engage in early online help-seeking steps to care.

STUDY DESIGN

Using a stepped-wedge randomized design, this project evaluated the effectiveness of a digital marketing campaign at reducing DUP and raising rates of referrals to FEP services by proactively targeting and engaging prospective patients and their adult allies online.

STUDY RESULTS

Throughout the 18-month campaign, 41 372 individuals visited our website, and 371 advanced to remote clinical assessment (median age = 24.4), including 53 allies and 318 youth. Among those assessed (n = 371), 53 individuals (14.3%) reported symptoms consistent with psychotic spectrum disorders (62.2% female, mean age 20.7 years) including 39 (10.5%) reporting symptoms consistent with either Clinical High Risk (ie, attenuated psychotic symptoms; n = 26) or FEP (n = 13). Among those with either suspected CHR or FEP (n = 39), 20 (51.3%) successfully connected with care. The campaign did not result in significant differences in DUP.

CONCLUSION

This study highlights the potential to leverage digital media to help identify and engage youth with early psychosis online. However, despite its potential, online education and professional support alone are not yet sufficient to expedite treatment initiation and reduce DUP.

Patient Partnership Tools to Support Medication Safety in Community-Dwelling Older Adults: Protocol for a Nonrandomized Stepped Wedge Clinical Trial

BACKGROUND

Preventable harms from medications are significant threats to patient safety in community settings, especially among ambulatory older adults on multiple prescription medications. Patients may partner with primary care professionals by taking on active roles in decisions, learning the basics of medication self-management, and working with community resources.

OBJECTIVE

This study aims to assess the impact of a set of patient partnership tools that redesign primary care encounters to encourage and empower patients to make more effective use of those encounters to improve medication safety.

METHODS

The study is a nonrandomized, cross-sectional stepped wedge cluster-controlled trial with 1 private family medicine clinic and 2 public safety-net primary care clinics each composing their own cluster. There are 2 intervention sequences with 1 cluster per sequence and 1 control sequence with 1 cluster. Cross-sectional surveys will be taken immediately at the conclusion of visits to the clinics during 6 time periods of 6 weeks each, with a transition period of no data collection during intervention implementation. The number of visits to be surveyed will vary by period and cluster. We plan to recruit patients and professionals for surveys during 405 visits. In the experimental periods, visits will be conducted with two partnership tools and associated clinic process changes: (1) a 1-page visit preparation guide given to relevant patients by clinic staff before seeing the provider, with the intention to improve communication and shared decision-making, and (2) a library of short educational videos that clinic staff encourage patients to watch on medication safety. In the control periods, visits will be conducted with usual care. The primary outcome will be patients' self-efficacy in medication use. The secondary outcomes are medication-related issues such as duplicate therapies identified by primary care providers and assessment of collaborative work during visits.

RESULTS

The study was funded in September 2019. Data collection started in April 2023 and ended in December 2023. Data was collected for 405 primary care encounters during that period. As of February 15, 2024, initial descriptive statistics were calculated. Full data analysis is expected to be completed and published in the summer of 2024.

CONCLUSIONS

This study will assess the impact of patient partnership tools and associated process changes in primary care on medication use self-efficacy and medication-related issues. The study is powered to identify types of patients who may benefit most from patient engagement tools in primary care visits.

TRIAL REGISTRATION

ClinicalTrials.gov NCT05880368; https://clinicaltrials.gov/study/NCT05880368.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

DERR1-10.2196/57878.

Integrated Hepatitis C-Opioid Use Disorder Care Through Facilitated Telemedicine: A Randomized Trial

Importance

Facilitated telemedicine may promote hepatitis C virus elimination by mitigating geographic and temporal barriers.

Objective

To compare sustained virologic responses for hepatitis C virus among persons with opioid use disorder treated through facilitated telemedicine integrated into opioid treatment programs compared with off-site hepatitis specialist referral.

Design, Setting, and Participants

Prospective, cluster randomized clinical trial using a stepped wedge design. Twelve programs throughout New York State included hepatitis C-infected participants (n = 602) enrolled between March 1, 2017, and February 29, 2020. Data were analyzed from December 1, 2022, through September 1, 2023.

Intervention

Hepatitis C treatment with direct-acting antivirals through comanagement with a hepatitis specialist either through facilitated telemedicine integrated into opioid treatment programs (n = 290) or standard-of-care off-site referral (n = 312).

Main Outcomes and Measures

The primary outcome was hepatitis C virus cure. Twelve programs began with off-site referral, and every 9 months, 4 randomly selected sites transitioned to facilitated telemedicine during 3 steps without participant crossover. Participants completed 2-year follow-up for reinfection assessment. Inclusion criteria required 6-month enrollment in opioid treatment and insurance coverage of hepatitis C medications. Generalized linear mixed-effects models were used to test for the intervention effect, adjusted for time, clustering, and effect modification in individual-based intention-to-treat analysis.

Results

Among 602 participants, 369 were male (61.3%); 296 (49.2%) were American Indian or Alaska Native, Asian, Black or African American, multiracial, or other (ie, no race category was selected, with race data collected according to the 5 standard National Institutes of Health categories); and 306 (50.8%) were White. The mean (SD) age of the enrolled participants in the telemedicine group was 47.1 (13.1) years; that of the referral group was 48.9 (12.8) years. In telemedicine, 268 of 290 participants (92.4%) initiated treatment compared with 126 of 312 participants (40.4%) in referral. Intention-to-treat cure percentages were 90.3% (262 of 290) in telemedicine and 39.4% (123 of 312) in referral, with an estimated logarithmic odds ratio of the study group effect of 2.9 (95% CI, 2.0-3.5; P < .001) with no effect modification. Observed cure percentages were 246 of 290 participants (84.8%) in telemedicine vs 106 of 312 participants (34.0%) in referral. Subgroup effects were not significant, including fibrosis stage, urban or rural participant residence location, or mental health (anxiety or depression) comorbid conditions. Illicit drug use decreased significantly (referral: 95% CI, 1.2-4.8; P = .001; telemedicine: 95% CI, 0.3-1.0; P < .001) among cured participants. Minimal reinfections (n = 13) occurred, with hepatitis C virus reinfection incidence of 2.5 per 100 person-years. Participants in both groups rated health care delivery satisfaction as high or very high.

Conclusions and Relevance

Opioid treatment program-integrated facilitated telemedicine resulted in significantly higher hepatitis C virus cure rates compared with off-site referral, with high participant satisfaction. Illicit drug use declined significantly among cured participants with minimal reinfections.

Trial Registration

ClinicalTrials.gov Identifier: NCT02933970.

Improving mental health in chronic care in general practice: study protocol for a cluster-randomised controlled trial of the Healthy Mind intervention

BACKGROUND

Mental health issues are common among patients with chronic physical conditions, affecting approximately one in five patients. Poor mental health is associated with worse disease outcomes and increased mortality. Problem-solving therapy (PST) may be a suitable treatment for targeting poor mental health in these patients. This study protocol describes a randomised controlled trial of the Healthy Mind intervention, a general practice-based intervention offering PST to patients with type 2 diabetes and/or ischaemic heart disease and poor mental well-being.

METHODS

A stepped-wedge cluster-randomised controlled trial with 1-year follow-up will be conducted in Danish general practice. At the annual chronic care consultation, patients with type 2 diabetes and/or chronic ischaemic heart disease will be screened for poor mental well-being. Patients in the control group will be offered usual care while patients in the intervention group will be offered treatment with PST provided by general practitioners (GPs) or general practice staff, such as nurses, who will undergo a 2-day PST course before transitioning from the control to the intervention group. The primary outcome is change in depressive symptoms after 6 and 12 months. Secondary outcomes include change in mental well-being, anxiety, and diabetes distress (patients with type 2 diabetes) after 6 and 12 months as well as change in total cholesterol levels, low-density lipoprotein (LDL) levels, and blood glucose levels (patients with diabetes) after 12 months. Process outcomes include measures of implementation and mechanisms of impact. We aim to include a total of 188 patients, corresponding to approximately 14 average-sized general practices.

DISCUSSION

The Healthy Mind trial investigates the impact of PST treatment for patients with chronic disease and poor mental well-being in general practice. This will be the first randomised controlled trial determining the effect of PST treatment for patients with chronic diseases in general practice. The results of this study will provide relevant insights to aid GPs, and general practice staff manage patients with poor mental well-being.

TRIAL REGISTRATION

ClinicalTrials.gov NCT05611112. Registered on October 28, 2022.

Reconsidering stepped wedge cluster randomized trial designs with implementation periods: Fewer sequences or the parallel-group design with baseline and implementation periods are potentially more efficient

BACKGROUND/AIMS

When designing a cluster randomized trial, advantages and disadvantages of tentative designs must be weighed. The stepped wedge design is popular for multiple reasons, including its potential to increase power via improved efficiency relative to a parallel-group design. In many realistic settings, it will take time for clusters to fully implement the intervention. When designing the HEALing (Helping to End Addiction Long-termSM) Communities Study, implementation time was a major consideration, and we examined the efficiency and practicality of three designs. Specifically, a three-sequence stepped wedge design with implementation periods, a corresponding two-sequence modified design that is created by removing the middle sequence, and a parallel-group design with baseline and implementation periods. In this article, we study the relative efficiencies of these specific designs. More generally, we study the relative efficiencies of modified designs when the stepped wedge design with implementation periods has three or more sequences. We also consider different correlation structures.

METHODS

We compare efficiencies of stepped wedge designs with implementation periods consisting of three to nine sequences with a variety of corresponding designs. The three-sequence design is compared to the two-sequence modified design and to the parallel-group design with baseline and implementation periods analysed via analysis of covariance. Stepped wedge designs with implementation periods consisting of four or more sequences are compared to modified designs that remove all or a subset of 'middle' sequences. Efficiencies are based on the use of linear mixed effects models.

RESULTS

In the studied settings, the modified design is more efficient than the three-sequence stepped wedge design with implementation periods. The parallel-group design with baseline and implementation periods with analysis of covariance-based analysis is often more efficient than the three-sequence design. With respect to stepped wedge designs with implementation periods that are comprised of more sequences, there are often corresponding modified designs that improve efficiency. However, use of only the first and last sequences has the potential to be either relatively efficient or inefficient. Relative efficiency is impacted by the strength of the statistical correlation among outcomes from the same cluster; for example, the relative efficiencies of modified designs tend to be greater for smaller cluster auto-correlation values.

CONCLUSION

If a three-sequence stepped wedge design with implementation periods is being considered for a future cluster randomized trial, then a corresponding modified design using only the first and last sequences should be considered if sole focus is on efficiency. However, a parallel-group design with baseline and implementation periods and analysis of covariance-based analysis can be a practical, efficient alternative. For stepped wedge designs with implementation periods and a larger number of sequences, modified versions that remove 'middle' sequences should be considered. Due to the potential sensitivity of design efficiencies, statistical correlation should be carefully considered.

Digital Medication Management in Polypharmacy

BACKGROUND

Inappropriate drug prescriptions for patients with polypharmacy can have avoidable adverse consequences. We studied the effects of a clinical decision-support system (CDSS) for medication management on hospitalizations and mortality.

METHODS

This stepped-wedge, cluster-randomized, controlled trial involved an open cohort of adult patients with polypharmacy in primary care practices (=clusters) in Westphalia-Lippe, Germany. During the period of the intervention, their medication lists were checked annually using the CDSS. The CDSS warns against inappropriate prescriptions on the basis of patient-related health insurance data. The combined primary endpoint consisted of overall mortality and hospitalization for any reason. The secondary endpoints were mortality, hospitalizations, and high-risk prescription. We analyzed the quarterly health insurance data of the intention- to-treat population with a mixed logistic model taking account of clustering and repeated measurements. Sensitivity analyses addressed effects of the COVID-19 pandemic and other effects.

RESULTS

688 primary care practices were randomized, and data were obtained on 42 700 patients over 391 994 quarter years. No significant reduction was found in either the primary endpoint (odds ratio [OR] 1.00; 95% confidence interval [0.95; 1.04]; p = 0.8716) or the secondary endpoints (hospitalizations: OR 1.00 [0.95; 1.05]; mortality: OR 1.04 [0.92; 1.17]; high-risk prescription: OR 0.98 [0.92; 1.04]).

CONCLUSION

The planned analyses did not reveal any significant effect of the intervention. Pandemicadjusted analyses yielded evidence that the mortality of adult patients with polypharmacy might potentially be lowered by the CDSS. Controlled trials with appropriate follow-up are needed to prove that a CDSS has significant effects on mortality in patients with polypharmacy.

Depression and loneliness among Sub-Saharan immigrants living in the greater Paris area: results from the MAKASI empowerment stepped wedge cluster randomised controlled trial

PURPOSE

The MAKASI intervention aimed to empower Sub-Saharan African immigrants living in precarious situations in the Paris metropolitan area. Because there are factors specifically related to immigration that may increase the risk for common mental disorders, the present study aimed to examine participants' levels of depression and loneliness and analyze the effect of the intervention on depression and loneliness.

METHODS

The MAKASI study was designed as a stepped wedge cluster randomized trial. Study participants were recruited through an outreach program led by a nongovernmental organization and randomly assigned to two clusters, with an intervention delay of 3 months between them. Participants were assessed for 6 months after inclusion and the effect of the intervention on depression and loneliness was assessed using generalized linear mixed models. The study was conducted from 2018 to 2021 and took in consideration whether being interviewed during one of the Covid-19 confinement had an effect on the results.

RESULTS

Between 2018 and 2021 a total of 821 subjects participated in the Makasi study. High levels of depression and loneliness were found in the study population. We found no effect of the intervention on depression [95% CI 0.77 to 2.40]. Similarly, no effect of the intervention was found on loneliness [95% CI 0.87 to 2.54].

CONCLUSIONS

The intervention tested did not appear to improve the level of depression and loneliness among participants. However, the high prevalence of mental and emotional problems in the study population suggests a public health crisis among immigrants in the greater Paris area.

CLINICAL TRIAL REGISTRATION NUMBER

 Trial registration Clinicaltrials.gov, NCT04468724 (July 13, 2020).

Effect of implementation strategies on the routine provision of antenatal care addressing smoking in pregnancy: study protocol for a non-randomised stepped-wedge cluster controlled trial

INTRODUCTION

Globally, guideline-recommended antenatal care for smoking cessation is not routinely delivered by antenatal care providers. Implementation strategies have been shown to improve the delivery of clinical practices across a variety of clinical services but there is an absence of evidence in applying such strategies to support improvements to antenatal care for smoking cessation in pregnancy. This study aims to determine the effectiveness and cost effectiveness of implementation strategies in increasing the routine provision of recommended antenatal care for smoking cessation in public maternity services.

METHODS AND ANALYSIS

A non-randomised stepped-wedge cluster-controlled trial will be conducted in maternity services across three health sectors in New South Wales, Australia. Implementation strategies including guidelines and procedures, reminders and prompts, leadership support, champions, training and monitoring and feedback will be delivered sequentially to each sector over 4 months. Primary outcome measures will be the proportion of: (1) pregnant women who report receiving a carbon monoxide breath test; (2) smokers or recent quitters who report receiving quit/relapse advice; and (3) smokers who report offer of help to quit smoking (Quitline referral or nicotine replacement therapy). Outcomes will be measured via cross-sectional telephone surveys with a random sample of women who attend antenatal appointments each week. Economic analyses will be undertaken to assess the cost effectiveness of the implementation intervention. Process measures including acceptability, adoption, fidelity and reach will be reported.

ETHICS AND DISSEMINATION

Ethics approval was obtained through the Hunter New England Human Research Ethics Committee (16/11/16/4.07; 16/10/19/5.15) and the Aboriginal Health and Medical Research Council (1236/16). Trial findings will be disseminated to health policy-makers and health services to inform best practice processes for effective guideline implementation. Findings will also be disseminated at scientific conferences and in peer-reviewed journals.

TRIAL REGISTRATION NUMBER

Australian New Zealand Clinical Trials Registry-ACTRN12622001010785.

Alternatives to dental opioid prescribing after tooth extraction (ADOPT): protocol for a stepped wedge cluster randomized trial

BACKGROUND

Dentists and oral surgeons are leading prescribers of opioids to adolescents and young adults (AYA), who are at high risk for developing problematic opioid use after an initial exposure. Most opioids are prescribed after tooth extraction, but non-opioid analgesics provide similar analgesia and are recommended by multiple professional organizations.

METHODS

This multi-site stepped wedge cluster-randomized trial will assess whether a multicomponent behavioral intervention can influence opioid prescribing behavior among dentists and oral surgeons compared to usual practice. Across up to 12 clinical practices (clusters), up to 33 dentists/oral surgeons (provider participants) who perform tooth extractions for individuals 12-25 years old will be enrolled. After enrollment, all provider participants will receive the intervention at a time based on the sequence to which their cluster is randomized. The intervention consists of prescriber education via academic detailing plus provision of standardized patient post-extraction instructions and blister packs of acetaminophen and ibuprofen. Provider participants will dispense the blister packs and distribute the patient instructions at their discretion to AYA undergoing tooth extraction, with or without additional analgesics. The primary outcome is a binary, patient-level indicator of electronic post-extraction opioid prescription. Data for the primary outcome will be collected from the provider participant's electronic health records quarterly throughout the study. Provider participants will complete a survey before and approximately 3 months after transitioning into the intervention condition to assess implementation outcomes. AYA patients undergoing tooth extraction will be offered a survey to assess pain control and satisfaction with pain management in the week after their extraction. Primary analyses will use generalized estimating equations to compare the binary patient-level indicator of being prescribed a post-extraction opioid in the intervention condition compared to usual practice. Secondary analyses will assess provider participants' perceptions of feasibility and appropriateness of the intervention, and patient-reported pain control and satisfaction with pain management. Analyses will adjust for patient-level factors (e.g., sex, number of teeth extracted, etc.).

DISCUSSION

This real-world study will address an important need, providing information on the effectiveness of a multicomponent intervention at modifying dental prescribing behavior and reducing opioid prescriptions to AYA.

CLINICALTRIALS

GOV: NCT06275191.

A Stepped-Wedge Cluster-Randomized Controlled Trial of a Multi-interventional Approach for Fall Prevention

BACKGROUND AND OBJECTIVES

Falls are one of the most common adverse events at hospitals that may result in injury and even death. They are also associated with raised length of stay (LOS) and hospitalization costs. This experiment aimed to examine the effectiveness of multiple interventions in reducing inpatient fall rates and the consequent injuries.

METHODS

The present study was a stepped-wedge cluster-randomized controlled trial. It was done in 18 units in a public university hospital over 36 weeks. Patients included in this research were at risk of falls. Overall, 33 856 patients were admitted, of whom 4766 were considered high-risk patients. During the intervention phases, a series of preventive and control measures were considered, namely staff training; patient education; placement of nursing call bells; adequate lighting; supervision of high-risk patients during transmission and handovers; mobility device allocation; placement of call bell and safe guard in bathrooms; placing "fall alert" signs above patients' beds; nurses informing physicians timely about complications such as delirium and hypoxia; encouraging appropriate use of eyeglasses, hearing aids and footwear; keeping side rails up; and reassessing patients after each fall. The primary outcome was participant falls per 1000 patient-days. Secondary outcomes were fall-related injuries and LOS.

RESULTS

The results revealed a decrease in fall rate (n = 4 per 1000 patient-days vs 1.34 per 1000 patient-days, incidence rate ratio (IRR) = 0.19 [95% confidence interval (CI), 0.14-0.26]; P = .001) and injuries (n = 2.4 per 1000 patient-days vs 0.79 per 1000 patient-days, IRR = 0.22 [95% CI, 0.15-0.32]; P = .001) in exposed compared with unexposed phases. There was not a significant difference in LOS (exposed mean 10.63 days [95% CI, 10.26-10.97], unexposed mean 10.84 days [95% CI, 10.59-11.09], mean difference = -0.13 [95% CI, -0.53 to 0.27], P = .52).

CONCLUSIONS

This multi-interventional trial showed a reduction in falls and fall rates with injury but without an overall effect on LOS. Further research is needed to understand the sustainability of multiple fall prevention strategies in hospitals and their long-term impacts.

Adherence to key recommendations for design and analysis of stepped-wedge cluster randomized trials: A review of trials published 2016-2022

BACKGROUND/AIMS

The stepped-wedge cluster randomized trial (SW-CRT), in which clusters are randomized to a time at which they will transition to the intervention condition - rather than a trial arm - is a relatively new design. SW-CRTs have additional design and analytical considerations compared to conventional parallel arm trials. To inform future methodological development, including guidance for trialists and the selection of parameters for statistical simulation studies, we conducted a review of recently published SW-CRTs. Specific objectives were to describe (1) the types of designs used in practice, (2) adherence to key requirements for statistical analysis, and (3) practices around covariate adjustment. We also examined changes in adherence over time and by journal impact factor.

METHODS

We used electronic searches to identify primary reports of SW-CRTs published 2016-2022. Two reviewers extracted information from each trial report and its protocol, if available, and resolved disagreements through discussion.

RESULTS

We identified 160 eligible trials, randomizing a median (Q1-Q3) of 11 (8-18) clusters to 5 (4-7) sequences. The majority (122, 76%) were cross-sectional (almost all with continuous recruitment), 23 (14%) were closed cohorts and 15 (9%) open cohorts. Many trials had complex design features such as multiple or multivariate primary outcomes (50, 31%) or time-dependent repeated measures (27, 22%). The most common type of primary outcome was binary (51%); continuous outcomes were less common (26%). The most frequently used method of analysis was a generalized linear mixed model (112, 70%); generalized estimating equations were used less frequently (12, 8%). Among 142 trials with fewer than 40 clusters, only 9 (6%) reported using methods appropriate for a small number of clusters. Statistical analyses clearly adjusted for time effects in 119 (74%), for within-cluster correlations in 132 (83%), and for distinct between-period correlations in 13 (8%). Covariates were included in the primary analysis of the primary outcome in 82 (51%) and were most often individual-level covariates; however, clear and complete pre-specification of covariates was uncommon. Adherence to some key methodological requirements (adjusting for time effects, accounting for within-period correlation) was higher among trials published in higher versus lower impact factor journals. Substantial improvements over time were not observed although a slight improvement was observed in the proportion accounting for a distinct between-period correlation.

CONCLUSIONS

Future methods development should prioritize methods for SW-CRTs with binary or time-to-event outcomes, small numbers of clusters, continuous recruitment designs, multivariate outcomes, or time-dependent repeated measures. Trialists, journal editors, and peer reviewers should be aware that SW-CRTs have additional methodological requirements over parallel arm designs including the need to account for period effects as well as complex intracluster correlations.

Enrollment in High-Deductible Health Plans and Incident Diabetes Complications

Importance

Preventing diabetes complications requires monitoring and control of hyperglycemia and cardiovascular risk factors. Switching to high-deductible health plans (HDHPs) has been shown to hinder aspects of diabetes care; however, the association of HDHP enrollment with microvascular and macrovascular diabetes complications is unknown.

Objective

To examine the association between an employer-required switch to an HDHP and incident complications of diabetes.

Design, Setting, and Participants

This retrospective cohort study used deidentified administrative claims data for US adults with diabetes enrolled in employer-sponsored health plans between January 1, 2010, and December 31, 2019. Data analysis was performed from May 26, 2022, to January 2, 2024.

Exposures

Adults with a baseline year of non-HDHP enrollment who had to switch to an HDHP because their employer offered no non-HDHP alternative in that year were compared with adults who were continuously enrolled in a non-HDHP.

Main Outcomes and Measures

Mixed-effects logistic regression models examined the association between switching to an HDHP and, individually, the odds of myocardial infarction, stroke, hospitalization for heart failure, lower-extremity complication, end-stage kidney disease, proliferative retinopathy, treatment for retinopathy, and blindness. Models were adjusted for demographics, comorbidities, and medications, with inverse propensity score weighting used to account for potential selection bias.

Results

The study included 42 326 adults who switched to an HDHP (mean [SD] age, 52 [10] years; 19 752 [46.7%] female) and 202 729 adults who did not switch (mean [SD] age, 53 [10] years; 89 828 [44.3%] female). Those who switched to an HDHP had greater odds of experiencing all diabetes complications (odds ratio [OR], 1.11; 95% CI, 1.06-1.16 for myocardial infarction; OR, 1.15; 95% CI, 1.09-1.21 for stroke; OR, 1.35; 95% CI, 1.30-1.41 for hospitalization for heart failure; OR, 2.53; 95% CI, 2.38-2.70 for end-stage kidney disease; OR, 2.23; 95% CI, 2.17-2.29 for lower-extremity complication; OR, 1.17; 95% CI, 1.13-1.21 for proliferative retinopathy; OR, 2.35; 95% CI, 2.18-2.54 for blindness; and OR, 2.28; 95% CI, 2.15-2.41 for retinopathy treatment).

Conclusions and Relevance

This study found that an employer-driven switch to an HDHP was associated with increased odds of experiencing all diabetes complications. These findings reinforce the potential harm associated with HDHPs for people with diabetes and the importance of affordable and accessible chronic disease management, which is hindered by high out-of-pocket costs incurred by HDHPs.

Removing home hazards for older adults living in affordable housing: A stepped-wedge cluster-randomized trial

BACKGROUND

Falls are the leading cause of injury, disability, premature institutionalization, and injury-related mortality among older adults. Home hazard removal can effectively reduce falls in this population but is not implemented as standard practice. This study translated an evidence-based home hazard removal program (HARP) for delivery in low-income senior apartments to test whether the intervention would work in the "real world."

METHODS

From May 1, 2019 to December 31, 2020, a stepped-wedge cluster-randomized trial was used to implement the evidence-based HARP among residents with high fall risk in 11 low-income senior apartment buildings. Five clusters of buildings were randomly assigned an intervention allocation sequence. Three-level negative-binomial models (repeated measures nested within individuals, individuals nested within buildings) were used to compare fall rates between treatment and control conditions (excluding a crossover period), controlling for demographic characteristics, fall risk, and time period.

RESULTS

Among 656 residents, 548 agreed to screening, 435 were eligible (high fall risk), and 291 agreed to participate and received HARP. Participants were, on average, 72 years, 67% female, and 76% Black. Approximately 95.4% of fall prevention strategies and modifications implemented were still used 3 months later. The fall rate (per 1000 participant-days) was 4.87 during the control period and 4.31 during the posttreatment period. After adjusting for covariates and secular trend, there was no significant difference in fall rate (incidence rate ratio [IRR] 0.97, 95% CI 0.66-1.42). After excluding data collected during a hiatus in the intervention due to COVID-19, the reduction in fall rate was not significant (IRR 0.93, 95% CI 0.62-1.40).

CONCLUSIONS

Although HARP did not significantly reduce the rate of falls, this pragmatic study showed that the program was feasible to deliver in low-income senior housing and was acceptable among residents. There was effective collaboration between researchers and community agency staff.

Healthy immigrant community study protocol: A randomized controlled trial of a social network intervention for cardiovascular risk reduction among Hispanic and Somali adults

BACKGROUND

Immigrants to the United States face structural barriers that contribute to rising cardiovascular risk factors and obesity after immigration. This manuscript describes the development of the Healthy Immigrant Community protocol and baseline measures for a stepped wedge cluster randomized trial to test the effectiveness of a social network intervention for cardiovascular risk reduction among two immigrant populations.

METHODS

We developed a social network-informed, community-based, participatory research-derived health promotion intervention with Hispanic and Somali immigrant communities in Minnesota consisting of mentoring, educational and motivational sessions, group activities, and a community toolkit for healthy weight loss delivered by culturally concordant health promoters (HPs) to their social networks. Using a stepped wedge cluster randomized design, social network-based groups were randomly assigned to receive the intervention either immediately or after a delay of one year. Outcomes, measured at baseline, 6 months, 12 months, and 24 months, were derived from the American Heart Association's "Life's Simple 7": BMI and waist circumference, blood pressure, fasting blood glucose, total cholesterol, physical activity level, and dietary quality.

RESULTS

A total of 51 HPs were enrolled and randomized (29 Hispanic; 22 Somali). There were 475 participants enrolled in the study, representing a mean social network group size of 8 (range, 5-12). The mean BMI of the sample (32.2) was in the "obese" range.

CONCLUSION

Processes and products from this Healthy Immigrant Community protocol are relevant to other communities seeking to reduce cardiovascular risk factors and negative health behaviors among immigrant populations by leveraging the influence of their social networks.

Information content of stepped wedge designs under the working independence assumption

The stepped wedge design is increasingly popular in pragmatic trials and implementation science research studies for evaluating system-level interventions that are perceived to be beneficial to patient populations. An important step in planning a stepped wedge design is to understand the efficiency of the treatment effect estimator and hence the power of the study. We develop several novel analytical results for designing stepped wedge cluster randomized trials analyzed through generalized estimating equations under a misspecified working independence correlation structure. We first contribute a general variance expression of the treatment effect estimator when data collection is scheduled for each cluster-period. Because resource and patient-centered considerations may intentionally call for an incomplete design with outcome data being omitted for certain cluster-periods, we further derive the information content based on the robust sandwich variance to identify data elements that may be preferentially omitted with minimum loss of precision in estimating the treatment effect. We prove that centrosymmetric pairs of cluster-periods, treatment sequences and periods have identical information content and thus contribute equally to the treatment effect estimation, as long as the true covariance structure for the cluster-period means remains centrosymmetric. Finally, we provide an example of how to obtain an incomplete stepped wedge design that admits a more efficient independence GEE estimator but requires less data collection effort. Our results elegantly extend existing ones from linear mixed models coupled with model-based variances to accommodate a misspecified independence working correlation structure through the robust sandwich variances.

Effect of a Standardized Family Participation Program in the ICU: A Multicenter Stepped-Wedge Cluster Randomized Controlled Trial

OBJECTIVES

To determine the effect of a standardized program for family participation in essential care activities in the ICU on symptoms of anxiety, depression, posttraumatic stress and satisfaction among relatives, and perceptions and experiences of ICU healthcare providers (HCPs).

DESIGN

Multicenter stepped-wedge cluster randomized controlled trial.

SETTING

Seven adult ICUs, one university, and six general teaching hospitals.

PARTICIPANTS

Three hundred six relatives and 235 ICU HCPs.

INTERVENTIONS

A standardized program to facilitate family participation inpatient communication, amusement/distraction, comfort, personal care, breathing, mobilization, and nutrition.

MEASUREMENTS AND MAIN RESULTS

Data were collected through surveys among relatives and ICU HCPs. There were no significant differences in symptoms of anxiety in relatives in the intervention period compared with the control period (median Hospital Anxiety and Depression Scale [HADS] 5 [interquartile range (IQR) 2-10] vs 6 [IQR 3-9]; median ratio [MR] 0.72; 95% CI, 0.46-1.13; p = 0.15), depression (median HADS 4 [IQR 2-6] vs 3 [IQR 1-6]; MR 0.85; 95% CI, 0.55-1.32; p = 0.47) or posttraumatic stress (median Impact of Event Scale-Revised score 0.45 [IQR 0.27-0.82] vs 0.41 [IQR 0.14-1]; MR 0.94; 95% CI, 0.78-1.14; p = 0.54). Reported satisfaction was slightly lower in the intervention period (mean 8.90 [ sd 1.10] vs mean 9.06 [ sd 1.10], difference -0.60; 95% CI, -1.07 to -0.12; p = 0.01). ICU HCPs perceived that more relatives knew how to participate: 47% in the intervention period versus 22% in the control period (odds ratio [OR] 3.15; 95% CI, 1.64-6.05; p < 0.01). They also reported relatives having sufficient knowledge (41% vs 16%; OR 3.56; 95% CI, 1.75-7.25; p < 0.01) and skills (44% vs 25%; OR 2.38; 95% CI, 1.22-4.63; p = 0.01) to apply family participation.

CONCLUSIONS

Application of a standardized program to facilitate family participation did not change mental health symptoms in relatives of ICU patients 3 months after discharge. ICU HCPs reported increased clarity, knowledge, and skills among relatives and ICU HCPs.

Planning stepped wedge cluster randomized trials to detect treatment effect heterogeneity

Stepped wedge design is a popular research design that enables a rigorous evaluation of candidate interventions by using a staggered cluster randomization strategy. While analytical methods were developed for designing stepped wedge trials, the prior focus has been solely on testing for the average treatment effect. With a growing interest on formal evaluation of the heterogeneity of treatment effects across patient subpopulations, trial planning efforts need appropriate methods to accurately identify sample sizes or design configurations that can generate evidence for both the average treatment effect and variations in subgroup treatment effects. To fill in that important gap, this article derives novel variance formulas for confirmatory analyses of treatment effect heterogeneity, that are applicable to both cross-sectional and closed-cohort stepped wedge designs. We additionally point out that the same framework can be used for more efficient average treatment effect analyses via covariate adjustment, and allows the use of familiar power formulas for average treatment effect analyses to proceed. Our results further sheds light on optimal design allocations of clusters to maximize the weighted precision for assessing both the average and heterogeneous treatment effects. We apply the new methods to the Lumbar Imaging with Reporting of Epidemiology Trial, and carry out a simulation study to validate our new methods.