Covariate-based constrained randomization of group-randomized trials

Community-Based Cluster-Randomized Trial to Reduce Opioid Overdose Deaths

BACKGROUND

Evidence-based practices for reducing opioid-related overdose deaths include overdose education and naloxone distribution, the use of medications for the treatment of opioid use disorder, and prescription opioid safety. Data are needed on the effectiveness of a community-engaged intervention to reduce opioid-related overdose deaths through enhanced uptake of these practices.

METHODS

In this community-level, cluster-randomized trial, we randomly assigned 67 communities in Kentucky, Massachusetts, New York, and Ohio to receive the intervention (34 communities) or a wait-list control (33 communities), stratified according to state. The trial was conducted within the context of both the coronavirus disease 2019 (Covid-19) pandemic and a national surge in the number of fentanyl-related overdose deaths. The trial groups were balanced within states according to urban or rural classification, previous overdose rate, and community population. The primary outcome was the number of opioid-related overdose deaths among community adults.

RESULTS

During the comparison period from July 2021 through June 2022, the population-averaged rates of opioid-related overdose deaths were similar in the intervention group and the control group (47.2 deaths per 100,000 population vs. 51.7 per 100,000 population), for an adjusted rate ratio of 0.91 (95% confidence interval, 0.76 to 1.09; P = 0.30). The effect of the intervention on the rate of opioid-related overdose deaths did not differ appreciably according to state, urban or rural category, age, sex, or race or ethnic group. Intervention communities implemented 615 evidence-based practice strategies from the 806 strategies selected by communities (254 involving overdose education and naloxone distribution, 256 involving the use of medications for opioid use disorder, and 105 involving prescription opioid safety). Of these evidence-based practice strategies, only 235 (38%) had been initiated by the start of the comparison year.

CONCLUSIONS

In this 12-month multimodal intervention trial involving community coalitions in the deployment of evidence-based practices to reduce opioid overdose deaths, death rates were similar in the intervention group and the control group in the context of the Covid-19 pandemic and the fentanyl-related overdose epidemic. (Funded by the National Institutes of Health; HCS ClinicalTrials.gov number, NCT04111939.).

Supporting young women's health through girl-friendly drug vendors in Lake Zone, Tanzania: protocol for the AmbassADDOrs for Health cluster-randomised controlled trial

INTRODUCTION

Adverse sexual and reproductive health (SRH) outcomes, such as unplanned pregnancies and HIV infection, disproportionately affect adolescent girls and young women (AGYW; aged 15-24 years) in east Africa. Increasing uptake of preventive SRH services via innovative, youth-centred interventions is imperative to addressing disparities in SRH outcomes.

METHODS AND ANALYSIS

From 2018 to 2019, we used human-centred design to co-develop a theoretically driven HIV and pregnancy prevention intervention for AGYW at private drug shops called Accredited Drug Dispensing Outlets (ADDOs) in Tanzania. The result, Malkia Klabu (Queen Club), was a customer loyalty programme designed to strengthen ADDOs' role as SRH providers while encouraging uptake of critical SRH prevention products among AGYW. Malkia Klabu members had access to free contraceptives and oral HIV self-test (HIVST) kits and earned punches on a loyalty card for other shop purchases; punches were redeemable for small prizes. Our pilot among 40 shops showed that intervention ADDOs had higher AGYW patronage and distributed more HIVST kits and contraceptives to AGYW relative to business-as-usual (ie, client purchasing) comparison shops. We will conduct a cluster-randomised controlled trial (c-RCT) among 120-140 ADDOs in 40 health catchment areas in Shinyanga and Mwanza Regions (Lake Zone), Tanzania. ADDO shop recruitment includes a 1-month run-in with a tablet-based electronic inventory management system for tracking shop transactions, followed by enrolment, randomisation and a 24-month trial period. Our c-RCT evaluating the human-centred design-derived intervention will assess population impact on the primary outcomes of HIV diagnoses and antenatal care registrations, measured with routine health facility data. We will also assess secondary outcomes focusing on mechanisms of action, evaluate programme exposure and AGYW behaviour change in interviews with AGYW, and assess shop-level implementation strategies and fidelity.

ETHICS AND DISSEMINATION

Ethical approval was granted from both the University of California, San Francisco and the Tanzanian National Institute for Medical Research. Study progress and final outcomes will be posted annually to the National Clinical Trials website; study dissemination will occur at conferences, peer-reviewed manuscripts and local convenings of stakeholders.

TRIAL REGISTRATION NUMBER

NCT05357144.

Reducing perceived barriers to scaling up overdose education and naloxone distribution and medications for opioid use disorder in the United States in the HEALing (helping end addiction long-term®) communities study

BACKGROUND

Scaling up overdose education and naloxone distribution (OEND) and medications for opioid use disorder (MOUD) is needed to reduce opioid overdose deaths, but barriers are pervasive. This study examines whether the Communities That HEAL (CTH) intervention reduced perceived barriers to expanding OEND and MOUD in healthcare/behavioral health, criminal-legal, and other/non-traditional venues.

METHODS

The HEALing (Helping End Addiction Long-Term®) Communities Study is a parallel, wait-list, cluster randomized trial testing the CTH intervention in 67 communities in the United States. Surveys administered to coalition members and key stakeholders measured the magnitude of perceived barriers to scaling up OEND and MOUD in November 2019-January 2020, May-June 2021, and May-June 2022. Multilevel linear mixed models compared Wave 1 (intervention) and Wave 2 (wait-list control) respondents. Interactions by rural/urban status and research site were tested.

RESULTS

Wave 1 respondents reported significantly greater reductions in mean scores for three outcomes: perceived barriers to scaling up OEND in Healthcare/Behavioral Health Venues (-0.26, 95% confidence interval, CI: -0.48, -0.05, p = 0.015), OEND in Other/Non-traditional Venues (-0.53, 95% CI: - 0.84, -0.22, p = 0.001) and MOUD in Other/Non-traditional Venues (-0.34, 95% CI: -0.62, -0.05, p = 0.020). There were significant interactions by research site for perceived barriers to scaling up OEND and MOUD in Criminal-Legal Venues. There were no significant interactions by rural/urban status.

DISCUSSION

The CTH Intervention reduced perceived barriers to scaling up OEND and MOUD in certain venues, with no difference in effectiveness between rural and urban communities. More research is needed to understand facilitators and barriers in different venues.

Clinician Prompts for Human Papillomavirus Vaccination: A Cluster Randomized Trial

OBJECTIVE

We assessed the impact of an online intervention using clinician prompts for human papillomavirus (HPV) vaccination with a cluster randomized controlled trial.

METHODS

The randomized trial occurred July 2021-January 2022 in 48 primary care pediatric practices (24 intervention, 24 control) across the US. We trained clinicians via two online learning modules, plus weekly ''quick tips'' delivered via text or email. The training taught practices to implement a staff prompt to the clinician (e.g., printed reminders placed on the keyboard) plus electronic health record (EHR) prompts (if not already done) at well and acute/chronic visits for initial and subsequent HPV vaccination. We assessed missed opportunities for HPV vaccination using logistic regression models accounting for clustering by practice on an intent to treat basis. Surveys assessed facilitators and barriers to using prompts.

RESULTS

During the 6-month intervention, missed opportunities for HPV vaccination increased (worsened) in both intervention and control groups. However, at well child care visits, missed opportunities for the initial HPV vaccine increased by 4.5 (95% CI: -9.0%, -0.1%) percentage points less in intervention versus control practices. Change in missed opportunities for subsequent doses at well child care and non-well child care visits did not differ between trial groups. An end-of trial survey found understaffing as a common challenge.

CONCLUSIONS

Clinician prompts reduced missed opportunities for HPV vaccination at well child care visits. Understaffing related to the COVID-19 pandemic may have led to worsening missed opportunities for both groups and likely impeded practices in fully implementing changes.

Integrated Hepatitis C-Opioid Use Disorder Care Through Facilitated Telemedicine: A Randomized Trial

Importance

Facilitated telemedicine may promote hepatitis C virus elimination by mitigating geographic and temporal barriers.

Objective

To compare sustained virologic responses for hepatitis C virus among persons with opioid use disorder treated through facilitated telemedicine integrated into opioid treatment programs compared with off-site hepatitis specialist referral.

Design, Setting, and Participants

Prospective, cluster randomized clinical trial using a stepped wedge design. Twelve programs throughout New York State included hepatitis C-infected participants (n = 602) enrolled between March 1, 2017, and February 29, 2020. Data were analyzed from December 1, 2022, through September 1, 2023.

Intervention

Hepatitis C treatment with direct-acting antivirals through comanagement with a hepatitis specialist either through facilitated telemedicine integrated into opioid treatment programs (n = 290) or standard-of-care off-site referral (n = 312).

Main Outcomes and Measures

The primary outcome was hepatitis C virus cure. Twelve programs began with off-site referral, and every 9 months, 4 randomly selected sites transitioned to facilitated telemedicine during 3 steps without participant crossover. Participants completed 2-year follow-up for reinfection assessment. Inclusion criteria required 6-month enrollment in opioid treatment and insurance coverage of hepatitis C medications. Generalized linear mixed-effects models were used to test for the intervention effect, adjusted for time, clustering, and effect modification in individual-based intention-to-treat analysis.

Results

Among 602 participants, 369 were male (61.3%); 296 (49.2%) were American Indian or Alaska Native, Asian, Black or African American, multiracial, or other (ie, no race category was selected, with race data collected according to the 5 standard National Institutes of Health categories); and 306 (50.8%) were White. The mean (SD) age of the enrolled participants in the telemedicine group was 47.1 (13.1) years; that of the referral group was 48.9 (12.8) years. In telemedicine, 268 of 290 participants (92.4%) initiated treatment compared with 126 of 312 participants (40.4%) in referral. Intention-to-treat cure percentages were 90.3% (262 of 290) in telemedicine and 39.4% (123 of 312) in referral, with an estimated logarithmic odds ratio of the study group effect of 2.9 (95% CI, 2.0-3.5; P < .001) with no effect modification. Observed cure percentages were 246 of 290 participants (84.8%) in telemedicine vs 106 of 312 participants (34.0%) in referral. Subgroup effects were not significant, including fibrosis stage, urban or rural participant residence location, or mental health (anxiety or depression) comorbid conditions. Illicit drug use decreased significantly (referral: 95% CI, 1.2-4.8; P = .001; telemedicine: 95% CI, 0.3-1.0; P < .001) among cured participants. Minimal reinfections (n = 13) occurred, with hepatitis C virus reinfection incidence of 2.5 per 100 person-years. Participants in both groups rated health care delivery satisfaction as high or very high.

Conclusions and Relevance

Opioid treatment program-integrated facilitated telemedicine resulted in significantly higher hepatitis C virus cure rates compared with off-site referral, with high participant satisfaction. Illicit drug use declined significantly among cured participants with minimal reinfections.

Trial Registration

ClinicalTrials.gov Identifier: NCT02933970.

Assessing the Effectiveness of a Multicomponent Intervention on Hand Hygiene and Well-Being in Primary Health Care Centers and Schools Lacking Functional Water Supply in Protracted Conflict Settings: Protocol for a Cluster Randomized Controlled Trial

BACKGROUND

Hand hygiene is crucial in health care centers and schools to avoid disease transmission. Currently, little is known about hand hygiene in such facilities in protracted conflict settings.

OBJECTIVE

This protocol aims to assess the effectiveness of a multicomponent hand hygiene intervention on handwashing behavior, underlying behavioral factors, and the well-being of health care workers and students. Moreover, we report our methodology and statistical analysis plan transparently.

METHODS

This is a cluster randomized controlled trial with 2 parallel arms taking place in 4 countries for 1 year. In Burkina Faso and Mali, we worked in 24 primary health care centers per country, whereas in Nigeria and Palestine, we focused on 26 primary schools per country. Facilities were eligible if they were not connected to a functioning water source but were deemed accessible to the implementation partners. Moreover, health care centers were eligible if they had a maternity ward and ≥5 employees, and schools if they had ≤7000 students studying in grades 5 to 7. We used covariate-constrained randomization to assign intervention facilities that received a hardware, management and monitoring support, and behavior change. Control facilities will receive the same or improved intervention after endline data collection. To evaluate the intervention, at baseline and endline, we used a self-reported survey, structured handwashing observations, and hand-rinse samples. At follow-up, hand-rinse samples were dropped. Starting from the intervention implementation, we collected longitudinal data on hygiene-related health conditions and absenteeism. We also collected qualitative data with focus group discussions and interviews. Data were analyzed descriptively and with random effect regression models with the random effect at a cluster level. The primary outcome for health centers is the handwashing rate, defined as the number of times health care workers performed good handwashing practice with soap or alcohol-based handrub at one of the World Health Organization 5 moments for hand hygiene, divided by the number of moments for hand hygiene that presented themselves during the patient interaction within an hour of observation. For schools, the primary outcome is the number of students who washed their hands before eating.

RESULTS

The baseline data collection across all countries lasted from February to June 2023. We collected data from 135 and 174 health care workers in Burkina Faso and Mali, respectively. In Nigeria, we collected data from 1300 students and in Palestine from 1127 students. The endline data collection began in February 2024.

CONCLUSIONS

This is one of the first studies investigating hand hygiene in primary health care centers and schools in protracted conflict settings. With our strong study design, we expect to support local policy makers and humanitarian organizations in developing sustainable agendas for hygiene promotion.

TRIAL REGISTRATION

ClinicalTrials.gov NCT05946980 (Burkina Faso and Mali); https://www.clinicaltrials.gov/study/NCT05946980 and NCT05964478 (Nigeria and Palestine); https://www.clinicaltrials.gov/study/NCT05964478.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

DERR1-10.2196/52959.

Effects of the Communities that Heal (CTH) intervention on perceived opioid-related community stigma in the HEALing Communities Study: results of a multi-site, community-level, cluster-randomized trial

Background

Community stigma against people with opioid use disorder (OUD) and intervention stigma (e.g., toward naloxone) exacerbate the opioid overdose crisis. We examined the effects of the Communities that HEAL (CTH) intervention on perceived opioid-related community stigma by stakeholders in the HEALing Communities Study (HCS).

Methods

We collected three surveys from community coalition members in 66 communities across four states participating in HCS. Communities were randomized into Intervention (Wave 1) or Wait-list Control (Wave 2) arms. We conducted multilevel linear mixed models to compare changes in primary outcomes of community stigma toward people treated for OUD, naloxone, and medication for opioid use disorder (MOUD) by arm from time 1 (before the start of the intervention) to time 3 (end of the intervention period in the Intervention arm).

Findings

Intervention stakeholders reported a larger decrease in perceived community stigma toward people treated for OUD (adjusted mean change (AMC) -3.20 [95% C.I. -4.43, -1.98]) and toward MOUD (AMC -0.33 [95% C.I. -0.56, -0.09]) than stakeholders in Wait-list Control communities (AMC -0.18 [95% C.I. -1.38, 1.02], p = 0.0007 and AMC 0.11 [95% C.I. -0.09, 0.31], p = 0.0066). The relationship between intervention status and change in stigma toward MOUD was moderated by rural-urban status (urban AMC -0.59 [95% CI, -0.87, -0.32], rural AMC not sig.) and state. The difference in stigma toward naloxone between Intervention and Wait-list Control stakeholders was not statistically significant (p = 0.18).

Interpretation

The CTH intervention decreased stakeholder perceptions of community stigma toward people treated for OUD and stigma toward MOUD. Implementing the CTH intervention in other communities could decrease OUD stigma across diverse settings nationally.

Funding

US National Institute on Drug Abuse.

A CKD Clinical Decision Support System: A Cluster Randomized Clinical Trial in Primary Care Clinics

Rationale & Objective

The study aimed to develop, implement, and evaluate a clinical decision support (CDS) system for chronic kidney disease (CKD) in a primary care setting, with the goal of improving CKD care in adults.

Study Design

This was a cluster randomized trial.

Setting & Participants

A total of 32 Midwestern primary care clinics were randomly assigned to either receive usual care or CKD-CDS intervention. Between April 2019 and March 2020, we enrolled 6,420 patients aged 18-75 years with laboratory-defined glomerular filtration rate categories of CKD Stage G3 and G4, and 1 or more of 6 CKD care gaps: absence of a CKD diagnosis, suboptimal blood pressure or glycated hemoglobin levels, indication for angiotensin-converting enzyme inhibitor or angiotensin receptor blocker but not prescribed, a nonsteroidal anti-inflammatory agent on the active medication list, or indication for a nephrology referral.

Intervention

The CKD-CDS provided personalized suggestions for CKD care improvement opportunities directed to both patients and clinicians at primary care encounters.

Outcomes

We assessed the proportion of patients meeting each of 6 CKD-CDS quality metrics representing care gap resolution after 18 months.

Results

The adjusted proportions of patients meeting quality metrics in CKD-CDS versus usual care were as follows: CKD diagnosis documented (26.6% vs 21.8%; risk ratio [RR], 1.17; 95% CI, 0.91-1.51); angiotensin-converting enzyme inhibitor or angiotensin receptor blocker prescribed (15.9% vs 16.1%; RR, 0.95; 95% CI, 0.76-1.18); blood pressure control (20.4% vs 20.2%; RR, 0.98; 95% CI, 0.84-1.15); glycated hemoglobin level control (21.4% vs 22.1%; RR, 1.00; 95% CI, 0.80-1.24); nonsteroidal anti-inflammatory agent not on the active medication list (51.5% vs 50.4%; RR, 1.03; 95% CI, 0.90-1.17); and referral or visit to a nephrologist (38.7% vs 36.1%; RR, 1.02; 95% CI, 0.79-1.32).

Limitations

We encountered an overall reduction in expected primary care encounters and obstacles to point-of-care CKD-CDS utilization because of the coronavirus disease 2019 pandemic.

Conclusions

The CKD-CDS intervention did not lead to a significant improvement in CKD quality metrics. The challenges to CDS use during the coronavirus disease 2019 pandemic likely influenced these results.

Funding

National Institute of Diabetes and Digestive and Kidney Diseases (R18DK118463).

Trial Registration

clinicaltrials.gov Identifier: NCT03890588.

Rudi Kundini, Pamoja Kundini (RKPK): study protocol for a hybrid type 1 randomized effectiveness-implementation trial using data science and economic incentive strategies to strengthen the continuity of care among people living with HIV in Tanzania

BACKGROUND

Economic incentives can improve clinical outcomes among in-care people living with HIV (PLHIV), but evidence is limited for their effectiveness among out-of-care PLHIV or those at risk of disengagement. We propose a type 1 hybrid effectiveness-implementation study to advance global knowledge about the use of economic incentives to strengthen the continuity of HIV care and accelerate global goals for HIV epidemic control.

METHODS

The Rudi Kundini, Pamoja Kundini study will evaluate two implementation models of an economic incentive strategy for supporting two groups of PLHIV in Tanzania. Phase 1 of the study consists of a two-arm, cluster randomized trial across 32 health facilities to assess the effectiveness of a home visit plus one-time economic incentive on the proportion of out-of-care PLHIV with viral load suppression (< 1000 copies/ml) 6 months after enrollment (n = 640). Phase 2 is an individual 1:1 randomized controlled trial designed to determine the effectiveness of a short-term counseling and economic incentive program offered to in-care PLHIV who are predicted through machine learning to be at risk of disengaging from care on the outcome of viral load suppression at 12 months (n = 692). The program includes up to three incentives conditional upon visit attendance coupled with adapted counselling sessions for this population of PLHIV. Consistent with a hybrid effectiveness-implementation study design, phase 3 is a mixed methods evaluation to explore barriers and facilitators to strategy implementation in phases 1 and 2. Results will be used to guide optimization and scale-up of the incentive strategies, if effective, to the larger population of Tanzanian PLHIV who struggle with continuity of HIV care.

DISCUSSION

Innovative strategies that recognize the dynamic process of lifelong retention in HIV care are urgently needed. Strategies such as conditional economic incentives are a simple and effective method for improving many health outcomes, including those on the HIV continuum. If coupled with other supportive services such as home visits (phase 1) or with tailored counselling (phase 2), economic incentives have the potential to strengthen engagement among the subpopulation of PLHIV who struggle with retention in care and could help to close the gap towards reaching global "95-95-95" goals for ending the AIDS epidemic.

TRIAL REGISTRATION

Phase 1: ClinicalTrials.gov, NCT05248100 , registered 2/21/2022. Phase 2: ClinicalTrials.gov, NCT05373095 , registered 5/13/2022.

Impact of the Communities That HEAL Intervention on Buprenorphine-Waivered Practitioners and Buprenorphine Prescribing: A Prespecified Secondary Analysis of the HCS Randomized Clinical Trial

Importance

Buprenorphine significantly reduces opioid-related overdose mortality. From 2002 to 2022, the Drug Addiction Treatment Act of 2000 (DATA 2000) required qualified practitioners to receive a waiver from the Drug Enforcement Agency to prescribe buprenorphine for treatment of opioid use disorder. During this period, waiver uptake among practitioners was modest; subsequent changes need to be examined.

Objective

To determine whether the Communities That HEAL (CTH) intervention increased the rate of practitioners with DATA 2000 waivers and buprenorphine prescribing.

Design, Setting, and Participants

This prespecified secondary analysis of the HEALing Communities Study, a multisite, 2-arm, parallel, community-level, cluster randomized, open, wait-list-controlled comparison clinical trial was designed to assess the effectiveness of the CTH intervention and was conducted between January 1, 2020, to December 31, 2023, in 67 communities in Kentucky, Massachusetts, New York, and Ohio, accounting for approximately 8.2 million adults. The participants in this trial were communities consisting of counties (n = 48) and municipalities (n = 19). Trial arm randomization was conducted using a covariate constrained randomization procedure stratified by state. Each state was balanced by community characteristics including urban/rural classification, fatal opioid overdose rate, and community population. Thirty-four communities were randomized to the intervention and 33 to wait-list control arms. Data analysis was conducted between March 20 and September 29, 2023, with a focus on the comparison period from July 1, 2021, to June 30, 2022.

Intervention

Waiver trainings and other educational trainings were offered or supported by the HEALing Communities Study research sites in each state to help build practitioner capacity.

Main Outcomes and Measures

The rate of practitioners with a DATA 2000 waiver (overall, and stratified by 30-, 100-, and 275-patient limits) per 100 000 adult residents aged 18 years or older during July 1, 2021, to June 30, 2022, were compared between the intervention and wait-list control communities. The rate of buprenorphine prescribing among those waivered practitioners was also compared between the intervention and wait-list control communities. Intention-to-treat and per-protocol analyses were performed.

Results

A total of 8 166 963 individuals aged 18 years or older were residents of the 67 communities studied. There was no evidence of an effect of the CTH intervention on the adjusted rate of practitioners with a DATA 2000 waiver (adjusted relative rate [ARR], 1.04; 95% CI, 0.94-1.14) or the adjusted rate of practitioners with a DATA 2000 waiver who actively prescribed buprenorphine (ARR, 0.97; 95% CI, 0.86-1.10).

Conclusions and Relevance

In this randomized clinical trial, the CTH intervention was not associated with increases in the rate of practitioners with a DATA 2000 waiver or buprenorphine prescribing among those waivered practitioners. Supporting practitioners to prescribe buprenorphine remains a critical yet challenging step in the continuum of care to treat opioid use disorder.

Trial Registration

ClinicalTrials.gov Identifier: NCT04111939.

Engaging staff to improve COVID-19 vaccination response at long-term care facilities (ENSPIRE): A cluster randomized trial of co-designed, tailored vaccine promotion materials

BACKGROUND

COVID-19 vaccination rates among long-term care center (LTCC) workers are among the lowest of all frontline health care workers. Current efforts to increase COVID-19 vaccine uptake generally focus on strategies that have proven effective for increasing influenza vaccine uptake among health care workers including educational and communication strategies. Experimental evidence is lacking on the comparative advantage of educational strategies to improve vaccine acceptance and uptake, especially in the context of COVID-19. Despite the lack of evidence, education and communication strategies are recommended to improve COVID-19 vaccination rates and decrease vaccine hesitancy (VH), especially strategies using tailored messaging for disproportionately affected populations.

METHODS

We describe a cluster-randomized comparative effectiveness trial with 40 LTCCs and approximately 4000 LTCC workers in 2 geographically, culturally, and ethnically distinct states. We compare the effectiveness of two strategies for increasing COVID-19 booster vaccination rates and willingness to promote COVID-19 booster vaccination: co-design processes for tailoring educational messages vs. an enhanced usual care comparator. Our study focuses on the language and/or cultural groups that are most disproportionately affected by VH and low COVID-19 vaccine uptake in these LTCCs.

CONCLUSION

Finding effective methods to increase COVID-19 vaccine uptake and decrease VH among LTCC staff is critical. Beyond COVID-19, better approaches are needed to improve vaccine uptake and decrease VH for a variety of existing vaccines as well as vaccines created to address novel viruses as they emerge.

Eliminating Monitor Overuse (EMO) type III effectiveness-deimplementation cluster-randomized trial: Statistical analysis plan

Background

Deimplementing overused health interventions is essential to maximizing quality and value while minimizing harm, waste, and inefficiencies. Three national guidelines discourage continuous pulse oximetry (SpO2) monitoring in children who are not receiving supplemental oxygen, but the guideline-discordant practice remains prevalent, making it a prime target for deimplementation. This paper details the statistical analysis plan for the Eliminating Monitor Overuse (EMO) SpO2 trial, which compares the effect of two competing deimplementation strategies (unlearning only vs. unlearning plus substitution) on the sustainment of deimplementation of SpO2 monitoring in children with bronchiolitis who are in room air.

Methods

The EMO Trial is a hybrid type 3 effectiveness-deimplementation trial with a longitudinal cluster-randomized design, conducted in Pediatric Research in Inpatient Settings Network hospitals. The primary outcome is deimplementation sustainment, analyzed as a longitudinal difference-in-differences comparison between study arms. This analysis will use generalized hierarchical mixed-effects models for longitudinal clustering outcomes. Secondary outcomes include the length of hospital stay and oxygen supplementation duration, modeled using linear mixed-effects regressions. Using the well-established counterfactual approach, we will also perform a mediation analysis of hospital-level mechanistic measures on the association between the deimplementation strategy and the sustainment outcome.

Discussion

We anticipate that the EMO Trial will advance the science of deimplementation by providing new insights into the processes, mechanisms, and likelihood of sustained practice change using rigorously designed deimplementation strategies. This pre-specified statistical analysis plan will mitigate reporting bias and support data-driven approaches.

Trial registration

ClinicalTrials.gov NCT05132322. Registered on 24 November 2021.

Effect of the Children and Young People's Health Partnership model of paediatric integrated care on health service use and child health outcomes: a pragmatic two-arm cluster randomised controlled trial

BACKGROUND

Paediatric health systems across high-income countries are facing avoidable adverse outcomes and increasing demands and costs. The aim of this study was to compare the effect of an enhanced usual care model with that of an integrated health-care model that offers local health clinics for general paediatric problems and early intervention and care for children and young people with tracer conditions.

METHODS

In this pragmatic two-arm cluster randomised controlled trial, we compared the Children and Young People's Health Partnership (CYPHP) model of care versus enhanced usual care (EUC) among children registered at general practices in south London, UK. The CYPHP trial intervention was delivered between April 1, 2018, and June 30, 2021, and children younger than 16 years during the intervention period and registered at study practices on June 30, 2021, were included in the analysis. A restricted randomisation (1:1) following a computer-generated sequence was done by a masked independent statistician at the level of general practice cluster, stratified by borough (Lambeth or Southwark). Cluster allocation and data collection were masked, with unmasking of trial statisticians before analysis. The CYPHP model comprised all elements of EUC (electronic decision support, a primary care hotline, health checks, self-management support and health promotion, and resilience building and mental health first aid) plus local child health clinics delivered by paediatricians and general practitioners, and a nurse-led early intervention service for children with tracer conditions (asthma, eczema, and constipation). Primary outcomes were non-elective admissions (NELA; admissions coded as an emergency) among the whole trial population up to June 30, 2021, and paediatric quality of life (Pediatric Quality of Life Inventory [PedsQL]) among participants with tracer conditions at 6 months after recruitment. Secondary outcomes were primary and secondary care use, child mental health, parental wellbeing, standardised symptom scores for asthma, eczema, and constipation, health-care quality, and child absences from school and parent absences from work. The trial was registered on ClinicalTrials.gov, NCT03461848, and is complete.

FINDINGS

The trial was conducted between April 1, 2018, and Dec 31, 2021. In total, 23 general practice clusters, consisting of 70 practices with 97 970 registered children, were randomised to CYPHP (n=11) or EUC (n=12). We found no effect, at the population level, of CYPHP versus EUC on non-elective admissions during the intervention period (adjusted mean incidence rate ratio [IRR] 1·00 [95% CI 0·91 to 1·10], p=0·99). Among children with tracer conditions, we found no difference in paediatric quality of life (PedsQL score) at 6 months (adjusted mean difference -0·033 [95% CI -0·122 to 0·055], p=0·46). As a secondary outcome, among children with tracer conditions and requiring care, NELA rates at 12 months did not differ between the CYPHP and EUC groups (66·1 per 1000 person-years vs 75·3 per 1000 person-years; adjusted mean IRR 0·87 [0·61-1·22], p=0·42). In children requiring care, a statistically significant improvement was observed in eczema symptoms at 6 months from baseline in the CYPHP group versus the EUC group (adjusted mean difference -1·370 [-2·630 to -0·122], p=0·032). Quality of asthma care significantly improved among children in the CYPHP group compared with children in the EUC group. No significant improvement was seen for all other secondary outcomes.

INTERPRETATION

Although the CYPHP trial found a null effect for the primary outcomes, we found clinically important improvements in some secondary outcomes including care quality. Previous research has shown that large-scale system change requires time to observe a potential positive effect.

FUNDING

Guy's and St Thomas Charity, the Lambeth and Southwark Clinical Commissioning Groups, and Evelina London Children's Hospital.

Considerations for Subgroup Analyses in Cluster-Randomized Trials Based on Aggregated Individual-Level Predictors

In research assessing the effect of an intervention or exposure, a key secondary objective often involves assessing differential effects of this intervention or exposure in subgroups of interest; this is often referred to as assessing effect modification or heterogeneity of treatment effects (HTE). Observed HTE can have important implications for policy, including intervention strategies (e.g., will some patients benefit more from intervention than others?) and prioritizing resources (e.g., to reduce observed health disparities). Analysis of HTE is well understood in studies where the independent unit is an individual. In contrast, in studies where the independent unit is a cluster (e.g., a hospital or school) and a cluster-level outcome is used in the analysis, it is less well understood how to proceed if the HTE analysis of interest involves an individual-level characteristic (e.g., self-reported race) that must be aggregated at the cluster level. Through simulations, we show that only individual-level models have power to detect HTE by individual-level variables; if outcomes must be defined at the cluster level, then there is often low power to detect HTE by the corresponding aggregated variables. We illustrate the challenges inherent to this type of analysis in a study assessing the effect of an intervention on increasing COVID-19 booster vaccination rates at long-term care centers.

Protocol for a pragmatic cluster randomised controlled trial to evaluate the effectiveness of digital health interventions in improving non-communicable disease management during the pandemic in rural Pakistan

BACKGROUND

The COVID-19 pandemic has revealed gaps in global health systems, especially in the low- and middle-income countries (LMICs). Evidence shows that patients with non-communicable diseases (NCDs) are at higher risk of contracting COVID-19 and suffering direct and indirect health consequences. Considering the future challenges such as environmental disasters and pandemics to the LMICs health systems, digital health interventions (DHI) are well poised to strengthen health care resilience. This study aims to implement and evaluate a comprehensive package of DHIs of integrated COVID-NCD care to manage NCDs in primary care facilities in rural Pakistan.

METHODS

The study is designed as a pragmatic, parallel two-arm, multi-centre, mix-methods cluster randomised controlled trial. We will randomise 30 primary care facilities in three districts of Punjab, where basic hypertension and diabetes diagnosis and treatment are provided, with a ratio of 1:1 between intervention and control. In each facility, we will recruit 50 patients who have uncontrolled hypertension. The intervention arm will receive training on an integrated COVID-NCD guideline, and will use a smartphone app-based telemedicine platform where patients can communicate with health providers and peer-supporters, along with a remote training and supervision system. Usual care will be provided in the control arm. Patients will be followed up for 10 months. Our primary indicator is systolic blood pressure measured at 10 months. A process evaluation guided by implementation science frameworks will be conducted to explore implementation questions. A cost-effectiveness evaluation will be conducted to inform future scale up in Pakistan and other LMICs.

DISCUSSION

Our study is one of the first randomised controlled trials to evaluate the effectiveness of DHIs to manage NCDs to strengthen health system resilience in LMICs. We will also evaluate the implementation process and cost-effectiveness to inform future scale-up in similar resource constrained settings.

TRIAL REGISTRATION

ClinicalTrials.gov Identifier-NCT05699369.

Key considerations for designing, conducting and analysing a cluster randomized trial

Not only do cluster randomized trials require a larger sample size than individually randomized trials, they also face many additional complexities. The potential for contamination is the most commonly used justification for using cluster randomization, but the risk of contamination should be carefully weighed against the more serious problem of questionable scientific validity in settings with post-randomization identification or recruitment of participants unblinded to the treatment allocation. In this paper we provide some simple guidelines to help researchers conduct cluster trials in a way that minimizes potential biases and maximizes statistical efficiency. The overarching theme of this guidance is that methods that apply to individually randomized trials rarely apply to cluster randomized trials. We recommend that cluster randomization be only used when necessary-balancing the benefits of cluster randomization with its increased risks of bias and increased sample size. Researchers should also randomize at the lowest possible level-balancing the risks of contamination with ensuring an adequate number of randomization units-as well as exploring other options for statistically efficient designs. Clustering should always be allowed for in the sample size calculation; and the use of restricted randomization (and adjustment in the analysis for covariates used in the randomization) should be considered. Where possible, participants should be recruited before randomizing clusters and, when recruiting (or identifying) participants post-randomization, recruiters should be masked to the allocation. In the analysis, the target of inference should align with the research question, and adjustment for clustering and small sample corrections should be used when the trial includes less than about 40 clusters.

Whole-cage randomization for animal studies with unequal cage or group sizes

Following good statistical practice, in vivo study investigators allocate animals into two or more treatment groups using a randomization routine to eliminate selection bias and balance known and unknown confounding factors. For some studies, however, randomization at the individual animal level cannot be implemented. For example, for studies that involve co-housed male mice, an animal-level randomization can place unfamiliar mice together in the same cage, which can trigger fighting. To meet the ethical obligations to enhance the welfare of an animal used in science, the experimental procedures are, therefore, often modified, and male mice, possibly from the same brood, may be housed together. It follows that animal allocation into groups must proceed at the whole-cage level. Given the small sample sizes in animal studies, controlling baseline variables can be quite challenging. The difficulty greatly increases with a whole-cage randomization restriction. When the number of animals per cage or the treatment group sizes are unequal, there is no algorithm in the literature to perform the task. We propose a novel, fast, and reliable algorithm to provide a whole-cage randomization that balances one or more baseline variables across groups. The algorithm was applied to a realistic example dataset.

Comparing analytical strategies for balancing site-level characteristics in stepped-wedge cluster randomized trials: a simulation study

BACKGROUND

Stepped-wedge cluster randomized trials (SWCRTs) are a type of cluster-randomized trial in which clusters are randomized to cross-over to the active intervention sequentially at regular intervals during the study period. For SWCRTs, sequential imbalances of cluster-level characteristics across the random sequence of clusters may lead to biased estimation. Our study aims to examine the effects of balancing cluster-level characteristics in SWCRTs.

METHODS

To quantify the level of cluster-level imbalance, a novel imbalance index was developed based on the Spearman correlation and rank regression of the cluster-level characteristic with the cross-over timepoints. A simulation study was conducted to assess the impact of sequential cluster-level imbalances across different scenarios varying the: number of sites (clusters), sample size, number of cross-over timepoints, site-level intra-cluster correlation coefficient (ICC), and effect sizes. SWCRTs assumed either an immediate "constant" treatment effect, or a gradual "learning" treatment effect which increases over time after crossing over to the active intervention. Key performance metrics included the relative root mean square error (RRMSE) and relative mean bias.

RESULTS

Fully-balanced designs almost always had the highest efficiency, as measured by the RRMSE, regardless of the number of sites, ICC, effect size, or sample sizes at each time for SWCRTs with learning effect. A consistent decreasing trend of efficiency was observed by increasing RRMSE as imbalance increased. For example, for a 12-site study with 20 participants per site/timepoint and ICC of 0.10, between the most balanced and least balanced designs, the RRMSE efficiency loss ranged from 52.5% to 191.9%. In addition, the RRMSE was decreased for larger sample sizes, larger number of sites, smaller ICC, and larger effect sizes. The impact of pre-balancing diminished when there was no learning effect.

CONCLUSION

The impact of pre-balancing on preventing efficiency loss was easily observed when there was a learning effect. This suggests benefit of pre-balancing with respect to impacting factors of treatment effects.

Adapting a clinical decision support system to improve identification of pediatric hypertension in a rural health system: Design of a pragmatic trial

BACKGROUND

Identifying hypertension (HTN) early is crucial in preventing and lowering the long-term risk of heart disease, yet HTN in children often goes undiagnosed. An electronic health record linked, web-based clinical decision support (CDS) called PedsBP can help address this care gap and has been previously shown to increase recognition of HTN by primary care clinicians.

OBJECTIVES

To adapt the PedsBP tool for use in a mostly rural health system and then to evaluate the effectiveness of PedsBP for repeat of hypertensive level blood pressure (BP) measurements and HTN recognition among youth 6-17 years of age in primary care settings, comparing low-intensity and high-intensity implementation approaches.

METHODS AND DESIGN

PedsBP was evaluated through a pragmatic, clinic-randomized trial. The tool was piloted in 2 primary care clinics and modified prior to the full trial. Forty community-based, primary care clinics (or clusters of clinics) were randomly allocated in a 1:1:1 ratio to usual care, low-intensity implementation (CDS only), or high-intensity implementation (CDS plus in-person training, monthly use reports, and ongoing communication between study staff and clinics). Accrual of eligible patients started on August 1, 2022 and will continue for 18 months. Primary outcomes include repeating hypertensive level BP measurements at office visits and clinical recognition of HTN. Secondary outcomes include lifestyle counseling, dietician referral, and BP at follow-up.

CONCLUSION

This report focuses on the design and feasibility of adapting and implementing PedsBP in a rural primary care setting. The trial and analysis are ongoing with main results expected in mid-2024.

Pragmatic cluster-randomized trial of home-based preventive treatment for TB in Ethiopia and South Africa (CHIP-TB)

BACKGROUND

Each year, 1 million children develop TB resulting in over 200,000 child deaths. TB preventive treatment (TPT) is highly effective in preventing TB but remains poorly implemented for household child contacts. Home-based child contact management and TPT services may improve access to care. In this study, we aim to evaluate the effectiveness and cost-effectiveness of home-based contact management with TPT initiation in two TB high-burden African countries, Ethiopia and South Africa.

METHODS

This pragmatic cluster randomized trial compares home-based versus facility-based care delivery models for contact management. Thirty-six clinics with decentralized TB services (18 in Ethiopia and 18 in South Africa) were randomized in a 1:1 ratio to conduct either home-based or facility-based contact management. The study will attempt to enroll all eligible close child contacts of infectious drug-sensitive TB index patients diagnosed and treated for TB by one of the study clinics. Child TB contact management, including contact tracing, child evaluation, and TPT initiation and follow-up, will take place in the child's home for the intervention arm and at the clinic for the control arm. The primary outcome is the cluster-level ratio of the number of household child contacts less than 15 years of age in Ethiopia and less than 5 years of age in South Africa initiated on TPT per index patient, comparing the intervention to the control arm. Secondary outcomes include child contact identification and the TB prevention continuum of care. Other implementation outcomes include acceptability, feasibility, fidelity, cost, and cost-effectiveness of the intervention.

DISCUSSION

This implementation research trial will determine whether home-based contact management identifies and initiates more household child contacts on TPT than facility-based contact management.

TRIAL REGISTRATION

NCT04369326 . Registered on April 30, 2020.

Evaluating the effectiveness of a multifaceted intervention to reduce low-value care in adults hospitalized following trauma: a protocol for a pragmatic cluster randomized controlled trial

BACKGROUND

While simple Audit & Feedback (A&F) has shown modest effectiveness in reducing low-value care, there is a knowledge gap on the effectiveness of multifaceted interventions to support de-implementation efforts. Given the need to make rapid decisions in a context of multiple diagnostic and therapeutic options, trauma is a high-risk setting for low-value care. Furthermore, trauma systems are a favorable setting for de-implementation interventions as they have quality improvement teams with medical leadership, routinely collected clinical data, and performance-linked to accreditation. We aim to evaluate the effectiveness of a multifaceted intervention for reducing low-value clinical practices in acute adult trauma care.

METHODS

We will conduct a pragmatic cluster randomized controlled trial (cRCT) embedded in a Canadian provincial quality assurance program. Level I-III trauma centers (n = 30) will be randomized (1:1) to receive simple A&F (control) or a multifaceted intervention (intervention). The intervention, developed using extensive background work and UK Medical Research Council guidelines, includes an A&F report, educational meetings, and facilitation visits. The primary outcome will be the use of low-value initial diagnostic imaging, assessed at the patient level using routinely collected trauma registry data. Secondary outcomes will be low-value specialist consultation, low-value repeat imaging after a patient transfer, unintended consequences, determinants for successful implementation, and incremental cost-effectiveness ratios.

DISCUSSION

On completion of the cRCT, if the intervention is effective and cost-effective, the multifaceted intervention will be integrated into trauma systems across Canada. Medium and long-term benefits may include a reduction in adverse events for patients and an increase in resource availability. The proposed intervention targets a problem identified by stakeholders, is based on extensive background work, was developed using a partnership approach, is low-cost, and is linked to accreditation. There will be no attrition, identification, or recruitment bias as the intervention is mandatory in line with trauma center designation requirements, and all outcomes will be assessed with routinely collected data. However, investigators cannot be blinded to group allocation and there is a possibility of contamination bias that will be minimized by conducting intervention refinement only with participants in the intervention arm.

TRIAL REGISTRATION

This protocol has been registered on ClinicalTrials.gov (February 24, 2023, # NCT05744154 ).

Design and rationale of behavioral nudges for diabetes prevention (BEGIN): A pragmatic, cluster randomized trial of text messaging and a decision aid intervention for primary care patients with prediabetes

BACKGROUND

Among 96 million U.S. adults with prediabetes, adoption of evidence-based treatment to prevent diabetes remains low. Primary care represents an essential venue for preventing diabetes, yet providers in this setting have limited time to address prevention. This highlights the need for low-touch interventions that promote diabetes prevention and are not delivered by primary care providers. Text messaging and decision aids displaying disease risk and treatment information have improved outcomes in prior research. However, these approaches have not been definitively studied for managing prediabetes.

METHODS

The Behavioral Nudges for Diabetes Prevention (BEGIN) trial is a pragmatic, cluster randomized trial testing the effectiveness of text messaging about diabetes prevention and a prediabetes decision aid. These interventions are being studied in 8 primary care clinics using a 2 × 2 factorial design, in which pairs of clinics are randomized in a 1:1:1:1 ratio to receive usual care, text messaging alone, prediabetes decision aid alone, or both interventions. A total of 656 patients are recruited to participate, receive the study interventions, and contribute data at baseline and 12 months. The primary outcome is 12-month weight change, and the secondary outcome is adoption of evidence-based treatment to prevent diabetes. Change in hemoglobin A1c is an exploratory outcome that will be assessed among participants with available values.

CONCLUSION

Findings from the BEGIN trial will provide evidence about the effectiveness of two novel, low-touch interventions focused on diabetes prevention in primary care, where patients are diagnosed with prediabetes and there is little prior research.

TRIAL REGISTRY

NCT04869917.

An effectiveness-implementation trial protocol to evaluate PrEP initiation among U.S. cisgender women using eHealth tools vs. standard care

Background

The United States' (U.S.) initiative to End the HIV Epidemic aims to reduce new HIV infections in areas of high HIV prevalence. Despite national efforts to reduce HIV incidence, cisgender women continue to represent approximately one out of every five new HIV diagnoses in the U.S. Taking pre-exposure prophylaxis (PrEP) is an effective HIV prevention strategy; however, PrEP initiation among cisgender women is suboptimal, with only 10% of eligible women receiving PrEP prescriptions in 2019.

Methods

We designed a trial to test the effectiveness of interventions to increase PrEP initiation, while evaluating the implementation strategy (hybrid type II trial) in seven obstetrics and gynecology (OB/GYN) clinics (two federally qualified health centers, three community-based, and two academic) in Baltimore, Maryland. A total of 42 OB/GYN providers will be enrolled and randomized (1:1:1) into one of three clinical trial arms (standard of care, patient-level intervention, or multi-level intervention). Eligible patients of enrolled providers will receive a sexual health questionnaire before their appointment through the electronic health record's (EHR) patient portal. The questionnaire will be scored in three tiers (low, moderate, and high) to assess HIV risk. Patients at low risk will be offered an HIV test only, while those who score medium or high risk will be included in the clinical trial and assigned to the clinical trial arm associated with their provider. Differences in PrEP initiation, our primary outcome, across the three arms will be analyzed using generalized linear mixed-effect models with logistic regression. We will adjust results for demographic differences observed between arms and examine PrEP initiation stratified by patient's and provider's race and ethnicity.Additionally, a comprehensive economic analysis for each intervention will be conducted.

Discussion

We hypothesize that gathering information on sensitive sexual behaviors electronically, communicating HIV risk in an understandable and relatable format to patients and OB/GYN providers, and deploying EHR alerts will increase PrEP initiation and HIV testing.

Trial Registration

The trial is registered with ClinicalTrials.gov (NCT05412433) on 09 June 2022. https://clinicaltrials.gov/ct2/show/NCT05412433?term=NCT05412433&draw=2&rank=1.

Improving outcomes for children with malaria, diarrhoea and pneumonia in Mozambique: A cluster randomised controlled trial of the inSCALE technology innovation

BACKGROUND

The majority of post-neonatal deaths in children under 5 are due to malaria, diarrhoea and pneumonia (MDP). The WHO recommends integrated community case management (iCCM) of these conditions using community-based health workers (CHW). However iCCM programmes have suffered from poor implementation and mixed outcomes. We designed and evaluated a technology-based (mHealth) intervention package 'inSCALE' (Innovations At Scale For Community Access and Lasting Effects) to support iCCM programmes and increase appropriate treatment coverage for children with MDP.

METHODS

This superiority cluster randomised controlled trial allocated all 12 districts in Inhambane Province in Mozambique to receive iCCM only (control) or iCCM plus the inSCALE technology intervention. Population cross-sectional surveys were conducted at baseline and after 18 months of intervention implementation in approximately 500 eligible households in randomly selected communities in all districts including at least one child less than 60 months of age where the main caregiver was available to assess the impact of the intervention on the primary outcome, the coverage of appropriate treatment for malaria, diarrhoea and pneumonia in children 2-59months of age. Secondary outcomes included the proportion of sick children who were taken to the CHW for treatment, validated tool-based CHW motivation and performance scores, prevalence of cases of illness, and a range of secondary household and health worker level outcomes. All statistical models accounted for the clustered study design and variables used to constrain the randomisation. A meta-analysis of the estimated pooled impact of the technology intervention was conducted including results from a sister trial (inSCALE-Uganda).

FINDINGS

The study included 2740 eligible children in control arm districts and 2863 children in intervention districts. After 18 months of intervention implementation 68% (69/101) CHWs still had a working inSCALE smartphone and app and 45% (44/101) had uploaded at least one report to their supervising health facility in the last 4 weeks. Coverage of the appropriate treatment of cases of MDP increased by 26% in the intervention arm (adjusted RR 1.26 95% CI 1.12-1.42, p<0.001). The rate of care seeking to the iCCM-trained community health worker increased in the intervention arm (14.4% vs 15.9% in control and intervention arms respectively) but fell short of the significance threshold (adjusted RR 1.63, 95% CI 0.93-2.85, p = 0.085). The prevalence of cases of MDP was 53.5% (1467) and 43.7% (1251) in the control and intervention arms respectively (risk ratio 0.82, 95% CI 0.78-0.87, p<0.001). CHW motivation and knowledge scores did not differ between intervention arms. Across two country trials, the estimated pooled effect of the inSCALE intervention on coverage of appropriate treatment for MDP was RR 1.15 (95% CI 1.08-1.24, p <0.001).

INTERPRETATION

The inSCALE intervention led to an improvement in appropriate treatment of common childhood illnesses when delivered at scale in Mozambique. The programme will be rolled out by the ministry of health to the entire national CHW and primary care network in 2022-2023. This study highlights the potential value of a technology intervention aimed at strengthening iCCM systems to address the largest causes of childhood morbidity and mortality in sub-Saharan Africa.

Covariate-constrained randomization with cluster selection and substitution

BACKGROUND

An ongoing cluster-randomized trial for the prevention of arboviral diseases utilizes covariate-constrained randomization to balance two treatment arms across four specified covariates and geographic sector. Each cluster is within a census tract of the city of Mérida, Mexico, and there were 133 eligible tracts from which to select 50. As some selected clusters may have been subsequently found unsuitable in the field, we desired a strategy to substitute new clusters while maintaining covariate balance.

METHODS

We developed an algorithm that successfully identified a subset of clusters that maximized the average minimum pairwise distance between clusters in order to reduce contamination and balanced the specified covariates both before and after substitutions were made.

SIMULATIONS

Simulations were performed to explore some limitations of this algorithm. The number of selected clusters and eligible clusters were varied along with the method of selecting the final allocation pattern.

CONCLUSION

The algorithm is presented here as a series of optional steps that can be added to the standard covariate-constrained randomization process in order to achieve spatial dispersion, cluster subsampling, and cluster substitution. Simulation results indicate that these extensions can be used without loss of statistical validity, given a sufficient number of clusters included in the trial.

Improving community health worker treatment for malaria, diarrhoea, and pneumonia in Uganda through inSCALE community and mHealth innovations: A cluster randomised controlled trial

The inSCALE cluster randomised controlled trial in Uganda evaluated two interventions, mHealth and Village Health Clubs (VHCs) which aimed to improve Community Health Worker (CHW) treatment for malaria, diarrhoea, and pneumonia within the national Integrated Community Case Management (iCCM) programme. The interventions were compared with standard care in a control arm. In a cluster randomised trial, 39 sub-counties in Midwest Uganda, covering 3167 CHWs, were randomly allocated to mHealth; VHC or usual care (control) arms. Household surveys captured parent-reported child illness, care seeking and treatment practices. Intention-to-treat analysis estimated the proportion of appropriately treated children with malaria, diarrhoea, and pneumonia according to WHO informed national guidelines. The trial was registered at ClinicalTrials.gov (NCT01972321). Between April-June 2014, 7679 households were surveyed; 2806 children were found with malaria, diarrhoea, or pneumonia symptoms in the last one month. Appropriate treatment was 11% higher in the mHealth compared to the control arm (risk ratio [RR] 1.11, 95% CI 1.02, 1.21; p = 0.018). The largest effect was on appropriate treatment for diarrhoea (RR 1.39; 95% CI 0.90, 2.15; p = 0.134). The VHC intervention increased appropriate treatment by 9% (RR 1.09; 95% CI 1.01, 1.18; p = 0.059), again with largest effect on treatment of diarrhoea (RR 1.56, 95% CI 1.04, 2.34, p = 0.030). CHWs provided the highest levels of appropriate treatment compared to other providers. However, improvements in appropriate treatment were observed at health facilities and pharmacies, with CHW appropriate treatment the same across the arms. The rate of CHW attrition in both intervention arms was less than half that of the control arm; adjusted risk difference mHealth arm -4.42% (95% CI -8.54, -0.29, p = 0.037) and VHC arm -4.75% (95% CI -8.74, -0.76, p = 0.021). Appropriate treatment by CHWs was encouragingly high across arms. The inSCALE mHealth and VHC interventions have the potential to reduce CHW attrition and improve the care quality for sick children, but not through improved CHW management as we had hypothesised. Trial Registration:ClinicalTrials.gov (NCT01972321).

A health-system-embedded deprescribing intervention targeting patients and providers to prevent falls in older adults (STOP-FALLS trial): study protocol for a pragmatic cluster-randomized controlled trial

BACKGROUND

Central nervous system (CNS) active medications have been consistently linked to falls in older people. However, few randomized trials have evaluated whether CNS-active medication reduction reduces falls and fall-related injuries. The objective of the Reducing CNS-active Medications to Prevent Falls and Injuries in Older Adults (STOP-FALLS) trial is to test the effectiveness of a health-system-embedded deprescribing intervention focused on CNS-active medications on the incidence of medically treated falls among community-dwelling older adults.

METHODS

We will conduct a pragmatic, cluster-randomized, parallel-group, controlled clinical trial within Kaiser Permanente Washington to test the effectiveness of a 12-month deprescribing intervention consisting of (1) an educational brochure and self-care handouts mailed to older adults prescribed one or more CNS-active medications (aged 60 + : opioids, benzodiazepines and Z-drugs; aged 65 + : skeletal muscle relaxants, tricyclic antidepressants, and antihistamines) and (2) decision support for their primary health care providers. Outcomes are examined over 18-26 months post-intervention. The primary outcome is first incident (post-baseline) medically treated fall as determined from health plan data. Our sample size calculations ensure at least 80% power to detect a 20% reduction in the rate of medically treated falls for participants receiving care within the intervention (n = 9) versus usual care clinics (n = 9) assuming 18 months of follow-up. Secondary outcomes include medication discontinuation or dose reduction of any target medications. Safety outcomes include serious adverse drug withdrawal events, unintentional overdose, and death. We will also examine medication signetur fields for attempts to decrease medications. We will report factors affecting implementation of the intervention.

DISCUSSION

The STOP-FALLS trial will provide new information about whether a health-system-embedded deprescribing intervention that targets older participants and their primary care providers reduces medically treated falls and CNS-active medication use. Insights into factors affecting implementation will inform future research and healthcare organizations that may be interested in replicating the intervention.

TRIAL REGISTRATION

ClinicalTrial.gov NCT05689554. Registered on 18 January 2023, retrospectively registered.

Engagement is a necessary condition to test audit and feedback design features: results of a pragmatic, factorial, cluster-randomized trial with an embedded process evaluation

BACKGROUND

While audit & feedback (A&F) is an effective implementation intervention, the design elements which maximize effectiveness are unclear. Partnering with a healthcare quality advisory organization already delivering feedback, we conducted a pragmatic, 2 × 2 factorial, cluster-randomized trial to test the impact of variations in two factors: (A) the benchmark used for comparison and (B) information framing. An embedded process evaluation explored hypothesized mechanisms of effect.

METHODS

Eligible physicians worked in nursing homes in Ontario, Canada, and had voluntarily signed up to receive the report. Groups of nursing homes sharing physicians were randomized to (A) physicians' individual prescribing rates compared to top-performing peers (the top quartile) or the provincial median and (B) risk-framed information (reporting the number of patients prescribed high-risk medication) or benefit-framed information (reporting the number of patients not prescribed). We hypothesized that the top quartile comparator and risk-framing would lead to greater practice improvements. The primary outcome was the mean number of central nervous system-active medications per resident per month. Primary analyses compared the four arms at 6 months post-intervention. Factorial analyses were secondary. The process evaluation comprised a follow-up questionnaire and semi-structured interviews.

RESULTS

Two hundred sixty-seven physicians (152 clusters) were randomized: 67 to arm 1 (median benchmark, benefit framing), 65 to arm 2 (top quartile benchmark, benefit framing), 75 to arm 3 (median benchmark, risk framing), and 60 to arm 4 (top quartile benchmark, risk framing). There were no significant differences in the primary outcome across arms or for each factor. However, engagement was low (27-31% of physicians across arms downloaded the report). The process evaluation indicated that both factors minimally impacted the proposed mechanisms. However, risk-framed feedback was perceived as more actionable and more compatible with current workflows, whilst a higher target might encourage behaviour change when physicians identified with the comparator.

CONCLUSIONS

Risk framing and a top quartile comparator have the potential to achieve change. Further work to establish the strategies most likely to enhance A&F engagement, particularly with physicians who may be most likely to benefit from feedback, is required to support meaningfully addressing intricate research questions concerning the design of A&F.

TRIAL REGISTRATION

ClinicalTrials.gov, NCT02979964 . Registered 29 November 2016.

A scoping review described diversity in methods of randomization and reporting of baseline balance in stepped-wedge cluster randomized trials

OBJECTIVES

In stepped-wedge cluster randomized trials (SW-CRTs), clusters are randomized not to treatment and control arms but to sequences dictating the times of crossing from control to intervention conditions. Randomization is an essential feature of this design but application of standard methods to promote and report on balance at baseline is not straightforward. We aimed to describe current methods of randomization and reporting of balance at baseline in SW-CRTs.

STUDY DESIGN AND SETTING

We used electronic searches to identify primary reports of SW-CRTs published between 2016 and 2022.

RESULTS

Across 160 identified trials, the median number of clusters randomized was 11 (Q1-Q3: 8-18). Sixty-three (39%) used restricted randomization-most often stratification based on a single cluster-level covariate; 12 (19%) of these adjusted for the covariate(s) in the primary analysis. Overall, 50 (31%) and 134 (84%) reported on balance at baseline on cluster- and individual-level characteristics, respectively. Balance on individual-level characteristics was most often reported by condition in cross-sectional designs and by sequence in cohort designs. Authors reported baseline imbalances in 72 (45%) trials.

CONCLUSION

SW-CRTs often randomize a small number of clusters using unrestricted allocation. Investigators need guidance on appropriate methods of randomization and assessment and reporting of balance at baseline.

Minimisation for the design of parallel cluster-randomised trials: An evaluation of balance in cluster-level covariates and numbers of clusters allocated to each arm

BACKGROUND

Cluster-randomised trials often use some form of restricted randomisation, such as stratified- or covariate-constrained randomisation. Minimisation has the potential to balance on more covariates than blocked stratification and can be implemented sequentially unlike covariate-constrained randomisation. Yet, unlike stratification, minimisation has no inbuilt guard to maintain close to a 1:1 allocation. A departure from a 1:1 allocation can be unappealing in a setting with a small number of allocation units such as cluster randomisation which typically include about 30 clusters.

METHODS

Using simulation (10,000 per scenario), we evaluate the performance of a range of minimisation procedures on the likelihood of a 1:1 allocation of clusters (10-80 clusters) to treatment arms, along with its performance on covariate imbalance. The range of minimisation procedures includes varying: the proportion of clusters allocated to the least imbalanced arm (known as the stochastic element) - between 0.7 and 1, percentage of first clusters allocated completely at random (known as the bed-in period) - between 0% and 20% and adding 'number of clusters allocated to each arm' as a covariate in the minimisation algorithm. We additionally include a comparison of stratifying and then minimising within key strata (such as country within a multi country cluster trial) as a potential aid to increasing balance.

RESULTS

Minimisation is unlikely to result in an exact 1:1 allocation unless the stochastic element is set higher than 0.9. For example, with 20 clusters, 2 binary covariates and setting the stochastic element to 0.7: only 41% of the possible randomisations over the 10,000 simulations achieved a 1:1 allocation. While typical sizes of imbalance were small (a difference of two clusters per arm), allocations as extreme as of 10:10 were observed. Adding the 'number of clusters' into the minimisation algorithm reduces this risk slightly, but covariate imbalance increases slightly. Stratifying and then minimising within key strata improve balance within strata but increase imbalance across all clusters, both on the number of clusters and covariate imbalance.

CONCLUSION

In cluster trials, where there are typically about 30 allocation units, when using minimisation, unless the stochastic element is set very high, there is a high risk of not achieving a 1:1 allocation, and a small but nonetheless real risk of an extreme departure from a 1:1 allocation. Stratification with minimisation within key strata (such as country) improves the balance within strata although compromises overall balance.

Propensity scores as a novel method to guide sample allocation and minimize batch effects during the design of high throughput experiments

BACKGROUND

We developed a novel approach to minimize batch effects when assigning samples to batches. Our algorithm selects a batch allocation, among all possible ways of assigning samples to batches, that minimizes differences in average propensity score between batches. This strategy was compared to randomization and stratified randomization in a case-control study (30 per group) with a covariate (case vs control, represented as β1, set to be null) and two biologically relevant confounding variables (age, represented as β2, and hemoglobin A1c (HbA1c), represented as β3). Gene expression values were obtained from a publicly available dataset of expression data obtained from pancreas islet cells. Batch effects were simulated as twice the median biological variation across the gene expression dataset and were added to the publicly available dataset to simulate a batch effect condition. Bias was calculated as the absolute difference between observed betas under the batch allocation strategies and the true beta (no batch effects). Bias was also evaluated after adjustment for batch effects using ComBat as well as a linear regression model. In order to understand performance of our optimal allocation strategy under the alternative hypothesis, we also evaluated bias at a single gene associated with both age and HbA1c levels in the 'true' dataset (CAPN13 gene).

RESULTS

Pre-batch correction, under the null hypothesis (β1), maximum absolute bias and root mean square (RMS) of maximum absolute bias, were minimized using the optimal allocation strategy. Under the alternative hypothesis (β2 and β3 for the CAPN13 gene), maximum absolute bias and RMS of maximum absolute bias were also consistently lower using the optimal allocation strategy. ComBat and the regression batch adjustment methods performed well as the bias estimates moved towards the true values in all conditions under both the null and alternative hypotheses. Although the differences between methods were less pronounced following batch correction, estimates of bias (average and RMS) were consistently lower using the optimal allocation strategy under both the null and alternative hypotheses.

CONCLUSIONS

Our algorithm provides an extremely flexible and effective method for assigning samples to batches by exploiting knowledge of covariates prior to sample allocation.

Reducing ethnic and racial disparities by improving undertreatment, control, and engagement in blood pressure management with health information technology (REDUCE-BP) hybrid effectiveness-implementation pragmatic trial: Rationale and design

BACKGROUND

While racial/ethnic disparities in blood pressure control are documented, few interventions have successfully reduced these gaps. Under-prescribing, lack of treatment intensification, and suboptimal follow-up care are thought to be central contributors. Electronic health record (EHR) tools may help address these barriers and may be enhanced with behavioral science techniques.

OBJECTIVE

To evaluate the impact of a multicomponent behaviorally-informed EHR-based intervention on blood pressure control.

TRIAL DESIGN

Reducing Ethnic and racial Disparities by improving Undertreatment, Control, and Engagement in Blood Pressure management with health information technology (REDUCE-BP) (NCT05030467) is a two-arm cluster-randomized hybrid type 1 pragmatic trial in a large multi-ethnic health care system. Twenty-four clinics (>350 primary care providers [PCPs] and >10,000 eligible patients) are assigned to either multi-component EHR-based intervention or usual care. Intervention clinic PCPs will receive several EHR tools designed to reduce disparities delivered at different points, including a: (1) dashboard of all patients visible upon logging on to the EHR displaying blood pressure control by race/ethnicity compared to their PCP peers and (2) set of tools in an individual patient's chart containing decision support to encourage treatment intensification, ordering home blood pressure measurement, interventions to address health-related social needs, default text for note documentation, and enhanced patient education materials. The primary outcome is patient-level change in systolic blood pressure over 12 months between arms; secondary outcomes include changes in disparities and other clinical outcomes.

CONCLUSION

REDUCE-BP will provide important insights into whether an EHR-based intervention designed using behavioral science can improve hypertension control and reduce disparities.

Sustainable deimplementation of continuous pulse oximetry monitoring in children hospitalized with bronchiolitis: study protocol for the Eliminating Monitor Overuse (EMO) type III effectiveness-deimplementation cluster-randomized trial

Background

Methods of sustaining the deimplementation of overused medical practices (i.e., practices not supported by evidence) are understudied. In pediatric hospital medicine, continuous pulse oximetry monitoring of children with the common viral respiratory illness bronchiolitis is recommended only under specific circumstances. Three national guidelines discourage its use for children who are not receiving supplemental oxygen, but guideline-discordant practice (i.e., overuse) remains prevalent. A 6-hospital pilot of educational outreach with audit and feedback resulted in immediate reductions in overuse; however, the best strategies to optimize sustainment of deimplementation success are unknown.

Methods

The Eliminating Monitor Overuse (EMO) trial will compare two deimplementation strategies in a hybrid type III effectiveness-deimplementation trial. This longitudinal cluster-randomized design will be conducted in Pediatric Research in Inpatient Settings (PRIS) Network hospitals and will include baseline measurement, active deimplementation, and sustainment phases. After a baseline measurement period, 16–19 hospitals will be randomized to a deimplementation strategy that targets unlearning (educational outreach with audit and feedback), and the other 16–19 will be randomized to a strategy that targets unlearning and substitution (adding an EHR-integrated clinical pathway decision support tool). The primary outcome is the sustainment of deimplementation in bronchiolitis patients who are not receiving any supplemental oxygen, analyzed as a longitudinal difference-in-differences comparison of overuse rates across study arms. Secondary outcomes include equity of deimplementation and the fidelity to, and cost of, each deimplementation strategy. To understand how the deimplementation strategies work, we will test hypothesized mechanisms of routinization (clinicians developing new routines supporting practice change) and institutionalization (embedding of practice change into existing organizational systems).

Discussion

The EMO trial will advance the science of deimplementation by providing new insights into the processes, mechanisms, costs, and likelihood of sustained practice change using rigorously designed deimplementation strategies. The trial will also advance care for a high-incidence, costly pediatric lung disease.

Trial registration

ClinicalTrials.gov,NCT05132322. Registered on November 10, 2021.

Supplementary Information

The online version contains supplementary material available at 10.1186/s13012-022-01246-z.

Performance of model-based vs. permutation tests in the HEALing (Helping to End Addiction Long-termSM) Communities Study, a covariate-constrained cluster randomized trial

BACKGROUND

The HEALing (Helping to End Addiction Long-term^SM) Communities Study (HCS) is a multi-site parallel group cluster randomized wait-list comparison trial designed to evaluate the effect of the Communities That Heal (CTH) intervention compared to usual care on opioid overdose deaths. Covariate-constrained randomization (CCR) was applied to balance the community-level baseline covariates in the HCS. The purpose of this paper is to evaluate the performance of model-based tests and permutation tests in the HCS setting. We conducted a simulation study to evaluate type I error rates and power for model-based and permutation tests for the multi-site HCS as well as for a subgroup analysis of a single state (Massachusetts). We also investigated whether the maximum degree of imbalance in the CCR design has an impact on the performance of the tests.

METHODS

The primary outcome, the number of opioid overdose deaths, is count data assessed at the community level that will be analyzed using a negative binomial regression model. We conducted a simulation study to evaluate the type I error rates and power for 3 tests: (1) Wald-type t-test with small-sample corrected empirical standard error estimates, (2) Wald-type z-test with model-based standard error estimates, and (3) permutation test with test statistics calculated by the difference in average residuals for the two groups.

RESULTS

Our simulation results demonstrated that Wald-type t-tests with small-sample corrected empirical standard error estimates from the negative binomial regression model maintained proper type I error. Wald-type z-tests with model-based standard error estimates were anti-conservative. Permutation tests preserved type I error rates if the constrained space was not too small. For all tests, the power was high to detect the hypothesized 40% reduction in opioid overdose deaths for the intervention vs. comparison group both for the overall HCS and the subgroup analysis of Massachusetts (MA).

CONCLUSIONS

Based on the results of our simulation study, the Wald-type t-test with small-sample corrected empirical standard error estimates from a negative binomial regression model is a valid and appropriate approach for analyzing cluster-level count data from the HEALing Communities Study.

TRIAL REGISTRATION

ClinicalTrials.gov http://www.

CLINICALTRIALS

gov ; Identifier: NCT04111939.

Effectiveness of universal school-based mindfulness training compared with normal school provision on teacher mental health and school climate: results of the MYRIAD cluster randomised controlled trial

BACKGROUND

Education is broader than academic teaching. It includes teaching students social-emotional skills both directly and indirectly through a positive school climate.

OBJECTIVE

To evaluate if a universal school-based mindfulness training (SBMT) enhances teacher mental health and school climate.

METHODS

The My Resilience in Adolescence parallel group, cluster randomised controlled trial (registration: ISRCTN86619085; funding: Wellcome Trust (WT104908/Z/14/Z, WT107496/Z/15/Z)) recruited 85 schools (679 teachers) delivering social and emotional teaching across the UK. Schools (clusters) were randomised 1:1 to either continue this provision (teaching as usual (TAU)) or include universal SBMT. Data on teacher mental health and school climate were collected at prerandomisation, postpersonal mindfulness and SBMT teacher training, after delivering SBMT to students, and at 1-year follow-up.

FINDING

Schools were recruited in academic years 2016/2017 and 2017/2018. Primary analysis (SBMT: 43 schools/362 teachers; TAU: 41 schools/310 teachers) showed that after delivering SBMT to students, SBMT versus TAU enhanced teachers' mental health (burnout) and school climate. Adjusted standardised mean differences (SBMT minus TAU) were: exhaustion (-0.22; 95% CI -0.38 to -0.05); personal accomplishment (-0.21; -0.41, -0.02); school leadership (0.24; 0.04, 0.44); and respectful climate (0.26; 0.06, 0.47). Effects on burnout were not significant at 1-year follow-up. Effects on school climate were maintained only for respectful climate. No SBMT-related serious adverse events were reported.

CONCLUSIONS

SBMT supports short-term changes in teacher burnout and school climate. Further work is required to explore how best to sustain improvements.

CLINICAL IMPLICATIONS

SBMT has limited effects on teachers' mental and school climate. Innovative approaches to support and preserve teachers' mental health and school climate are needed.

Effectiveness and cost-effectiveness of universal school-based mindfulness training compared with normal school provision in reducing risk of mental health problems and promoting well-being in adolescence: the MYRIAD cluster randomised controlled trial

BACKGROUND

Systematic reviews suggest school-based mindfulness training (SBMT) shows promise in promoting student mental health.

OBJECTIVE

The My Resilience in Adolescence (MYRIAD) Trial evaluated the effectiveness and cost-effectiveness of SBMT compared with teaching-as-usual (TAU).

METHODS

MYRIAD was a parallel group, cluster-randomised controlled trial. Eighty-five eligible schools consented and were randomised 1:1 to TAU (43 schools, 4232 students) or SBMT (42 schools, 4144 students), stratified by school size, quality, type, deprivation and region. Schools and students (mean (SD); age range=12.2 (0.6); 11-14 years) were broadly UK population-representative. Forty-three schools (n=3678 pupils; 86.9%) delivering SBMT, and 41 schools (n=3572; 86.2%) delivering TAU, provided primary end-point data. SBMT comprised 10 lessons of psychoeducation and mindfulness practices. TAU comprised standard social-emotional teaching. Participant-level risk for depression, social-emotional-behavioural functioning and well-being at 1 year follow-up were the co-primary outcomes. Secondary and economic outcomes were included.

FINDINGS

Analysis of 84 schools (n=8376 participants) found no evidence that SBMT was superior to TAU at 1 year. Standardised mean differences (intervention minus control) were: 0.005 (95% CI -0.05 to 0.06) for risk for depression; 0.02 (-0.02 to 0.07) for social-emotional-behavioural functioning; and 0.02 (-0.03 to 0.07) for well-being. SBMT had a high probability of cost-effectiveness (83%) at a willingness-to-pay threshold of £20 000 per quality-adjusted life year. No intervention-related adverse events were observed.

CONCLUSIONS

Findings do not support the superiority of SBMT over TAU in promoting mental health in adolescence.

CLINICAL IMPLICATIONS

There is need to ask what works, for whom and how, as well as considering key contextual and implementation factors.

TRIAL REGISTRATION

Current controlled trials ISRCTN86619085. This research was funded by the Wellcome Trust (WT104908/Z/14/Z and WT107496/Z/15/Z).

Systematic review of the characteristics of school-based feasibility cluster randomised trials of interventions for improving the health of pupils in the UK

Background

The last 20 years have seen a marked increase in the use of cluster randomised trials (CRTs) in schools to evaluate interventions for improving pupil health outcomes. Schools have limited resources and participating in full-scale trials can be challenging and costly, given their main purpose is education. Feasibility studies can be used to identify challenges with implementing interventions and delivering trials. This systematic review summarises methodological characteristics and objectives of school-based cluster randomised feasibility studies in the United Kingdom (UK).

Methods

We systematically searched MEDLINE from inception to 31 December 2020. Eligible papers were school-based feasibility CRTs that included health outcomes measured on pupils.

Results

Of 3285 articles identified, 24 were included. School-based feasibility CRTs have been increasingly used in the UK since the first publication in 2008. Five (21%) studies provided justification for the use of the CRT design. Three (13%) studies provided details of a formal sample size calculation, with only one of these allowing for clustering. The median (IQR; range) recruited sample size was 7.5 (4.5 to 9; 2 to 37) schools and 274 (179 to 557; 29 to 1567) pupils. The most common feasibility objectives were to estimate the potential effectiveness of the intervention (n = 17; 71%), assess acceptability of the intervention (n = 16; 67%), and estimate the recruitment/retention rates (n = 15; 63%). Only one study was used to assess whether cluster randomisation was appropriate, and none of the studies that randomised clusters before recruiting pupils assessed the possibility of recruitment bias. Besides potential effectiveness, cost-effectiveness, and the intra-cluster correlation coefficient, no studies quantified the precision of the feasibility parameter estimates.

Conclusions

Feasibility CRTs are increasingly used in schools prior to definitive trials of interventions for improving health in pupils. The average sample size of studies included in this review would be large enough to estimate pupil-level feasibility parameters (e.g., percentage followed up) with reasonable precision. The review highlights the need for clearer sample size justification and better reporting of the precision with which feasibility parameters are estimated. Better use could be made of feasibility CRTs to assess challenges that are specific to the cluster design.

Trial registration

PROSPERO: CRD42020218993.

Supplementary Information

The online version contains supplementary material available at 10.1186/s40814-022-01098-w.

A comparison of analytical strategies for cluster randomized trials with survival outcomes in the presence of competing risks

While statistical methods for analyzing cluster randomized trials with continuous and binary outcomes have been extensively studied and compared, little comparative evidence has been provided for analyzing cluster randomized trials with survival outcomes in the presence of competing risks. Motivated by the Strategies to Reduce Injuries and Develop Confidence in Elders trial, we carried out a simulation study to compare the operating characteristics of several existing population-averaged survival models, including the marginal Cox, marginal Fine and Gray, and marginal multi-state models. For each model, we found that adjusting for the intraclass correlations through the sandwich variance estimator effectively maintained the type I error rate when the number of clusters is large. With no more than 30 clusters, however, the sandwich variance estimator can exhibit notable negative bias, and a permutation test provides better control of type I error inflation. Under the alternative, the power for each model is differentially affected by two types of intraclass correlations-the within-individual and between-individual correlations. Furthermore, the marginal Fine and Gray model occasionally leads to higher power than the marginal Cox model or the marginal multi-state model, especially when the competing event rate is high. Finally, we provide an illustrative analysis of Strategies to Reduce Injuries and Develop Confidence in Elders trial using each analytical strategy considered.

The impact of a package of behaviour change interventions on breastfeeding practices in East Java Province, Indonesia

Suboptimal infant young child feeding practices are frequently reported globally, including in Indonesia. This analysis examined the impact of a package of behaviour change interventions on breastfeeding practices in Malang and Sidoarjo Districts, East Java Province, Indonesia. The BADUTA study (which in the Indonesian Language is an acronym for BAwah DUa TAhun, or children aged less than 2 years) was an impact evaluation using a cluster‐randomized controlled trial with two parallel treatment arms. We conducted household surveys in 12 subdistricts from Malang and Sidoarjo. We collected information from 5175 mothers of children aged 0–23 months: 2435 mothers at baseline (February 2015) and 2740 mothers at endline (January to February 2017). This analysis used two indicators for fever and diarrhoea and seven breastfeeding indicators (early initiation of breastfeeding, prelacteal feeding, exclusive breastfeeding under 6 months, predominant breastfeeding, continued breastfeeding, age‐appropriate breastfeeding and bottle‐feeding). We used multilevel logistic regression analysis to assess the effect of the intervention. After 2 years of implementation of interventions, we observed an increased odds of exclusive breastfeeding under 6 months (adjusted odds ratio [aOR] = 1.85; 95% confidence interval [CI]: 1.35–2.53) and age‐appropriate breastfeeding (aOR = 1.39; 95% CI: 1.07–1.79) in the intervention group than in the comparison group, at the endline survey. We found significantly lower odds for prelacteal feeding (aOR = 0.52; 95% CI: 0.41–0.65) in the intervention than in the comparison group. Our findings confirmed the benefits of integrated, multilayer behaviour change interventions to promote breastfeeding practices. Further research is required to develop effective interventions to reduce bottle use and improve other breastfeeding indicators that did not change with the BADUTA intervention.

The integrated package of behaviour change interventions in the BADUTA study (which in the Indonesian Language is an acronym for BAwah DUa TAhun, or children aged less than 2 years) increased exclusive and age‐appropriate breastfeeding practices in children under 2 years old in Indonesia.

The BADUTA study interventions did not significantly affect early breastfeeding initiation, breastfeeding in the last 24 h, ever breastfed, continued breastfeeding, predominant breastfeeding, bottle‐feeding practices, fever and diarrhoea 2 weeks before the interview.

Further research is required to develop effective interventions to improve continued breastfeeding after 12 months of age and reduce predominant breastfeeding for children aged 0–5 months and bottle‐feeding practices.

Effectiveness of a home-environmental intervention package and an early child development intervention on child health and development in high-altitude rural communities in the Peruvian Andes: a cluster-randomised controlled trial

BACKGROUND

Unsafe drinking water, poor sanitation and hygiene, exposure to household air pollution and low cognitive and socio-emotional stimulation are risk factors affecting children in low- and middle-income countries. We implemented an integrated home-environmental intervention package (IHIP), comprising a kitchen sink, hygiene education and a certified improved biomass cookstove, and an early child development (ECD) programme to improve children´s health and developmental outcomes in the rural high-altitude Andes of Peru.

METHODS

We conducted a one-year cluster-randomised controlled trial among 317 children < 36 months divided into 4 arms (IHIP + ECD, IHIP, ECD, and Control) and 40 clusters (10 clusters per arm). ECD status (socio-emotional, fine and gross motor, communication, cognitive skills, and an overall performance) measured with the Peruvian Infant Development Scale and the occurrence of self-reported child diarrhoea from caretakers were primary outcomes. Secondary outcomes included the occurrence of acute respiratory infections and the presence of thermo-tolerant faecal bacteria in drinking water. The trial was powered to compare each intervention against its control arm but it did not allow pairwise comparisons among the four arms. Primary analysis followed the intention-to-treat principle. For the statistical analysis, we employed generalised estimating equation models with robust standard errors and an independent correlation structure.

RESULTS

We obtained ECD information from 101 children who received the ECD intervention (individually and combined with IHIP) and 102 controls. Children who received the ECD intervention performed better in all the domains compared to controls. We found differences in the overall performance (64 vs. 39%, odd ratio (OR): 2.8; 95% confidence interval (CI): 1.6-4.9) and the cognitive domain (62 vs 46%, OR: 1.9; 95% CI: 1.1-3.5). Data analysis of child morbidity included 154 children who received the IHIP intervention (individually and combined with ECD) and 156 controls. We recorded 110,666 child-days of information on diarrhoea morbidity and observed 1.3 mean episodes per child-year in the children who received the IHIP intervention and 1.1 episodes in the controls. This corresponded to an incidence risk ratio of 1.2 (95% CI: 0.8-1.7).

CONCLUSIONS

Child stimulation improved developmental status in children, but there was no health benefit associated with the home-environmental intervention. Limited year-round access to running water at home and the possible contamination of drinking water after boiling were two potential factors linked to the lack of effect of the home-environmental intervention. Potential interactions between ECD and home-environmental interventions need to be further investigated.

TRIAL REGISTRATION

ISRCTN, ISRCTN-26548981. Registered 15 January 2018-Retrospectively registered, https://doi.org/10.1186/ISRCTN26548981 .

A general practice intervention for people at risk of poor health outcomes: the Flinders QUEST cluster randomised controlled trial and economic evaluation

Objective

To determine whether a multicomponent general practice intervention cost‐effectively improves health outcomes and reduces health service use for patients at high risk of poor health outcomes.

Design, setting

Clustered randomised controlled trial in general practices in metropolitan Adelaide.

Participants

Three age‐based groups of patients identified by their general practitioners as being at high risk of poor health outcomes: children and young people (under 18 years), adults (18–64 years) with two or more chronic diseases, and older people (65 years or more).

Intervention

Enrolment of patients with a preferred GP, longer general practice appointments, and general practice follow‐up within seven days of emergency department and hospital care episodes. Intervention practices received payment of $1000 per enrolled participant.

Main outcome measures

Primary outcome: change in self‐rated health between baseline and 12‐month follow‐up for control (usual care) and intervention groups. Secondary outcomes: numbers of emergency department presentations and hospital admissions, Medicare specialist claims and Pharmaceutical Benefits Scheme (PBS) items supplied, Health Literacy Questionnaire scores, and cost‐effectiveness of the intervention (based on the number of quality‐adjusted life‐years [QALYs] gained over 12 months, derived from EQ‐5D‐5L utility scores for the two adult groups).

Results

Twenty practices with a total of 92 GPs were recruited, and 1044 eligible patients participated. The intervention did not improve self‐rated health (coefficient, –0.29; 95% CI, –2.32 to 1.73), nor did it have significant effects on the numbers of emergency department presentations (incidence rate ratio [IRR], 0.90; 95% CI, 0.69–1.17), hospital admissions (IRR, 0.90; 95% CI, 0.66–1.22), Medicare specialist claims (IRR, 1.00; 95% CI, 0.91–1.09), or PBS items supplied (IRR, 0.99; 95% CI, 0.96–1.03), nor on Health Literacy Questionnaire scores. The intervention was effective in terms of QALYs gained (v usual care: difference, 0.032 QALYs; 95% CI, 0.001–0.063), but the incremental cost‐effectiveness ratio was $69 585 (95% CI, $22 968–$116 201) per QALY gained, beyond the willingness‐to‐pay threshold.

Conclusions

Our multicomponent intervention did not improve self‐rated health, health service use, or health literacy. It achieved greater improvement in quality of life than usual care, but not cost‐effectively.

Trial registration

Australian New Zealand Clinical Trials Registry, ACTRN12617001589370 (prospective).

Mind the gap: covariate constrained randomisation can protect against substantial power loss in parallel cluster randomised trials

Background

Cluster randomised trials often randomise a small number of units, putting them at risk of poor balance of covariates across treatment arms. Covariate constrained randomisation aims to reduce this risk by removing the worst balanced allocations from consideration. This is known to provide only a small gain in power over that averaged under simple randomisation and is likely influenced by the number and prognostic effect of the covariates.

We investigated the performance of covariate constrained randomisation in comparison to the worst balanced allocations, and considered the impact on the power of the prognostic effect and number of covariates adjusted for in the analysis.

Methods

Using simulation, we examined the Monte Carlo type I error rate and power of cross-sectional, two-arm parallel cluster-randomised trials with a continuous outcome and four binary cluster-level covariates, using either simple or covariate constrained randomisation. Data were analysed using a small sample corrected linear mixed-effects model, adjusted for some or all of the binary covariates. We varied the number of clusters, intra-cluster correlation, number and prognostic effect of covariates balanced in the randomisation and adjusted in the analysis, and the size of the candidate set from which the allocation was selected. For each scenario, 20,000 simulations were conducted.

Results

When compared to the worst balanced allocations, covariate constrained randomisation with an adjusted analysis provided gains in power of up to 20 percentage points. Even with analysis-based adjustment for those covariates balanced in the randomisation, the type I error rate was not maintained when the intracluster correlation is very small (0.001). Generally, greater power was achieved when more prognostic covariates are restricted in the randomisation and as the size of the candidate set decreases. However, adjustment for weakly prognostic covariates lead to a loss in power of up to 20 percentage points.

Conclusions

When compared to the worst balanced allocations, covariate constrained randomisation provides moderate to substantial improvements in power. However, the prognostic effect of the covariates should be carefully considered when selecting them for inclusion in the randomisation.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12874-022-01588-8.

Multifaceted intervention to reduce haemodialysis catheter related bloodstream infections: REDUCCTION stepped wedge, cluster randomised trial

OBJECTIVE

To identify whether multifaceted interventions, or care bundles, reduce catheter related bloodstream infections (CRBSIs) from central venous catheters used for haemodialysis.

DESIGN

Stepped wedge, cluster randomised design.

SETTING

37 renal services across Australia.

PARTICIPANTS

All adults (age ≥18 years) under the care of a renal service who required insertion of a new haemodialysis catheter.

INTERVENTIONS

After a baseline observational phase, a service-wide, multifaceted intervention bundle that included elements of catheter care (insertion, maintenance, and removal) was implemented at one of three randomly assigned time points (12 at the first time point, 12 at the second, and 13 at the third) between 20 December 2016 and 31 March 2020.

MAIN OUTCOMES MEASURE

The primary endpoint was the rate of CRBSI in the baseline phase compared with intervention phase at the renal service level using the intention-to-treat principle.

RESULTS

1.14 million haemodialysis catheter days of use were monitored across 6364 patients. Patient characteristics were similar across baseline and intervention phases. 315 CRBSIs occurred (158 in the baseline phase and 157 in the intervention phase), with a rate of 0.21 per 1000 days of catheter use in the baseline phase and 0.29 per 1000 days in the intervention phase, giving an incidence rate ratio of 1.37 (95% confidence interval 0.85 to 2.21; P=0.20). This translates to one in 10 patients who undergo dialysis for a year with a catheter experiencing an episode of CRBSI.

CONCLUSIONS

Among patients who require a haemodialysis catheter, the implementation of a multifaceted intervention did not reduce the rate of CRBSI. Multifaceted interventions to prevent CRBSI might not be effective in clinical practice settings.

TRIAL REGISTRATION

Australia New Zealand Clinical Trials Registry ACTRN12616000830493.

Practical issues in operationalizing the design and outcome evaluation of cluster randomized trials

Trial designs using cluster-level randomization are necessary when interventions have intended effects that cannot be measured with individual randomization. When an intervention is intrinsically only able to be delivered to a cluster or when implementation of an individual level intervention is only feasibly implemented at a cluster level, cluster-level randomization is required. In designing the strategy for evaluation of the primary outcome of a cluster randomized trial, there are a multitude of important decisions to consider. While these decisions are guided primarily by the intervention-who benefits, what is the intended effect and when will it be achieved-there are important detailed choices that affect potential bias and statistical power, and implementation considerations that require compromise for considerations of feasibility and practicality. Through the lens of three large completed cluster randomized trials in HIV prevention, we present specific choices made for the overall evaluation plan, together with some of the detailed considerations, compromises and modifications that occurred during trial implementation.

Randomization: Beyond the closurization principle

Many cluster randomized trials have relatively few numbers of clusters to be randomized. When baseline cluster-level covariates are available prior to randomization, the set of potential allocations can be restricted so as to ensure balance across study arms. This article discusses why and how restrictions can be made, and the ramifications of so doing. The Fisher-Bailey validity is explained, and examples are given regarding the tradeoff between balance and validity.

Effect of Clinical Decision Support on Cardiovascular Risk Among Adults With Bipolar Disorder, Schizoaffective Disorder, or Schizophrenia: A Cluster Randomized Clinical Trial

IMPORTANCE

Adults with schizophrenia, schizoaffective disorder, or bipolar disorder, collectively termed serious mental illness (SMI), have shortened life spans compared with people without SMI. The leading cause of death is cardiovascular (CV) disease.

OBJECTIVE

To assess whether a clinical decision support (CDS) system aimed at primary care clinicians improves CV health for adult primary care patients with SMI.

DESIGN, SETTING, AND PARTICIPANTS

In this cluster randomized clinical trial conducted from March 2, 2016, to September 19, 2018, restricted randomization assigned 76 primary care clinics in 3 Midwestern health care systems to receive or not receive a CDS system aimed at improving CV health among patients with SMI. Eligible clinics had at least 20 patients with SMI; clinicians and their adult patients with SMI with at least 1 modifiable CV risk factor not at the goal set by the American College of Cardiology/American Heart Association guidelines were included. Statistical analysis was conducted on an intention-to-treat basis from January 10, 2019, to December 29, 2021.

INTERVENTION

The CDS system assessed modifiable CV risk factors and provided personalized treatment recommendations to clinicians and patients.

MAIN OUTCOMES AND MEASURES

Patient-level change in total modifiable CV risk over 12 months, summed from individual modifiable risk factors (smoking, body mass index, low-density lipoprotein cholesterol level, systolic blood pressure, and hemoglobin A1c level).

RESULTS

A total of 80 clinics were randomized; 4 clinics were excluded for having fewer than 20 eligible patients, leaving 42 intervention clinics and 34 control clinics. A total of 8937 patients with SMI (4922 women [55.1%]; mean [SD] age, 48.4 [13.5] years) were enrolled. There was a 4% lower rate of increase in total modifiable CV risk among intervention patients relative to control patients (relative rate ratio [RR], 0.96; 95% CI, 0.94-0.98). The intervention favored patients who were 18 to 29 years of age (RR, 0.89; 95% CI, 0.81-0.98) or 50 to 59 years of age (RR, 0.93; 95% CI, 0.90-0.96), Black (RR, 0.93; 95% CI, 0.88-0.98), or White (RR, 0.96; 95% CI, 0.94-0.98). Men (RR, 0.96; 95% CI, 0.94-0.99) and women (RR, 0.95; 95% CI, 0.92-0.97), as well as patients with any SMI subtype (bipolar disorder: RR, 0.96; 95% CI, 0.94-0.99; schizoaffective disorder: RR, 0.94; 95% CI, 0.90-0.98; schizophrenia: RR, 0.92; 95% CI, 0.85-0.99) also benefited from the intervention. Despite treatment effects favoring the intervention, there were no significant differences in individual modifiable risk factors.

CONCLUSIONS AND RELEVANCE

This CDS intervention resulted in a rate of change in total modifiable CV risk that was 4% lower among intervention patients compared with control patients. Results were driven by the cumulative effects of incremental and mostly nonsignificant changes in individual modifiable risk factors. These findings emphasize the value of using CDS to prompt early primary care intervention for adults with SMI.

TRIAL REGISTRATION

ClinicalTrials.gov Identifier: NCT02451670.

Study protocol for a cluster randomized trial of a school, family, and community intervention for preventing drug misuse among older adolescents in the Cherokee Nation

BACKGROUND

The national opioid crisis has disproportionately burdened rural White populations and American Indian/Alaska Native (AI/AN) populations. Therefore, Cherokee Nation and Emory University public health scientists have designed an opioid prevention trial to be conducted in rural communities in the Cherokee Nation (northeast Oklahoma) with AI and other (mostly White) adolescents and young adults. Our goal is to implement and evaluate a theory-based, integrated multi-level community intervention designed to prevent the onset and escalation of opioid and other drug misuse. Two distinct intervention approaches-community organizing, as implemented in our established Communities Mobilizing for Change and Action (CMCA) intervention protocol, and universal school-based brief intervention and referral, as implemented in our established Connect intervention protocol-will be integrated with skill-based training for adults to strengthen social support for youth and also with strategic media. Furthermore, we will test systems for sustained implementation within existing organizational structures of the Cherokee Nation and local schools and communities. This study protocol describes the cluster randomized trial, designed to measure implementation and evaluate the effectiveness on primary and secondary outcomes.

METHODS

Using a cluster randomized controlled design and constrained randomization, this trial will allocate 20 high schools and surrounding communities to either an intervention or delayed-intervention comparison condition. With a proposed sample of 20 high schools, all enrolled 10th grade students in fall 2021 (ages 15 to 17) will be eligible for participation. During the trial, we will (1) implement interventions through the Cherokee Nation and measure implementation processes and fidelity, (2) measure opioid and other drug use and secondary outcomes every 6 months among a cohort of high school students followed over 3 years through their transition out of high school, (3) test via a cluster randomized trial the effect of the integrated CMCA-Connect intervention, and (4) analyze implementation costs. Primary outcomes include the number of days during the past 30 days of (1) any alcohol use, (2) heavy alcohol use (defined as having at least four, among young women, or five, among young men, standard alcoholic drinks within a couple of hours), (3) any marijuana use, and (4) prescription opioid misuse (defined as "without a doctor's prescription or differently than how a doctor or medical provider told you to use it").

DISCUSSION

This trial will expand upon previous research advancing the scientific evidence regarding prevention of opioid and other drug misuse during the critical developmental period of late adolescent transition to young adulthood among a sample of American Indian and other youth living within the Cherokee Nation reservation.

TRIAL REGISTRATION

ClinicalTrials.gov NCT04839978 . Registered on April 9, 2021. Version 4, January 26, 2022.

Constrained randomization and statistical inference for multi‐arm parallel cluster randomized controlled trials

A practical limitation of cluster randomized controlled trials (cRCTs) is that the number of available clusters may be small, resulting in an increased risk of baseline imbalance under simple randomization. Constrained randomization overcomes this issue by restricting the allocation to a subset of randomization schemes where sufficient overall covariate balance across comparison arms is achieved. However, for multi-arm cRCTs, several design and analysis issues pertaining to constrained randomization have not been fully investigated. Motivated by an ongoing multi-arm cRCT, we elaborate the method of constrained randomization and provide a comprehensive evaluation of the statistical properties of model-based and randomization-based tests under both simple and constrained randomization designs in multi-arm cRCTs, with varying combinations of design and analysis-based covariate adjustment strategies. In particular, as randomization-based tests have not been extensively studied in multi-arm cRCTs, we additionally develop most-powerful randomization tests under the linear mixed model framework for our comparisons. Our results indicate that under constrained randomization, both model-based and randomization-based analyses could gain power while preserving nominal type I error rate, given proper analysis-based adjustment for the baseline covariates. Randomization-based analyses, however, are more robust against violations of distributional assumptions. The choice of balance metrics and candidate set sizes and their implications on the testing of the pairwise and global hypotheses are also discussed. Finally, we caution against the design and analysis of multi-arm cRCTs with an extremely small number of clusters, due to insufficient degrees of freedom and the tendency to obtain an overly restricted randomization space.

Study protocol for a randomized clinical trial to evaluate the effect of the use of Xylitol gum in the prevention of caries lesions in children living in Ladakh-the Caries Prevention Xylitol in Children (CaPreXCh) trial

Background

Xylitol use is reported to be able to reduce dental plaque amount and cariogenic bacteria and, as a consequence, the caries increment. Only few data on the oral health of Ladakh’s population are available. The aim of the present protocol will be to record the caries prevalence of primary and permanent molars of schoolchildren living in Ladakh and to implement a school-based Xylitol programme, named the Caries Prevention Xylitol in Children (CaPreXCh) trial, using chewing gums.

Methods

The protocol is designed as a triple-blind randomized, controlled, parallel-group clinical trial in children aged 5–14 years. The study should have been carried out from August 2021 to August 2024 in Zanskar Valley (Ladakh), but the COVID-19 pandemic does not allow today to make predictions on the exact start. Participants will be randomly allocated into two groups: subjects who will receive a chewing gum with Xylitol (70% w/v) as only sweetener, and those who will receive a sugared chewing gum containing Maltitol (23% w/v). The subjects will be instructed to chew a total of 6 pellets for 5 min divided into 3 intakes a day (2 in the morning, 2 after the midday meal and 2 in the afternoon) for one school year. Clinical examination will comprise an oral examination in which caries index (ICDAS scores), bleeding on probing and plaque pH evaluation after sucrose challenge will be recorded at baseline (t₀); the clinical examination will be repeated after 12 months since the beginning of the chewing gum administration period (t₁), after another 12-month period (t₂) and finally after further 12 months (t₃) (24 months from the end of the chewing gum use). The primary outcome will be the caries increment measured both at enamel and dentinal levels on primary and permanent molars. Data analysis will be conducted through Kaplan-Meyer graphs to evaluate caries increment. A comparison of the methods will be carried out with Cox regression with shared frailty. The net caries increment for initial, moderate and severe caries levels, using ICDAS (Δ-initial, Δ-moderate and Δ-severe), will be calculated.

Discussion

This trial will be the first trial conducted in India assessing the efficacy of a school-based caries preventive programme through the use of chewing gum containing only Xylitol as a sweetener. The findings could help strengthen the evidence for the efficacy of Xylitol use in community-based caries prevention programmes in children.

Trial registration

Clinical trials.govNCT04420780. Registered on June 9, 2020

Supplementary Information

The online version contains supplementary material available at 10.1186/s13063-021-05828-y.