Lessons for cluster randomized trials in the twenty-first century: a systematic review of trials in primary care

Equitable Care for Hypertension: Blood Pressure and Patient-Reported Outcomes of the RICH LIFE Cluster Randomized Trial

BACKGROUND

Disparities in hypertension control are well documented but underaddressed.

METHODS

RICH LIFE (Reducing Inequities in Care of Hypertension: Lifestyle Improvement for Everyone) was a 2-arm, cluster randomized trial comparing the effect on blood pressure (BP) control (systolic BP ≤140 mm Hg, diastolic BP ≤90 mm Hg), patient activation, and disparities in BP control of 2 multilevel interventions, standard of care plus (SCP) and collaborative care/stepped care (CC/SC). SCP included BP measurement standardization, audit and feedback, and equity-leadership training. CC/SC added roles to address social or medical needs. Primary outcomes were BP control and patient activation at 12 months. Generalized estimating equations and mixed-effects regression models with fixed effects of time, intervention, and their interaction compared change in outcomes at 12 months from baseline.

RESULTS

A total of 1820 adults with uncontrolled BP and ≥1 other risk factors enrolled in the study. Their mean age was 60.3 years, and baseline BP was 152.3/85.5 mm Hg; 59.4% were women; 57.4% were Black, 33.2% were White, and 9.4% were Hispanic; 74% had hyperlipidemia; and 45.1% had type 2 diabetes. CC/SC did not improve BP control rates more than SCP. Both groups achieved statistically and clinically significant BP control rates at 12 months (CC/SC: 57.3% [95% CI, 52.7%-62.0%]; SCP: 56.7% [95% CI, 51.9%-61.5%]). Pairwise comparisons between racial and ethnic groups showed overall no significant differences in BP control at 12 months. Patients with coronary heart disease showed greater achievement of BP control in CC/SC than in SCP (64.0% [95% CI, 54.1%-73.9%] versus 50.8% [95% CI, 42.6%-59.0%]; P=0.04), as did patients in rural areas (67.3% [95% CI, 49.8%-84.8%] versus 47.8% [95% CI, 32.4%-63.2%]; P=0.01). Individuals in both arms experienced statistically and clinically significant reductions in mean systolic BP (CC/SC: -13.8 mm Hg [95% CI, -15.2 to -12.5]; SCP: -14.6 mm Hg [95% CI, -15.9 to -13.2]) and diastolic BP (CC/SC: -6.9 mm Hg [95% CI, -7.8 to -6.1]; SCP: -5.5 mm Hg [95% CI, -6.4 to -4.6]) over time. The difference in diastolic BP reduction between CC/SC and SCP over time was statistically significant (-1.4 mm Hg [95% CI, -2.6 to -0.2). Patient activation did not differ between arms. CC/SC showed greater improvements in patient ratings of chronic illness care (Patient Assessment of Chronic Illness Care score) over 12 months (0.12 [95% CI, 0.02-0.22]).

CONCLUSIONS

Adding a collaborative care team to enhanced standard of care did not improve BP control but did improve patient ratings of chronic illness care.

Evaluating tests for cluster-randomized trials with few clusters under generalized linear mixed models with covariate adjustment: A simulation study

Generalized linear mixed models (GLMM) are commonly used to analyze clustered data, but when the number of clusters is small to moderate, standard statistical tests may produce elevated type I error rates. Small-sample corrections have been proposed for continuous or binary outcomes without covariate adjustment. However, appropriate tests to use for count outcomes or under covariate-adjusted models remains unknown. An important setting in which this issue arises is in cluster-randomized trials (CRTs). Because many CRTs have just a few clusters (eg, clinics or health systems), covariate adjustment is particularly critical to address potential chance imbalance and/or low power (eg, adjustment following stratified randomization or for the baseline value of the outcome). We conducted simulations to evaluate GLMM-based tests of the treatment effect that account for the small (10) or moderate (20) number of clusters under a parallel-group CRT setting across scenarios of covariate adjustment (including adjustment for one or more person-level or cluster-level covariates) for both binary and count outcomes. We find that when the intraclass correlation is non-negligible (≥ $$ \ge $$ 0.01) and the number of covariates is small (≤ $$ \le $$ 2), likelihood ratio tests with a between-within denominator degree of freedom have type I error rates close to the nominal level. When the number of covariates is moderate (≥ $$ \ge $$ 5), across our simulation scenarios, the relative performance of the tests varied considerably and no method performed uniformly well. Therefore, we recommend adjusting for no more than a few covariates and using likelihood ratio tests with a between-within denominator degree of freedom.

Primary Care Behavioral Health in Sweden - a protocol of a cluster randomized trial evaluating outcomes related to implementation, organization, and patients (KAIROS)

BACKGROUND

Providing comprehensive and continuous care for patients whose conditions have mental or behavioral components is a central challenge in primary care and an important part of improving universal health coverage. There is a great need for high and routine availability of psychological interventions, but traditional methods for delivering psychotherapy often result in low reach and long wait times. Primary Care Behavioral Health (PCBH) is a method for organizing primary care in which behavioral health staff provide brief, flexible interventions to a large part of the population in active collaboration with other providers. While PCBH holds promise in addressing important challenges, it has not yet been thoroughly evaluated.

METHODS

This cluster randomized trial will assess 17 primary care centers (PCCs) that are starting a PCBH implementation process. The PCCs will be divided into two groups, with one starting immediate implementation and the other acting as a control, implementing six months later. The purpose of the study is to strengthen the evidence base for PCBH regarding implementation-, organization-, and patient-level outcomes, taking into consideration that there is a partially dependent relationship between the three levels. Patient outcomes (such as increased daily functioning and reduction of symptoms) may be dependent on organizational changes (such as availability of treatment, waiting times and interprofessional teamwork), which in turn requires change in implementation outcomes (most notably, model fidelity). In addition to the main analysis, five secondary analyses will compare groups based on different combinations of randomization and time periods, specifically before and after each center achieves sufficient PCBH fidelity.

DISCUSSION

A randomized comparison of PCBH and traditional primary care has, to our knowledge, not been made before. While the naturalistic setting and the intricacies of implementation pose certain challenges, we have designed this study in an effort to evaluate the causal effects of PCBH despite these complex aspects. The results of this project will be helpful in guiding decisions on how to organize the delivery of behavioral interventions and psychological treatment within the context of primary care in Sweden and elsewhere.

TRIAL REGISTRATION

ClinicalTrials.gov: NCT05335382. Retrospectively registered on March 13th, 2022.

Restricted mean survival time to estimate an intervention effect in a cluster randomized trial

For time-to-event outcomes, the difference in restricted mean survival time is a measure of the intervention effect, an alternative to the hazard ratio, corresponding to the expected survival duration gain due to the intervention up to a predefined time t*. We extended two existing approaches of restricted mean survival time estimation for independent data to clustered data in the framework of cluster randomized trials: one based on the direct integration of Kaplan-Meier curves and the other based on pseudo-values regression. Then, we conducted a simulation study to assess and compare the statistical performance of the proposed methods, varying the number and size of clusters, the degree of clustering, and the magnitude of the intervention effect under proportional and non-proportional hazards assumption. We found that the extended methods well estimated the variance and controlled the type I error if there was a sufficient number of clusters (≥ 50) under both proportional and non-proportional hazards assumption. For cluster randomized trials with a limited number of clusters (< 50), a permutation test for pseudo-values regression was implemented and corrected the type I error. We also provided a procedure to estimate permutation-based confidence intervals which produced adequate coverage. All the extended methods performed similarly, but the pseudo-values regression offered the possibility to adjust for covariates. Finally, we illustrated each considered method with a cluster randomized trial evaluating the effectiveness of an asthma-control education program.

A Bayesian Approach for Estimating the Survivor Average Causal Effect When Outcomes Are Truncated by Death in Cluster-Randomized Trials

Many studies encounter clustering due to multicenter enrollment and nonmortality outcomes, such as quality of life, that are truncated due to death-that is, missing not at random and nonignorable. Traditional missing-data methods and target causal estimands are suboptimal for statistical inference in the presence of these combined issues, which are especially common in multicenter studies and cluster-randomized trials (CRTs) carried out among the elderly or seriously ill. Using principal stratification, we developed a Bayesian estimator that jointly identifies the always-survivor principal stratum in a clustered/hierarchical data setting and estimates the average treatment effect among them (i.e., the survivor average causal effect (SACE)). In simulations, we observed low bias and good coverage with our method. In a motivating CRT, the SACE and the estimate from complete-case analysis differed in magnitude, but both were small, and neither was incompatible with a null effect. However, the SACE estimate has a clear causal interpretation. The option to assess the rigorously defined SACE estimand in studies with informative truncation and clustering can provide additional insight into an important subset of study participants. Based on the simulation study and CRT reanalysis, we provide practical recommendations for using the SACE in CRTs and software code to support future research.

Best (but oft forgotten) practices: Efficient sample sizes for commonly used trial designs

Designing studies such that they have a high level of power to detect an effect or association of interest is an important tool to improve the quality and reproducibility of findings from such studies. Since resources (research subjects, time, and money) are scarce, it is important to obtain sufficient power with minimum use of such resources. For commonly used randomized trials of the treatment effect on a continuous outcome, designs are presented that minimize the number of subjects or the amount of research budget when aiming for a desired power level. This concerns the optimal allocation of subjects to treatments and, in case of nested designs such as cluster-randomized trials and multicenter trials, also the optimal number of centers versus the number of persons per center. Since such optimal designs require knowledge of parameters of the analysis model that are not known in the design stage, in particular outcome variances, maximin designs are presented. These designs guarantee a prespecified power level for plausible ranges of the unknown parameters and minimize research costs for the worst-case values of these parameters. The focus is on a 2-group parallel design, the AB/BA crossover design, and cluster-randomized and multicenter trials with a continuous outcome. How to calculate sample sizes for maximin designs is illustrated for examples from nutrition. Several computer programs that are helpful in calculating sample sizes for optimal and maximin designs are discussed as well as some results on optimal designs for other types of outcomes.

Self-supporting wound care mobile applications for nurses: A scoping review protocol

AIM

Mobile health (mHealth) is playing an increasingly important role in the computerization of wound care on an international scale with an aim to improve care. The aim of this scoping review protocol is to present a transparent process for how we plan to search and review the existing evidence related to self-supporting mobile wound care applications used by nurses.

MATERIALS AND METHODS

The scoping review will follow the Joanna Briggs Institute (JBI) methodology. An exploratory search was performed using MEDLINE (Ovid), Embase, CINAHL (Ebsco), to identify concepts, keywords, MeSH terms, and headings to identify study types looking for mobile applications in wound care. The findings of this search will determine the final search strategy. Data sources will include MEDLINE, Embase, CINAHL, Web of Science, LiSSa, Cochrane Wounds (Cochrane Library) and Erudit. The titles and abstracts of the identified articles will be screened independently by two authors for relevance. Full texts will also be screened by two independent reviewers and data extraction will be performed in accordance with a pre-designed extraction form. All types of studies and literature linked to self-supporting mobile wound care application used by nurses will be included (quantitative, qualitative, mixed methods and grey literature).

CONCLUSION

The results of the scoping review will give an overview of the existing self-supporting mobile applications in wound care used by nurses. These will also help to identify the existing applications, and describe knowledge in nursing about their utilisation, development, and evaluation, as well as synthesize the available literature on their impacts.

Encounter-based randomization did not result in contamination in a shared decision-making trial: a secondary analysis

OBJECTIVES

To estimate the level of contamination in an encounter-randomized trial evaluating a shared decision-making (SDM) tool.

STUDY DESIGN AND SETTING

We assessed contamination at three levels: (1) tool contamination (whether the tool was physically present in the usual care encounter), (2) functional contamination (whether components of the SDM tool were recreated in the usual care encounters without directly accessing the tool), and (3) learned contamination (whether clinicians "got better at SDM" in the usual care encounters as assessed by the OPTION-12 score). For functional and learned contamination, the interaction with the number of exposures to the tool was assessed.

RESULTS

We recorded and analyzed 830 of 922 randomized encounters. Of the 411 recorded encounters randomized to usual care, the SDM tool was used in nine (2.2%) encounters. Clinicians discussed at least one patient-important issue in 377 usual care encounters (92%) and the risk of stroke in 214 encounters (52%). We found no significant interaction between number of times the SDM tool was used and subsequent functional or learned contamination.

CONCLUSION

Despite randomly assigning clinicians to use an SDM tool in some and not other encounters, we found no evidence of contamination in usual care encounters.

Person-centred support programme (RESPECT intervention) for women with breast cancer treated with endocrine therapy: a feasibility study

OBJECTIVE

The peRson-cEntred Support Programme EndoCrine Therapy intervention is a complex intervention encompassing a person-centred support programme for patients with breast cancer being treated with endocrine therapy (ET). The aim of this study was to explore the feasibility of the trial design and patient acceptability of the intervention and outcome measures and to provide data to estimate the parameters required to design the final intervention.

DESIGN

A controlled before-and-after design following the Consolidated Standards of Reporting Trials 2010 statement for feasibility trials.

SETTING

A surgical outpatient clinic in Sweden.

PARTICIPANTS

Forty-one patients (aged 47-85) with breast cancer who were treated with ET.

INTERVENTIONS

Eligible patients were assigned to the control group or intervention group, which included individual education material, an individualised learning plan and a personalised reminder letter using a person-centred approach. The intervention could be delivered as a telephone or digital follow-up during a 12-week follow-up.

OUTCOME MEASURES

The aims were to determine the recruitment rate, assess the rate of retention, explore whether the intervention was delivered according to the protocol, assess the preferred form of educational support, rate of education sessions, length per education session and length between each education session, determine the distribution of education materials and assess completion rates of patient-reported instruments, including the General Self-efficacy Scale, the Quality of Care from the Patient's Perspective Questionnaire and the Memorial Symptom Assessment Scale.

RESULTS

Eighty-six per cent of the patients in the intervention group completed the intervention and questionnaires 3 months after their inclusion. The call attendance was 90%. During the intervention, the contact nurse complied with the intervention protocol. For self-efficacy, symptoms and quality of care, there were no differences in effect size between the control and intervention groups.

CONCLUSIONS

This intervention seems to be feasible and acceptable among patients.

Influential methods reports for group-randomized trials and related designs

BACKGROUND

This article identifies the most influential methods reports for group-randomized trials and related designs published through 2020. Many interventions are delivered to participants in real or virtual groups or in groups defined by a shared interventionist so that there is an expectation for positive correlation among observations taken on participants in the same group. These interventions are typically evaluated using a group- or cluster-randomized trial, an individually randomized group treatment trial, or a stepped wedge group- or cluster-randomized trial. These trials face methodological issues beyond those encountered in the more familiar individually randomized controlled trial.

METHODS

PubMed was searched to identify candidate methods reports; that search was supplemented by reports known to the author. Candidate reports were reviewed by the author to include only those focused on the designs of interest. Citation counts and the relative citation ratio, a new bibliometric tool developed at the National Institutes of Health, were used to identify influential reports. The relative citation ratio measures influence at the article level by comparing the citation rate of the reference article to the citation rates of the articles cited by other articles that also cite the reference article.

RESULTS

In total, 1043 reports were identified that were published through 2020. However, 55 were deemed to be the most influential based on their relative citation ratio or their citation count using criteria specific to each of the three designs, with 32 group-randomized trial reports, 7 individually randomized group treatment trial reports, and 16 stepped wedge group-randomized trial reports. Many of the influential reports were early publications that drew attention to the issues that distinguish these designs from the more familiar individually randomized controlled trial. Others were textbooks that covered a wide range of issues for these designs. Others were "first reports" on analytic methods appropriate for a specific type of data (e.g. binary data, ordinal data), for features commonly encountered in these studies (e.g. unequal cluster size, attrition), or for important variations in study design (e.g. repeated measures, cohort versus cross-section). Many presented methods for sample size calculations. Others described how these designs could be applied to a new area (e.g. dissemination and implementation research). Among the reports with the highest relative citation ratios were the CONSORT statements for each design.

CONCLUSIONS

Collectively, the influential reports address topics of great interest to investigators who might consider using one of these designs and need guidance on selecting the most appropriate design for their research question and on the best methods for design, analysis, and sample size.

A first step towards best practice recommendations for the design and statistical analyses of pragmatic clinical trials: a modified Delphi approach

AIM

Pragmatic clinical trials (PCTs) are randomised trials implemented through routine clinical practice, where design parameters of traditional randomised controlled trials are modified to increase generalizability. However, this may introduce statistical challenges. We aimed to identify these challenges and discuss possible solutions leading to best practice recommendations for the design and analysis of PCTs.

METHODS

A modified Delphi method was used to reach consensus among a panel of 11 experts in clinical trials and statistics. Statistical issues were identified in a focused literature review and aggregated with insights and possible solutions from expert collected through a series of survey iterations. Issues were ranked according to their importance.

RESULTS

27 articles were included and combined with experts' insight to generate a list of issues categorized into: participants; recruiting sites; randomisation, blinding and intervention; outcome (selection and measurement); and data analysis. Consensus was reached about the most important issues: risk of participants' attrition; heterogeneity of "usual care" across sites; absence of blinding; use of a subjective endpoint; and data analysis aligned with the trial estimand. Potential issues should be anticipated and preferably be addressed in the trial protocol. The experts provided solutions regarding data collection and data analysis, which were considered of equal importance.

DISCUSSION

A set of important statistical issues in PCTs was identified and approaches were suggested to anticipate and/or minimize these through data analysis. Any impact of choosing a pragmatic design feature should be gauged in the light of the trial estimand.

A study protocol of the adaptation and evaluation by means of a cluster-RCT of an integrated workplace health promotion program based on a European good practice

Background

An integrated workplace health promotion program (WHPP) which targets multiple lifestyle factors at different levels (individual and organizational) is potentially more effective than a single component WHPP. The aim of this study is to describe the protocol of a study to tailor a European good practice of such an integral approach to the Dutch context and to evaluate its effectiveness and implementation.

Methods

This study consists of two components. First, the five steps of the Map of Adaptation Process (MAP) will be followed to tailor the Lombardy WHP to the Dutch context. Both the employers and employees will be actively involved in this process. Second, the effectiveness of the integrated Dutch WHPP will be evaluated in a clustered randomized controlled trial (C-RCT) with measurements at baseline, 6 months and 12 months. Clusters will be composed based on working locations or units - dependent on the organization’s structure and randomization within each organization takes place after baseline measurements. Primary outcome will be a combined lifestyle score. Secondary outcomes will be the separate lifestyle behaviors targeted, stress, work-life balance, need for recovery, general health, and well-being. Simultaneously, a process evaluation will be conducted. The study population will consist of employees from multiple organizations in different industry sectors. Organizations in the intervention condition will receive the integrated Dutch WHPP during 12 months, consisting of an implementation plan and a catalogue with activities for multiple lifestyle themes on various domains: 1) screening and support; 2) information and education; 3) adjustments in the social, digital or physical environment; and 4) policy.

Discussion

The MAP approach provides an appropriate framework to systematically adapt an existing WHPP to the Dutch context, involving both employers and employees and retaining the core elements, i.e. the catalogue with evidence-based activities on multiple lifestyle themes and domains enabling an integrated approach. The following process and effect evaluation will contribute to further insight in the actual implementation and effectiveness of the integrated WHP approach.

Trial registration

NTR (trialregister.nl), NL9526. Registered on 3 June 2021.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12889-022-13352-0.

Conditions for the Successful Integration of an eHealth Tool "StopBlues" Into Community-Based Interventions in France: Results From a Multiple Correspondence Analysis

Background

For over a decade, digital health has held promise for enabling broader access to health information, education, and services for the general population at a lower cost. However, recent studies have shown mixed results leading to a certain disappointment regarding the benefits of eHealth technologies. In this context, community-based health promotion represents an interesting and efficient conceptual framework that could help increase the adoption of digital health solutions and facilitate their evaluation.

Objective

To understand how the local implementation of the promotion of an eHealth tool, StopBlues (SB), aimed at preventing psychological distress and suicide, varied according to local contexts and if the implementation was related to the use of the tool.

Methods

The study was nested within a cluster-randomized controlled trial that was conducted to evaluate the effectiveness of the promotion, with before and after observation (NCT03565562). Data from questionnaires, observations, and institutional sources were collected in 27 localities where SB was implemented. A multiple correspondence analysis was performed to assess the relations between context, type of implementation and promotion, and use of the tool.

Results

Three distinct promotion patterns emerged according to the profiles of the localities that were associated with specific SB utilization rates. From highest to lowest utilization rates, they are listed as follows: the privileged urban localities, investing in health that implemented a high-intensity and digital promotion, demonstrating a greater capacity to take ownership of the project; the urban, but less privileged localities that, in spite of having relatively little experience in health policy implementation, managed to implement a traditional and high-intensity promotion; and the rural localities, with little experience in addressing health issues, that implemented low-intensity promotion but could not overcome the challenges associated with their local context.

Conclusions

These findings indicate the substantial influence of local context on the reception of digital tools. The urban and socioeconomic status profiles of the localities, along with their investment and pre-existing experience in health, appear to be critical for shaping the promotion and implementation of eHealth tools in terms of intensity and use of digital communication. The more digital channels used, the higher the utilization rates, ultimately leading to the overall success of the intervention.

International Registered Report Identifier (IRRID)

RR2-10.1186/s13063-020-04464-2

A public health intervention package for increasing tuberculosis notifications from private practitioners in Bandung, Indonesia (INSTEP2): A cluster-randomised controlled trial protocol

Background. A significant proportion of tuberculosis (TB) patients globally make their initial visit for medical care to either an informal provider or a private practitioner, and many are not formally notified. Involvement of private practitioners (PPs) in a public–private mix for TB (TB-PPM) provides an opportunity for improving TB control. However, context-specific interventions beyond public–private agreements and mandatory notification are needed. In this study we will evaluate whether a tailored intervention package can increase TB notifications from PPs in Indonesia. Methods. This is a cluster-randomized trial of a multi-component public health intervention. 36 community health centre (CHC) areas will be selected as study locations and randomly allocated to intervention and control arms (1:1). PPs in the intervention areas will be identified using a mapping exercise and recruited into the study if they are eligible and consent. They will receive a tailored intervention package including in-person education about TB management along with bimonthly electronic refreshers, context-specific selection of referral pathways, and access to a TB-reporting app developed in collaboration with the National TB programme. The primary hypothesis is that the intervention package will increase the TB notification rate. The primary outcome will be measured by collecting notification data from the CHCs in intervention and control arms at the end of a 1-year observation period and comparing with the 1-year pre-intervention. The primary analysis will be intention-to-treat at the cluster level, using a generalised mixed model with repeated measures of TB notifications for 1 year pre- and 1 year post-intervention. Discussion. The results from this study will provide evidence on whether a tailored intervention package is effective in increasing the number of TB notifications, and whether the PPs refer presumptive TB cases correctly. The study results will guide policy in the development of TB-PPM in Indonesia and similar settings.

Locating and testing the healthy context paradox: examples from the INCLUSIVE trial

Background

The healthy context paradox, originally described with respect to school-level bullying interventions, refers to the generation of differences in mental wellbeing amongst those who continue to experience bullying even after interventions successfully reduce victimisation. Using data from the INCLUSIVE trial of restorative practice in schools, we relate this paradox to the need to theorise potential harms when developing interventions; formulate the healthy context paradox in a more general form defined by mediational relationships and cluster-level interventions; and propose two statistical models for testing the healthy context paradox informed by multilevel mediation methods, with relevance to structural and individual explanations for this paradox.

Methods

We estimated two multilevel mediation models with bullying victimisation as the mediator and mental wellbeing as the outcome: one with a school-level interaction between intervention assignment and the mediator; and one with a random slope component for the student-level mediator-outcome relationship predicted by school-level assignment. We relate each of these models to contextual or individual-level explanations for the healthy context paradox.

Results

Neither model suggested that the INCLUSIVE trial represented an example of the healthy context paradox. However, each model has different interpretations which relate to a multilevel understanding of the healthy context paradox.

Conclusions

Greater exploration of intervention harms, especially when those accrue to population subgroups, is an essential step in better understanding how interventions work and for whom. Our proposed tests for the presence of a healthy context paradox provide the analytic tools to better understand how to support development and implementation of interventions that work for all groups in a population.

Trial registration

Current Controlled Trials, ISRCTN10751359.

Towards optimal treatment selection for borderline personality disorder patients (BOOTS): a study protocol for a multicenter randomized clinical trial comparing schema therapy and dialectical behavior therapy

BACKGROUND

Specialized evidence-based treatments have been developed and evaluated for borderline personality disorder (BPD), including Dialectical Behavior Therapy (DBT) and Schema Therapy (ST). Individual differences in treatment response to both ST and DBT have been observed across studies, but the factors driving these differences are largely unknown. Understanding which treatment works best for whom and why remain central issues in psychotherapy research. The aim of the present study is to improve treatment response of DBT and ST for BPD patients by a) identifying patient characteristics that predict (differential) treatment response (i.e., treatment selection) and b) understanding how both treatments lead to change (i.e., mechanisms of change). Moreover, the clinical effectiveness and cost-effectiveness of DBT and ST will be evaluated.

METHODS

The BOOTS trial is a multicenter randomized clinical trial conducted in a routine clinical setting in several outpatient clinics in the Netherlands. We aim to recruit 200 participants, to be randomized to DBT or ST. Patients receive a combined program of individual and group sessions for a maximum duration of 25 months. Data are collected at baseline until three-year follow-up. Candidate predictors of (differential) treatment response have been selected based on the literature, a patient representative of the Borderline Foundation of the Netherlands, and semi-structured interviews among 18 expert clinicians. In addition, BPD-treatment-specific (ST: beliefs and schema modes; DBT: emotion regulation and skills use), BPD-treatment-generic (therapeutic environment characterized by genuineness, safety, and equality), and non-specific (attachment and therapeutic alliance) mechanisms of change are assessed. The primary outcome measure is change in BPD manifestations. Secondary outcome measures include functioning, additional self-reported symptoms, and well-being.

DISCUSSION

The current study contributes to the optimization of treatments for BPD patients by extending our knowledge on "Which treatment - DBT or ST - works the best for which BPD patient, and why?", which is likely to yield important benefits for both BPD patients (e.g., prevention of overtreatment and potential harm of treatments) and society (e.g., increased economic productivity of patients and efficient use of treatments).

TRIAL REGISTRATION

Netherlands Trial Register, NL7699 , registered 25/04/2019 - retrospectively registered.

Accounting for unequal cluster sizes in designing cluster randomized trials to detect treatment effect heterogeneity

Unequal cluster sizes are common in cluster randomized trials (CRTs). While there are a number of previous investigations studying the impact of unequal cluster sizes on the power for testing the average treatment effect in CRTs, little is known about the impact of unequal cluster sizes on the power for testing the heterogeneous treatment effect (HTE) in CRTs. In this work, we expand the sample size procedures for studying HTE in CRTs to accommodate cluster size variation under the linear mixed model framework. Through analytical derivation and graphical exploration, we show that the sample size for the HTE with an individual-level effect modifier is less affected by unequal cluster sizes than with a cluster-level effect modifier. The impact of cluster size variability jointly depends on the mean and coefficient of variation of cluster sizes, covariate intraclass correlation coefficient (ICC) and the conditional outcome ICC. In addition, we demonstrate that the HTE-motivated analysis of covariance framework can be used for analyzing the average treatment effect, and offer a more efficient sample size procedure for studying the average treatment effect adjusting for the effect modifier. We use simulations to confirm the accuracy of the proposed sample size procedures for both the average treatment effect and HTE in CRTs. Extensions to multivariate effect modifiers are provided and our procedure is illustrated in the context of the Strategies to Reduce Injuries and Develop Confidence in Elders trial.

Supporting Self-management Among Young People With Acne Vulgaris Through a Web-Based Behavioral Intervention: Development and Feasibility Randomized Controlled Trial

BACKGROUND

Acne is a common skin condition that is most prevalent in young people. It can have a substantial impact on the quality of life, which can be minimized with the appropriate use of topical treatments. Nonadherence to topical treatments for acne is common and often leads to treatment failure.

OBJECTIVE

The aim of this study is to develop a web-based behavioral intervention to support the self-management of acne and to assess the feasibility of recruitment, retention, and engagement of users with the intervention.

METHODS

The intervention was developed iteratively using the LifeGuide software and following the person-based approach for intervention development. The target behavior was appropriate use of topical treatments. Barriers and facilitators identified from the qualitative research and evidence from the wider literature were used to identify techniques to improve and promote their use. Young people with acne aged 14-25 years who had received treatment for acne in the past 6 months were invited to participate through mail-out from primary care practices in the South of England in a parallel, unblinded randomized trial. Participants were automatically randomized using a computer-generated algorithm to usual care or to usual care plus access to the web-based intervention. Usage data was collected, and a series of questionnaires, including the primary outcome measure for skin-specific quality of life (Skindex-16), were collected at baseline and at the 4- and 6-week follow-ups.

RESULTS

A total of 1193 participants were invited, and 53 young people with acne were randomized to usual care (27/53, 51%) or usual care plus intervention (26/53, 49%). The response rate for the primary outcome measure (Skindex-16) was 87% at 4 weeks, 6 weeks, and at both time points. The estimate of mean scores between groups (with 95% CI) using linear regression showed a trend in the direction of benefit for the web-based intervention group in the primary outcome measure (Skindex-16) and secondary measures (Patient Health Questionnaire-4 and the Problematic Experiences of Therapy Scale). Intervention usage data showed high uptake of the core module in the usual care plus web-based intervention group, with 88% (23/26) of participants completing the module. Uptake of the optional modules was low, with less than half visiting each (myth-busting quiz: 27%; living with spots or acne: 42%; oral antibiotics: 19%; what are spots or acne: 27%; other treatments: 27%; talking to your general practitioner: 12%).

CONCLUSIONS

This study demonstrated the feasibility of delivering a trial of a web-based intervention to support self-management in young people with acne. Additional work is needed before a full definitive trial, including enhancing engagement with the intervention, recruitment, and follow-up rates.

TRIAL REGISTRATION

ISRCTN 78626638; https://tinyurl.com/n4wackrw.

Impact of complex, partially nested clustering in a three-arm individually randomized group treatment trial: A case study with the wHOPE trial

BACKGROUND/AIMS

When participants in individually randomized group treatment trials are treated by multiple clinicians or in multiple group treatment sessions throughout the trial, this induces partially nested clusters which can affect the power of a trial. We investigate this issue in the Whole Health Options and Pain Education trial, a three-arm pragmatic, individually randomized clinical trial. We evaluate whether partial clusters due to multiple visits delivered by different clinicians in the Whole Health Team arm and dynamic participant groups due to changing group leaders and/or participants across treatment sessions during treatment delivery in the Primary Care Group Education arm may impact the power of the trial. We also present a Bayesian approach to estimate the intraclass correlation coefficients.

METHODS

We present statistical models for each treatment arm of Whole Health Options and Pain Education trial in which power is estimated under different intraclass correlation coefficients and mapping matrices between participants and clinicians or treatment sessions. Power calculations are based on pairwise comparisons. In practice, sample size calculations depend on estimates of the intraclass correlation coefficients at the treatment sessions and clinician levels. To accommodate such complexities, we present a Bayesian framework for the estimation of intraclass correlation coefficients under different participant-to-session and participant-to-clinician mapping scenarios. We simulated continuous outcome data based on various clinical scenarios in Whole Health Options and Pain Education trial using a range of intraclass correlation coefficients and mapping matrices and used Gibbs samplers with conjugate priors to obtain posteriors of the intraclass correlation coefficients under those different scenarios. Posterior means and medians and their biases are calculated for the intraclass correlation coefficients to evaluate the operating characteristics of the Bayesian intraclass correlation coefficient estimators.

RESULTS

Power for Whole Health Team versus Primary Care Group Education is sensitive to the intraclass correlation coefficient in the Whole Health Team arm. In these two arms, an increased number of clinicians, more evenly distributed workload of clinicians, or more homogeneous treatment group sizes leads to increased power. Our simulation study for the intraclass correlation coefficient estimation indicates that the posterior mean intraclass correlation coefficient estimator has less bias when the true intraclass correlation coefficients are large (i.e. 0.10), but when the intraclass correlation coefficient is small (i.e. 0.01), the posterior median intraclass correlation coefficient estimator is less biased.

CONCLUSION

Knowledge of intraclass correlation coefficients and the structure of clustering are critical to the design of individually randomized group treatment trials with partially nested clusters. We demonstrate that the intraclass correlation coefficient of the Whole Health Team arm can affect power in the Whole Health Options and Pain Education trial. A Bayesian approach provides a flexible procedure for estimating the intraclass correlation coefficients under complex scenarios. More work is needed to educate the research community about the individually randomized group treatment design and encourage publication of intraclass correlation coefficients to help inform future trial designs.

Maximin design of cluster randomized trials with heterogeneous costs and variances

Cluster randomized trials evaluate the effect of a treatment on persons nested within clusters, with clusters being randomly assigned to treatment. The optimal sample size at the cluster and person level depends on the study cost per cluster and per person, and the outcome variance at the cluster and the person level. The variances are unknown in the design stage and can differ between treatment arms. As a solution, this paper presents a Maximin design that maximizes the minimum relative efficiency (relative to the optimal design) over the variance parameter space, for trials with two treatment arms and a quantitative outcome. This maximin relative efficiency design (MMRED) is compared with a published Maximin design which maximizes the minimum efficiency (MMED). Both designs are also compared with the optimal designs for homogeneous costs and variances (balanced design) and heterogeneous costs and homogeneous variances (cost-conscious design), for a range of variances based upon three published trials. Whereas the MMED is balanced under high uncertainty about the treatment-to-control variance ratio, the MMRED then tends towards a balanced budget allocation between arms, leading to an unbalanced sample size allocation if costs are heterogeneous, similar to the cost-conscious design. Further, the MMRED corresponds to an optimal design for an intraclass correlation (ICC) in the lower half of the assumed ICC range (optimistic), whereas the MMED is the optimal design for the maximum ICC within the ICC range (pessimistic). Attention is given to the effect of the Welch-Satterthwaite degrees of freedom for treatment effect testing on the design efficiencies.

Sex/gender considerations in school-based interventions to promote children’s and adolescents’ physical activity

Physical inactivity is an increasing problem worldwide, but especially among girls. This difference by gender increases with age. Schools serve virtually all young people in most parts of the world and can thus play an important role in promoting physical activity. In this systematic review, we qualitatively and comprehensively assessed the treatment of sex/gender considerations (from study design to discussion of results) in 56 school-based intervention studies aiming to promote physical activity in children and adolescents. In all 56 studies, the factor of sex/gender was only rudimentarily considered, regardless of the effectiveness of the intervention. The meta-analysis revealed that the interventions had significant but relatively small effects with both girls and boys, along with high heterogeneity. To obtain better information about effective strategies that promote physical activity for both girls and boys equally, researchers conducting future intervention studies should pay attention to sex/gender differences and report on how they take this factor into account.

When should matching be used in the design of cluster randomized trials?

For cluster randomized trials (CRTs) with a small number of clusters, the matched-pair (MP) design, where clusters are paired before randomizing one to each trial arm, is often recommended to minimize imbalance on known prognostic factors, add face-validity to the study, and increase efficiency, provided the analysis recognizes the matching. Little evidence exists to guide decisions on when to use matching. We used simulation to compare the efficiency of the MP design with the stratified and simple designs, based on the mean confidence interval width of the estimated intervention effect. Matched and unmatched analyses were used for the MP design; a stratified analysis was used for the stratified design; and analyses without and with post-stratification adjustment for factors that would otherwise have been used for restricted allocation were used for the simple design. Results showed the MP design was generally the most efficient for CRTs with 10 or more pairs when the correlation between cluster-level outcomes within pairs (matching correlation) was moderate to strong (0.3-0.5). There was little gain in efficiency for the MP or stratified designs compared to simple randomization when the matching correlation was weak (0.05-0.1). For trials with four pairs of clusters, the simple and stratified designs were more efficient than the MP design because greater degrees of freedom were available for the analysis, although an unmatched analysis of the MP design recovered precision for weak matching correlations. Practical guidance on choosing between the MP, stratified, and simple designs is provided.

Guidance for biostatisticians on their essential contributions to clinical and translational research protocol review

Rigorous scientific review of research protocols is critical to making funding decisions, and to the protection of both human and non-human research participants. Given the increasing complexity of research designs and data analysis methods, quantitative experts, such as biostatisticians, play an essential role in evaluating the rigor and reproducibility of proposed methods. However, there is a common misconception that a statistician's input is relevant only to sample size/power and statistical analysis sections of a protocol. The comprehensive nature of a biostatistical review coupled with limited guidance on key components of protocol review motived this work. Members of the Biostatistics, Epidemiology, and Research Design Special Interest Group of the Association for Clinical and Translational Science used a consensus approach to identify the elements of research protocols that a biostatistician should consider in a review, and provide specific guidance on how each element should be reviewed. We present the resulting review framework as an educational tool and guideline for biostatisticians navigating review boards and panels. We briefly describe the approach to developing the framework, and we provide a comprehensive checklist and guidance on review of each protocol element. We posit that the biostatistical reviewer, through their breadth of engagement across multiple disciplines and experience with a range of research designs, can and should contribute significantly beyond review of the statistical analysis plan and sample size justification. Through careful scientific review, we hope to prevent excess resource expenditure and risk to humans and animals on poorly planned studies.

Considering sex/gender in interventions to promote children’s and adolescents’ leisure-time physical activity: a systematic review and meta-analysis

Aim

The main objectives of this systematic review were to evaluate the effects of interventions on leisure-time PA of boys and girls and to appraise the extent to which studies have taken sex/gender into account.

Subject and methods

PRISMA guidelines were followed. Two researchers independently screened studies for eligibility and assessed the risk of bias. Descriptive analyses were conducted to evaluate intervention effects in relation to the consideration of sex/gender in the studies based on a newly developed checklist. Additionally, meta-analyses were performed to determine the effect of interventions on girls’ and boys’ leisure-time PA.

Results

Overall 31 unique studies reported 44 outcomes on leisure-time PA and 20,088 participants were included in the current study. Consideration of sex/gender aspects in studies is low. PA outcomes with statistically significant same/similar effects in boys and girls showed higher quality of reporting sex/gender aspects of theoretical and/or conceptual linkages with sex/gender, measurement instruments, intervention delivery, location and interventionists and participant flow than PA outcomes without significant effects in both boys and girls or effects only in boys or girls. Interventions had a small but significant effect on girls (number of included studies (k) = 9, g = 0.220, p = .003) and boys (k = 7, g = 0.193, p = .020) leisure-time PA.

Conclusion

Higher reporting of sex/gender aspects may improve leisure-time PA of boys and girls. Nevertheless, there remains a need to address sufficient consideration of sex/gender aspects in interventions in the context of PA.

The Sub-Saharan Africa Regional Partnership (SHARP) for Mental Health Capacity-Building Scale-Up Trial: Study Design and Protocol

BACKGROUND

Depression is a leading cause of death and disability worldwide, including in low- and middle-income countries (LMICs). Depression often coexists with chronic medical conditions and is associated with worse clinical outcomes. This confluence has led to calls to integrate mental health treatment with chronic disease care systems in LMICs. This article describes the rationale and protocol for a trial comparing the clinical effectiveness and cost-effectiveness of two different intervention packages to implement evidence-based antidepressant management and psychotherapy into chronic noncommunicable disease (NCD) clinics in Malawi.

METHODS

Using constrained randomization, the Sub-Saharan Africa Regional Partnership (SHARP) for mental health capacity building will assign five Malawian NCD clinics to a basic implementation strategy via an internal coordinator, a provider within the chronic care clinic who champions depression services by providing training, supervision, operations, and reporting. Another five clinics will be assigned to depression services implementation via an internal coordinator along with an external quality assurance committee, which will provide a quarterly audit of intervention component delivery with feedback to providers and the health management team.

RESULTS

The authors will compare key implementation outcomes (fidelity to intervention), clinical effectiveness outcomes (patient health), and cost-effectiveness and will assess characteristics of clinics that may influence uptake and fidelity.

NEXT STEPS

This trial will provide key information to guide the Malawi Ministry of Health in scaling up depression management in existing NCD settings. The SHARP trial is anticipated to substantially contribute to enhancing both mental health treatment and implementation science research capacity in Malawi and the wider region.

Imputing intracluster correlation coefficients from a posterior predictive distribution is a feasible method of dealing with unit of analysis errors in a meta-analysis of cluster RCTs

BACKGROUND

Incorporating cluster randomized trials (CRTs) into meta-analyses is challenging because appropriate standard errors of study estimates accounting for clustering are not always reported. Systematic reviews of CRTs often use a single constant external estimate of the intraclass correlation coefficient (ICC) to adjust study estimate standard errors and facilitate meta-analyses; an approach that fails to account for possible variation of ICCs among studies and the imprecision with which they are estimated. Using a large systematic review of the effects of diabetes quality improvement interventions, we investigated whether we could better account for ICC variation and uncertainty in meta-analyzed effect estimates by imputing missing ICCs from a posterior predictive distribution constructed from a database of relevant ICCs.

METHODS

We constructed a dataset of ICC estimates from applicable studies. For outcomes with two or more available ICC estimates, we constructed posterior predictive ICC distributions in a Bayesian framework. For a selected continuous outcome, glycosylated hemoglobin (HbA1c), we compared the impact of incorporating a single constant ICC versus imputing ICCs drawn from the posterior predictive distribution when estimating the effect of intervention components on post treatment mean in a case study of diabetes quality improvement trials.

RESULTS

Using internal and external ICC estimates, we were able to construct a database of 59 ICCs for 12 of the 13 review outcomes (range 1-10 per outcome) and estimate the posterior predictive ICC distribution for 11 review outcomes. Synthesized results were not markedly changed by our approach for HbA1c.

CONCLUSION

Building posterior predictive distributions to impute missing ICCs is a feasible approach to facilitate principled meta-analyses of cluster randomized trials using prior data. Further work is needed to establish whether the application of these methods leads to improved review inferences for different reviews based on different factors (e.g., proportion of CRTs and CRTs with missing ICCs, different outcomes, variation and precision of ICCs).

Addressing cancer survivors' cardiovascular health using the automated heart health assessment (AH-HA) EHR tool: Initial protocol and modifications to address COVID-19 challenges

Background

The purpose of this paper is to describe the Automated Heart-Health Assessment (AH-HA) study protocol, which demonstrates an agile approach to cancer care delivery research. This study aims to assess the effect of a clinical decision support tool for cancer survivors on cardiovascular health (CVH) discussions, referrals, completed visits with primary care providers and cardiologists, and control of modifiable CVH factors and behaviors. The COVID-19 pandemic has caused widespread disruption to clinical trial accrual and operations. Studies conducted with potentially vulnerable populations, including cancer survivors, must shift towards virtual consent, data collection, and study visits to reduce risk for participants and study staff. Studies examining cancer care delivery innovations may also need to accommodate the increased use of virtual visits.

Methods/design

This group-randomized, mixed methods study will recruit 600 cancer survivors from 12 National Cancer Institute Community Oncology Research Program (NCORP) practices. Survivors at intervention sites will use the AH-HA tool with their oncology provider; survivors at usual care sites will complete routine survivorship visits. Outcomes will be measured immediately after the study visit, with follow-up at 6 and 12 months. The study was amended during the COVID-19 pandemic to allow for virtual consent, data collection, and intervention options, with the goal of minimizing participant-staff in-person contact and accommodating virtual survivorship visits.

Conclusions

Changes to the study protocol and procedures allow important cancer care delivery research to continue safely during the COVID-19 pandemic and give sites and survivors flexibility to conduct study activities in-person or remotely.

•

We present a protocol to examine the effectiveness of an electronic health record (EHR)-embedded CVH assessment tool for cancer survivors.

•

The protocol was adapted to include virtual data collection and study visits to continue in the COVID-19 era.

•

Flexibility to conduct study activities in-person or remotely supports accrual during the COVID-19 pandemic and beyond.

Feasibility Trial of Cognitive Behavioral Therapy for Fatigue in Hemodialysis (BReF Intervention)

CONTEXT

Fatigue affects at least half of patients who are on hemodialysis (HD) with considerable repercussions on their functioning, quality of life, and clinical outcomes.

OBJECTIVES

This study assessed the feasibility, acceptability, and potential benefits of a cognitive behavioral therapy intervention for renal fatigue (BReF intervention).

METHODS

This was a feasibility randomized controlled trial of the BReF intervention vs. waiting-list control. Outcomes included recruitment, retention, and adherence rates. Exploratory estimates of treatment effect were computed. The statistician was blinded to allocation.

RESULTS

Twenty-four prevalent HD patients experiencing clinical levels of fatigue were individually randomized (1:1) to BReF (N = 12) or waiting-list control arms (N = 12). Fifty-three (16.6%; 95% CI = 12.7-21.1) of 320 patients approached consented and completed the screening questionnaire. It was necessary to approach 13 patients for screening for every one patient randomized. The rate of retention at follow-up was 75% (95% CI = 53.29-90.23). Moderate to large treatment effects were observed in favor of BReF on fatigue severity, fatigue-related functional impairment, depression, and anxiety (standardized mean difference [SMD]_g = 0.81; SMD_g = 0.93; SMD_g = 0.38; SMD_g = 0.42, respectively) but not sleep quality (SMD_g = -0.31). No trial adverse events occurred.

CONCLUSION

There was promising evidence in support of the need and benefits of a cognitive behavioral therapy-based intervention for fatigue in HD. However, uptake was low, possibly as a result of an already high treatment burden in this setting. Considerations on the context of delivery are necessary before pursuing a definitive trial.

The Head and Neck Survivorship Tool (HN-STAR) Trial (WF-1805CD): A protocol for a cluster-randomized, hybrid effectiveness-implementation, pragmatic trial to improve the follow-up care of head and neck cancer survivors

Survivors of head and neck cancer (HNC) can have multiple health concerns. To facilitate their care, we developed and pilot-tested a clinical informatics intervention, HN-STAR. HN-STAR elicits concerns online from HNC survivors prior to a routine oncology clinic visit. HN-STAR then presents tailored evidence-based clinical recommendations as a clinical decision support tool to be used during the visit where the oncology clinician and survivor select symptom management strategies and other actions. This generates a survivorship care plan (SCP). Online elicitation of health concerns occurs 3, 6, and 9 months after the clinic visit, generating an updated SCP each time. HN-STAR encompasses important methods of improving survivorship care (e.g., needs assessment, tailored interventions, dissemination of guidelines) and will be evaluated in a pragmatic trial to maximize external validity. This hybrid type 1 implementation-effectiveness trial tests HN-STAR effectiveness while studying barriers and facilitators to implementation in community oncology practices within the National Cancer Institute Community Oncology Research Program. Effectiveness will be measured as differences in key survivorship outcomes between HNC participants who do and do not use HN-STAR over one year after the clinic visit. The primary endpoint is HNC-specific quality of life; other outcomes include patient-centered measures and receipt of guideline-concordant care. Implementation outcomes will be assessed of survivors, providers, and clinic stakeholders. The hybrid design will provide insight into a dose-response relationship between the extent of implementation fidelity and effectiveness outcomes, as well as how to incorporate HN-STAR into standard practice outside the research setting.

A public health intervention package for increasing tuberculosis notifications from private practitioners in Bandung, Indonesia (INSTEP2): A cluster-randomised controlled trial protocol

Background. A significant proportion of tuberculosis (TB) patients globally make their initial visit for medical care to either an informal provider or a private practitioner, and many are not formally notified. Involvement of private practitioners (PPs) in a public-private mix for TB (TB-PPM) provides an opportunity for improving TB control. However, context-specific interventions beyond public-private agreements and mandatory notification are needed. In this study we will evaluate whether a tailored intervention package can increase TB notifications from PPs in Indonesia. Methods. This is a cluster-randomized trial of a multi-component public health intervention. 36 community health centre (CHC) areas will be selected as study locations and randomly allocated to intervention and control arms (1:1). PPs in the intervention areas will be identified using a mapping exercise and recruited into the study if they are eligible and consent. They will receive a tailored intervention package including in-person education about TB management along with bimonthly electronic refreshers, context-specific selection of referral pathways, and access to a TB-reporting app developed in collaboration with the National TB programme. The primary hypothesis is that the intervention package will increase the TB notification rate. The primary outcome will be measured by collecting notification data from the CHCs in intervention and control arms at the end of a 1-year observation period and comparing with the 1-year pre-intervention. The primary analysis will be intention-to-treat at the cluster level, using a generalised mixed model with repeated measures of TB notifications for 1 year pre- and 1 year post-intervention. Discussion. The results from this study will provide evidence on whether a tailored intervention package is effective in increasing the number of TB notifications, and whether the PPs refer presumptive TB cases correctly. The study results will guide policy in the development of TB-PPM in Indonesia and similar settings.

Characteristics and practices of school-based cluster randomised controlled trials for improving health outcomes in pupils in the UK: a systematic review protocol

INTRODUCTION

Cluster randomised trials (CRTs) are studies in which groups (clusters) of participants rather than the individuals themselves are randomised to trial arms. CRTs are becoming increasingly relevant for evaluating interventions delivered in school settings for improving the health of children. Schools are a convenient setting for health interventions targeted at children and the CRT design respects the clustered structure in schools (ie, pupils within classrooms/teachers within schools). Some of the methodological challenges of CRTs, such as ethical considerations for enrolment of children into trials and how best to handle the analysis of data from participants (pupils) that change clusters (schools), may be more salient for the school setting. A better understanding of the characteristics and methodological considerations of school-based CRTs of health interventions would inform the design of future similar studies. To our knowledge, this is the only systematic review to focus specifically on the characteristics and methodological practices of CRTs delivered in schools to evaluate interventions for improving health outcomes in pupils in the UK.

METHODS AND ANALYSIS

We will search for CRTs published from inception to 30 June 2020 inclusively indexed in MEDLINE (Ovid). We will identify relevant articles through title and abstract screening, and subsequent full-text screening for eligibility against predefined inclusion criteria. Disagreements will be resolved through discussion. Two independent reviewers will extract data for each study using a prepiloted data extraction form. Findings will be summarised using descriptive statistics and graphs.

ETHICS AND DISSEMINATION

This methodological systematic review does not require ethical approval as only secondary data extracted from papers will be analysed and the data are not linked to individual participants. After completion of the systematic review, the data will be analysed, and the findings disseminated through peer-reviewed publications and scientific meetings.

PROSPERO REGISTRATION NUMBER

CRD42020201792.

Rationale, Methodological Quality, and Reporting of Cluster-Randomized Controlled Trials in Critical Care Medicine: A Systematic Review

OBJECTIVE

Compared with individual-patient randomized controlled trials, cluster randomized controlled trials have unique methodological and ethical considerations. We evaluated the rationale, methodological quality, and reporting of cluster randomized controlled trials in critical care studies.

DATA SOURCES

Systematic searches of Medline, Embase, and Cochrane Central Register were performed.

STUDY SELECTION

We included all cluster randomized controlled trials conducted in adult, pediatric, or neonatal critical care units from January 2005 to September 2019.

DATA EXTRACTION

Two reviewers independently screened citations, reviewed full texts, protocols, and supplements of potentially eligible studies, abstracted data, and assessed methodology of included studies.

DATA SYNTHESIS

From 1,902 citations, 59 cluster randomized controlled trials met criteria. Most focused on quality improvement (24, 41%), antimicrobial therapy (9, 15%), or infection control (9, 15%) interventions. Designs included parallel-group (25, 42%), crossover (21, 36%), and stepped-wedge (13, 22%). Concealment of allocation was reported in 21 studies (36%). Thirteen studies (22%) reported at least one method of blinding. The median total sample size was 1,660 patients (interquartile range, 813-4,295); the median number of clusters was 12 (interquartile range, 5-24); and the median patients per cluster was 141 (interquartile range, 54-452). Sample size calculations were reported in 90% of trials, but only 54% met Consolidated Standards of Reporting Trials guidance for sample size reporting. Twenty-seven of the studies (46%) identified a fixed number of available clusters prior to trial commencement, and only nine (15%) prespecified both the number of clusters and patients required to detect the expected effect size. Overall, 36 trials (68%) achieved the total prespecified sample size. When analyzing data, 44 studies (75%) appropriately adjusted for clustering when analyzing the primary outcome. Only 12 (20%) reported an intracluster coefficient (median 0.047 [interquartile range, 0.01-0.13]).

CONCLUSIONS

Cluster randomized controlled trials in critical care typically involve a small and fixed number of relatively large clusters. The reporting of key methodological aspects of these trials is often inadequate.

Biomass-fuelled improved cookstove intervention to prevent household air pollution in Northwest Ethiopia: a cluster randomized controlled trial

Background

Household air pollution from biomass fuels burning in traditional cookstoves currently appeared as one of the most serious threats to public health with a recent burden estimate of 2.6 million premature deaths every year worldwide, ranking highest among environmental risk factors and one of the major risk factors of any type globally. Improved cookstove interventions have been widely practiced as potential solutions. However, studies on the effect of improved cookstove interventions are limited and heterogeneous which suggested the need for further research.

Methods

A cluster randomized controlled trial study was conducted to assess the effect of biomass-fuelled improved cookstove intervention on the concentration of household air pollution compared with the continuation of an open burning traditional cookstove. A total of 36 clusters were randomly allocated to both arms at a 1:1 ratio, and improved cookstove intervention was delivered to all households allocated into the treatment arm. All households in the included clusters were biomass fuel users and relatively homogenous in terms of basic socio-demographic and cooking-related characteristics. Household air pollution was determined by measuring the concentration of indoor fine particulate, and the effect of the intervention was estimated using the Generalized Estimating Equation.

Results

A total of 2031 household was enrolled in the study across 36 randomly selected clusters in both arms, among which data were obtained from a total of 1977 households for at least one follow-up visit which establishes the intention-to-treat population dataset for analysis. The improved cookstove intervention significantly reduces the concentration of household air pollution by about 343 μg/m³ (Ḃ = − 343, 95% CI − 350, − 336) compared to the traditional cookstove method. The overall reduction was found to be about 46% from the baseline value of 859 (95% CI 837–881) to 465 (95% CI 458–472) in the intervention arm compared to only about 5% reduction from 850 (95% CI 828–872) to 805 (95% CI 794–817) in the control arm.

Conclusions

The biomass-fuelled improved cookstove intervention significantly reduces the concentration of household air pollution compared to the traditional method. This suggests that the implementation of these cookstove technologies may be necessary to achieve household air pollution exposure reductions.

Trial registration

The trial project was retrospectively registered on August 2, 2018, at the clinical trials.gov registry database (https://clinicaltrials.gov/) with the NCT03612362 registration identifier number.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12199-020-00923-z.

Sample size requirements for detecting treatment effect heterogeneity in cluster randomized trials

Cluster randomized trials (CRTs) refer to experiments with randomization carried out at the cluster or the group level. While numerous statistical methods have been developed for the design and analysis of CRTs, most of the existing methods focused on testing the overall treatment effect across the population characteristics, with few discussions on the differential treatment effect among subpopulations. In addition, the sample size and power requirements for detecting differential treatment effect in CRTs remain unclear, but are helpful for studies planned with such an objective. In this article, we develop a new sample size formula for detecting treatment effect heterogeneity in two-level CRTs for continuous outcomes, continuous or binary covariates measured at cluster or individual level. We also investigate the roles of two intraclass correlation coefficients (ICCs): the adjusted ICC for the outcome of interest and the marginal ICC for the covariate of interest. We further derive a closed-form design effect formula to facilitate the application of the proposed method, and provide extensions to accommodate multiple covariates. Extensive simulations are carried out to validate the proposed formula in finite samples. We find that the empirical power agrees well with the prediction across a range of parameter constellations, when data are analyzed by a linear mixed effects model with a treatment-by-covariate interaction. Finally, we use data from the HF-ACTION study to illustrate the proposed sample size procedure for detecting heterogeneous treatment effects.

Collaborative care for depression and anxiety disorders: results and lessons learned from the Danish cluster-randomized Collabri trials

BACKGROUND

Meta-analyses suggest that collaborative care (CC) improves symptoms of depression and anxiety. In CC, a care manager collaborates with a general practitioner (GP) to provide evidence-based care. Most CC research is from the US, focusing on depression. As research results may not transfer to other settings, we developed and tested a Danish CC-model (the Collabri-model) for depression, panic disorder, generalized anxiety disorder, and social anxiety disorder in general practice.

METHODS

Four cluster-randomized superiority trials evaluated the effects of CC. The overall aim was to explore if CC significantly improved depression and anxiety symptoms compared to treatment-as-usual at 6-months' follow-up. The Collabri-model was founded on a multi-professional collaboration between a team of mental-health specialists (psychiatrists and care managers) and GPs. In collaboration with GPs, care managers provided treatment according to a structured plan, including regular reassessments and follow-up. Treatment modalities (cognitive behavioral therapy, psychoeducation, and medication) were offered based on stepped care algorithms. Face-to-face meetings between GPs and care managers took place regularly, and a psychiatrist provided supervision. The control group received treatment-as-usual. Primary outcomes were symptoms of depression (BDI-II) and anxiety (BAI) at 6-months' follow-up. The incremental cost-effectiveness ratio (ICER) was estimated based on 6-months' follow-up.

RESULTS

Despite various attempts to improve inclusion rates, the necessary number of participants was not recruited. Seven hundred thirty-one participants were included: 325 in the depression trial and 406 in the anxiety trials. The Collabri-model was implemented, demonstrating good fidelity to core model elements. In favor of CC, we found a statistically significant difference between depression scores at 6-months' follow-up in the depression trial. The difference was not significant at 15-months' follow-up. The anxiety trials were pooled for data analysis due to inadequate sample sizes. At 6- and 15-months' follow-up, there was a difference in anxiety symptoms favoring CC. These differences were not statistically significant. The ICER was 58,280 Euro per QALY.

CONCLUSIONS

At 6 months, a significant difference between groups was found in the depression trial, but not in the pooled anxiety trial. However, these results should be cautiously interpreted as there is a risk of selection bias and lacking statistical power.

TRIAL REGISTRATION

ClinicalTrials.gov, ID: NCT02678624 and NCT02678845 . Retrospectively registered on 7 February 2016.

Analysis and reporting of stratified cluster randomized trials-a systematic survey

BACKGROUND

In order to correctly assess the effect of intervention from stratified cluster randomized trials (CRTs), it is necessary to adjust for both clustering and stratification, as failure to do so leads to misleading conclusions about the intervention effect. We have conducted a systematic survey to examine the current practices about analysis and reporting of stratified CRTs.

METHOD

We used the search terms to identify the stratified CRTs from MEDLINE since the inception to July 2019. In phase 1, we screened the title and abstract for English-only studies and selected, including the main results paper of the identified protocols, for the next phase. In phase 2, we screened the full text and selected studies for data abstraction. The data abstraction form was piloted and developed using the REDCap. We abstracted data on multiple design and methodological aspects of the study including whether the primary method adjusted for both clustering and stratification, reporting of sample size, randomization, and results.

RESULTS

We screened 2686 studies in the phase 1 and selected 286 studies for phase 2-among them 185 studies were selected for data abstraction. Most of the selected studies were two-arm 140/185 (76%) and parallel-group 165/185 (89%) trials. Among these 185 studies, 27 (15%) of them did not provide any sample size or power calculation, while 105 (57%) studies did not mention any method used for randomization within each stratum. Further, 43 (23%) and 150 (81%) of 185 studies did not provide the definition of all the strata, while more than 60% of the studies did not include all the stratification variable(s) in the flow chart or baseline characteristics table. More than half 114/185 (62%) of the studies did not adjust the primary method for both clustering and stratification.

CONCLUSION

Stratification helps to achieve the balance among intervention groups. However, to correctly assess the intervention effect from stratified CRTs, it is important to adjust the primary analysis for both stratification and clustering. There are significant deficiencies in the reporting of methodological aspects of stratified CRTs, which require substantial improvements in several areas including definition of strata, inclusion of stratification variable(s) in the flow chart or baseline characteristics table, and reporting the stratum-specific number of clusters and individuals in the intervention groups.

Optimal two-stage sampling for mean estimation in multilevel populations when cluster size is informative

To estimate the mean of a quantitative variable in a hierarchical population, it is logistically convenient to sample in two stages (two-stage sampling), i.e. selecting first clusters, and then individuals from the sampled clusters. Allowing cluster size to vary in the population and to be related to the mean of the outcome variable of interest (informative cluster size), the following competing sampling designs are considered: sampling clusters with probability proportional to cluster size, and then the same number of individuals per cluster; drawing clusters with equal probability, and then the same percentage of individuals per cluster; and selecting clusters with equal probability, and then the same number of individuals per cluster. For each design, optimal sample sizes are derived under a budget constraint. The three optimal two-stage sampling designs are compared, in terms of efficiency, with each other and with simple random sampling of individuals. Sampling clusters with probability proportional to size is recommended. To overcome the dependency of the optimal design on unknown nuisance parameters, maximin designs are derived. The results are illustrated, assuming probability proportional to size sampling of clusters, with the planning of a hypothetical survey to compare adolescent alcohol consumption between France and Italy.

Comparing a standard and tailored approach to scaling up an evidence-based intervention for antiretroviral therapy for people who inject drugs in Vietnam: study protocol for a cluster randomized hybrid type III trial

Background

People who inject drugs (PWID) bear a disproportionate burden of HIV infection and experience poor outcomes. A randomized trial demonstrated the efficacy of an integrated System Navigation and Psychosocial Counseling (SNaP) intervention in improving HIV outcomes, including antiretroviral therapy (ART) and medications for opioid use disorder (MOUD) uptake, viral suppression, and mortality. There is limited evidence about how to effectively scale such intervention. This protocol presents a hybrid type III effectiveness-implementation trial comparing two approaches for scaling-up SNaP. We will evaluate the effectiveness of SNaP implementation approaches as well as cost and the characteristics of HIV testing sites achieving successful or unsuccessful implementation of SNaP in Vietnam.

Methods

Design: In this cluster randomized controlled trial, two approaches to scaling-up SNaP for PWID in Vietnam will be compared. HIV testing sites (n = 42) were randomized 1:1 to the standard approach or the tailored approach. Intervention mapping was used to develop implementation strategies for both arms. The standard arm will receive a uniform package of these strategies, while implementation strategies for the tailored arm will be designed to address site-specific needs.

Participants: HIV-positive PWID participants (n = 6200) will be recruited for medical record assessment at baseline; of those, 1500 will be enrolled for detailed assessments at baseline, 12, and 24 months. Site directors and staff at each of the 42 HIV testing sites will complete surveys at baseline, 12, and 24 months.

Outcomes: Implementation outcomes (fidelity, penetration, acceptability) and effectiveness outcomes (ART, MOUD uptake, viral suppression) will be compared between the arms. To measure incremental costs, we will conduct an empirical costing study of each arm and the actual process of implementation from a societal perspective. Qualitative and quantitative site-level data will be used to explore key characteristics of HIV testing sites that successfully or unsuccessfully implement the intervention for each arm.

Discussion

Scaling up evidence-based interventions poses substantial challenges. The proposed trial contributes to the field of implementation science by applying a systematic approach to designing and tailoring implementation strategies, conducting a rigorous comparison of two promising implementation approaches, and assessing their incremental costs. Our study will provide critical guidance to Ministries of Health worldwide regarding the most effective, cost-efficient approach to SNaP implementation.

Trial registration

NCT03952520 on Clinialtrials.gov. Registered 16 May 2019.

Intra-cluster correlation coefficients in primary care patients with type 2 diabetes and hypertension

Introduction

There are few sources of published data on intra-cluster correlation coefficients (ICCs) amongst patients with type 2 diabetes (T2D) and/or hypertension in primary care, particularly in low- and middle-income countries. ICC values are necessary for determining the sample sizes of cluster randomized trials. Hence, we aim to report the ICC values for a range of measures from a cluster-based interventional study conducted in Malaysia.

Method

Baseline data from a large study entitled Evaluation of Enhanced Primary Health Care interventions in public health clinics (EnPHC-EVA: Facility) were used in this analysis. Data from 40 public primary care clinics were collected through retrospective chart reviews and a patient exit survey. We calculated the ICCs for processes of care, clinical outcomes and patient experiences in patients with T2D and/or hypertension using the analysis of variance approach.

Results

Patient experience had the highest ICC values compared to processes of care and clinical outcomes. The ICC values ranged from 0.01 to 0.48 for processes of care. Generally, the ICC values for processes of care for patients with hypertension only are higher than those for T2D patients, with or without hypertension. However, both groups of patients have similar ICCs for antihypertensive medications use. In addition, similar ICC values were observed for clinical outcomes, ranging from 0.01 to 0.09. For patient experience, the ICCs were between 0.03 (proportion of patients who are willing to recommend the clinic to their friends and family) and 0.25 (for Patient Assessment of Chronic Illness Care item 9, Given a copy of my treatment plan).

Conclusion

The reported ICCs and their respective 95% confidence intervals for T2D and hypertension will be useful for estimating sample sizes and improving efficiency of cluster trials conducted in the primary care setting, particularly for low- and middle-income countries.

A cluster-randomized, non-inferiority trial comparing use of misoprostol for universal prophylaxis vs. secondary prevention of postpartum hemorrhage among community level births in Egypt

Background

Previous community-based research shows that secondary prevention of postpartum hemorrhage (PPH) with misoprostol only given to women with above-average measured blood loss produces similar clinical outcomes compared to routine administration of misoprostol for prevention of PPH. Given the difficulty of routinely measuring blood loss for all deliveries, more operational models of secondary prevention are needed.

Methods

This cluster-randomized, non-inferiority trial included women giving birth with nurse-midwives at home or in Primary Health Units (PHUs) in rural Egypt. Two PPH management approaches were compared: 1) 600mcg oral misoprostol given to all women after delivery (i.e. primary prevention, current standard of care); 2) 800mcg sublingual misoprostol given only to women with 350-500 ml postpartum blood loss estimated using an underpad (i.e. secondary prevention). The primary outcome was mean change in pre- and post-delivery hemoglobin. Secondary outcomes included hemoglobin ≥2 g/dL and other PPH interventions.

Results

Misoprostol was administered after delivery to 100% (1555/1555) and 10.7% (117/1099) of women in primary and secondary prevention clusters, respectively. The mean drop in pre- to post-delivery hemoglobin was 0.37 (SD: 0.91) and 0.45 (SD: 0.76) among women in primary and secondary prevention clusters, respectively (difference adjusted for clustering = 0.01, one-sided 95% CI: < 0.27, p = 0.535). There were no statistically significant differences in secondary outcomes, including hemoglobin drop ≥2 g/dL, PPH diagnosis, transfer to higher level, or other interventions.

Conclusions

Misoprostol for secondary prevention of PPH is comparable to universal prophylaxis and can be implemented using local materials, such as underpads.

Trial registration

Clinicaltrials.gov NCT02226588, date of registration 27 August 2014.

Design and sample characteristics of COordinated Oral health Promotion (CO-OP) Chicago: A cluster-randomized controlled trial

COordinated Oral health Promotion (CO-OP) Chicago is a two-arm cluster-randomized trial with a wait-list control. The primary aim is to evaluate the efficacy of an oral health community health worker (CHW) intervention to improve oral health behaviors in low-income, urban children under the age of three years. Exploratory aims will determine cost-effectiveness, and if any CHW intervention impact on child tooth brushing behaviors varies when CHWs are based out of a medical clinic compared to a community setting. This paper describes progress toward achieving these aims. Participating families were recruited from community social service centers and pediatric primary care medical clinics in Cook County, Illinois. Sites were cluster-randomized to CHW intervention or usual services (a wait-list control). The intervention is oral health support from CHWs delivered in four visits to individual families over one year. The trial sample consists of 420 child/caregiver dyads enrolled at the 20 participating sites over 11 months. Participant demographics varied across the sites, but primary outcomes values at baseline did not. Data on brushing frequency, plaque, and other oral health behaviors are collected at three timepoints: baseline, 6-, and 12-months. The primary analysis will assess differences in caregiver-reported child brushing frequency and observed plaque score between the two arms at 12-months. The trial is currently in the active intervention phase. The trial's cluster-randomized controlled design takes a real-world approach by integrating into existing health and social service agencies and collecting data in participant homes. Results will address an important child health disparity. ClinicalTrials.gov identifier: NCT03397589. CLINICAL TRIAL REGISTRATION: University of Illinois at Chicago Protocol Record 2017-1090. National Institutes of Dental & Craniofacial Research of the National Institutes of Health (NIDCR) Protocol Number: 17-074-E. NCT03397589.

The Partnership to Improve Diabetes Education Trial: a Cluster Randomized Trial Addressing Health Communication in Diabetes Care

BACKGROUND

Effective type 2 diabetes care remains a challenge for patients including those receiving primary care in safety net settings.

OBJECTIVE

The Partnership to Improve Diabetes Education (PRIDE) trial team and leaders from a regional department of health evaluated approaches to improve care for vulnerable patients.

DESIGN

Cluster randomized controlled trial.

PATIENTS

Adults with uncontrolled type 2 diabetes seeking care across 10 unblinded, randomly assigned safety net clinics in Middle TN.

INTERVENTIONS

A literacy-sensitive, provider-focused, health communication intervention (PRIDE; 5 clinics) vs. standard diabetes education (5 clinics).

MAIN MEASURES

Participant-level primary outcome was glycemic control [A1c] at 12 months. Secondary outcomes included select health behaviors and psychosocial aspects of care at 12 and 24 months. Adjusted mixed effects regression models were used to examine the comparative effectiveness of each approach to care.

KEY RESULTS

Of 410 patients enrolled, 364 (89%) were included in analyses. Median age was 51 years; Black and Hispanic patients represented 18% and 25%; 96% were uninsured, and 82% had low annual income level (< $20,000); adequate health literacy was seen in 83%, but numeracy deficits were common. At 12 months, significant within-group treatment effects occurred from baseline for both PRIDE and control sites: adjusted A1c (- 0.76 [95% CI, - 1.08 to - 0.44]; P < .001 vs - 0.54 [95% CI, - 0.86 to - 0.21]; P = .001), odds of poor eating (0.53 [95% CI, 0.33-0.83]; P = .01 vs 0.42 [95% CI, 0.26-0.68]; P < .001), treatment satisfaction (3.93 [95% CI, 2.48-6.21]; P < .001 vs 3.04 [95% CI, 1.93-4.77]; P < .001), and self-efficacy (2.97 [95% CI, 1.89-4.67]; P < .001 vs 1.81 [95% CI, 1.1-2.84]; P = .01). No significant difference was observed between study arms in adjusted analyses.

CONCLUSIONS

Both interventions improved the participant's A1c and behavioral outcomes. PRIDE was not more effective than standard education. Further research may elucidate the added value of a focused health communication program in this setting.

A systematic review of hand-hygiene and environmental-disinfection interventions in settings with children

BACKGROUND

Helping adults and children develop better hygiene habits is an important public health focus. As infection causing bacteria can live on one's body and in the surrounding environment, more effective interventions should simultaneously encourage personal-hygiene (e.g. hand-hygiene) and environmental-disinfecting (e.g. cleaning surfaces). To inform the development of a future multi-faceted intervention to improve public health, a systematic literature review was conducted on behavior change interventions designed to increase hand-hygiene and environmental-disinfecting in settings likely to include children.

METHODS

The search was conducted over two comprehensive data-bases, Ebsco Medline and Web of Science, to locate intervention studies that aimed to increase hand-hygiene or environmental-disinfecting behavior in settings likely to include children. Located article titles and abstracts were independently assessed, and the full-texts of agreed articles were collaboratively assessed for inclusion. Of the 2893 titles assessed, 29 met the eligibility criteria. The extracted data describe the Behavior Change Techniques (version 1) that the interventions employed and the interventions' effectiveness. The techniques were then linked to their associated theoretical domains and to their capability-opportunity-motivation (i.e., COM-B model) components, as described in the Behavior Change Wheel. Due to the heterogeneity of the studies' methods and measures, a meta-analysis was not conducted.

RESULTS

A total of 29 studies met the inclusion criteria. The majority of interventions were designed to increase hand-hygiene alone (N = 27), and the remaining two interventions were designed to increase both hand-hygiene and environmental-disinfecting. The most used techniques involved shaping knowledge (N = 22) and antecedents (N = 21). Interventions that included techniques targeting four or more theoretical domains and all the capability-opportunity-motivation components were descriptively more effective.

CONCLUSIONS

In alignment with previous findings, the current review encourages future interventions to target multiple theoretical domains, across all capability-opportunity-motivation components. The discussion urges interventionists to consider the appropriateness of interventions in their development, feasibility/pilot, evaluation, and implementation stages.

REGISTRATION

Prospero ID - CRD42019133735.

Impact of baseline covariate imbalance on bias in treatment effect estimation in cluster randomized trials: Race as an example

Individual-level baseline covariate imbalance could happen more frequently in cluster randomized trials, and may influence the observed treatment effect. Using computer and real-data simulations, this paper quantifies the extent and impact of covariate imbalance on the estimated treatment effect for both continuous and binary outcomes, and relates it to the degree of imbalance for different numbers of clusters, cluster sizes, and covariate intraclass correlation coefficients. We focused on the impact of race as a covariate, given the emphasis of regulatory and funding bodies on understanding the influence of demographic characteristics on treatment effectiveness. We found that bias in the treatment effect is proportional to both the degree of baseline covariate imbalance and the covariate effect size. Larger numbers of clusters result in lower covariate imbalance, and increasing cluster size is less effective in reducing imbalance compared to increasing the number of clusters. Models adjusted for important baseline confounders are superior to unadjusted models for minimizing bias in both model-based simulations and an innovative simulation based on real clinical trial data. Higher outcome intraclass correlation coefficients did not affect bias but resulted in greater variance in treatment estimates.

Teacher Anxiety Program for Elementary Students (TAPES): intervention development and proposed randomized controlled trial

Background

Excessive student anxiety is a common problem that severely impairs short- and long-term academic functioning and increases teacher burden. Reducing student anxiety has been associated with improvement in educational functioning. Because anxiety manifests daily in the classroom, teachers are in an ideal position to identify and help students manage their anxiety. Unfortunately, teachers lack the knowledge and skills to support the learning of students with excessive anxiety. The Teacher Anxiety Program for Elementary Students (TAPES), a novel teacher-administered school-home collaborative intervention, was designed to address this gap.

Methods

This manuscript describes the protocol for developing and evaluating TAPES. Specifically, we present a description of: (1) the intervention and theoretical model; and (2) methods for the proposed randomized controlled trial comparing TAPES to a standard professional development seminar focused on reducing student anxiety.

Discussion

Primary aims examine the impact of the TAPES training on teacher knowledge and skill. Secondary aims examine the impact of TAPES on student outcomes. Exploratory aims will examine mediators based on our proposed theory of change. If effective, TAPES has the potential to directly benefit teachers (improving skills) and students (reducing anxiety and improving functioning).

Trial registration

ClinicalTrials.gov, NCT03899948. Registered on 28 March 2019.

Essential Ingredients and Innovations in the Design and Analysis of Group-Randomized Trials

This article reviews the essential ingredients and innovations in the design and analysis of group-randomized trials. The methods literature for these trials has grown steadily since they were introduced to the biomedical research community in the late 1970s, and we summarize those developments. We review, in addition to the group-randomized trial, methods for two closely related designs, the individually randomized group treatment trial and the stepped-wedge group-randomized trial. After describing the essential ingredients for these designs, we review the most important developments in the evolution of their methods using a new bibliometric tool developed at the National Institutes of Health. We then discuss the questions to be considered when selecting from among these designs or selecting the traditional randomized controlled trial. We close with a review of current methods for the analysis of data from these designs, a case study to illustrate each design, and a brief summary.

Assessing heterogeneity of treatment effect analyses in health-related cluster randomized trials: A systematic review

Background

Cluster-randomized trials (CRTs) are being increasingly used to test a range of interventions, including medical interventions commonly used in clinical practice. Policies created by the NIH and the Food and Drug Administration (FDA) require the reporting of demographics and the examination of demographic heterogeneity of treatment effect (HTE) for individually randomized trials. Little is known about how frequent demographics are reported and HTE analyses are conducted in CRTs.

Objectives

We sought to understand the prevalence of HTE analyses and the statistical methods used to conduct them in CRTs focused on treating cardiovascular disease, cancer, and chronic lower respiratory diseases. Additionally, we also report on the proportion of CRTs that reported on baseline demographics of its populations and conducted demographic HTE analyses.

Data sources

We searched PubMed and Embase for CRTs published between 1/1/2010 and 3/29/2016 that focused on treating the top 3 Center for Disease Control causes of death (cardiovascular disease, chronic lower respiratory disease, and cancer).

Evidence Screening And Review: Of 1,682 unique titles, 117 abstracts were screened. After excluding 53 articles, we included 64 CRT publications and abstracted information on study characteristics and demographic information, statistical analysis, HTE analysis, and study quality.

Results

Age and sex were reported in greater than 95.3% of CRTs, while race and ethnicity were reported in only 20.3% of CRTs. HTE analyses were conducted in 28.1% (n = 18) of included CRTs and 77.8% (n = 12) were prespecified analyses. Four CRTs conducted a demographic subgroup analysis. Only 6/18 CRTs used interaction testing to determine whether HTE existed.

Conclusions

Baseline demographic reporting was high for age and sex in CRTs, but was uncommon for race and ethnicity. HTE analyses were uncommon and was rare for demographic subgroups, which limits the ability to examine the extent of benefits or risks for treatments tested with CRT designs.

The holistic assessment and care planning in partnership intervention study (HAPPI): A protocol for a feasibility, cluster randomized controlled trial

AIM

During an initial phase of this research, an e-Delphi survey was conducted to gain consensus among stakeholders on the components of a nurse-led assessment and care planning intervention for older people who live with frailty in primary care. This feasibility randomized controlled trial (fRCT) will test the proposed intervention and its implementation and determine methods for the design of a conclusive randomized controlled trial.

METHODS

The fRCT, with embedded qualitative study, aims to recruit 60 participants. Moderately and severely frail older people will be identified using the electronic frailty index (eFI) and the intervention will be delivered by senior community nurses. The control participants will receive usual primary care for frailty. The study is funded by the National Institute of Health Research (NIHR; funding granted in May 2016, ref: ICA-CDRF-2016-02-018) and received NHS and University Research Ethics Committee approval in 2018.

DISCUSSION

There is evidence that the delivery of complex interventions for community-dwelling older people can reduce care home and hospital admissions and falls, there is less evidence for the benefit of any specific type or intensity of intervention or the additional benefits of targeting the frail population. This trial will determine feasibility of the intervention, define recruitment and retention parameters and trial logistics, and decide outcome measures.

IMPACT

This study aims to address the limitations of current research by using a systematic method of frailty diagnosis and participant identification, trialling implementation of a person-centred intervention, and testing of feasibility parameters.

TRIAL REGISTRATION NUMBER

ISRCTN: 74345449.