Adaptive designs for randomized trials in public health

Adaptive design trials in eating disorder research: A scoping review

OBJECTIVE

This scoping review sought to map the breadth of literature on the use of adaptive design trials in eating disorder research.

METHOD

A systematic literature search was conducted in Medline, Scopus, PsycInfo, Emcare, Econlit, CINAHL and ProQuest Dissertations and Theses. Articles were included if they reported on an intervention targeting any type of eating disorder (including anorexia nervosa, bulimia nervosa, binge-eating disorder, and other specified feeding or eating disorders), and employed the use of an adaptive design trial to evaluate the intervention. Two independent reviewers screened citations for inclusion, and data abstraction was performed by one reviewer and verified by a second.

RESULTS

We identified five adaptive design trials targeting anorexia nervosa, bulimia nervosa and binge-eating disorder conducted in the USA and Australia. All employed adaptive treatment arm switching based on early response to treatment and identified a priori stopping rules. None of the studies included value of information analysis to guide adaptive design decisions and none included lived experience perspectives.

DISCUSSION

The limited use of adaptive designs in eating disorder trials represents a missed opportunity to improve enrolment targets, attrition rates, treatment outcomes and trial efficiency. We outline the range of adaptive methodologies, how they could be applied to eating disorder research, and the specific operational and statistical considerations relevant to adaptive design trials.

PUBLIC SIGNIFICANCE

Adaptive design trials are increasingly employed as flexible, efficient alternatives to fixed trial designs, but they are not often used in eating disorder research. This first scoping review identified five adaptive design trials targeting anorexia nervosa, bulimia nervosa and binge-eating disorder that employed treatment arm switching adaptive methodology. We make recommendations on the use of adaptive design trials for future eating disorder trials.

Adaptive designs in critical care trials: a simulation study

BACKGROUND

Adaptive clinical trials are growing in popularity as they are more flexible, efficient and ethical than traditional fixed designs. However, notwithstanding their increased use in assessing treatments for COVID-19, their use in critical care trials remains limited. A better understanding of the relative benefits of various adaptive designs may increase their use and interpretation.

METHODS

Using two large critical care trials (ADRENAL.

CLINICALTRIALS

gov number, NCT01448109. Updated 12-12-2017; NICE-SUGAR.

CLINICALTRIALS

gov number, NCT00220987. Updated 01-29-2009), we assessed the performance of three frequentist and two bayesian adaptive approaches. We retrospectively re-analysed the trials with one, two, four, and nine equally spaced interims. Using the original hypotheses, we conducted 10,000 simulations to derive error rates, probabilities of making an early correct and incorrect decision, expected sample size and treatment effect estimates under the null scenario (no treatment effect) and alternative scenario (a positive treatment effect). We used a logistic regression model with 90-day mortality as the outcome and the treatment arm as the covariate. The null hypothesis was tested using a two-sided significance level (α) at 0.05.

RESULTS

Across all approaches, increasing the number of interims led to a decreased expected sample size. Under the null scenario, group sequential approaches provided good control of the type-I error rate; however, the type I error rate inflation was an issue for the Bayesian approaches. The Bayesian Predictive Probability and O'Brien-Fleming approaches showed the highest probability of correctly stopping the trials (around 95%). Under the alternative scenario, the Bayesian approaches showed the highest overall probability of correctly stopping the ADRENAL trial for efficacy (around 91%), whereas the Haybittle-Peto approach achieved the greatest power for the NICE-SUGAR trial. Treatment effect estimates became increasingly underestimated as the number of interims increased.

CONCLUSIONS

This study confirms the right adaptive design can reach the same conclusion as a fixed design with a much-reduced sample size. The efficiency gain associated with an increased number of interims is highly relevant to late-phase critical care trials with large sample sizes and short follow-up times. Systematically exploring adaptive methods at the trial design stage will aid the choice of the most appropriate method.

Impact of Sources of Strength on adolescent suicide deaths across three randomized trials

Universal interventions are key to reducing youth suicide rates, yet no universal intervention has demonstrated reduction in suicide mortality through an RCT. This study pooled three cluster-RCTs of Sources of Strength (n=78 high schools), a universal social network-informed intervention. In each trial, matched pairs of schools were assigned to immediate intervention or wait-list. Six schools were assigned without a pair due to logistical constraints. During the study period, no suicides occurred in intervention schools vs four in control schools, that is, suicide rates of 0 vs. 20.86/100,000, respectively. Results varied across statistical tests of impact. A state-level exact test pooling all available schools showed fewer suicides in intervention vs. control schools (p=0.047); whereas a stricter test involving only schools with a randomised pair found no difference (p=0.150). Results suggest that identifying mortality-reducing interventions will require commitment to new public-health designs optimised for population-level interventions, including adaptive roll-out trials.

Rationale and design for Healthy Hearts for Michigan (HH4M): A pragmatic single-arm hybrid effectiveness-implementation study

Background

The burden of cardiovascular disease (CVD) is particularly high in several US states, which include the state of Michigan. Hypertension and smoking are two major risk factors for mortality due to CVD. Rural Michigan is disproportionally affected by CVD and by primary care shortages. The Healthy Hearts for Michigan (HH4M) study aims to promote hypertension management and smoking cessation through practice facilitation and quality improvement efforts and is part of the multi-state EvidenceNOW: Building State Capacity initiative to provide external support to primary care practices to improve care delivery.

Methods

Primary care practices in rural and underserved areas of Michigan were recruited to join HH4M, a pragmatic, single-arm hybrid Type 2 effectiveness-implementation study during which practice facilitation was delivered at the practice level for 12 months, followed by a 3-month maintenance period.

Results

Fifty-four practices were enrolled over a 12-month recruitment period. At baseline, the mean proportion (standard deviation) of patients at the practice level meeting the clinical quality measures were: blood pressure, 0.72 (0.12); tobacco screening, 0.80 (0.30); tobacco cessation intervention, 0.57 (0.28); tobacco screening and cessation intervention: 0.78 (0.26).

Conclusion

This three-year research program will evaluate the ability of rural and medically underserved primary care practices to implement the quality improvement model by identifying drivers of and barriers to sustainable implementation, and test whether the model improves (a) blood pressure control and (b) tobacco use screening and cessation.

Expanding population-level interventions to help more low-income smokers quit: Study protocol for a randomized controlled trial

BACKGROUND

Low-income Americans have higher rates of smoking and a greater burden of smoking-related disease. In the United States, smokers in every state can access evidence-based telephone counseling through free tobacco quitlines. However, quitlines target smokers who are ready to quit in the next 30 days, which can exclude many low-income smokers. A smoke-free homes intervention may help engage smokers in tobacco control services who are not yet ready to quit. Previous research in low-income populations suggests that receiving a smoke-free homes intervention is associated with higher quit rates. This study tests whether, at a population level, expanding on quitlines to include a smoke-free homes intervention for smokers not ready to quit could engage more low-income smokers and increase long-term cessation rates.

METHODS

In a Hybrid Type 2 design, participants are recruited from 211 helplines in 9 states and randomly assigned to standard quitline or quitline plus smoke-free homes intervention arms. Participants in both arms are initially offered quitline services. In the quitline plus smoke-free homes condition, participants who decline the quitline are then offered a smoke-free homes intervention. Participants complete a baseline and follow-up surveys at 3 and 6 months. Those who have not yet quit at the 3-month follow-up are re-offered the interventions, which differ by study arm. The primary study outcome is self-reported 7-day point prevalence abstinence from smoking at 6-month follow-up.

CONCLUSION

This real-world cessation trial involving 9 state tobacco quitlines will help inform whether offering smoke-free homes as an alternative intervention could engage more low-income smokers with evidence-based interventions and increase overall cessation rates. This study has been registered at ClinicalTrials.gov (Study Identifier: NCT04311983).

Leveraging Implementation Science for Cardiovascular Health Equity: A Scientific Statement From the American Heart Association

Reducing cardiovascular disease disparities will require a concerted, focused effort to better adopt evidence-based interventions, in particular, those that address social determinants of health, in historically marginalized populations (ie, communities excluded on the basis of social identifiers like race, ethnicity, and social class and subject to inequitable distribution of social, economic, physical, and psychological resources). Implementation science is centered around stakeholder engagement and, by virtue of its reliance on theoretical frameworks, is custom built for addressing research-to-practice gaps. However, little guidance exists for how best to leverage implementation science to promote cardiovascular health equity. This American Heart Association scientific statement was commissioned to define implementation science with a cardiovascular health equity lens and to evaluate implementation research that targets cardiovascular inequities. We provide a 4-step roadmap and checklist with critical equity considerations for selecting/adapting evidence-based practices, assessing barriers and facilitators to implementation, selecting/using/adapting implementation strategies, and evaluating implementation success. Informed by our roadmap, we examine several organizational, community, policy, and multisetting interventions and implementation strategies developed to reduce cardiovascular disparities. We highlight gaps in implementation science research to date aimed at achieving cardiovascular health equity, including lack of stakeholder engagement, rigorous mixed methods, and equity-informed theoretical frameworks. We provide several key suggestions, including the need for improved conceptualization and inclusion of social and structural determinants of health in implementation science, and the use of adaptive, hybrid effectiveness designs. In addition, we call for more rigorous examination of multilevel interventions and implementation strategies with the greatest potential for reducing both primary and secondary cardiovascular disparities.

Revisiting concepts of evidence in implementation science

Background

Evidence, in multiple forms, is a foundation of implementation science. For public health and clinical practice, evidence includes the following: type 1 evidence on etiology and burden; type 2 evidence on effectiveness of interventions; and type 3: evidence on dissemination and implementation (D&I) within context. To support a vision for development and use of evidence in D&I science that is more comprehensive and equitable (particularly for type 3 evidence), this article aims to clarify concepts of evidence, summarize ongoing debates about evidence, and provide a set of recommendations and tools/resources for addressing the “how-to” in filling evidence gaps most critical to advancing implementation science.

Main text

Because current conceptualizations of evidence have been relatively narrow and insufficiently characterized in our opinion, we identify and discuss challenges and debates about the uses, usefulness, and gaps in evidence for implementation science. A set of questions is proposed to assist in determining when evidence is sufficient for dissemination and implementation. Intersecting gaps include the need to (1) reconsider how the evidence base is determined, (2) improve understanding of contextual effects on implementation, (3) sharpen the focus on health equity in how we approach and build the evidence-base, (4) conduct more policy implementation research and evaluation, and (5) learn from audience and stakeholder perspectives. We offer 15 recommendations to assist in filling these gaps and describe a set of tools for enhancing the evidence most needed in implementation science.

Conclusions

To address our recommendations, we see capacity as a necessary ingredient to shift the field’s approach to evidence. Capacity includes the “push” for implementation science where researchers are trained to develop and evaluate evidence which should be useful and feasible for implementers and reflect community or stakeholder priorities. Equally important, there has been inadequate training and too little emphasis on the “pull” for implementation science (e.g., training implementers, practice-based research). We suggest that funders and reviewers of research should adopt and support a more robust definition of evidence. By critically examining the evolving nature of evidence, implementation science can better fulfill its vision of facilitating widespread and equitable adoption, delivery, and sustainment of scientific advances.

Designing and conducting adaptive trials to evaluate interventions in health services and implementation research: practical considerations

Randomized controlled clinical trials are widely considered the gold standard for evaluating the efficacy or effectiveness of interventions in health care. Adaptive trials incorporate changes as the study proceeds, such as modifying allocation probabilities or eliminating treatment arms that are likely to be ineffective. These designs have been widely used in drug discovery studies but can also be useful in health services and implementation research and have been minimally used. As motivating examples, we use an ongoing adaptive trial and two completed parallel group studies and highlight potential advantages, disadvantages, and important considerations when using adaptive trial designs in health services and implementation research. In addition, we investigate the impact on power and the study duration if the two completed parallel-group trials had instead been conducted using adaptive principles. Compared with traditional trial designs, adaptive designs can often allow one to evaluate more interventions, adjust participant allocation probabilities (e.g., to achieve covariate balance), and identify participants who are likely to agree to enroll. These features could reduce resources needed to conduct a trial. However, adaptive trials have potential disadvantages and practical aspects that need to be considered, most notably outcomes that can be rapidly measured and extracted (e.g., long-term outcomes that take significant time to measure from data sources can be challenging), minimal missing data, and time trends. In conclusion, adaptive designs are a promising approach to help identify how best to implement evidence-based interventions into real-world practice in health services and implementation research.

High-Fidelity Agent-Based Modeling to Support Prevention Decision-Making: an Open Science Approach

Preventing adverse health outcomes is complex due to the multi-level contexts and social systems in which these phenomena occur. To capture both the systemic effects, local determinants, and individual-level risks and protective factors simultaneously, the prevention field has called for adoption of system science methods in general and agent-based models (ABMs) specifically. While these models can provide unique and timely insight into the potential of prevention strategies, an ABM’s ability to do so depends strongly on its accuracy in capturing the phenomenon. Furthermore, for ABMs to be useful, they need to be accepted by and available to decision-makers and other stakeholders. These two attributes of accuracy and acceptability are key components of open science. To ensure the creation of high-fidelity models and reliability in their outcomes and consequent model-based decision-making, we present a set of recommendations for adopting and using this novel method. We recommend ways to include stakeholders throughout the modeling process, as well as ways to conduct model verification, validation, and replication. Examples from HIV and overdose prevention work illustrate how these recommendations can be applied.

A technology-based intervention to improve safety, mental health and empowerment outcomes for immigrant women with intimate partner violence experiences: it's weWomen plus sequential multiple assignment randomized trial (SMART) protocol

BACKGROUND

Intimate partner violence (IPV) disproportionately affects immigrant women, an understudied and underserved population in need for evidence-based rigorously evaluated culturally competent interventions that can effectively address their health and safety needs.

METHODS

This study uses a sequential, multiple assignment, randomized trial (SMART) design to rigorously evaluate an adaptive, trauma-informed, culturally tailored technology-delivered intervention tailored to the needs of immigrant women who have experienced IPV. In the first stage randomization, participants are randomly assigned to an online safety decision and planning or a usual care control arm and safety, mental health and empowerment outcomes are assessed at 3-, 6- and 12-months post-baseline. For the second stage randomization, women who do not report significant improvements in safety (i.e., reduction in IPV) and empowerment from baseline to 3 months follow up (i.e., non-responders) are re- randomized to safety and empowerment strategies delivered via text only or a combination of text and phone calls with trained advocates. Data on outcomes (safety, mental health, and empowerment) for early non-responders is assessed at 6 and 12 months post re-randomization.

DISCUSSION

The study's SMART design provides an opportunity to implement and evaluate an individualized intervention protocol for immigrant women based on their response to type or intensity of intervention. The findings will be useful for identifying what works for whom and characteristics of participants needing a particular type or intensity level of intervention for improved outcomes. If found to be effective, the study will result in an evidence-based trauma-informed culturally tailored technology-based safety decision and planning intervention for immigrant survivors of IPV that can be implemented by practitioners serving immigrant women in diverse settings.

TRIAL REGISTRATION

This trial was registered with ClinicalTrials.gov as NCT04098276 on September 13, 2019.

Motor Imagery to Facilitate Sensorimotor Re-Learning (MOTIFS) after traumatic knee injury: study protocol for an adaptive randomized controlled trial

Background

Treatment following traumatic knee injury includes neuromuscular training, with or without surgical reconstruction. The aim of rehabilitation is to restore muscle function and address psychological factors to allow a return to activity. Attention is often on rehabilitation of knee function, but deficiencies often persist. Specific interventions addressing psychological factors are sparing with varying degrees of success. We have developed a novel training program, MOTor Imagery to Facilitate Sensorimotor Re-Learning (MOTIFS), which integrates simultaneous psychological training into physical rehabilitation exercises. The MOTIFS model individualizes rehabilitation to increase central nervous system involvement by creating realistic and relevant mental images based on past experiences. We hypothesize that a 12-week MOTIFS training intervention will improve psychological readiness to return to activity and muscle function to a greater extent than current neuromuscular training (Care-as-Usual).

Methods

This pragmatic 1:1 single assessor-blinded adaptive cumulative cluster-randomized controlled trial will include 106 knee-injured people with a goal of returning to physical activity. Participants are randomized to either the MOTIFS or Care-as-Usual condition. Primary outcomes are the ACL Return to Sport after Injury Scale and change in injured leg hop performance in a side hop task from baseline to 12 weeks. Secondary outcomes include patient-reported outcomes and assessment of muscle function using a hop test battery and Postural Orientation Errors at 12-week follow-up. At 12-month follow-up, patient-reported outcomes are assessed. A sub-group (7-10 in each group) will be interviewed to gain insight into experiences of rehabilitation.

Discussion

Strengths of this trial include that it is a randomized and pragmatic trial examining commonly under-studied aspects of rehabilitation following a knee injury. The model uses the patient as a reference, creating simultaneous psychological and physical training exercises with easily adopted principles for clinical practice. Limitations include that blinding is limited due to study design, and shifting the clinical paradigm to a more holistic model is a challenge. If successful, the MOTIFS model has implications for a clinically useful, individualized, and patient-relevant method of improving rehabilitation outcomes by integrating psychological training into physical training.

Trial registration

ClinicalTrials.gov NCT03473821. Registered March 22, 2018, with ethical approval that has been granted (Dnr 2016/413, Dnr 2018/927).

Trial status

Trial Status: Protocol Version is 2020, Dec 10 – Version 1

Supplementary Information

The online version contains supplementary material available at 10.1186/s13063-021-05713-8.

Using numerical modeling and simulation to assess the ethical burden in clinical trials and how it relates to the proportion of responders in a trial sample

In order to propose a more precise definition and explore how to reduce ethical losses in randomized controlled clinical trials (RCTs), we set out to identify trial participants who do not contribute to demonstrating that the treatment in the experimental arm is superior to that in the control arm. RCTs emerged mid-last century as the gold standard for assessing efficacy, becoming the cornerstone of the value of new therapies, yet their ethical grounds are a matter of debate. We introduce the concept of unnecessary participants in RCTs, the sum of non-informative participants and non-responders. The non-informative participants are considered not informative with respect to the efficacy measured in the trial in contrast to responders who carry all the information required to conclude on the treatment's efficacy. The non-responders present the event whether or not they are treated with the experimental treatment. The unnecessary participants carry the burden of having to participate in a clinical trial without benefiting from it, which might include experiencing side effects. Thus, these unnecessary participants carry the ethical loss that is inherent to the RCT methodology. On the contrary, responders to the experimental treatment bear its entire efficacy in the RCT. Starting from the proportions observed in a real placebo-controlled trial from the literature, we carried out simulations of RCTs progressively increasing the proportion of responders up to 100%. We show that the number of unnecessary participants decreases steadily until the RCT's ethical loss reaches a minimum. In parallel, the trial sample size decreases (presumably its cost as well), although the trial's statistical power increases as shown by the increase of the chi-square comparing the event rates between the two arms. Thus, we expect that increasing the proportion of responders in RCTs would contribute to making them more ethically acceptable, with less false negative outcomes.

Multitiered Systems of Support, Adaptive Interventions, and SMART Designs

This article introduces the special section on adaptive interventions and sequential multiple-assignment randomized trial (SMART) research designs. In addition to describing the two accompanying articles, we discuss features of adaptive interventions (AIs) and describe the use of SMART design to optimize AIs in the context of multitiered systems of support (MTSS) and integrated MTSS. AI is a treatment delivery model that explicitly specifies how information about individuals should be used to decide which treatment to provide in practice. Principles that apply to the design of AIs may help to more clearly operationalize MTSS-based programs, improve their implementation in school settings, and increase their efficacy when used according to evidence-based decision rules. A SMART is a research design for developing and optimizing MTSS-based programs. We provide a running example of a SMART design to optimize an MTSS-aligned AI that integrates academic and behavioral interventions.

Three Flavorings for a Soup to Cure what Ails Mental Health Services

With new tools from artificial intelligence and new perspectives on personalizing interventions, we could revolutionize the way mental health services are delivered and achieve major gains in improving the public's mental health. We examine Dr. Bickman's vision around these technological and paradigm changes that would usher in major scientific, workforce training, and societal cultural changes. We argue that additional efforts in research evaluations in implementation have the potential to scale up and adapt existing interventions and scale them out to diverse populations and service systems. The next stage of this work involves testing the effectiveness of personalized interventions that are preferred by the public and integrating these choices into sustainable service systems. We note cautions on the delivery of these programs as automated algorithmic recommendations are heretofore foreign to humans.

Collaborative care for depression management in primary care: A randomized roll-out trial using a type 2 hybrid effectiveness-implementation design

Background

The Collaborative Care Model (CoCM) is a well-established treatment for depression in primary care settings. The critical drivers and specific strategies for improving implementation and sustainment are largely unknown. Rigorous pragmatic research is needed to understand CoCM implementation processes and outcomes.

Methods

This study is a hybrid Type 2 randomized roll-out effectiveness-implementation trial of CoCM in 11 primary care practices affiliated with an academic medical center. The Collaborative Behavioral Health Program (CBHP) was developed as a means of improving access to effective mental health services for depression. Implementation strategies are provided to all practices. Using a sequential mixed methods approach, we will assess key stakeholders’ perspectives on barriers and facilitators of implementation and sustainability of CBHP. The speed and quantity of implementation activities completed over a 30-month period for each practice will be assessed. Economic analyses will be conducted to determine the budget impact and cost offset of CBHP in the healthcare system. We hypothesize that CBHP will be effective in reducing depressive symptoms and spillover effects on chronic health conditions. We will also examine differential outcomes among racial/ethnic minority patients.

Discussion

This study will elucidate critical drivers of successful CoCM implementation. It will be among the first to conduct economic analyses on a fee-for-service model utilizing billing codes for CoCM. Data may inform ways to improve implementation efficiency with an optimization approach to successive practices due to the roll-out design. Changes to the protocol and current status of the study are discussed.

Randomized Controlled Trials 1: Design

Today's clinical practice relies on the application of well-designed clinical research, the gold standard test of an intervention being the randomized controlled trial. Principles of the randomized control trial include emphasis on the principal research question, randomization, blinding; definitions of outcome measures, of inclusion and exclusion criteria, and of co-morbid and confounding factors; enrolling an adequate sample size; planning data management and analysis; preventing challenges to trial integrity such as drop-out, drop-in, and bias. The application of pre-trial planning is stressed to ensure the proper application of epidemiological principles resulting in clinical studies that are feasible and generalizable. In addition, funding strategies and trial team composition are discussed.

Randomized COVID-19 vaccination rollout can offer direct real-world evidence

Vaccines are vital to control the Coronavirus disease 2019 (COVID-19) pandemic, but the pressure to quickly move from research to implementation in the context of a pandemic crisis raises concerns about benefits and harms, vaccine acceptance and fair access. Here we present a strategy for the COVID-19 vaccination rollout which can be rapidly embedded and would offer direct real-world evidence of vaccines on a large scale to generate otherwise unobtainable knowledge on the safety and perhaps efficacy of COVID-19 vaccines. Such strategic rollouts leveraging randomization can provide important evidence, for COVID-19 and in future occasions, for vaccines and beyond.

Post-exposure prophylaxis against SARS-CoV-2 in close contacts of confirmed COVID-19 cases (CORIPREV): study protocol for a cluster-randomized trial

Background

Post-exposure prophylaxis (PEP) is a well-established strategy for the prevention of infectious diseases, in which recently exposed people take a short course of medication to prevent infection. The primary objective of the COVID-19 Ring-based Prevention Trial with lopinavir/ritonavir (CORIPREV-LR) is to evaluate the efficacy of a 14-day course of oral lopinavir/ritonavir as PEP against COVID-19 among individuals with a high-risk exposure to a confirmed case.

Methods

This is an open-label, multicenter, 1:1 cluster-randomized trial of LPV/r 800/200 mg twice daily for 14 days (intervention arm) versus no intervention (control arm), using an adaptive approach to sample size calculation. Participants will be individuals aged > 6 months with a high-risk exposure to a confirmed COVID-19 case within the past 7 days. A combination of remote and in-person study visits at days 1, 7, 14, 35, and 90 includes comprehensive epidemiological, clinical, microbiologic, and serologic sampling. The primary outcome is microbiologically confirmed COVID-19 infection within 14 days after exposure, defined as a positive respiratory tract specimen for SARS-CoV-2 by polymerase chain reaction. Secondary outcomes include safety, symptomatic COVID-19, seropositivity, hospitalization, respiratory failure requiring ventilator support, mortality, psychological impact, and health-related quality of life. Additional analyses will examine the impact of LPV/r on these outcomes in the subset of participants who test positive for SARS-CoV-2 at baseline. To detect a relative risk reduction of 40% with 80% power at α = 0.05, assuming the secondary attack rate in ring members (p₀) = 15%, 5 contacts per case and intra-class correlation coefficient (ICC) = 0.05, we require 110 clusters per arm, or 220 clusters overall and approximately 1220 enrollees after accounting for 10% loss-to-follow-up. We will modify the sample size target after 60 clusters, based on preliminary estimates of p₀, ICC, and cluster size and consider switching to an alternative drug after interim analyses and as new data emerges. The primary analysis will be a generalized linear mixed model with logit link to estimate the effect of LPV/r on the probability of infection. Participants who test positive at baseline will be excluded from the primary analysis but will be maintained for additional analyses to examine the impact of LPV/r on early treatment.

Discussion

Harnessing safe, existing drugs such as LPV/r as PEP could provide an important tool for control of the COVID-19 pandemic. Novel aspects of our design include the ring-based prevention approach, and the incorporation of remote strategies for conducting study visits and biospecimen collection.

Trial registration

This trial was registered at www.ClinicalTrials.gov (NCT04321174) on March 25, 2020.

Supplementary Information

The online version contains supplementary material available at 10.1186/s13063-021-05134-7.

Findings and lessons learnt from early termination of a pragmatic comparative effectiveness trial of video consultations in home-based palliative care

BACKGROUND

Health systems need evidence about how best to deliver home-based palliative care (HBPC) to meet the growing needs of seriously ill patients. We hypothesised that a tech-supported model that aimed to promote timely inter-professional team coordination using video consultation with a remote physician while a nurse is in the patient's home would be non-inferior compared with a standard model that includes routine home visits by nurses and physicians.

METHODS

We conducted a pragmatic, cluster randomised non-inferiority trial across 14 sites (HomePal Study). Registered nurses (n=111) were randomised to the two models so that approximately half of the patients with any serious illness admitted to HBPC and their caregivers were enrolled in each study arm. Process measures (video and home visits and satisfaction) were tracked. The primary outcomes for patients and caregivers were symptom burden and caregiving preparedness at 1-2 months.

RESULTS

The study was stopped early after 12 months of enrolment (patients=3533; caregivers=463) due to a combination of low video visit uptake (31%), limited substitution of video for home visits, and the health system's decision to expand telehealth use in response to changes in telehealth payment policies, the latter of which was incompatible with the randomised design. Implementation barriers included persistent workforce shortages and inadequate systems that contributed to scheduling and coordination challenges and unreliable technology and connectivity.

CONCLUSIONS

We encountered multiple challenges to feasibility, relevance and value of conducting large, multiyear pragmatic randomised trials with seriously ill patients in the real-world settings where care delivery, regulatory and payment policies are constantly shifting.

Effect of the Wingman-Connect Upstream Suicide Prevention Program for Air Force Personnel in Training: A Cluster Randomized Clinical Trial

IMPORTANCE

Suicide has been a leading manner of death for US Air Force personnel in recent years. Universal prevention programs that reduce suicidal thoughts and behaviors in military populations have not been identified.

OBJECTIVES

To determine whether the Wingman-Connect program for Airmen-in-training reduces suicidal ideation, depression, and occupational problems compared with a stress management program and to test the underlying network health model positing that cohesive, healthy units are protective against suicidal ideation.

DESIGN, SETTING, AND PARTICIPANTS

This cluster randomized clinical trial was conducted from October 2017 to October 2019 and compared classes of personnel followed up for 6 months. The setting was a US Air Force technical training school, with participants studied to their first base assignment, whether US or international. Participants in 216 classes were randomized, with an 84% retention rate. Data analysis was performed from November 2019 to May 2020.

INTERVENTIONS

The Wingman-Connect program used group skill building for cohesion, shared purpose, and managing career and personal stressors (3 blocks of 2 hours each). Stress management training covered cognitive and behavioral strategies (2 hours). Both conditions had a 1-hour booster session, plus text messages.

MAIN OUTCOMES AND MEASURES

The primary outcomes were scores on the suicidal ideation and depression scales of the Computerized Adaptive Test for Mental Health and self-reports of military occupational impairment. Class network protective factors hypothesized to mediate the effect of Wingman-Connect were assessed with 4 measures: cohesion assessed perceptions that classmates cooperate, work well together, and support each other; morale was measured with a single item used in other studies with military samples; healthy class norms assessed perceptions of behaviors supported by classmates; and bonds to classmates were assessed by asking each participant to name classmates whom they respect and would choose to spend time with.

RESULTS

A total of 215 classes including 1485 individuals (1222 men [82.3%]; mean [SD] age, 20.9 [3.1] years) participated; 748 individuals were enrolled in the Wingman-Connect program and 737 individuals were enrolled in the stress management program. At 1 month, the Wingman-Connect group reported lower suicidal ideation severity (effect size [ES], -0.23; 95% CI, -0.39 to -0.09; P = .001) and depression symptoms (ES, -0.24; 95% CI, -0.41 to -0.08; P = .002) and fewer occupational problems (ES, -0.14; 95% CI, -0.31 to -0.02; P = .02). At 6 months, the Wingman-Connect group reported lower depression symptoms (ES, -0.16; 95% CI, -0.34 to -0.02; P = .03), whereas the difference in suicidal ideation severity was not significant (ES, -0.13; 95% CI, -0.29 to 0.01; P = .06). The number needed to treat to produce 1 fewer participant with elevated depression at either follow-up point was 21. The benefits of the training on occupational problems did not extend past 1 month. The Wingman-Connect program strengthened cohesive, healthy class units, which helped reduce suicidal ideation severity (estimate, -0.035; 95% CI, -0.07 to -0.01; P = .02) and depression symptom scores (estimate, -0.039; 95% CI, -0.07 to -0.01; P = .02) at 1 month.

CONCLUSIONS AND RELEVANCE

Wingman-Connect is the first universal prevention program to reduce suicidal ideation and depression symptoms in a general Air Force population. Group training that builds cohesive, healthy military units is promising for upstream suicide prevention and may be essential for ecological validity. Extension of the program to the operational Air Force is recommended for maintaining continuity and testing the prevention impact on suicidal behavior.

TRIAL REGISTRATION

ClinicalTrials.gov Identifier: NCT04067401.

IDeA States Pediatric Clinical Trials Network for Underserved and Rural Communities

The National Institutes of Health's Environmental Influences on Child Health Outcomes (ECHO) program aims to study high-priority and high-impact pediatric conditions. This broad-based health initiative is unique in the National Institutes of Health research portfolio and involves 2 research components: (1) a large group of established centers with pediatric cohorts combining data to support longitudinal studies (ECHO cohorts) and (2) pediatric trials program for institutions within Institutional Development Awards states, known as the ECHO Institutional Development Awards States Pediatric Clinical Trials Network (ISPCTN). In the current presentation, we provide a broad overview of the ISPCTN and, particularly, its importance in enhancing clinical trials capabilities of pediatrician scientists through the support of research infrastructure, while at the same time implementing clinical trials that inform future health care for children. The ISPCTN research mission is aligned with the health priority conditions emphasized in the ECHO program, with a commitment to bringing state-of-the-science trials to children residing in underserved and rural communities. ISPCTN site infrastructure is critical to successful trial implementation and includes research training for pediatric faculty and coordinators. Network sites exist in settings that have historically had limited National Institutes of Health funding success and lacked pediatric research infrastructure, with the initial funding directed to considerable efforts in professional development, implementation of regulatory procedures, and engagement of communities and families. The Network has made considerable headway with these objectives, opening two large research studies during its initial 18 months as well as producing findings that serve as markers of success that will optimize sustainability.

The Implementation Research Logic Model: a method for planning, executing, reporting, and synthesizing implementation projects

BACKGROUND

Numerous models, frameworks, and theories exist for specific aspects of implementation research, including for determinants, strategies, and outcomes. However, implementation research projects often fail to provide a coherent rationale or justification for how these aspects are selected and tested in relation to one another. Despite this need to better specify the conceptual linkages between the core elements involved in projects, few tools or methods have been developed to aid in this task. The Implementation Research Logic Model (IRLM) was created for this purpose and to enhance the rigor and transparency of describing the often-complex processes of improving the adoption of evidence-based interventions in healthcare delivery systems.

METHODS

The IRLM structure and guiding principles were developed through a series of preliminary activities with multiple investigators representing diverse implementation research projects in terms of contexts, research designs, and implementation strategies being evaluated. The utility of the IRLM was evaluated in the course of a 2-day training to over 130 implementation researchers and healthcare delivery system partners.

RESULTS

Preliminary work with the IRLM produced a core structure and multiple variations for common implementation research designs and situations, as well as guiding principles and suggestions for use. Results of the survey indicated a high utility of the IRLM for multiple purposes, such as improving rigor and reproducibility of projects; serving as a "roadmap" for how the project is to be carried out; clearly reporting and specifying how the project is to be conducted; and understanding the connections between determinants, strategies, mechanisms, and outcomes for their project.

CONCLUSIONS

The IRLM is a semi-structured, principle-guided tool designed to improve the specification, rigor, reproducibility, and testable causal pathways involved in implementation research projects. The IRLM can also aid implementation researchers and implementation partners in the planning and execution of practice change initiatives. Adaptation and refinement of the IRLM are ongoing, as is the development of resources for use and applications to diverse projects, to address the challenges of this complex scientific field.

The adaptive designs CONSORT extension (ACE) statement: a checklist with explanation and elaboration guideline for reporting randomised trials that use an adaptive design

Adaptive designs (ADs) allow pre-planned changes to an ongoing trial without compromising the validity of conclusions and it is essential to distinguish pre-planned from unplanned changes that may also occur. The reporting of ADs in randomised trials is inconsistent and needs improving. Incompletely reported AD randomised trials are difficult to reproduce and are hard to interpret and synthesise. This consequently hampers their ability to inform practice as well as future research and contributes to research waste. Better transparency and adequate reporting will enable the potential benefits of ADs to be realised.This extension to the Consolidated Standards Of Reporting Trials (CONSORT) 2010 statement was developed to enhance the reporting of randomised AD clinical trials. We developed an Adaptive designs CONSORT Extension (ACE) guideline through a two-stage Delphi process with input from multidisciplinary key stakeholders in clinical trials research in the public and private sectors from 21 countries, followed by a consensus meeting. Members of the CONSORT Group were involved during the development process.The paper presents the ACE checklists for AD randomised trial reports and abstracts, as well as an explanation with examples to aid the application of the guideline. The ACE checklist comprises seven new items, nine modified items, six unchanged items for which additional explanatory text clarifies further considerations for ADs, and 20 unchanged items not requiring further explanatory text. The ACE abstract checklist has one new item, one modified item, one unchanged item with additional explanatory text for ADs, and 15 unchanged items not requiring further explanatory text.The intention is to enhance transparency and improve reporting of AD randomised trials to improve the interpretability of their results and reproducibility of their methods, results and inference. We also hope indirectly to facilitate the much-needed knowledge transfer of innovative trial designs to maximise their potential benefits. In order to encourage its wide dissemination this article is freely accessible on the BMJ and Trials journal websites."To maximise the benefit to society, you need to not just do research but do it well" Douglas G Altman.

The Adaptive designs CONSORT Extension (ACE) statement: a checklist with explanation and elaboration guideline for reporting randomised trials that use an adaptive design

Adaptive designs (ADs) allow pre-planned changes to an ongoing trial without compromising the validity of conclusions and it is essential to distinguish pre-planned from unplanned changes that may also occur. The reporting of ADs in randomised trials is inconsistent and needs improving. Incompletely reported AD randomised trials are difficult to reproduce and are hard to interpret and synthesise. This consequently hampers their ability to inform practice as well as future research and contributes to research waste. Better transparency and adequate reporting will enable the potential benefits of ADs to be realised.This extension to the Consolidated Standards Of Reporting Trials (CONSORT) 2010 statement was developed to enhance the reporting of randomised AD clinical trials. We developed an Adaptive designs CONSORT Extension (ACE) guideline through a two-stage Delphi process with input from multidisciplinary key stakeholders in clinical trials research in the public and private sectors from 21 countries, followed by a consensus meeting. Members of the CONSORT Group were involved during the development process.The paper presents the ACE checklists for AD randomised trial reports and abstracts, as well as an explanation with examples to aid the application of the guideline. The ACE checklist comprises seven new items, nine modified items, six unchanged items for which additional explanatory text clarifies further considerations for ADs, and 20 unchanged items not requiring further explanatory text. The ACE abstract checklist has one new item, one modified item, one unchanged item with additional explanatory text for ADs, and 15 unchanged items not requiring further explanatory text.The intention is to enhance transparency and improve reporting of AD randomised trials to improve the interpretability of their results and reproducibility of their methods, results and inference. We also hope indirectly to facilitate the much-needed knowledge transfer of innovative trial designs to maximise their potential benefits.

Efficacy of a Spatial Repellent for Control of Malaria in Indonesia: A Cluster-Randomized Controlled Trial

A cluster-randomized, double-blinded, placebo-controlled trial was conducted to estimate the protective efficacy (PE) of a spatial repellent (SR) against malaria infection in Sumba, Indonesia. Following radical cure in 1,341 children aged ≥ 6 months to ≤ 5 years in 24 clusters, households were given transfluthrin or placebo passive emanators (devices designed to release vaporized chemical). Monthly blood screening and biweekly human-landing mosquito catches were performed during a 10-month baseline (June 2015-March 2016) and a 24-month intervention period (April 2016-April 2018). Screening detected 164 first-time infections and an accumulative total of 459 infections in 667 subjects in placebo-control households, and 134 first-time and 253 accumulative total infections among 665 subjects in active intervention households. The 24-cluster protective effect of 27.7% and 31.3%, for time to first-event and overall (total new) infections, respectively, was not statistically significant. Purportedly, this was due in part to zero to low incidence in some clusters, undermining the ability to detect a protective effect. Subgroup analysis of 19 clusters where at least one infection occurred during baseline showed 33.3% (P-value = 0.083) and 40.9% (P-value = 0.0236, statistically significant at the one-sided 5% significance level) protective effect to first infection and overall infections, respectively. Among 12 moderate- to high-risk clusters, a statistically significant decrease in infection by intervention was detected (60% PE). Primary entomological analysis of impact was inconclusive. Although this study suggests SRs prevent malaria, additional evidence is required to demonstrate the product class provides an operationally feasible and effective means of reducing malaria transmission.

A Procedure for Changing a Behavioral Health Treatment During a Trial, with Case Example in Suicide Prevention

During a trial, standardization can lock in a treatment that researchers learn is flawed and may be ineffective. In such cases, researchers typically decide between two options, continue the trial and monitor for iatrogenic effects or stop the trial. When faced with this dilemma while testing an adaptation of motivational interviewing to address suicidal ideation, our research team considered a third option, to correct the flaws in the intervention and study the effect on outcome. We explored the rationale for and against changing an intervention mid-trial and progressed through a series of steps to determine whether we should change the intervention, ultimately deciding to make changes and examine their impact. We developed a procedure that researchers can use to determine whether they should change an intervention during a trial, how to implement the changes, and how to redesign their study. When faced with evidence that a treatment is ineffective, researchers should consider changing the intervention and examining the effects of the changes on outcome. Such decisions may be particularly relevant in trials examining life-threatening outcomes. Making and studying these changes may increase the potential for the study to identify a treatment that produces a desired outcome.

Designs and methods for implementation research: Advancing the mission of the CTSA program

INTRODUCTION

The US National Institutes of Health (NIH) established the Clinical and Translational Science Award (CTSA) program in response to the challenges of translating biomedical and behavioral interventions from discovery to real-world use. To address the challenge of translating evidence-based interventions (EBIs) into practice, the field of implementation science has emerged as a distinct discipline. With the distinction between EBI effectiveness research and implementation research comes differences in study design and methodology, shifting focus from clinical outcomes to the systems that support adoption and delivery of EBIs with fidelity.

METHODS

Implementation research designs share many of the foundational elements and assumptions of efficacy/effectiveness research. Designs and methods that are currently applied in implementation research include experimental, quasi-experimental, observational, hybrid effectiveness-implementation, simulation modeling, and configurational comparative methods.

RESULTS

Examples of specific research designs and methods illustrate their use in implementation science. We propose that the CTSA program takes advantage of the momentum of the field's capacity building in three ways: 1) integrate state-of-the-science implementation methods and designs into its existing body of research; 2) position itself at the forefront of advancing the science of implementation science by collaborating with other NIH institutes that share the goal of advancing implementation science; and 3) provide adequate training in implementation science.

CONCLUSIONS

As implementation methodologies mature, both implementation science and the CTSA program would greatly benefit from cross-fertilizing expertise and shared infrastructures that aim to advance healthcare in the USA and around the world.

Motivational Interviewing to Address Suicidal Ideation: A Randomized Controlled Trial in Veterans

OBJECTIVE

Although the months following discharge from psychiatric hospitalization are a period of acute risk for veterans, there is a dearth of empirically supported treatments tailored to veterans in acute psychiatric hospitalization.

METHOD

We conducted a randomized controlled trial to test the efficacy of Motivational Interviewing to Address Suicidal Ideation (MI-SI) that explored and resolved ambivalence, and a revised MI-SI (MI-SI-R) that resolved ambivalence, on suicidal ideation (SI) in hospitalized veterans who scored > 2 on the Scale for Suicidal Ideation. Participants were randomized to receive MI-SI plus treatment as usual (TAU), MI-SI-R+TAU, or TAU alone. MI-SI+TAU and MI-SI-R+TAU included two in-hospital therapy sessions and one telephone booster session. Participants completed follow-up assessments over 6 months.

RESULTS

Participants in all groups experienced reductions in the presence and severity of SI, but there were no significant differences among the groups. For the presence of SI, results were in the hypothesized direction for both MI-SI+TAU conditions.

CONCLUSIONS

Results are nondefinitive, but the effect size of both versions of MI-SI+TAU on the presence of SI was consistent with prior MI findings. Exploratory analyses suggest MI-SI-R may be preferable to MI-SI. More intensive MI-SI-R with a greater number of follow-ups may increase its effectiveness.

Novel Clinical Trial Designs to Improve the Efficiency of Research

SUMMARY

Large randomized trials provide the highest level of clinical evidence. However, enrolling large numbers of randomized patients across numerous study sites is expensive and often takes years. There will never be enough conventional clinical trials to address the important questions in medicine. Efficient alternatives to conventional randomized trials that preserve protections against bias and confounding are thus of considerable interest. A common feature of novel trial designs is that they are pragmatic and facilitate enrollment of large numbers of patients at modest cost. This article presents trial designs including cluster designs, real-time automated enrollment, and practitioner-preference approaches. Then various adaptive designs that improve trial efficiency are presented. And finally, the article discusses the advantages of embedding randomized trials within registries.

Evaluation of Store Environment Changes of an In-Store Intervention to Promote Fruits and Vegetables in Latino/Hispanic-Focused Food Stores

Implementing interventions that manipulate food store environments are one potential strategy for improving dietary behaviors. The present study evaluated intervention effects, from the El Valor de Nuestra Salud (The Value of Our Health) study, on in-store environmental changes within Latino/Hispanic-focused food stores (tiendas). Sixteen tiendas were randomly assigned to either: a six-month structural and social food store intervention or a wait-list control condition. Store-level environmental measures of product availability, placement, and promotion were assessed monthly from baseline through six-months post-baseline using store audits. Linear mixed effects models tested for condition-by-time interactions in store-level environmental measures. Results demonstrated that the intervention was successful at increasing the total number of fruit and vegetable (FV) promotions (p < 0.001) and the number of FV promotions outside the produce department (p < 0.001) among tiendas in the intervention versus control condition. No changes in product availability or placement were observed. Results suggests changing the marketing mix element of promotions within small stores is measurable and feasible in an in-store intervention. Difficulties in capturing changes in product availability and placement may be due to intervention implementation methods chosen by tiendas. It is important to build upon the lessons learned from these types of interventions to disseminate evidence-based in-store interventions.

Point-of-Care Clinical Trials in Sports Medicine Research: Identifying Effective Treatment Interventions Through Comparative Effectiveness Research

CONTEXT

Recently, calls to conduct comparative effectiveness research (CER) in athletic training to better support patient care decisions have been circulated. Traditional research methods (eg, randomized controlled trials [RCTs], observational studies) may be ill suited for CER. Thus, innovative research methods are needed to support CER efforts.

OBJECTIVES

To discuss the limitations of traditional research designs in CER studies, describe a novel methodologic approach called the point-of-care clinical trial (POC-CT), and highlight components of the POC-CT (eg, incorporation of an electronic medical record [EMR], Bayesian adaptive feature) that allow investigators to conduct scientifically rigorous studies at the point of care.

DESCRIPTION

Practical concerns (eg, high costs and limited generalizability of RCTs, the inability to control for bias in observational studies) may stall CER efforts in athletic training. In short, the aim of the POC-CT is to embed a randomized pragmatic trial into routine care; thus, patients are randomized to minimize potential bias, but the study is conducted at the point of care to limit cost and improve the generalizability of the findings. Furthermore, the POC-CT uses an EMR to replace much of the infrastructure associated with a traditional RCT (eg, research team, patient and clinician reminders) and a Bayesian adaptive feature to help limit the number of patients needed for the study. Together, the EMR and Bayesian adaptive feature can improve the overall feasibility of the study and preserve the typical clinical experiences of the patient and clinician.

CLINICAL ADVANTAGES

The POC-CT includes the basic tenets of practice-based research because studies are conducted at the point of care, in real-life settings, and during routine clinical practice. If implemented effectively, the POC-CT can be seamlessly integrated into daily clinical practice, allowing investigators to establish patient-reported evidence that may be quickly applied to patient care decisions. This design appears to be a promising approach for CER investigations and may help establish a "learning health care system" in the sports medicine community.

Enhancing the Impact of Implementation Strategies in Healthcare: A Research Agenda

The field of implementation science was developed to better understand the factors that facilitate or impede implementation and generate evidence for implementation strategies. In this article, we briefly review progress in implementation science, and suggest five priorities for enhancing the impact of implementation strategies. Specifically, we suggest the need to: (1) enhance methods for designing and tailoring implementation strategies; (2) specify and test mechanisms of change; (3) conduct more effectiveness research on discrete, multi-faceted, and tailored implementation strategies; (4) increase economic evaluations of implementation strategies; and (5) improve the tracking and reporting of implementation strategies. We believe that pursuing these priorities will advance implementation science by helping us to understand when, where, why, and how implementation strategies improve implementation effectiveness and subsequent health outcomes.

Development process of a consensus-driven CONSORT extension for randomised trials using an adaptive design

BACKGROUND

Adequate reporting of adaptive designs (ADs) maximises their potential benefits in the conduct of clinical trials. Transparent reporting can help address some obstacles and concerns relating to the use of ADs. Currently, there are deficiencies in the reporting of AD trials. To overcome this, we have developed a consensus-driven extension to the CONSORT statement for randomised trials using an AD. This paper describes the processes and methods used to develop this extension rather than detailed explanation of the guideline.

METHODS

We developed the guideline in seven overlapping stages: 1) Building on prior research to inform the need for a guideline; 2) A scoping literature review to inform future stages; 3) Drafting the first checklist version involving an External Expert Panel; 4) A two-round Delphi process involving international, multidisciplinary, and cross-sector key stakeholders; 5) A consensus meeting to advise which reporting items to retain through voting, and to discuss the structure of what to include in the supporting explanation and elaboration (E&E) document; 6) Refining and finalising the checklist; and 7) Writing-up and dissemination of the E&E document. The CONSORT Executive Group oversaw the entire development process.

RESULTS

Delphi survey response rates were 94/143 (66%), 114/156 (73%), and 79/143 (55%) in rounds 1, 2, and across both rounds, respectively. Twenty-seven delegates from Europe, the USA, and Asia attended the consensus meeting. The main checklist has seven new and nine modified items and six unchanged items with expanded E&E text to clarify further considerations for ADs. The abstract checklist has one new and one modified item together with an unchanged item with expanded E&E text. The E&E document will describe the scope of the guideline, the definition of an AD, and some types of ADs and trial adaptations and explain each reporting item in detail including case studies.

CONCLUSIONS

We hope that making the development processes, methods, and all supporting information that aided decision-making transparent will enhance the acceptability and quick uptake of the guideline. This will also help other groups when developing similar CONSORT extensions. The guideline is applicable to all randomised trials with an AD and contains minimum reporting requirements.

The Inter-ministerial National Structural Intervention trial (INSTRUCT): protocol for a parallel group cluster randomised controlled trial of a structural intervention to reduce HIV infection among young women in Botswana

Background

Wide recognition that structural factors are important in the HIV epidemic has not generated much evidence of impact of structural interventions. Few randomised controlled trials of structural interventions for HIV prevention have an HIV endpoint, and most of those did not show a significant impact. It has proved difficult to prevent new HIV infections in Botswana, especially among young women, many of whom are unable to act on HIV preventive choices. Proposed by a government think tank in Botswana, the Inter-ministerial National Structural Intervention trial (INSTRUCT) tests whether addressing social and economic factors, including gender inequality, gender violence, poverty, and poor access to education, can lower HIV infection rates among young women. Focussed on increasing access by marginalised young women to government support programs, the intervention seeks to change their structural position, reducing their vulnerability to transactional sex, and thus to HIV infection.

Methods

This parallel group cluster randomised controlled trial compares HIV rates among young women in districts with and without the structural interventions. The 30 administrative districts in the country, stratified by HIV prevalence and development status, will be randomly assigned to 5-district implementation waves. The intervention in the first-wave districts will include: (i) recruiting and preparing vulnerable young women to apply to government support programs, (ii) making the support programs more accessible to young women by engaging local program officers and young women in co-evaluation of programs and co-design of solutions; and (iii) generating an enabling environment for change in communities through an audio-drama edutainment program. In year five, an impact survey will measure HIV rates among vulnerable young women (15–29 years) in a random sample of communities in the five intervention districts and in the five second-wave (control) districts. Fieldworkers will undertake rapid HIV screening and interview young women and young men, collecting information on secondary outcomes of attitudes and behaviours.

Discussion

This is the first step in a planned stepped-wedge design that will roll out the intervention, modified as necessary, to all districts. Strong government commitment provides an important opportunity to reduce new HIV cases in Botswana, and guide prevention efforts in other countries.

Trial registration

Registration number: ISRCTN 54878784. Registry: ISRCTN. Date of registration: 11 June 2013.

Interventions to reduce unnecessary caesarean sections in healthy women and babies

Optimising the use of caesarean section (CS) is of global concern. Underuse leads to maternal and perinatal mortality and morbidity. Conversely, overuse of CS has not shown benefits and can create harm. Worldwide, the frequency of CS continues to increase, and interventions to reduce unnecessary CSs have shown little success. Identifying the underlying factors for the continuing increase in CS use could improve the efficacy of interventions. In this Series paper, we describe the factors for CS use that are associated with women, families, health professionals, and health-care organisations and systems, and we examine behavioural, psychosocial, health system, and financial factors. We also outline the type and effects of interventions to reduce CS use that have been investigated. Clinical interventions, such as external cephalic version for breech delivery at term, vaginal breech delivery in appropriately selected women, and vaginal birth after CS, could reduce the frequency of CS use. Approaches such as labour companionship and midwife-led care have been associated with higher proportions of physiological births, safer outcomes, and lower health-care costs relative to control groups without these interventions, and with positive maternal experiences, in high-income countries. Such approaches need to be assessed in middle-income and low-income countries. Educational interventions for women should be complemented with meaningful dialogue with health professionals and effective emotional support for women and families. Investing in the training of health professionals, eliminating financial incentives for CS use, and reducing fear of litigation is fundamental. Safe, private, welcoming, and adequately resourced facilities are needed. At the country level, effective medical leadership is essential to ensure CS is used only when indicated. We conclude that interventions to reduce overuse must be multicomponent and locally tailored, addressing women's and health professionals' concerns, as well as health system and financial factors.

Dexamethasone for Cardiac Surgery trial (DECS-II): Rationale and a novel, practice preference-randomized consent design

BACKGROUND

Numerous studies have investigated high-dose corticosteroids in cardiac surgery, but with mixed results leading to ongoing variations in practice around the world. DECS-II is a study comparing high-dose dexamethasone with placebo in patients undergoing cardiac surgery.

METHODS

We discuss the rationale for conducting DECS-II, a 2800-patient, pragmatic, multicenter, assessor-blinded, randomized trial in cardiac surgery, and the features of the DECS-II study design (objectives, end points, target population, based on practice preference with post-randomization consent, treatments, patient follow-up and analysis).

CONCLUSIONS

The DECS-II trial will use a novel, efficient trial design to evaluate whether high-dose dexamethasone has a patient-centered benefit of enhancing recovery and increasing the number of days at home after cardiac surgery.

Selecting and Improving Quasi-Experimental Designs in Effectiveness and Implementation Research

Interventional researchers face many design challenges when assessing intervention implementation in real-world settings. Intervention implementation requires holding fast on internal validity needs while incorporating external validity considerations (such as uptake by diverse subpopulations, acceptability, cost, and sustainability). Quasi-experimental designs (QEDs) are increasingly employed to achieve a balance between internal and external validity. Although these designs are often referred to and summarized in terms of logistical benefits, there is still uncertainty about (a) selecting from among various QEDs and (b) developing strategies to strengthen the internal and external validity of QEDs. We focus here on commonly used QEDs (prepost designs with nonequivalent control groups, interrupted time series, and stepped-wedge designs) and discuss several variants that maximize internal and external validity at the design, execution and implementation, and analysis stages.

Comparative effectiveness in urology: a state of the art review utilizing a systematic approach

PURPOSE OF REVIEW

Comparative effectiveness research plays a vital role in healthcare delivery by guiding evidence-based practices. We performed a state-of-the-art review of comparative effectiveness research in the urology literature for 2016, utilizing a systematic approach. Seven high-impact papers are reviewed in detail.

RECENT FINDINGS

Across the breadth of urology, there were several important studies in comparative effectiveness research, of which we will highlight two randomized controlled trials and five observational trials: radiotherapy, prostatectomy, and active monitoring have equivalent mortality outcomes in patients with localized prostate cancer; the ideal modality of patient education is yet to be determined, and written education has minimal effect on patient perception of prostate specific antigen screening; robotic prostatectomy is associated with higher perioperative complication rates on a population basis; racial disparities exist in incontinence rates after treatment for localized prostate cancer, but not in irritative, bowel, or sexual function; androgen deprivation therapy is associated with higher fracture, peripheral artery disease, and cardiac-related complications than bilateral orchiectomy; robotic and open cystectomy offer comparable cancer-specific mortality and perioperative outcomes; and bonuses for low-cost hospitals can inadvertently reward low-quality hospitals.

SUMMARY

There have been major advancements in comparative effectiveness research in urology in 2016.

Variation in Research Designs Used to Test the Effectiveness of Dissemination and Implementation Strategies: A Review

Background

The need for optimal study designs in dissemination and implementation (D&I) research is increasingly recognized. Despite the wide range of study designs available for D&I research, we lack understanding of the types of designs and methodologies that are routinely used in the field. This review assesses the designs and methodologies in recently proposed D&I studies and provides resources to guide design decisions.

Methods

We reviewed 404 study protocols published in the journal Implementation Science from 2/2006 to 9/2017. Eligible studies tested the efficacy or effectiveness of D&I strategies (i.e., not effectiveness of the underlying clinical or public health intervention); had a comparison by group and/or time; and used ≥1 quantitative measure. Several design elements were extracted: design category (e.g., randomized); design type [e.g., cluster randomized controlled trial (RCT)]; data type (e.g., quantitative); D&I theoretical framework; levels of treatment assignment, intervention, and measurement; and country in which the research was conducted. Each protocol was double-coded, and discrepancies were resolved through discussion.

Results

Of the 404 protocols reviewed, 212 (52%) studies tested one or more implementation strategy across 208 manuscripts, therefore meeting inclusion criteria. Of the included studies, 77% utilized randomized designs, primarily cluster RCTs. The use of alternative designs (e.g., stepped wedge) increased over time. Fewer studies were quasi-experimental (17%) or observational (6%). Many study design categories (e.g., controlled pre-post, matched pair cluster design) were represented by only one or two studies. Most articles proposed quantitative and qualitative methods (61%), with the remaining 39% proposing only quantitative. Half of protocols (52%) reported using a theoretical framework to guide the study. The four most frequently reported frameworks were Consolidated Framework for Implementing Research and RE-AIM (n = 16 each), followed by Promoting Action on Research Implementation in Health Services and Theoretical Domains Framework (n = 12 each).

Conclusion

While several novel designs for D&I research have been proposed (e.g., stepped wedge, adaptive designs), the majority of the studies in our sample employed RCT designs. Alternative study designs are increasing in use but may be underutilized for a variety of reasons, including preference of funders or lack of awareness of these designs. Promisingly, the prevalent use of quantitative and qualitative methods together reflects methodological innovation in newer D&I research.

Two-Year Impact of Prevention Programs on Adolescent Depression: an Integrative Data Analysis Approach

This paper presents the first findings of an integrative data analysis of individual-level data from 19 adolescent depression prevention trials (n = 5210) involving nine distinct interventions across 2 years post-randomization. In separate papers, several interventions have been found to decrease the risk of depressive disorders or elevated depressive/internalizing symptoms among youth. One type of intervention specifically targets youth without a depressive disorder who are at risk due to elevated depressive symptoms and/or having a parent with a depressive disorder. A second type of intervention targets two broad domains: prevention of problem behaviors, which we define as drug use/abuse, sexual risk behaviors, conduct disorder, or other externalizing problems, and general mental health. Most of these latter interventions improve parenting or family factors. We examined the shared and unique effects of these interventions by level of baseline youth depressive symptoms, sociodemographic characteristics of the youth (age, sex, parent education, and family income), type of intervention, and mode of intervention delivery to the youth, parent(s), or both. We harmonized eight different measures of depression utilized across these trials and used growth models to evaluate intervention impact over 2 years. We found a significant overall effect of these interventions on reducing depressive symptoms over 2 years and a stronger impact among those interventions that targeted depression specifically rather than problem behaviors or general mental health, especially when baseline symptoms were high. Implications for improving population-level impact are discussed.

Comprehensive, integrated approaches to suicide prevention: practical guidance

BACKGROUND

Efforts in the USA during the 21st century to stem the ever-rising tide of suicide and risk-related premature deaths, such as those caused by drug intoxications, have failed. Based primarily on identifying individuals with heightened risk nearing the precipice of death, these initiatives face fundamental obstacles that cannot be overcome readily.

OBJECTIVE

This paper describes the step-by-step development of a comprehensive public health approach that seeks to integrate at the community level an array of programmatic efforts, which address upstream (distal) risk factors to alter life trajectories while also involving health systems and clinical providers who care for vulnerable, distressed individuals, many of whom have attempted suicide.

CONCLUSION

Preventing suicide and related self-injury morbidity and mortality, and their antecedents, will require a systemic approach that builds on a societal commitment to save lives and collective actions that bring together diverse communities, service organisations, healthcare providers and governmental agencies and political leaders. This will require frank, data-based appraisals of burden that drive planning, programme development and implementation, rigorous evaluation and a willingness to try-fail-and-try-again until the tide has been turned.

Encouraging Physical Activity in Patients With Diabetes: Intervention Using a Reinforcement Learning System

BACKGROUND

Regular physical activity is known to be beneficial for people with type 2 diabetes. Nevertheless, most of the people who have diabetes lead a sedentary lifestyle. Smartphones create new possibilities for helping people to adhere to their physical activity goals through continuous monitoring and communication, coupled with personalized feedback.

OBJECTIVE

The aim of this study was to help type 2 diabetes patients increase the level of their physical activity.

METHODS

We provided 27 sedentary type 2 diabetes patients with a smartphone-based pedometer and a personal plan for physical activity. Patients were sent short message service messages to encourage physical activity between once a day and once per week. Messages were personalized through a Reinforcement Learning algorithm so as to improve each participant's compliance with the activity regimen. The algorithm was compared with a static policy for sending messages and weekly reminders.

RESULTS

Our results show that participants who received messages generated by the learning algorithm increased the amount of activity and pace of walking, whereas the control group patients did not. Patients assigned to the learning algorithm group experienced a superior reduction in blood glucose levels (glycated hemoglobin [HbA1c]) compared with control policies, and longer participation caused greater reductions in blood glucose levels. The learning algorithm improved gradually in predicting which messages would lead participants to exercise.

CONCLUSIONS

Mobile phone apps coupled with a learning algorithm can improve adherence to exercise in diabetic patients. This algorithm can be used in large populations of diabetic patients to improve health and glycemic control. Our results can be expanded to other areas where computer-led health coaching of humans may have a positive impact. Summary of a part of this manuscript has been previously published as a letter in Diabetes Care, 2016.

Investigating interventions to increase uptake of HIV testing and linkage into care or prevention for male partners of pregnant women in antenatal clinics in Blantyre, Malawi: study protocol for a cluster randomised trial

BACKGROUND

Despite large-scale efforts to diagnose people living with HIV, 54% remain undiagnosed in sub-Saharan Africa. The gap in knowledge of HIV status and uptake of follow-on services remains wide with much lower rates of HIV testing among men compared to women. Here, we design a study to investigate the effect on uptake of HIV testing and linkage into care or prevention of partner-delivered HIV self-testing alone or with an additional intervention among male partners of pregnant women.

METHODS

A phase II, adaptive, multi-arm, multi-stage cluster randomised trial, randomising antenatal clinic (ANC) days to six different trial arms. Pregnant women accessing ANC in urban Malawi for the first time will be recruited into either the standard of care (SOC) arm (invitation letter to the male partner offering HIV testing) or one of five intervention arms offering oral HIV self-test kits. Three of the five intervention arms will additionally offer the male partner a financial incentive (fixed or lottery amount) conditional on linkage after self-testing with one arm testing phone call reminders. Assuming that 25% of male partners link to care or prevention in the SOC arm, six clinic days, with a harmonic mean of 21 eligible participants, per arm will provide 80% power to detect a 0.15 absolute difference in the primary outcome. Cluster proportions will be analysed by a cluster summaries approach with adjustment for clustering and multiplicity.

DISCUSSION

This trial applies adaptive methods which are novel and efficient designs. The methodology and lessons learned here will be important as proof of concept of how to design and conduct similar studies in the future. Although small, this trial will potentially present good evidence on the type of effective interventions for improving linkage into ART or prevention. The trial results will also have important policy implications on how to implement HIVST targeting male partners of pregnant women who are accessing ANC for the first time while paying particular attention to safety concerns. Contamination may occur if women in the intervention arms share their self-test kits with women in the SOC arm.

TRIAL REGISTRATION

ISRCTN, ID: 18421340 . Registered on 31 March 2016.

Time to selected quit date and subsequent rates of sustained smoking abstinence

In efforts to combat tobacco dependence, most smoking cessation programs offer individuals who smoke the choice of a target quit date. However, it is uncertain whether the time to the selected quit date is associated with participants' chances of achieving sustained abstinence. In a pre-specified secondary analysis of a randomized clinical trial of four financial-incentive programs or usual care to encourage smoking cessation (Halpern et al. in N Engl J Med 372(22):2108-2117, doi: 10.1056/NEJMoa1414293 , 2015), study participants were instructed to select a quit date between 0 and 90 days from enrollment. Among those who selected a quit date and provided complete baseline data (n = 1848), we used multivariable logistic regression to evaluate the association of the time to the selected quit date with 6- and 12-month biochemically-confirmed abstinence rates. In the fully adjusted model, the probability of being abstinent at 6 months if the participant selected a quit date in weeks 1, 5, 10, and 13 were 39.6, 22.6, 10.9, and 4.3%, respectively.

Community-led trials: Intervention co-design in a cluster randomised controlled trial

In conventional randomised controlled trials (RCTs), researchers design the interventions. In the Camino Verde trial, each intervention community designed its own programmes to prevent dengue. Instead of fixed actions or menus of activities to choose from, the trial randomised clusters to a participatory research protocol that began with sharing and discussing evidence from a local survey, going on to local authorship of the action plan for vector control.

Adding equitable stakeholder engagement to RCT infrastructure anchors the research culturally, making it more meaningful to stakeholders. Replicability in other conditions is straightforward, since all intervention clusters used the same engagement protocol to discuss and to mobilize for dengue prevention. The ethical codes associated with RCTs play out differently in community-led pragmatic trials, where communities essentially choose what they want to do. Several discussion groups in each intervention community produced multiple plans for prevention, recognising different time lines. Some chose fast turnarounds, like elimination of breeding sites, and some chose longer term actions like garbage disposal and improving water supplies.

A big part of the skill set for community-led trials is being able to stand back and simply support communities in what they want to do and how they want to do it, something that does not come naturally to many vector control programs or to RCT researchers. Unexpected negative outcomes can come from the turbulence implicit in participatory research. One example was the gender dynamic in the Mexican arm of the Camino Verde trial. Strong involvement of women in dengue control activities seems to have discouraged men in settings where activity in public spaces or outside of the home would ordinarily be considered a “male competence”.

Community-led trials address the tension between one-size-fits-all programme interventions and local needs. Whatever the conventional wisdom about how prevention works at a system level, programmes have to be perceived as locally relevant and they must engage stakeholders who make them work. Locally, each participating community has to know the intervention is relevant to them; they have to want to do it. That happens much more easily if they design the programme themselves.

Predictors of Consent in a Randomized Field Study in Child Welfare

PURPOSE

Randomized controlled trials (RCTs) are often viewed as the "gold standard" for proving the efficacy and effectiveness of new interventions. However, some are skeptical of the generalizability of the findings that RCTs produce. The characteristics of those willing to participate in research studies have the potential to affect the generalizability of its findings. This study examined factors that could influence consent among families recruited to participate in a randomized field trial in a real-world child welfare setting.

METHODS

This study tested the Parent Management Training Oregon Model for children in foster care with serious emotional disturbance. It employed a post-randomization consent design, whereby the entire sample of eligible participants, not just those who are willing to consent to randomization, are included in the sample. Initial eligibility assessment data and data from the federally mandated reporting system for public child welfare agencies provided the pool of potential predictors of consent. Bivariate and multivariate analyses were conducted to identify statistically significant predictors of consent.

RESULTS

Being a dual reunification family was the most significant factor in predicting consent. Unmarried individuals, younger, female parents, cases where parental incarceration was the reason for removal and cases where the removal reason was not due to their children's behavioral problem(s) were also more likely to participate.

DISCUSSION

As one of the first research studies to examine predictors of consent to a randomized field study in child welfare settings, results presented here can act as a preliminary guide for conducting RCTs in child welfare settings.