1
|
Krisam J, Ryeznik Y, Carter K, Kuznetsova O, Sverdlov O. Understanding an impact of patient enrollment pattern on predictability of central (unstratified) randomization in a multi-center clinical trial. Stat Med 2024. [PMID: 38831520 DOI: 10.1002/sim.10117] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/09/2024] [Revised: 04/01/2024] [Accepted: 05/07/2024] [Indexed: 06/05/2024]
Abstract
In a multi-center randomized controlled trial (RCT) with competitive recruitment, eligible patients are enrolled sequentially by different study centers and are randomized to treatment groups using the chosen randomization method. Given the stochastic nature of the recruitment process, some centers may enroll more patients than others, and in some instances, a center may enroll multiple patients in a row, for example, on a given day. If the study is open-label, the investigators might be able to make intelligent guesses on upcoming treatment assignments in the randomization sequence, even if the trial is centrally randomized and not stratified by center. In this paper, we use enrollment data inspired by a real multi-center RCT to quantify the susceptibility of two restricted randomization procedures, the permuted block design and the big stick design, to selection bias under the convergence strategy of Blackwell and Hodges (1957) applied at the center level. We provide simulation evidence that the expected proportion of correct guesses may be greater than 50% (i.e., an increased risk of selection bias) and depends on the chosen randomization method and the number of study patients recruited by a given center that takes consecutive positions on the central allocation schedule. We propose some strategies for ensuring stronger encryption of the randomization sequence to mitigate the risk of selection bias.
Collapse
Affiliation(s)
- Johannes Krisam
- Global Biostatistics and Data Sciences, Boehringer Ingelheim Pharma GmbH & Co. KG, Ingelheim, Germany
| | - Yevgen Ryeznik
- Department of Pharmacy, Uppsala University, Uppsala, Sweden
| | - Kerstine Carter
- Global Biostatistics and Data Sciences, Boehringer Ingelheim Pharmaceuticals Inc., Ridgefield, Connecticut, USA
| | | | | |
Collapse
|
2
|
Zhao W, Carter K, Sverdlov O, Scheffold A, Ryeznik Y, Cassarly C, Berger VW. Steady-state statistical properties and implementation of randomization designs with maximum tolerated imbalance restriction for two-arm equal allocation clinical trials. Stat Med 2024; 43:1194-1212. [PMID: 38243729 PMCID: PMC10925840 DOI: 10.1002/sim.10013] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/26/2023] [Revised: 11/01/2023] [Accepted: 01/04/2024] [Indexed: 01/21/2024]
Abstract
In recent decades, several randomization designs have been proposed in the literature as better alternatives to the traditional permuted block design (PBD), providing higher allocation randomness under the same restriction of the maximum tolerated imbalance (MTI). However, PBD remains the most frequently used method for randomizing subjects in clinical trials. This status quo may reflect an inadequate awareness and appreciation of the statistical properties of these randomization designs, and a lack of simple methods for their implementation. This manuscript presents the analytic results of statistical properties for five randomization designs with MTI restriction based on their steady-state probabilities of the treatment imbalance Markov chain and compares them to those of the PBD. A unified framework for randomization sequence generation and real-time on-demand treatment assignment is proposed for the straightforward implementation of randomization algorithms with explicit formulas of conditional allocation probabilities. Topics associated with the evaluation, selection, and implementation of randomization designs are discussed. It is concluded that for two-arm equal allocation trials, several randomization designs offer stronger protection against selection bias than the PBD does, and their implementation is not necessarily more difficult than the implementation of the PBD.
Collapse
Affiliation(s)
- Wenle Zhao
- Medical University of South Carolina, Charleston, SC, USA
| | - Kerstine Carter
- Boehringer-Ingelheim Pharmaceuticals Inc, Ridgefield, CT, USA
| | | | - Annika Scheffold
- Boehringer-Ingelheim Pharmaceuticals Inc, Ridgefield, CT, USA
- Boehringer Ingelheim Pharma GmbH & Co. KG, Biberach, Germany
| | - Yevgen Ryeznik
- Data Science & AI, R&D BioPharmaceuticals, AstraZeneca, Gothenburg, Sweden
| | | | | |
Collapse
|
3
|
Sverdlov O, Ryeznik Y, Anisimov V, Kuznetsova OM, Knight R, Carter K, Drescher S, Zhao W. Selecting a randomization method for a multi-center clinical trial with stochastic recruitment considerations. BMC Med Res Methodol 2024; 24:52. [PMID: 38418968 PMCID: PMC10900599 DOI: 10.1186/s12874-023-02131-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/16/2023] [Accepted: 12/19/2023] [Indexed: 03/02/2024] Open
Abstract
BACKGROUND The design of a multi-center randomized controlled trial (RCT) involves multiple considerations, such as the choice of the sample size, the number of centers and their geographic location, the strategy for recruitment of study participants, amongst others. There are plenty of methods to sequentially randomize patients in a multi-center RCT, with or without considering stratification factors. The goal of this paper is to perform a systematic assessment of such randomization methods for a multi-center 1:1 RCT assuming a competitive policy for the patient recruitment process. METHODS We considered a Poisson-gamma model for the patient recruitment process with a uniform distribution of center activation times. We investigated 16 randomization methods (4 unstratified, 4 region-stratified, 4 center-stratified, 3 dynamic balancing randomization (DBR), and a complete randomization design) to sequentially randomize n = 500 patients. Statistical properties of the recruitment process and the randomization procedures were assessed using Monte Carlo simulations. The operating characteristics included time to complete recruitment, number of centers that recruited a given number of patients, several measures of treatment imbalance and estimation efficiency under a linear model for the response, the expected proportions of correct guesses under two different guessing strategies, and the expected proportion of deterministic assignments in the allocation sequence. RESULTS Maximum tolerated imbalance (MTI) randomization methods such as big stick design, Ehrenfest urn design, and block urn design result in a better balance-randomness tradeoff than the conventional permuted block design (PBD) with or without stratification. Unstratified randomization, region-stratified randomization, and center-stratified randomization provide control of imbalance at a chosen level (trial, region, or center) but may fail to achieve balance at the other two levels. By contrast, DBR does a very good job controlling imbalance at all 3 levels while maintaining the randomized nature of treatment allocation. Adding more centers into the study helps accelerate the recruitment process but at the expense of increasing the number of centers that recruit very few (or no) patients-which may increase center-level imbalances for center-stratified and DBR procedures. Increasing the block size or the MTI threshold(s) may help obtain designs with improved randomness-balance tradeoff. CONCLUSIONS The choice of a randomization method is an important component of planning a multi-center RCT. Dynamic balancing randomization with carefully chosen MTI thresholds could be a very good strategy for trials with the competitive policy for patient recruitment.
Collapse
Affiliation(s)
| | - Yevgen Ryeznik
- Department of Pharmacy, Uppsala University, Uppsala, Sweden
| | | | | | - Ruth Knight
- Liverpool Clinical Trials Centre, University of Liverpool, Merseyside, Liverpool, UK
| | - Kerstine Carter
- Boehringer-Ingelheim Pharmaceuticals Inc, Ridgefield, CT, USA
| | - Sonja Drescher
- Boehringer-Ingelheim Pharma GmbH & Co. KG, Biberach, Germany
| | - Wenle Zhao
- Medical University of South Carolina, Charleston, SC, USA
| |
Collapse
|
4
|
Shan G, Li Y, Lu X, Zhang Y, Wu SS. Comparison of Pocock and Simon's covariate-adaptive randomization procedures in clinical trials. BMC Med Res Methodol 2024; 24:22. [PMID: 38273261 PMCID: PMC10809571 DOI: 10.1186/s12874-024-02151-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/12/2023] [Accepted: 01/16/2024] [Indexed: 01/27/2024] Open
Abstract
When multiple influential covariates need to be balanced during a clinical trial, stratified blocked randomization and covariate-adaptive randomization procedures are frequently used in trials to prevent bias and enhance the validity of data analysis results. The latter approach is increasingly used in practice for a study with multiple covariates and limited sample sizes. Among a group of these approaches, the covariate-adaptive procedures proposed by Pocock and Simon are straightforward to be utilized in practice. We aim to investigate the optimal design parameters for the patient treatment assignment probability of their developed three methods. In addition, we seek to answer the question related to the randomization performance when additional covariates are added to the existing randomization procedure. We conducted extensive simulation studies to address these practically important questions.
Collapse
Affiliation(s)
- Guogen Shan
- Department of Biostatistics, University of Florida, Gainesville, 32610, FL, USA.
| | - Yulin Li
- Department of Biostatistics, University of Florida, Gainesville, 32610, FL, USA
| | - Xinlin Lu
- Department of Biostatistics, University of Florida, Gainesville, 32610, FL, USA
| | - Yahui Zhang
- Department of Biostatistics, University of Florida, Gainesville, 32610, FL, USA
| | - Samuel S Wu
- Department of Biostatistics, University of Florida, Gainesville, 32610, FL, USA
| |
Collapse
|
5
|
Atkinson AC, Duarte BP, Pedrosa DJ, van Munster M. Randomizing a clinical trial in neuro-degenerative disease. Contemp Clin Trials Commun 2023; 33:101140. [PMID: 37180844 PMCID: PMC10172741 DOI: 10.1016/j.conctc.2023.101140] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/20/2022] [Revised: 03/26/2023] [Accepted: 04/12/2023] [Indexed: 05/16/2023] Open
Abstract
The paper studies randomization rules for a sequential two-treatment, two-site clinical trial in Parkinson's disease. An important feature is that we have values of responses and five potential prognostic factors from a sample of 144 patients similar to those to be enrolled in the trial. Analysis of this sample provides a model for trial analysis. The comparison of allocation rules is made by simulation yielding measures of loss due to imbalance and of potential bias. A major novelty of the paper is the use of this sample, via a two-stage algorithm, to provide an empirical distribution of covariates for the simulation; sampling of a correlated multivariate normal distribution is followed by transformation to variables following the empirical marginal distributions. Six allocation rules are evaluated. The paper concludes with some comments on general aspects of the evaluation of such rules and provides a recommendation for two allocation rules, one for each site, depending on the target number of patients to be enrolled.
Collapse
Affiliation(s)
- Anthony C. Atkinson
- Department of Statistics, London School of Economics, London WC2A 2AE, United Kingdom
- Corresponding author.
| | - Belmiro P.M. Duarte
- Polytechnic Institute of Coimbra, ISEC, Department of Chemical & Biological Engineering, Rua Pedro Nunes, 3030–199 Coimbra, Portugal
- Univ Coimbra, CIEPQPF, Department of Chemical Engineering, Rua Sílvio Lima — Pólo II, 3030–790 Coimbra, Portugal
| | - David J. Pedrosa
- Department of Neurology, University Hospital Marburg, 35043 Marburg, Germany
- Center of Brain, Mind and Behaviour, Philipps-University Marburg, 35043 Marburg, Germany
| | - Marlena van Munster
- Department of Neurology, University Hospital Marburg, 35043 Marburg, Germany
| |
Collapse
|
6
|
Brookman-Frazee L, Chlebowski C, Villodas M, Garland A, McPherson J, Koenig Y, Roesch S. The effectiveness of training community mental health therapists in an evidence-based intervention for ASD: Findings from a hybrid effectiveness-implementation trial in outpatient and school-based mental health services. AUTISM : THE INTERNATIONAL JOURNAL OF RESEARCH AND PRACTICE 2022; 26:678-689. [PMID: 34983251 PMCID: PMC10987077 DOI: 10.1177/13623613211067844] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
LAY ABSTRACT Publicly funded mental health services play an important role in caring for school-age children with autism spectrum disorder (ASD); however, therapists report a lack of specialized ASD training, which families identity as a barrier in obtaining mental health services for their children. An Individualized Mental Health Intervention for ASD (AIM HI) was developed in collaboration with community stakeholders to respond to identified needs of children and community therapists. The current study examined the effects of therapist training in AIM HI on the changes in therapist practice, including therapists' use of evidence-based intervention strategies in session. Data were collected from a study conducted in community outpatient and school based mental health programs randomly assigned to receive AIM HI therapist training or observation of routine care. Therapist and child clients were enrolled from participating programs. Therapists in AIM HI training received training and consultation for 6 months while delivering the AIM HI intervention to a participating client; therapists in usual care delivered routine care. Both groups of therapists video recorded psychotherapy sessions which were scored by trained raters. Differences between training groups were examined using multilevel modeling. Therapists trained in AIM HI were observed to use more extensive active teaching strategies with caregivers, engagement strategies with children, strategies promoting continuity of care, and had more structured sessions with more effective pursuit of caregiver and children skill teaching. Therapist licensure moderated some training outcomes.
Collapse
Affiliation(s)
| | | | | | | | | | - Yael Koenig
- San Diego County Behavioral Health Services, USA
| | | |
Collapse
|
7
|
Proper J, Connett J, Murray T. Alternative models and randomization techniques for Bayesian response-adaptive randomization with binary outcomes. Clin Trials 2021; 18:417-426. [PMID: 33926267 DOI: 10.1177/17407745211010139] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/21/2022]
Abstract
BACKGROUND Bayesian response-adaptive designs, which data adaptively alter the allocation ratio in favor of the better performing treatment, are often criticized for engendering a non-trivial probability of a subject imbalance in favor of the inferior treatment, inflating type I error rate, and increasing sample size requirements. The implementation of these designs using the Thompson sampling methods has generally assumed a simple beta-binomial probability model in the literature; however, the effect of these choices on the resulting design operating characteristics relative to other reasonable alternatives has not been fully examined. Motivated by the Advanced R2 Eperfusion STrategies for Refractory Cardiac Arrest trial, we posit that a logistic probability model coupled with an urn or permuted block randomization method will alleviate some of the practical limitations engendered by the conventional implementation of a two-arm Bayesian response-adaptive design with binary outcomes. In this article, we discuss up to what extent this solution works and when it does not. METHODS A computer simulation study was performed to evaluate the relative merits of a Bayesian response-adaptive design for the Advanced R2 Eperfusion STrategies for Refractory Cardiac Arrest trial using the Thompson sampling methods based on a logistic regression probability model coupled with either an urn or permuted block randomization method that limits deviations from the evolving target allocation ratio. The different implementations of the response-adaptive design were evaluated for type I error rate control across various null response rates and power, among other performance metrics. RESULTS The logistic regression probability model engenders smaller average sample sizes with similar power, better control over type I error rate, and more favorable treatment arm sample size distributions than the conventional beta-binomial probability model, and designs using the alternative randomization methods have a negligible chance of a sample size imbalance in the wrong direction. CONCLUSION Pairing the logistic regression probability model with either of the alternative randomization methods results in a much improved response-adaptive design in regard to important operating characteristics, including type I error rate control and the risk of a sample size imbalance in favor of the inferior treatment.
Collapse
Affiliation(s)
- Jennifer Proper
- Division of Biostatistics, University of Minnesota Twin Cities, Minneapolis, MN, USA
| | - John Connett
- Division of Biostatistics, University of Minnesota Twin Cities, Minneapolis, MN, USA
| | - Thomas Murray
- Division of Biostatistics, University of Minnesota Twin Cities, Minneapolis, MN, USA
| |
Collapse
|
8
|
Lee KM, Brown LC, Jaki T, Stallard N, Wason J. Statistical consideration when adding new arms to ongoing clinical trials: the potentials and the caveats. Trials 2021; 22:203. [PMID: 33691748 PMCID: PMC7944243 DOI: 10.1186/s13063-021-05150-7] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/31/2020] [Accepted: 02/24/2021] [Indexed: 02/08/2023] Open
Abstract
BACKGROUND Platform trials improve the efficiency of the drug development process through flexible features such as adding and dropping arms as evidence emerges. The benefits and practical challenges of implementing novel trial designs have been discussed widely in the literature, yet less consideration has been given to the statistical implications of adding arms. MAIN: We explain different statistical considerations that arise from allowing new research interventions to be added in for ongoing studies. We present recent methodology development on addressing these issues and illustrate design and analysis approaches that might be enhanced to provide robust inference from platform trials. We also discuss the implication of changing the control arm, how patient eligibility for different arms may complicate the trial design and analysis, and how operational bias may arise when revealing some results of the trials. Lastly, we comment on the appropriateness and the application of platform trials in phase II and phase III settings, as well as publicly versus industry-funded trials. CONCLUSION Platform trials provide great opportunities for improving the efficiency of evaluating interventions. Although several statistical issues are present, there are a range of methods available that allow robust and efficient design and analysis of these trials.
Collapse
Affiliation(s)
- Kim May Lee
- MRC Biostatistics Unit, School of Clinical Medicine, University of Cambridge, Cambridge, CB2 0SR, UK.
- Pragmatic Clinical Trials Unit, Queen Mary University of London, Yvonne Carter Building, 58 Turner Street, London, E1 2AB, UK.
| | - Louise C Brown
- MRC Clinical Trials Unit, University College London, 90 High Holborn 2nd Floor, London, WC1V 6LJ, UK
| | - Thomas Jaki
- MRC Biostatistics Unit, School of Clinical Medicine, University of Cambridge, Cambridge, CB2 0SR, UK
- Medical and Pharmaceutical Statistics Research Unit, Department of Mathematics and Statistics, Lancaster University, Lancaster, UK
| | - Nigel Stallard
- Statistics and Epidemiology, Division of Health Sciences, Warwick Medical School, University of Warwick, Coventry, CV4 7AL, UK
| | - James Wason
- MRC Biostatistics Unit, School of Clinical Medicine, University of Cambridge, Cambridge, CB2 0SR, UK
- Population Health Sciences Institute, Baddiley-Clark Building, Newcastle University, Richardson Road, Newcastle upon Tyne, UK
| |
Collapse
|
9
|
Brookman-Frazee L, Chlebowski C, Villodas M, Roesch S, Martinez K. Training Community Therapists to Deliver an Individualized Mental Health Intervention for Autism Spectrum Disorder: Changes in Caregiver Outcomes and Mediating Role on Child Outcomes. J Am Acad Child Adolesc Psychiatry 2021; 60:355-366. [PMID: 32755632 DOI: 10.1016/j.jaac.2020.07.896] [Citation(s) in RCA: 13] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/22/2019] [Revised: 06/26/2020] [Accepted: 07/27/2020] [Indexed: 10/23/2022]
Abstract
OBJECTIVE This study examines the impact of training therapists to deliver "An Individualized Mental Health Intervention for Autism Spectrum Disorder (ASD)" (AIM HI) for children with autism spectrum disorder on caregiver outcomes and the mediating role of changes in caregiver outcomes on child outcomes. METHOD Data were drawn from a cluster randomized trial conducted in 29 publicly funded mental health programs randomized to receive AIM HI training or usual care. Therapists were recruited from enrolled programs and child/caregiver participants enrolled from therapists' caseloads. Participants included 202 caregivers of children 5 to 13 years of age with autism spectrum disorder. Caregiver strain and sense of competence were assessed at baseline and 6 month postbaseline. Child behaviors were assessed at baseline and 6, 12, and 18 months postbaseline. Therapist delivery of evidence-based intervention strategies were assessed between baseline and 6 months. RESULTS A significant training effect was observed for caregiver sense of competence, with AIM HI caregivers reporting significantly greater improvement relative to usual care. There was no significant training effect for caregiver strain. Observer-rated therapist delivery of evidence-based interventions strategies over 6 months mediated training effects for sense of competence at 6 months. Changes in sense of competence from baseline to 6 months was associated with reduced child challenging behaviors at 6 months and mediated child outcomes at 12 and 18 months. CONCLUSION Combined with research demonstrating effectiveness of therapist AIM HI training on child outcomes, this study provides further evidence of the positive impact of training community therapists in the AIM HI intervention. CLINICAL TRIAL REGISTRATION INFORMATION Effectiveness and Implementation of a Mental Health Intervention for ASD (AIM HI); https://clinicaltrials.gov/; NCT02416323.
Collapse
Affiliation(s)
- Lauren Brookman-Frazee
- Child and Adolescent Services Research Center, San Diego, California; University of California, San Diego; Rady Children's Hospital, San Diego, California
| | - Colby Chlebowski
- Child and Adolescent Services Research Center, San Diego, California; University of California, San Diego.
| | - Miguel Villodas
- Child and Adolescent Services Research Center, San Diego, California; San Diego State University, California
| | | | - Kassandra Martinez
- Child and Adolescent Services Research Center, San Diego, California; University of California, San Diego; San Diego State University, California
| |
Collapse
|
10
|
Callegaro A, Harsha Shree BS, Karkada N. Inference under covariate-adaptive randomization: A simulation study. Stat Methods Med Res 2021; 30:1072-1080. [PMID: 33504277 DOI: 10.1177/0962280220985564] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
In clinical trials, several covariate-adaptive designs have been proposed to balance treatment arms with respect to key covariates. Although some argue that conventional asymptotic tests are still appropriate when covariate-adaptive randomization is used, others think that re-randomization tests should be used. In this manuscript, we compare by simulation the performance of asymptotic and re-randomization tests under covariate-adaptive randomization. Our simulation study confirms results expected by the existing theory (e.g. asymptotic tests do not control type I error when the model is miss-specified). Furthermore, it shows that (i) re-randomization tests are as powerful as the asymptotic tests if the model is correct; (ii) re-randomization tests are more powerful when adjusting for covariates; (iii) minimization and permuted blocks provide similar results.
Collapse
Affiliation(s)
| | - B S Harsha Shree
- Randstad India Pvt Ltd (Employee Contracted for GSK Asia Pvt Ltd), Bangalore, India
| | | |
Collapse
|
11
|
Lee KM, Wason J. Including non-concurrent control patients in the analysis of platform trials: is it worth it? BMC Med Res Methodol 2020; 20:165. [PMID: 32580702 PMCID: PMC7315495 DOI: 10.1186/s12874-020-01043-6] [Citation(s) in RCA: 21] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/11/2019] [Accepted: 06/04/2020] [Indexed: 01/10/2023] Open
Abstract
Background Platform trials allow adding new experimental treatments to an on-going trial. This feature is attractive to practitioners due to improved efficiency. Nevertheless, the operating characteristics of a trial that adds arms have not been well-studied. One controversy is whether just the concurrent control data (i.e. of patients who are recruited after a new arm is added) should be used in the analysis of the newly added treatment(s), or all control data (i.e. non-concurrent and concurrent). Methods We investigate the benefits and drawbacks of using non-concurrent control data within a two-stage setting. We perform simulation studies to explore the impact of a linear and a step trend on the inference of the trial. We compare several analysis approaches when one includes all the control data or only concurrent control data in the analysis of the newly added treatment. Results When there is a positive trend and all the control data are used, the marginal power of rejecting the corresponding hypothesis and the type one error rate can be higher than the nominal value. A model-based approach adjusting for a stage effect is equivalent to using concurrent control data; an adjustment with a linear term may not guarantee valid inference when there is a non-linear trend. Conclusions If strict error rate control is required then non-concurrent control data should not be used; otherwise it may be beneficial if the trend is sufficiently small. On the other hand, the root mean squared error of the estimated treatment effect can be improved through using non-concurrent control data.
Collapse
Affiliation(s)
- Kim May Lee
- MRC Biostatistics Unit, School of Clinical Medicine, University of Cambridge, Cambridge Institute of Public Health, Forvie Site, Robinson Way, Cambridge Biomedical Campus, Cambridge, CB2 0SR, UK.
| | - James Wason
- MRC Biostatistics Unit, School of Clinical Medicine, University of Cambridge, Cambridge Institute of Public Health, Forvie Site, Robinson Way, Cambridge Biomedical Campus, Cambridge, CB2 0SR, UK.,Population Health Sciences Institute, Newcastle University, Baddiley-Clark Building, Newcastle University Richardson Road, Newcastle upon Tyne, Newcastle upon Tyne, UK
| |
Collapse
|
12
|
Brookman-Frazee L, Roesch S, Chlebowski C, Baker-Ericzen M, Ganger W. Effectiveness of Training Therapists to Deliver An Individualized Mental Health Intervention for Children With ASD in Publicly Funded Mental Health Services: A Cluster Randomized Clinical Trial. JAMA Psychiatry 2019; 76:574-583. [PMID: 30840040 PMCID: PMC6551846 DOI: 10.1001/jamapsychiatry.2019.0011] [Citation(s) in RCA: 37] [Impact Index Per Article: 7.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/14/2022]
Abstract
IMPORTANCE Publicly funded mental health services play an important role in addressing co-occurring mental health problems in children with autism spectrum disorder (ASD); however, therapists report lacking training to effectively serve this complex population. OBJECTIVE To test the effectiveness of training community therapists in An Individualized Mental Health Intervention for ASD (AIM HI) on challenging behaviors across 18 months among children with ASD and identify moderators and mediators of any intervention effects. DESIGN, SETTING, AND PARTICIPANTS Cluster randomized trial conducted in 29 publicly funded outpatient and school-based mental health programs in southern California from 2012 to 2017. Programs were randomized to receive immediate AIM HI training or provide usual care followed by receipt of AIM HI training. Therapist participants were recruited from enrolled programs, and child participants were recruited from participant therapists' caseloads. Data were analyzed from 202 children with ASD who were aged 5 to 13 years. INTERVENTIONS The AIM HI protocol is a package of parent-mediated and child-focused strategies aimed to reduce challenging behaviors in children with ASD who are 5 to 13 years old. It was designed for delivery in publicly funded mental health services based on a systematic assessment of therapist training needs and child clinical needs. The therapist training and consultation process takes approximately 6 months and includes an introductory workshop, 11 structured consultation meetings as the therapist delivers AIM HI with a current client, and case-specific performance feedback from trainers. MAIN OUTCOMES AND MEASURES Child participants were assessed for challenging behaviors using the Eyberg Child Behavior Inventory (ECBI) and Social Skills Improvement System (SSIS) Competing Problem Behaviors scales based on parent report at baseline and at 6-month intervals for 18 months. Outcomes were analyzed using intent-to-treat models. RESULTS In total, 202 children with ASD (mean [SD] age, 9.1 [2.4] years; 170 [84.2%] male; 121 [59.9%] Latinx) were eligible, enrolled, and included in the analyses. Statistically significant group by time interactions for the ECBI Intensity (B = -0.38; P = .02) and ECBI Problem (B = -1.00; P = .005) scales were observed, with significantly larger decreases in ECBI Intensity scores in the AIM HI group (B = -1.36; P < .001) relative to the usual care group (B = -0.98; P < .001) and a significantly larger decrease in ECBI Problem scores in the AIM HI group (B = -1.22; P < .001) relative to the usual care group (B = -0.20; P = .29). Therapist fidelity moderated these intervention effects. CONCLUSIONS AND RELEVANCE The present findings support the effectiveness of training therapists to deliver the AIM HI model to children with ASD receiving publicly funded mental health services. TRIAL REGISTRATION ClinicalTrials.gov identifier: NCT02416323.
Collapse
Affiliation(s)
- Lauren Brookman-Frazee
- Department of Psychiatry, University of California, San Diego, La Jolla,Child and Adolescent Services Research Center, San Diego, California,Rady Children’s Hospital–San Diego, University of California San Diego School of Medicine, La Jolla
| | - Scott Roesch
- Department of Psychology, San Diego State University, San Diego, California
| | - Colby Chlebowski
- Department of Psychiatry, University of California, San Diego, La Jolla,Child and Adolescent Services Research Center, San Diego, California
| | - Mary Baker-Ericzen
- Child and Adolescent Services Research Center, San Diego, California,Rady Children’s Hospital–San Diego, University of California San Diego School of Medicine, La Jolla
| | - William Ganger
- Child and Adolescent Services Research Center, San Diego, California,San Diego State University Research Foundation, San Diego, California
| |
Collapse
|
13
|
Sverdlov O, Ryeznik Y. Implementing unequal randomization in clinical trials with heterogeneous treatment costs. Stat Med 2019; 38:2905-2927. [DOI: 10.1002/sim.8160] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/30/2018] [Revised: 12/28/2018] [Accepted: 03/15/2019] [Indexed: 11/11/2022]
Affiliation(s)
- Oleksandr Sverdlov
- Early Development BiostatisticsNovartis Pharmaceuticals East Hanover New Jersey
| | - Yevgen Ryeznik
- Department of MathematicsUppsala University Uppsala Sweden
- Department of Pharmaceutical BiosciencesUppsala University Uppsala Sweden
| |
Collapse
|
14
|
Ryeznik Y, Sverdlov O, Hooker AC. Implementing Optimal Designs for Dose-Response Studies Through Adaptive Randomization for a Small Population Group. AAPS JOURNAL 2018; 20:85. [PMID: 30027336 DOI: 10.1208/s12248-018-0242-5] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/24/2018] [Accepted: 06/18/2018] [Indexed: 11/30/2022]
Abstract
In dose-response studies with censored time-to-event outcomes, D-optimal designs depend on the true model and the amount of censored data. In practice, such designs can be implemented adaptively, by performing dose assignments according to updated knowledge of the dose-response curve at interim analysis. It is also essential that treatment allocation involves randomization-to mitigate various experimental biases and enable valid statistical inference at the end of the trial. In this work, we perform a comparison of several adaptive randomization procedures that can be used for implementing D-optimal designs for dose-response studies with time-to-event outcomes with small to moderate sample sizes. We consider single-stage, two-stage, and multi-stage adaptive designs. We also explore robustness of the designs to experimental (chronological and selection) biases. Simulation studies provide evidence that both the choice of an allocation design and a randomization procedure to implement the target allocation impact the quality of dose-response estimation, especially for small samples. For best performance, a multi-stage adaptive design with small cohort sizes should be implemented using a randomization procedure that closely attains the targeted D-optimal design at each stage. The results of the current work should help clinical investigators select an appropriate randomization procedure for their dose-response study.
Collapse
Affiliation(s)
- Yevgen Ryeznik
- Department of Mathematics, Uppsala University, Room Å14133 Lägerhyddsvägen 1, Hus 1, 6 och 7, 751 06, Uppsala, Sweden. .,Department of Pharmaceutical Biosciences, Uppsala University, Uppsala, Sweden.
| | - Oleksandr Sverdlov
- Early Development Biostatistics, Novartis Institutes for Biomedical Research, East Hannover, New Jersey, USA
| | - Andrew C Hooker
- Department of Pharmaceutical Biosciences, Uppsala University, Uppsala, Sweden
| |
Collapse
|