1
|
Dong Y, Paux G, Broglio K, Cooner F, Gao G, He W, Gao L, Xue X, He P. Use of Seamless Study Designs in Oncology Clinical Development- A Survey Conducted by IDSWG Oncology Sub-team. Ther Innov Regul Sci 2024:10.1007/s43441-024-00676-9. [PMID: 38909174 DOI: 10.1007/s43441-024-00676-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/27/2023] [Accepted: 06/07/2024] [Indexed: 06/24/2024]
Abstract
Seamless study designs have the potential to accelerate clinical development. The use of innovative seamless designs has been increasing in the oncology area; however, while the concept of seamless designs becomes more popular and accepted, many challenges remain in both the design and conduct of these trials. This may be especially true when seamless designs are used in late phase development supporting regulatory decision-making. The Innovative Design Scientific Working Group (IDSWG) Oncology team conducted a survey to understand the current use of seamless study designs for registration purposes in oncology clinical development. The survey was designed to provide insights into the benefits and to identify the roadblocks. A total of 16 questions were included in the survey that was distributed using the ASA Biopharmaceutical Section and IDSWG email listings from August to September 2022. A total of 51 responses were received, with 39 (76%) respondents indicating that their organizations had seamless oncology studies in planning or implementation for registration purposes. Detailed survey results are presented in the manuscript. Overall, while seamless designs offer advantages in terms of timeline reduction and cost saving, they also present challenges related to additional complexity and the need for efficient surrogate clinical endpoints in oncology drug development.
Collapse
Affiliation(s)
| | | | | | | | | | - Wei He
- AstraZeneca, Cambridge, MA, USA
| | - Lei Gao
- Moderna, Inc, Cambridge, MA, USA
| | | | - Philip He
- Daiichi Sankyo, Basking Ridge, NJ, USA
| |
Collapse
|
2
|
Baldi Antognini A, Frieri R, Zagoraiou M. New insights into adaptive enrichment designs. Stat Pap (Berl) 2023. [DOI: 10.1007/s00362-023-01433-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 04/03/2023]
Abstract
AbstractThe transition towards personalized medicine is happening and the new experimental framework is raising several challenges, from a clinical, ethical, logistical, regulatory, and statistical perspective. To face these challenges, innovative study designs with increasing complexity have been proposed. In particular, adaptive enrichment designs are becoming more attractive for their flexibility. However, these procedures rely on an increasing number of parameters that are unknown at the planning stage of the clinical trial, so the study design requires particular care. This review is dedicated to adaptive enrichment studies with a focus on design aspects. While many papers deal with methods for the analysis, the sample size determination and the optimal allocation problem have been overlooked. We discuss the multiple aspects involved in adaptive enrichment designs that contribute to their advantages and disadvantages. The decision-making process of whether or not it is worth enriching should be driven by clinical and ethical considerations as well as scientific and statistical concerns.
Collapse
|
3
|
Placzek M, Friede T. Blinded sample size recalculation in adaptive enrichment designs. Biom J 2023; 65:e2000345. [PMID: 35983952 DOI: 10.1002/bimj.202000345] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/30/2020] [Revised: 09/24/2021] [Accepted: 11/07/2021] [Indexed: 12/17/2022]
Abstract
In the precision medicine era, (prespecified) subgroup analyses are an integral part of clinical trials. Incorporating multiple populations and hypotheses in the design and analysis plan, adaptive designs promise flexibility and efficiency in such trials. Adaptations include (unblinded) interim analyses (IAs) or blinded sample size reviews. An IA offers the possibility to select promising subgroups and reallocate sample size in further stages. Trials with these features are known as adaptive enrichment designs. Such complex designs comprise many nuisance parameters, such as prevalences of the subgroups and variances of the outcomes in the subgroups. Additionally, a number of design options including the timepoint of the sample size review and timepoint of the IA have to be selected. Here, for normally distributed endpoints, we propose a strategy combining blinded sample size recalculation and adaptive enrichment at an IA, that is, at an early timepoint nuisance parameters are reestimated and the sample size is adjusted while subgroup selection and enrichment is performed later. We discuss implications of different scenarios concerning the variances as well as the timepoints of blinded review and IA and investigate the design characteristics in simulations. The proposed method maintains the desired power if planning assumptions were inaccurate and reduces the sample size and variability of the final sample size when an enrichment is performed. Having two separate timepoints for blinded sample size review and IA improves the timing of the latter and increases the probability to correctly enrich a subgroup.
Collapse
Affiliation(s)
- Marius Placzek
- Department of Medical Statistics, University Medical Center Göttingen, Göttingen, Germany
| | - Tim Friede
- Department of Medical Statistics, University Medical Center Göttingen, Göttingen, Germany.,DZHK (German Center for Cardiovascular Research), partner site Göttingen, Göttingen, Germany
| |
Collapse
|
4
|
Zhang C, Mayo MS, Wick JA, Gajewski BJ. Designing and analyzing clinical trials for personalized medicine via Bayesian models. Pharm Stat 2021; 20:573-596. [PMID: 33463906 DOI: 10.1002/pst.2095] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/19/2019] [Revised: 09/21/2020] [Accepted: 12/31/2020] [Indexed: 11/11/2022]
Abstract
Patients with different characteristics (e.g., biomarkers, risk factors) may have different responses to the same medicine. Personalized medicine clinical studies that are designed to identify patient subgroup treatment efficacies can benefit patients and save medical resources. However, subgroup treatment effect identification complicates the study design in consideration of desired operating characteristics. We investigate three Bayesian adaptive models for subgroup treatment effect identification: pairwise independent, hierarchical, and cluster hierarchical achieved via Dirichlet Process (DP). The impact of interim analysis and longitudinal data modeling on the personalized medicine study design is also explored. Interim analysis is considered since they can accelerate personalized medicine studies in cases where early stopping rules for success or futility are met. We apply integrated two-component prediction method (ITP) for longitudinal data simulation, and simple linear regression for longitudinal data imputation to optimize the study design. The designs' performance in terms of power for the subgroup treatment effects and overall treatment effect, sample size, and study duration are investigated via simulation. We found the hierarchical model is an optimal approach to identifying subgroup treatment effects, and the cluster hierarchical model is an excellent alternative approach in cases where sufficient information is not available for specifying the priors. The interim analysis introduction to the study design lead to the trade-off between power and expected sample size via the adjustment of the early stopping criteria. The introduction of the longitudinal modeling slightly improves the power. These findings can be applied to future personalized medicine studies with discrete or time-to-event endpoints.
Collapse
Affiliation(s)
- Chuanwu Zhang
- Department of Biostatistics & Data Science, University of Kansas Medical Center, Kansas City, Kansas, USA.,Sanofi, Waltham, Massachusetts, USA
| | - Matthew S Mayo
- Department of Biostatistics & Data Science, University of Kansas Medical Center, Kansas City, Kansas, USA
| | - Jo A Wick
- Department of Biostatistics & Data Science, University of Kansas Medical Center, Kansas City, Kansas, USA
| | - Byron J Gajewski
- Department of Biostatistics & Data Science, University of Kansas Medical Center, Kansas City, Kansas, USA
| |
Collapse
|
5
|
Joshi N, Nguyen C, Ivanova A. Multi-stage adaptive enrichment trial design with subgroup estimation. J Biopharm Stat 2020; 30:1038-1049. [PMID: 33073685 DOI: 10.1080/10543406.2020.1832109] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/02/2023]
Abstract
We consider the problem of estimating the best subgroup and testing for treatment effect in a clinical trial. We define the best subgroup as the subgroup that maximizes a utility function that reflects the trade-off between the subgroup size and the treatment effect. For moderate effect sizes and sample sizes, simpler methods for subgroup estimation worked better than more complex tree-based regression approaches. We propose a three-stage design with a weighted inverse normal combination test to test the hypothesis of no treatment effect across the three stages.
Collapse
Affiliation(s)
- Neha Joshi
- Department of Biostatistics, The University of North Carolina at Chapel Hill, Chapel Hill, North Carolina, USA
| | - Crystal Nguyen
- Department of Biostatistics, The University of North Carolina at Chapel Hill, Chapel Hill, North Carolina, USA
| | - Anastasia Ivanova
- Department of Biostatistics, The University of North Carolina at Chapel Hill, Chapel Hill, North Carolina, USA
| |
Collapse
|
6
|
Nikkho S, Fernandes P, White RJ, Deng C(CQ, Farber HW, Corris PA. Clinical trial design in phase 2 and 3 trials for pulmonary hypertension. Pulm Circ 2020; 10:2045894020941491. [PMID: 33282181 PMCID: PMC7682228 DOI: 10.1177/2045894020941491] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/11/2020] [Accepted: 06/17/2020] [Indexed: 11/15/2022] Open
Abstract
This article on clinical trial design incorporates the broad experience of members of the Pulmonary Vascular Research Institute's (PVRI) Innovative Drug Development Initiative (IDDI) as an open debate platform for academia, the pharmaceutical industry and regulatory experts surrounding the future design of clinical trials in pulmonary hypertension. It is increasingly clear that the design of phase 2 and 3 trials in pulmonary hypertension will have to diversify from the traditional randomised double-blind design, given the anticipated need to trial novel therapeutic approaches in the immediate future. This article reviews a wide range of differing approaches and places these into context within the field of pulmonary hypertension.
Collapse
Affiliation(s)
| | | | - R. James White
- University of Rochester Medical Center, Rochester, NY, USA
| | | | | | - Paul A Corris
- Translational and Clinical Science Institute, Newcastle University, Newcastle upon Tyne, UK
| |
Collapse
|
7
|
Kimani PK, Todd S, Renfro LA, Glimm E, Khan JN, Kairalla JA, Stallard N. Point and interval estimation in two-stage adaptive designs with time to event data and biomarker-driven subpopulation selection. Stat Med 2020; 39:2568-2586. [PMID: 32363603 PMCID: PMC7785132 DOI: 10.1002/sim.8557] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/12/2019] [Revised: 03/31/2020] [Accepted: 04/06/2020] [Indexed: 02/02/2023]
Abstract
In personalized medicine, it is often desired to determine if all patients or only a subset of them benefit from a treatment. We consider estimation in two-stage adaptive designs that in stage 1 recruit patients from the full population. In stage 2, patient recruitment is restricted to the part of the population, which, based on stage 1 data, benefits from the experimental treatment. Existing estimators, which adjust for using stage 1 data for selecting the part of the population from which stage 2 patients are recruited, as well as for the confirmatory analysis after stage 2, do not consider time to event patient outcomes. In this work, for time to event data, we have derived a new asymptotically unbiased estimator for the log hazard ratio and a new interval estimator with good coverage probabilities and probabilities that the upper bounds are below the true values. The estimators are appropriate for several selection rules that are based on a single or multiple biomarkers, which can be categorical or continuous.
Collapse
Affiliation(s)
| | - Susan Todd
- Department of Mathematics and Statistics, University of Reading, Reading, UK
| | - Lindsay A. Renfro
- Division of Biostatistics, University of Southern California, Los Angeles, CA
| | | | | | - John A. Kairalla
- Department of Biostatistics, University of Florida, Gainesville, Florida
| | - Nigel Stallard
- Warwick Medical School, University of Warwick, Coventry, UK
| |
Collapse
|
8
|
Friede T, Stallard N, Parsons N. Adaptive seamless clinical trials using early outcomes for treatment or subgroup selection: Methods, simulation model and their implementation in R. Biom J 2020; 62:1264-1283. [PMID: 32118317 PMCID: PMC8614126 DOI: 10.1002/bimj.201900020] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/12/2019] [Revised: 01/10/2020] [Accepted: 01/12/2020] [Indexed: 11/12/2022]
Abstract
Adaptive seamless designs combine confirmatory testing, a domain of phase III trials, with features such as treatment or subgroup selection, typically associated with phase II trials. They promise to increase the efficiency of development programmes of new drugs, for example, in terms of sample size and/or development time. It is well acknowledged that adaptive designs are more involved from a logistical perspective and require more upfront planning, often in the form of extensive simulation studies, than conventional approaches. Here, we present a framework for adaptive treatment and subgroup selection using the same notation, which links the somewhat disparate literature on treatment selection on one side and on subgroup selection on the other. Furthermore, we introduce a flexible and efficient simulation model that serves both designs. As primary endpoints often take a long time to observe, interim analyses are frequently informed by early outcomes. Therefore, all methods presented accommodate interim analyses informed by either the primary outcome or an early outcome. The R package asd, previously developed to simulate designs with treatment selection, was extended to include subgroup selection (so‐called adaptive enrichment designs). Here, we describe the functionality of the R package asd and use it to present some worked‐up examples motivated by clinical trials in chronic obstructive pulmonary disease and oncology. The examples both illustrate various features of the R package and provide insights into the operating characteristics of adaptive seamless studies.
Collapse
Affiliation(s)
- Tim Friede
- Department of Medical StatisticsUniversity Medical Center GöttingenGöttingen Germany
| | - Nigel Stallard
- Division of Health SciencesWarwick Medical SchoolUniversity of WarwickCoventry UK
| | - Nicholas Parsons
- Division of Health SciencesWarwick Medical SchoolUniversity of WarwickCoventry UK
| |
Collapse
|
9
|
Placzek M, Friede T. A conditional error function approach for adaptive enrichment designs with continuous endpoints. Stat Med 2019; 38:3105-3122. [PMID: 31066093 DOI: 10.1002/sim.8154] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/26/2018] [Revised: 02/22/2019] [Accepted: 03/09/2019] [Indexed: 12/15/2022]
Abstract
Adaptive enrichment designs offer an efficient and flexible way to demonstrate the efficacy of a treatment in a clinically defined full population or in, eg, biomarker-defined subpopulations while controlling the family-wise Type I error rate in the strong sense. Frequently used testing strategies in designs with two or more stages include the combination test and the conditional error function approach. Here, we focus on the latter and present some extensions. In contrast to previous work, we allow for multiple subgroups rather than one subgroup only. For nested as well as nonoverlapping subgroups with normally distributed endpoints, we explore the effect of estimating the variances in the subpopulations. Instead of using a normal approximation, we derive new t-distribution-based methods for two different scenarios. First, in the case of equal variances across the subpopulations, we present exact results using a multivariate t-distribution. Second, in the case of potentially varying variances across subgroups, we provide some improved approximations compared to the normal approximation. The performance of the proposed conditional error function approaches is assessed and compared to the combination test in a simulation study. The proposed methods are motivated by an example in pulmonary arterial hypertension.
Collapse
Affiliation(s)
- Marius Placzek
- Department of Medical Statistics, University Medical Center Göttingen, Göttingen, Germany
| | - Tim Friede
- Department of Medical Statistics, University Medical Center Göttingen, Göttingen, Germany.,DZHK (German Center for Cardiovascular Research), Partner Site Göttingen, Göttingen, Germany
| |
Collapse
|
10
|
Mayer C, Perevozskaya I, Leonov S, Dragalin V, Pritchett Y, Bedding A, Hartford A, Fardipour P, Cicconetti G. Simulation Practices for Adaptive Trial Designs in Drug and Device Development. Stat Biopharm Res 2019. [DOI: 10.1080/19466315.2018.1560359] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/27/2022]
Affiliation(s)
| | | | | | | | | | - Alun Bedding
- Roche Products Limited, Welwyn Garden City, United Kingdom
| | | | | | | |
Collapse
|
11
|
Collignon O, Koenig F, Koch A, Hemmings RJ, Pétavy F, Saint-Raymond A, Papaluca-Amati M, Posch M. Adaptive designs in clinical trials: from scientific advice to marketing authorisation to the European Medicine Agency. Trials 2018; 19:642. [PMID: 30454061 PMCID: PMC6245528 DOI: 10.1186/s13063-018-3012-x] [Citation(s) in RCA: 18] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/23/2018] [Accepted: 10/21/2018] [Indexed: 12/15/2022] Open
Abstract
Background In recent years, experience on the application of adaptive designs in confirmatory clinical trials has accumulated. Although planning such trials comes at the cost of additional operational complexity, adaptive designs offer the benefit of flexibility to update trial design and objectives as data accrue. In 2007, the European Medicines Agency (EMA) provided guidance on confirmatory clinical trials with adaptive (or flexible) designs. In order to better understand how adaptive trials are implemented in practice and how they may impact medicine approval within the EMA centralised procedure, we followed on 59 medicines for which an adaptive clinical trial had been submitted to the EMA Scientific Advice (SA) and analysed previously in a dedicated EMA survey of scientific advice letters. We scrutinized in particular the submission of the corresponding medicines for a marketing authorisation application (MAA). We also discuss the current regulatory perspective as regards the implementation of adaptive designs in confirmatory clinical trials. Methods Using the internal EMA MAA database, the AdisInsight database and related trial registries, we analysed how many of these 59 trials actually started, the completion status, results, the time to trial start, the adaptive elements finally implemented after SA, their possible influence on the success of the trial and corresponding product approval. Results Overall 31 trials out of 59 (53%) were retrieved. Thirty of them (97%) have been started and 23 (74%) concluded. Nine of these trials (39% out of 23) demonstrated a significant treatment effect on their primary endpoint and 4 (17% out of 23) supported a marketing authorisation (MA). An additional two trials were stopped using pre-defined criteria for futility, efficiently identifying trials on which further resources should not be spent. Median time to trial start after SA letter was given by EMA was 5 months. In the investigated trial registries, at least 18 trial (58% of 31 retrieved trials) designs were implemented with adaptive elements, which were predominantly dose selection, sample size reassessment (SSR) and stopping for futility (SFF). Among the 11 completed trials including adaptive elements, 6 demonstrated a significant treatment effect on their primary endpoint (55%). Conclusions Adaptive designs are now well established in the drug development landscape. If properly pre-planned, adaptations can play a key role in the success of some of these trials, for example to help successfully select the most promising dose regimens for phase II/III trials. Interim analyses can also enable stopping of trials for futility when they do not hold their promises. Type I error rate control, trial integrity and results consistency between the different stages of the analyses are fundamental aspects to be discussed thoroughly. Engaging early dialogue with regulators and implementing the scientific advice received is strongly recommended, since much experience in discussing adaptive designs and assessing their results has been accumulated.
Collapse
Affiliation(s)
- Olivier Collignon
- European Medicines Agency, 30 Churchill Place, London, E14 5EU, UK. .,Competence Center for Methodology and Statistics, Luxembourg Institute of Health, 1A-B, rue Thomas Edison, L-1445, Strassen, Luxembourg.
| | - Franz Koenig
- Section for Medical Statistics, Center for Medical Statistics, Informatics, and Intelligent Systems, Medical University of Vienna, Spitalgasse 23, 1090, Vienna, Austria
| | - Armin Koch
- Institut für Biometrie, Medizinische Hochschule Hannover, OE 8410, 30625, Hanover, Germany
| | - Robert James Hemmings
- Medicines and Healthcare Products Regulatory Agency, 151 Buckingham Palace Road, London, SW1W 9SZ, UK
| | - Frank Pétavy
- European Medicines Agency, 30 Churchill Place, London, E14 5EU, UK
| | | | | | - Martin Posch
- Section for Medical Statistics, Center for Medical Statistics, Informatics, and Intelligent Systems, Medical University of Vienna, Spitalgasse 23, 1090, Vienna, Austria
| |
Collapse
|
12
|
Sugitani T, Posch M, Bretz F, Koenig F. Flexible alpha allocation strategies for confirmatory adaptive enrichment clinical trials with a prespecified subgroup. Stat Med 2018; 37:3387-3402. [PMID: 29945304 DOI: 10.1002/sim.7851] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/08/2017] [Revised: 03/08/2018] [Accepted: 05/25/2018] [Indexed: 02/05/2023]
Abstract
Adaptive enrichment designs have recently received considerable attention as they have the potential to make drug development process for personalized medicine more efficient. Several statistical approaches have been proposed so far in the literature and the operating characteristics of these approaches are extensively investigated using simulation studies. In this paper, we improve on existing adaptive enrichment designs by assigning unequal weights to the significance levels associated with the hypotheses of the overall population and a prespecified subgroup. More specifically, we focus on the standard combination test, a modified combination test, the marginal combination test, and the partial conditional error rate approach and explore the operating characteristics of these approaches by a simulation study. We show that these approaches can lead to power gains, compared to existing approaches, if the weights are chosen carefully.
Collapse
Affiliation(s)
- Toshifumi Sugitani
- Biostatistics Group, Astellas Pharma Inc, Tokyo, Japan.,Section for Medical Statistics, Medical University of Vienna, Vienna, Austria
| | - Martin Posch
- Section for Medical Statistics, Medical University of Vienna, Vienna, Austria
| | - Frank Bretz
- Section for Medical Statistics, Medical University of Vienna, Vienna, Austria.,Statistical Methodology, Novartis Pharma AG, Basel, Switzerland
| | - Franz Koenig
- Section for Medical Statistics, Medical University of Vienna, Vienna, Austria
| |
Collapse
|
13
|
Krisam J, Kieser M. Optimal Interim Decision Rules Based on a Binary Surrogate Outcome for Adaptive Biomarker-Based Trials in Oncology. Stat Biopharm Res 2018. [DOI: 10.1080/19466315.2017.1323670] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
Affiliation(s)
- Johannes Krisam
- Institute of Medical Biometry and Informatics, University of Heidelberg, Heidelberg, Germany
| | - Meinhard Kieser
- Institute of Medical Biometry and Informatics, University of Heidelberg, Heidelberg, Germany
| |
Collapse
|
14
|
Su SC, Li X, Zhao Y, Chan ISF. Population-Enrichment Adaptive Design Strategy for an Event-Driven Vaccine Efficacy Trial. STATISTICS IN BIOSCIENCES 2017. [DOI: 10.1007/s12561-017-9202-3] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/27/2022]
|
15
|
Kunzmann K, Benner L, Kieser M. Point estimation in adaptive enrichment designs. Stat Med 2017; 36:3935-3947. [DOI: 10.1002/sim.7412] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/27/2015] [Revised: 06/21/2017] [Accepted: 06/21/2017] [Indexed: 11/08/2022]
Affiliation(s)
- Kevin Kunzmann
- Institute of Medical Biometry and Informatics University of Heidelberg Heidelberg Germany
| | - Laura Benner
- Institute of Medical Biometry and Informatics University of Heidelberg Heidelberg Germany
| | - Meinhard Kieser
- Institute of Medical Biometry and Informatics University of Heidelberg Heidelberg Germany
| |
Collapse
|
16
|
He W, Gallo P, Miller E, Jemiai Y, Maca J, Koury K, Fan XF, Jiang Q, Wang C, Lin M. Addressing Challenges and Opportunities of "Less Well-Understood" Adaptive Designs. Ther Innov Regul Sci 2016; 51:60-68. [PMID: 30235991 DOI: 10.1177/2168479016663265] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
The draft adaptive design guidance released by FDA in 2010 included references to adaptive study designs that were described as "less well-understood." At that time, there was relatively little regulatory experience with such designs, and their properties were felt to be insufficiently understood. In order to promote greater use of adaptive designs, especially those categorized as less well-understood, the Best Practice Subteam of the DIA Adaptive Designs Scientific Working Group (ADSWG) has worked on describing and characterizing these designs, identifying challenges associated with them and suggesting improvements to design or study conduct aspects that might make them more acceptable. This paper summarizes the work from the subteam.
Collapse
Affiliation(s)
- Weili He
- 1 Clinical Biostatistics, Merck & Co Inc, Rahway, NJ, USA
| | - Paul Gallo
- 2 Statistical Methodology, Novartis Pharmaceuticals, East Hanover, NJ, USA
| | - Eva Miller
- 3 Independent biostatistical consultant, Levittown, PA, USA
| | | | - Jeff Maca
- 5 Center for Statistics and Drug Development, Quintiles Inc, Morrisville, NC, USA
| | - Ken Koury
- 1 Clinical Biostatistics, Merck & Co Inc, Rahway, NJ, USA
| | - Xiaoyin Frank Fan
- 6 Statistical Sciences, Novartis Institute of Biomedical Research, Cambridge, MA, USA
| | | | | | - Min Lin
- 9 Center for Biologics Evaluation and Research, Food and Drug Administration, Silver Spring, MD, USA
| |
Collapse
|
17
|
Bauer P, Bretz F, Dragalin V, König F, Wassmer G. Twenty-five years of confirmatory adaptive designs: opportunities and pitfalls. Stat Med 2016; 35:325-47. [PMID: 25778935 PMCID: PMC6680191 DOI: 10.1002/sim.6472] [Citation(s) in RCA: 135] [Impact Index Per Article: 16.9] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/02/2014] [Revised: 02/03/2015] [Accepted: 02/19/2015] [Indexed: 12/26/2022]
Abstract
'Multistage testing with adaptive designs' was the title of an article by Peter Bauer that appeared 1989 in the German journal Biometrie und Informatik in Medizin und Biologie. The journal does not exist anymore but the methodology found widespread interest in the scientific community over the past 25 years. The use of such multistage adaptive designs raised many controversial discussions from the beginning on, especially after the publication by Bauer and Köhne 1994 in Biometrics: Broad enthusiasm about potential applications of such designs faced critical positions regarding their statistical efficiency. Despite, or possibly because of, this controversy, the methodology and its areas of applications grew steadily over the years, with significant contributions from statisticians working in academia, industry and agencies around the world. In the meantime, such type of adaptive designs have become the subject of two major regulatory guidance documents in the US and Europe and the field is still evolving. Developments are particularly noteworthy in the most important applications of adaptive designs, including sample size reassessment, treatment selection procedures, and population enrichment designs. In this article, we summarize the developments over the past 25 years from different perspectives. We provide a historical overview of the early days, review the key methodological concepts and summarize regulatory and industry perspectives on such designs. Then, we illustrate the application of adaptive designs with three case studies, including unblinded sample size reassessment, adaptive treatment selection, and adaptive endpoint selection. We also discuss the availability of software for evaluating and performing such designs. We conclude with a critical review of how expectations from the beginning were fulfilled, and - if not - discuss potential reasons why this did not happen.
Collapse
Affiliation(s)
- Peter Bauer
- Section of Medical StatisticsMedical University of ViennaSpitalgasse 231090 WienAustria
| | - Frank Bretz
- Novartis Pharma AGLichtstrasse 354002BaselSwitzerland
- Shanghai University of Finance and EconomicsChina
| | | | - Franz König
- Section of Medical StatisticsMedical University of ViennaSpitalgasse 231090 WienAustria
| | - Gernot Wassmer
- Aptiv Solutions, an ICON plc companyRobert‐Perthel‐Str. 77a50739KölnGermany
- Institute for Medical Statistics, Informatics and EpidemiologyUniversity of Cologne50924KölnGermany
| |
Collapse
|
18
|
Ondra T, Dmitrienko A, Friede T, Graf A, Miller F, Stallard N, Posch M. Methods for identification and confirmation of targeted subgroups in clinical trials: A systematic review. J Biopharm Stat 2016; 26:99-119. [PMID: 26378339 PMCID: PMC4732423 DOI: 10.1080/10543406.2015.1092034] [Citation(s) in RCA: 73] [Impact Index Per Article: 9.1] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/14/2015] [Accepted: 08/14/2015] [Indexed: 12/30/2022]
Abstract
Important objectives in the development of stratified medicines include the identification and confirmation of subgroups of patients with a beneficial treatment effect and a positive benefit-risk balance. We report the results of a literature review on methodological approaches to the design and analysis of clinical trials investigating a potential heterogeneity of treatment effects across subgroups. The identified approaches are classified based on certain characteristics of the proposed trial designs and analysis methods. We distinguish between exploratory and confirmatory subgroup analysis, frequentist, Bayesian and decision-theoretic approaches and, last, fixed-sample, group-sequential, and adaptive designs and illustrate the available trial designs and analysis strategies with published case studies.
Collapse
Affiliation(s)
- Thomas Ondra
- Center for Medical Statistics and Informatics, Medizinische Universität Wien, Vienna, Austria
| | - Alex Dmitrienko
- Center for Statistics in Drug Development, Quintiles, Overland Park, Kansas, USA
| | - Tim Friede
- Department of Medical Statistics, Universitaetsmedizin, Göttingen, Göttingen, Germany
| | - Alexandra Graf
- Center for Medical Statistics and Informatics, Medizinische Universität Wien, Vienna, Austria
| | - Frank Miller
- Statistiska institutionen, Stockholms Universitet, Stockholm, Sweden
| | - Nigel Stallard
- Department of Statistics and Epidemiology, University of Warwick, Coventry, UK
| | - Martin Posch
- Center for Medical Statistics and Informatics, Medizinische Universität Wien, Vienna, Austria
| |
Collapse
|
19
|
Optimal decision rules for biomarker-based subgroup selection for a targeted therapy in oncology. Int J Mol Sci 2015; 16:10354-75. [PMID: 25961947 PMCID: PMC4463650 DOI: 10.3390/ijms160510354] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/25/2015] [Revised: 04/16/2015] [Accepted: 04/29/2015] [Indexed: 01/14/2023] Open
Abstract
Throughout recent years, there has been a rapidly increasing interest regarding the evaluation of so-called targeted therapies. These therapies are assumed to show a greater benefit in a pre-specified subgroup of patients—commonly identified by a predictive biomarker—as compared to the total patient population of interest. This situation has led to the necessity to develop biostatistical methods allowing an efficient evaluation of such treatments. Among others, adaptive enrichment designs have been proposed as a solution. These designs allow the selection of the most promising patient population based on an efficacy analysis at interim and restricting recruitment to these patients afterwards. As has recently been shown, the performance of the applied interim decision rule in such a design plays a crucial role in ensuring a successful trial. In this work, we investigate the situation when the primary outcome of the trial is a binary variable. Optimal decision rules are derived which incorporate the uncertainty about the treatment effects. These optimal decision rules are evaluated with respect to their performance in an adaptive enrichment design in terms of correct selection probability and power, and are compared to proposed ad hoc decision rules. Our methods are illustrated by means of a clinical trial example.
Collapse
|
20
|
Maca J, Dragalin V, Gallo P. Adaptive Clinical Trials: Overview of Phase III Designs and Challenges. Ther Innov Regul Sci 2014; 48:31-40. [PMID: 30231417 DOI: 10.1177/2168479013507436] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
Adaptive designs use accruing data to make changes in an ongoing trial according to a prespecified plan and potentially offer great efficiencies for clinical development. There are many types of adaptive designs and many trial aspects that could in theory be adapted. However, the scope of adaptive designs with relevance in confirmatory trials is narrower, and in addition, extensive pre-planning is needed and various types of challenges need to be addressed in order to use these designs in this stage of development. Nevertheless, with careful planning, there are opportunities for these designs to offer important benefits even in the confirmatory stage of development. We provide an overview of adaptive designs that have relevance for confirmatory trials and discuss considerations that may affect whether they should or should not be used in particular trials or programs as well as the challenges that need to be addressed.
Collapse
Affiliation(s)
- Jeff Maca
- 1 Center for Statistics in Drug Development, Quintiles Inc, Morrisville, SC, USA
| | | | - Paul Gallo
- 3 Statistical Methodology, Novartis Pharmaceuticals, East Hanover, NJ, USA
| |
Collapse
|
21
|
Sugitani T, Bretz F, Maurer W. A simple and flexible graphical approach for adaptive group-sequential clinical trials. J Biopharm Stat 2014; 26:202-16. [PMID: 25372071 DOI: 10.1080/10543406.2014.972509] [Citation(s) in RCA: 9] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/24/2022]
Abstract
In this article, we introduce a graphical approach to testing multiple hypotheses in group-sequential clinical trials allowing for midterm design modifications. It is intended for structured study objectives in adaptive clinical trials and extends the graphical group-sequential designs from Maurer and Bretz (Statistics in Biopharmaceutical Research 2013; 5: 311-320) to adaptive trial designs. The resulting test strategies can be visualized graphically and performed iteratively. We illustrate the methodology with two examples from our clinical trial practice. First, we consider a three-armed gold-standard trial with the option to reallocate patients to either the test drug or the active control group, while stopping the recruitment of patients to placebo, after having demonstrated superiority of the test drug over placebo at an interim analysis. Second, we consider a confirmatory two-stage adaptive design with treatment selection at interim.
Collapse
Affiliation(s)
- Toshifumi Sugitani
- a Section for Medical Statistics, Medical University of Vienna , Vienna , Austria
| | - Frank Bretz
- b Novartis Pharma AG , Basel , Switzerland.,c Shanghai University of Finance and Economics , Shanghai , Peoples Republic of China
| | | |
Collapse
|