1
|
Boumendil L, Chevret S, Lévy V, Biard L. Two-stage randomized clinical trials with a right-censored endpoint: Comparison of frequentist and Bayesian adaptive designs. Stat Med 2024; 43:3364-3382. [PMID: 38844988 DOI: 10.1002/sim.10130] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/21/2022] [Revised: 04/17/2024] [Accepted: 05/20/2024] [Indexed: 07/17/2024]
Abstract
Adaptive randomized clinical trials are of major interest when dealing with a time-to-event outcome in a prolonged observation window. No consensus exists either to define stopping boundaries or to combinep $$ p $$ values or test statistics in the terminal analysis in the case of a frequentist design and sample size adaptation. In a one-sided setting, we compared three frequentist approaches using stopping boundaries relying onα $$ \alpha $$ -spending functions and a Bayesian monitoring setting with boundaries based on the posterior distribution of the log-hazard ratio. All designs comprised a single interim analysis with an efficacy stopping rule and the possibility of sample size adaptation at this interim step. Three frequentist approaches were defined based on the terminal analysis: combination of stagewise statistics (Wassmer) or ofp $$ p $$ values (Desseaux), or on patientwise splitting (Jörgens), and we compared the results with those of the Bayesian monitoring approach (Freedman). These different approaches were evaluated in a simulation study and then illustrated on a real dataset from a randomized clinical trial conducted in elderly patients with chronic lymphocytic leukemia. All approaches controlled for the type I error rate, except for the Bayesian monitoring approach, and yielded satisfactory power. It appears that the frequentist approaches are the best in underpowered trials. The power of all the approaches was affected by the violation of the proportional hazards (PH) assumption. For adaptive designs with a survival endpoint and a one-sided alternative hypothesis, the Wassmer and Jörgens approaches after sample size adaptation should be preferred, unless violation of PH is suspected.
Collapse
Affiliation(s)
- Luana Boumendil
- INSERM U1153, Team ECSTRRA, Hôpital Saint Louis, Paris, France
- Université Paris Cité, Paris, France
- AP-HP Hôpital Saint Louis, Service de Biostatistique et Information Médicale, Paris, France
| | - Sylvie Chevret
- INSERM U1153, Team ECSTRRA, Hôpital Saint Louis, Paris, France
- Université Paris Cité, Paris, France
- AP-HP Hôpital Saint Louis, Service de Biostatistique et Information Médicale, Paris, France
| | - Vincent Lévy
- INSERM U1153, Team ECSTRRA, Hôpital Saint Louis, Paris, France
- Université Paris 13, Villetaneuse, France
- AP-HP Hôpital Avicenne, Unité de Recherche Clinique Bobigny, Bobigny, France
| | - Lucie Biard
- INSERM U1153, Team ECSTRRA, Hôpital Saint Louis, Paris, France
- Université Paris Cité, Paris, France
- AP-HP Hôpital Saint Louis, Service de Biostatistique et Information Médicale, Paris, France
| |
Collapse
|
2
|
Burnett T, König F, Jaki T. Adding experimental treatment arms to multi-arm multi-stage platform trials in progress. Stat Med 2024; 43:3447-3462. [PMID: 38852991 DOI: 10.1002/sim.10090] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/09/2022] [Revised: 01/16/2024] [Accepted: 04/15/2024] [Indexed: 06/11/2024]
Abstract
Multi-arm multi-stage (MAMS) platform trials efficiently compare several treatments with a common control arm. Crucially MAMS designs allow for adjustment for multiplicity if required. If for example, the active treatment arms in a clinical trial relate to different dose levels or different routes of administration of a drug, the strict control of the family-wise error rate (FWER) is paramount. Suppose a further treatment becomes available, it is desirable to add this to the trial already in progress; to access both the practical and statistical benefits of the MAMS design. In any setting where control of the error rate is required, we must add corresponding hypotheses without compromising the validity of the testing procedure.To strongly control the FWER, MAMS designs use pre-planned decision rules that determine the recruitment of the next stage of the trial based on the available data. The addition of a treatment arm presents an unplanned change to the design that we must account for in the testing procedure. We demonstrate the use of the conditional error approach to add hypotheses to any testing procedure that strongly controls the FWER. We use this framework to add treatments to a MAMS trial in progress. Simulations illustrate the possible characteristics of such procedures.
Collapse
Affiliation(s)
- Thomas Burnett
- Department of Mathematical Sciences, University of Bath, Bath, UK
| | - Franz König
- Center for Medical Data Science, Medical University of Vienna, Vienna, Austria
| | - Thomas Jaki
- MRC Biostatistics Unit, University of Cambridge, Cambridge, UK
- Faculty of Computer Science and Data Science, University of Regensburg, Regensburg, Germany
| |
Collapse
|
3
|
Gao P, Li Y. Adaptive two-stage seamless sequential design for clinical trials. J Biopharm Stat 2024:1-23. [PMID: 38704845 DOI: 10.1080/10543406.2024.2342518] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/16/2023] [Accepted: 04/09/2024] [Indexed: 05/07/2024]
Abstract
We propose an adaptive sequential testing procedure for the selection and testing of multiple treatment options, such as dose/regimen, different drugs, sub-populations, endpoints, or a mixture of them in a seamlessly combined phase II/III trial. The selection is to be made at the end of phase 2 stage. Unlike in many of the published literature, the selection rule is not required to be to "select the best", and does not need to be pre-specified, which provides flexibility and allows the trial investigators to use any efficacy and safety information/criteria, or surrogate or intermediate endpoint to make the selection. Sample size and power calculations are provided. The calculations have been confirmed to be accurate by simulations. Interim analysis can be performed after the selection, sample size can be modified if the observed efficacy deviates from the assumed. Inference after the trial, including p-value, median unbiased point estimate and confidence intervals, are provided. By applying a dominance theorem, the procedure can be applied to normal, binary, Poisson, negative binomial distributed endpoints and time-to-event endpoints, and a mixture of these distributions (in trials involving endpoint selection).
Collapse
Affiliation(s)
- Ping Gao
- Biostatistics, Innovatio Statistics, Inc ., Bridgewater, USA
| | - Yingqiu Li
- School of Mathematics and Statistics, Changsha University of Science and Technology, Changsha, Hunan, China
| |
Collapse
|
4
|
Gao P, Li Y. Adaptive Multiple Comparison Sequential Design (AMCSD) for clinical trials. J Biopharm Stat 2024; 34:424-440. [PMID: 37526434 DOI: 10.1080/10543406.2023.2233590] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/06/2022] [Accepted: 07/01/2023] [Indexed: 08/02/2023]
Abstract
We propose an adaptive sequential testing procedure for clinical trials that test the efficacy of multiple treatment options, such as dose/regimen, different drugs, sub-populations, endpoints, or a mixture of them in one trial. At any interim analyses, sample size re-estimation can be conducted, and any option can be dropped for lack of efficacy or unsatisfactory safety profile. Inference after the trial, including p-value, conservative point estimate and confidence intervals, are provided.
Collapse
Affiliation(s)
- Ping Gao
- Innovatio Statistics, Inc., Bridgewater, New Jersey, USA
| | - Yingqiu Li
- School of Mathematics and Statistics, Changsha University of Science and Technology, Changsha, Hunan, China
| |
Collapse
|
5
|
Berry LR, Marion J, Berry SM, Viele K. Optimal sample size division in two-stage seamless designs. Pharm Stat 2024. [PMID: 38676420 DOI: 10.1002/pst.2394] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/19/2023] [Revised: 02/21/2024] [Accepted: 04/08/2024] [Indexed: 04/28/2024]
Abstract
Inferentially seamless 2/3 designs are increasingly popular in clinical trials. It is important to understand their relative advantages compared with separate phase 2 and phase 3 trials, and to understand the consequences of design choices such as the proportion of patients included in the phase 2 portion of the design. Extending previous work in this area, we perform a simulation study across multiple numbers of arms and efficacy response curves. We consider a design space crossing the choice of a separate versus seamless design with the choice of allocating 0%-100% of available patients in phase 2, with the remainder in phase 3. The seamless designs achieve greater power than their separate trial counterparts. Importantly, the optimal seamless design is more robust than the optimal separate program, meaning that one range of values for the proportion of patients used in phase 2 (30%-50% of the total phase 2/3 sample size) is nearly optimal for a wide range of response scenarios. In contrast, a percentage of patients used in phase 2 for separate trials may be optimal for some alternative scenarios but decidedly inferior for other alternative scenarios. When operationally and scientifically viable, seamless trials provide superior performance compared with separate phase 2 and phase 3 trials. The results also provide guidance for the implementation of these trials in practice.
Collapse
Affiliation(s)
| | - Joe Marion
- Berry Consultants, LLC, Austin, Texas, USA
| | - Scott M Berry
- Berry Consultants, LLC, Austin, Texas, USA
- Department of Biostatistics, University of Kansas Medical Center, Kansas City, Kansas, USA
| | - Kert Viele
- Berry Consultants, LLC, Austin, Texas, USA
- Department of Biostatistics, University of Kentucky, Lexington, Kentucky, USA
| |
Collapse
|
6
|
Li L, Ivanova A. Efficient testing of the biomarker positive and negative subgroups in a biomarker-stratified trial. Biometrics 2024; 80:ujae056. [PMID: 38861372 PMCID: PMC11166030 DOI: 10.1093/biomtc/ujae056] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/02/2023] [Revised: 05/01/2024] [Accepted: 05/20/2024] [Indexed: 06/13/2024]
Abstract
In many randomized placebo-controlled trials with a biomarker defined subgroup, it is believed that this subgroup has the same or higher treatment effect compared with its complement. These subgroups are often referred to as the biomarker positive and negative subgroups. Most biomarker-stratified pivotal trials are aimed at demonstrating a significant treatment effect either in the biomarker positive subgroup or in the overall population. A major shortcoming of this approach is that the treatment can be declared effective in the overall population even though it has no effect in the biomarker negative subgroup. We use the isotonic assumption about the treatment effects in the two subgroups to construct an efficient way to test for a treatment effect in both the biomarker positive and negative subgroups. A substantial reduction in the required sample size for such a trial compared with existing methods makes evaluating the treatment effect in both the biomarker positive and negative subgroups feasible in pivotal trials especially when the prevalence of the biomarker positive subgroup is less than 0.5.
Collapse
Affiliation(s)
- Lang Li
- Department of Biostatistics, University of North Carolina at Chapel Hill, Chapel Hill, NC 27599-7420, USA
| | - Anastasia Ivanova
- Department of Biostatistics, University of North Carolina at Chapel Hill, Chapel Hill, NC 27599-7420, USA
| |
Collapse
|
7
|
Pepić A, Stark M, Friede T, Kopp-Schneider A, Calderazzo S, Reichert M, Wolf M, Wirth U, Schopf S, Zapf A. A diagnostic phase III/IV seamless design to investigate the diagnostic accuracy and clinical effectiveness using the example of HEDOS and HEDOS II. Stat Methods Med Res 2024; 33:433-448. [PMID: 38327081 PMCID: PMC10981198 DOI: 10.1177/09622802241227951] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/09/2024]
Abstract
The development process of medical devices can be streamlined by combining different study phases. Here, for a diagnostic medical device, we present the combination of confirmation of diagnostic accuracy (phase III) and evaluation of clinical effectiveness regarding patient-relevant endpoints (phase IV) using a seamless design. This approach is used in the Thyroid HEmorrhage DetectOr Study (HEDOS & HEDOS II) investigating a post-operative hemorrhage detector named ISAR-M THYRO® in patients after thyroid surgery. Data from the phase III trial are reused as external controls in the control group of the phase IV trial. An unblinded interim analysis is planned between the two study stages which includes a recalculation of the sample size for the phase IV part after completion of the first stage of the seamless design. The study concept presented here is the first seamless design proposed in the field of diagnostic studies. Hence, the aim of this work is to emphasize the statistical methodology as well as feasibility of the proposed design in relation to the planning and implementation of the seamless design. Seamless designs can accelerate the overall trial duration and increase its efficiency in terms of sample size and recruitment. However, careful planning addressing numerous methodological and procedural challenges is necessary for successful implementation as well as agreement with regulatory bodies.
Collapse
Affiliation(s)
- Amra Pepić
- Institute of Medical Biometry and Epidemiology, University Medical Center Hamburg-Eppendorf (UKE), Hamburg, Germany
| | - Maria Stark
- Institute of Medical Biometry and Epidemiology, University Medical Center Hamburg-Eppendorf (UKE), Hamburg, Germany
| | - Tim Friede
- Department of Medical Statistics, University Medical Center Göttingen, Göttingen, Germany
| | | | - Silvia Calderazzo
- Division of Biostatistics, German Cancer Research Center (DKFZ), Heidelberg, Germany
| | | | - Michael Wolf
- CRI—The Clinical Research Institute, Munich, Germany
| | - Ulrich Wirth
- Clinic for General, Visceral and Transplant Surgery, Hospital of the Ludwig-Maximilians-University, Munich, Germany
| | - Stefan Schopf
- RoMed Klinik Bad Aibling, Academic University Hospital of the Technical University of Munich, Bad Aibling, Germany
| | - Antonia Zapf
- Institute of Medical Biometry and Epidemiology, University Medical Center Hamburg-Eppendorf (UKE), Hamburg, Germany
| |
Collapse
|
8
|
Yang J, Li G, Yang D, Wu J, Wang J, Gao X, Liu P. Seamless phase 2/3 design for trials with multiple co-primary endpoints using Bayesian predictive power. BMC Med Res Methodol 2024; 24:12. [PMID: 38233758 PMCID: PMC10792895 DOI: 10.1186/s12874-024-02144-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/15/2023] [Accepted: 01/05/2024] [Indexed: 01/19/2024] Open
Abstract
Seamless phase 2/3 design has become increasingly popular in clinical trials with a single endpoint. Trials that define success based on the achievement of all co-primary endpoints (CPEs) encounter the challenge of inflated type 2 error rates, often leading to an overly large sample size. To tackle this challenge, we introduced a seamless phase 2/3 design strategy that employs Bayesian predictive power (BPP) for futility monitoring and sample size re-estimation at interim analysis. The correlations among multiple CPEs are incorporated using a Dirichlet-multinomial distribution. An alternative approach based on conditional power (CP) was also discussed for comparison. A seamless phase 2/3 vaccine trial employing four binary endpoints under the non-inferior hypothesis serves as an example. Our results spotlight that, in scenarios with relatively small phase 2 sample sizes (e.g., 50 or 100 subjects), the BPP approach either outperforms or matches the CP approach in terms of overall power. Particularly, with n1 = 50 and ρ = 0, BPP showcases an overall power advantage over CP by as much as 8.54%. Furthermore, when the phase 2 stage enrolled more subjects (e.g., 150 or 200), especially with a phase 2 sample size of 200 and ρ = 0, the BPP approach evidences a peak difference of 5.76% in early stop probability over the CP approach, emphasizing its better efficiency in terminating futile trials. It's noteworthy that both BPP and CP methodologies maintained type 1 error rates under 2.5%. In conclusion, the integration of the Dirichlet-Multinominal model with the BPP approach offers improvement in certain scenarios over the CP approach for seamless phase 2/3 trials with multiple CPEs.
Collapse
Affiliation(s)
- Jiaying Yang
- Department of Public Health, School of Medicine, Nanjing University of Chinese Medicine, 138 Xianlin Rd, Nanjing, 210023, China.
| | - Guochun Li
- Department of Public Health, School of Medicine, Nanjing University of Chinese Medicine, 138 Xianlin Rd, Nanjing, 210023, China
| | - Dongqing Yang
- Department of Public Health, School of Medicine, Nanjing University of Chinese Medicine, 138 Xianlin Rd, Nanjing, 210023, China
| | - Juan Wu
- Department of Public Health, School of Medicine, Nanjing University of Chinese Medicine, 138 Xianlin Rd, Nanjing, 210023, China
| | - Junqin Wang
- Department of Public Health, School of Medicine, Nanjing University of Chinese Medicine, 138 Xianlin Rd, Nanjing, 210023, China
| | - Xingsu Gao
- Department of Public Health, School of Medicine, Nanjing University of Chinese Medicine, 138 Xianlin Rd, Nanjing, 210023, China
| | - Pei Liu
- Department of Epidemiology and Biostatistics, School of Public Health, Southeast University, No.87 Dingjiaqiao, Nanjing, 210009, China
| |
Collapse
|
9
|
Zhu H, Wong WK. An Overview of Adaptive Designs and Some of Their Challenges, Benefits, and Innovative Applications. J Med Internet Res 2023; 25:e44171. [PMID: 37843888 PMCID: PMC10616728 DOI: 10.2196/44171] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/08/2022] [Revised: 03/25/2023] [Accepted: 05/16/2023] [Indexed: 10/17/2023] Open
Abstract
Adaptive designs are increasingly developed and used to improve all phases of clinical trials and in biomedical studies in various ways to address different statistical issues. We first present an overview of adaptive designs and note their numerous advantages over traditional clinical trials. In particular, we provide a concrete demonstration that shows how recent adaptive design strategies can further improve an adaptive trial implemented 13 years ago. Despite their usefulness, adaptive designs are still not widely implemented in clinical trials. We offer a few possible reasons and propose some ways to use them more broadly in practice, which include greater availability of software tools and interactive websites to generate optimal adaptive trials freely and effectively, including the use of metaheuristics to facilitate the search for an efficient trial design. To this end, we present several web-based tools for finding various adaptive and nonadaptive optimal designs and discuss nature-inspired metaheuristics. Metaheuristics are assumptions-free general purpose optimization algorithms widely used in computer science and engineering to tackle all kinds of challenging optimization problems, and their use in designing clinical trials is just emerging. We describe a few recent such applications and some of their capabilities for designing various complex trials. Particle swarm optimization is an exemplary nature-inspired algorithm, and similar to others, it has a simple definition but many moving parts, making it hard to study its properties analytically. We investigated one of its hitherto unstudied issues on how to bring back out-of-range candidates during the search for the optimum of the search domain and show that different strategies can impact the success and time of the search. We conclude with a few caveats on the use of metaheuristics for a successful search.
Collapse
Affiliation(s)
- Hongjian Zhu
- Statistical Innovation Group, AbbVie Inc., Virtual Office, Sugar Land, TX, United States
| | - Weng Kee Wong
- Department of Biostatistics, Fielding School of Public Health, University of California at Los Angeles, Los Angeles, CA, United States
| |
Collapse
|
10
|
Gera RG, Friede T. Blinded sample size recalculation in multiple composite population designs with normal data and baseline adjustments. Biom J 2023; 65:e2000326. [PMID: 37309256 DOI: 10.1002/bimj.202000326] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/30/2020] [Revised: 12/13/2022] [Accepted: 03/07/2023] [Indexed: 06/14/2023]
Abstract
The increasing interest in subpopulation analysis has led to the development of various new trial designs and analysis methods in the fields of personalized medicine and targeted therapies. In this paper, subpopulations are defined in terms of an accumulation of disjoint population subsets and will therefore be called composite populations. The proposed trial design is applicable to any set of composite populations, considering normally distributed endpoints and random baseline covariates. Treatment effects for composite populations are tested by combining p-values, calculated on the subset levels, using the inverse normal combination function to generate test statistics for those composite populations while the closed testing procedure accounts for multiple testing. Critical boundaries for intersection hypothesis tests are derived using multivariate normal distributions, reflecting the joint distribution of composite population test statistics given no treatment effect exists. For sample size calculation and sample size, recalculation multivariate normal distributions are derived which describe the joint distribution of composite population test statistics under an assumed alternative hypothesis. Simulations demonstrate the absence of any practical relevant inflation of the type I error rate. The target power after sample size recalculation is typically met or close to being met.
Collapse
Affiliation(s)
- Roland G Gera
- Department of Medical Statistics, University Medical Centre Göttingen, Göttingen, Germany
| | - Tim Friede
- Department of Medical Statistics, University Medical Centre Göttingen, Göttingen, Germany
- DZHK (German Center for Cardiovascular Research), Partner Site Göttingen, Göttingen, Germany
| |
Collapse
|
11
|
Jiang L, Yuan Y. Seamless phase II/III design: a useful strategy to reduce the sample size for dose optimization. J Natl Cancer Inst 2023; 115:1092-1098. [PMID: 37243720 PMCID: PMC10483325 DOI: 10.1093/jnci/djad103] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/15/2022] [Revised: 05/02/2023] [Accepted: 05/24/2023] [Indexed: 05/29/2023] Open
Abstract
BACKGROUND The traditional more-is-better dose selection paradigm, originally developed for cytotoxic chemotherapeutics, can be problematic when applied to the development of novel molecularly targeted agents. Recognizing this issue, the US Food and Drug Administration initiated Project Optimus to reform the dose optimization and selection paradigm in oncology drug development, emphasizing the need for greater attention to benefit-risk considerations. METHODS We identify different types of phase II/III dose-optimization designs, classified according to trial objectives and endpoint types. Through computer simulations, we examine their operating characteristics and discuss the relevant statistical and design considerations for effective dose optimization. RESULTS Phase II/III dose-optimization designs are capable of controlling family-wise type I error rates and achieving appropriate statistical power with substantially smaller sample sizes than the conventional approach while also reducing the number of patients who experience toxicity. Depending on the design and scenario, the sample size savings range from 16.6% to 27.3%, with a mean savings of 22.1%. CONCLUSIONS Phase II/III dose-optimization designs offer an efficient way to reduce sample sizes for dose optimization and accelerate the development of targeted agents. However, because of interim dose selection, the phase II/III dose-optimization design presents logistical and operational challenges and requires careful planning and implementation to ensure trial integrity.
Collapse
Affiliation(s)
- Liyun Jiang
- Research Center of Biostatistics and Computational Pharmacy, China Pharmaceutical University, Nanjing, China
| | - Ying Yuan
- Department of Biostatistics, The University of Texas MD Anderson Cancer Center, Houston, TX, USA
| |
Collapse
|
12
|
Yu Z, Wu L, Bunn V, Li Q, Lin J. Evolution of Phase II Oncology Trial Design: from Single Arm to Master Protocol. Ther Innov Regul Sci 2023; 57:823-838. [PMID: 36871111 DOI: 10.1007/s43441-023-00500-w] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/30/2022] [Accepted: 02/10/2023] [Indexed: 03/06/2023]
Abstract
The recent development of novel anticancer treatments with diverse mechanisms of action has accelerated the detection of treatment candidates tremendously. The rapidly changing drug development landscapes and the high failure rates in Phase III trials both underscore the importance of more efficient and robust phase II designs. The goals of phase II oncology studies are to explore the preliminary efficacy and toxicity of the investigational product and to inform future drug development strategies such as go/no-go decisions for phase III development, or dose/indication selection. These complex purposes of phase II oncology designs call for efficient, flexible, and easy-to-implement clinical trial designs. Therefore, innovative adaptive study designs with the potential of improving the efficiency of the study, protecting patients, and improving the quality of information gained from trials have been commonly used in Phase II oncology studies. Although the value of adaptive clinical trial methods in early phase drug development is generally well accepted, there is no comprehensive review and guidance on adaptive design methods and their best practice for phase II oncology trials. In this paper, we review the recent development and evolution of phase II oncology design, including frequentist multistage design, Bayesian continuous monitoring, master protocol design, and innovative design methods for randomized phase II studies. The practical considerations and the implementation of these complex design methods are also discussed.
Collapse
Affiliation(s)
- Ziji Yu
- , 95 Hayden Ave, Lexington, MA, 02421, USA.
- Takeda Pharmaceuticals, Lexington, USA.
| | - Liwen Wu
- Takeda Pharmaceuticals, Lexington, USA
| | | | | | | |
Collapse
|
13
|
Robertson DS, Choodari-Oskooei B, Dimairo M, Flight L, Pallmann P, Jaki T. Point estimation for adaptive trial designs II: Practical considerations and guidance. Stat Med 2023; 42:2496-2520. [PMID: 37021359 PMCID: PMC7614609 DOI: 10.1002/sim.9734] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/25/2021] [Revised: 01/20/2023] [Accepted: 03/18/2023] [Indexed: 04/07/2023]
Abstract
In adaptive clinical trials, the conventional end-of-trial point estimate of a treatment effect is prone to bias, that is, a systematic tendency to deviate from its true value. As stated in recent FDA guidance on adaptive designs, it is desirable to report estimates of treatment effects that reduce or remove this bias. However, it may be unclear which of the available estimators are preferable, and their use remains rare in practice. This article is the second in a two-part series that studies the issue of bias in point estimation for adaptive trials. Part I provided a methodological review of approaches to remove or reduce the potential bias in point estimation for adaptive designs. In part II, we discuss how bias can affect standard estimators and assess the negative impact this can have. We review current practice for reporting point estimates and illustrate the computation of different estimators using a real adaptive trial example (including code), which we use as a basis for a simulation study. We show that while on average the values of these estimators can be similar, for a particular trial realization they can give noticeably different values for the estimated treatment effect. Finally, we propose guidelines for researchers around the choice of estimators and the reporting of estimates following an adaptive design. The issue of bias should be considered throughout the whole lifecycle of an adaptive design, with the estimation strategy prespecified in the statistical analysis plan. When available, unbiased or bias-reduced estimates are to be preferred.
Collapse
Affiliation(s)
| | - Babak Choodari-Oskooei
- MRC Clinical Trials Unit at UCL, Institute of Clinical Trials and Methodology, University College London, London, UK
| | - Munya Dimairo
- School of Health and Related Research (ScHARR), University of Sheffield, Sheffield, UK
| | - Laura Flight
- School of Health and Related Research (ScHARR), University of Sheffield, Sheffield, UK
| | | | - Thomas Jaki
- MRC Biostatistics Unit, University of Cambridge, Cambridge, UK
- Faculty of Informatics and Data Science, University of Regensburg, Regensburg, Germany
| |
Collapse
|
14
|
Duputel B, Stallard N, Montestruc F, Zohar S, Ursino M. Using dichotomized survival data to construct a prior distribution for a Bayesian seamless Phase II/III clinical trial. Stat Methods Med Res 2023; 32:963-977. [PMID: 36919403 PMCID: PMC10521165 DOI: 10.1177/09622802231160554] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/16/2023]
Abstract
Master protocol designs allow for simultaneous comparison of multiple treatments or disease subgroups. Master protocols can also be designed as seamless studies, in which two or more clinical phases are considered within the same trial. They can be divided into two categories: operationally seamless, in which the two phases are separated into two independent studies, and inferentially seamless, in which the interim analysis is considered an adaptation of the study. Bayesian designs are scarcely studied. Our aim is to propose and compare Bayesian operationally seamless Phase II/III designs using a binary endpoint for the first stage and a time-to-event endpoint for the second stage. At the end of Phase II, arm selection is based on posterior (futility) and predictive (selection) probabilities. The results of the first phase are then incorporated into prior distributions of a time-to-event model. Simulation studies showed that Bayesian operationally seamless designs can approach the inferentially seamless counterpart, allowing for an increasing simulated power with respect to the operationally frequentist design.
Collapse
Affiliation(s)
- Benjamin Duputel
- Universitè Paris Citè, Sorbonne Université, Inserm, Centre de Recherche des Cordeliers, Paris, France
- Inria, HeKA, Paris, France
- eXYSTAT, Malakoff, France
| | - Nigel Stallard
- Warwick Clinical Trials Unit, Warwick Medical School, University of Warwick, Coventry, UK
| | | | - Sarah Zohar
- Universitè Paris Citè, Sorbonne Université, Inserm, Centre de Recherche des Cordeliers, Paris, France
- Inria, HeKA, Paris, France
| | - Moreno Ursino
- Universitè Paris Citè, Sorbonne Université, Inserm, Centre de Recherche des Cordeliers, Paris, France
- Inria, HeKA, Paris, France
- Unit of Clinical Epidemiology, Assistance Publique-Hôpitaux de Paris, CHU Robert Debrè, Paris, France
| |
Collapse
|
15
|
Jennison C. Discussion on "Adaptive enrichment designs with a continuous biomarker" by N. Stallard. Biometrics 2023; 79:26-30. [PMID: 35344206 DOI: 10.1111/biom.13642] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/11/2021] [Accepted: 12/23/2021] [Indexed: 11/29/2022]
|
16
|
Xu H, Liu Y, Beckman RA. Adaptive Endpoints Selection with Application in Rare Disease. Stat Biopharm Res 2023. [DOI: 10.1080/19466315.2023.2183252] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/25/2023]
Affiliation(s)
- Heng Xu
- Nektar Therapeutics, San Francisco, USA
| | - Yi Liu
- Nektar Therapeutics, San Francisco, USA
| | - Robert A. Beckman
- Departments of Oncology and of Biostatistics, Bioinformatics, and Biomathematics, Lombardi Comprehensive Cancer Center and Innovation Center for Biomedical Informatics, Georgetown University Medical Center
| |
Collapse
|
17
|
Placzek M, Friede T. Blinded sample size recalculation in adaptive enrichment designs. Biom J 2023; 65:e2000345. [PMID: 35983952 DOI: 10.1002/bimj.202000345] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/30/2020] [Revised: 09/24/2021] [Accepted: 11/07/2021] [Indexed: 12/17/2022]
Abstract
In the precision medicine era, (prespecified) subgroup analyses are an integral part of clinical trials. Incorporating multiple populations and hypotheses in the design and analysis plan, adaptive designs promise flexibility and efficiency in such trials. Adaptations include (unblinded) interim analyses (IAs) or blinded sample size reviews. An IA offers the possibility to select promising subgroups and reallocate sample size in further stages. Trials with these features are known as adaptive enrichment designs. Such complex designs comprise many nuisance parameters, such as prevalences of the subgroups and variances of the outcomes in the subgroups. Additionally, a number of design options including the timepoint of the sample size review and timepoint of the IA have to be selected. Here, for normally distributed endpoints, we propose a strategy combining blinded sample size recalculation and adaptive enrichment at an IA, that is, at an early timepoint nuisance parameters are reestimated and the sample size is adjusted while subgroup selection and enrichment is performed later. We discuss implications of different scenarios concerning the variances as well as the timepoints of blinded review and IA and investigate the design characteristics in simulations. The proposed method maintains the desired power if planning assumptions were inaccurate and reduces the sample size and variability of the final sample size when an enrichment is performed. Having two separate timepoints for blinded sample size review and IA improves the timing of the latter and increases the probability to correctly enrich a subgroup.
Collapse
Affiliation(s)
- Marius Placzek
- Department of Medical Statistics, University Medical Center Göttingen, Göttingen, Germany
| | - Tim Friede
- Department of Medical Statistics, University Medical Center Göttingen, Göttingen, Germany.,DZHK (German Center for Cardiovascular Research), partner site Göttingen, Göttingen, Germany
| |
Collapse
|
18
|
Khan JN, Kimani PK, Glimm E, Stallard N. Adjusting for treatment selection in phase II/III clinical trials with time to event data. Stat Med 2023; 42:146-163. [PMID: 36419206 PMCID: PMC10098876 DOI: 10.1002/sim.9606] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/22/2022] [Revised: 09/25/2022] [Accepted: 11/01/2022] [Indexed: 11/26/2022]
Abstract
Phase II/III clinical trials are efficient two-stage designs that test multiple experimental treatments. In stage 1, patients are allocated to the control and all experimental treatments, with the data collected from them used to select experimental treatments to continue to stage 2. Patients recruited in stage 2 are allocated to the selected treatments and the control. Combined data of stage 1 and stage 2 are used for a confirmatory phase III analysis. Appropriate analysis needs to adjust for selection bias of the stage 1 data. Point estimators exist for normally distributed outcome data. Extending these estimators to time to event data is not straightforward because treatment selection is based on correlated treatment effects and stage 1 patients who do not get events in stage 1 are followed-up in stage 2. We have derived an approximately uniformly minimum variance conditional unbiased estimator (UMVCUE) and compared its biases and mean squared errors to existing bias adjusted estimators. In simulations, one existing bias adjusted estimator has similar properties as the practically unbiased UMVCUE while the others can have noticeable biases but they are less variable than the UMVCUE. For confirmatory phase II/III clinical trials where unbiased estimators are desired, we recommend the UMVCUE or the existing estimator with which it has similar properties.
Collapse
Affiliation(s)
| | - Peter K Kimani
- Warwick Medical School, University of Warwick, Coventry, UK
| | | | - Nigel Stallard
- Warwick Medical School, University of Warwick, Coventry, UK
| |
Collapse
|
19
|
A gated group sequential design for seamless Phase II/III trial with subpopulation selection. BMC Med Res Methodol 2023; 23:2. [PMID: 36597042 PMCID: PMC9809114 DOI: 10.1186/s12874-022-01825-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/15/2022] [Accepted: 12/19/2022] [Indexed: 01/04/2023] Open
Abstract
BACKGROUND Due to the high cost and high failure rate of Phase III trials where a classical group sequential design (GSD) is usually used, seamless Phase II/III designs are more and more popular to improve trial efficiency. A potential attraction of Phase II/III design is to allow a randomized proof-of-concept stage prior to committing to the full cost of a Phase III trial. Population selection during the trial allows a trial to adapt and focus investment where it is most likely to provide patient benefit. Previous methods have been developed for this problem when there is a single primary endpoint and two possible populations. METHODS To find the population that potentially benefits with one or two primary endpoints (e.g., progression free survival (PFS), overall survival (OS)), we propose a gated group sequential design for a seamless Phase II/III trial design with adaptive population selection. RESULTS The investigated design controls the familywise error rate and allows multiple interim analyses to enable early stopping for efficacy or futility. Simulations and an illustrative example suggest that the proposed gated group sequential design has more power and requires less time and resources compared to the group sequential design and adaptive design. CONCLUSIONS Combining the group sequential design and adaptive design, the gated group sequential design has more power and higher efficiency while controlling for the familywise error rate. It has the potential to save drug development cost and more quickly fulfill unmet medical needs.
Collapse
|
20
|
Abstract
Covariate adjustment via a regression approach is known to increase the precision of statistical inference when fixed trial designs are employed in randomized controlled studies. When an adaptive multi-arm design is employed with the ability to select treatments, it is unclear how covariate adjustment affects various aspects of the study. Consider the design framework that relies on pre-specified treatment selection rule(s) and a combination test approach for hypothesis testing. It is our primary goal to evaluate the impact of covariate adjustment on adaptive multi-arm designs with treatment selection. Our secondary goal is to show how the Uniformly Minimum Variance Conditionally Unbiased Estimator can be extended to account for covariate adjustment analytically. We find that adjustment with different sets of covariates can lead to different treatment selection outcomes and hence probabilities of rejecting hypotheses. Nevertheless, we do not see any negative impact on the control of the familywise error rate when covariates are included in the analysis model. When adjusting for covariates that are moderately or highly correlated with the outcome, we see various benefits to the analysis of the design. Conversely, there is negligible impact when including covariates that are uncorrelated with the outcome. Overall, pre-specification of covariate adjustment is recommended for the analysis of adaptive multi-arm design with treatment selection. Having the statistical analysis plan in place prior to the interim and final analyses is crucial, especially when a non-collapsible measure of treatment effect is considered in the trial.
Collapse
Affiliation(s)
- Kim May Lee
- Institute of Psychiatry, Psychology and Neuroscience, King’s College
London, London, UK
| | | | - Thomas Jaki
- MRC Biostatistics Unit, University of Cambridge, Cambridge, UK
| | | |
Collapse
|
21
|
Takahashi K, Ishii R, Maruo K, Gosho M. Statistical tests for two-stage adaptive seamless design using short- and long-term binary outcomes. Stat Med 2022; 41:4130-4142. [PMID: 35713225 DOI: 10.1002/sim.9500] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/26/2021] [Revised: 04/20/2022] [Accepted: 05/30/2022] [Indexed: 11/09/2022]
Abstract
The adaptive seamless design combining phases II and III into a single trial has been shown growing interest for improving the efficiency of drug development, becoming the most frequent adaptive design type. It typically consists of two stages, the trial objectives being often different in each stage. The primary objectives are to select optimal experimental treatment group(s) in the first stage and compare the efficacy between the selected treatment and control groups in the second stage. In this article, we focus on a two-stage adaptive seamless design, for which treatment selection is based on the short-term binary endpoint and treatment comparison is based on the long-term binary endpoint. We thus propose an exact conditional test as a final analysis, based on the bivariate binomial distribution and given the selected treatment with the most promising short-term endpoint response rate from an interim analysis. Additionally, the mid- p $$ p $$ approach is incorporated to improve conservativeness for an exact test. Simulation studies were conducted to compare the proposed methods with a method based on the combination test. The proposed exact method controlled for type I error rate at the nominal level, regardless of the number of initial treatments or the correlation between short- and long-term endpoints. In terms of the treatment comparison power, the proposed methods are more powerful than that based on the combination test in the scenarios, with only one treatment being effective.
Collapse
Affiliation(s)
- Kenichi Takahashi
- Japan Development, MSD K. K., Tokyo, Japan.,Graduate School of Comprehensive Human Sciences, University of Tsukuba, Tsukuba, Japan
| | - Ryota Ishii
- Department of Biostatistics, Faculty of Medicine, University of Tsukuba, Tsukuba, Japan
| | - Kazushi Maruo
- Department of Biostatistics, Faculty of Medicine, University of Tsukuba, Tsukuba, Japan
| | - Masahiko Gosho
- Department of Biostatistics, Faculty of Medicine, University of Tsukuba, Tsukuba, Japan
| |
Collapse
|
22
|
McMillan G, Mayer C, Tang R, Liu Y, LaVange L, Antonijevic Z, Beckman RA. Planning for the Next Pandemic: Ethics and Innovation Today for Improved Clinical Trials Tomorrow. Stat Biopharm Res 2021; 14:22-27. [PMID: 37006380 PMCID: PMC10061983 DOI: 10.1080/19466315.2021.1918236] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/13/2020] [Revised: 03/22/2021] [Accepted: 04/12/2021] [Indexed: 01/05/2023]
Abstract
The coronavirus pandemic has brought public attention to the steps required to produce valid scientific clinical research in drug development. Traditional ethical principles that guide clinical research remain the guiding compass for physicians, patients, public health officials, investigators, drug developers and the public. Accelerating the process of delivering safe and effective treatments and vaccines against COVID-19 is a moral imperative. The apparent clash between the regulated system of phased randomized clinical trials and urgent public health need requires leveraging innovation with ethical scientific rigor. We reflect on the Belmont principles of autonomy, beneficence and justice as the pandemic unfolds, and illustrate the role of innovative clinical trial designs in alleviating pandemic challenges. Our discussion highlights selected types of innovative trial design and correlates them with ethical parameters and public health benefits. Details are provided for platform trials and other innovative designs such as basket and umbrella trials, designs leveraging external data sources, multi-stage seamless trials, preplanned control arm data sharing between larger trials, and higher order systems of linked trials coordinated more broadly between individual trials and phases of development, recently introduced conceptually as "PIPELINEs."
Collapse
Affiliation(s)
- Gianna McMillan
- Bioethics Institute, Loyola Marymount University, Los Angeles, CA
| | | | - Rui Tang
- Servier Pharmaceuticals, Boston, MA
| | - Yi Liu
- Nektar Therapeutics, Data Science and Systems, San Francisco, CA
| | - Lisa LaVange
- Department of Biostatistics, University of North Carolina, Chapel Hill, NC
| | | | - Robert A. Beckman
- Departments of Oncology and of Biostatistics, Bioinformatics, and Biomathematics, Lombardi Comprehensive Cancer Center and Innovation Center for Biomedical Informatics, Georgetown University Medical Center, Washington, DC
| |
Collapse
|
23
|
Burnett T, Jennison C. Adaptive enrichment trials: What are the benefits? Stat Med 2020; 40:690-711. [PMID: 33244786 PMCID: PMC7839594 DOI: 10.1002/sim.8797] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/05/2020] [Revised: 10/13/2020] [Accepted: 10/14/2020] [Indexed: 11/10/2022]
Abstract
When planning a Phase III clinical trial, suppose a certain subset of patients is expected to respond particularly well to the new treatment. Adaptive enrichment designs make use of interim data in selecting the target population for the remainder of the trial, either continuing with the full population or restricting recruitment to the subset of patients. We define a multiple testing procedure that maintains strong control of the familywise error rate, while allowing for the adaptive sampling procedure. We derive the Bayes optimal rule for deciding whether or not to restrict recruitment to the subset after the interim analysis and present an efficient algorithm to facilitate simulation-based optimisation, enabling the construction of Bayes optimal rules in a wide variety of problem formulations. We compare adaptive enrichment designs with traditional nonadaptive designs in a broad range of examples and draw clear conclusions about the potential benefits of adaptive enrichment.
Collapse
Affiliation(s)
- Thomas Burnett
- Department of Mathematics and Statistics, Lancaster University, Lancaster, UK
| | | |
Collapse
|
24
|
Heath A, Yaskina M, Pechlivanoglou P, Rios D, Offringa M, Klassen TP, Poonai N, Pullenayegum E. A Bayesian response-adaptive dose-finding and comparative effectiveness trial. Clin Trials 2020; 18:61-70. [PMID: 33231105 DOI: 10.1177/1740774520965173] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/03/2023]
Abstract
BACKGROUND/AIMS Combinations of treatments that have already received regulatory approval can offer additional benefit over Each of the treatments individually. However, trials of these combinations are lower priority than those that develop novel therapies, which can restrict funding, timelines and patient availability. This article develops a novel trial design to facilitate the evaluation of New combination therapies. This trial design combines elements of phase II and phase III trials to reduce the burden of evaluating combination therapies, while also maintaining a feasible sample size. This design was developed for a randomised trial that compares the properties of three combination doses of ketamine and dexmedetomidine, given intranasally, to ketamine delivered intravenously for children undergoing a closed reduction for a fracture or dislocation. METHODS This trial design uses response-adaptive randomisation to evaluate different dose combinations and increase the information collected for successful novel drug combinations. The design then uses Bayesian dose-response modelling to undertake a comparative effectiveness analysis for the most successful dose combination against a relevant comparator. We used simulation methods determine the thresholds for adapting the trial and making conclusions. We also used simulations to evaluate the probability of selecting the dose combination with the highest true effectiveness the operating characteristics of the design and its Bayesian predictive power. RESULTS With 410 participants, five interim updates of the randomisation ratio and a probability of effectiveness of 0.93, 0.88 and 0.83 for the three dose combinations, we have an 83% chance of randomising the largest number of patients to the drug with the highest probability of effectiveness. Based on this adaptive randomisation procedure, the comparative effectiveness analysis has a type I error of less than 5% and a 93% chance of correcting concluding non-inferiority, when the probability of effectiveness for the optimal combination therapy is 0.9. In this case, the trial has a greater than 77% chance of meeting its dual aims of dose-finding and comparative effectiveness. Finally, the Bayesian predictive power of the trial is over 90%. CONCLUSIONS By simultaneously determining the optimal dose and collecting data on the relative effectiveness of an intervention, we can minimise administrative burden and recruitment time for a trial. This will minimise the time required to get effective, safe combination therapies to patients quickly. The proposed trial has high potential to meet the dual study objectives within a feasible overall sample size.
Collapse
Affiliation(s)
- Anna Heath
- Child Health Evaluative Sciences, Peter Gilgan Centre for Research and Learning, The Hospital for Sick Children, Toronto, ON, Canada.,Division of Biostatistics, University of Toronto, Toronto, ON, Canada.,Department of Statistical Science, University College London, London, United Kingdom
| | - Maryna Yaskina
- Women & Children's Health Research Institute, University of Alberta, Edmonton, AB, Canada
| | - Petros Pechlivanoglou
- Child Health Evaluative Sciences, Peter Gilgan Centre for Research and Learning, The Hospital for Sick Children, Toronto, ON, Canada.,Institute of Health Policy, Management and Evaluation, University of Toronto, Toronto, ON, Canada
| | - David Rios
- Child Health Evaluative Sciences, Peter Gilgan Centre for Research and Learning, The Hospital for Sick Children, Toronto, ON, Canada
| | - Martin Offringa
- Child Health Evaluative Sciences, Peter Gilgan Centre for Research and Learning, The Hospital for Sick Children, Toronto, ON, Canada.,Institute of Health Policy, Management and Evaluation, University of Toronto, Toronto, ON, Canada
| | - Terry P Klassen
- University of Manitoba, Winnipeg, MB, Canada.,Children's Hospital Research Institute of Manitoba, Winnipeg, MB, Canada
| | - Naveen Poonai
- Schulich School of Medicine and Dentistry, London, ON, Canada.,Children's Health Research Institute, London Health Sciences Centre, London, ON, Canada
| | - Eleanor Pullenayegum
- Child Health Evaluative Sciences, Peter Gilgan Centre for Research and Learning, The Hospital for Sick Children, Toronto, ON, Canada.,Division of Biostatistics, University of Toronto, Toronto, ON, Canada
| |
Collapse
|
25
|
Burnett T, Mozgunov P, Pallmann P, Villar SS, Wheeler GM, Jaki T. Adding flexibility to clinical trial designs: an example-based guide to the practical use of adaptive designs. BMC Med 2020; 18:352. [PMID: 33208155 PMCID: PMC7677786 DOI: 10.1186/s12916-020-01808-2] [Citation(s) in RCA: 32] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/29/2020] [Accepted: 10/07/2020] [Indexed: 12/18/2022] Open
Abstract
Adaptive designs for clinical trials permit alterations to a study in response to accumulating data in order to make trials more flexible, ethical, and efficient. These benefits are achieved while preserving the integrity and validity of the trial, through the pre-specification and proper adjustment for the possible alterations during the course of the trial. Despite much research in the statistical literature highlighting the potential advantages of adaptive designs over traditional fixed designs, the uptake of such methods in clinical research has been slow. One major reason for this is that different adaptations to trial designs, as well as their advantages and limitations, remain unfamiliar to large parts of the clinical community. The aim of this paper is to clarify where adaptive designs can be used to address specific questions of scientific interest; we introduce the main features of adaptive designs and commonly used terminology, highlighting their utility and pitfalls, and illustrate their use through case studies of adaptive trials ranging from early-phase dose escalation to confirmatory phase III studies.
Collapse
Affiliation(s)
- Thomas Burnett
- Department of Mathematics and Statistics, Lancaster University, Fylde College, Lancaster, LA1 4YF UK
| | - Pavel Mozgunov
- Department of Mathematics and Statistics, Lancaster University, Fylde College, Lancaster, LA1 4YF UK
| | - Philip Pallmann
- Centre for Trials Research, College of Biomedical & Life Sciences, Cardiff University, Cardiff, UK
| | - Sofia S. Villar
- MRC Biostatistics Unit, University of Cambridge School of Clinical Medicine, Cambridge Institute of Public Health, Forvie Site, Robinson Way, Cambridge Biomedical Campus, Cambridge, CB2 0SR UK
| | - Graham M. Wheeler
- Cancer Research UK & UCL Cancer Trials Centre, University College London, 90 Tottenham Court Road, London, W1T 4TJ UK
| | - Thomas Jaki
- Department of Mathematics and Statistics, Lancaster University, Fylde College, Lancaster, LA1 4YF UK
- MRC Biostatistics Unit, University of Cambridge School of Clinical Medicine, Cambridge Institute of Public Health, Forvie Site, Robinson Way, Cambridge Biomedical Campus, Cambridge, CB2 0SR UK
| |
Collapse
|
26
|
Quan H, Luo X, Zhou T, Zhao PL. Seamless phase II/III/IIIb clinical trial designs with different endpoints for different phases. COMMUN STAT-THEOR M 2020. [DOI: 10.1080/03610926.2019.1618871] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/26/2022]
Affiliation(s)
- Hui Quan
- Biostatistics and Programming, Sanofi, 55C-335A, Bridgewater, New Jersey, USA
| | - Xiaodong Luo
- Biostatistics and Programming, Sanofi, 55C-335A, Bridgewater, New Jersey, USA
| | - Tianyue Zhou
- Biostatistics and Programming, Sanofi, 55C-335A, Bridgewater, New Jersey, USA
| | - Peng-Liang Zhao
- Biostatistics and Programming, Sanofi, 55C-335A, Bridgewater, New Jersey, USA
| |
Collapse
|
27
|
Mütze T, Friede T. Data monitoring committees for clinical trials evaluating treatments of COVID-19. Contemp Clin Trials 2020; 98:106154. [PMID: 32961361 PMCID: PMC7833551 DOI: 10.1016/j.cct.2020.106154] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/13/2020] [Accepted: 09/15/2020] [Indexed: 12/15/2022]
Abstract
The first cases of coronavirus disease 2019 (COVID-19) were reported in December 2019 and the outbreak of SARS-CoV-2 was declared a pandemic in March 2020 by the World Health Organization. This sparked a plethora of investigations into diagnostics and vaccination for SARS-CoV-2, as well as treatments for COVID-19. Since COVID-19 is a severe disease associated with a high mortality, clinical trials in this disease should be monitored by a data monitoring committee (DMC), also known as data safety monitoring board (DSMB). DMCs in this indication face a number of challenges including fast recruitment requiring an unusually high frequency of safety reviews, more frequent use of complex designs and virtually no prior experience with the disease. In this paper, we provide a perspective on the work of DMCs for clinical trials of treatments for COVID-19. More specifically, we discuss organizational aspects of setting up and running DMCs for COVID-19 trials, in particular for trials with more complex designs such as platform trials or adaptive designs. Furthermore, statistical aspects of monitoring clinical trials of treatments for COVID-19 are considered. Some recommendations are made regarding the presentation of the data, stopping rules for safety monitoring and the use of external data. The proposed stopping boundaries are assessed in a simulation study motivated by clinical trials in COVID-19.
Collapse
Affiliation(s)
- Tobias Mütze
- Statistical Methodology, Novartis Pharma AG, Basel, Switzerland
| | - Tim Friede
- Department of Medical Statistics, University Medical Center Göttingen, Göttingen, Germany; DZHK (German Center for Cardiovascular Research), partner site Göttingen, Göttingen, Germany.
| |
Collapse
|
28
|
A potential for seamless designs in diagnostic research could be identified. J Clin Epidemiol 2020; 129:51-59. [PMID: 32991994 DOI: 10.1016/j.jclinepi.2020.09.019] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/29/2020] [Revised: 08/26/2020] [Accepted: 09/23/2020] [Indexed: 11/23/2022]
Abstract
BACKGROUND AND OBJECTIVE New diagnostic tests to identify a well-established disease state must undergo a series of scientific studies from test construction to finally demonstrating a societal impact. Traditionally, these studies are performed with substantial time gaps in between, resulting in a long time period from the initial idea to roll out in clinical practice including reimbursement. Seamless designs allowing us to combine a sequence of studies in one protocol may hence accelerate this process. Currently, a systematic investigation of the potential of seamless designs in diagnostic research is lacking. METHODS We identify major study types in diagnostic research and their basic characteristics with respect to the application of seamless designs. This information is used to identify major hurdles and opportunities for seamless designs. RESULTS The following major study types were identified: Variable construction studies, cut point finding studies, variable value studies, single-arm accuracy studies, comparative accuracy studies, change-in-management studies, observational discordant pair studies, randomized discordant pair studies, and randomized diagnostic studies. The following characteristics were identified: Type of recruitment (case-control vs. population-based), application of a reference standard, inclusion of a comparator, paired or unpaired application of a comparator, assessment of patient-relevant outcomes, and possibility for blinding of test results. Two basic hurdles could be identified: 1) Accuracy studies are hard to combine with postaccuracy studies in a seamless design for the following reasons. First, because the former are required to justify the latter and application of a reference test in outcome studies may be a threat to the integrity of the study. 2) Randomized diagnostic studies are probably best placed as singular studies at the end of the process, as all other questions should be clarified before performing such a study. However, otherwise there is a substantial potential for seamless designs. All steps from the construction to the comparison with the comparator can be combined in one protocol. This may include a switch from case-control to population-based recruitment as well as a switch from a single-arm study to a comparative accuracy study. In addition, change-in-management studies can be combined with an outcome study in discordant pairs. CONCLUSION There is a potential for seamless designs in diagnostic research. It is wise to have the whole sequence of necessary studies in mind and to plan a full programme than rather individual studies one by one.
Collapse
|
29
|
Kunz CU, Jörgens S, Bretz F, Stallard N, Van Lancker K, Xi D, Zohar S, Gerlinger C, Friede T. Clinical Trials Impacted by the COVID-19 Pandemic: Adaptive Designs to the Rescue? Stat Biopharm Res 2020; 12:461-477. [PMID: 34191979 PMCID: PMC8011492 DOI: 10.1080/19466315.2020.1799857] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/22/2020] [Revised: 07/17/2020] [Accepted: 07/18/2020] [Indexed: 01/09/2023]
Abstract
Very recently the new pathogen severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) was identified and the coronavirus disease 2019 (COVID-19) declared a pandemic by the World Health Organization. The pandemic has a number of consequences for ongoing clinical trials in non-COVID-19 conditions. Motivated by four current clinical trials in a variety of disease areas we illustrate the challenges faced by the pandemic and sketch out possible solutions including adaptive designs. Guidance is provided on (i) where blinded adaptations can help; (ii) how to achieve Type I error rate control, if required; (iii) how to deal with potential treatment effect heterogeneity; (iv) how to use early read-outs; and (v) how to use Bayesian techniques. In more detail approaches to resizing a trial affected by the pandemic are developed including considerations to stop a trial early, the use of group-sequential designs or sample size adjustment. All methods considered are implemented in a freely available R shiny app. Furthermore, regulatory and operational issues including the role of data monitoring committees are discussed.
Collapse
Affiliation(s)
| | | | - Frank Bretz
- Novartis Pharma AG, Basel, Switzerland
- Section for Medical Statistics, Medical University of Vienna, Vienna, Austria
| | - Nigel Stallard
- Division of Health Sciences, Warwick Medical School, The University of Warwick, Coventry, UK
| | - Kelly Van Lancker
- Department of Applied Mathematics, Computer Science and Statistics, Ghent University, Ghent, Belgium
| | - Dong Xi
- Novartis Pharmaceuticals, East Hanover, NJ
| | - Sarah Zohar
- INSERM, Centre de Recherche des Cordeliers, Sorbonne Université, Université de Paris, Paris, France
| | - Christoph Gerlinger
- Statistics and Data Insights, Bayer AG, Berlin, Germany
- Department of Gynecology, Obstetrics and Reproductive Medicine, University Medical School of Saarland, Homburg/Saar, Germany
| | - Tim Friede
- Department of Medical Statistics, University Medical Center Göttingen, Göttingen, Germany
- DZHK (German Center for Cardiovascular Research), Partner Site Göttingen, Göttingen, Germany
| |
Collapse
|
30
|
Li Q, Lin J, Lin Y. Adaptive design implementation in confirmatory trials: methods, practical considerations and case studies. Contemp Clin Trials 2020; 98:106096. [PMID: 32739496 DOI: 10.1016/j.cct.2020.106096] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/24/2020] [Revised: 07/13/2020] [Accepted: 07/27/2020] [Indexed: 10/23/2022]
Abstract
The rapidly changing drug development landscapes have brought unique challenges to sponsors in designing clinical trials in a faster and more efficient way. With the ability to accelerate development timeline, reduce redundant sample size, and select the right dose and patient population during the clinical trial, adaptive designs help to increase the probability of success of clinical trials and eventually contribute to bringing the promising drugs to patients earlier and fulfilling their unmet medical needs. Although extensive adaptive design methods have been proposed in recent years, a comprehensive review of how to implement adaptive design in the practical confirmatory trials is still lacking. In this paper, we will review the evolving history of adaptive designs, updates of newly released regulatory guidance and emerging practical adaptive designs, including but not limited to sample size re-estimation, seamless design and surrogate endpoint used in the interim analysis. Furthermore, we will discuss the current practice of adaptive design implementation by demonstrating a complex oncology seamless phase 2/3 adaptive design case study. Through this example, we will introduce the critical roles of each cross disciplinary function, communication process and important documents when adaptive designs are implemented in real-world setting.
Collapse
Affiliation(s)
- Qing Li
- Takeda Pharmaceuticals, 300 Massachusetts Ave, Cambridge, MA 02139, United States of America.
| | - Jianchang Lin
- Takeda Pharmaceuticals, 300 Massachusetts Ave, Cambridge, MA 02139, United States of America
| | - Yunzhi Lin
- Sanofi, 50 Binney Street, Cambridge, MA 02142, United States of America
| |
Collapse
|
31
|
Dimairo M, Pallmann P, Wason J, Todd S, Jaki T, Julious SA, Mander AP, Weir CJ, Koenig F, Walton MK, Nicholl JP, Coates E, Biggs K, Hamasaki T, Proschan MA, Scott JA, Ando Y, Hind D, Altman DG. The adaptive designs CONSORT extension (ACE) statement: a checklist with explanation and elaboration guideline for reporting randomised trials that use an adaptive design. Trials 2020; 21:528. [PMID: 32546273 PMCID: PMC7298968 DOI: 10.1186/s13063-020-04334-x] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/11/2022] Open
Abstract
Adaptive designs (ADs) allow pre-planned changes to an ongoing trial without compromising the validity of conclusions and it is essential to distinguish pre-planned from unplanned changes that may also occur. The reporting of ADs in randomised trials is inconsistent and needs improving. Incompletely reported AD randomised trials are difficult to reproduce and are hard to interpret and synthesise. This consequently hampers their ability to inform practice as well as future research and contributes to research waste. Better transparency and adequate reporting will enable the potential benefits of ADs to be realised.This extension to the Consolidated Standards Of Reporting Trials (CONSORT) 2010 statement was developed to enhance the reporting of randomised AD clinical trials. We developed an Adaptive designs CONSORT Extension (ACE) guideline through a two-stage Delphi process with input from multidisciplinary key stakeholders in clinical trials research in the public and private sectors from 21 countries, followed by a consensus meeting. Members of the CONSORT Group were involved during the development process.The paper presents the ACE checklists for AD randomised trial reports and abstracts, as well as an explanation with examples to aid the application of the guideline. The ACE checklist comprises seven new items, nine modified items, six unchanged items for which additional explanatory text clarifies further considerations for ADs, and 20 unchanged items not requiring further explanatory text. The ACE abstract checklist has one new item, one modified item, one unchanged item with additional explanatory text for ADs, and 15 unchanged items not requiring further explanatory text.The intention is to enhance transparency and improve reporting of AD randomised trials to improve the interpretability of their results and reproducibility of their methods, results and inference. We also hope indirectly to facilitate the much-needed knowledge transfer of innovative trial designs to maximise their potential benefits. In order to encourage its wide dissemination this article is freely accessible on the BMJ and Trials journal websites."To maximise the benefit to society, you need to not just do research but do it well" Douglas G Altman.
Collapse
Affiliation(s)
- Munyaradzi Dimairo
- School of Health and Related Research, University of Sheffield, Sheffield, S1 4DA, UK.
| | | | - James Wason
- MRC Biostatistics Unit, University of Cambridge, Cambridge, UK
- Institute of Health and Society, Newcastle University, Newcastle, UK
| | - Susan Todd
- Department of Mathematics and Statistics, University of Reading, Reading, UK
| | - Thomas Jaki
- Department of Mathematics and Statistics, Lancaster University, Lancaster, UK
| | - Steven A Julious
- School of Health and Related Research, University of Sheffield, Sheffield, S1 4DA, UK
| | - Adrian P Mander
- Centre for Trials Research, Cardiff University, Cardiff, UK
- MRC Biostatistics Unit, University of Cambridge, Cambridge, UK
| | - Christopher J Weir
- Edinburgh Clinical Trials Unit, Usher Institute, University of Edinburgh, Edinburgh, UK
| | - Franz Koenig
- Centre for Medical Statistics, Informatics, and Intelligent Systems, Medical University of Vienna, Vienna, Austria
| | - Marc K Walton
- Janssen Pharmaceuticals, Titusville, New Jersey, USA
| | - Jon P Nicholl
- School of Health and Related Research, University of Sheffield, Sheffield, S1 4DA, UK
| | - Elizabeth Coates
- School of Health and Related Research, University of Sheffield, Sheffield, S1 4DA, UK
| | - Katie Biggs
- School of Health and Related Research, University of Sheffield, Sheffield, S1 4DA, UK
| | | | - Michael A Proschan
- National Institute of Allergy and Infectious Diseases, National Institutes of Health, Bethesda, USA
| | - John A Scott
- Division of Biostatistics in the Center for Biologics Evaluation and Research, Food and Drug Administration, Rockville, USA
| | - Yuki Ando
- Pharmaceuticals and Medical Devices Agency, Tokyo, Japan
| | - Daniel Hind
- School of Health and Related Research, University of Sheffield, Sheffield, S1 4DA, UK
| | - Douglas G Altman
- Centre for Statistics in Medicine, University of Oxford, Oxford, UK
| |
Collapse
|
32
|
Dimairo M, Pallmann P, Wason J, Todd S, Jaki T, Julious SA, Mander AP, Weir CJ, Koenig F, Walton MK, Nicholl JP, Coates E, Biggs K, Hamasaki T, Proschan MA, Scott JA, Ando Y, Hind D, Altman DG. The Adaptive designs CONSORT Extension (ACE) statement: a checklist with explanation and elaboration guideline for reporting randomised trials that use an adaptive design. BMJ 2020; 369:m115. [PMID: 32554564 PMCID: PMC7298567 DOI: 10.1136/bmj.m115] [Citation(s) in RCA: 55] [Impact Index Per Article: 13.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Accepted: 11/19/2019] [Indexed: 12/11/2022]
Abstract
Adaptive designs (ADs) allow pre-planned changes to an ongoing trial without compromising the validity of conclusions and it is essential to distinguish pre-planned from unplanned changes that may also occur. The reporting of ADs in randomised trials is inconsistent and needs improving. Incompletely reported AD randomised trials are difficult to reproduce and are hard to interpret and synthesise. This consequently hampers their ability to inform practice as well as future research and contributes to research waste. Better transparency and adequate reporting will enable the potential benefits of ADs to be realised.This extension to the Consolidated Standards Of Reporting Trials (CONSORT) 2010 statement was developed to enhance the reporting of randomised AD clinical trials. We developed an Adaptive designs CONSORT Extension (ACE) guideline through a two-stage Delphi process with input from multidisciplinary key stakeholders in clinical trials research in the public and private sectors from 21 countries, followed by a consensus meeting. Members of the CONSORT Group were involved during the development process.The paper presents the ACE checklists for AD randomised trial reports and abstracts, as well as an explanation with examples to aid the application of the guideline. The ACE checklist comprises seven new items, nine modified items, six unchanged items for which additional explanatory text clarifies further considerations for ADs, and 20 unchanged items not requiring further explanatory text. The ACE abstract checklist has one new item, one modified item, one unchanged item with additional explanatory text for ADs, and 15 unchanged items not requiring further explanatory text.The intention is to enhance transparency and improve reporting of AD randomised trials to improve the interpretability of their results and reproducibility of their methods, results and inference. We also hope indirectly to facilitate the much-needed knowledge transfer of innovative trial designs to maximise their potential benefits.
Collapse
Affiliation(s)
- Munyaradzi Dimairo
- School of Health and Related Research, University of Sheffield, Sheffield S1 4DA, UK
| | | | - James Wason
- MRC Biostatistics Unit, University of Cambridge, UK
- Institute of Health and Society, Newcastle University, UK
| | - Susan Todd
- Department of Mathematics and Statistics, University of Reading, UK
| | - Thomas Jaki
- Department of Mathematics and Statistics, Lancaster University, UK
| | - Steven A Julious
- School of Health and Related Research, University of Sheffield, Sheffield S1 4DA, UK
| | - Adrian P Mander
- Centre for Trials Research, Cardiff University, UK
- MRC Biostatistics Unit, University of Cambridge, UK
| | - Christopher J Weir
- Edinburgh Clinical Trials Unit, Usher Institute, University of Edinburgh, UK
| | - Franz Koenig
- Centre for Medical Statistics, Informatics, and Intelligent Systems, Medical University of Vienna, Austria
| | | | - Jon P Nicholl
- School of Health and Related Research, University of Sheffield, Sheffield S1 4DA, UK
| | - Elizabeth Coates
- School of Health and Related Research, University of Sheffield, Sheffield S1 4DA, UK
| | - Katie Biggs
- School of Health and Related Research, University of Sheffield, Sheffield S1 4DA, UK
| | | | - Michael A Proschan
- National Institute of Allergy and Infectious Diseases, National Institutes of Health, USA
| | - John A Scott
- Division of Biostatistics in the Center for Biologics Evaluation and Research, Food and Drug Administration, USA
| | - Yuki Ando
- Pharmaceuticals and Medical Devices Agency, Japan
| | - Daniel Hind
- School of Health and Related Research, University of Sheffield, Sheffield S1 4DA, UK
| | | |
Collapse
|
33
|
Chen X, Hartford A, Zhao J. A model-based approach for simulating adaptive clinical studies with surrogate endpoints used for interim decision-making. Contemp Clin Trials Commun 2020; 18:100562. [PMID: 32395663 PMCID: PMC7205753 DOI: 10.1016/j.conctc.2020.100562] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/03/2020] [Revised: 03/15/2020] [Accepted: 03/28/2020] [Indexed: 11/28/2022] Open
Abstract
In clinical trials, when exploring multiple dose groups to establish efficacy and safety on one or more selected doses, adaptive designs with interim dose selection are often used for dropping less effective dose groups. When it takes a long time to observe primary outcomes, utilizing information on a surrogate endpoint available at an earlier interim may be preferred for selecting which dose to continue. We propose a Bayesian model-based approach where historical data can be leveraged to incorporate a correlation model for investigating the design's operating characteristics. Simulation studies were conducted and the method can be readily applied for power and sample size calculations.
Collapse
Affiliation(s)
- Xiaotian Chen
- Data and Statistical Sciences, AbbVie Inc, North Chicago, IL, United States
| | - Alan Hartford
- Statistical and Quantitative Sciences, Takeda Pharmaceuticals Inc, Cambridge, MA, United States
| | - Jun Zhao
- Data Science, Astellas Pharma Global Development, Northbrook, IL, United States
| |
Collapse
|
34
|
Spivack J, Cheng B, Levin B. Adding dose modifications into Phase II and Phase II/III seamless trials. Stat Methods Med Res 2020; 29:1315-1324. [PMID: 31267845 DOI: 10.1177/0962280219859387] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
We present a technique for adding dose modifications into seamless Phase II and Phase II/III trials featuring dose selection at an interim analysis. The method is convenient to apply and can be used either in a fully prespecified, structured way or as a response to new considerations that emerge at interim. Strong control of the familywise error rate regarding false declarations of efficacy versus control is maintained. Two examples are given. One illustrates how the method could potentially "save" a trial performed in a Phase II context. The other is a seamless Phase II/III trial that uses an adaptive exploration strategy for an assumed nonmonotonic dose-response curve. It can result in greatly improved efficiency over a standard "promote the winner" rule.
Collapse
Affiliation(s)
- John Spivack
- Department of Environmental Medicine and Public Health, Mount Sinai Medical Center, New York, NY, USA
| | - Bin Cheng
- Department of Biostatistics, Columbia University, New York, NY, USA
| | - Bruce Levin
- Department of Biostatistics, Columbia University, New York, NY, USA
| |
Collapse
|
35
|
Teng Z, Tian Y, Liu Y, Liu G. Seamless phase 2/3 oncology trial design with flexible sample size determination. Stat Med 2020; 39:2373-2386. [PMID: 32338410 DOI: 10.1002/sim.8543] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/20/2019] [Revised: 02/19/2020] [Accepted: 03/13/2020] [Indexed: 11/06/2022]
Abstract
Conventional seamless phase 2/3 design with fixed sample size determination (SSD) has gained its popularity in oncology drug development due to attractive features such as significantly shortening the development timeline, minimizing sample size, as well as early decision making. However, this design is not immune to inaccurate treatment effect assumption when only limited efficacy data are available at study design stage. We propose an innovative seamless phase 2/3 study design with flexible SSD for oncology trials, in which the trial is designed under a distribution of treatment effect instead of one single assumption due to huge uncertainty of treatment effect at design stage and the sample size for end of phase 3 analysis is not predetermined at design stage, but rather dynamically determined based on observed treatment effect at phase 2 portion. Some practical sample size determination rules for end of phase 3 analysis will be discussed. The proposed design can lead to reduced sample size or/and improved power compared with conventional seamless phase 2/3 design with fixed SSD. This innovative study design can be especially useful for programs with aggressive development strategy to expedite the process in delivering efficacious treatment to patients.
Collapse
Affiliation(s)
| | - Yuan Tian
- Department of Statistics, North Carolina State University, Raleigh, North Carolina, USA
| | - Yi Liu
- Nektar Therapeutics, San Francisco, California, USA
| | - Guohui Liu
- Takeda Pharmaceuticals Inc., Cambridge, Massachusetts, USA
| |
Collapse
|
36
|
Rosenblum M, Fang EX, Liu H. Optimal, two-stage, adaptive enrichment designs for randomized trials, using sparse linear programming. J R Stat Soc Series B Stat Methodol 2020. [DOI: 10.1111/rssb.12366] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/27/2022]
Affiliation(s)
| | | | - Han Liu
- Northwestern University; Evanston USA
| |
Collapse
|
37
|
Friede T, Stallard N, Parsons N. Adaptive seamless clinical trials using early outcomes for treatment or subgroup selection: Methods, simulation model and their implementation in R. Biom J 2020; 62:1264-1283. [PMID: 32118317 PMCID: PMC8614126 DOI: 10.1002/bimj.201900020] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/12/2019] [Revised: 01/10/2020] [Accepted: 01/12/2020] [Indexed: 11/12/2022]
Abstract
Adaptive seamless designs combine confirmatory testing, a domain of phase III trials, with features such as treatment or subgroup selection, typically associated with phase II trials. They promise to increase the efficiency of development programmes of new drugs, for example, in terms of sample size and/or development time. It is well acknowledged that adaptive designs are more involved from a logistical perspective and require more upfront planning, often in the form of extensive simulation studies, than conventional approaches. Here, we present a framework for adaptive treatment and subgroup selection using the same notation, which links the somewhat disparate literature on treatment selection on one side and on subgroup selection on the other. Furthermore, we introduce a flexible and efficient simulation model that serves both designs. As primary endpoints often take a long time to observe, interim analyses are frequently informed by early outcomes. Therefore, all methods presented accommodate interim analyses informed by either the primary outcome or an early outcome. The R package asd, previously developed to simulate designs with treatment selection, was extended to include subgroup selection (so‐called adaptive enrichment designs). Here, we describe the functionality of the R package asd and use it to present some worked‐up examples motivated by clinical trials in chronic obstructive pulmonary disease and oncology. The examples both illustrate various features of the R package and provide insights into the operating characteristics of adaptive seamless studies.
Collapse
Affiliation(s)
- Tim Friede
- Department of Medical StatisticsUniversity Medical Center GöttingenGöttingen Germany
| | - Nigel Stallard
- Division of Health SciencesWarwick Medical SchoolUniversity of WarwickCoventry UK
| | - Nicholas Parsons
- Division of Health SciencesWarwick Medical SchoolUniversity of WarwickCoventry UK
| |
Collapse
|
38
|
Zapf A, Stark M, Gerke O, Ehret C, Benda N, Bossuyt P, Deeks J, Reitsma J, Alonzo T, Friede T. Adaptive trial designs in diagnostic accuracy research. Stat Med 2019; 39:591-601. [PMID: 31773788 DOI: 10.1002/sim.8430] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/10/2019] [Revised: 10/23/2019] [Accepted: 10/26/2019] [Indexed: 11/10/2022]
Abstract
The aim of diagnostic accuracy studies is to evaluate how accurately a diagnostic test can distinguish diseased from nondiseased individuals. Depending on the research question, different study designs and accuracy measures are appropriate. As the prior knowledge in the planning phase is often very limited, modifications of design aspects such as the sample size during the ongoing trial could increase the efficiency of diagnostic trials. In intervention studies, group sequential and adaptive designs are well established. Such designs are characterized by preplanned interim analyses, giving the opportunity to stop early for efficacy or futility or to modify elements of the study design. In contrast, in diagnostic accuracy studies, such flexible designs are less common, even if they are as important as for intervention studies. However, diagnostic accuracy studies have specific features, which may require adaptations of the statistical methods or may lead to specific advantages or limitations of sequential and adaptive designs. In this article, we summarize the current status of methodological research and applications of flexible designs in diagnostic accuracy research. Furthermore, we indicate and advocate future development of adaptive design methodology and their use in diagnostic accuracy trials from an interdisciplinary viewpoint. The term "interdisciplinary viewpoint" describes the collaboration of experts of the academic and nonacademic research.
Collapse
Affiliation(s)
- Antonia Zapf
- Department of Medical Biometry and Epidemiology, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| | - Maria Stark
- Department of Medical Biometry and Epidemiology, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| | - Oke Gerke
- Department of Nuclear Medicine, Odense University Hospital, Odense, Denmark
| | | | - Norbert Benda
- Federal Institute for Drugs and Medical Devices (BfArM), Bonn, Germany.,Department of Medical Statistics, University Medical Center Göttingen, Göttingen, Germany
| | - Patrick Bossuyt
- Department of Clinical Epidemiology and Biostatistics, University of Amsterdam, Amsterdam, The Netherlands
| | - Jon Deeks
- Institute of Applied Health Research, University of Birmingham, Birmingham, UK.,NIHR Birmingham Biomedical Research Centre, University Hospitals Birmingham NHS Trust and the University of Birmingham, Birmingham, UK
| | - Johannes Reitsma
- Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht & University Utrecht, Utrecht, The Netherlands
| | - Todd Alonzo
- Keck School of Medicine, University of Southern California, Los Angeles, California
| | - Tim Friede
- Department of Medical Statistics, University Medical Center Göttingen, Göttingen, Germany
| |
Collapse
|
39
|
Narayan VM, Dahm P. The future of clinical trials in urological oncology. Nat Rev Urol 2019; 16:722-733. [PMID: 31605037 DOI: 10.1038/s41585-019-0243-x] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 09/19/2019] [Indexed: 12/11/2022]
Abstract
Well-designed clinical trials in urological oncology help to guide treatment decisions and aid in counselling patients, ultimately serving to improve outcomes. Since the term evidence-based medicine was first used by Gordon Guyatt in 1991, a renewed emphasis on methodology, transparent trial design and study reporting has helped to improve clinical research and in turn, the landscape of medical literature. Novel clinical trial designs (including multi-arm, multistage trials, basket and umbrella studies and research from big data sources, such as electronic health records, administrative claims databases and quality monitoring registries) are well suited to advance innovation in urological oncology. Existing urological clinical trials are often limited by small numbers, are statistically underpowered and many face difficulties with accrual. Thus, efforts to improve trial design are of considerable importance. The development and use of standard outcome sets and adherence to reporting guidelines offer researchers the opportunity to guide value-oriented care, minimize research waste and efficiently identify solutions to the unanswered questions in urology cancer care.
Collapse
Affiliation(s)
- Vikram M Narayan
- Minneapolis VA Medical Center and University of Minnesota Department of Urology, Minneapolis, MN, 55417, USA.,University of Texas MD Anderson Cancer Center, Department of Urology, Houston, TX, 77030, USA
| | - Philipp Dahm
- Minneapolis VA Medical Center and University of Minnesota Department of Urology, Minneapolis, MN, 55417, USA.
| |
Collapse
|
40
|
|
41
|
Barker KL, Newman M, Stallard N, Leal J, Minns Lowe C, Javaid MK, Noufaily A, Adhikari A, Hughes T, Smith DJ, Gandhi V, Cooper C, Lamb SE. Exercise or manual physiotherapy compared with a single session of physiotherapy for osteoporotic vertebral fracture: three-arm PROVE RCT. Health Technol Assess 2019; 23:1-318. [PMID: 31456562 DOI: 10.3310/hta23440] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/21/2022] Open
Abstract
BACKGROUND A total of 25,000 people in the UK have osteoporotic vertebral fracture (OVF). Evidence suggests that physiotherapy may have an important treatment role. OBJECTIVE The objective was to investigate the clinical effectiveness and cost-effectiveness of two different physiotherapy programmes for people with OVF compared with a single physiotherapy session. DESIGN This was a prospective, adaptive, multicentre, assessor-blinded randomised controlled trial (RCT) with nested qualitative and health economic studies. SETTING This trial was based in 21 NHS physiotherapy departments. PARTICIPANTS The participants were people with symptomatic OVF. INTERVENTIONS Seven sessions of either manual outpatient physiotherapy or exercise outpatient physiotherapy compared with the best practice of a 1-hour single session of physiotherapy (SSPT). MAIN OUTCOME MEASURES Outcomes were measured at 4 and 12 months. The primary outcomes were quality of life and muscle endurance, which were measured by the disease-specific QUALEFFO-41 (Quality of Life Questionnaire of the European Foundation for Osteoporosis - 41 items) and timed loaded standing (TLS) test, respectively. Secondary outcomes were (1) thoracic kyphosis angle, (2) balance, evaluated via the functional reach test (FRT), and (3) physical function, assessed via the Short Physical Performance Battery (SPPB), 6-minute walk test (6MWT), Physical Activity Scale for the Elderly, a health resource use and falls diary, and the EuroQol-5 Dimensions, five-level version. RESULTS A total of 615 participants were enrolled, with 216, 203 and 196 randomised by a computer-generated program to exercise therapy, manual therapy and a SSPT, respectively. Baseline data were available for 613 participants, 531 (86.6%) of whom were women; the mean age of these participants was 72.14 years (standard deviation 9.09 years). Primary outcome data were obtained for 69% of participants (429/615) at 12 months: 175 in the exercise therapy arm, 181 in the manual therapy arm and 173 in the SSPT arm. Interim analysis met the criteria for all arms to remain in the study. For the primary outcomes at 12 months, there were no significant benefits over SSPT of exercise [QUALEFFO-41, difference -0.23 points, 95% confidence interval (CI) -3.20 to 1.59 points; p = 1.000; and TLS test, difference 5.77 seconds, 95% CI -4.85 to 20.46 seconds; p = 0.437] or of manual therapy (QUALEFFO-41, difference 1.35 points, 95% CI -1.76 to 2.93 points; p = 0.744; TLS test, difference 9.69 seconds (95% CI 0.09 to 24.86 seconds; p = 0.335). At 4 months, there were significant gains for both manual therapy and exercise therapy over SSPT in the TLS test in participants aged < 70 years. Exercise therapy was superior to a SSPT at 4 months in the SPPB, FRT and 6MWT and manual therapy was superior to a SSPT at 4 months in the TLS test and FRT. Neither manual therapy nor exercise therapy was cost-effective relative to a SSPT using the threshold of £20,000 per quality-adjusted life-year. There were no treatment-related serious adverse events. CONCLUSIONS This is the largest RCT to date assessing physiotherapy in participants with OVFs. At 1 year, neither treatment intervention conferred more benefit than a single 1-hour physiotherapy advice session. The focus of future work should be on the intensity and duration of interventions to determine if changes to these would demonstrate more sustained effects. TRIAL REGISTRATION Current Controlled Trials ISRCTN49117867. FUNDING This project was funded by the National Institute for Health Research (NIHR) Health Technology Assessment programme and will be published in full in Health Technology Assessment; Vol. 23, No. 44. See the NIHR Journals Library website for further project information.
Collapse
Affiliation(s)
- Karen L Barker
- Nuffield Department of Orthopaedics, Rheumatology and Musculoskeletal Sciences, University of Oxford, Oxford, UK.,Physiotherapy Research Unit, Nuffield Orthopaedic Centre, Oxford University Hospitals NHS Foundation Trust, Oxford, UK
| | - Meredith Newman
- Nuffield Department of Orthopaedics, Rheumatology and Musculoskeletal Sciences, University of Oxford, Oxford, UK.,Physiotherapy Research Unit, Nuffield Orthopaedic Centre, Oxford University Hospitals NHS Foundation Trust, Oxford, UK
| | - Nigel Stallard
- Division of Health Sciences, Warwick Medical School, University of Warwick, Coventry, UK
| | - Jose Leal
- Health Economics Research Centre, Nuffield Department of Population Health, University of Oxford, Oxford, UK
| | - Catherine Minns Lowe
- Physiotherapy Research Unit, Nuffield Orthopaedic Centre, Oxford University Hospitals NHS Foundation Trust, Oxford, UK
| | - Muhammad K Javaid
- Nuffield Department of Orthopaedics, Rheumatology and Musculoskeletal Sciences, University of Oxford, Oxford, UK
| | - Angela Noufaily
- Division of Health Sciences, Warwick Medical School, University of Warwick, Coventry, UK
| | - Anish Adhikari
- Health Economics Research Centre, Nuffield Department of Population Health, University of Oxford, Oxford, UK
| | - Tamsin Hughes
- Physiotherapy Research Unit, Nuffield Orthopaedic Centre, Oxford University Hospitals NHS Foundation Trust, Oxford, UK
| | - David J Smith
- Nuffield Department of Orthopaedics, Rheumatology and Musculoskeletal Sciences, University of Oxford, Oxford, UK
| | - Varsha Gandhi
- Nuffield Department of Orthopaedics, Rheumatology and Musculoskeletal Sciences, University of Oxford, Oxford, UK
| | - Cyrus Cooper
- Nuffield Department of Orthopaedics, Rheumatology and Musculoskeletal Sciences, University of Oxford, Oxford, UK
| | - Sarah E Lamb
- Nuffield Department of Orthopaedics, Rheumatology and Musculoskeletal Sciences, University of Oxford, Oxford, UK
| |
Collapse
|
42
|
Zhu H, Piao J, Lee JJ, Hu F, Zhang L. Response adaptive randomization procedures in seamless phase II/III clinical trials. J Biopharm Stat 2019; 30:3-17. [PMID: 31454295 DOI: 10.1080/10543406.2019.1657439] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/26/2022]
Abstract
It is desirable to work efficiently and cost effectively to evaluate new therapies in a time-sensitive and ethical manner without compromising the integrity and validity of the development process. The seamless phase II/III clinical trial has been proposed to meet this need, and its efficient, ethical and economic advantages can be strengthened by its combination with innovative response adaptive randomization (RAR) procedures. In particular, well-designed frequentist RAR procedures can target theoretically optimal allocation proportions, and there are explicit asymptotic results. However, there has been little research into seamless phase II/III clinical trials with frequentist RAR because of the difficulty in performing valid statistical inference and controlling the type I error rate. In this paper, we propose the framework for a family of frequentist RAR designs for seamless phase II/III trials, derive the asymptotic distribution of the parameter estimators using martingale processes and offer solutions to control the type I error rate. The numerical studies demonstrate our theoretical findings and the advantages of the proposed methods.
Collapse
Affiliation(s)
- Hongjian Zhu
- Department of Biostatistics and Data Science, University of Texas Health Science Center, Houston, TX, USA
| | - Jin Piao
- Keck School of Medicine, University of Southern California, California, LA, USA
| | - J Jack Lee
- Department of Biostatistics, University of Texas MD Anderson Cancer Center
| | - Feifang Hu
- Department of Statistics, George Washington University, Washington D.C., USA
| | - Lixin Zhang
- School of Mathematical Sciences, Zhejiang University, Hangzhou, China
| |
Collapse
|
43
|
Placzek M, Friede T. A conditional error function approach for adaptive enrichment designs with continuous endpoints. Stat Med 2019; 38:3105-3122. [PMID: 31066093 DOI: 10.1002/sim.8154] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/26/2018] [Revised: 02/22/2019] [Accepted: 03/09/2019] [Indexed: 12/15/2022]
Abstract
Adaptive enrichment designs offer an efficient and flexible way to demonstrate the efficacy of a treatment in a clinically defined full population or in, eg, biomarker-defined subpopulations while controlling the family-wise Type I error rate in the strong sense. Frequently used testing strategies in designs with two or more stages include the combination test and the conditional error function approach. Here, we focus on the latter and present some extensions. In contrast to previous work, we allow for multiple subgroups rather than one subgroup only. For nested as well as nonoverlapping subgroups with normally distributed endpoints, we explore the effect of estimating the variances in the subpopulations. Instead of using a normal approximation, we derive new t-distribution-based methods for two different scenarios. First, in the case of equal variances across the subpopulations, we present exact results using a multivariate t-distribution. Second, in the case of potentially varying variances across subgroups, we provide some improved approximations compared to the normal approximation. The performance of the proposed conditional error function approaches is assessed and compared to the combination test in a simulation study. The proposed methods are motivated by an example in pulmonary arterial hypertension.
Collapse
Affiliation(s)
- Marius Placzek
- Department of Medical Statistics, University Medical Center Göttingen, Göttingen, Germany
| | - Tim Friede
- Department of Medical Statistics, University Medical Center Göttingen, Göttingen, Germany.,DZHK (German Center for Cardiovascular Research), Partner Site Göttingen, Göttingen, Germany
| |
Collapse
|
44
|
Bayar MA, Le Teuff G, Koenig F, Le Deley MC, Michiels S. Group sequential adaptive designs in series of time-to-event randomised trials in rare diseases: A simulation study. Stat Methods Med Res 2019; 29:1483-1498. [PMID: 31354106 DOI: 10.1177/0962280219862313] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
In rare diseases, fully powered large trials may not be doable in a reasonable time frame even with international collaborations. In a previous work, we proposed an approach based on a series of smaller parallel group two-arm randomised controlled trials (RCT) performed over a long research horizon. Within the series of trials, the treatment selected after each trial becomes the control treatment of the next one. We concluded that running more trials with smaller sample sizes and relaxed α-levels leads in the long term and under reasonable assumptions to larger survival benefits with a moderate increase of risk as compared to traditional designs based on larger but fewer trials designed to meet stringent evidence criteria. We now extend this quantitative framework with more 'flexible' designs including interim analyses for futility and/or efficacy, and three-arm adaptive designs with treatment selection at interim. In the simulation study, we considered different disease severities, accrual rates, and hypotheses of how treatments improve over time. For each design, we estimated the long-term survival benefit as the relative difference in hazard rates between the end and the start of the research horizon, and the risk defined as the probability of selecting at the end of the research horizon a treatment inferior to the initial control. We assessed the impact of the α-level and the choice of the stopping rule on the operating characteristics. We also compared the performance of series based on two- vs. three-arm trials. We show that relaxing α-levels within the limit of 0.1 is associated with larger survival gains and moderate increase of risk which remains within acceptable ranges. Including an interim analysis with a futility rule is associated with an additional survival gain and a better risk control as compared to series with no interim analysis, when the α-level is below or equal to 0.1, whereas the benefit of including an interim analysis is rather small for higher α-levels. Including an interim analysis for efficacy yields almost no additional gain. Series based on three-arm trials are associated with a systematic improvement in terms of survival gain and risk control as compared to series of two-arm trials.
Collapse
Affiliation(s)
- Mohamed Amine Bayar
- Service de Biostatistique et d'Épidémiologie, Gustave Roussy, Villejuif, France.,CESP, Faculté de médecine - Université Paris-Sud, Faculté de médecine - INSERM, Université Paris-Saclay, Villejuif, France
| | - Gwénaël Le Teuff
- Service de Biostatistique et d'Épidémiologie, Gustave Roussy, Villejuif, France.,CESP, Faculté de médecine - Université Paris-Sud, Faculté de médecine - INSERM, Université Paris-Saclay, Villejuif, France
| | - Franz Koenig
- Center for Medical Statistics, Informatics and Intelligent Systems, Medical University of Vienna, Spitalgasse 23, 1090 Vienna, Austria
| | - Marie-Cécile Le Deley
- Service de Biostatistique et d'Épidémiologie, Gustave Roussy, Villejuif, France.,CESP, Faculté de médecine - Université Paris-Sud, Faculté de médecine - INSERM, Université Paris-Saclay, Villejuif, France.,Unité de Méthodologie et Biostatistique, Centre Oscar Lambret, Lille, France
| | - Stefan Michiels
- Service de Biostatistique et d'Épidémiologie, Gustave Roussy, Villejuif, France.,CESP, Faculté de médecine - Université Paris-Sud, Faculté de médecine - INSERM, Université Paris-Saclay, Villejuif, France
| |
Collapse
|
45
|
Gal J, Milano G, Ferrero JM, Saâda-Bouzid E, Viotti J, Chabaud S, Gougis P, Le Tourneau C, Schiappa R, Paquet A, Chamorey E. Optimizing drug development in oncology by clinical trial simulation: Why and how? Brief Bioinform 2019; 19:1203-1217. [PMID: 28575140 DOI: 10.1093/bib/bbx055] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/07/2017] [Indexed: 12/11/2022] Open
Abstract
In therapeutic research, the safety and efficacy of pharmaceutical products are necessarily tested on humans via clinical trials after an extensive and expensive preclinical development period. Methodologies such as computer modeling and clinical trial simulation (CTS) might represent a valuable option to reduce animal and human assays. The relevance of these methods is well recognized in pharmacokinetics and pharmacodynamics from the preclinical phase to postmarketing. However, they are barely used and are poorly regarded for drug approval, despite Food and Drug Administration and European Medicines Agency recommendations. The generalization of CTS could be greatly facilitated by the availability of software for modeling biological systems, by clinical trial studies and hospital databases. Data sharing and data merging raise legal, policy and technical issues that will need to be addressed. Development of future molecules will have to use CTS for faster development and thus enable better patient management. Drug activity modeling coupled with disease modeling, optimal use of medical data and increased computing speed should allow this leap forward. The realization of CTS requires not only bioinformatics tools to allow interconnection and global integration of all clinical data but also a universal legal framework to protect the privacy of every patient. While recognizing that CTS can never replace 'real-life' trials, they should be implemented in future drug development schemes to provide quantitative support for decision-making. This in silico medicine opens the way to the P4 medicine: predictive, preventive, personalized and participatory.
Collapse
Affiliation(s)
- Jocelyn Gal
- Epidemiology and Biostatistics Unit at the Antoine Lacassagne Center, Nice, France
| | | | | | | | | | | | - Paul Gougis
- Pitie´-Salp^etrie`re Hospital in Paris, France
| | | | | | - Agnes Paquet
- Molecular and Cellular Pharmacology Institute of Sophia Antipolis, Valbonne, France
| | | |
Collapse
|
46
|
Van Norman GA. Phase II Trials in Drug Development and Adaptive Trial Design. JACC Basic Transl Sci 2019; 4:428-437. [PMID: 31312766 PMCID: PMC6609997 DOI: 10.1016/j.jacbts.2019.02.005] [Citation(s) in RCA: 56] [Impact Index Per Article: 11.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/11/2019] [Accepted: 02/14/2019] [Indexed: 12/20/2022]
Abstract
Phase II clinical studies represent a critical point in determining drug costs, and phase II is a poor predictor of drug success: >30% of drugs entering phase II studies fail to progress, and >58% of drugs go on to fail in phase III. Adaptive clinical trial design has been proposed as a way to reduce the costs of phase II testing by providing earlier determination of futility and prediction of phase III success, reducing overall phase II and III trial sizes, and shortening overall drug development time. This review examines issues in phase II testing and adaptive trial design.
Collapse
Affiliation(s)
- Gail A. Van Norman
- Department of Anesthesiology and Pain Medicine, University of Washington, Seattle, Washington
| |
Collapse
|
47
|
Simon N, Simon R. Using Bayesian modeling in frequentist adaptive enrichment designs. Biostatistics 2019; 19:27-41. [PMID: 28520893 DOI: 10.1093/biostatistics/kxw054] [Citation(s) in RCA: 19] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/28/2015] [Accepted: 11/25/2016] [Indexed: 11/14/2022] Open
Abstract
Our increased understanding of the mechanistic heterogeneity of diseases has pushed the development of targeted therapeutics. We do not expect all patients with a given disease to benefit from a targeted drug; only those in the target population. That is, those with sufficient dysregulation in the biomolecular pathway targeted by treatment. However, due to complexity of the pathway, and/or technical issues with our characterizing assay, it is often hard to characterize the target population until well into large-scale clinical trials. This has stimulated the development of adaptive enrichment trials; clinical trials in which the target population is adaptively learned; and enrollment criteria are adaptively updated to reflect this growing understanding. This paper proposes a framework for group-sequential adaptive enrichment trials. Building on the work of Simon & Simon (2013). Adaptive enrichment designs for clinical trials. Biostatistics 14(4), 613-625), it includes a frequentist hypothesis test at the end of the trial. However, it uses Bayesian methods to optimize the decisions required during the trial (regarding how to restrict enrollment) and Bayesian methods to estimate effect size, and characterize the target population at the end of the trial. This joint frequentist/Bayesian design combines the power of Bayesian methods for decision making with the use of a formal hypothesis test at the end of the trial to preserve the studywise probability of a type I error.
Collapse
Affiliation(s)
- Noah Simon
- Department of Biostatistics, University of Washington, Box 357232, Seattle, WA 98195, USA
| | - Richard Simon
- Biometric Research Branch of the National Cancer Institute (at the National Institutes of Health), 9609 Medical Center Dr, Rockville, MD 20850, USA
| |
Collapse
|
48
|
Sitbon O, Gomberg-Maitland M, Granton J, Lewis MI, Mathai SC, Rainisio M, Stockbridge NL, Wilkins MR, Zamanian RT, Rubin LJ. Clinical trial design and new therapies for pulmonary arterial hypertension. Eur Respir J 2019; 53:13993003.01908-2018. [PMID: 30545975 PMCID: PMC6351342 DOI: 10.1183/13993003.01908-2018] [Citation(s) in RCA: 132] [Impact Index Per Article: 26.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/05/2018] [Accepted: 10/09/2018] [Indexed: 12/20/2022]
Abstract
Until 20 years ago the treatment of pulmonary arterial hypertension (PAH) was based on case reports and small series, and was largely ineffectual. As a deeper understanding of the pathogenesis and pathophysiology of PAH evolved over the subsequent two decades, coupled with epidemiological studies defining the clinical and demographic characteristics of the condition, a renewed interest in treatment development emerged through collaborations between international experts, industry and regulatory agencies. These efforts led to the performance of robust, high-quality clinical trials of novel therapies that targeted putative pathogenic pathways, leading to the approval of more than 10 novel therapies that have beneficially impacted both the quality and duration of life. However, our understanding of PAH remains incomplete and there is no cure. Accordingly, efforts are now focused on identifying novel pathogenic pathways that may be targeted, and applying more rigorous clinical trial designs to better define the efficacy of these new potential treatments and their role in the management scheme. This article, prepared by a Task Force comprised of expert clinicians, trialists and regulators, summarises the current state of the art, and provides insight into the opportunities and challenges for identifying and assessing the efficacy and safety of new treatments for this challenging condition. State of the art and research perspectives in clinical trial design and new therapies for pulmonary arterial hypertensionhttp://ow.ly/VHQ030mfRxc
Collapse
Affiliation(s)
- Olivier Sitbon
- Université Paris-Sud, Hôpital Bicêtre, INSERM UMR_S999, Le Kremlin-Bicêtre, France
| | | | - John Granton
- University Health Network-General Division, University of Toronto, Toronto, ON, Canada
| | - Michael I Lewis
- Pulmonary/Critical Care Division and Smidt Heart Institute, Cedars Sinai Medical Center, UCLA, Los Angeles, CA, USA
| | - Stephen C Mathai
- Division of Pulmonary and Critical Care, Dept of Medicine, Johns Hopkins University, Baltimore, MD, USA
| | | | | | - Martin R Wilkins
- Dept of Medicine, Faculty of Medicine, Imperial College London, London, UK
| | - Roham T Zamanian
- Dept of Medicine, Stanford University Medical Center, Stanford, CA, USA
| | - Lewis J Rubin
- San Diego School of Medicine, University of California, La Jolla, CA, USA
| |
Collapse
|
49
|
Collignon O, Koenig F, Koch A, Hemmings RJ, Pétavy F, Saint-Raymond A, Papaluca-Amati M, Posch M. Adaptive designs in clinical trials: from scientific advice to marketing authorisation to the European Medicine Agency. Trials 2018; 19:642. [PMID: 30454061 PMCID: PMC6245528 DOI: 10.1186/s13063-018-3012-x] [Citation(s) in RCA: 18] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/23/2018] [Accepted: 10/21/2018] [Indexed: 12/15/2022] Open
Abstract
Background In recent years, experience on the application of adaptive designs in confirmatory clinical trials has accumulated. Although planning such trials comes at the cost of additional operational complexity, adaptive designs offer the benefit of flexibility to update trial design and objectives as data accrue. In 2007, the European Medicines Agency (EMA) provided guidance on confirmatory clinical trials with adaptive (or flexible) designs. In order to better understand how adaptive trials are implemented in practice and how they may impact medicine approval within the EMA centralised procedure, we followed on 59 medicines for which an adaptive clinical trial had been submitted to the EMA Scientific Advice (SA) and analysed previously in a dedicated EMA survey of scientific advice letters. We scrutinized in particular the submission of the corresponding medicines for a marketing authorisation application (MAA). We also discuss the current regulatory perspective as regards the implementation of adaptive designs in confirmatory clinical trials. Methods Using the internal EMA MAA database, the AdisInsight database and related trial registries, we analysed how many of these 59 trials actually started, the completion status, results, the time to trial start, the adaptive elements finally implemented after SA, their possible influence on the success of the trial and corresponding product approval. Results Overall 31 trials out of 59 (53%) were retrieved. Thirty of them (97%) have been started and 23 (74%) concluded. Nine of these trials (39% out of 23) demonstrated a significant treatment effect on their primary endpoint and 4 (17% out of 23) supported a marketing authorisation (MA). An additional two trials were stopped using pre-defined criteria for futility, efficiently identifying trials on which further resources should not be spent. Median time to trial start after SA letter was given by EMA was 5 months. In the investigated trial registries, at least 18 trial (58% of 31 retrieved trials) designs were implemented with adaptive elements, which were predominantly dose selection, sample size reassessment (SSR) and stopping for futility (SFF). Among the 11 completed trials including adaptive elements, 6 demonstrated a significant treatment effect on their primary endpoint (55%). Conclusions Adaptive designs are now well established in the drug development landscape. If properly pre-planned, adaptations can play a key role in the success of some of these trials, for example to help successfully select the most promising dose regimens for phase II/III trials. Interim analyses can also enable stopping of trials for futility when they do not hold their promises. Type I error rate control, trial integrity and results consistency between the different stages of the analyses are fundamental aspects to be discussed thoroughly. Engaging early dialogue with regulators and implementing the scientific advice received is strongly recommended, since much experience in discussing adaptive designs and assessing their results has been accumulated.
Collapse
Affiliation(s)
- Olivier Collignon
- European Medicines Agency, 30 Churchill Place, London, E14 5EU, UK. .,Competence Center for Methodology and Statistics, Luxembourg Institute of Health, 1A-B, rue Thomas Edison, L-1445, Strassen, Luxembourg.
| | - Franz Koenig
- Section for Medical Statistics, Center for Medical Statistics, Informatics, and Intelligent Systems, Medical University of Vienna, Spitalgasse 23, 1090, Vienna, Austria
| | - Armin Koch
- Institut für Biometrie, Medizinische Hochschule Hannover, OE 8410, 30625, Hanover, Germany
| | - Robert James Hemmings
- Medicines and Healthcare Products Regulatory Agency, 151 Buckingham Palace Road, London, SW1W 9SZ, UK
| | - Frank Pétavy
- European Medicines Agency, 30 Churchill Place, London, E14 5EU, UK
| | | | | | - Martin Posch
- Section for Medical Statistics, Center for Medical Statistics, Informatics, and Intelligent Systems, Medical University of Vienna, Spitalgasse 23, 1090, Vienna, Austria
| |
Collapse
|
50
|
Quan H, Xu Y, Chen Y, Gao L, Chen X. A case study of an adaptive design for a clinical trial with 2 doses and 2 endpoints in a rare disease area. Pharm Stat 2018; 17:797-810. [DOI: 10.1002/pst.1902] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/26/2018] [Revised: 06/12/2018] [Accepted: 07/31/2018] [Indexed: 11/09/2022]
Affiliation(s)
- Hui Quan
- Biostatistics and Programming; Sanofi; Bridgewater NJ USA
| | - Yi Xu
- Biostatistics and Programming; Sanofi; Bridgewater NJ USA
| | - Yixin Chen
- Biostatistics and Programming; Sanofi; Bridgewater NJ USA
| | - Lei Gao
- Biostatistics and Programming; Sanofi; Bridgewater NJ USA
| | - Xun Chen
- Biostatistics and Programming; Sanofi; Bridgewater NJ USA
| |
Collapse
|