1
|
Dong Y, Paux G, Broglio K, Cooner F, Gao G, He W, Gao L, Xue X, He P. Use of Seamless Study Designs in Oncology Clinical Development- A Survey Conducted by IDSWG Oncology Sub-team. Ther Innov Regul Sci 2024; 58:978-986. [PMID: 38909174 DOI: 10.1007/s43441-024-00676-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/27/2023] [Accepted: 06/07/2024] [Indexed: 06/24/2024]
Abstract
Seamless study designs have the potential to accelerate clinical development. The use of innovative seamless designs has been increasing in the oncology area; however, while the concept of seamless designs becomes more popular and accepted, many challenges remain in both the design and conduct of these trials. This may be especially true when seamless designs are used in late phase development supporting regulatory decision-making. The Innovative Design Scientific Working Group (IDSWG) Oncology team conducted a survey to understand the current use of seamless study designs for registration purposes in oncology clinical development. The survey was designed to provide insights into the benefits and to identify the roadblocks. A total of 16 questions were included in the survey that was distributed using the ASA Biopharmaceutical Section and IDSWG email listings from August to September 2022. A total of 51 responses were received, with 39 (76%) respondents indicating that their organizations had seamless oncology studies in planning or implementation for registration purposes. Detailed survey results are presented in the manuscript. Overall, while seamless designs offer advantages in terms of timeline reduction and cost saving, they also present challenges related to additional complexity and the need for efficient surrogate clinical endpoints in oncology drug development.
Collapse
Affiliation(s)
| | | | | | | | | | - Wei He
- AstraZeneca, Cambridge, MA, USA
| | - Lei Gao
- Moderna, Inc, Cambridge, MA, USA
| | | | - Philip He
- Daiichi Sankyo, Basking Ridge, NJ, USA
| |
Collapse
|
2
|
Gou J. Reverse graphical approaches for multiple test procedures. J Biopharm Stat 2024; 34:90-110. [PMID: 36757196 DOI: 10.1080/10543406.2023.2171428] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/16/2021] [Accepted: 01/17/2023] [Indexed: 02/10/2023]
Abstract
The graphical approach has been proposed as a general framework for clinical trial designs involving multiple hypotheses, where decisions are made only based on the observed marginal p -values. The graphical approach starts from a graph that includes all hypotheses as vertices and gradually removes some vertices when their corresponding hypotheses are rejected. In this paper, we propose a reverse graphical approach, which starts from a set of singleton graphs and gradually adds vertices into graphs until rejection of a set of hypotheses is made. Proofs of familywise error rate control are provided. A simulation study is conducted for statistical power analysis, and a case study is included to illustrate how the proposed approach can be applied to clinical studies.
Collapse
Affiliation(s)
- Jiangtao Gou
- Department of Mathematics and Statistics, Villanova University, Villanova, PA, USA
| |
Collapse
|
3
|
A gated group sequential design for seamless Phase II/III trial with subpopulation selection. BMC Med Res Methodol 2023; 23:2. [PMID: 36597042 PMCID: PMC9809114 DOI: 10.1186/s12874-022-01825-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/15/2022] [Accepted: 12/19/2022] [Indexed: 01/04/2023] Open
Abstract
BACKGROUND Due to the high cost and high failure rate of Phase III trials where a classical group sequential design (GSD) is usually used, seamless Phase II/III designs are more and more popular to improve trial efficiency. A potential attraction of Phase II/III design is to allow a randomized proof-of-concept stage prior to committing to the full cost of a Phase III trial. Population selection during the trial allows a trial to adapt and focus investment where it is most likely to provide patient benefit. Previous methods have been developed for this problem when there is a single primary endpoint and two possible populations. METHODS To find the population that potentially benefits with one or two primary endpoints (e.g., progression free survival (PFS), overall survival (OS)), we propose a gated group sequential design for a seamless Phase II/III trial design with adaptive population selection. RESULTS The investigated design controls the familywise error rate and allows multiple interim analyses to enable early stopping for efficacy or futility. Simulations and an illustrative example suggest that the proposed gated group sequential design has more power and requires less time and resources compared to the group sequential design and adaptive design. CONCLUSIONS Combining the group sequential design and adaptive design, the gated group sequential design has more power and higher efficiency while controlling for the familywise error rate. It has the potential to save drug development cost and more quickly fulfill unmet medical needs.
Collapse
|
4
|
Tamhane AC, Xi D, Gou J. Group sequential Holm and Hochberg procedures. Stat Med 2021; 40:5333-5350. [PMID: 34636081 DOI: 10.1002/sim.9128] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/27/2020] [Revised: 06/20/2021] [Accepted: 06/21/2021] [Indexed: 11/11/2022]
Abstract
The problem of testing multiple hypotheses using a group sequential procedure often arises in clinical trials. We review several group sequential Holm (GSHM) type procedures proposed in the literature and clarify the relationships between them. In particular, we show which procedures are equivalent or, if different, which are more powerful and what are their pros and cons. We propose a step-up group sequential Hochberg (GSHC) procedure as a reverse application of a particular step-down GSHM procedure. We conducted an extensive simulation study to evaluate the familywise error rate (FWER) and power properties of that GSHM procedure and the GSHC procedure and found that the GSHC procedure controls FWER more closely and is more powerful. All procedures are illustrated with a common numerical example, the data for which are chosen to bring out the differences between them. A real case study is also presented to illustrate application of these procedures. R programs for applying the proposed procedures, additional simulation results, and the proof of the FWER control of the GSHC procedure in a special case are provided in Supplementary Material.
Collapse
Affiliation(s)
- Ajit C Tamhane
- Department of Industrial Engineering & Management Sciences, Northwestern University, Evanston, Illinois, USA
| | - Dong Xi
- Statistical Methodology, Novartis Pharmaceuticals, East Hanover, New Jersey, USA
| | - Jiangtao Gou
- Department of Mathematics and Statistics, Villanova University, Villanova, Pennsylvania, USA
| |
Collapse
|
5
|
Jin M. A parametric multiple test procedure to adaptive group-sequential trials allowing for mid-term modifications. Contemp Clin Trials 2020; 90:105955. [DOI: 10.1016/j.cct.2020.105955] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/19/2019] [Revised: 01/24/2020] [Accepted: 01/30/2020] [Indexed: 11/30/2022]
|
6
|
Xi D, Bretz F. Symmetric graphs for equally weighted tests, with application to the Hochberg procedure. Stat Med 2019; 38:5268-5282. [PMID: 31657025 DOI: 10.1002/sim.8375] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/18/2019] [Revised: 05/02/2019] [Accepted: 09/02/2019] [Indexed: 01/21/2023]
Abstract
The graphical approach to multiple testing provides a convenient tool for designing, visualizing, and performing multiplicity adjustments in confirmatory clinical trials while controlling the familywise error rate. It assigns a set of weights to each intersection null hypothesis within the closed test framework. These weights form the basis for intersection tests using weighted individual p-values, such as the weighted Bonferroni test. In this paper, we extend the graphical approach to intersection tests that assume equal weights for the elementary null hypotheses associated with any intersection hypothesis, including the Hochberg procedure as well as omnibus tests such as Fisher's combination, O'Brien's, and F tests. More specifically, we introduce symmetric graphs that generate sets of equal weights so that the aforementioned tests can be applied with the graphical approach. In addition, we visualize the Hochberg and the truncated Hochberg procedures in serial and parallel gatekeeping settings using symmetric component graphs. We illustrate the method with two clinical trial examples.
Collapse
Affiliation(s)
- Dong Xi
- Statistical Methodology, Novartis Pharmaceuticals, East Hanover, New Jersey
| | - Frank Bretz
- Statistical Methodology, Novartis Pharma AG, Basel, Switzerland.,Section for Medical Statistics, Medical University of Vienna, Vienna, Austria
| |
Collapse
|
7
|
Sugitani T, Posch M, Bretz F, Koenig F. Flexible alpha allocation strategies for confirmatory adaptive enrichment clinical trials with a prespecified subgroup. Stat Med 2018; 37:3387-3402. [PMID: 29945304 DOI: 10.1002/sim.7851] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/08/2017] [Revised: 03/08/2018] [Accepted: 05/25/2018] [Indexed: 02/05/2023]
Abstract
Adaptive enrichment designs have recently received considerable attention as they have the potential to make drug development process for personalized medicine more efficient. Several statistical approaches have been proposed so far in the literature and the operating characteristics of these approaches are extensively investigated using simulation studies. In this paper, we improve on existing adaptive enrichment designs by assigning unequal weights to the significance levels associated with the hypotheses of the overall population and a prespecified subgroup. More specifically, we focus on the standard combination test, a modified combination test, the marginal combination test, and the partial conditional error rate approach and explore the operating characteristics of these approaches by a simulation study. We show that these approaches can lead to power gains, compared to existing approaches, if the weights are chosen carefully.
Collapse
Affiliation(s)
- Toshifumi Sugitani
- Biostatistics Group, Astellas Pharma Inc, Tokyo, Japan.,Section for Medical Statistics, Medical University of Vienna, Vienna, Austria
| | - Martin Posch
- Section for Medical Statistics, Medical University of Vienna, Vienna, Austria
| | - Frank Bretz
- Section for Medical Statistics, Medical University of Vienna, Vienna, Austria.,Statistical Methodology, Novartis Pharma AG, Basel, Switzerland
| | - Franz Koenig
- Section for Medical Statistics, Medical University of Vienna, Vienna, Austria
| |
Collapse
|
8
|
Affiliation(s)
- Lulu Wang
- Department of Statistics, Colorado State University, Fort Collins, CO
| | - Qing Li
- Merck & Co., Inc., Kenilworth, NJ
| | | | | |
Collapse
|
9
|
Kordzakhia G, Dmitrienko A, Ishida E. Mixture-based gatekeeping procedures in adaptive clinical trials. J Biopharm Stat 2017; 28:129-145. [PMID: 29283310 DOI: 10.1080/10543406.2017.1399901] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/18/2022]
Abstract
Clinical trials with data-driven decision rules often pursue multiple clinical objectives such as the evaluation of several endpoints or several doses of an experimental treatment. These complex analysis strategies give rise to "multivariate" multiplicity problems with several components or sources of multiplicity. A general framework for defining gatekeeping procedures in clinical trials with adaptive multistage designs is proposed in this paper. The mixture method is applied to build a gatekeeping procedure at each stage and inferences at each decision point (interim or final analysis) are performed using the combination function approach. An advantage of utilizing the mixture method is that it enables powerful gatekeeping procedures applicable to a broad class of settings with complex logical relationships among the hypotheses of interest. Further, the combination function approach supports flexible data-driven decisions such as a decision to increase the sample size or remove a treatment arm. The paper concludes with a clinical trial example that illustrates the methodology by applying it to develop an adaptive two-stage design with a mixture-based gatekeeping procedure.
Collapse
Affiliation(s)
- George Kordzakhia
- a U.S. Food and Drug Administration , Silver Spring , Maryland , USA
| | | | - Eiji Ishida
- a U.S. Food and Drug Administration , Silver Spring , Maryland , USA
| |
Collapse
|
10
|
Johnson SB. Clinical Research Informatics: Supporting the Research Study Lifecycle. Yearb Med Inform 2017; 26:193-200. [PMID: 29063565 PMCID: PMC6239240 DOI: 10.15265/iy-2017-022] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/18/2017] [Indexed: 12/27/2022] Open
Abstract
Objectives: The primary goal of this review is to summarize significant developments in the field of Clinical Research Informatics (CRI) over the years 2015-2016. The secondary goal is to contribute to a deeper understanding of CRI as a field, through the development of a strategy for searching and classifying CRI publications. Methods: A search strategy was developed to query the PubMed database, using medical subject headings to both select and exclude articles, and filtering publications by date and other characteristics. A manual review classified publications using stages in the "research study lifecycle", with key stages that include study definition, participant enrollment, data management, data analysis, and results dissemination. Results: The search strategy generated 510 publications. The manual classification identified 125 publications as relevant to CRI, which were classified into seven different stages of the research lifecycle, and one additional class that pertained to multiple stages, referring to general infrastructure or standards. Important cross-cutting themes included new applications of electronic media (Internet, social media, mobile devices), standardization of data and procedures, and increased automation through the use of data mining and big data methods. Conclusions: The review revealed increased interest and support for CRI in large-scale projects across institutions, regionally, nationally, and internationally. A search strategy based on medical subject headings can find many relevant papers, but a large number of non-relevant papers need to be detected using text words which pertain to closely related fields such as computational statistics and clinical informatics. The research lifecycle was useful as a classification scheme by highlighting the relevance to the users of clinical research informatics solutions.
Collapse
Affiliation(s)
- S. B. Johnson
- Healthcare Policy and Research, Weill Cornell Medicine, New York, USA
| |
Collapse
|
11
|
Zhong J, Wen MJ, Kwong KS, Cheung SH. Testing of non-inferiority and superiority for three-arm clinical studies with multiple experimental treatments. Stat Methods Med Res 2016; 27:1751-1765. [PMID: 27647816 DOI: 10.1177/0962280216668913] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/19/2023]
Abstract
The purpose of a non-inferiority trial is to assert the efficacy of an experimental treatment compared with a reference treatment by showing that the experimental treatment retains a substantial proportion of the efficacy of the reference treatment. Statistical methods have been developed to test multiple experimental treatments in three-arm non-inferiority trials. In this paper, we report the development of procedures that simultaneously test the non-inferiority and the superiority of experimental treatments after the assay sensitivity has been established. The advantage of the proposed test procedures is the additional ability to identify superior treatments while retaining an non-inferiority testing power comparable to that of existing testing procedures. Single-step and stepwise procedures are derived and then compared with each other to determine their relative testing power and testing error in a simulation study. Finally, the suggested procedures are illustrated with two clinical examples.
Collapse
Affiliation(s)
- Junjiang Zhong
- 1 School of Applied Mathematics, Xiamen University of Technology, Xiamen, China.,2 Department of Statistics, National Cheng Kung University, Tainan, Taiwan
| | - Miin-Jye Wen
- 2 Department of Statistics, National Cheng Kung University, Tainan, Taiwan
| | - Koon Shing Kwong
- 3 School of Economics, Singapore Management University, Singapore, Singapore
| | - Siu Hung Cheung
- 2 Department of Statistics, National Cheng Kung University, Tainan, Taiwan.,4 Department of Statistics, The Chinese University of Hong Kong, Shatin, Hong Kong, China
| |
Collapse
|
12
|
Bauer P, Bretz F, Dragalin V, König F, Wassmer G. Twenty-five years of confirmatory adaptive designs: opportunities and pitfalls. Stat Med 2016; 35:325-47. [PMID: 25778935 PMCID: PMC6680191 DOI: 10.1002/sim.6472] [Citation(s) in RCA: 135] [Impact Index Per Article: 16.9] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/02/2014] [Revised: 02/03/2015] [Accepted: 02/19/2015] [Indexed: 12/26/2022]
Abstract
'Multistage testing with adaptive designs' was the title of an article by Peter Bauer that appeared 1989 in the German journal Biometrie und Informatik in Medizin und Biologie. The journal does not exist anymore but the methodology found widespread interest in the scientific community over the past 25 years. The use of such multistage adaptive designs raised many controversial discussions from the beginning on, especially after the publication by Bauer and Köhne 1994 in Biometrics: Broad enthusiasm about potential applications of such designs faced critical positions regarding their statistical efficiency. Despite, or possibly because of, this controversy, the methodology and its areas of applications grew steadily over the years, with significant contributions from statisticians working in academia, industry and agencies around the world. In the meantime, such type of adaptive designs have become the subject of two major regulatory guidance documents in the US and Europe and the field is still evolving. Developments are particularly noteworthy in the most important applications of adaptive designs, including sample size reassessment, treatment selection procedures, and population enrichment designs. In this article, we summarize the developments over the past 25 years from different perspectives. We provide a historical overview of the early days, review the key methodological concepts and summarize regulatory and industry perspectives on such designs. Then, we illustrate the application of adaptive designs with three case studies, including unblinded sample size reassessment, adaptive treatment selection, and adaptive endpoint selection. We also discuss the availability of software for evaluating and performing such designs. We conclude with a critical review of how expectations from the beginning were fulfilled, and - if not - discuss potential reasons why this did not happen.
Collapse
Affiliation(s)
- Peter Bauer
- Section of Medical StatisticsMedical University of ViennaSpitalgasse 231090 WienAustria
| | - Frank Bretz
- Novartis Pharma AGLichtstrasse 354002BaselSwitzerland
- Shanghai University of Finance and EconomicsChina
| | | | - Franz König
- Section of Medical StatisticsMedical University of ViennaSpitalgasse 231090 WienAustria
| | - Gernot Wassmer
- Aptiv Solutions, an ICON plc companyRobert‐Perthel‐Str. 77a50739KölnGermany
- Institute for Medical Statistics, Informatics and EpidemiologyUniversity of Cologne50924KölnGermany
| |
Collapse
|