1
|
Wang Y, Yao M, Liu J, Liu Y, Ma Y, Luo X, Mei F, Xiang H, Zou K, Li L, Sun X. Adaptive designs were primarily used but inadequately reported in early phase drug trials. BMC Med Res Methodol 2024; 24:130. [PMID: 38840047 PMCID: PMC11151552 DOI: 10.1186/s12874-024-02256-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/26/2023] [Accepted: 05/27/2024] [Indexed: 06/07/2024] Open
Abstract
BACKGROUND Faced with the high cost and limited efficiency of classical randomized controlled trials, researchers are increasingly applying adaptive designs to speed up the development of new drugs. However, the application of adaptive design to drug randomized controlled trials (RCTs) and whether the reporting is adequate are unclear. Thus, this study aimed to summarize the epidemiological characteristics of the relevant trials and assess their reporting quality by the Adaptive designs CONSORT Extension (ACE) checklist. METHODS We searched MEDLINE, EMBASE, Cochrane Central Register of Controlled Trials (CENTRAL) and ClinicalTrials.gov from inception to January 2020. We included drug RCTs that explicitly claimed to be adaptive trials or used any type of adaptative design. We extracted the epidemiological characteristics of included studies to summarize their adaptive design application. We assessed the reporting quality of the trials by Adaptive designs CONSORT Extension (ACE) checklist. Univariable and multivariable linear regression models were used to the association of four prespecified factors with the quality of reporting. RESULTS Our survey included 108 adaptive trials. We found that adaptive design has been increasingly applied over the years, and was commonly used in phase II trials (n = 45, 41.7%). The primary reasons for using adaptive design were to speed the trial and facilitate decision-making (n = 24, 22.2%), maximize the benefit of participants (n = 21, 19.4%), and reduce the total sample size (n = 15, 13.9%). Group sequential design (n = 63, 58.3%) was the most frequently applied method, followed by adaptive randomization design (n = 26, 24.1%), and adaptive dose-finding design (n = 24, 22.2%). The proportion of adherence to the ACE checklist of 26 topics ranged from 7.4 to 99.1%, with eight topics being adequately reported (i.e., level of adherence ≥ 80%), and eight others being poorly reported (i.e., level of adherence ≤ 30%). In addition, among the seven items specific for adaptive trials, three were poorly reported: accessibility to statistical analysis plan (n = 8, 7.4%), measures for confidentiality (n = 14, 13.0%), and assessments of similarity between interim stages (n = 25, 23.1%). The mean score of the ACE checklist was 13.9 (standard deviation [SD], 3.5) out of 26. According to our multivariable regression analysis, later published trials (estimated β = 0.14, p < 0.01) and the multicenter trials (estimated β = 2.22, p < 0.01) were associated with better reporting. CONCLUSION Adaptive design has shown an increasing use over the years, and was primarily applied to early phase drug trials. However, the reporting quality of adaptive trials is suboptimal, and substantial efforts are needed to improve the reporting.
Collapse
Affiliation(s)
- Yuning Wang
- Institute of Integrated Traditional Chinese and Western Medicine, West China Hospital, Chinese Evidence-based Medicine Center and Chinese Cochrane Center, Sichuan University, Chengdu, 610041, China
- NMPA Key Laboratory for Real World Data Research and Evaluation in Hainan, Chengdu, 610041, China
- China Sichuan Center of Technology Innovation for Real World Data, Chengdu, 610041, China
| | - Minghong Yao
- Institute of Integrated Traditional Chinese and Western Medicine, West China Hospital, Chinese Evidence-based Medicine Center and Chinese Cochrane Center, Sichuan University, Chengdu, 610041, China
- NMPA Key Laboratory for Real World Data Research and Evaluation in Hainan, Chengdu, 610041, China
- China Sichuan Center of Technology Innovation for Real World Data, Chengdu, 610041, China
| | - Jiali Liu
- Institute of Integrated Traditional Chinese and Western Medicine, West China Hospital, Chinese Evidence-based Medicine Center and Chinese Cochrane Center, Sichuan University, Chengdu, 610041, China
- NMPA Key Laboratory for Real World Data Research and Evaluation in Hainan, Chengdu, 610041, China
- China Sichuan Center of Technology Innovation for Real World Data, Chengdu, 610041, China
| | - Yanmei Liu
- Institute of Integrated Traditional Chinese and Western Medicine, West China Hospital, Chinese Evidence-based Medicine Center and Chinese Cochrane Center, Sichuan University, Chengdu, 610041, China
- NMPA Key Laboratory for Real World Data Research and Evaluation in Hainan, Chengdu, 610041, China
- China Sichuan Center of Technology Innovation for Real World Data, Chengdu, 610041, China
| | - Yu Ma
- Institute of Integrated Traditional Chinese and Western Medicine, West China Hospital, Chinese Evidence-based Medicine Center and Chinese Cochrane Center, Sichuan University, Chengdu, 610041, China
- NMPA Key Laboratory for Real World Data Research and Evaluation in Hainan, Chengdu, 610041, China
- China Sichuan Center of Technology Innovation for Real World Data, Chengdu, 610041, China
| | - Xiaochao Luo
- Institute of Integrated Traditional Chinese and Western Medicine, West China Hospital, Chinese Evidence-based Medicine Center and Chinese Cochrane Center, Sichuan University, Chengdu, 610041, China
- NMPA Key Laboratory for Real World Data Research and Evaluation in Hainan, Chengdu, 610041, China
- China Sichuan Center of Technology Innovation for Real World Data, Chengdu, 610041, China
| | - Fan Mei
- Institute of Integrated Traditional Chinese and Western Medicine, West China Hospital, Chinese Evidence-based Medicine Center and Chinese Cochrane Center, Sichuan University, Chengdu, 610041, China
- NMPA Key Laboratory for Real World Data Research and Evaluation in Hainan, Chengdu, 610041, China
- China Sichuan Center of Technology Innovation for Real World Data, Chengdu, 610041, China
| | - Hunong Xiang
- Institute of Integrated Traditional Chinese and Western Medicine, West China Hospital, Chinese Evidence-based Medicine Center and Chinese Cochrane Center, Sichuan University, Chengdu, 610041, China
- NMPA Key Laboratory for Real World Data Research and Evaluation in Hainan, Chengdu, 610041, China
- China Sichuan Center of Technology Innovation for Real World Data, Chengdu, 610041, China
| | - Kang Zou
- Institute of Integrated Traditional Chinese and Western Medicine, West China Hospital, Chinese Evidence-based Medicine Center and Chinese Cochrane Center, Sichuan University, Chengdu, 610041, China
- NMPA Key Laboratory for Real World Data Research and Evaluation in Hainan, Chengdu, 610041, China
- China Sichuan Center of Technology Innovation for Real World Data, Chengdu, 610041, China
| | - Ling Li
- Institute of Integrated Traditional Chinese and Western Medicine, West China Hospital, Chinese Evidence-based Medicine Center and Chinese Cochrane Center, Sichuan University, Chengdu, 610041, China.
- NMPA Key Laboratory for Real World Data Research and Evaluation in Hainan, Chengdu, 610041, China.
- China Sichuan Center of Technology Innovation for Real World Data, Chengdu, 610041, China.
| | - Xin Sun
- Institute of Integrated Traditional Chinese and Western Medicine, West China Hospital, Chinese Evidence-based Medicine Center and Chinese Cochrane Center, Sichuan University, Chengdu, 610041, China.
- NMPA Key Laboratory for Real World Data Research and Evaluation in Hainan, Chengdu, 610041, China.
- China Sichuan Center of Technology Innovation for Real World Data, Chengdu, 610041, China.
| |
Collapse
|
2
|
Wang Y, Yao M, Liu J, Liu Y, Ma Y, Luo X, Mei F, Xiang H, Zou K, Sun X, Li L. A systematic survey of adaptive trials shows substantial improvement in methods is needed. J Clin Epidemiol 2024; 167:111257. [PMID: 38218461 DOI: 10.1016/j.jclinepi.2024.111257] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/20/2023] [Revised: 12/22/2023] [Accepted: 01/08/2024] [Indexed: 01/15/2024]
Abstract
OBJECTIVES To investigate the design, conduct, and analysis of adaptive trials through a systematic survey and provide recommendations for future adaptive trials. STUDY DESIGN AND SETTING We systematically searched MEDLINE, EMBASE, Cochrane Central Register of Controlled Trials, and ClinicalTrials.gov databases up to January 2020. We included trials that were self-described as adaptive trials or applied adaptive designs. We identified three frequently used adaptive designs and summarized their methodological details in terms of design, conduct, and analysis. Lastly, we provided recommendations for future adaptive trials. RESULTS We included a total of 128 trials in this study. The primary motivations for using adaptive design were to speed up the trials and facilitate decision-making (n = 29, 31.5%). The three most frequently used methods were group sequential design (GSD) (n = 71, 55.5%), adaptive dose-finding design (ADFD) (n = 35, 27.3%), and adaptive randomization design (ARD) (n = 26, 20.3%). The timing and frequency of interim analysis were detailed in three-fourths of the GSD trials (n = 55, 77.5%) and in half of the ADFD trials (n = 19, 54.3%); however, more than half of the ARD trials (n = 15, 57.7%) did not provide this information. Some trials selected a different outcome than the primary outcome for interim analysis (GSD: n = 7, 12.7%; ADFD: n = 8, 27.6%; ARD: n = 7, 50.0%), but the majority of these trials did not provide explicit reasons for this choice (GSD: n = 7, 100.0%; ADFD: n = 7, 87.5%; ARD: n = 5, 71.4%). More than half (n = 76, 59.4%) of trials did not mention the accessibility of supporting documents, and two-thirds (n = 86, 67.2%) did not state the establishment of independent data monitoring committees (IDMCs). Moreover, unplanned adjustments were observed during the conduct of one-sixth adaptive trials (n = 22, 17.2%). Based on our findings, we provide 14 recommendations for improving adaptive trials in the future. CONCLUSION Substantial improvements were needed in methods of adaptive trials, particularly in the areas of interim analysis, the establishment of independent data monitoring committees, and unplanned adjustments. In this study, we offer recommendations from both general and specific aspects for researchers to carefully design, conduct, and analyze adaptive trials.
Collapse
Affiliation(s)
- Yuning Wang
- Institute of Integrated Traditional Chinese and Western Medicine, Chinese Evidence-based Medicine Center and Chinese Cochrane Center, West China Hospital, Sichuan University, Chengdu, 610041, China; NMPA Key Laboratory for Real World Data Research and Evaluation in Hainan, Chengdu, 610041, China; China Sichuan Center of Technology Innovation for Real World Data, Chengdu, 610041, China
| | - Minghong Yao
- Institute of Integrated Traditional Chinese and Western Medicine, Chinese Evidence-based Medicine Center and Chinese Cochrane Center, West China Hospital, Sichuan University, Chengdu, 610041, China; NMPA Key Laboratory for Real World Data Research and Evaluation in Hainan, Chengdu, 610041, China; China Sichuan Center of Technology Innovation for Real World Data, Chengdu, 610041, China
| | - Jiali Liu
- Institute of Integrated Traditional Chinese and Western Medicine, Chinese Evidence-based Medicine Center and Chinese Cochrane Center, West China Hospital, Sichuan University, Chengdu, 610041, China; NMPA Key Laboratory for Real World Data Research and Evaluation in Hainan, Chengdu, 610041, China; China Sichuan Center of Technology Innovation for Real World Data, Chengdu, 610041, China
| | - Yanmei Liu
- Institute of Integrated Traditional Chinese and Western Medicine, Chinese Evidence-based Medicine Center and Chinese Cochrane Center, West China Hospital, Sichuan University, Chengdu, 610041, China; NMPA Key Laboratory for Real World Data Research and Evaluation in Hainan, Chengdu, 610041, China; China Sichuan Center of Technology Innovation for Real World Data, Chengdu, 610041, China
| | - Yu Ma
- Institute of Integrated Traditional Chinese and Western Medicine, Chinese Evidence-based Medicine Center and Chinese Cochrane Center, West China Hospital, Sichuan University, Chengdu, 610041, China; NMPA Key Laboratory for Real World Data Research and Evaluation in Hainan, Chengdu, 610041, China; China Sichuan Center of Technology Innovation for Real World Data, Chengdu, 610041, China
| | - Xiaochao Luo
- Institute of Integrated Traditional Chinese and Western Medicine, Chinese Evidence-based Medicine Center and Chinese Cochrane Center, West China Hospital, Sichuan University, Chengdu, 610041, China; NMPA Key Laboratory for Real World Data Research and Evaluation in Hainan, Chengdu, 610041, China; China Sichuan Center of Technology Innovation for Real World Data, Chengdu, 610041, China
| | - Fan Mei
- Institute of Integrated Traditional Chinese and Western Medicine, Chinese Evidence-based Medicine Center and Chinese Cochrane Center, West China Hospital, Sichuan University, Chengdu, 610041, China; NMPA Key Laboratory for Real World Data Research and Evaluation in Hainan, Chengdu, 610041, China; China Sichuan Center of Technology Innovation for Real World Data, Chengdu, 610041, China
| | - Hunong Xiang
- Institute of Integrated Traditional Chinese and Western Medicine, Chinese Evidence-based Medicine Center and Chinese Cochrane Center, West China Hospital, Sichuan University, Chengdu, 610041, China; NMPA Key Laboratory for Real World Data Research and Evaluation in Hainan, Chengdu, 610041, China; China Sichuan Center of Technology Innovation for Real World Data, Chengdu, 610041, China
| | - Kang Zou
- Institute of Integrated Traditional Chinese and Western Medicine, Chinese Evidence-based Medicine Center and Chinese Cochrane Center, West China Hospital, Sichuan University, Chengdu, 610041, China; NMPA Key Laboratory for Real World Data Research and Evaluation in Hainan, Chengdu, 610041, China; China Sichuan Center of Technology Innovation for Real World Data, Chengdu, 610041, China
| | - Xin Sun
- Institute of Integrated Traditional Chinese and Western Medicine, Chinese Evidence-based Medicine Center and Chinese Cochrane Center, West China Hospital, Sichuan University, Chengdu, 610041, China; NMPA Key Laboratory for Real World Data Research and Evaluation in Hainan, Chengdu, 610041, China; China Sichuan Center of Technology Innovation for Real World Data, Chengdu, 610041, China.
| | - Ling Li
- Institute of Integrated Traditional Chinese and Western Medicine, Chinese Evidence-based Medicine Center and Chinese Cochrane Center, West China Hospital, Sichuan University, Chengdu, 610041, China; NMPA Key Laboratory for Real World Data Research and Evaluation in Hainan, Chengdu, 610041, China; China Sichuan Center of Technology Innovation for Real World Data, Chengdu, 610041, China.
| |
Collapse
|
3
|
Dimairo M, Pallmann P, Wason J, Todd S, Jaki T, Julious SA, Mander AP, Weir CJ, Koenig F, Walton MK, Nicholl JP, Coates E, Biggs K, Hamasaki T, Proschan MA, Scott JA, Ando Y, Hind D, Altman DG. The adaptive designs CONSORT extension (ACE) statement: a checklist with explanation and elaboration guideline for reporting randomised trials that use an adaptive design. Trials 2020; 21:528. [PMID: 32546273 PMCID: PMC7298968 DOI: 10.1186/s13063-020-04334-x] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/11/2022] Open
Abstract
Adaptive designs (ADs) allow pre-planned changes to an ongoing trial without compromising the validity of conclusions and it is essential to distinguish pre-planned from unplanned changes that may also occur. The reporting of ADs in randomised trials is inconsistent and needs improving. Incompletely reported AD randomised trials are difficult to reproduce and are hard to interpret and synthesise. This consequently hampers their ability to inform practice as well as future research and contributes to research waste. Better transparency and adequate reporting will enable the potential benefits of ADs to be realised.This extension to the Consolidated Standards Of Reporting Trials (CONSORT) 2010 statement was developed to enhance the reporting of randomised AD clinical trials. We developed an Adaptive designs CONSORT Extension (ACE) guideline through a two-stage Delphi process with input from multidisciplinary key stakeholders in clinical trials research in the public and private sectors from 21 countries, followed by a consensus meeting. Members of the CONSORT Group were involved during the development process.The paper presents the ACE checklists for AD randomised trial reports and abstracts, as well as an explanation with examples to aid the application of the guideline. The ACE checklist comprises seven new items, nine modified items, six unchanged items for which additional explanatory text clarifies further considerations for ADs, and 20 unchanged items not requiring further explanatory text. The ACE abstract checklist has one new item, one modified item, one unchanged item with additional explanatory text for ADs, and 15 unchanged items not requiring further explanatory text.The intention is to enhance transparency and improve reporting of AD randomised trials to improve the interpretability of their results and reproducibility of their methods, results and inference. We also hope indirectly to facilitate the much-needed knowledge transfer of innovative trial designs to maximise their potential benefits. In order to encourage its wide dissemination this article is freely accessible on the BMJ and Trials journal websites."To maximise the benefit to society, you need to not just do research but do it well" Douglas G Altman.
Collapse
Affiliation(s)
- Munyaradzi Dimairo
- School of Health and Related Research, University of Sheffield, Sheffield, S1 4DA, UK.
| | | | - James Wason
- MRC Biostatistics Unit, University of Cambridge, Cambridge, UK
- Institute of Health and Society, Newcastle University, Newcastle, UK
| | - Susan Todd
- Department of Mathematics and Statistics, University of Reading, Reading, UK
| | - Thomas Jaki
- Department of Mathematics and Statistics, Lancaster University, Lancaster, UK
| | - Steven A Julious
- School of Health and Related Research, University of Sheffield, Sheffield, S1 4DA, UK
| | - Adrian P Mander
- Centre for Trials Research, Cardiff University, Cardiff, UK
- MRC Biostatistics Unit, University of Cambridge, Cambridge, UK
| | - Christopher J Weir
- Edinburgh Clinical Trials Unit, Usher Institute, University of Edinburgh, Edinburgh, UK
| | - Franz Koenig
- Centre for Medical Statistics, Informatics, and Intelligent Systems, Medical University of Vienna, Vienna, Austria
| | - Marc K Walton
- Janssen Pharmaceuticals, Titusville, New Jersey, USA
| | - Jon P Nicholl
- School of Health and Related Research, University of Sheffield, Sheffield, S1 4DA, UK
| | - Elizabeth Coates
- School of Health and Related Research, University of Sheffield, Sheffield, S1 4DA, UK
| | - Katie Biggs
- School of Health and Related Research, University of Sheffield, Sheffield, S1 4DA, UK
| | | | - Michael A Proschan
- National Institute of Allergy and Infectious Diseases, National Institutes of Health, Bethesda, USA
| | - John A Scott
- Division of Biostatistics in the Center for Biologics Evaluation and Research, Food and Drug Administration, Rockville, USA
| | - Yuki Ando
- Pharmaceuticals and Medical Devices Agency, Tokyo, Japan
| | - Daniel Hind
- School of Health and Related Research, University of Sheffield, Sheffield, S1 4DA, UK
| | - Douglas G Altman
- Centre for Statistics in Medicine, University of Oxford, Oxford, UK
| |
Collapse
|
4
|
Dimairo M, Pallmann P, Wason J, Todd S, Jaki T, Julious SA, Mander AP, Weir CJ, Koenig F, Walton MK, Nicholl JP, Coates E, Biggs K, Hamasaki T, Proschan MA, Scott JA, Ando Y, Hind D, Altman DG. The Adaptive designs CONSORT Extension (ACE) statement: a checklist with explanation and elaboration guideline for reporting randomised trials that use an adaptive design. BMJ 2020; 369:m115. [PMID: 32554564 PMCID: PMC7298567 DOI: 10.1136/bmj.m115] [Citation(s) in RCA: 55] [Impact Index Per Article: 13.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Accepted: 11/19/2019] [Indexed: 12/11/2022]
Abstract
Adaptive designs (ADs) allow pre-planned changes to an ongoing trial without compromising the validity of conclusions and it is essential to distinguish pre-planned from unplanned changes that may also occur. The reporting of ADs in randomised trials is inconsistent and needs improving. Incompletely reported AD randomised trials are difficult to reproduce and are hard to interpret and synthesise. This consequently hampers their ability to inform practice as well as future research and contributes to research waste. Better transparency and adequate reporting will enable the potential benefits of ADs to be realised.This extension to the Consolidated Standards Of Reporting Trials (CONSORT) 2010 statement was developed to enhance the reporting of randomised AD clinical trials. We developed an Adaptive designs CONSORT Extension (ACE) guideline through a two-stage Delphi process with input from multidisciplinary key stakeholders in clinical trials research in the public and private sectors from 21 countries, followed by a consensus meeting. Members of the CONSORT Group were involved during the development process.The paper presents the ACE checklists for AD randomised trial reports and abstracts, as well as an explanation with examples to aid the application of the guideline. The ACE checklist comprises seven new items, nine modified items, six unchanged items for which additional explanatory text clarifies further considerations for ADs, and 20 unchanged items not requiring further explanatory text. The ACE abstract checklist has one new item, one modified item, one unchanged item with additional explanatory text for ADs, and 15 unchanged items not requiring further explanatory text.The intention is to enhance transparency and improve reporting of AD randomised trials to improve the interpretability of their results and reproducibility of their methods, results and inference. We also hope indirectly to facilitate the much-needed knowledge transfer of innovative trial designs to maximise their potential benefits.
Collapse
Affiliation(s)
- Munyaradzi Dimairo
- School of Health and Related Research, University of Sheffield, Sheffield S1 4DA, UK
| | | | - James Wason
- MRC Biostatistics Unit, University of Cambridge, UK
- Institute of Health and Society, Newcastle University, UK
| | - Susan Todd
- Department of Mathematics and Statistics, University of Reading, UK
| | - Thomas Jaki
- Department of Mathematics and Statistics, Lancaster University, UK
| | - Steven A Julious
- School of Health and Related Research, University of Sheffield, Sheffield S1 4DA, UK
| | - Adrian P Mander
- Centre for Trials Research, Cardiff University, UK
- MRC Biostatistics Unit, University of Cambridge, UK
| | - Christopher J Weir
- Edinburgh Clinical Trials Unit, Usher Institute, University of Edinburgh, UK
| | - Franz Koenig
- Centre for Medical Statistics, Informatics, and Intelligent Systems, Medical University of Vienna, Austria
| | | | - Jon P Nicholl
- School of Health and Related Research, University of Sheffield, Sheffield S1 4DA, UK
| | - Elizabeth Coates
- School of Health and Related Research, University of Sheffield, Sheffield S1 4DA, UK
| | - Katie Biggs
- School of Health and Related Research, University of Sheffield, Sheffield S1 4DA, UK
| | | | - Michael A Proschan
- National Institute of Allergy and Infectious Diseases, National Institutes of Health, USA
| | - John A Scott
- Division of Biostatistics in the Center for Biologics Evaluation and Research, Food and Drug Administration, USA
| | - Yuki Ando
- Pharmaceuticals and Medical Devices Agency, Japan
| | - Daniel Hind
- School of Health and Related Research, University of Sheffield, Sheffield S1 4DA, UK
| | | |
Collapse
|
5
|
Van Norman GA. Phase II Trials in Drug Development and Adaptive Trial Design. JACC Basic Transl Sci 2019; 4:428-437. [PMID: 31312766 PMCID: PMC6609997 DOI: 10.1016/j.jacbts.2019.02.005] [Citation(s) in RCA: 56] [Impact Index Per Article: 11.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/11/2019] [Accepted: 02/14/2019] [Indexed: 12/20/2022]
Abstract
Phase II clinical studies represent a critical point in determining drug costs, and phase II is a poor predictor of drug success: >30% of drugs entering phase II studies fail to progress, and >58% of drugs go on to fail in phase III. Adaptive clinical trial design has been proposed as a way to reduce the costs of phase II testing by providing earlier determination of futility and prediction of phase III success, reducing overall phase II and III trial sizes, and shortening overall drug development time. This review examines issues in phase II testing and adaptive trial design.
Collapse
Affiliation(s)
- Gail A. Van Norman
- Department of Anesthesiology and Pain Medicine, University of Washington, Seattle, Washington
| |
Collapse
|
6
|
Dimairo M, Coates E, Pallmann P, Todd S, Julious SA, Jaki T, Wason J, Mander AP, Weir CJ, Koenig F, Walton MK, Biggs K, Nicholl J, Hamasaki T, Proschan MA, Scott JA, Ando Y, Hind D, Altman DG. Development process of a consensus-driven CONSORT extension for randomised trials using an adaptive design. BMC Med 2018; 16:210. [PMID: 30442137 PMCID: PMC6238302 DOI: 10.1186/s12916-018-1196-2] [Citation(s) in RCA: 22] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/05/2018] [Accepted: 10/23/2018] [Indexed: 11/12/2022] Open
Abstract
BACKGROUND Adequate reporting of adaptive designs (ADs) maximises their potential benefits in the conduct of clinical trials. Transparent reporting can help address some obstacles and concerns relating to the use of ADs. Currently, there are deficiencies in the reporting of AD trials. To overcome this, we have developed a consensus-driven extension to the CONSORT statement for randomised trials using an AD. This paper describes the processes and methods used to develop this extension rather than detailed explanation of the guideline. METHODS We developed the guideline in seven overlapping stages: 1) Building on prior research to inform the need for a guideline; 2) A scoping literature review to inform future stages; 3) Drafting the first checklist version involving an External Expert Panel; 4) A two-round Delphi process involving international, multidisciplinary, and cross-sector key stakeholders; 5) A consensus meeting to advise which reporting items to retain through voting, and to discuss the structure of what to include in the supporting explanation and elaboration (E&E) document; 6) Refining and finalising the checklist; and 7) Writing-up and dissemination of the E&E document. The CONSORT Executive Group oversaw the entire development process. RESULTS Delphi survey response rates were 94/143 (66%), 114/156 (73%), and 79/143 (55%) in rounds 1, 2, and across both rounds, respectively. Twenty-seven delegates from Europe, the USA, and Asia attended the consensus meeting. The main checklist has seven new and nine modified items and six unchanged items with expanded E&E text to clarify further considerations for ADs. The abstract checklist has one new and one modified item together with an unchanged item with expanded E&E text. The E&E document will describe the scope of the guideline, the definition of an AD, and some types of ADs and trial adaptations and explain each reporting item in detail including case studies. CONCLUSIONS We hope that making the development processes, methods, and all supporting information that aided decision-making transparent will enhance the acceptability and quick uptake of the guideline. This will also help other groups when developing similar CONSORT extensions. The guideline is applicable to all randomised trials with an AD and contains minimum reporting requirements.
Collapse
Affiliation(s)
- Munyaradzi Dimairo
- School of Health and Related Research, University of Sheffield, Regent Court, 30 Regent Street, Sheffield, S1 4DA, UK.
| | - Elizabeth Coates
- School of Health and Related Research, University of Sheffield, Regent Court, 30 Regent Street, Sheffield, S1 4DA, UK
| | | | | | - Steven A Julious
- School of Health and Related Research, University of Sheffield, Regent Court, 30 Regent Street, Sheffield, S1 4DA, UK
| | | | - James Wason
- MRC Biostatistics Unit, University of Cambridge, Cambridge, UK
- Institute of Health and Society, Newcastle University, Newcastle upon Tyne, UK
| | - Adrian P Mander
- MRC Biostatistics Unit, University of Cambridge, Cambridge, UK
| | | | - Franz Koenig
- Centre for Medical Statistics, Informatics, and Intelligent Systems, Medical University of Vienna, Vienna, Austria
| | - Marc K Walton
- Janssen Pharmaceuticals, Titusville, New Jersey, USA
| | - Katie Biggs
- School of Health and Related Research, University of Sheffield, Regent Court, 30 Regent Street, Sheffield, S1 4DA, UK
| | - Jon Nicholl
- School of Health and Related Research, University of Sheffield, Regent Court, 30 Regent Street, Sheffield, S1 4DA, UK
| | | | - Michael A Proschan
- National Institute of Allergy and Infectious Diseases, National Institutes of Health, Bethesda, USA
| | - John A Scott
- Division of Biostatistics in the Center for Biologics Evaluation and Research, Food and Drug Administration, White Oak, USA
| | - Yuki Ando
- Pharmaceuticals and Medical Devices Agency, Tokyo, Japan
| | - Daniel Hind
- School of Health and Related Research, University of Sheffield, Regent Court, 30 Regent Street, Sheffield, S1 4DA, UK
| | | |
Collapse
|
7
|
Pallmann P, Bedding AW, Choodari-Oskooei B, Dimairo M, Flight L, Hampson LV, Holmes J, Mander AP, Odondi L, Sydes MR, Villar SS, Wason JMS, Weir CJ, Wheeler GM, Yap C, Jaki T. Adaptive designs in clinical trials: why use them, and how to run and report them. BMC Med 2018; 16:29. [PMID: 29490655 PMCID: PMC5830330 DOI: 10.1186/s12916-018-1017-7] [Citation(s) in RCA: 361] [Impact Index Per Article: 60.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/10/2017] [Accepted: 01/30/2018] [Indexed: 12/11/2022] Open
Abstract
Adaptive designs can make clinical trials more flexible by utilising results accumulating in the trial to modify the trial's course in accordance with pre-specified rules. Trials with an adaptive design are often more efficient, informative and ethical than trials with a traditional fixed design since they often make better use of resources such as time and money, and might require fewer participants. Adaptive designs can be applied across all phases of clinical research, from early-phase dose escalation to confirmatory trials. The pace of the uptake of adaptive designs in clinical research, however, has remained well behind that of the statistical literature introducing new methods and highlighting their potential advantages. We speculate that one factor contributing to this is that the full range of adaptations available to trial designs, as well as their goals, advantages and limitations, remains unfamiliar to many parts of the clinical community. Additionally, the term adaptive design has been misleadingly used as an all-encompassing label to refer to certain methods that could be deemed controversial or that have been inadequately implemented.We believe that even if the planning and analysis of a trial is undertaken by an expert statistician, it is essential that the investigators understand the implications of using an adaptive design, for example, what the practical challenges are, what can (and cannot) be inferred from the results of such a trial, and how to report and communicate the results. This tutorial paper provides guidance on key aspects of adaptive designs that are relevant to clinical triallists. We explain the basic rationale behind adaptive designs, clarify ambiguous terminology and summarise the utility and pitfalls of adaptive designs. We discuss practical aspects around funding, ethical approval, treatment supply and communication with stakeholders and trial participants. Our focus, however, is on the interpretation and reporting of results from adaptive design trials, which we consider vital for anyone involved in medical research. We emphasise the general principles of transparency and reproducibility and suggest how best to put them into practice.
Collapse
Affiliation(s)
- Philip Pallmann
- Department of Mathematics & Statistics, Lancaster University, Lancaster, LA1 4YF UK
| | | | - Babak Choodari-Oskooei
- MRC Clinical Trials Unit at UCL, Institute of Clinical Trials and Methodology, University College London, London, UK
| | | | - Laura Flight
- Medical Statistics Group, University of Sheffield, Sheffield, UK
| | - Lisa V. Hampson
- Department of Mathematics & Statistics, Lancaster University, Lancaster, LA1 4YF UK
- Statistical Innovation Group, Advanced Analytics Centre, AstraZeneca, Cambridge, UK
| | - Jane Holmes
- Centre for Statistics in Medicine, University of Oxford, Oxford, UK
| | | | - Lang’o Odondi
- Centre for Statistics in Medicine, University of Oxford, Oxford, UK
| | - Matthew R. Sydes
- MRC Clinical Trials Unit at UCL, Institute of Clinical Trials and Methodology, University College London, London, UK
| | - Sofía S. Villar
- MRC Biostatistics Unit, University of Cambridge, Cambridge, UK
| | - James M. S. Wason
- MRC Biostatistics Unit, University of Cambridge, Cambridge, UK
- Institute of Health and Society, Newcastle University, Newcastle, UK
| | - Christopher J. Weir
- Usher Institute of Population Health Sciences and Informatics, University of Edinburgh, Edinburgh, UK
| | - Graham M. Wheeler
- MRC Biostatistics Unit, University of Cambridge, Cambridge, UK
- Cancer Research UK & UCL Cancer Trials Centre, University College London, London, UK
| | - Christina Yap
- Cancer Research UK Clinical Trials Unit, University of Birmingham, Birmingham, UK
| | - Thomas Jaki
- Department of Mathematics & Statistics, Lancaster University, Lancaster, LA1 4YF UK
| |
Collapse
|
8
|
Abstract
OBJECTIVES This review investigates characteristics of implemented adaptive design clinical trials and provides examples of regulatory experience with such trials. DESIGN Review of adaptive design clinical trials in EMBASE, PubMed, Cochrane Registry of Controlled Clinical Trials, Web of Science and ClinicalTrials.gov. Phase I and seamless Phase I/II trials were excluded. Variables extracted from trials included basic study characteristics, adaptive design features, size and use of independent data monitoring committees (DMCs) and blinded interim analyses. We also examined use of the adaptive trials in new drug submissions to the Food and Drug Administration (FDA) and European Medicines Agency (EMA) and recorded regulators' experiences with adaptive designs. RESULTS 142 studies met inclusion criteria. There has been a recent growth in publicly reported use of adaptive designs among researchers around the world. The most frequently appearing types of adaptations were seamless Phase II/III (57%), group sequential (21%), biomarker adaptive (20%), and adaptive dose-finding designs (16%). About one-third (32%) of trials reported an independent DMC, while 6% reported blinded interim analysis. We found that 9% of adaptive trials were used for FDA product approval consideration, and 12% were used for EMA product approval consideration. International regulators had mixed experiences with adaptive trials. Many product applications with adaptive trials had extensive correspondence between drug sponsors and regulators regarding the adaptive designs, in some cases with regulators requiring revisions or alterations to research designs. CONCLUSIONS Wider use of adaptive designs will necessitate new drug application sponsors to engage with regulatory scientists during planning and conduct of the trials. Investigators need to more consistently report protections intended to preserve confidentiality and minimise potential operational bias during interim analysis.
Collapse
Affiliation(s)
- Laura E Bothwell
- Program on Regulation, Therapeutics, and Law (PORTAL), Division of Pharmacoepidemiology and Pharmacoeconomics, Department of Medicine, Brigham and Women's Hospital and Harvard Medical School, Boston, Massachusetts, USA
| | - Jerry Avorn
- Program on Regulation, Therapeutics, and Law (PORTAL), Division of Pharmacoepidemiology and Pharmacoeconomics, Department of Medicine, Brigham and Women's Hospital and Harvard Medical School, Boston, Massachusetts, USA
| | - Nazleen F Khan
- Program on Regulation, Therapeutics, and Law (PORTAL), Division of Pharmacoepidemiology and Pharmacoeconomics, Department of Medicine, Brigham and Women's Hospital and Harvard Medical School, Boston, Massachusetts, USA
| | - Aaron S Kesselheim
- Program on Regulation, Therapeutics, and Law (PORTAL), Division of Pharmacoepidemiology and Pharmacoeconomics, Department of Medicine, Brigham and Women's Hospital and Harvard Medical School, Boston, Massachusetts, USA
| |
Collapse
|
9
|
Mistry P, Dunn JA, Marshall A. A literature review of applied adaptive design methodology within the field of oncology in randomised controlled trials and a proposed extension to the CONSORT guidelines. BMC Med Res Methodol 2017; 17:108. [PMID: 28720094 PMCID: PMC5516365 DOI: 10.1186/s12874-017-0393-6] [Citation(s) in RCA: 25] [Impact Index Per Article: 3.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/20/2017] [Accepted: 07/10/2017] [Indexed: 11/30/2022] Open
Abstract
Background The application of adaptive design methodology within a clinical trial setting is becoming increasingly popular. However the application of these methods within trials is not being reported as adaptive designs hence making it more difficult to capture the emerging use of these designs. Within this review, we aim to understand how adaptive design methodology is being reported, whether these methods are explicitly stated as an ‘adaptive design’ or if it has to be inferred and to identify whether these methods are applied prospectively or concurrently. Methods Three databases; Embase, Ovid and PubMed were chosen to conduct the literature search. The inclusion criteria for the review were phase II, phase III and phase II/III randomised controlled trials within the field of Oncology that published trial results in 2015. A variety of search terms related to adaptive designs were used. Results A total of 734 results were identified, after screening 54 were eligible. Adaptive designs were more commonly applied in phase III confirmatory trials. The majority of the papers performed an interim analysis, which included some sort of stopping criteria. Additionally only two papers explicitly stated the term ‘adaptive design’ and therefore for most of the papers, it had to be inferred that adaptive methods was applied. Sixty-five applications of adaptive design methods were applied, from which the most common method was an adaptation using group sequential methods. Conclusions This review indicated that the reporting of adaptive design methodology within clinical trials needs improving. The proposed extension to the current CONSORT 2010 guidelines could help capture adaptive design methods. Furthermore provide an essential aid to those involved with clinical trials. Electronic supplementary material The online version of this article (doi:10.1186/s12874-017-0393-6) contains supplementary material, which is available to authorized users.
Collapse
Affiliation(s)
- Pankaj Mistry
- Warwick Clinical Trials Unit, University of Warwick, Gibbet Hill Road, Coventry, CV4 7AL, UK.
| | - Janet A Dunn
- Warwick Clinical Trials Unit, University of Warwick, Gibbet Hill Road, Coventry, CV4 7AL, UK
| | - Andrea Marshall
- Warwick Clinical Trials Unit, University of Warwick, Gibbet Hill Road, Coventry, CV4 7AL, UK
| |
Collapse
|
10
|
Asikanius E, Rufibach K, Bahlo J, Bieska G, Burger HU. Comparison of design strategies for a three-arm clinical trial with time-to-event endpoint: Power, time-to-analysis, and operational aspects. Biom J 2016; 58:1295-1310. [PMID: 27346746 DOI: 10.1002/bimj.201500077] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/11/2015] [Revised: 02/17/2016] [Accepted: 03/31/2016] [Indexed: 12/17/2022]
Abstract
To optimize resources, randomized clinical trials with multiple arms can be an attractive option to simultaneously test various treatment regimens in pharmaceutical drug development. The motivation for this work was the successful conduct and positive final outcome of a three-arm randomized clinical trial primarily assessing whether obinutuzumab plus chlorambucil in patients with chronic lympocytic lymphoma and coexisting conditions is superior to chlorambucil alone based on a time-to-event endpoint. The inference strategy of this trial was based on a closed testing procedure. We compare this strategy to three potential alternatives to run a three-arm clinical trial with a time-to-event endpoint. The primary goal is to quantify the differences between these strategies in terms of the time it takes until the first analysis and thus potential approval of a new drug, number of required events, and power. Operational aspects of implementing the various strategies are discussed. In conclusion, using a closed testing procedure results in the shortest time to the first analysis with a minimal loss in power. Therefore, closed testing procedures should be part of the statistician's standard clinical trials toolbox when planning multiarm clinical trials.
Collapse
Affiliation(s)
| | | | - Jasmin Bahlo
- German CLL Study Group, Department I of Internal Medicine, University Hospital Cologne, Cologne, Germany
| | | | | |
Collapse
|
11
|
Flight L, Julious SA, Goodacre S. Can emergency medicine research benefit from adaptive design clinical trials? Emerg Med J 2016; 34:243-248. [DOI: 10.1136/emermed-2016-206046] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/11/2016] [Accepted: 10/03/2016] [Indexed: 11/04/2022]
|
12
|
Grieve AP. Response-adaptive clinical trials: case studies in the medical literature. Pharm Stat 2016; 16:64-86. [PMID: 27730735 DOI: 10.1002/pst.1778] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/24/2016] [Revised: 07/02/2016] [Accepted: 08/19/2016] [Indexed: 12/20/2022]
Abstract
The past 15 years has seen many pharmaceutical sponsors consider and implement adaptive designs (AD) across all phases of drug development. Given their arrival at the turn of the millennium, we might think that they are a recent invention. That is not the case. The earliest idea of an AD predates Bradford Hill's MRC tuberculosis study, appearing in Biometrika in 1933. In this paper, we trace the development of response-ADs, designs in which the allocation to intervention arms depends on the responses of subjects already treated. We describe some statistical details underlying the designs, but our main focus is to describe and comment on ADs from the medical research literature. Copyright © 2016 John Wiley & Sons, Ltd.
Collapse
Affiliation(s)
- Andrew P Grieve
- Innovation Centre, 3 Globeside Business Park, Marlow, Buckinghamshire, SL7 1HZ, UK
| |
Collapse
|
13
|
Hatfield I, Allison A, Flight L, Julious SA, Dimairo M. Adaptive designs undertaken in clinical research: a review of registered clinical trials. Trials 2016; 17:150. [PMID: 26993469 PMCID: PMC4799596 DOI: 10.1186/s13063-016-1273-9] [Citation(s) in RCA: 60] [Impact Index Per Article: 7.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/04/2015] [Accepted: 03/02/2016] [Indexed: 12/25/2022] Open
Abstract
Adaptive designs have the potential to improve efficiency in the evaluation of new medical treatments in comparison to traditional fixed sample size designs. However, they are still not widely used in practice in clinical research. Little research has been conducted to investigate what adaptive designs are being undertaken. This review highlights the current state of registered adaptive designs and their characteristics. The review looked at phase II, II/III and III trials registered on ClinicalTrials.gov from 29 February 2000 to 1 June 2014, supplemented with trials from the National Institute for Health Research register and known adaptive trials. A range of adaptive design search terms were applied to the trials extracted from each database. Characteristics of the adaptive designs were then recorded including funder, therapeutic area and type of adaptation. The results in the paper suggest that the use of adaptive designs has increased. They seem to be most often used in phase II trials and in oncology. In phase III trials, the most popular form of adaptation is the group sequential design. The review failed to capture all trials with adaptive designs, which suggests that the reporting of adaptive designs, such as in clinical trials registers, needs much improving. We recommend that clinical trial registers should contain sections dedicated to the type and scope of the adaptation and that the term 'adaptive design' should be included in the trial title or at least in the brief summary or design sections.
Collapse
Affiliation(s)
- Isabella Hatfield
- />School of Mathematics & Statistics, Newcastle University, Herschel Building, Newcastle upon Tyne, NE1 7RU UK
- />ScHARR, University of Sheffield, 30 Regent Street, Sheffield, S1 4DA UK
| | - Annabel Allison
- />ScHARR, University of Sheffield, 30 Regent Street, Sheffield, S1 4DA UK
- />MRC Biostatistics Unit, Cambridge Institute of Public Health, Forvie Site, Robinson Way, Cambridge Biomedical Campus, Cambridge, CB2 0SR UK
| | - Laura Flight
- />ScHARR, University of Sheffield, 30 Regent Street, Sheffield, S1 4DA UK
| | - Steven A. Julious
- />ScHARR, University of Sheffield, 30 Regent Street, Sheffield, S1 4DA UK
| | - Munyaradzi Dimairo
- />ScHARR, University of Sheffield, 30 Regent Street, Sheffield, S1 4DA UK
| |
Collapse
|
14
|
Majid A, Bae ON, Redgrave J, Teare D, Ali A, Zemke D. The Potential of Adaptive Design in Animal Studies. Int J Mol Sci 2015; 16:24048-58. [PMID: 26473839 PMCID: PMC4632737 DOI: 10.3390/ijms161024048] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/01/2015] [Revised: 09/23/2015] [Accepted: 09/27/2015] [Indexed: 11/30/2022] Open
Abstract
Clinical trials are the backbone of medical research, and are often the last step in the development of new therapies for use in patients. Prior to human testing, however, preclinical studies using animal subjects are usually performed in order to provide initial data on the safety and effectiveness of prospective treatments. These studies can be costly and time consuming, and may also raise concerns about the ethical treatment of animals when potentially harmful procedures are involved. Adaptive design is a process by which the methods used in a study may be altered while it is being conducted in response to preliminary data or other new information. Adaptive design has been shown to be useful in reducing the time and costs associated with clinical trials, and may provide similar benefits in preclinical animal studies. The purpose of this review is to summarize various aspects of adaptive design and evaluate its potential for use in preclinical research.
Collapse
Affiliation(s)
- Arshad Majid
- Sheffield Institute for Translational Neuroscience, University of Sheffield, Sheffield S10 2HQ, UK.
| | - Ok-Nam Bae
- College of Pharmacy Institute of Pharmaceutical Science and Technology, Hanyang University, Ansan 426-791, Korea.
| | - Jessica Redgrave
- Sheffield Institute for Translational Neuroscience, University of Sheffield, Sheffield S10 2HQ, UK.
| | - Dawn Teare
- School of Health and Related Research, University of Sheffield, Sheffield S10 2HQ, UK.
| | - Ali Ali
- Sheffield Institute for Translational Neuroscience, University of Sheffield, Sheffield S10 2HQ, UK.
| | - Daniel Zemke
- Sheffield Institute for Translational Neuroscience, University of Sheffield, Sheffield S10 2HQ, UK.
| |
Collapse
|
15
|
Klinglmueller F, Posch M, Koenig F. Adaptive graph-based multiple testing procedures. Pharm Stat 2014; 13:345-56. [PMID: 25319733 PMCID: PMC4789493 DOI: 10.1002/pst.1640] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/26/2013] [Revised: 08/13/2014] [Accepted: 08/26/2014] [Indexed: 11/17/2022]
Abstract
Multiple testing procedures defined by directed, weighted graphs have recently been proposed as an intuitive visual tool for constructing multiple testing strategies that reflect the often complex contextual relations between hypotheses in clinical trials. Many well-known sequentially rejective tests, such as (parallel) gatekeeping tests or hierarchical testing procedures are special cases of the graph based tests. We generalize these graph-based multiple testing procedures to adaptive trial designs with an interim analysis. These designs permit mid-trial design modifications based on unblinded interim data as well as external information, while providing strong family wise error rate control. To maintain the familywise error rate, it is not required to prespecify the adaption rule in detail. Because the adaptive test does not require knowledge of the multivariate distribution of test statistics, it is applicable in a wide range of scenarios including trials with multiple treatment comparisons, endpoints or subgroups, or combinations thereof. Examples of adaptations are dropping of treatment arms, selection of subpopulations, and sample size reassessment. If, in the interim analysis, it is decided to continue the trial as planned, the adaptive test reduces to the originally planned multiple testing procedure. Only if adaptations are actually implemented, an adjusted test needs to be applied. The procedure is illustrated with a case study and its operating characteristics are investigated by simulations.
Collapse
Affiliation(s)
- Florian Klinglmueller
- Center for Medical Statistics, Informatics, and Intelligent Systems,
Medical University of Vienna, Spitalgasse 23, 1090 Vienna, Austria
| | - Martin Posch
- Center for Medical Statistics, Informatics, and Intelligent Systems,
Medical University of Vienna, Spitalgasse 23, 1090 Vienna, Austria
| | - Franz Koenig
- Center for Medical Statistics, Informatics, and Intelligent Systems,
Medical University of Vienna, Spitalgasse 23, 1090 Vienna, Austria
| |
Collapse
|
16
|
Leuchs AK, Neuhäuser M. A modified combination test for the analysis of a clinical trial when a protocol amendment changed the inclusion criteria. J STAT COMPUT SIM 2013. [DOI: 10.1080/00949655.2011.638635] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/14/2022]
|
17
|
Hampson LV, Jennison C. Group sequential tests for delayed responses (with discussion). J R Stat Soc Series B Stat Methodol 2012. [DOI: 10.1111/j.1467-9868.2012.01030.x] [Citation(s) in RCA: 61] [Impact Index Per Article: 5.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/02/2023]
|
18
|
Wunder C, Kopp-Schneider A, Edler L. An adaptive group sequential phase II design to compare treatments for survival endpoints in rare patient entities. J Biopharm Stat 2012; 22:294-311. [PMID: 22251175 DOI: 10.1080/10543406.2010.531831] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/14/2022]
Abstract
For rare diseases, standard treatments are often not available and essential study parameters are difficult or impossible to obtain. Therefore, designs of clinical trials for these diseases are often based on little information. Adaptive designs allow such trials to be started and to gain information during the study. Motivated by a trial for a rare subtype of renal-cell carcinoma, we present a two-stage adaptive design for right-censored time-to-event data and a two-sided test. After the first stage, one can stop for futility or continue with reestimated sample size. The properties of such designs are analyzed by simulation studies.
Collapse
Affiliation(s)
- Christina Wunder
- Department of Biostatistics, German Cancer Research Center, Heidelberg, Germany.
| | | | | |
Collapse
|
19
|
Jiang Z, Xue F, Li C, Wang L, Cai H, Zhang C, Xia J. Design of adaptive two-stage double-arm clinical trials for dichotomous variables. Contemp Clin Trials 2010; 31:242-50. [PMID: 20172053 DOI: 10.1016/j.cct.2010.02.001] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/16/2009] [Revised: 01/28/2010] [Accepted: 02/10/2010] [Indexed: 10/19/2022]
Abstract
It is well known that flexibility is one of the major advantages of an adaptive two-stage design, and the intended adaptation should be as preplanned as possible to maintain the integrity of the clinical trial. The design of adaptive two-stage double-arm clinical trials for dichotomous variables was proposed by simulation and forecasting procedure at the planning stage. To further ensure the integrity of the clinical trial, the sample size scheme for each scenario, which was supposed to be based on the first stage, was provided in the protocol by Monte Carlo simulation. In addition, the study parameters were determined by comparing the assessment indexes such as total sample size, expected sample size and the test power at the first stage. Furthermore, Fisher's combination test and pooled data analysis were considered and compared through the simulation. The latter, which has the larger overall power and the better overall type I error control, with the same sample size was adopted for further simulation and statistical analysis in the clinical trial.
Collapse
Affiliation(s)
- Zhiwei Jiang
- Department of Health Statistics, Faculty of Preventative Medicine, Fourth Military Medical University, Xi'an, Shaanxi, China
| | | | | | | | | | | | | |
Collapse
|
20
|
Bretz F, Branson M, Burman CF, Chuang-Stein C, Coffey CS. Adaptivity in drug discovery and development. Drug Dev Res 2009. [DOI: 10.1002/ddr.20285] [Citation(s) in RCA: 19] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
|
21
|
Jahn-Eimermacher A, Ingel K. Adaptive trial design: a general methodology for censored time to event data. Contemp Clin Trials 2008; 30:171-7. [PMID: 19130902 DOI: 10.1016/j.cct.2008.12.002] [Citation(s) in RCA: 13] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/10/2008] [Revised: 11/25/2008] [Accepted: 12/08/2008] [Indexed: 10/21/2022]
Abstract
Adaptive designs allow a clinical trial design to be changed according to interim findings without inflating type I error. The Inverse Normal method can be considered as an adaptive generalization of classical group sequential designs. The use of the Inverse Normal method for censored survival data was demonstrated only for the logrank statistic. However, the logrank statistic is inefficient in the presence of nuisance covariates affecting survival. We demonstrate, how the Inverse Normal method can be applied to Cox regression analysis. The required independence between test statistics of the different stages of the trial can be obtained by two different approaches. One is using the independent increment structure of the score process. The other uses right censoring and left truncating to divide individuals follow-up into per-stage data. Simulation studies show, that performance of the adaptive design does not depend on the method used for obtaining independence. Either way, an adaptive Cox regression analyis is more efficient than an adaptive logrank analysis if nuisance covariates affect survival.
Collapse
Affiliation(s)
- Antje Jahn-Eimermacher
- Institute of Medical Biostatistics, Epidemiology and Informatics, University of Mainz, Mainz, Germany.
| | | |
Collapse
|
22
|
Abstract
Adaptive designs promise the flexibility to redesign clinical trials at interim stages. This flexibility would provide greater efficiency in drug development. However, despite this promise, many hesitate to implement such designs. Here we explore three possible reasons for the hesitation: (i) confusion with respect to the definition of an 'adaptive design'; (ii) controversy surrounding the use of sample size re-estimation methods; and (iii) logistical barriers that must be overcome in order to use adaptive designs within existing trial frameworks.The large volume of recent work has created confusion with respect to the definition of an 'adaptive design'. Unfortunately, this has resulted in reduced usage of many acceptable methods because of guilt by association with the more controversial methods. This review attempts to clarify the differences among many common types of proposed adaptive designs. Once the differences are noted, it becomes apparent that some adaptive designs are well accepted while others remain very controversial. In fact, much of the controversy and criticism surrounding adaptive designs has focused on their use for sample size re-estimation. Hence, this review also examines the different types of adaptive designs for sample size re-estimation in order to clarify the controversy surrounding the use of these methods. Specifically, separating the controversial from good practice requires clarifying differences between adaptive designs with sample size re-estimation based on a revised treatment effect and re-estimation based only on nuisance parameters (internal pilot designs). Finally, many logistical barriers must be overcome in order to use adaptive designs within existing trial frameworks.If the promise of adaptive designs is to be achieved, it will be important to bring together large groups of individuals from funding sources and regulatory agencies to address these limitations. Very few discussions of these issues have appeared in journals that are targeted to clinical audiences. In fact, current use of adaptive designs is not really hindered by the lack of statistical methods to accommodate the adaptations. Rather, there is a need for education as to which adaptive designs are acceptable and which are not acceptable. These discussions will require the involvement of many individuals outside the statistical community. In this review, we summarize the existing methods and current controversies with the intent of providing a clarification that will enable these individuals to participate in these much-needed discussions.
Collapse
Affiliation(s)
- Christopher S Coffey
- Department of Biostatistics, School of Public Health, University of Alabama Birmingham, Birmingham, Alabama, USA
| | | |
Collapse
|
23
|
Bauer P. Adaptive designs: looking for a needle in the haystack-a new challenge in medical research. Stat Med 2008; 27:1565-80. [PMID: 17935261 DOI: 10.1002/sim.3090] [Citation(s) in RCA: 14] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/06/2023]
Abstract
The statistical principles of fully adaptive designs are outlined. The options of flexibility and the price to be paid in terms of statistical properties of the test procedures are discussed. It is stressed that controlled inference after major design modifications (changing hypotheses) will include a penalty: Intersections among all the hypotheses considered throughout the trial have to be rejected before testing individual hypotheses. Moreover, feasibility in terms of integrity and persuasiveness of the results achieved after adaptations based on unblinded data is considered as the crucial issue in practice. In the second part, sample size adaptive procedures are considered testing a large number of hypotheses under constraints on total sample size as in genetic studies. The advantage of sequential procedures is sketched for the example of two-stage designs with a pilot phase for screening promising hypotheses (markers) and controlling the false discovery rate. Finally, we turn to the clinical problem how to select markers and estimate a score from limited samples, e.g. for predicting the response to therapy of a future patient. The predictive ability of such scores will be rather poor when investigating a large number of hypotheses and truly large marker effects are lacking. An obvious dilemma will show up: More optimistic selection rules may be superior if in fact effective markers exist, but will produce more nuisance prediction if no effective markers exist compared with more cautious strategies, e.g. aiming at some control of type I error probabilities.
Collapse
Affiliation(s)
- Peter Bauer
- Section of Medical Statistics, Medical University of Vienna, Vienna, Austria.
| |
Collapse
|
24
|
Bartroff J, Lai TL. Generalized Likelihood Ratio Statistics and Uncertainty Adjustments in Efficient Adaptive Design of Clinical Trials. Seq Anal 2008. [DOI: 10.1080/07474940802241009] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/21/2022]
|
25
|
Editorial – Year 2007 Report. Biom J 2008. [DOI: 10.1002/bimj.200810411] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
|
26
|
|
27
|
Brunner E, Schumacher M. Year 2006 – Report. Biom J 2007. [DOI: 10.1002/bimj.200710327] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
|
28
|
Saito H, Fujieda T, Naganuma H. Current status and issues of drug development strategy in Japan. ACTA ACUST UNITED AC 2007. [DOI: 10.2745/dds.22.65] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/05/2022]
|
29
|
Abstract
This is a discussion of the following three papers appearing in this special issue on adaptive designs: 'FDA's critical path initiative: A perspective on contributions of biostatistics' by Robert T. O'Neill, 'A regulatory view on adaptive/flexible clinical trial design' by H. M. James Hung, Robert T. O'Neill, Sue-Jane Wang and John Lawrence; and 'Confirmatory clinical trials with an adaptive design' by Armin Koch.
Collapse
Affiliation(s)
- Peter Bauer
- Core Unit for Medical Statistics and Informatics, Section of Medical Statistics, Medical University of Vienna, Spitalgasse 23, 1090 Vienna, Austria.
| |
Collapse
|