1
|
Xie CX, De Simoni A, Eldridge S, Pinnock H, Relton C. Development of a conceptual framework for defining trial efficiency. PLoS One 2024; 19:e0304187. [PMID: 38781167 PMCID: PMC11115328 DOI: 10.1371/journal.pone.0304187] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/04/2023] [Accepted: 05/07/2024] [Indexed: 05/25/2024] Open
Abstract
BACKGROUND Globally, there is a growing focus on efficient trials, yet numerous interpretations have emerged, suggesting a significant heterogeneity in understanding "efficiency" within the trial context. Therefore in this study, we aimed to dissect the multifaceted nature of trial efficiency by establishing a comprehensive conceptual framework for its definition. OBJECTIVES To collate diverse perspectives regarding trial efficiency and to achieve consensus on a conceptual framework for defining trial efficiency. METHODS From July 2022 to July 2023, we undertook a literature review to identify various terms that have been used to define trial efficiency. We then conducted a modified e-Delphi study, comprising an exploratory open round and a subsequent scoring round to refine and validate the identified items. We recruited a wide range of experts in the global trial community including trialists, funders, sponsors, journal editors and members of the public. Consensus was defined as items rated "without disagreement", measured by the inter-percentile range adjusted for symmetry through the UCLA/RAND approach. RESULTS Seventy-eight studies were identified from a literature review, from which we extracted nine terms related to trial efficiency. We then used review findings as exemplars in the Delphi open round. Forty-nine international experts were recruited to the e-Delphi panel. Open round responses resulted in the refinement of the initial nine terms, which were consequently included in the scoring round. We obtained consensus on all nine items: 1) four constructs that collectively define trial efficiency containing scientific efficiency, operational efficiency, statistical efficiency and economic efficiency; and 2) five essential building blocks for efficient trial comprising trial design, trial process, infrastructure, superstructure, and stakeholders. CONCLUSIONS This is the first attempt to dissect the concept of trial efficiency into theoretical constructs. Having an agreed definition will allow better trial implementation and facilitate effective communication and decision-making across stakeholders. We also identified essential building blocks that are the cornerstones of an efficient trial. In this pursuit of understanding, we are not only unravelling the complexities of trial efficiency but also laying the groundwork for evaluating the efficiency of an individual trial or a trial system in the future.
Collapse
Affiliation(s)
- Charis Xuan Xie
- Wolfson Institute of Population Health, Queen Mary University of London, London, England, United Kingdom
| | - Anna De Simoni
- Wolfson Institute of Population Health, Queen Mary University of London, London, England, United Kingdom
| | - Sandra Eldridge
- Wolfson Institute of Population Health, Queen Mary University of London, London, England, United Kingdom
| | - Hilary Pinnock
- Usher Institute, Asthma UK Centre for Applied Research, The University of Edinburgh, Edinburgh, Scotland, United Kingdom
| | - Clare Relton
- Wolfson Institute of Population Health, Queen Mary University of London, London, England, United Kingdom
| |
Collapse
|
2
|
Zhu H, Wong WK. An Overview of Adaptive Designs and Some of Their Challenges, Benefits, and Innovative Applications. J Med Internet Res 2023; 25:e44171. [PMID: 37843888 PMCID: PMC10616728 DOI: 10.2196/44171] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/08/2022] [Revised: 03/25/2023] [Accepted: 05/16/2023] [Indexed: 10/17/2023] Open
Abstract
Adaptive designs are increasingly developed and used to improve all phases of clinical trials and in biomedical studies in various ways to address different statistical issues. We first present an overview of adaptive designs and note their numerous advantages over traditional clinical trials. In particular, we provide a concrete demonstration that shows how recent adaptive design strategies can further improve an adaptive trial implemented 13 years ago. Despite their usefulness, adaptive designs are still not widely implemented in clinical trials. We offer a few possible reasons and propose some ways to use them more broadly in practice, which include greater availability of software tools and interactive websites to generate optimal adaptive trials freely and effectively, including the use of metaheuristics to facilitate the search for an efficient trial design. To this end, we present several web-based tools for finding various adaptive and nonadaptive optimal designs and discuss nature-inspired metaheuristics. Metaheuristics are assumptions-free general purpose optimization algorithms widely used in computer science and engineering to tackle all kinds of challenging optimization problems, and their use in designing clinical trials is just emerging. We describe a few recent such applications and some of their capabilities for designing various complex trials. Particle swarm optimization is an exemplary nature-inspired algorithm, and similar to others, it has a simple definition but many moving parts, making it hard to study its properties analytically. We investigated one of its hitherto unstudied issues on how to bring back out-of-range candidates during the search for the optimum of the search domain and show that different strategies can impact the success and time of the search. We conclude with a few caveats on the use of metaheuristics for a successful search.
Collapse
Affiliation(s)
- Hongjian Zhu
- Statistical Innovation Group, AbbVie Inc., Virtual Office, Sugar Land, TX, United States
| | - Weng Kee Wong
- Department of Biostatistics, Fielding School of Public Health, University of California at Los Angeles, Los Angeles, CA, United States
| |
Collapse
|
3
|
Zhang J, Saju C. A systematic review of randomised controlled trials with adaptive and traditional group sequential designs - applications in cardiovascular clinical trials. BMC Med Res Methodol 2023; 23:200. [PMID: 37679710 PMCID: PMC10483862 DOI: 10.1186/s12874-023-02024-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/25/2023] [Accepted: 08/24/2023] [Indexed: 09/09/2023] Open
Abstract
BACKGROUND Trial design plays a key role in clinical trials. Traditional group sequential design has been used in cardiovascular clinical trials over decades as the trials can potentially be stopped early, therefore, it can reduce pre-planned sample size and trial resources. In contrast, trials with adoptive designs provide greater flexibility and are more efficient due to the ability to modify trial design according to the interim analysis results. In this systematic review, we aim to explore characteristics of adaptive and traditional group sequential trials in practice and to gain an understanding how these trial designs are currently being reported in cardiology. METHODS PubMed, Embase and Cochrane Central Register of Controlled Trials database were searched from January 1980 to June 2022. Randomised controlled phase 2/3 trials with either adaptive or traditional group sequential design in patients with cardiovascular disease were included. Descriptive statistics were used to present the collected data. RESULTS Of 456 articles found in the initial search, 56 were identified including 43 (76.8%) trials with traditional group sequential design and 13 (23.2%) with adaptive. Most trials were large, multicentre, led by the USA (50%) and Europe (28.6%), and were funded by companies (78.6%). For trials with group sequential design, frequency of interim analyses was determined mainly by the number of events (47%). 67% of the trials stopped early, in which 14 (32.6%) were due to efficacy, and 5 (11.6%) for futility. The commonly used stopping rule to terminate trials was O'Brien- Fleming-type alpha spending function (10 (23.3%)). For trials with adaptive designs, 54% of the trials stopped early, in which 4 (30.8%) were due to futility, and 2 (15.4%) for efficacy. Sample size re-estimation was commonly used (8 (61.5%)). In 69% of the trials, simulation including Bayesian approach was used to define the statistical stopping rules. The adaptive designs have been increasingly used (from 0 to 1999 to 38.6% after 2015 amongst adaptive trials). 25% of the trials reported "adaptive" in abstract or title of the studies. CONCLUSIONS The application of adaptive trials is increasingly popular in cardiovascular clinical trials. The reporting of adaptive design needs improving.
Collapse
Affiliation(s)
- Jufen Zhang
- School of Medicine, Faculty of Health, Education, Medicine and Social Care, Anglia Ruskin University, Bishop Hall Lane, Chelmsford, CM1 1SQ, U.K..
- School of Cardiovascular & Metabolic Health, University of Glasgow, Glasgow, U.K..
| | - Christy Saju
- School of Medicine, Faculty of Health, Education, Medicine and Social Care, Anglia Ruskin University, Bishop Hall Lane, Chelmsford, CM1 1SQ, U.K
| |
Collapse
|
4
|
Cho NS, Wong WK, Nghiemphu PL, Cloughesy TF, Ellingson BM. The Future Glioblastoma Clinical Trials Landscape: Early Phase 0, Window of Opportunity, and Adaptive Phase I-III Studies. Curr Oncol Rep 2023; 25:1047-1055. [PMID: 37402043 PMCID: PMC10474988 DOI: 10.1007/s11912-023-01433-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 05/03/2023] [Indexed: 07/05/2023]
Abstract
PURPOSE OF REVIEW Innovative clinical trial designs for glioblastoma (GBM) are needed to expedite drug discovery. Phase 0, window of opportunity, and adaptive designs have been proposed, but their advanced methodologies and underlying biostatistics are not widely known. This review summarizes phase 0, window of opportunity, and adaptive phase I-III clinical trial designs in GBM tailored to physicians. RECENT FINDINGS Phase 0, window of opportunity, and adaptive trials are now being implemented for GBM. These trials can remove ineffective therapies earlier during drug development and improve trial efficiency. There are two ongoing adaptive platform trials: GBM Adaptive Global Innovative Learning Environment (GBM AGILE) and the INdividualized Screening trial of Innovative GBM Therapy (INSIGhT). The future clinical trials landscape in GBM will increasingly involve phase 0, window of opportunity, and adaptive phase I-III studies. Continued collaboration between physicians and biostatisticians will be critical for implementing these trial designs.
Collapse
Affiliation(s)
- Nicholas S Cho
- UCLA Brain Tumor Imaging Laboratory, Center for Computer Vision and Imaging Biomarkers, Department of Radiological Sciences, David Geffen School of Medicine, University of California Los Angeles, 924 Westwood Blvd., Suite 615, Los Angeles, CA, 90024, USA
- Department of Radiological Sciences, David Geffen School of Medicine, University of California Los Angeles, Los Angeles, CA, USA
- Department of Bioengineering, Henry Samueli School of Engineering and Applied Science, University of California Los Angeles, Los Angeles, CA, USA
- Medical Scientist Training Program, David Geffen School of Medicine, University of California Los Angeles, Los Angeles, CA, USA
| | - Weng Kee Wong
- Department of Biostatistics, Fielding School of Public Health, University of California Los Angeles, Los Angeles, CA, USA
| | - Phioanh L Nghiemphu
- Department of Neurology, David Geffen School of Medicine, University of California Los Angeles, Los Angeles, CA, USA
| | - Timothy F Cloughesy
- Department of Neurology, David Geffen School of Medicine, University of California Los Angeles, Los Angeles, CA, USA
| | - Benjamin M Ellingson
- UCLA Brain Tumor Imaging Laboratory, Center for Computer Vision and Imaging Biomarkers, Department of Radiological Sciences, David Geffen School of Medicine, University of California Los Angeles, 924 Westwood Blvd., Suite 615, Los Angeles, CA, 90024, USA.
- Department of Radiological Sciences, David Geffen School of Medicine, University of California Los Angeles, Los Angeles, CA, USA.
- Department of Bioengineering, Henry Samueli School of Engineering and Applied Science, University of California Los Angeles, Los Angeles, CA, USA.
- Department of Neurosurgery, David Geffen School of Medicine, University of California Los Angeles, Los Angeles, CA, USA.
- Department of Psychiatry and Biobehavioral Sciences, David Geffen School of Medicine, University of California Los Angeles, Los Angeles, CA, USA.
| |
Collapse
|
5
|
Kandi V, Vadakedath S. Clinical Trials and Clinical Research: A Comprehensive Review. Cureus 2023; 15:e35077. [PMID: 36938261 PMCID: PMC10023071 DOI: 10.7759/cureus.35077] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 02/16/2023] [Indexed: 02/18/2023] Open
Abstract
Clinical research is an alternative terminology used to describe medical research. Clinical research involves people, and it is generally carried out to evaluate the efficacy of a therapeutic drug, a medical/surgical procedure, or a device as a part of treatment and patient management. Moreover, any research that evaluates the aspects of a disease like the symptoms, risk factors, and pathophysiology, among others may be termed clinical research. However, clinical trials are those studies that assess the potential of a therapeutic drug/device in the management, control, and prevention of disease. In view of the increasing incidences of both communicable and non-communicable diseases, and especially after the effects that Coronavirus Disease-19 (COVID-19) had on public health worldwide, the emphasis on clinical research assumes extremely essential. The knowledge of clinical research will facilitate the discovery of drugs, devices, and vaccines, thereby improving preparedness during public health emergencies. Therefore, in this review, we comprehensively describe the critical elements of clinical research that include clinical trial phases, types, and designs of clinical trials, operations of trial, audit, and management, and ethical concerns.
Collapse
Affiliation(s)
- Venkataramana Kandi
- Clinical Microbiology, Prathima Institute of Medical Sciences, Karimnagar, IND
| | | |
Collapse
|
6
|
Opotowsky AR, Allen KY, Bucholz EM, Burns KM, del Nido P, Fenton KN, Gelb BD, Kirkpatrick JN, Kutty S, Lambert LM, Lopez KN, Olivieri LJ, Pajor NM, Pasquali SK, Petit CJ, Sood E, VanBuren JM, Pearson GD, Miyamoto SD. Pediatric and Congenital Cardiovascular Disease Research Challenges and Opportunities. J Am Coll Cardiol 2022; 80:2239-2250. [DOI: 10.1016/j.jacc.2022.09.032] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/19/2022] [Accepted: 09/27/2022] [Indexed: 11/29/2022]
|