1
|
Hyndman TH, Bowden RS, Woodward AP, Pang DSJ, Hampton JO. Uncontrolled pain: a call for better study design. Front Vet Sci 2024; 11:1328098. [PMID: 38420206 PMCID: PMC10899387 DOI: 10.3389/fvets.2024.1328098] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/26/2023] [Accepted: 01/02/2024] [Indexed: 03/02/2024] Open
Abstract
Studies assessing animal pain in veterinary research are often performed primarily for the benefit of animals. Frequently, the goal of these studies is to determine whether the analgesic effect of a novel treatment is clinically meaningful, and therefore has the capacity to improve the welfare of treated animals. To determine the treatment effect of a potential analgesic, control groups are necessary to allow comparison. There are negative control groups (where pain is unattenuated) and positive control groups (where pain is attenuated). Arising out of animal welfare concerns, there is growing reluctance to use negative control groups in pain studies. But for studies where pain is experimentally induced, the absence of a negative control group removes the opportunity to demonstrate that the study methods could differentiate a positive control intervention from doing nothing at all. For studies that are controlled by a single comparison group, the capacity to distinguish treatment effects from experimental noise is more difficult; especially considering that pain studies often involve small sample sizes, small and variable treatment effects, systematic error and use pain assessment measures that are unreliable. Due to these limitations, and with a focus on farm animals, we argue that many pain studies would be enhanced by the simultaneous inclusion of positive and negative control groups. This would help provide study-specific definitions of pain and pain attenuation, thereby permitting more reliable estimates of treatment effects. Adoption of our suggested refinements could improve animal welfare outcomes for millions of animals globally.
Collapse
Affiliation(s)
- Timothy H. Hyndman
- School of Veterinary Medicine, Murdoch University, Murdoch, WA, Australia
- Harry Butler Research Institute, Murdoch University, Murdoch, WA, Australia
| | - Ross S. Bowden
- School of Mathematics, Statistics, Chemistry and Physics, Murdoch University, Murdoch, WA, Australia
| | | | - Daniel S. J. Pang
- Faculty of Veterinary Medicine, University of Calgary, Calgary, AB, Canada
| | - Jordan O. Hampton
- Harry Butler Research Institute, Murdoch University, Murdoch, WA, Australia
- Faculty of Science, University of Melbourne, Parkville, VIC, Australia
| |
Collapse
|
2
|
Kasianova K, Kelbert M, Mozgunov P. Response-adaptive randomization for multiarm clinical trials using context-dependent information measures. Biom J 2023; 65:e2200301. [PMID: 37816142 DOI: 10.1002/bimj.202200301] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/01/2022] [Revised: 05/10/2023] [Accepted: 06/16/2023] [Indexed: 10/12/2023]
Abstract
Theoretical-information approach applied to the clinical trial designs appeared to bring several advantages when tackling a problem of finding a balance between power and expected number of successes (ENS). In particular, it was shown that the built-in parameter of the weight function allows finding the desired trade-off between the statistical power and number of treated patients in the context of small population Phase II clinical trials. However, in real clinical trials, randomized designs are more preferable. The goal of this research is to introduce randomization to a deterministic entropy-based sequential trial procedure generalized to multiarm setting. Several methods of randomization applied to an entropy-based design are investigated in terms of statistical power and ENS. Namely, the four design types are considered: (a) deterministic procedures, (b) naive randomization using the inverse of entropy criteria as weights, (c) block randomization, and (d) randomized penalty parameter. The randomized entropy-based designs are compared to randomized Gittins index (GI) and fixed randomization (FR). After the comprehensive simulation study, the following conclusion on block randomization is made: for both entropy-based and GI-based block randomization designs the degree of randomization induced by forward-looking procedures is insufficient to achieve a decent statistical power. Therefore, we propose an adjustment for the forward-looking procedure that improves power with almost no cost in terms of ENS. In addition, the properties of randomization procedures based on randomly drawn penalty parameter are also thoroughly investigated.
Collapse
Affiliation(s)
- Ksenia Kasianova
- Faculty of Economics, National Research University Higher School of Economics, Moscow, Russia
| | - Mark Kelbert
- Faculty of Economics, National Research University Higher School of Economics, Moscow, Russia
| | - Pavel Mozgunov
- MRC Biostatistics Unit, University of Cambridge, Cambridge, UK
| |
Collapse
|
3
|
Robertson DS, Lee KM, López-Kolkovska BC, Villar SS. Response-adaptive randomization in clinical trials: from myths to practical considerations. Stat Sci 2023; 38:185-208. [PMID: 37324576 PMCID: PMC7614644 DOI: 10.1214/22-sts865] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/17/2023]
Abstract
Response-Adaptive Randomization (RAR) is part of a wider class of data-dependent sampling algorithms, for which clinical trials are typically used as a motivating application. In that context, patient allocation to treatments is determined by randomization probabilities that change based on the accrued response data in order to achieve experimental goals. RAR has received abundant theoretical attention from the biostatistical literature since the 1930's and has been the subject of numerous debates. In the last decade, it has received renewed consideration from the applied and methodological communities, driven by well-known practical examples and its widespread use in machine learning. Papers on the subject present different views on its usefulness, and these are not easy to reconcile. This work aims to address this gap by providing a unified, broad and fresh review of methodological and practical issues to consider when debating the use of RAR in clinical trials.
Collapse
Affiliation(s)
- David S. Robertson
- MRC Biostatistics Unit, University of Cambridge, Forvie Site, Robinson Way, Cambridge CB2 0SR, United Kingdom
| | | | | | | |
Collapse
|
4
|
Wason JMS, Dimairo M, Biggs K, Bowden S, Brown J, Flight L, Hall J, Jaki T, Lowe R, Pallmann P, Pilling MA, Snowdon C, Sydes MR, Villar SS, Weir CJ, Wilson N, Yap C, Hancock H, Maier R. Practical guidance for planning resources required to support publicly-funded adaptive clinical trials. BMC Med 2022; 20:254. [PMID: 35945610 PMCID: PMC9364623 DOI: 10.1186/s12916-022-02445-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/01/2022] [Accepted: 06/20/2022] [Indexed: 11/15/2022] Open
Abstract
Adaptive designs are a class of methods for improving efficiency and patient benefit of clinical trials. Although their use has increased in recent years, research suggests they are not used in many situations where they have potential to bring benefit. One barrier to their more widespread use is a lack of understanding about how the choice to use an adaptive design, rather than a traditional design, affects resources (staff and non-staff) required to set-up, conduct and report a trial. The Costing Adaptive Trials project investigated this issue using quantitative and qualitative research amongst UK Clinical Trials Units. Here, we present guidance that is informed by our research, on considering the appropriate resourcing of adaptive trials. We outline a five-step process to estimate the resources required and provide an accompanying costing tool. The process involves understanding the tasks required to undertake a trial, and how the adaptive design affects them. We identify barriers in the publicly funded landscape and provide recommendations to trial funders that would address them. Although our guidance and recommendations are most relevant to UK non-commercial trials, many aspects are relevant more widely.
Collapse
Affiliation(s)
- James M S Wason
- Biostatistics Research Group, Population Health Sciences Institute, Newcastle University, Newcastle upon Tyne, UK.
| | - Munyaradzi Dimairo
- School of Health and Related Research, Clinical Trials Research Unit, University of Sheffield, Sheffield, UK
| | - Katie Biggs
- School of Health and Related Research, Clinical Trials Research Unit, University of Sheffield, Sheffield, UK
| | - Sarah Bowden
- Cancer Research UK Clinical Trials Unit (CRCTU), University of Birmingham, Birmingham, UK
| | - Julia Brown
- Cancer Research UK CTU, University of Leeds, Leeds, UK
| | - Laura Flight
- School of Health and Related Research, Health Economics and Decision Science, University of Sheffield, Sheffield, UK
| | - Jamie Hall
- School of Health and Related Research, Clinical Trials Research Unit, University of Sheffield, Sheffield, UK
| | - Thomas Jaki
- MRC Biostatistics Unit, University of Cambridge, Cambridge, UK
- Department of Mathematics and Statistics, Lancaster University, Lancaster, UK
| | - Rachel Lowe
- Centre for Trials Research, Cardiff University, Cardiff, UK
| | | | - Mark A Pilling
- Department of Public Health and Primary Care, University of Cambridge, Cambridge, UK
| | - Claire Snowdon
- The Institute of Cancer Research Clinical Trials & Statistics Unit, London, UK
| | | | - Sofía S Villar
- MRC Biostatistics Unit, University of Cambridge, Cambridge, UK
| | - Christopher J Weir
- Edinburgh Clinical Trials Unit, Usher Institute, University of Edinburgh, Edinburgh, UK
| | - Nina Wilson
- Biostatistics Research Group, Population Health Sciences Institute, Newcastle University, Newcastle upon Tyne, UK
| | - Christina Yap
- The Institute of Cancer Research Clinical Trials & Statistics Unit, London, UK
| | - Helen Hancock
- Newcastle Clinical Trials Unit, Newcastle University, Newcastle upon Tyne, UK
| | - Rebecca Maier
- Newcastle Clinical Trials Unit, Newcastle University, Newcastle upon Tyne, UK
| |
Collapse
|
5
|
Walley R, Brayshaw N. From innovative thinking to pharmaceutical industry implementation: Some success stories. Pharm Stat 2022; 21:712-719. [PMID: 35819113 DOI: 10.1002/pst.2222] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/21/2021] [Revised: 02/21/2022] [Accepted: 02/25/2022] [Indexed: 11/10/2022]
Abstract
In industry, successful innovation involves not only developing new statistical methodology, but also ensuring that this methodology is implemented successfully. This includes enabling applied statisticians to understand the method, its benefits and limitations and empowering them to implement the new method. This will include advocacy, influencing in-house and external stakeholders, such that these stakeholders are receptive to the new methodology. In this paper, we describe some industry successes and focus on our colleague, Andy Grieve's role in these.
Collapse
|
6
|
Branch-Elliman W, Ferguson R, Doros G, Woods P, Leatherman S, Strymish J, Datta R, Goswami R, Jankowich MD, Shah NR, Taylor TH, Page ST, Schiller SJ, Shannon C, Hau C, Flynn M, Holmberg E, Visnaw K, Dhond R, Brophy M, Monach PA. Subcutaneous sarilumab for the treatment of hospitalized patients with moderate to severe COVID19 disease: A pragmatic, embedded randomized clinical trial. PLoS One 2022; 17:e0263591. [PMID: 35213547 PMCID: PMC8880885 DOI: 10.1371/journal.pone.0263591] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/24/2021] [Accepted: 12/09/2021] [Indexed: 12/15/2022] Open
Abstract
IMPORTANCE AND OBJECTIVE The aim of this pragmatic, embedded, adaptive trial was to measure the effectiveness of the subcutaneous anti-IL-6R antibody sarilumab, when added to an evolving standard of care (SOC), for clinical management of inpatients with moderate to severe COVID-19 disease. DESIGN Two-arm, randomized, open-label controlled trial comparing SOC alone to SOC plus sarilumab. The trial used a randomized play-the-winner design and was fully embedded within the electronic health record (EHR) system. SETTING 5 VA Medical Centers. PARTICIPANTS Hospitalized patients with clinical criteria for moderate to severe COVID-19 but not requiring mechanical ventilation, and a diagnostic test positive for SARS-CoV-2. INTERVENTIONS Sarilumab, 200 or 400 mg subcutaneous injection. SOC was not pre-specified and could vary over time, e.g., to include antiviral or other anti-inflammatory drugs. MAIN OUTCOMES AND MEASURES The primary outcome was intubation or death within 14 days of randomization. All data were extracted remotely from the EHR. RESULTS Among 162 eligible patients, 53 consented, and 50 were evaluated for the primary endpoint of intubation or death. This occurred in 5/20 and 1/30 of participants in the sarilumab and SOC arms respectively, with the majority occurring in the initial 9 participants (3/4 in the sarilumab and 1/5 in the SOC) before the sarilumab dose was increased to 400 mg and before remdesivir and dexamethasone were widely adopted. After interim review, the unblinded Data Monitoring Committee recommended that the study be stopped due to concern for safety: a high probability that rates of intubation or death were higher with addition of sarilumab to SOC (92.6%), and a very low probability (3.4%) that sarilumab would be found to be superior. CONCLUSIONS AND RELEVANCE This randomized trial of patients hospitalized due to respiratory compromise from COVID-19 but not mechanical ventilation found no benefit from subcutaneous sarilumab when added to an evolving SOC. The numbers of patients and events were too low to allow definitive conclusions to be drawn, but this study contributes valuable information about the role of subcutaneous IL-6R inhibition in the treatment of hospitalized COVID-19 patients. Methods developed and piloted during this trial will be useful in conducting future studies more efficiently. TRIAL REGISTRATION Clinicaltrials.gov-NCT04359901; https://clinicaltrials.gov/ct2/show/NCT04359901?cond=NCT04359901&draw=2&rank=1.
Collapse
Affiliation(s)
- Westyn Branch-Elliman
- VA Boston Healthcare System, Boston, Massachusetts, United States of America
- Harvard Medical School, Boston, Massachusetts, United States of America
| | - Ryan Ferguson
- VA Boston Healthcare System, Boston, Massachusetts, United States of America
- Evans Department of Medicine, Section of General Internal Medicine, Boston University School of Medicine, Boston, Massachusetts, United States of America
| | - Gheorghe Doros
- VA Boston Healthcare System, Boston, Massachusetts, United States of America
- Department of Biostatistics, Boston University School of Public Health, Boston, Massachusetts, United States of America
| | - Patricia Woods
- VA Boston Healthcare System, Boston, Massachusetts, United States of America
| | - Sarah Leatherman
- VA Boston Healthcare System, Boston, Massachusetts, United States of America
| | - Judith Strymish
- VA Boston Healthcare System, Boston, Massachusetts, United States of America
| | - Rupak Datta
- Hospital Epidemiology and Infection Prevention Program, VA Connecticut Healthcare System, West Haven, Connecticut, United States of America
- Section of Infectious Diseases, Yale School of Medicine, New Haven, Connecticut, United States of America
| | - Rekha Goswami
- Section of Infectious Diseases, VA Maine Healthcare System, Togus, Maine, United States of America
| | - Matthew D. Jankowich
- Division of Pulmonary and Critical Care Medicine, Department of Medicine, Providence VA Medical Center, Alpert Medical School of Brown University, Providence, Rhode Island, United States of America
| | - Nishant R. Shah
- Division of Cardiology, Department of Medicine, Providence VA Medical Center, Alpert Medical School of Brown University, Providence, Rhode Island, United States of America
| | - Thomas H. Taylor
- Infectious Diseases and Rheumatology, White River Jct. VA Medical Center, Hartford, Vermont, United States of America
| | - Sarah T. Page
- VA Boston Healthcare System, Boston, Massachusetts, United States of America
| | - Sara J. Schiller
- VA Boston Healthcare System, Boston, Massachusetts, United States of America
| | - Colleen Shannon
- VA Boston Healthcare System, Boston, Massachusetts, United States of America
| | - Cynthia Hau
- VA Boston Healthcare System, Boston, Massachusetts, United States of America
| | - Maura Flynn
- VA Boston Healthcare System, Boston, Massachusetts, United States of America
| | - Erika Holmberg
- VA Boston Healthcare System, Boston, Massachusetts, United States of America
| | - Karen Visnaw
- VA Boston Healthcare System, Boston, Massachusetts, United States of America
| | - Rupali Dhond
- VA Boston Healthcare System, Boston, Massachusetts, United States of America
- Evans Department of Medicine, Section of General Internal Medicine, Boston University School of Medicine, Boston, Massachusetts, United States of America
| | - Mary Brophy
- VA Boston Healthcare System, Boston, Massachusetts, United States of America
| | - Paul A. Monach
- VA Boston Healthcare System, Boston, Massachusetts, United States of America
| |
Collapse
|
7
|
Monach PA, Branch-Elliman W. Reconsidering 'minimal risk' to expand the repertoire of trials with waiver of informed consent for research. BMJ Open 2021; 11:e048534. [PMID: 34521663 PMCID: PMC8442055 DOI: 10.1136/bmjopen-2020-048534] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Abstract
BACKGROUND Progress in therapeutic research is slowed by the regulatory burden of clinical trials, which provide the best evidence for guiding treatment. There is a long delay from evidence generation to adoption, highlighting the need for designs that link evidence generation to implementation. OBJECTIVE To identify clinical trial designs that confer minimal risk above that inherent in clinical care, to obviate the need for cumbersome consenting processes to enrol patients in prospective clinical research studies. These designs extend the scope of the Learning Healthcare System, a framework for leveraging retrospective 'big data' to advance clinical research, to include data collected from prospective controlled trials. SUMMARY Pragmatic trials may use simplified eligibility criteria, unblinded interventions and objective outcome measures that can all be monitored through the electronic health records (EHR), to reduce costs and speed study conduct. Most pragmatic trials continue to suffer from substantial regulatory burden. Written consent to participate in research can be waived only if the research produces minimal risk above what is encountered in everyday life. However, the 'consent' processes for prescribing Federal Drug Administration-approved medications in clinical medicine are informal, even when they involve decisions of uncertain benefit and higher levels of risk. We propose that trial designs that mimic clinical decision-making in areas of uncertainty (clinical equipoise) and in which no data are generated outside of usual care (ideally by EHR embedding) confer minimal additional risk. Trial designs meeting this standard could, therefore, be conducted with minimal documentation of consent, even when interventions contain different risks. To align with risk encountered in clinical practice, allocation to treatment arms should change (adaptive randomisation) as data are collected and analysed. Embedding of informatics tools into the EHR has the additional benefit that, as adaptive randomisation progresses, evidence-generation transitions into implementation via decision-support tools-the ultimate realisation of the Learning Healthcare System.
Collapse
Affiliation(s)
- Paul A Monach
- Rheumatology Section, VA Boston Health Care System Jamaica Plain Campus, Boston, Massachusetts, USA
| | - Westyn Branch-Elliman
- Infectious Diseases Section, VA Boston Health Care System West Roxbury Campus, West Roxbury, Massachusetts, USA
| |
Collapse
|
8
|
Burnett T, Mozgunov P, Pallmann P, Villar SS, Wheeler GM, Jaki T. Adding flexibility to clinical trial designs: an example-based guide to the practical use of adaptive designs. BMC Med 2020; 18:352. [PMID: 33208155 PMCID: PMC7677786 DOI: 10.1186/s12916-020-01808-2] [Citation(s) in RCA: 32] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/29/2020] [Accepted: 10/07/2020] [Indexed: 12/18/2022] Open
Abstract
Adaptive designs for clinical trials permit alterations to a study in response to accumulating data in order to make trials more flexible, ethical, and efficient. These benefits are achieved while preserving the integrity and validity of the trial, through the pre-specification and proper adjustment for the possible alterations during the course of the trial. Despite much research in the statistical literature highlighting the potential advantages of adaptive designs over traditional fixed designs, the uptake of such methods in clinical research has been slow. One major reason for this is that different adaptations to trial designs, as well as their advantages and limitations, remain unfamiliar to large parts of the clinical community. The aim of this paper is to clarify where adaptive designs can be used to address specific questions of scientific interest; we introduce the main features of adaptive designs and commonly used terminology, highlighting their utility and pitfalls, and illustrate their use through case studies of adaptive trials ranging from early-phase dose escalation to confirmatory phase III studies.
Collapse
Affiliation(s)
- Thomas Burnett
- Department of Mathematics and Statistics, Lancaster University, Fylde College, Lancaster, LA1 4YF UK
| | - Pavel Mozgunov
- Department of Mathematics and Statistics, Lancaster University, Fylde College, Lancaster, LA1 4YF UK
| | - Philip Pallmann
- Centre for Trials Research, College of Biomedical & Life Sciences, Cardiff University, Cardiff, UK
| | - Sofia S. Villar
- MRC Biostatistics Unit, University of Cambridge School of Clinical Medicine, Cambridge Institute of Public Health, Forvie Site, Robinson Way, Cambridge Biomedical Campus, Cambridge, CB2 0SR UK
| | - Graham M. Wheeler
- Cancer Research UK & UCL Cancer Trials Centre, University College London, 90 Tottenham Court Road, London, W1T 4TJ UK
| | - Thomas Jaki
- Department of Mathematics and Statistics, Lancaster University, Fylde College, Lancaster, LA1 4YF UK
- MRC Biostatistics Unit, University of Cambridge School of Clinical Medicine, Cambridge Institute of Public Health, Forvie Site, Robinson Way, Cambridge Biomedical Campus, Cambridge, CB2 0SR UK
| |
Collapse
|
9
|
Dimairo M, Pallmann P, Wason J, Todd S, Jaki T, Julious SA, Mander AP, Weir CJ, Koenig F, Walton MK, Nicholl JP, Coates E, Biggs K, Hamasaki T, Proschan MA, Scott JA, Ando Y, Hind D, Altman DG. The adaptive designs CONSORT extension (ACE) statement: a checklist with explanation and elaboration guideline for reporting randomised trials that use an adaptive design. Trials 2020; 21:528. [PMID: 32546273 PMCID: PMC7298968 DOI: 10.1186/s13063-020-04334-x] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/11/2022] Open
Abstract
Adaptive designs (ADs) allow pre-planned changes to an ongoing trial without compromising the validity of conclusions and it is essential to distinguish pre-planned from unplanned changes that may also occur. The reporting of ADs in randomised trials is inconsistent and needs improving. Incompletely reported AD randomised trials are difficult to reproduce and are hard to interpret and synthesise. This consequently hampers their ability to inform practice as well as future research and contributes to research waste. Better transparency and adequate reporting will enable the potential benefits of ADs to be realised.This extension to the Consolidated Standards Of Reporting Trials (CONSORT) 2010 statement was developed to enhance the reporting of randomised AD clinical trials. We developed an Adaptive designs CONSORT Extension (ACE) guideline through a two-stage Delphi process with input from multidisciplinary key stakeholders in clinical trials research in the public and private sectors from 21 countries, followed by a consensus meeting. Members of the CONSORT Group were involved during the development process.The paper presents the ACE checklists for AD randomised trial reports and abstracts, as well as an explanation with examples to aid the application of the guideline. The ACE checklist comprises seven new items, nine modified items, six unchanged items for which additional explanatory text clarifies further considerations for ADs, and 20 unchanged items not requiring further explanatory text. The ACE abstract checklist has one new item, one modified item, one unchanged item with additional explanatory text for ADs, and 15 unchanged items not requiring further explanatory text.The intention is to enhance transparency and improve reporting of AD randomised trials to improve the interpretability of their results and reproducibility of their methods, results and inference. We also hope indirectly to facilitate the much-needed knowledge transfer of innovative trial designs to maximise their potential benefits. In order to encourage its wide dissemination this article is freely accessible on the BMJ and Trials journal websites."To maximise the benefit to society, you need to not just do research but do it well" Douglas G Altman.
Collapse
Affiliation(s)
- Munyaradzi Dimairo
- School of Health and Related Research, University of Sheffield, Sheffield, S1 4DA, UK.
| | | | - James Wason
- MRC Biostatistics Unit, University of Cambridge, Cambridge, UK
- Institute of Health and Society, Newcastle University, Newcastle, UK
| | - Susan Todd
- Department of Mathematics and Statistics, University of Reading, Reading, UK
| | - Thomas Jaki
- Department of Mathematics and Statistics, Lancaster University, Lancaster, UK
| | - Steven A Julious
- School of Health and Related Research, University of Sheffield, Sheffield, S1 4DA, UK
| | - Adrian P Mander
- Centre for Trials Research, Cardiff University, Cardiff, UK
- MRC Biostatistics Unit, University of Cambridge, Cambridge, UK
| | - Christopher J Weir
- Edinburgh Clinical Trials Unit, Usher Institute, University of Edinburgh, Edinburgh, UK
| | - Franz Koenig
- Centre for Medical Statistics, Informatics, and Intelligent Systems, Medical University of Vienna, Vienna, Austria
| | - Marc K Walton
- Janssen Pharmaceuticals, Titusville, New Jersey, USA
| | - Jon P Nicholl
- School of Health and Related Research, University of Sheffield, Sheffield, S1 4DA, UK
| | - Elizabeth Coates
- School of Health and Related Research, University of Sheffield, Sheffield, S1 4DA, UK
| | - Katie Biggs
- School of Health and Related Research, University of Sheffield, Sheffield, S1 4DA, UK
| | | | - Michael A Proschan
- National Institute of Allergy and Infectious Diseases, National Institutes of Health, Bethesda, USA
| | - John A Scott
- Division of Biostatistics in the Center for Biologics Evaluation and Research, Food and Drug Administration, Rockville, USA
| | - Yuki Ando
- Pharmaceuticals and Medical Devices Agency, Tokyo, Japan
| | - Daniel Hind
- School of Health and Related Research, University of Sheffield, Sheffield, S1 4DA, UK
| | - Douglas G Altman
- Centre for Statistics in Medicine, University of Oxford, Oxford, UK
| |
Collapse
|
10
|
Dimairo M, Pallmann P, Wason J, Todd S, Jaki T, Julious SA, Mander AP, Weir CJ, Koenig F, Walton MK, Nicholl JP, Coates E, Biggs K, Hamasaki T, Proschan MA, Scott JA, Ando Y, Hind D, Altman DG. The Adaptive designs CONSORT Extension (ACE) statement: a checklist with explanation and elaboration guideline for reporting randomised trials that use an adaptive design. BMJ 2020; 369:m115. [PMID: 32554564 PMCID: PMC7298567 DOI: 10.1136/bmj.m115] [Citation(s) in RCA: 55] [Impact Index Per Article: 13.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Accepted: 11/19/2019] [Indexed: 12/11/2022]
Abstract
Adaptive designs (ADs) allow pre-planned changes to an ongoing trial without compromising the validity of conclusions and it is essential to distinguish pre-planned from unplanned changes that may also occur. The reporting of ADs in randomised trials is inconsistent and needs improving. Incompletely reported AD randomised trials are difficult to reproduce and are hard to interpret and synthesise. This consequently hampers their ability to inform practice as well as future research and contributes to research waste. Better transparency and adequate reporting will enable the potential benefits of ADs to be realised.This extension to the Consolidated Standards Of Reporting Trials (CONSORT) 2010 statement was developed to enhance the reporting of randomised AD clinical trials. We developed an Adaptive designs CONSORT Extension (ACE) guideline through a two-stage Delphi process with input from multidisciplinary key stakeholders in clinical trials research in the public and private sectors from 21 countries, followed by a consensus meeting. Members of the CONSORT Group were involved during the development process.The paper presents the ACE checklists for AD randomised trial reports and abstracts, as well as an explanation with examples to aid the application of the guideline. The ACE checklist comprises seven new items, nine modified items, six unchanged items for which additional explanatory text clarifies further considerations for ADs, and 20 unchanged items not requiring further explanatory text. The ACE abstract checklist has one new item, one modified item, one unchanged item with additional explanatory text for ADs, and 15 unchanged items not requiring further explanatory text.The intention is to enhance transparency and improve reporting of AD randomised trials to improve the interpretability of their results and reproducibility of their methods, results and inference. We also hope indirectly to facilitate the much-needed knowledge transfer of innovative trial designs to maximise their potential benefits.
Collapse
Affiliation(s)
- Munyaradzi Dimairo
- School of Health and Related Research, University of Sheffield, Sheffield S1 4DA, UK
| | | | - James Wason
- MRC Biostatistics Unit, University of Cambridge, UK
- Institute of Health and Society, Newcastle University, UK
| | - Susan Todd
- Department of Mathematics and Statistics, University of Reading, UK
| | - Thomas Jaki
- Department of Mathematics and Statistics, Lancaster University, UK
| | - Steven A Julious
- School of Health and Related Research, University of Sheffield, Sheffield S1 4DA, UK
| | - Adrian P Mander
- Centre for Trials Research, Cardiff University, UK
- MRC Biostatistics Unit, University of Cambridge, UK
| | - Christopher J Weir
- Edinburgh Clinical Trials Unit, Usher Institute, University of Edinburgh, UK
| | - Franz Koenig
- Centre for Medical Statistics, Informatics, and Intelligent Systems, Medical University of Vienna, Austria
| | | | - Jon P Nicholl
- School of Health and Related Research, University of Sheffield, Sheffield S1 4DA, UK
| | - Elizabeth Coates
- School of Health and Related Research, University of Sheffield, Sheffield S1 4DA, UK
| | - Katie Biggs
- School of Health and Related Research, University of Sheffield, Sheffield S1 4DA, UK
| | | | - Michael A Proschan
- National Institute of Allergy and Infectious Diseases, National Institutes of Health, USA
| | - John A Scott
- Division of Biostatistics in the Center for Biologics Evaluation and Research, Food and Drug Administration, USA
| | - Yuki Ando
- Pharmaceuticals and Medical Devices Agency, Japan
| | - Daniel Hind
- School of Health and Related Research, University of Sheffield, Sheffield S1 4DA, UK
| | | |
Collapse
|
11
|
Wheeler GM, Mander AP, Bedding A, Brock K, Cornelius V, Grieve AP, Jaki T, Love SB, Odondi L, Weir CJ, Yap C, Bond SJ. How to design a dose-finding study using the continual reassessment method. BMC Med Res Methodol 2019; 19:18. [PMID: 30658575 PMCID: PMC6339349 DOI: 10.1186/s12874-018-0638-z] [Citation(s) in RCA: 48] [Impact Index Per Article: 9.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/04/2017] [Accepted: 12/06/2018] [Indexed: 11/16/2022] Open
Abstract
INTRODUCTION The continual reassessment method (CRM) is a model-based design for phase I trials, which aims to find the maximum tolerated dose (MTD) of a new therapy. The CRM has been shown to be more accurate in targeting the MTD than traditional rule-based approaches such as the 3 + 3 design, which is used in most phase I trials. Furthermore, the CRM has been shown to assign more trial participants at or close to the MTD than the 3 + 3 design. However, the CRM's uptake in clinical research has been incredibly slow, putting trial participants, drug development and patients at risk. Barriers to increasing the use of the CRM have been identified, most notably a lack of knowledge amongst clinicians and statisticians on how to apply new designs in practice. No recent tutorial, guidelines, or recommendations for clinicians on conducting dose-finding studies using the CRM are available. Furthermore, practical resources to support clinicians considering the CRM for their trials are scarce. METHODS To help overcome these barriers, we present a structured framework for designing a dose-finding study using the CRM. We give recommendations for key design parameters and advise on conducting pre-trial simulation work to tailor the design to a specific trial. We provide practical tools to support clinicians and statisticians, including software recommendations, and template text and tables that can be edited and inserted into a trial protocol. We also give guidance on how to conduct and report dose-finding studies using the CRM. RESULTS An initial set of design recommendations are provided to kick-start the design process. To complement these and the additional resources, we describe two published dose-finding trials that used the CRM. We discuss their designs, how they were conducted and analysed, and compare them to what would have happened under a 3 + 3 design. CONCLUSIONS The framework and resources we provide are aimed at clinicians and statisticians new to the CRM design. Provision of key resources in this contemporary guidance paper will hopefully improve the uptake of the CRM in phase I dose-finding trials.
Collapse
Affiliation(s)
- Graham M. Wheeler
- Cancer Research UK and UCL Cancer Trials Centre, University College London, 90 Tottenham Court Road, London, W1T 4TJ UK
| | - Adrian P. Mander
- MRC Biostatistics Unit Hub for Trials Methodology Research, University of Cambridge, Cambridge Institute of Public Health, Forvie Site, Robinson Way, Cambridge Biomedical Campus, Cambridge, CB2 0SR UK
| | - Alun Bedding
- Roche Pharmaceuticals, Hexagon Place, Falcon Way, Shire Park, Welwyn Garden City, AL7 1TW UK
| | - Kristian Brock
- Cancer Research UK Clinical Trials Unit, Institute of Cancer and Genomic Sciences, University of Birmingham, Edgbaston, Birmingham, B15 2TT UK
| | - Victoria Cornelius
- School of Public Health, Imperial College London, 68 Wood Lane, London, W12 7RH UK
| | | | - Thomas Jaki
- Department of Mathematics and Statistics, Fylde College, Lancaster University, Fylde Avenue, Bailrigg, Lancaster, LA1 4YF UK
| | - Sharon B. Love
- Oxford Clinical Trials Research Unit, Centre for Statistics in Medicine, NDORMS, University of Oxford, Botnar Research Centre, Windmill Road, Oxford, OX3 7LD UK
- MRC Clinical Trials Unit, University College London, 90 High Holborn, London, WC1V 6LJ UK
| | - Lang’o Odondi
- Oxford Clinical Trials Research Unit, Centre for Statistics in Medicine, NDORMS, University of Oxford, Botnar Research Centre, Windmill Road, Oxford, OX3 7LD UK
| | - Christopher J. Weir
- Edinburgh Clinical Trials Unit, Usher Institute of Population Health Sciences, University of Edinburgh, Nine Edinburgh Bioquarter, 9 Little France Road, Edinburgh, EH16 4UX UK
| | - Christina Yap
- Cancer Research UK Clinical Trials Unit, Institute of Cancer and Genomic Sciences, University of Birmingham, Edgbaston, Birmingham, B15 2TT UK
| | - Simon J. Bond
- MRC Biostatistics Unit Hub for Trials Methodology Research, University of Cambridge, Cambridge Institute of Public Health, Forvie Site, Robinson Way, Cambridge Biomedical Campus, Cambridge, CB2 0SR UK
- National Institute for Health Research Cambridge Clinical Trials Unit, Cambridge University Hospitals NHS Foundation Trust, Addenbrooke’s Hospital, Hills Road, Cambridge Biomedical Campus, Box 401, Coton House Level 6, Cambridge, CB2 0QQ UK
| |
Collapse
|
12
|
Morgan D. Bayesian applications in pharmaceutical statistics. Pharm Stat 2018; 17:298-300. [PMID: 29943434 DOI: 10.1002/pst.1876] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 06/06/2018] [Indexed: 11/06/2022]
Affiliation(s)
- David Morgan
- Department of Pharmaceutical Medicine, King's College London, London, UK
| |
Collapse
|
13
|
Pallmann P, Bedding AW, Choodari-Oskooei B, Dimairo M, Flight L, Hampson LV, Holmes J, Mander AP, Odondi L, Sydes MR, Villar SS, Wason JMS, Weir CJ, Wheeler GM, Yap C, Jaki T. Adaptive designs in clinical trials: why use them, and how to run and report them. BMC Med 2018; 16:29. [PMID: 29490655 PMCID: PMC5830330 DOI: 10.1186/s12916-018-1017-7] [Citation(s) in RCA: 361] [Impact Index Per Article: 60.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/10/2017] [Accepted: 01/30/2018] [Indexed: 12/11/2022] Open
Abstract
Adaptive designs can make clinical trials more flexible by utilising results accumulating in the trial to modify the trial's course in accordance with pre-specified rules. Trials with an adaptive design are often more efficient, informative and ethical than trials with a traditional fixed design since they often make better use of resources such as time and money, and might require fewer participants. Adaptive designs can be applied across all phases of clinical research, from early-phase dose escalation to confirmatory trials. The pace of the uptake of adaptive designs in clinical research, however, has remained well behind that of the statistical literature introducing new methods and highlighting their potential advantages. We speculate that one factor contributing to this is that the full range of adaptations available to trial designs, as well as their goals, advantages and limitations, remains unfamiliar to many parts of the clinical community. Additionally, the term adaptive design has been misleadingly used as an all-encompassing label to refer to certain methods that could be deemed controversial or that have been inadequately implemented.We believe that even if the planning and analysis of a trial is undertaken by an expert statistician, it is essential that the investigators understand the implications of using an adaptive design, for example, what the practical challenges are, what can (and cannot) be inferred from the results of such a trial, and how to report and communicate the results. This tutorial paper provides guidance on key aspects of adaptive designs that are relevant to clinical triallists. We explain the basic rationale behind adaptive designs, clarify ambiguous terminology and summarise the utility and pitfalls of adaptive designs. We discuss practical aspects around funding, ethical approval, treatment supply and communication with stakeholders and trial participants. Our focus, however, is on the interpretation and reporting of results from adaptive design trials, which we consider vital for anyone involved in medical research. We emphasise the general principles of transparency and reproducibility and suggest how best to put them into practice.
Collapse
Affiliation(s)
- Philip Pallmann
- Department of Mathematics & Statistics, Lancaster University, Lancaster, LA1 4YF UK
| | | | - Babak Choodari-Oskooei
- MRC Clinical Trials Unit at UCL, Institute of Clinical Trials and Methodology, University College London, London, UK
| | | | - Laura Flight
- Medical Statistics Group, University of Sheffield, Sheffield, UK
| | - Lisa V. Hampson
- Department of Mathematics & Statistics, Lancaster University, Lancaster, LA1 4YF UK
- Statistical Innovation Group, Advanced Analytics Centre, AstraZeneca, Cambridge, UK
| | - Jane Holmes
- Centre for Statistics in Medicine, University of Oxford, Oxford, UK
| | | | - Lang’o Odondi
- Centre for Statistics in Medicine, University of Oxford, Oxford, UK
| | - Matthew R. Sydes
- MRC Clinical Trials Unit at UCL, Institute of Clinical Trials and Methodology, University College London, London, UK
| | - Sofía S. Villar
- MRC Biostatistics Unit, University of Cambridge, Cambridge, UK
| | - James M. S. Wason
- MRC Biostatistics Unit, University of Cambridge, Cambridge, UK
- Institute of Health and Society, Newcastle University, Newcastle, UK
| | - Christopher J. Weir
- Usher Institute of Population Health Sciences and Informatics, University of Edinburgh, Edinburgh, UK
| | - Graham M. Wheeler
- MRC Biostatistics Unit, University of Cambridge, Cambridge, UK
- Cancer Research UK & UCL Cancer Trials Centre, University College London, London, UK
| | - Christina Yap
- Cancer Research UK Clinical Trials Unit, University of Birmingham, Birmingham, UK
| | - Thomas Jaki
- Department of Mathematics & Statistics, Lancaster University, Lancaster, LA1 4YF UK
| |
Collapse
|
14
|
Peck RW. Precision Medicine Is Not Just Genomics: The Right Dose for Every Patient. Annu Rev Pharmacol Toxicol 2018; 58:105-122. [DOI: 10.1146/annurev-pharmtox-010617-052446] [Citation(s) in RCA: 60] [Impact Index Per Article: 10.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Affiliation(s)
- Richard W. Peck
- Pharma Research and Exploratory Development, Roche Innovation Center Basel, 4070 Basel, Switzerland
| |
Collapse
|