1
|
Yarchoan M, Gane EJ, Marron TU, Perales-Linares R, Yan J, Cooch N, Shu DH, Fertig EJ, Kagohara LT, Bartha G, Northcott J, Lyle J, Rochestie S, Peters J, Connor JT, Jaffee EM, Csiki I, Weiner DB, Perales-Puchalt A, Sardesai NY. Personalized neoantigen vaccine and pembrolizumab in advanced hepatocellular carcinoma: a phase 1/2 trial. Nat Med 2024; 30:1044-1053. [PMID: 38584166 PMCID: PMC11031401 DOI: 10.1038/s41591-024-02894-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/28/2022] [Accepted: 03/01/2024] [Indexed: 04/09/2024]
Abstract
Programmed cell death protein 1 (PD-1) inhibitors have modest efficacy as a monotherapy in hepatocellular carcinoma (HCC). A personalized therapeutic cancer vaccine (PTCV) may enhance responses to PD-1 inhibitors through the induction of tumor-specific immunity. We present results from a single-arm, open-label, phase 1/2 study of a DNA plasmid PTCV (GNOS-PV02) encoding up to 40 neoantigens coadministered with plasmid-encoded interleukin-12 plus pembrolizumab in patients with advanced HCC previously treated with a multityrosine kinase inhibitor. Safety and immunogenicity were assessed as primary endpoints, and treatment efficacy and feasibility were evaluated as secondary endpoints. The most common treatment-related adverse events were injection-site reactions, observed in 15 of 36 (41.6%) patients. No dose-limiting toxicities or treatment-related grade ≥3 events were observed. The objective response rate (modified intention-to-treat) per Response Evaluation Criteria in Solid Tumors 1.1 was 30.6% (11 of 36 patients), with 8.3% (3 of 36) of patients achieving a complete response. Clinical responses were associated with the number of neoantigens encoded in the vaccine. Neoantigen-specific T cell responses were confirmed in 19 of 22 (86.4%) evaluable patients by enzyme-linked immunosorbent spot assays. Multiparametric cellular profiling revealed active, proliferative and cytolytic vaccine-specific CD4+ and CD8+ effector T cells. T cell receptor β-chain (TCRβ) bulk sequencing results demonstrated vaccination-enriched T cell clone expansion and tumor infiltration. Single-cell analysis revealed posttreatment T cell clonal expansion of cytotoxic T cell phenotypes. TCR complementarity-determining region cloning of expanded T cell clones in the tumors following vaccination confirmed reactivity against vaccine-encoded neoantigens. Our results support the PTCV's mechanism of action based on the induction of antitumor T cells and show that a PTCV plus pembrolizumab has clinical activity in advanced HCC. ClinicalTrials.gov identifier: NCT04251117 .
Collapse
|
2
|
Fleming TR, Wittes J, Fiuzat M, Bristow MR, Rockhold FW, Connor JT, Saville BR, Claggett B, Cavagna I, Abraham WT, Cook TD, Lindenfeld J, O'Connor C, DeMets DL. Training the Next Generation of Data Monitoring Committee Members: An Initiative of the Heart Failure Collaboratory. JACC. HEART FAILURE 2024:S2213-1779(24)00180-X. [PMID: 38530701 DOI: 10.1016/j.jchf.2024.02.016] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/22/2023] [Revised: 02/14/2024] [Accepted: 02/21/2024] [Indexed: 03/28/2024]
Abstract
Clinical trials are vital for assessing therapeutic interventions. The associated data monitoring committees (DMCs) safeguard patient interests and enhance trial integrity, thus promoting timely, reliable evaluations of those interventions. We face an urgent need to recruit and train new DMC members. The Heart Failure Collaboratory (HFC), a multidisciplinary public-private consortium of academics, trialists, patients, industry representatives, and government agencies, is working to improve the clinical trial ecosystem. The HFC aims to improve clinical trial efficiency and quality by standardizing concepts, and to help meet the demand for experienced individuals on DMCs by creating a standardized approach to training new members. This paper discusses the HFC's training workshop, and an apprenticeship model for new DMC members. It describes opportunities and challenges DMCs face, along with common myths and best practices learned through previous experiences, with an emphasis on data confidentiality and need for quality independent statistical reporting groups.
Collapse
|
3
|
Stevens G, Dolley S, Mogg R, Connor JT. A template for the authoring of statistical analysis plans. Contemp Clin Trials Commun 2023; 34:101100. [PMID: 37388218 PMCID: PMC10300078 DOI: 10.1016/j.conctc.2023.101100] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/26/2022] [Revised: 01/06/2023] [Accepted: 03/10/2023] [Indexed: 07/01/2023] Open
Abstract
A number of principal investigators may have limited access to biostatisticians, a lack of biostatistical training, or no requirement to complete a timely statistical analysis plan (SAP). SAPs completed early will identify design or implementation weak points, improve protocols, remove the temptation for p-hacking, and enable proper peer review by stakeholders considering funding the trial. An SAP completed at the same time as the study protocol might be the only comprehensive method for at once optimizing sample size, identifying bias, and applying rigor to study design. This ordered corpus of SAP sections with detailed definitions and a variety of examples represents an omnibus of best practice methods offered by biostatistical practitioners inside and outside of industry. The article presents a protocol template for clinical research design, enabling statisticians, from beginners to advanced.
Collapse
|
4
|
Crippa A, De Laere B, Discacciati A, Larsson B, Connor JT, Gabriel EE, Thellenberg C, Jänes E, Enblad G, Ullen A, Hjälm-Eriksson M, Oldenburg J, Ost P, Lindberg J, Eklund M, Grönberg H. The ProBio trial: molecular biomarkers for advancing personalized treatment decision in patients with metastatic castration-resistant prostate cancer. Trials 2020; 21:579. [PMID: 32586393 PMCID: PMC7318749 DOI: 10.1186/s13063-020-04515-8] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/12/2020] [Accepted: 06/15/2020] [Indexed: 12/14/2022] Open
Abstract
BACKGROUND Multiple therapies exist for patients with metastatic castration-resistant prostate cancer (mCRPC). However, their improvement on progression-free survival (PFS) remains modest, potentially explained by tumor molecular heterogeneity. Several prognostic molecular biomarkers have been identified for mCRPC that may have predictive potential to guide treatment selection and prolong PFS. We designed a platform trial to test this hypothesis. METHODS The Prostate-Biomarker (ProBio) study is a multi-center, outcome-adaptive, multi-arm, biomarker-driven platform trial for tailoring treatment decisions for men with mCRPC. Treatment decisions in the experimental arms are based on biomarker signatures defined as mutations in certain genes/pathways suggested in the scientific literature to be important for treatment response in mCRPC. The biomarker signatures are determined by targeted sequencing of circulating tumor and germline DNA using a panel specifically designed for mCRPC. DISCUSSION Patients are stratified based on the sequencing results and randomized to either current clinical practice (control), where the treating physician decides treatment, or to molecularly driven treatment selection based on the biomarker profile. Outcome-adaptive randomization is implemented to early identify promising treatments for a biomarker signature. Biomarker signature-treatment combinations graduate from the platform when they demonstrate 85% probability of improving PFS compared to the control arm. Graduated combinations are further evaluated in a seamless confirmatory trial with fixed randomization. The platform design allows for new drugs and biomarkers to be introduced in the study. CONCLUSIONS The ProBio design allows promising treatment-biomarker combinations to quickly graduate from the platform and be confirmed for rapid implementation in clinical care. TRIAL REGISTRATION ClinicalTrials.gov Identifier NCT03903835. Date of registration: April 4, 2019. Status: Recruiting.
Collapse
|
5
|
Eklund M, Broglio K, Yau C, Connor JT, Fiscalini AS, Esserman, LJ. Response to Carter et al. JNCI Cancer Spectr 2020; 4:pkaa016. [PMID: 32373780 PMCID: PMC7192025 DOI: 10.1093/jncics/pkaa016] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/06/2020] [Accepted: 02/24/2020] [Indexed: 11/15/2022] Open
|
6
|
Chamberlain JM, Kapur J, Shinnar S, Elm J, Holsti M, Babcock L, Rogers A, Barsan W, Cloyd J, Lowenstein D, Bleck TP, Conwit R, Meinzer C, Cock H, Fountain NB, Underwood E, Connor JT, Silbergleit R. Efficacy of levetiracetam, fosphenytoin, and valproate for established status epilepticus by age group (ESETT): a double-blind, responsive-adaptive, randomised controlled trial. Lancet 2020; 395:1217-1224. [PMID: 32203691 PMCID: PMC7241415 DOI: 10.1016/s0140-6736(20)30611-5] [Citation(s) in RCA: 113] [Impact Index Per Article: 28.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/17/2020] [Revised: 03/03/2020] [Accepted: 03/05/2020] [Indexed: 12/19/2022]
Abstract
BACKGROUND Benzodiazepine-refractory, or established, status epilepticus is thought to be of similar pathophysiology in children and adults, but differences in underlying aetiology and pharmacodynamics might differentially affect response to therapy. In the Established Status Epilepticus Treatment Trial (ESETT) we compared the efficacy and safety of levetiracetam, fosphenytoin, and valproate in established status epilepticus, and here we describe our results after extending enrolment in children to compare outcomes in three age groups. METHODS In this multicentre, double-blind, response-adaptive, randomised controlled trial, we recruited patients from 58 hospital emergency departments across the USA. Patients were eligible for inclusion if they were aged 2 years or older, had been treated for a generalised convulsive seizure of longer than 5 min duration with adequate doses of benzodiazepines, and continued to have persistent or recurrent convulsions in the emergency department for at least 5 min and no more than 30 min after the last dose of benzodiazepine. Patients were randomly assigned in a response-adaptive manner, using Bayesian methods and stratified by age group (<18 years, 18-65 years, and >65 years), to levetiracetam, fosphenytoin, or valproate. All patients, investigators, study staff, and pharmacists were masked to treatment allocation. The primary outcome was absence of clinically apparent seizures with improved consciousness and without additional antiseizure medication at 1 h from start of drug infusion. The primary safety outcome was life-threatening hypotension or cardiac arrhythmia. The efficacy and safety outcomes were analysed by intention to treat. This study is registered in ClinicalTrials.gov, NCT01960075. FINDINGS Between Nov 3, 2015, and Dec 29, 2018, we enrolled 478 patients and 462 unique patients were included: 225 children (aged <18 years), 186 adults (18-65 years), and 51 older adults (>65 years). 175 (38%) patients were randomly assigned to levetiracetam, 142 (31%) to fosphenyltoin, and 145 (31%) were to valproate. Baseline characteristics were balanced across treatments within age groups. The primary efficacy outcome was met in those treated with levetiracetam for 52% (95% credible interval 41-62) of children, 44% (33-55) of adults, and 37% (19-59) of older adults; with fosphenytoin in 49% (38-61) of children, 46% (34-59) of adults, and 35% (17-59) of older adults; and with valproate in 52% (41-63) of children, 46% (34-58) of adults, and 47% (25-70) of older adults. No differences were detected in efficacy or primary safety outcome by drug within each age group. With the exception of endotracheal intubation in children, secondary safety outcomes did not significantly differ by drug within each age group. INTERPRETATION Children, adults, and older adults with established status epilepticus respond similarly to levetiracetam, fosphenytoin, and valproate, with treatment success in approximately half of patients. Any of the three drugs can be considered as a potential first-choice, second-line drug for benzodiazepine-refractory status epilepticus. FUNDING National Institute of Neurological Disorders and Stroke, National Institutes of Health.
Collapse
|
7
|
Butler CC, van der Velden AW, Bongard E, Saville BR, Holmes J, Coenen S, Cook J, Francis NA, Lewis RJ, Godycki-Cwirko M, Llor C, Chlabicz S, Lionis C, Seifert B, Sundvall PD, Colliers A, Aabenhus R, Bjerrum L, Jonassen Harbin N, Lindbæk M, Glinz D, Bucher HC, Kovács B, Radzeviciene Jurgute R, Touboul Lundgren P, Little P, Murphy AW, De Sutter A, Openshaw P, de Jong MD, Connor JT, Matheeussen V, Ieven M, Goossens H, Verheij TJ. Oseltamivir plus usual care versus usual care for influenza-like illness in primary care: an open-label, pragmatic, randomised controlled trial. Lancet 2020; 395:42-52. [PMID: 31839279 DOI: 10.1016/s0140-6736(19)32982-4] [Citation(s) in RCA: 55] [Impact Index Per Article: 13.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/02/2019] [Revised: 11/06/2019] [Accepted: 11/08/2019] [Indexed: 12/25/2022]
Abstract
BACKGROUND Antivirals are infrequently prescribed in European primary care for influenza-like illness, mostly because of perceived ineffectiveness in real world primary care and because individuals who will especially benefit have not been identified in independent trials. We aimed to determine whether adding antiviral treatment to usual primary care for patients with influenza-like illness reduces time to recovery overall and in key subgroups. METHODS We did an open-label, pragmatic, adaptive, randomised controlled trial of adding oseltamivir to usual care in patients aged 1 year and older presenting with influenza-like illness in primary care. The primary endpoint was time to recovery, defined as return to usual activities, with fever, headache, and muscle ache minor or absent. The trial was designed and powered to assess oseltamivir benefit overall and in 36 prespecified subgroups defined by age, comorbidity, previous symptom duration, and symptom severity, using a Bayesian piece-wise exponential primary analysis model. The trial is registered with the ISRCTN Registry, number ISRCTN 27908921. FINDINGS Between Jan 15, 2016, and April 12, 2018, we recruited 3266 participants in 15 European countries during three seasonal influenza seasons, allocated 1629 to usual care plus oseltamivir and 1637 to usual care, and ascertained the primary outcome in 1533 (94%) and 1526 (93%). 1590 (52%) of 3059 participants had PCR-confirmed influenza infection. Time to recovery was shorter in participants randomly assigned to oseltamivir (hazard ratio 1·29, 95% Bayesian credible interval [BCrI] 1·20-1·39) overall and in 30 of the 36 prespecified subgroups, with estimated hazard ratios ranging from 1·13 to 1·72. The estimated absolute mean benefit from oseltamivir was 1·02 days (95% [BCrI] 0·74-1·31) overall, and in the prespecified subgroups, ranged from 0·70 (95% BCrI 0·30-1·20) in patients younger than 12 years, with less severe symptoms, no comorbidities, and shorter previous illness duration to 3·20 (95% BCrI 1·00-5·50) in patients aged 65 years or older who had more severe illness, comorbidities, and longer previous illness duration. Regarding harms, an increased burden of vomiting or nausea was observed in the oseltamivir group. INTERPRETATION Primary care patients with influenza-like illness treated with oseltamivir recovered one day sooner on average than those managed by usual care alone. Older, sicker patients with comorbidities and longer previous symptom duration recovered 2-3 days sooner. FUNDING European Commission's Seventh Framework Programme.
Collapse
|
8
|
Kapur J, Elm J, Chamberlain JM, Barsan W, Cloyd J, Lowenstein D, Shinnar S, Conwit R, Meinzer C, Cock H, Fountain N, Connor JT, Silbergleit R. Randomized Trial of Three Anticonvulsant Medications for Status Epilepticus. N Engl J Med 2019; 381:2103-2113. [PMID: 31774955 PMCID: PMC7098487 DOI: 10.1056/nejmoa1905795] [Citation(s) in RCA: 281] [Impact Index Per Article: 56.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/22/2022]
Abstract
BACKGROUND The choice of drugs for patients with status epilepticus that is refractory to treatment with benzodiazepines has not been thoroughly studied. METHODS In a randomized, blinded, adaptive trial, we compared the efficacy and safety of three intravenous anticonvulsive agents - levetiracetam, fosphenytoin, and valproate - in children and adults with convulsive status epilepticus that was unresponsive to treatment with benzodiazepines. The primary outcome was absence of clinically evident seizures and improvement in the level of consciousness by 60 minutes after the start of drug infusion, without additional anticonvulsant medication. The posterior probabilities that each drug was the most or least effective were calculated. Safety outcomes included life-threatening hypotension or cardiac arrhythmia, endotracheal intubation, seizure recurrence, and death. RESULTS A total of 384 patients were enrolled and randomly assigned to receive levetiracetam (145 patients), fosphenytoin (118), or valproate (121). Reenrollment of patients with a second episode of status epilepticus accounted for 16 additional instances of randomization. In accordance with a prespecified stopping rule for futility of finding one drug to be superior or inferior, a planned interim analysis led to the trial being stopped. Of the enrolled patients, 10% were determined to have had psychogenic seizures. The primary outcome of cessation of status epilepticus and improvement in the level of consciousness at 60 minutes occurred in 68 patients assigned to levetiracetam (47%; 95% credible interval, 39 to 55), 53 patients assigned to fosphenytoin (45%; 95% credible interval, 36 to 54), and 56 patients assigned to valproate (46%; 95% credible interval, 38 to 55). The posterior probability that each drug was the most effective was 0.41, 0.24, and 0.35, respectively. Numerically more episodes of hypotension and intubation occurred in the fosphenytoin group and more deaths occurred in the levetiracetam group than in the other groups, but these differences were not significant. CONCLUSIONS In the context of benzodiazepine-refractory convulsive status epilepticus, the anticonvulsant drugs levetiracetam, fosphenytoin, and valproate each led to seizure cessation and improved alertness by 60 minutes in approximately half the patients, and the three drugs were associated with similar incidences of adverse events. (Funded by the National Institute of Neurological Disorders and Stroke; ESETT ClinicalTrials.gov number, NCT01960075.).
Collapse
|
9
|
Eklund M, Broglio K, Yau C, Connor JT, Stover Fiscalini A, Esserman LJ. The WISDOM Personalized Breast Cancer Screening Trial: Simulation Study to Assess Potential Bias and Analytic Approaches. JNCI Cancer Spectr 2019; 2:pky067. [PMID: 31360882 PMCID: PMC6649825 DOI: 10.1093/jncics/pky067] [Citation(s) in RCA: 19] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/03/2017] [Revised: 09/05/2018] [Accepted: 10/09/2018] [Indexed: 12/20/2022] Open
Abstract
Background WISDOM (Women Informed to Screen Depending on Measures of Risk) is a randomized trial to assess whether personalized breast cancer screening—where women are screened biannually, annually, biennially, or not at all depending on risk and age—can prevent as many advanced (stage IIB or higher) cancers as annual screening in women ages 40–74 years across 5 years of trial time. The short study time in combination with design choices of not requiring study entry and exit mammograms for all participants may introduce different sources of bias in favor of either the personalized or the annual arm. Methods We designed a simulation model and performed 5000 virtual WISDOM trials to assess potential biases. Each virtual trial simulated 65 000 randomly assigned participants who were each assigned a risk stratum and a time to stage of at least IIB cancer sampled from an exponential distribution with the hazard rate based on the risk stratum. Results from the virtual trials were used to evaluate two candidate analysis strategies with respect to susceptibility for introducing bias: 1) difference between arms in total number of events over total trial time, and 2) difference in number of events within complete screening cycles. Results Based on the simulations, about 86 stage IIB or higher cancers will be detected within the trial and the total exposure time will be about 74 000 years in each arm. Potential ascertainment bias is introduced at study entry and exit. Analysis strategy 1 works better for the nonscreened stratum, whereas method 2 is considerably more unbiased for the strata of women screened biennially or every 6 months. Conclusion Combining the two candidate analysis approaches gives a reasonably unbiased analysis based on the simulations and is the method we will use for the primary analysis in WISDOM. Publishing the WISDOM analysis approach provides transparency and can aid the design and analysis of other individualized screening trials.
Collapse
|
10
|
Connor JT. BOOK REVIEW. Biometrics 2018. [DOI: 10.1111/biom.12946] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
|
11
|
Connor JT, DeMichele A, Wittes J. University of Pennsylvania ninth annual conference on statistical issues in clinical trials: Where are we with adaptive clinical trial designs? (afternoon panel discussion). Clin Trials 2017; 14:470-482. [PMID: 28776417 DOI: 10.1177/1740774517723605] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
|
12
|
Glassberg J, Minnitti C, Cromwell C, Cytryn L, Kraus T, Skloot GS, Connor JT, Rahman AH, Meurer WJ. Inhaled steroids reduce pain and sVCAM levels in individuals with sickle cell disease: A triple-blind, randomized trial. Am J Hematol 2017; 92:622-631. [PMID: 28370266 DOI: 10.1002/ajh.24742] [Citation(s) in RCA: 25] [Impact Index Per Article: 3.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/16/2017] [Accepted: 03/17/2017] [Indexed: 12/31/2022]
Abstract
Clinical and preclinical data demonstrate that altered pulmonary physiology (including increased inflammation, increased blood flow, airway resistance, and hyper-reactivity) is an intrinsic component of Sickle Cell Disease (SCD) and may contribute to excess SCD morbidity and mortality. Inhaled corticosteroids (ICS), a safe and effective therapy for pulmonary inflammation in asthma, may ameliorate the altered pulmonary physiologic milieu in SCD. With this single-center, longitudinal, randomized, triple-blind, placebo controlled trial we studied the efficacy and feasibility of ICS in 54 nonasthmatic individuals with SCD. Participants received once daily mometasone furoate 220 mcg dry powder inhalation or placebo for 16 weeks. The primary outcome was feasibility (the number who complete the trial divided by the total number enrolled) with prespecified efficacy outcomes including daily pain score over time (patient reported) and change in soluble vascular cell adhesion molecule (sVCAM) levels between entry and 8-weeks. For the primary outcome of feasibility, the result was 96% (52 of 54, 95% CI 87%-99%) for the intent-to-treat analysis and 83% (45 of 54, 95% CI 71%-91%) for the per-protocol analysis. The adjusted treatment effect of mometasone was a reduction in daily pain score of 1.42 points (95%CI 0.61-2.21, P = 0.001). Mometasone was associated with a reduction in sVCAM levels of 526.94 ng/mL more than placebo (95% CI 50.66-1003.23, P = 0.03). These results support further study of ICS in SCD including multicenter trials and longer durations of treatment. www.clinicaltrials.gov (NCT02061202).
Collapse
|
13
|
Luce BR, Connor JT, Broglio KR, Mullins CD, Ishak KJ, Saunders E, Davis BR. Using Bayesian Adaptive Trial Designs for Comparative Effectiveness Research: A Virtual Trial Execution. Ann Intern Med 2016; 165:431-8. [PMID: 27273013 DOI: 10.7326/m15-0823] [Citation(s) in RCA: 16] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/22/2022] Open
Abstract
BACKGROUND Bayesian and adaptive clinical trial designs offer the potential for more efficient processes that result in lower sample sizes and shorter trial durations than traditional designs. OBJECTIVE To explore the use and potential benefits of Bayesian adaptive clinical trial designs in comparative effectiveness research. DESIGN Virtual execution of ALLHAT (Antihypertensive and Lipid-Lowering Treatment to Prevent Heart Attack Trial) as if it had been done according to a Bayesian adaptive trial design. SETTING Comparative effectiveness trial of antihypertensive medications. PATIENTS Patient data sampled from the more than 42 000 patients enrolled in ALLHAT with publicly available data. MEASUREMENTS Number of patients randomly assigned between groups, trial duration, observed numbers of events, and overall trial results and conclusions. RESULTS The Bayesian adaptive approach and original design yielded similar overall trial conclusions. The Bayesian adaptive trial randomly assigned more patients to the better-performing group and would probably have ended slightly earlier. LIMITATIONS This virtual trial execution required limited resampling of ALLHAT patients for inclusion in RE-ADAPT (REsearch in ADAptive methods for Pragmatic Trials). Involvement of a data monitoring committee and other trial logistics were not considered. CONCLUSION In a comparative effectiveness research trial, Bayesian adaptive trial designs are a feasible approach and potentially generate earlier results and allocate more patients to better-performing groups. PRIMARY FUNDING SOURCE National Heart, Lung, and Blood Institute.
Collapse
|
14
|
Shermock KM, Connor JT, Smith NT, Fink JM, Bragg L. Validity of Criteria Used to Evaluate Fingerstick Devices That Assess International Normalized Ratio. Med Decis Making 2016; 26:239-46. [PMID: 16751322 DOI: 10.1177/0272989x06288681] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
Background . Investigators commonly rely on unvalidated, mainly arithmetic criteria to predict if point-of-care fingerstick devices that assess International Normalized Ratio (INR) lead to the same warfarin dosing decisions as a standard measure. Methods . Criteria that predict warfarin dosing agreement between 2 INR measurements were evaluated using clinicians’ actual dosing decisions as the standard. Bayesian hierarchical modeling was used to rank the criteria by the proportion of correct dosing predictions and the magnitude of difference between actual and predicted dosing agreement. Results . The prediction criteria misclassified dosing agreement for between 19% and 38% of paired INR values (x̄x: 27%). The magnitude of misclassification varied inconsistently throughout the INR scale. Conclusion . The unvalidated criteria used to predict warfarin dosing agreement between 2 INR measurements are associated with large error. Warfarin dosing decisions should be measured directly in such assessments.
Collapse
|
15
|
Meurer WJ, Connor JT, Glassberg J. Simulation of various randomization strategies for a clinical trial in sickle cell disease. ACTA ACUST UNITED AC 2016; 21:241-7. [PMID: 26868369 DOI: 10.1080/10245332.2015.1101966] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/22/2022]
Abstract
OBJECTIVE To use numerical simulation to evaluate various randomization strategies for a clinical trial in sickle cell disease (SCD). METHODS The Inhaled Mometasone to Promote Reduction in Vaso-occlusive Events trial* is a randomized, controlled, feasibility study of inhaled mometasone for individuals with SCD who do not have asthma. The target sample size is 45 patients and one goal is to limit imbalance with respect to two important covariates (1) hydroxyurea use and (2) historical emergency department (ED) utilization. We compared three methods of patient allocation (simple randomization, block randomization, and biased-coin adaptive randomization) using numerical simulation (10 000 trials). The primary outcome measure was the proportion of simulated trials with numerically apparent differences in the two covariates: hydroxyurea use (binary) and ED utilization (three-level ordinal). RESULTS Overall, only 1.6% of simulated trials had any covariate comparison with P < 0.3 across groups for simple randomization, and 0% for both the block and adaptive randomization. In trials where the total sample size was 45 patients, the block randomization strategy achieved the greatest balance because participants were deterministically assigned to the treatment arm that balanced covariates. The adaptive strategy achieved similar results without deterministic treatment assignments even when trials included only 45 patients. DISCUSSION Adaptive clinical trial designs have potential to mitigate some of the challenges that have hampered SCD trials. In small exploratory trials, even non-statistically significant differences in important covariates can threaten interpretability and external validity. CONCLUSION Adaptive randomization performed similarly to block randomization and offers advantages including better allocation concealment and less ability for investigators to predict the next assignment.
Collapse
|
16
|
Lee RJ, Lakkireddy D, Mittal S, Ellis C, Connor JT, Saville BR, Wilber D. Percutaneous alternative to the Maze procedure for the treatment of persistent or long-standing persistent atrial fibrillation (aMAZE trial): Rationale and design. Am Heart J 2015; 170:1184-94. [PMID: 26678640 DOI: 10.1016/j.ahj.2015.09.019] [Citation(s) in RCA: 74] [Impact Index Per Article: 8.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/06/2015] [Accepted: 09/26/2015] [Indexed: 11/15/2022]
Abstract
BACKGROUND Pulmonary vein antrum isolation (PVI) as a treatment of paroxysmal atrial fibrillation (AF) is associated with a high rate of success; however, outcomes for treating persistent and long-standing persistent AF with PVI alone are substantially lower and often require multiple procedures to maintain long-term freedom from atrial arrhythmias. Foci and/or substrate outside the pulmonary veins, particularly in the left atrial appendage (LAA), has been identified as a key mechanism in the maintenance of persistent AF and long-standing persistent AF. OBJECTIVE The goals of the study are to evaluate the safety and effectiveness of the LARIAT System to percutaneously isolate and ligate the LAA and to determine if LAA ligation as adjunctive therapy to PVI improves maintenance of sinus rhythm in patients with persistent and long-standing persistent AF. STUDY DESIGN The trial is a prospective, multicenter, randomized controlled study. The trial design incorporates a Bayesian adaptive design that will randomize a maximum of 600 patients with persistent or long-standing persistent AF to LAA ligation and PVI vs PVI alone in a 2:1 randomization. The primary end points include 30-day safety of the LARIAT procedure and freedom from documented AF, atrial flutter, or atrial tachycardia of more than 30 seconds at 12 months after the PVI off antiarrhythmic drugs. Key secondary outcomes include a composite of cardiovascular death and stroke, as well as quality of life. CONCLUSION The aMAZE trial will determine if LAA ligation as adjunctive therapy to PVI increases the efficacy of maintaining sinus rhythm in patients with persistent and long-standing persistent AF.
Collapse
|
17
|
|
18
|
|
19
|
Connor JT, Broglio KR, Durkalski V, Meurer WJ, Johnston KC. The Stroke Hyperglycemia Insulin Network Effort (SHINE) trial: an adaptive trial design case study. Trials 2015; 16:72. [PMID: 25885963 PMCID: PMC4352277 DOI: 10.1186/s13063-015-0574-8] [Citation(s) in RCA: 18] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/30/2014] [Accepted: 01/20/2015] [Indexed: 11/17/2022] Open
Abstract
Background The ‘Adaptive Designs Accelerating Promising Trials into Treatments (ADAPT-IT)’ project is a collaborative effort supported by the National Institutes of Health (NIH) and United States Food & Drug Administration (FDA) to explore how adaptive clinical trial design might improve the evaluation of drugs and medical devices. ADAPT-IT uses the National Institute of Neurologic Disorders & Stroke-supported Neurological Emergencies Treatment Trials (NETT) network as a ‘laboratory’ in which to study the development of adaptive clinical trial designs in the confirmatory setting. The Stroke Hyperglycemia Insulin Network Effort (SHINE) trial was selected for funding by the NIH-NINDS at the start of ADAPT-IT and is currently an ongoing phase III trial of tight glucose control in hyperglycemic acute ischemic stroke patients. Within ADAPT-IT, a Bayesian adaptive Goldilocks trial design alternative was developed. Methods The SHINE design includes response adaptive randomization, a sample size re-estimation, and monitoring for early efficacy and futility according to a group sequential design. The Goldilocks design includes more frequent monitoring for predicted success or futility and a longitudinal model of the primary endpoint. Both trial designs were simulated and compared in terms of their mean sample size and power across a range of treatment effects and success rates for the control group. Results As simulated, the SHINE design tends to have slightly higher power and the Goldilocks design has a lower mean sample size. Both designs were tuned to have approximately 80% power to detect a difference of 25% versus 32% between control and treatment, respectively. In this scenario, mean sample sizes are 1,114 and 979 for the SHINE and Goldilocks designs, respectively. Conclusions Two designs were brought forward, and both were evaluated, revised, and improved based on the input of all parties involved in the ADAPT-IT process. However, the SHINE investigators were tasked with choosing only a single design to implement and ultimately elected not to implement the Goldilocks design. The Goldilocks design will be retrospectively executed upon completion of SHINE to later compare the designs based on their use of patient resources, time, and conclusions in a real world setting. Trial registration ClinicalTrials.gov NCT01369069 June 2011.
Collapse
|
20
|
Broglio KR, Connor JT, Berry SM. Not too big, not too small: a goldilocks approach to sample size selection. J Biopharm Stat 2014; 24:685-705. [PMID: 24697532 DOI: 10.1080/10543406.2014.888569] [Citation(s) in RCA: 29] [Impact Index Per Article: 2.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/25/2022]
Abstract
We present a Bayesian adaptive design for a confirmatory trial to select a trial's sample size based on accumulating data. During accrual, frequent sample size selection analyses are made and predictive probabilities are used to determine whether the current sample size is sufficient or whether continuing accrual would be futile. The algorithm explicitly accounts for complete follow-up of all patients before the primary analysis is conducted. We refer to this as a Goldilocks trial design, as it is constantly asking the question, "Is the sample size too big, too small, or just right?" We describe the adaptive sample size algorithm, describe how the design parameters should be chosen, and show examples for dichotomous and time-to-event endpoints.
Collapse
|
21
|
Saville BR, Connor JT, Ayers GD, Alvarez J. The utility of Bayesian predictive probabilities for interim monitoring of clinical trials. Clin Trials 2014; 11:485-493. [PMID: 24872363 DOI: 10.1177/1740774514531352] [Citation(s) in RCA: 79] [Impact Index Per Article: 7.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
BACKGROUND Bayesian predictive probabilities can be used for interim monitoring of clinical trials to estimate the probability of observing a statistically significant treatment effect if the trial were to continue to its predefined maximum sample size. PURPOSE We explore settings in which Bayesian predictive probabilities are advantageous for interim monitoring compared to Bayesian posterior probabilities, p-values, conditional power, or group sequential methods. RESULTS For interim analyses that address prediction hypotheses, such as futility monitoring and efficacy monitoring with lagged outcomes, only predictive probabilities properly account for the amount of data remaining to be observed in a clinical trial and have the flexibility to incorporate additional information via auxiliary variables. LIMITATIONS Computational burdens limit the feasibility of predictive probabilities in many clinical trial settings. The specification of prior distributions brings additional challenges for regulatory approval. CONCLUSIONS The use of Bayesian predictive probabilities enables the choice of logical interim stopping rules that closely align with the clinical decision-making process.
Collapse
|
22
|
Pavlovich CP, Cornish TC, Mullins JK, Fradin J, Mettee LZ, Connor JT, Reese AC, Askin FB, Luck R, Epstein JI, Burke HB. High-resolution transrectal ultrasound: Pilot study of a novel technique for imaging clinically localized prostate cancer. Urol Oncol 2014; 32:34.e27-32. [DOI: 10.1016/j.urolonc.2013.01.006] [Citation(s) in RCA: 16] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/08/2012] [Revised: 12/31/2012] [Accepted: 01/19/2013] [Indexed: 10/27/2022]
|
23
|
Broglio KR, Connor JT, Berry SM. Combining risk difference and risk ratio in noninferiority trials of safety. J Biopharm Stat 2013; 23:261-71. [PMID: 23331235 DOI: 10.1080/10543406.2011.616966] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/27/2022]
Abstract
Prior to marketing, the long-term safety profile of a new therapy is often uncertain. One recommendation for premarket safety studies is to compare the new therapy to an appropriate control to determine whether the 95% confidence interval of the risk ratio is entirely less than a prespecified threshold (e.g., 1.8). The restriction to the risk ratio, however, has consequences that may not be intended. Risk difference may be a more appropriate measure of risk in this setting when event rates are very low. We propose using a suitable combination of risk ratio and risk difference in demonstrating noninferiority.
Collapse
|
24
|
Connor JT, Elm JJ, Broglio KR. Bayesian adaptive trials offer advantages in comparative effectiveness trials: an example in status epilepticus. J Clin Epidemiol 2013; 66:S130-7. [PMID: 23849147 DOI: 10.1016/j.jclinepi.2013.02.015] [Citation(s) in RCA: 60] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/17/2012] [Revised: 01/31/2013] [Accepted: 02/19/2013] [Indexed: 11/15/2022]
Abstract
OBJECTIVE We present a novel Bayesian adaptive comparative effectiveness trial comparing three treatments for status epilepticus that uses adaptive randomization with potential early stopping. STUDY DESIGN AND SETTING The trial will enroll 720 unique patients in emergency departments and uses a Bayesian adaptive design. RESULTS The trial design is compared to a trial without adaptive randomization and produces an efficient trial in which a higher proportion of patients are likely to be randomized to the most effective treatment arm while generally using fewer total patients and offers higher power than an analogous trial with fixed randomization when identifying a superior treatment. CONCLUSION When one treatment is superior to the other two, the trial design provides better patient care, higher power, and a lower expected sample size.
Collapse
|
25
|
Connor JT, Luce BR, Broglio KR, Ishak KJ, Mullins CD, Vanness DJ, Fleurence R, Saunders E, Davis BR. Do Bayesian adaptive trials offer advantages for comparative effectiveness research? Protocol for the RE-ADAPT study. Clin Trials 2013; 10:807-27. [PMID: 23983160 PMCID: PMC3834735 DOI: 10.1177/1740774513497293] [Citation(s) in RCA: 20] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
BACKGROUND Randomized clinical trials, particularly for comparative effectiveness research (CER), are frequently criticized for being overly restrictive or untimely for health-care decision making. PURPOSE Our prospectively designed REsearch in ADAptive methods for Pragmatic Trials (RE-ADAPT) study is a 'proof of concept' to stimulate investment in Bayesian adaptive designs for future CER trials. METHODS We will assess whether Bayesian adaptive designs offer potential efficiencies in CER by simulating a re-execution of the Antihypertensive and Lipid Lowering Treatment to Prevent Heart Attack Trial (ALLHAT) study using actual data from ALLHAT. RESULTS We prospectively define seven alternate designs consisting of various combinations of arm dropping, adaptive randomization, and early stopping and describe how these designs will be compared to the original ALLHAT design. We identify the one particular design that would have been executed, which incorporates early stopping and information-based adaptive randomization. LIMITATIONS While the simulation realistically emulates patient enrollment, interim analyses, and adaptive changes to design, it cannot incorporate key features like the involvement of data monitoring committee in making decisions about adaptive changes. CONCLUSION This article describes our analytic approach for RE-ADAPT. The next stage of the project is to conduct the re-execution analyses using the seven prespecified designs and the original ALLHAT data.
Collapse
|