1
|
Weatherald J, Fleming TR, Wilkins MR, Cascino TM, Psotka MA, Zamanian R, Seeger W, Galiè N, Gomberg-Maitland M. Clinical trial design, end-points, and emerging therapies in pulmonary arterial hypertension. Eur Respir J 2024:2401205. [PMID: 39209468 DOI: 10.1183/13993003.01205-2024] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/21/2024] [Accepted: 06/21/2024] [Indexed: 09/04/2024]
Abstract
Clinical trials in pulmonary arterial hypertension (PAH) have led to the approval of several effective treatments that improve symptoms, exercise capacity and clinical outcomes. In phase 3 clinical trials, primary end-points must reflect how a patient "feels, functions or survives". In a rare disease like PAH, with an ever-growing number of treatment options and numerous candidate therapies being studied, future clinical trials are now faced with challenges related to sample size requirements, efficiency and demonstration of incremental benefit on traditional end-points in patients receiving background therapy with multiple drugs. Novel clinical trial end-points, innovative trial designs and statistical approaches and new technologies may be potential solutions to tackle the challenges facing future PAH trials, but these must be acceptable to patients and regulatory bodies while preserving methodological rigour. In this World Symposium on Pulmonary Hypertension task force article, we address emerging trial end-points and designs, biomarkers and surrogate end-point validation, the concept of disease modification, challenges and opportunities to address diversity and representativeness, and the use of new technologies such as artificial intelligence in PAH clinical trials.
Collapse
Affiliation(s)
- Jason Weatherald
- Department of Medicine, Division of Pulmonary Medicine, University of Alberta, Edmonton, AB, Canada
| | - Thomas R Fleming
- Department of Biostatistics, University of Washington, Seattle, WA, USA
| | - Martin R Wilkins
- National Heart and Lung Institute, Imperial College London, London, UK
| | - Thomas M Cascino
- Division of Cardiovascular Medicine, University of Michigan, Ann Arbor, MI, USA
| | - Mitchell A Psotka
- Inova Schar Heart and Vascular, Falls Church, VA, USA
- United States Food and Drug Administration, Silver Spring, MD, USA
| | - Roham Zamanian
- Vera Moulton Wall Center for Pulmonary Vascular Disease, Stanford University School of Medicine, Palo Alto, CA, USA
| | - Werner Seeger
- Department of Internal Medicine, Universities of Giessen and Marburg Lung Center (UGMLC), Institute for Lung Health (ILH), Cardio-Pulmonary Institute (CPI), Member of the German Center for Lung Research (DZL), Giessen, Germany
| | - Nazzareno Galiè
- Cardiology Unit, IRCCS Azienda Ospedaliero-Universitaria di Bologna and Dipartimento DIMEC, Università di Bologna, Bologna, Italy
| | - Mardi Gomberg-Maitland
- Division of Cardiovascular Medicine, Department of Medicine, George Washington University, School of Medicine, Washington, DC, USA
| |
Collapse
|
2
|
Mao L. Defining estimand for the win ratio: Separate the true effect from censoring. Clin Trials 2024:17407745241259356. [PMID: 39076157 DOI: 10.1177/17407745241259356] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 07/31/2024]
Abstract
The win ratio has been increasingly used in trials with hierarchical composite endpoints. While the outcomes involved and the rule for their comparisons vary with the application, there is invariably little attention to the estimand of the resulting statistic, causing difficulties in interpretation and cross-trial comparison. We make the case for articulating the estimand as a first step to win ratio analysis and establish that the root cause for its elusiveness is its intrinsic dependency on the time frame of comparison, which, if left unspecified, is set haphazardly by trial-specific censoring. From the statistical literature, we summarize two general approaches to overcome this uncertainty-a nonparametric one that pre-specifies the time frame for all comparisons, and a semiparametric one that posits a constant win ratio across all times-each with publicly available software and real examples. Finally, we discuss unsolved challenges, such as estimand construction and inference in the presence of intercurrent events.
Collapse
Affiliation(s)
- Lu Mao
- Department of Biostatistics and Medical Informatics, School of Medicine and Public Health, University of Wisconsin-Madison, Madison, WI, USA
| |
Collapse
|
3
|
Carpio Alvarez M, Cintado Benitez A, Diaz Argudin T, Nodarse Cuni H, Dominguez Horta MDC, Fernández Massó JR. Association between COMMD1 gene polymorphism rs11125908 and rheumatoid arthritis in the Cuban population. Reumatismo 2024; 76. [PMID: 38916163 DOI: 10.4081/reumatismo.2024.1691] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/04/2023] [Accepted: 03/09/2024] [Indexed: 06/26/2024] Open
Abstract
OBJECTIVE To evaluate the association of the rs11125908 polymorphism in the COMMD1 gene in the Cuban population with rheumatoid arthritis (RA). METHODS In this case-control study, 161 RA patients and 150 control subjects were genotyped for rs11125908 by the allele-specific polymerase chain reaction method. DNA sequencing was used to verify the assignation of the polymorphism. The odds ratios (OR) and their 95% confidence interval were calculated by logistic regression to determine the associations between genotypes and RA using the SNPStats software. RESULTS An association of the single nucleotide polymorphism with the disease was found in the overdominant model (p=0.025; OR=1.91) for the AG genotype. Our analyses revealed an association between rs11125908 and the subgroup of patients with swollen joints < median under the codominant model for AG (p=0.034; OR=2.30) and GG genotype (p=0.034; OR=0.82) and with the overdominant model (p=0.01; OR=2.38). The subgroup of patients with an age of onset lower than the mean and AG genotype showed an association in the overdominant model (p=0.027; OR=2.27). Disease activity score 28 with erythrocyte sedimentation rate and disease duration variables were not associated with the rs11125908 polymorphism. CONCLUSIONS rs11125908 was associated with RA and with the number of swollen joints and age of onset subgroup analyses. We provide concepts for treatments for RA, based on pharmacological management of COMMD1 expression.
Collapse
Affiliation(s)
- M Carpio Alvarez
- Pharmaceutical Department, Center for Genetic Engineering and Biotechnology, Havana.
| | - A Cintado Benitez
- Pharmacogenomics Department, Center for Genetic Engineering and Biotechnology, Havana.
| | - T Diaz Argudin
- Pharmacogenomics Department, Center for Genetic Engineering and Biotechnology, Havana.
| | - H Nodarse Cuni
- Clinical Research Direction, Center for Genetic Engineering and Biotechnology, Havana.
| | - M D C Dominguez Horta
- Pharmaceutical Department, Center for Genetic Engineering and Biotechnology, Havana.
| | - J R Fernández Massó
- Pharmaceutical Department, Center for Genetic Engineering and Biotechnology, Havana.
| |
Collapse
|
4
|
Hardy M, Harris PNA, Paterson DL, Chatfield MD, Mo Y. Win Ratio Analyses of Piperacillin-Tazobactam Versus Meropenem for Ceftriaxone-Nonsusceptible Escherichia coli or Klebsiella pneumoniae Bloodstream Infections: Post Hoc Insights From the MERINO Trial. Clin Infect Dis 2024; 78:1482-1489. [PMID: 38306577 DOI: 10.1093/cid/ciae050] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/21/2023] [Revised: 01/18/2024] [Accepted: 01/30/2024] [Indexed: 02/04/2024] Open
Abstract
BACKGROUND Clinical trials of treatments for serious infections commonly use the primary endpoint of all-cause mortality. However, many trial participants survive their infection and this endpoint may not truly reflect important benefits and risks of therapy. The win ratio uses a hierarchical composite endpoint that can incorporate and prioritize outcome measures by relative clinical importance. METHODS The win ratio methodology was applied post hoc to outcomes observed in the MERINO trial, which compared piperacillin-tazobactam with meropenem. We quantified the win ratio with a primary hierarchical composite endpoint, including all-cause mortality, microbiological relapse, and secondary infection. A win ratio of 1 would correspond to no difference between the 2 antibiotics, while a ratio <1 favors meropenem. Further analyses were performed to calculate the win odds and to introduce a continuous outcome variable in order to reduce ties. RESULTS With the hierarchy of all-cause mortality, microbiological relapse, and secondary infection, the win ratio estimate was 0.40 (95% confidence interval [CI], .22-.71]; P = .002), favoring meropenem over piperacillin-tazobactam. However, 73.4% of the pairs were tied due to the small proportion of events. The win odds, a modification of the win ratio accounting for ties, was 0.79 (95% CI, .68-.92). The addition of length of stay to the primary composite greatly minimized the number of ties (4.6%) with a win ratio estimate of 0.77 (95% CI, .60-.99; P = .04). CONCLUSIONS The application of the win ratio methodology to the MERINO trial data illustrates its utility and feasibility for use in antimicrobial trials.
Collapse
Affiliation(s)
- Melissa Hardy
- UQ Centre for Clinical Research, The University of Queensland, Brisbane, Queensland, Australia
| | - Patrick N A Harris
- UQ Centre for Clinical Research, The University of Queensland, Brisbane, Queensland, Australia
- Central Microbiology Laboratory, Pathology Queensland, Brisbane, Queensland, Australia
| | - David L Paterson
- UQ Centre for Clinical Research, The University of Queensland, Brisbane, Queensland, Australia
- ADVANCE-ID, Saw Swee Hock School of Public Health, National University of Singapore, Singapore
- Infectious Diseases Translational Research Programme, Yong Loo Lin School of Medicine, National University of Singapore, Singapore
| | - Mark D Chatfield
- UQ Centre for Clinical Research, The University of Queensland, Brisbane, Queensland, Australia
| | - Yin Mo
- ADVANCE-ID, Saw Swee Hock School of Public Health, National University of Singapore, Singapore
- Centre for Tropical Medicine and Global Health, Nuffield Department of Medicine, University of Oxford, United Kingdom
- Mahidol-Oxford Tropical Medicine Research Unit, Faculty of Tropical Medicine, Mahidol University, Bangkok, Thailand
- Division of Infectious Diseases, University Medicine Cluster, National University Hospital, Singapore
- Yong Loo Lin School of Medicine, National University of Singapore, Singapore
| |
Collapse
|
5
|
Chiaruttini MV, Lorenzoni G, Spolverato G, Gregori D. Win Statistics in Observational Cancer Research: Integrating Clinical and Quality-of-Life Outcomes. J Clin Med 2024; 13:3272. [PMID: 38892983 PMCID: PMC11173121 DOI: 10.3390/jcm13113272] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/30/2024] [Revised: 05/29/2024] [Accepted: 05/29/2024] [Indexed: 06/21/2024] Open
Abstract
Background: Quality-of-life metrics are increasingly important for oncological patients alongside traditional endpoints like mortality and disease progression. Statistical tools such as Win Ratio, Win Odds, and Net Benefit prioritize clinically significant outcomes using composite endpoints. In randomized trials, Win Statistics provide fair comparisons between treatment and control groups. However, their use in observational studies is complicated by confounding variables. Propensity score (PS) matching mitigates confounding variables but may reduce the sample size, affecting the power of win statistics analyses. Alternatively, PS matching can stratify samples, preserving the sample size. This study aims to assess the long-term impact of these methods on decision making, particularly in colorectal cancer patients. Methods: A motivating example involves a cohort of patients from the ReSARCh observational study (2016-2021) with locally advanced adenocarcinoma of the rectum, situated up to 12 cm from the anal verge. These patients underwent either a watch-and-wait approach (WW) or trans-anal local excision (LE). Win statistics compared the effects of WW and LE on a composite outcome (overall survival, recurrence, presence of ostomy, and rectum excision). For matched win statistics, we used robust inference techniques proposed by Matsouaka et al. (2022), and for stratified win statistics, we applied the method proposed by Dong et al. (2018). A simulation study assessed the coverage probability of matched and stratified win statistics in balanced and unbalanced groups, calculating how often the confidence intervals included the true values of WR, NB, and WO across 1000 simulations. Results: The results suggest a better efficacy of the LE approach when considering efficacy outcomes alone (WR: 0.47 (0.01 to 1.14); NB: -0.16 (-0.34 to 0.02); and WO: 0.73 (0.5 to 1.05)). However, when QoL outcomes are included in the analyses, the estimates are closer to 1 (WR: 0.87 (0.06 to 2.06); WO: 0.93 (0.61 to 1.4)) and to 0 (NB: -0.04 (-0.25 to 0.17)), indicating a negative impact of the treatment effect of LE regarding the presence of ostomy and the excision of the rectum. Moreover, based on the simulation study, our findings underscore the superior performance of matched compared to stratified win statistics in terms of coverage probability (matched WR: 97% vs. stratified WR: 33.3% in a high-imbalance setting; matched WR: 98% vs. stratified WR: 34.4% in a medium-imbalance setting; and matched WR: 99.2% vs. stratified WR: 37.4% in a low-imbalance setting). Conclusions: In conclusion, our study sheds light on the interpretation of the results of win statistics in terms of statistical significance, providing insights into the application of pairwise comparison in observational settings, promoting its use to improve outcomes for cancer patients.
Collapse
Affiliation(s)
- Maria Vittoria Chiaruttini
- Unit of Biostatistics, Epidemiology and Public Health, Department of Cardiac, Thoracic, and Vascular Sciences and Public Health, University of Padova, 35128 Padova, Italy; (M.V.C.); (G.L.)
| | - Giulia Lorenzoni
- Unit of Biostatistics, Epidemiology and Public Health, Department of Cardiac, Thoracic, and Vascular Sciences and Public Health, University of Padova, 35128 Padova, Italy; (M.V.C.); (G.L.)
| | - Gaya Spolverato
- Department of Surgical Oncological and Gastrointestinal Science, University of Padova, 35128 Padova, Italy;
| | - Dario Gregori
- Unit of Biostatistics, Epidemiology and Public Health, Department of Cardiac, Thoracic, and Vascular Sciences and Public Health, University of Padova, 35128 Padova, Italy; (M.V.C.); (G.L.)
| |
Collapse
|
6
|
Kondo T, Jhund PS, Gasparyan SB, Yang M, Claggett BL, McCausland FR, Tolomeo P, Vadagunathan M, Heerspink HJL, Solomon SD, McMurray JJV. A hierarchical kidney outcome using win statistics in patients with heart failure from the DAPA-HF and DELIVER trials. Nat Med 2024; 30:1432-1439. [PMID: 38710952 PMCID: PMC11108780 DOI: 10.1038/s41591-024-02941-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/13/2023] [Accepted: 03/21/2024] [Indexed: 05/08/2024]
Abstract
Win statistics offer a new approach to the analysis of outcomes in clinical trials, allowing the combination of time-to-event and longitudinal measurements and taking into account the clinical importance of the components of composite outcomes, as well as their relative timing. We examined this approach in a post hoc analysis of two trials that compared dapagliflozin to placebo in patients with heart failure and reduced ejection fraction (DAPA-HF) and mildly reduced or preserved ejection fraction (DELIVER). The effect of dapagliflozin on a hierarchical composite kidney outcome was assessed, including the following: (1) all-cause mortality; (2) end-stage kidney disease; (3) a decline in estimated glomerular filtration rate (eGFR) of ≥57%; (4) a decline in eGFR of ≥50%; (5) a decline in eGFR of ≥40%; and (6) participant-level eGFR slope. For this outcome, the win ratio was 1.10 (95% confidence interval (CI) = 1.06-1.15) in the combined dataset, 1.08 (95% CI = 1.01-1.16) in the DAPA-HF trial and 1.12 (95% CI = 1.05-1.18) in the DELIVER trial; that is, dapagliflozin was superior to placebo in both trials. The benefits of treatment were consistent in participants with and without baseline kidney disease, and with and without type 2 diabetes. In heart failure trials, win statistics may provide the statistical power to evaluate the effect of treatments on kidney as well as cardiovascular outcomes.
Collapse
Affiliation(s)
- Toru Kondo
- British Heart Foundation Cardiovascular Research Centre, University of Glasgow, Glasgow, UK
- Department of Cardiology, Nagoya University Graduate School of Medicine, Nagoya, Japan
| | - Pardeep S Jhund
- British Heart Foundation Cardiovascular Research Centre, University of Glasgow, Glasgow, UK
| | - Samvel B Gasparyan
- Late-Stage Development, Cardiovascular, Renal, and Metabolism, BioPharmaceuticals R&D, AstraZeneca, Gothenburg, Sweden
| | - Mingming Yang
- British Heart Foundation Cardiovascular Research Centre, University of Glasgow, Glasgow, UK
- Department of Cardiology, Zhongda Hospital, School of Medicine, Southeast University, Nanjing, China
| | - Brian L Claggett
- Cardiovascular Division, Brigham and Women's Hospital, Harvard Medical School, Boston, MA, USA
| | - Finnian R McCausland
- Renal Division, Brigham and Women's Hospital, Harvard Medical School, Boston, MA, USA
| | - Paolo Tolomeo
- British Heart Foundation Cardiovascular Research Centre, University of Glasgow, Glasgow, UK
| | - Muthiah Vadagunathan
- Cardiovascular Division, Brigham and Women's Hospital, Harvard Medical School, Boston, MA, USA
| | - Hiddo J L Heerspink
- Department of Clinical Pharmacy and Pharmacology, University of Groningen, Groningen, the Netherlands
| | - Scott D Solomon
- Cardiovascular Division, Brigham and Women's Hospital, Harvard Medical School, Boston, MA, USA
| | - John J V McMurray
- British Heart Foundation Cardiovascular Research Centre, University of Glasgow, Glasgow, UK.
| |
Collapse
|
7
|
Zhang P, Li XN. A win ratio-based framework to combine multiple clinical endpoints in exploratory basket trials. J Biopharm Stat 2024; 34:251-259. [PMID: 38252040 DOI: 10.1080/10543406.2023.2187819] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/23/2022] [Accepted: 03/01/2023] [Indexed: 03/11/2023]
Abstract
In contemporary exploratory phase of oncology drug development, there has been an increasing interest in evaluating investigational drug or drug combination in multiple tumor indications in a single basket trial to expedite drug development. There has been extensive research on more efficiently borrowing information across tumor indications in early phase drug development including Bayesian hierarchical modeling and the pruning-and-pooling methods. Despite the fact that the Go/No-Go decision for subsequent Phase 2 or Phase 3 trial initiation is almost always a multi-facet consideration, the statistical literature of basket trial design and analysis has largely been limited to a single binary endpoint. In this paper we explore the application of considering clinical priorities of multiple endpoints based on matched win ratio to the basket trial design and analysis. The control arm data will be simulated for each tumor indication based on the corresponding null assumptions that could be heterogeneous across tumor indications. The matched win ratio matching on the tumor indication can be performed for individual tumor indication, pooled data, or the pooled data after pruning depending on whether an individual evaluation or a simple pooling or a pruning-and-pooling method is used. We conduct the simulation studies to evaluate the performance of proposed win ratio-based framework and the results suggest the proposed framework could provide desirable operating characteristics.
Collapse
Affiliation(s)
- Pingye Zhang
- Global Statistics and Data Science, BeiGene, Ltd, Ridgefield Park, New Jersey, USA
| | - Xiaoyun Nicole Li
- Global Statistics and Data Science, BeiGene, Ltd, Ridgefield Park, New Jersey, USA
| |
Collapse
|
8
|
Mao L, Wang T. Dissecting the restricted mean time in favor of treatment. J Biopharm Stat 2024; 34:111-126. [PMID: 37224223 PMCID: PMC10667568 DOI: 10.1080/10543406.2023.2210658] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/01/2022] [Accepted: 05/01/2023] [Indexed: 05/26/2023]
Abstract
The restricted mean time in favor (RMT-IF) summarizes the treatment effect on a hierarchical composite endpoint with mortality at the top. Its crude decomposition into "stage-wise effects," i.e., the net average time gained by the treatment prior to each component event, does not reveal the patient state in which the extra time is spent. To obtain this information, we break each stage-wise effect into subcomponents according to the specific state to which the reference condition is improved. After re-expressing the subcomponents as functionals of the marginal survival functions of outcome events, we estimate them conveniently by plugging in the Kaplan -- Meier estimators. Their robust variance matrices allow us to construct joint tests on the decomposed units, which are particularly powerful against component-wise differential treatment effects. By reanalyzing a cancer trial and a cardiovascular trial, we acquire new insights into the quality and composition of the extra survival times, as well as the extra time with fewer hospitalizations, gained by the treatment in question. The proposed methods are implemented in the rmt package freely available on the Comprehensive R Archive Network (CRAN).
Collapse
Affiliation(s)
- Lu Mao
- Department of Biostatistics and Medical Informatics, School of Medicine and Public Health, University of Wisconsin-Madison, Madison, WI, USA
| | - Tuo Wang
- Department of Biostatistics and Medical Informatics, School of Medicine and Public Health, University of Wisconsin-Madison, Madison, WI, USA
| |
Collapse
|
9
|
Lieto E, Cardella F, Wang D, Ronchi A, Del Sorbo G, Panarese I, Ferraraccio F, De Vita F, Galizia G, Auricchio A. Assessment of the DNA Mismatch Repair System Is Crucial in Colorectal Cancers Necessitating Adjuvant Treatment: A Propensity Score-Matched and Win Ratio Analysis. Cancers (Basel) 2023; 16:134. [PMID: 38201561 PMCID: PMC10778196 DOI: 10.3390/cancers16010134] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/22/2023] [Revised: 12/20/2023] [Accepted: 12/24/2023] [Indexed: 01/12/2024] Open
Abstract
A deficient DNA mismatch repair (MMR) system is identified in a non-negligible part of sporadic colorectal cancers (CRCs), and its prognostic value remains controversial. High tumor mutational burden, along with a poor response to conventional chemotherapy and excellent results from immunotherapy, are the main features of this subset. The aim of this study was to evaluate the predictive value of DNA MMR system status for its best treatment. Four hundred and three CRC patients, operated on from 2014 to 2021 and not treated with immunotherapy, entered this study. Immunohistochemistry and polymerase chain reaction, as appropriate, were used to unequivocally group specimens into microsatellite stable (MSS) and instable (MSI) tumors. The win-ratio approach was utilized to compare composite outcomes. MSI tumors accounted for 12.9% of all series. The right tumor location represented the most important factor related to MSI. The status of the DNA MMR system did not appear to correlate with outcome in early-stage CRCs not requiring adjuvant treatment; in advanced stages undergoing conventional chemotherapy, MSI tumors showed significantly poorer overall and disease-free survival rates and the highest win ratio instead. The determination of DNA MMR status is crucial to recommending correct management. There is clear evidence that instable CRCs needing adjuvant therapy should undergo appropriate treatments.
Collapse
Affiliation(s)
- Eva Lieto
- Division of GI Tract Surgical Oncology, Department of Translational Medical Sciences, University of Campania “Luigi Vanvitelli”, 80138 Naples, Italy; (E.L.); (F.C.); (G.D.S.); (A.A.)
| | - Francesca Cardella
- Division of GI Tract Surgical Oncology, Department of Translational Medical Sciences, University of Campania “Luigi Vanvitelli”, 80138 Naples, Italy; (E.L.); (F.C.); (G.D.S.); (A.A.)
| | - Duolao Wang
- Department of Clinical Sciences, School of Tropical Medicine Liverpool, Liverpool L7 8XZ, UK;
| | - Andrea Ronchi
- Division of Pathology, Department of Mental and Physical Health and Rehabilitation Medicine, University of Campania “L VanvItelli”, via Luciano Armanni, 80138 Naples, Italy; (A.R.); (I.P.); (F.F.)
| | - Giovanni Del Sorbo
- Division of GI Tract Surgical Oncology, Department of Translational Medical Sciences, University of Campania “Luigi Vanvitelli”, 80138 Naples, Italy; (E.L.); (F.C.); (G.D.S.); (A.A.)
| | - Iacopo Panarese
- Division of Pathology, Department of Mental and Physical Health and Rehabilitation Medicine, University of Campania “L VanvItelli”, via Luciano Armanni, 80138 Naples, Italy; (A.R.); (I.P.); (F.F.)
| | - Francesca Ferraraccio
- Division of Pathology, Department of Mental and Physical Health and Rehabilitation Medicine, University of Campania “L VanvItelli”, via Luciano Armanni, 80138 Naples, Italy; (A.R.); (I.P.); (F.F.)
| | - Ferdinando De Vita
- Division of Medical Oncology, Department of Precision Medicine, School of Medicine, University of Campania ‘Luigi Vanvitelli’, 80138 Naples, Italy;
| | - Gennaro Galizia
- Division of GI Tract Surgical Oncology, Department of Translational Medical Sciences, University of Campania “Luigi Vanvitelli”, 80138 Naples, Italy; (E.L.); (F.C.); (G.D.S.); (A.A.)
| | - Annamaria Auricchio
- Division of GI Tract Surgical Oncology, Department of Translational Medical Sciences, University of Campania “Luigi Vanvitelli”, 80138 Naples, Italy; (E.L.); (F.C.); (G.D.S.); (A.A.)
| |
Collapse
|
10
|
Freund Y, Viglino D, Cachanado M, Cassard C, Montassier E, Douay B, Guenezan J, Le Borgne P, Yordanov Y, Severin A, Roussel M, Daniel M, Marteau A, Peschanski N, Teissandier D, Macrez R, Morere J, Chouihed T, Roux D, Adnet F, Bloom B, Chauvin A, Simon T. Effect of Noninvasive Airway Management of Comatose Patients With Acute Poisoning: A Randomized Clinical Trial. JAMA 2023; 330:2267-2274. [PMID: 38019968 PMCID: PMC10687712 DOI: 10.1001/jama.2023.24391] [Citation(s) in RCA: 13] [Impact Index Per Article: 13.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/28/2023] [Accepted: 11/06/2023] [Indexed: 12/01/2023]
Abstract
Importance Tracheal intubation is recommended for coma patients and those with severe brain injury, but its use in patients with decreased levels of consciousness from acute poisoning is uncertain. Objective To determine the effect of intubation withholding vs routine practice on clinical outcomes of comatose patients with acute poisoning and a Glasgow Coma Scale score less than 9. Design, Setting, and Participants This was a multicenter, randomized trial conducted in 20 emergency departments and 1 intensive care unit (ICU) that included comatose patients with suspected acute poisoning and a Glasgow Coma Scale score less than 9 in France between May 16, 2021, and April 12, 2023, and followed up until May 12, 2023. Intervention Patients were randomized to undergo conservative airway strategy of intubation withholding vs routine practice. Main Outcomes and Measures The primary outcome was a hierarchical composite end point of in-hospital death, length of ICU stay, and length of hospital stay. Key secondary outcomes included adverse events resulting from intubation as well as pneumonia within 48 hours. Results Among the 225 included patients (mean age, 33 years; 38% female), 116 were in the intervention group and 109 in the control group, with respective proportions of intubations of 16% and 58%. No patients died during the in-hospital stay. There was a significant clinical benefit for the primary end point in the intervention group, with a win ratio of 1.85 (95% CI, 1.33 to 2.58). In the intervention group, there was a lower proportion with any adverse event (6% vs 14.7%; absolute risk difference, 8.6% [95% CI, -16.6% to -0.7%]) compared with the control group, and pneumonia occurred in 8 (6.9%) and 16 (14.7%) patients, respectively (absolute risk difference, -7.8% [95% CI, -15.9% to 0.3%]). Conclusions and Relevance Among comatose patients with suspected acute poisoning, a conservative strategy of withholding intubation was associated with a greater clinical benefit for the composite end point of in-hospital death, length of ICU stay, and length of hospital stay. Trial Registration ClinicalTrials.gov Identifier: NCT04653597.
Collapse
Affiliation(s)
- Yonathan Freund
- Sorbonne Université, IMProving Emergency Care FHU, Paris, France
- Emergency Department and Service Mobile d’Urgence et de Réanimation (SMUR), Hôpital Pitié-Salpêtrière, Assistance Publique–Hôpitaux de Paris (AP-HP), Paris, France
| | - Damien Viglino
- Emergency Department, Grenoble-Alpes University Hospital, and University Grenoble-Alpes, HP2 Laboratory INSERM U 1300, Grenoble, France
| | - Marine Cachanado
- Department of Clinical Pharmacology and Clinical Research Platform Paris-East, AP-HP, Sorbonne University, St Antoine Hospital, Paris, France
| | - Clémentine Cassard
- Emergency Department and Service Mobile d’Urgence et de Réanimation (SMUR), Hôpital Pitié-Salpêtrière, Assistance Publique–Hôpitaux de Paris (AP-HP), Paris, France
| | - Emmanuel Montassier
- Emergency Department and SMUR, Nantes Université, CHU Nantes, INSERM UMR 1064, Nantes, France
| | - Bénedicte Douay
- Emergency Department and SMUR, Hôpital Beaujon AP-HP, Clichy, France
| | - Jérémy Guenezan
- Emergency Department, University Hospital of Poitiers, Poitiers, France
| | - Pierrick Le Borgne
- Emergency Department, Hôpitaux Universitaires de Strasbourg, Strasbourg, France and INSERM UMR 1260, Regenerative NanoMedicine, Fédération de Médecine Translationnelle, University of Strasbourg, Strasbourg, France
| | - Youri Yordanov
- Sorbonne Université, IMProving Emergency Care FHU, Paris, France
- Emergency Department, Hôpital Saint Antoine AP-HP, INSERM, Institut Pierre Louis d’Epidémiologie et de Santé Publique, UMR-S 1136, Paris, France
| | - Armelle Severin
- SAMU 92–SMUR Raymond Poincaré, Raymond Poincaré Hospital, AP-HP, Paris, France
| | - Mélanie Roussel
- Emergency Department, Univ Rouen Normandie, CHU Rouen, Rouen, France
| | - Matthieu Daniel
- Emergency Department, SAMU-SMUR et Secours en Milieu Périlleux, CHU de La Réunion Site Nord Félix Guyon, La Réunion, France
| | - Adrien Marteau
- Emergency Department, Centre Hospitalier Universitaire Sud Réunion, Saint Pierre, La Réunion, France
| | - Nicolas Peschanski
- Emergency Department and SAMU35-SMUR, Hôpital Pontchaillou, Centre Hospitalier Universitaire de Rennes, Rennes, France
- Faculté de Médecine, Université de Rennes, Rennes, France
| | - Dorian Teissandier
- Emergency Department, CHU Clermont-Ferrand, Clermont-Ferrand, France
- Université Clermont Auvergne, INRAE, UNH, Clermont-Ferrand, France
| | - Richard Macrez
- Emergency Department, University hospital of Caen, UNICAEN, INSERM UMR-S U1237, Physiopathology and Imaging of Neurological Disorders, GIP Cyceron, Institut Blood and Brain Normandie University, Caen, France
| | - Julia Morere
- Emergency Department and SMUR, Hôpital Edouard Herriot, Lyon, France
| | - Tahar Chouihed
- Emergency Department, University Hospital of Nancy, INSERM, UMR_S 1116, University Hospital of Nancy, Nancy, France
| | - Damien Roux
- Université Paris Cité, AP-HP, Hôpital Louis Mourier, DMU ESPRIT, Service de Médecine Intensive Réanimation, Colombes, France
| | - Frédéric Adnet
- Emergency Department and Service Mobile d’Urgence et de Réanimation SMUR, Hôpital Avicenne, AP-HP, Bobigny, France
| | - Ben Bloom
- Emergency Department, Royal London Hospital, London, United Kingdom
| | - Anthony Chauvin
- Emergency Department, Hôpital Lariboisiere AP-HP, Paris, France and INSERM U942 MASCOT, University of Paris, Paris, France
| | - Tabassome Simon
- Sorbonne Université, IMProving Emergency Care FHU, Paris, France
- Department of Clinical Pharmacology and Clinical Research Platform Paris-East, AP-HP, Sorbonne University, St Antoine Hospital, Paris, France
| |
Collapse
|
11
|
Weatherald J, Moutchia J, Al-Naamani N, McClelland RL, Ventetuolo CE, Palevsky HI, Harhay MO, Kawut SM. Win Statistics in Pulmonary Arterial Hypertension Clinical Trials. Am J Respir Crit Care Med 2023; 208:1231-1234. [PMID: 37734029 PMCID: PMC10868347 DOI: 10.1164/rccm.202305-0800le] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/03/2023] [Accepted: 09/21/2023] [Indexed: 09/23/2023] Open
Affiliation(s)
- Jason Weatherald
- Division of Pulmonary Medicine, Department of Medicine, University of Alberta, Edmonton, Alberta, Canada
| | - Jude Moutchia
- Department of Biostatistics, Epidemiology, and Informatics and
| | - Nadine Al-Naamani
- Department of Medicine, Perelman School of Medicine, University of Pennsylvania, Philadelphia, Pennsylvania
| | | | - Corey E. Ventetuolo
- Department of Medicine and
- Department of Health Services, Policy and Practice, Brown University, Providence, Rhode Island
| | - Harold I. Palevsky
- Department of Medicine, Perelman School of Medicine, University of Pennsylvania, Philadelphia, Pennsylvania
| | - Michael O. Harhay
- Department of Biostatistics, Epidemiology, and Informatics and
- Department of Medicine, Perelman School of Medicine, University of Pennsylvania, Philadelphia, Pennsylvania
| | - Steven M. Kawut
- Department of Biostatistics, Epidemiology, and Informatics and
- Department of Medicine, Perelman School of Medicine, University of Pennsylvania, Philadelphia, Pennsylvania
| |
Collapse
|
12
|
Little DJ, Gasparyan SB, Schloemer P, Jongs N, Brinker M, Karpefors M, Tasto C, Rethemeier N, Frison L, Nkulikiyinka R, Rossert J, Heerspink HJ. Validity and Utility of a Hierarchical Composite End Point for Clinical Trials of Kidney Disease Progression: A Review. J Am Soc Nephrol 2023; 34:1928-1935. [PMID: 37807165 PMCID: PMC10703071 DOI: 10.1681/asn.0000000000000244] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/21/2023] [Accepted: 09/21/2023] [Indexed: 10/10/2023] Open
Abstract
Clinical trials in nephrology often use composite end points comprising clinical events, such as onset of ESKD and initiation of kidney function replacement therapy, along with a sustained large ( e.g. , ≥50%) decrease in GFR. Such events typically occur late in the disease course, resulting in large trials in which most participants do not contribute clinical events. In addition, components of the end point are considered of equal importance; however, their clinical significance varies. For example, kidney function replacement therapy initiation is likely to be clinically more meaningful than GFR decline of ≥50%. By contrast, hierarchical composite end points (HCEs) combine multiple outcomes and prioritize each patient's most clinically relevant outcome for inclusion in analysis. In this review, we consider the use of HCEs in clinical trials of CKD progression, emphasizing the potential to combine dichotomous clinical events such as those typically used in CKD progression trials, with the continuous variable of GFR over time, while ranking all components according to clinical significance. We consider maraca plots to visualize overall treatment effects and the contributions of individual components, discuss the application of win odds in kidney HCE trials, and review general design considerations for clinical trials for CKD progression with kidney HCE as an efficacy end point.
Collapse
Affiliation(s)
- Dustin J. Little
- Late Stage Development, Cardiovascular, Renal and Metabolism (CVRM), Biopharmaceuticals R&D, AstraZeneca, Gaithersburg, Maryland
| | - Samvel B. Gasparyan
- Late Stage Development, Cardiovascular, Renal and Metabolism (CVRM), BioPharmaceuticals R&D, AstraZeneca, Gothenburg, Sweden
| | - Patrick Schloemer
- Pharmaceuticals, Research and Development, Bayer AG, Berlin, Germany
| | - Niels Jongs
- Department of Clinical Pharmacy and Pharmacology, University Medical Center Groningen, University of Groningen, Groningen, The Netherlands
| | - Meike Brinker
- Pharmaceuticals, Research and Development, Bayer AG, Wuppertal, Germany
| | - Martin Karpefors
- Late Stage Development, Cardiovascular, Renal and Metabolism (CVRM), BioPharmaceuticals R&D, AstraZeneca, Gothenburg, Sweden
| | - Christoph Tasto
- Pharmaceuticals, Research and Development, Bayer AG, Wuppertal, Germany
| | - Nicole Rethemeier
- Pharmaceuticals, Research and Development, Bayer AG, Wuppertal, Germany
| | - Lars Frison
- Late Stage Development, Cardiovascular, Renal and Metabolism (CVRM), BioPharmaceuticals R&D, AstraZeneca, Gothenburg, Sweden
| | | | - Jerome Rossert
- Late Stage Development, Cardiovascular, Renal and Metabolism (CVRM), Biopharmaceuticals R&D, AstraZeneca, Gaithersburg, Maryland
| | - Hiddo J.L. Heerspink
- Department of Clinical Pharmacy and Pharmacology, University Medical Center Groningen, University of Groningen, Groningen, The Netherlands
- The George Institute for Global Health, Sydney, New South Wales, Australia
| |
Collapse
|
13
|
Seifu Y, Mt-Isa S, Duke K, Gamalo-Siebers M, Wang W, Dong G, Kolassa J. Design of paediatric trials with benefit-risk endpoints using a composite score of adverse events of interest (AEI) and win-statistics. J Biopharm Stat 2023; 33:696-707. [PMID: 36545791 DOI: 10.1080/10543406.2022.2153202] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/12/2022] [Accepted: 11/23/2022] [Indexed: 12/24/2022]
Abstract
A fundamental problem in the regulatory evaluation of a therapy is assessing whether the benefit outweighs the associated risks. This work proposes designing a trial that assesses a composite endpoint consisting of benefit and risk, hence, making the core of the design of the study, to assess benefit and risk. The proposed benefit risk measure consists of efficacy measure(s) and a risk measure that is based on a composite score obtained from pre-defined adverse events of interest (AEI). This composite score incorporates full aspects of adverse events of interest (i.e. the incidence, severity, and duration of the events). We call this newly proposed score the AEI composite score. After specifying the priorities between the components of the composite endpoint, a win-statistic (i.e. win ratio, win odds, or net benefit) is used to assess the difference between treatments in this composite endpoint. The power and sample size requirements of such a trial design are explored via simulation. Finally, using Dupixent published adult study results, we show how we can design a paediatric trial where the primary outcome is a composite of prioritized outcomes consisting of efficacy endpoints and the AEI composite score endpoint. The resulting trial design can potentially substantially reduce sample size compared to a trial designed to assess the co-primary efficacy endpoints, therefore it may address the challenge of slow enrollment and patient availability for paediatric studies.
Collapse
Affiliation(s)
- Yodit Seifu
- GBDS, Bristol-Myers Squibb, Berkeley Heights, New Jersey, USA
| | | | - Kyle Duke
- Department of Statistics, North Caroline State University, Raleigh, North Carolina
| | | | - William Wang
- BARDS, Merck & Co. Inc, Kenilworth, New Jersey, USA
| | | | - John Kolassa
- Department of Statistics, Rutgers, the State University of NJ, Piscataway, New Jersey, USA
| |
Collapse
|
14
|
Kondo T, Gasparyan SB, Jhund PS, Bengtsson O, Claggett BL, de Boer RA, Hernandez AF, Inzucchi SE, Kosiborod MN, Køber L, Lam CSP, Langkilde AM, Martinez FA, Petersson M, Ponikowski P, Sabatine MS, Shah SJ, Sjostrand M, Wilderang U, Vaduganathan M, Solomon SD, McMurray JJV. Use of Win Statistics to Analyze Outcomes in the DAPA-HF and DELIVER Trials. NEJM EVIDENCE 2023; 2:EVIDoa2300042. [PMID: 38320525 DOI: 10.1056/evidoa2300042] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/08/2024]
Abstract
BACKGROUND: The primary end point in most heart failure (HF) trials is a composite of time to a first worsening HF event or cardiovascular death. Prevention of recurrent events and improvements in symptoms/quality of life are also important for patients but are usually analyzed separately. Win statistics can integrate all these outcomes into a single composite end point, which is analyzed in hierarchical order, reflecting the clinical importance of each component. METHODS: The Dapagliflozin and Prevention of Adverse Outcomes in Heart Failure (DAPA-HF, n=4744) and Dapagliflozin Evaluation to Improve the Lives of Patients with Preserved Ejection Fraction Heart Failure (DELIVER, n=6263) trials enrolled patients with New York Heart Association class II, III, or IV HF, elevated natriuretic peptides, and either an ejection fraction of 40% or less (DAPA-HF) or greater than 40% and left atrial enlargement/left ventricular hypertrophy (DELIVER). We examined the effects of dapagliflozin compared with placebo on a hierarchical composite outcome, including cardiovascular death, total (first and recurrent) HF hospitalizations, total urgent HF visits, and improvement/deterioration in Kansas City Cardiomyopathy Questionnaire total symptom score (KCCQ-TSS; range from 0 to 100, with a higher score indicating fewer symptoms and physical limitations) at 8 months. RESULTS: For this composite outcome, the win ratio was 1.30 (95% confidence interval [CI], 1.23 to 1.36) in the pooled cohort, 1.33 (95% CI, 1.23 to 1.43) in the DAPA-HF trial, and 1.27 (95% CI, 1.18 to 1.36) in the DELIVER trial. Win odds and net benefit in overall patients were 1.19 (95% CI, 1.14 to 1.24) and 8.7% (95% CI, 6.6 to 10.9%), respectively. In the overall pooled cohort, the majority of wins and losses were accounted for by KCCQ-TSS; 52.4% were settled by the KCCQ-TSS tier in the pooled cohort. CONCLUSIONS: In both the DAPA-HF and DELIVER trials, dapagliflozin led to a significant improvement in composite outcomes that incorporated patient-reported outcomes along with total HF events, as well as cardiovascular deaths. These analyses provided a comprehensive presentation of win statistics and illustrated the utility and flexibility of win statistics in describing the effects of dapagliflozin in two recent clinical trials in patients with HF. (Funded by British Heart Foundation Centre of Research Excellence and others; clinical trial registration numbers, NCT03036124 and NCT03619213.)
Collapse
Affiliation(s)
- Toru Kondo
- British Heart Foundation Cardiovascular Research Centre, University of Glasgow, Glasgow, United Kingdom
- Department of Cardiology, Nagoya University Graduate School of Medicine, Nagoya, Japan
| | - Samvel B Gasparyan
- Late-Stage Development, Cardiovascular, Renal, and Metabolism, BioPharmaceuticals R&D, AstraZeneca, Gothenburg, Sweden
| | - Pardeep S Jhund
- British Heart Foundation Cardiovascular Research Centre, University of Glasgow, Glasgow, United Kingdom
| | - Olof Bengtsson
- Late-Stage Development, Cardiovascular, Renal, and Metabolism, BioPharmaceuticals R&D, AstraZeneca, Gothenburg, Sweden
| | - Brian L Claggett
- Cardiovascular Division, Brigham and Women's Hospital, Harvard Medical School, Boston
| | | | | | | | | | - Lars Køber
- Department of Cardiology, Copenhagen University Hospital-Rigshospitalet, Copenhagen
| | - Carolyn S P Lam
- National Heart Centre Singapore & Duke-National University of Singapore, Singapore
| | - Anna Maria Langkilde
- Late-Stage Development, Cardiovascular, Renal, and Metabolism, BioPharmaceuticals R&D, AstraZeneca, Gothenburg, Sweden
| | | | - Magnus Petersson
- Late-Stage Development, Cardiovascular, Renal, and Metabolism, BioPharmaceuticals R&D, AstraZeneca, Gothenburg, Sweden
| | - Piotr Ponikowski
- Department of Heart Disease, Wroclaw Medical University, Wroclaw, Poland
| | - Marc S Sabatine
- TIMI Study Group, Division of Cardiovascular Medicine, Brigham and Women's Hospital, Boston
| | - Sanjiv J Shah
- Northwestern University Feinberg School of Medicine, Chicago
| | - Mikaela Sjostrand
- Late-Stage Development, Cardiovascular, Renal, and Metabolism, BioPharmaceuticals R&D, AstraZeneca, Gothenburg, Sweden
| | - Ulrica Wilderang
- Late-Stage Development, Cardiovascular, Renal, and Metabolism, BioPharmaceuticals R&D, AstraZeneca, Gothenburg, Sweden
| | - Muthiah Vaduganathan
- Cardiovascular Division, Brigham and Women's Hospital, Harvard Medical School, Boston
| | - Scott D Solomon
- Cardiovascular Division, Brigham and Women's Hospital, Harvard Medical School, Boston
| | - John J V McMurray
- British Heart Foundation Cardiovascular Research Centre, University of Glasgow, Glasgow, United Kingdom
| |
Collapse
|
15
|
Verbeeck J, De Backer M, Verwerft J, Salvaggio S, Valgimigli M, Vranckx P, Buyse M, Brunner E. Generalized Pairwise Comparisons to Assess Treatment Effects: JACC Review Topic of the Week. J Am Coll Cardiol 2023; 82:1360-1372. [PMID: 37730293 DOI: 10.1016/j.jacc.2023.06.047] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/30/2023] [Revised: 06/28/2023] [Accepted: 06/29/2023] [Indexed: 09/22/2023]
Abstract
A time-to-first-event composite endpoint analysis has well-known shortcomings in evaluating a treatment effect in cardiovascular clinical trials. It does not fully describe the clinical benefit of therapy because the severity of the events, events repeated over time, and clinically relevant nonsurvival outcomes cannot be considered. The generalized pairwise comparisons (GPC) method adds flexibility in defining the primary endpoint by including any number and type of outcomes that best capture the clinical benefit of a therapy as compared with standard of care. Clinically important outcomes, including bleeding severity, number of interventions, and quality of life, can easily be integrated in a single analysis. The treatment effect in GPC can be expressed by the net treatment benefit, the success odds, or the win ratio. This review provides guidance on the use of GPC and the choice of treatment effect measures for the analysis and reporting of cardiovascular trials.
Collapse
Affiliation(s)
- Johan Verbeeck
- Data Science Institute, Interuniversity Institute for Biostatistics and statistical Bioinformatics (I-Biostat), University of Hasselt, Hasselt, Belgium.
| | | | - Jan Verwerft
- Department of Cardiology and Critical Care Medicine, Hasselt Heart Center, Jessa Hospital Hasselt, Hasselt, Belgium; Faculty of Medicine and Life Sciences, University of Hasselt, Hasselt, Belgium
| | - Samuel Salvaggio
- International Drug Development Institute, Louvain-la-Neuve, Belgium
| | - Marco Valgimigli
- Cardiocentro Institute, Ente Ospedaliero Cantonale, Università della Svizzera Italiana (University of Lugano), Lugano, Switzerland
| | - Pascal Vranckx
- Department of Cardiology and Critical Care Medicine, Hasselt Heart Center, Jessa Hospital Hasselt, Hasselt, Belgium; Faculty of Medicine and Life Sciences, University of Hasselt, Hasselt, Belgium
| | - Marc Buyse
- Data Science Institute, Interuniversity Institute for Biostatistics and statistical Bioinformatics (I-Biostat), University of Hasselt, Hasselt, Belgium; International Drug Development Institute, Louvain-la-Neuve, Belgium
| | - Edgar Brunner
- Department of Medical Statistics, University Medical Center Göttingen, Göttingen, Germany
| |
Collapse
|
16
|
Song J, Verbeeck J, Huang B, Hoaglin DC, Gamalo-Siebers M, Seifu Y, Wang D, Cooner F, Dong G. The win odds: statistical inference and regression. J Biopharm Stat 2023; 33:140-150. [PMID: 35946932 DOI: 10.1080/10543406.2022.2089156] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/15/2022]
Abstract
Generalized pairwise comparisons and win statistics (i.e., win ratio, win odds and net benefit) are advantageous in analyzing and interpreting a composite of multiple outcomes in clinical trials. An important limitation of these statistics is their inability to adjust for covariates other than by stratified analysis. Because the win ratio does not account for ties, the win odds, a modification that includes ties, has attracted attention. We review and combine information on the win odds to articulate the statistical inferences for the win odds. We also show alternative variance estimators based on the exact permutation and bootstrap as well as statistical inference via the probabilistic index. Finally, we extend multiple-covariate regression probabilistic index models to the win odds with a univariate outcome. As an illustration we apply the regression models to the data in the CHARM trial.
Collapse
Affiliation(s)
- James Song
- BeiGene, Ridgefield Park, New Jersey, USA
| | | | - Bo Huang
- Pfizer Inc, Groton, Connecticut, USA
| | - David C Hoaglin
- Department of Population and Quantitative Health Sciences, UMass Chan Medical School, Worcester, Massachusetts, USA
| | | | - Yodit Seifu
- Bristol Myers Squibb, Berkeley Heights, New Jersey, USA
| | - Duolao Wang
- Liverpool School of Tropical Medicine, Liverpool, UK
| | | | | |
Collapse
|
17
|
Johns H, Campbell B, Bernhardt J, Churilov L. Generalised pairwise comparisons for trend: An extension to the win ratio and win odds for dose-response and prognostic variable analysis with arbitrary statements of outcome preference. Stat Methods Med Res 2023; 32:609-625. [PMID: 36573043 DOI: 10.1177/09622802221146306] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/28/2022]
Abstract
The win ratio is a novel approach for handling complex patient outcomes that have seen considerable interest in the medical statistics literature, and operates by considering all-to-all pairwise statements of preference on outcomes. Recent extensions to the method have focused on the two-group case, with few developments made for considering the impact of a well-ordered explanatory variable, which would allow for dose-response analysis or the analysis of links between complex patient outcomes and prognostic variables. Where such methods have been developed, they are semiparametric methods that can only be applied to survival outcomes. In this article, we introduce the generalised pairwise comparison for trend, a modified form of Agresti's generalised odds ratio. This approach is capable of considering arbitrary statements of preference, thus enabling its use across all types of outcome data. We provide a simulation study validating the approach and illustrate it with three clinical applications in stroke research.
Collapse
Affiliation(s)
- Hannah Johns
- Melbourne Medical School, University of Melbourne, Melbourne, Australia
| | - Bruce Campbell
- Department of Medicine and Neurology, Melbourne Brain Centre and Royal Melbourne Hospital, University of Melbourne, Melbourne, Australia
| | - Julie Bernhardt
- Florey Institute of Neuroscience and Mental Health, University of Melbourne, Melbourne, Australia
| | - Leonid Churilov
- Melbourne Medical School, University of Melbourne, Melbourne, Australia
| |
Collapse
|
18
|
Dong G, Hoaglin DC, Huang B, Cui Y, Wang D, Cheng Y, Gamalo-Siebers M. The stratified win statistics (win ratio, win odds, and net benefit). Pharm Stat 2023. [PMID: 36808217 DOI: 10.1002/pst.2293] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/22/2022] [Revised: 01/13/2023] [Accepted: 01/31/2023] [Indexed: 02/22/2023]
Abstract
The win odds and the net benefit are related directly to each other and indirectly, through ties, to the win ratio. These three win statistics test the same null hypothesis of equal win probabilities between two groups. They provide similar p-values and powers, because the Z-values of their statistical tests are approximately equal. Thus, they can complement one another to show the strength of a treatment effect. In this article, we show that the estimated variances of the win statistics are also directly related regardless of ties or indirectly related through ties. Since its introduction in 2018, the stratified win ratio has been applied in designs and analyses of clinical trials, including Phase III and Phase IV studies. This article generalizes the stratified method to the win odds and the net benefit. As a result, the relations of the three win statistics and the approximate equivalence of their statistical tests also hold for the stratified win statistics.
Collapse
Affiliation(s)
| | - David C Hoaglin
- Department of Population and Quantitative Health Sciences, UMass Chan Medical School, Worcester, Massachusetts, USA
| | - Bo Huang
- Pfizer Inc., Groton, Connecticut, USA
| | - Ying Cui
- Department of Biostatistics and Bioinformatics, Emory University, Atlanta, Georgia, USA
| | - Duolao Wang
- Liverpool School of Tropical Medicine, Liverpool, UK
| | - Yu Cheng
- Department of Statistics, University of Pittsburgh, Pittsburgh, Pennsylvania, USA
| | | |
Collapse
|
19
|
Wang B, Zhou D, Zhang J, Kim Y, Chen LW, Dunnmon P, Bai S, Liu Q, Ishida E. Statistical power considerations in the use of win ratio in cardiovascular outcome trials. Contemp Clin Trials 2023; 124:107040. [PMID: 36470557 DOI: 10.1016/j.cct.2022.107040] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/01/2022] [Revised: 11/18/2022] [Accepted: 12/01/2022] [Indexed: 12/11/2022]
Abstract
BACKGROUND In cardiovascular outcome trials, the win ratio (WR) method models the composite endpoint under a hierarchical structure to account for clinical priorities. It also can be applied to both survival and nonsurvival outcomes. METHODS In this article, we assess the performance of the WR method via extensive simulation studies and real data analyses and discuss power considerations of the method with respect to hierarchical order, variable type, magnitude of treatment effect, and event rates when applied to clinical studies. RESULTS AND CONCLUSION In the hierarchy of the WR method, the first-ordered component (e.g., death) plays a dominant role in statistical power, especially when that component has a large treatment effect and a high event rate. This is in contrast with the score test of the Cox proportional hazards model in which the power is more likely affected by the nonfatal events that are usually observed earlier. Furthermore, when adding an additional component to the composite endpoint, the performance of the WR method varies depending on the treatment effect, event rate, and hierarchical position of the component. If the additional component has a relatively smaller or no treatment effect, the statistical power will decrease; if the additional component has a relatively larger treatment effect and higher event rate, the statistical power will increase. When adding a nonsurvival continuous outcome (e.g., 6-min walk distance) with even a tiny treatment effect, the statistical power could dramatically increase.
Collapse
Affiliation(s)
- Bang Wang
- Department of Statistics, University of Pittsburgh, Pittsburgh, PA, USA
| | - Dali Zhou
- Office of Biostatistics, Center for Drug Evaluation and Research, FDA, Silver Spring, MD, USA.
| | - Jialu Zhang
- Office of Biostatistics, Center for Drug Evaluation and Research, FDA, Silver Spring, MD, USA
| | - Yoonhee Kim
- Office of Biostatistics, Center for Drug Evaluation and Research, FDA, Silver Spring, MD, USA
| | - Ling-Wan Chen
- Office of Biostatistics, Center for Drug Evaluation and Research, FDA, Silver Spring, MD, USA
| | - Preston Dunnmon
- Data Sciences, Janssen Research and Development, Titusville, NJ, USA
| | - Steven Bai
- Office of Biostatistics, Center for Drug Evaluation and Research, FDA, Silver Spring, MD, USA
| | - Ququan Liu
- Office of Biostatistics, Center for Drug Evaluation and Research, FDA, Silver Spring, MD, USA
| | - Eiji Ishida
- Sunovion Pharmaceuticals, Marlborough, MA, USA
| |
Collapse
|
20
|
Cui Y, Dong G, Kuan PF, Huang B. Evidence synthesis analysis with prioritized benefit outcomes in oncology clinical trials. J Biopharm Stat 2022; 33:272-288. [PMID: 36343174 DOI: 10.1080/10543406.2022.2141769] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
Overall survival, progression-free survival, objective response/complete response, and duration of (complete) response are frequently used as the primary and secondary efficacy endpoints for designs and analyses of oncology clinical trials. However, these endpoints are typically analyzed separately. In this article, we introduce an evidence synthesis approach to prioritize the benefit outcomes by applying the generalized pairwise comparisons (GPC) method, and use win statistics (win ratio, win odds and net benefit) to quantify treatment benefit. Under the framework of GPC, the main advantage of this evidence synthesis approach is the ability to combine relevant outcomes of various types into a single summary statistic without relying on any parametric assumptions. It is particularly relevant since health authorities and the pharmaceutical industry are increasingly incorporating structured quantitative methodologies in their benefit-risk assessment. We apply this evidence synthesis approach to an oncology phase 3 study in first-line renal cell carcinoma to assess the overall effect of an investigational treatment by ranking the most clinically relevant endpoints in cancer drug development. This application and a simulation study demonstrate that the proposed approach can synthesize the evidence of treatment effect from multiple prioritized benefit outcomes, and has substantial advantage over conventional methods that analyze each individual endpoint separately. We also introduce a newly developed R package WINS for statistical inference based on win statistics.
Collapse
Affiliation(s)
- Ying Cui
- Department of Biostatistics and Bioinformatics, Emory University, Atlanta, GA, USA
| | | | - Pei Fen Kuan
- Department of Applied Mathematics and Statistics, Stony Brook University, Stony Brook, NY, USA
| | | |
Collapse
|