1
|
León LF, Jemielita T, Guo Z, Marceau West R, Anderson KM. Exploratory subgroup identification in the heterogeneous Cox model: A relatively simple procedure. Stat Med 2024; 43:3921-3942. [PMID: 38951867 DOI: 10.1002/sim.10163] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/30/2023] [Revised: 05/17/2024] [Accepted: 06/16/2024] [Indexed: 07/03/2024]
Abstract
For survival analysis applications we propose a novel procedure for identifying subgroups with large treatment effects, with focus on subgroups where treatment is potentially detrimental. The approach, termed forest search, is relatively simple and flexible. All-possible subgroups are screened and selected based on hazard ratio thresholds indicative of harm with assessment according to the standard Cox model. By reversing the role of treatment one can seek to identify substantial benefit. We apply a splitting consistency criteria to identify a subgroup considered "maximally consistent with harm." The type-1 error and power for subgroup identification can be quickly approximated by numerical integration. To aid inference we describe a bootstrap bias-corrected Cox model estimator with variance estimated by a Jacknife approximation. We provide a detailed evaluation of operating characteristics in simulations and compare to virtual twins and generalized random forests where we find the proposal to have favorable performance. In particular, in our simulation setting, we find the proposed approach favorably controls the type-1 error for falsely identifying heterogeneity with higher power and classification accuracy for substantial heterogeneous effects. Two real data applications are provided for publicly available datasets from a clinical trial in oncology, and HIV.
Collapse
Affiliation(s)
- Larry F León
- Biostatistics and Research Decision Sciences, Merck & Co., Inc., New Jersey
| | - Thomas Jemielita
- Biostatistics and Research Decision Sciences, Merck & Co., Inc., New Jersey
| | - Zifang Guo
- Biostatistics, BioNTech SE, Rahway, New York
| | | | - Keaven M Anderson
- Biostatistics and Research Decision Sciences, Merck & Co., Inc., New Jersey
| |
Collapse
|
2
|
Admon AJ, Cohen-Mekelburg S, Opatrny M, Lee KT, Law AC, Gershengorn HB, Valley TS, Prescott HC, Wiktor MJ, Neeluru J, Cooke CR, Weissman GE. Two Weeks Versus One Week of Maximal Patient-Intensivist Continuity for Adult Medical Intensive Care Patients: A Two-Center Target Trial Emulation. Crit Care Med 2024; 52:1323-1332. [PMID: 38713002 PMCID: PMC11326999 DOI: 10.1097/ccm.0000000000006322] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/08/2024]
Abstract
OBJECTIVES To compare outcomes for 2 weeks vs. 1 week of maximal patient-intensivist continuity in the ICU. DESIGN Retrospective cohort study. SETTING Two U.S. urban, teaching, medical ICUs where intensivists were scheduled for 2-week service blocks: site A was in the Midwest and site B was in the Northeast. PATIENTS Patients 18 years old or older admitted to a study ICU between March 1, 2017, and February 28, 2020. INTERVENTIONS None. MEASUREMENTS AND MAIN RESULTS We applied target trial emulation to compare admission during an intensivist's first week (as a proxy for 2 wk of maximal continuity) vs. admission during their second week (as a proxy for 1 wk of maximal continuity). Outcomes included hospital mortality, ICU length of stay, and, for mechanically ventilated patients, duration of ventilation. Exploratory outcomes included imaging, echocardiogram, and consultation orders. We used inverse probability weighting to adjust for baseline differences and random-effects meta-analysis to calculate overall effect estimates. Among 2571 patients, 1254 were admitted during an intensivist's first week and 1317 were admitted during a second week. At sites A and B, hospital mortality rates were 25.8% and 24.2%, median ICU length of stay were 4 and 2 days, and median mechanical ventilation durations were 3 and 3 days, respectively. There were no differences in adjusted mortality (odds ratio [OR], 1.01 [95% CI, 0.96-1.06]) or ICU length of stay (-0.25 d [-0.82 d to +0.32 d]) for 2 weeks vs. 1 week of maximal continuity. Among mechanically ventilated patients, there were no differences in adjusted mortality (OR, 1.00 [0.87-1.16]), ICU length of stay (+0.06 d [-0.78 d to +0.91 d]), or duration of mechanical ventilation (+0.37 d [-0.46 d to +1.21 d]) for 2 weeks vs. 1 week of maximal continuity. CONCLUSIONS Two weeks of maximal patient-intensivist continuity was not associated with differences in clinical outcomes compared with 1 week in two medical ICUs.
Collapse
Affiliation(s)
- Andrew J Admon
- Division of Pulmonary and Critical Care Medicine, Department of Internal Medicine, University of Michigan Medical School, Ann Arbor, MI
- Department of Epidemiology, University of Michigan School of Public Health, University of Michigan, Ann Arbor, MI
- VA Center for Clinical Management Research, VA Ann Arbor Healthcare System, Ann Arbor, MI
- Pulmonary Service, Medicine Service, LTC Charles S. Kettles VA Medical Center, Ann Arbor, MI
| | - Shirley Cohen-Mekelburg
- VA Center for Clinical Management Research, VA Ann Arbor Healthcare System, Ann Arbor, MI
- Division of Gastroenterology, Department of Internal Medicine, University of Michigan Medical School, Ann Arbor, MI
- Gastroenterology Service, Medicine Service, LTC Charles S. Kettles VA Medical Center, Ann Arbor, MI
| | - Megan Opatrny
- Department of Internal Medicine, University of Michigan Medical School, Ann Arbor, MI
| | - Kathleen T Lee
- Division of Pulmonary and Critical Care Medicine, Department of Internal Medicine, University of Michigan Medical School, Ann Arbor, MI
| | - Anica C Law
- Pulmonary Center, Department of Medicine, Boston University School of Medicine, Boston, MA
- Richard A and Susan F Smith Center for Outcomes Research in Cardiology, Beth Israel Deaconess Medical Center, Boston, MA
| | - Hayley B Gershengorn
- Division of Pulmonary, Critical Care, and Sleep Medicine, Department of Medicine, University of Miami Miller School of Medicine, Miami, FL
- Division of Critical Care Medicine, Department of Medicine, Albert Einstein College of Medicine, Bronx, NY
| | - Thomas S Valley
- Division of Pulmonary and Critical Care Medicine, Department of Internal Medicine, University of Michigan Medical School, Ann Arbor, MI
- VA Center for Clinical Management Research, VA Ann Arbor Healthcare System, Ann Arbor, MI
- Pulmonary Service, Medicine Service, LTC Charles S. Kettles VA Medical Center, Ann Arbor, MI
| | - Hallie C Prescott
- Division of Pulmonary and Critical Care Medicine, Department of Internal Medicine, University of Michigan Medical School, Ann Arbor, MI
- VA Center for Clinical Management Research, VA Ann Arbor Healthcare System, Ann Arbor, MI
- Pulmonary Service, Medicine Service, LTC Charles S. Kettles VA Medical Center, Ann Arbor, MI
| | - Michael J Wiktor
- Quality Analytics Division, Quality Department, Michigan Medicine, Ann Arbor, MI
| | - Jayashree Neeluru
- Quality Analytics Division, Quality Department, Michigan Medicine, Ann Arbor, MI
| | - Colin R Cooke
- Division of Pulmonary and Critical Care Medicine, Department of Internal Medicine, University of Michigan Medical School, Ann Arbor, MI
- Pulmonary Service, Medicine Service, LTC Charles S. Kettles VA Medical Center, Ann Arbor, MI
| | - Gary E Weissman
- Pulmonary, Allergy, and Critical Care Division, Department of Medicine, University of Pennsylvania Perelman School of Medicine, Philadelphia, PA
- Palliative and Advanced Illness Research (PAIR) Center, University of Pennsylvania Perelman School of Medicine, Philadelphia, PA
- Leonard Davis Institute of Health Economics, University of Pennsylvania, Philadelphia, PA
- Department of Biostatistics, Epidemiology and Informatics, University of Pennsylvania Perelman School of Medicine, Philadelphia, PA
| |
Collapse
|
3
|
Ko D, Evans PT, Lin KJ, Pande AN, Cervone A, Lee SB, Cheng S, Tsacogianis T, Glynn RJ, Kim DH. Frailty and Clinical Outcomes of Ticagrelor Versus Clopidogrel in Older Adults With Acute Myocardial Infarction. J Am Heart Assoc 2024; 13:e034529. [PMID: 39056329 DOI: 10.1161/jaha.124.034529] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/19/2024] [Accepted: 07/02/2024] [Indexed: 07/28/2024]
Abstract
BACKGROUND Ticagrelor is recommended over clopidogrel in acute coronary syndrome based on the results of the PLATO (Study of Platelet Inhibition and Patient Outcomes) trial. We aimed to emulate PLATO in older adults with and without frailty and with acute coronary syndrome treated with percutaneous coronary intervention. METHODS AND RESULTS We created a new-user cohort of Medicare fee-for-service beneficiaries aged ≥65 years hospitalized for acute coronary syndrome from 2014 to 2018 and initiated ticagrelor or clopidogrel following percutaneous coronary intervention. Frailty was defined using a validated claims-based frailty index ≥0.25. Coprimary outcomes were major adverse cardiovascular events and major bleeding. Follow-up began on the date of first outpatient prescription for ticagrelor or clopidogrel and ended on the earliest date for an outcome event, death, discontinuation of the index drug, or disenrollment from Medicare. The study included 42 843 older adults; 23% were frail. After propensity score matching, the rates of major adverse cardiovascular events per 100 person-years comparing ticagrelor versus clopidogrel groups were 7.8 and 7.3 in the frail cohort (hazard ratio [HR], 1.07 [95% CI, 0.84-1.36]) and 3.7 and 4.2 in the nonfrail cohort (HR, 0.87 [95% CI, 0.75-1.02]). The corresponding rates of major bleeding were 4.3 and 3.8 in the frail cohort (HR, 1.12 95% CI, [0.80-1.56]) and 2.2 and 1.8 in the nonfrail cohort (HR, 1.22 [95% CI, 0.98-1.51]). CONCLUSIONS There was a trend toward a modest reduction in risk of major adverse cardiovascular events and a trend toward a modest increase in risk of major bleeding with ticagrelor compared with clopidogrel in the nonfrail cohort. There was insufficient evidence for the benefit of ticagrelor in frail older adults.
Collapse
Affiliation(s)
- Darae Ko
- Hinda and Arthur Marcus Institute for Aging Research Hebrew SeniorLife Boston MA
- Section of Cardiovascular Medicine Boston Medical Center Boston MA
| | - Peter T Evans
- Section of Cardiovascular Medicine Boston Medical Center Boston MA
| | - Kueiyu Joshua Lin
- Division of Pharmacoepidemiology and Pharmacoeconomics, Department of Medicine Brigham and Women's Hospital Boston MA
- Division of General Internal Medicine, Department of Medicine Massachusetts General Hospital Boston MA
| | - Ashvin N Pande
- Section of Cardiovascular Medicine Boston Medical Center Boston MA
| | - Alexander Cervone
- Division of Pharmacoepidemiology and Pharmacoeconomics, Department of Medicine Brigham and Women's Hospital Boston MA
| | - Su Been Lee
- Division of Pharmacoepidemiology and Pharmacoeconomics, Department of Medicine Brigham and Women's Hospital Boston MA
| | - Susan Cheng
- Department of Cardiology Cedars-Sinai Medical Center Los Angeles CA
| | - Theodore Tsacogianis
- Division of Pharmacoepidemiology and Pharmacoeconomics, Department of Medicine Brigham and Women's Hospital Boston MA
| | - Robert J Glynn
- Division of Pharmacoepidemiology and Pharmacoeconomics, Department of Medicine Brigham and Women's Hospital Boston MA
| | - Dae Hyun Kim
- Hinda and Arthur Marcus Institute for Aging Research Hebrew SeniorLife Boston MA
- Division of Pharmacoepidemiology and Pharmacoeconomics, Department of Medicine Brigham and Women's Hospital Boston MA
- Division of Gerontology, Department of Medicine Beth Israel Deaconess Medical Center Boston MA
| |
Collapse
|
4
|
Abbasi AB, Curtis LH, Fleisher LA, Califf RM. Why Evidence Generation Should Matter to Payers and How They Can Help. JAMA 2024; 332:412-417. [PMID: 38949829 DOI: 10.1001/jama.2024.7616] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 07/02/2024]
Abstract
Importance The US leads the world in bringing new medical products to market, but the ability to generate evidence to inform clinical practice in postmarket settings needs improvement. Although a diverse group of stakeholders is working to improve postmarket evidence generation, the role of private payers has been underappreciated. Observations Payers are crucial allies in improving evidence generation because better data would better inform coverage decisions, their policies and practices influence the conduct of care and research, and their claims data are a source of real-world evidence used in medical product evaluation. In addition, payers have a stake in improving evidence generation because the kinds of evidence needed to inform health care and coverage decisions are often not available when a product enters the market and may not be generated without their involvement. Here, we describe several key steps payers could take to improve evidence generation, including participating in efforts to reduce administrative and financial barriers to the conduct of clinical trials, directly incentivizing evidence generation on high-priority questions by funding potential cost-saving trials, increasing engagement with the medical products industry on evidentiary needs for coverage decisions, and improving usability of claims data by reducing data lags and routinely recording unique device identifiers. Broad payer engagement with US Food and Drug Administration recommendations regarding evidence generation will ensure that the opportunities to participate in clinical research are extended to all communities and that evidence needed to inform care is generated in trials and surveillance systems that reflect the clinical reality across the US. Conclusions and Relevance Increasing payer involvement in evidence generation can benefit all participants in the medical innovation ecosystem. The importance of payers in these efforts will continue to grow in response to imperatives to increase integration of care and research, engage a diverse set of communities in clinical research, and move toward alternative payment models.
Collapse
Affiliation(s)
- Ali B Abbasi
- US Food and Drug Administration, Silver Spring, Maryland
| | | | | | | |
Collapse
|
5
|
Rippin G, Sanz H, Hoogendoorn WE, Ballarini NM, Largent JA, Demas E, Postmus D, Framke T, Dávila LMA, Quinten C, Pignatti F. Examining the Effect of Missing Data and Unmeasured Confounding on External Comparator Studies: Case Studies and Simulations. Drug Saf 2024:10.1007/s40264-024-01467-9. [PMID: 39102176 DOI: 10.1007/s40264-024-01467-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 07/04/2024] [Indexed: 08/06/2024]
Abstract
BACKGROUND AND OBJECTIVE Missing data and unmeasured confounding are key challenges for external comparator studies. This work evaluates bias and other performance characteristics depending on missingness and unmeasured confounding by means of two case studies and simulations. METHODS Two case studies were constructed by taking the treatment arms from two randomised controlled trials and an external real-world data source that exhibited substantial missingness. The indications of the randomised controlled trials were multiple myeloma and metastatic hormone-sensitive prostate cancer. Overall survival was taken as the main endpoint. The effects of missing data and unmeasured confounding were assessed for the case studies by reporting estimated external comparator versus randomised controlled trial treatment effects. Based on the two case studies, simulations were performed broadening the settings by varying the underlying hazard ratio, the sample size, the sample size ratio between the experimental arm and the external comparator, the number of missing covariates and the percentage of missingness. Thereby, bias and other performance metrics could be quantified dependent on these factors. RESULTS For the multiple myeloma external comparator study, results were in line with the randomised controlled trial, despite missingness and potential unmeasured confounding, while for the metastatic hormone-sensitive prostate cancer case study missing data led to a low sample size, leading overall to inconclusive results. Furthermore, for the metastatic hormone-sensitive prostate cancer study, missing data in important eligibility criteria led to further limitations. Simulations were successfully applied to gain a quantitative understanding of the effects of missing data and unmeasured confounding. CONCLUSIONS This exploratory study confirmed external comparator strengths and limitations by quantifying the impact of missing data and unmeasured confounding using case studies and simulations. In particular, missing data in key eligibility criteria were seen to limit the ability to derive the external comparator target analysis population accurately, while simulations demonstrated the magnitude of bias to expect for various settings.
Collapse
Affiliation(s)
- Gerd Rippin
- IQVIA, Unterschweinstiege 2-14, 60549, Frankfurt, Germany.
| | - Héctor Sanz
- IQVIA, Unterschweinstiege 2-14, 60549, Frankfurt, Germany
| | | | | | - Joan A Largent
- IQVIA, Unterschweinstiege 2-14, 60549, Frankfurt, Germany
| | - Eleni Demas
- IQVIA, Unterschweinstiege 2-14, 60549, Frankfurt, Germany
| | - Douwe Postmus
- European Medicines Agency, Domenico Scarlattilaan 6, Amsterdam, 1083 HS, The Netherlands
| | - Theodor Framke
- European Medicines Agency, Domenico Scarlattilaan 6, Amsterdam, 1083 HS, The Netherlands
- Institute for Biostatistics, Hannover Medical School, Carl-Neuberg-Str. 1, 30625, Hannover, Germany
| | | | - Chantal Quinten
- European Medicines Agency, Domenico Scarlattilaan 6, Amsterdam, 1083 HS, The Netherlands
| | - Francesco Pignatti
- European Medicines Agency, Domenico Scarlattilaan 6, Amsterdam, 1083 HS, The Netherlands
| |
Collapse
|
6
|
Castanon A, Tsvetanova A, Ramagopalan SV. RWE ready for reimbursement? A round up of developments in real-world evidence relating to health technology assessment: part 16. J Comp Eff Res 2024; 13:e240095. [PMID: 38967245 DOI: 10.57264/cer-2024-0095] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 07/06/2024] Open
Abstract
In this update, we discuss recent US FDA guidance offering more specific guidelines on appropriate study design and analysis to support causal inference for non-interventional studies and the launch of the European Medicines Agency (EMA) and the Heads of Medicines Agencies (HMA) public electronic catalogues. We also highlight an article recommending assessing data quality and suitability prior to protocol finalization and a Journal of the American Medical Association-endorsed framework for using causal language when publishing real-world evidence studies. Finally, we explore the potential of large language models to automate the development of health economic models.
Collapse
Affiliation(s)
| | | | - Sreeram V Ramagopalan
- Lane Clark & Peacock LLP, London, W1U 1DQ, UK
- Centre for Pharmaceutical Medicine Research, King's College London, London, SE1 9NH, UK
| |
Collapse
|
7
|
Simon TG, Singer DE, Zhang Y, Mastrorilli JM, Cervone A, DiCesare E, Lin KJ. Comparative Effectiveness and Safety of Apixaban, Rivaroxaban, and Warfarin in Patients With Cirrhosis and Atrial Fibrillation : A Nationwide Cohort Study. Ann Intern Med 2024; 177:1028-1038. [PMID: 38976880 DOI: 10.7326/m23-3067] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 07/10/2024] Open
Abstract
BACKGROUND Apixaban, rivaroxaban, and warfarin have shown benefit for preventing major ischemic events, albeit with increased bleeding risk, among patients in the general population with atrial fibrillation (AF). However, data are scarce in patients with cirrhosis and AF. OBJECTIVE To compare the effectiveness and safety of apixaban versus rivaroxaban and versus warfarin in patients with cirrhosis and AF. DESIGN Population-based cohort study. SETTING Two U.S. claims data sets (Medicare and Optum's de-identified Clinformatics Data Mart Database [2013 to 2022]). PARTICIPANTS 1:1 propensity score (PS)-matched patients with cirrhosis and nonvalvular AF initiating use of apixaban, rivaroxaban, or warfarin. MEASUREMENTS Primary outcomes included ischemic stroke or systemic embolism and major hemorrhage (intracranial hemorrhage or major gastrointestinal bleeding). Database-specific and pooled PS-matched rate differences (RDs) per 1000 person-years (PY) and Cox proportional hazard ratios (HRs) with 95% CIs were estimated, controlling for 104 preexposure covariates. RESULTS Rivaroxaban initiators had significantly higher rates of major hemorrhagic events than apixaban initiators (RD, 33.1 per 1000 PY [95% CI, 12.9 to 53.2 per 1000 PY]; HR, 1.47 [CI, 1.11 to 1.94]) but no significant differences in rates of ischemic events or death. Consistently higher rates of major hemorrhage were found with rivaroxaban across subgroup and sensitivity analyses. Warfarin initiators also had significantly higher rates of major hemorrhage than apixaban initiators (RD, 26.1 per 1000 PY [CI, 6.8 to 45.3 per 1000 PY]; HR, 1.38 [CI, 1.03 to 1.84]), particularly hemorrhagic stroke (RD, 9.7 per 1000 PY [CI, 2.2 to 17.2 per 1000 PY]; HR, 2.85 [CI, 1.24 to 6.59]). LIMITATION Nonrandomized treatment selection. CONCLUSION Among patients with cirrhosis and nonvalvular AF, initiators of rivaroxaban versus apixaban had significantly higher rates of major hemorrhage and similar rates of ischemic events and death. Initiation of warfarin versus apixaban also contributed to significantly higher rates of major hemorrhagic events, including hemorrhagic stroke. PRIMARY FUNDING SOURCE National Institutes of Health.
Collapse
Affiliation(s)
- Tracey G Simon
- Division of Pharmacoepidemiology and Pharmacoeconomics, Department of Medicine, Brigham and Women's Hospital, Harvard Medical School; Division of Gastroenterology and Hepatology, Department of Medicine, Massachusetts General Hospital, Harvard Medical School; and Clinical and Translational Epidemiology Unit (CTEU), Massachusetts General Hospital, Boston, Massachusetts (T.G.S.)
| | - Daniel E Singer
- Division of General Internal Medicine, Department of Medicine, Massachusetts General Hospital, Harvard Medical School, Boston, Massachusetts (D.E.S.)
| | - Yichi Zhang
- Division of Pharmacoepidemiology and Pharmacoeconomics, Department of Medicine, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts (Y.Z., J.M.M., A.C., E.D.)
| | - Julianna M Mastrorilli
- Division of Pharmacoepidemiology and Pharmacoeconomics, Department of Medicine, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts (Y.Z., J.M.M., A.C., E.D.)
| | - Alexander Cervone
- Division of Pharmacoepidemiology and Pharmacoeconomics, Department of Medicine, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts (Y.Z., J.M.M., A.C., E.D.)
| | - Elyse DiCesare
- Division of Pharmacoepidemiology and Pharmacoeconomics, Department of Medicine, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts (Y.Z., J.M.M., A.C., E.D.)
| | - Kueiyu Joshua Lin
- Division of Pharmacoepidemiology and Pharmacoeconomics, Department of Medicine, Brigham and Women's Hospital, Harvard Medical School, and Department of Medicine, Massachusetts General Hospital, Harvard Medical School, Boston, Massachusetts (K.J.L.)
| |
Collapse
|
8
|
Thiruvengadam NR, Saumoy M, Schaubel DE, Cotton PB, Elmunzer BJ, Freeman ML, Varadarajulu S, Kochman ML, Coté GA. Rise in First-Time ERCP for Benign Indications >1 Year After Cholecystectomy Is Associated With Worse Outcomes. Clin Gastroenterol Hepatol 2024; 22:1618-1627.e4. [PMID: 38599308 DOI: 10.1016/j.cgh.2024.03.027] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/18/2024] [Revised: 03/20/2024] [Accepted: 03/21/2024] [Indexed: 04/12/2024]
Abstract
BACKGROUND & AIMS Greater availability of less invasive biliary imaging to rule out choledocholithiasis should reduce the need for diagnostic endoscopic retrograde cholangiopancreatography (ERCP) in patients who have a remote history of cholecystectomy. The primary aims were to determine the incidence, characteristics, and outcomes of individuals who undergo first-time ERCP >1 year after cholecystectomy (late-ERCP). METHODS Data from a commercial insurance claim database (Optum Clinformatics) identified 583,712 adults who underwent cholecystectomy, 4274 of whom underwent late-ERCP, defined as first-time ERCP for nonmalignant indications >1 year after cholecystectomy. Outcomes were exposure and temporal trends in late-ERCP, biliary imaging utilization, and post-ERCP outcomes. Multivariable logistic regression was used to examine patient characteristics associated with undergoing late-ERCP. RESULTS Despite a temporal increase in the use of noninvasive biliary imaging (35.9% in 2004 to 65.6% in 2021; P < .001), the rate of late-ERCP increased 8-fold (0.5-4.2/1000 person-years from 2005 to 2021; P < .001). Although only 44% of patients who underwent late-ERCP had gallstone removal, there were high rates of post-ERCP pancreatitis (7.1%), hospitalization (13.1%), and new chronic opioid use (9.7%). Factors associated with late-ERCP included concomitant disorder of gut-brain interaction (odds ratio [OR], 6.48; 95% confidence interval [CI], 5.88-6.91) and metabolic dysfunction steatotic liver disease (OR, 3.27; 95% CI, 2.79-3.55) along with use of anxiolytic (OR, 3.45; 95% CI, 3.19-3.58), antispasmodic (OR, 1.60; 95% CI, 1.53-1.72), and chronic opioids (OR, 6.24; 95% CI, 5.79-6.52). CONCLUSIONS The rate of late-ERCP postcholecystectomy is increasing significantly, particularly in patients with comorbidities associated with disorder of gut-brain interaction and mimickers of choledocholithiasis. Late-ERCPs are associated with disproportionately higher rates of adverse events, including initiation of chronic opioid use.
Collapse
Affiliation(s)
- Nikhil R Thiruvengadam
- Division of Gastroenterology and Hepatology, Loma Linda University Health, Loma Linda, California; Center for Endoscopic Innovation, Research, and Training, Department of Medicine, Hospital of the University of Pennsylvania, Philadelphia, Pennsylvania.
| | - Monica Saumoy
- Center for Digestive Health, Penn Medicine Princeton Medical Center, Plainsboro, New Jersey
| | - Douglas E Schaubel
- Department of Biostatistics, Epidemiology, and Informatics, University of Pennsylvania, Philadelphia, Pennsylvania
| | - Peter B Cotton
- Division of Gastroenterology and Hepatology, Medical University of South Carolina, Charleston, South Carolina
| | - B Joseph Elmunzer
- Division of Gastroenterology and Hepatology, Medical University of South Carolina, Charleston, South Carolina
| | - Martin L Freeman
- Division of Gastroenterology and Hepatology, University of Minnesota School of Medicine, Minneapolis, Minnesota
| | | | - Michael L Kochman
- Center for Endoscopic Innovation, Research, and Training, Department of Medicine, Hospital of the University of Pennsylvania, Philadelphia, Pennsylvania; Division of Gastroenterology and Hepatology, Perelman School of Medicine, Philadelphia, Pennsylvania
| | - Gregory A Coté
- Division of Gastroenterology and Hepatology, Oregon Health & Science University, Portland, Oregon
| |
Collapse
|
9
|
Magagnoli J, Sutton SS, Ambati J. Facilitating Drug Repurposing-Using Databases for Drug Discovery in AMD. JAMA Ophthalmol 2024; 142:759-760. [PMID: 38990521 DOI: 10.1001/jamaophthalmol.2024.2516] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 07/12/2024]
Affiliation(s)
- Joseph Magagnoli
- Dorn Research Institute, Columbia VA Health Care System, Columbia, South Carolina
- Department of Clinical Pharmacy and Outcomes Sciences, College of Pharmacy, University of South Carolina, Columbia
| | - S Scott Sutton
- Dorn Research Institute, Columbia VA Health Care System, Columbia, South Carolina
- Department of Clinical Pharmacy and Outcomes Sciences, College of Pharmacy, University of South Carolina, Columbia
| | - Jayakrishna Ambati
- Center for Advanced Vision Science, University of Virginia School of Medicine, Charlottesville
- Department of Ophthalmology, University of Virginia School of Medicine, Charlottesville
- Department of Pathology, University of Virginia, Charlottesville
| |
Collapse
|
10
|
Gressler LE, Marinac-Dabic D, Resnic FS, Williams S, Yang K, Weichold F, Avila-Tang E, Mack C, Coplan P, Panagiotou OA, Pappas G. A Comprehensive Framework for Evaluating the Value Created by Real-World Evidence for Diverse Stakeholders: The Case for Coordinated Registry Networks. Ther Innov Regul Sci 2024:10.1007/s43441-024-00680-z. [PMID: 39060838 DOI: 10.1007/s43441-024-00680-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/04/2024] [Accepted: 07/18/2024] [Indexed: 07/28/2024]
Abstract
OBJECTIVES This manuscript presents a comprehensive framework for the assessment of the value of real-world evidence (RWE) in healthcare decision-making. While RWE has been proposed to overcome some limitations of traditional, one-off studies, no systematic framework exists to measure if RWE actually lowers the burden. This framework aims to fill that gap by providing conceptual approaches for evaluating the time and cost efficiencies of RWE, thus guiding strategic investments in RWE infrastructure. METHODS The framework consists of four components: (114th Congress. 21st Century Cures Act.; 2015. https://www.congress.gov/114/plaws/publ255/PLAW-114publ255.pdf .) identification of stakeholders using and producing RWE, (National Health Council. Glossary of Patient Engagement Terms. Published 2019. Accessed May 18. 2021. https://nationalhealthcouncil.org/glossary-of-patient-engagement-terms/ .) understanding value propositions on how RWE can benefit stakeholders, (Center for Drug Evaluation and Research. CDER Patient-Focused Drug Development. U.S. Food & Drug Administration.) defining key performance indicators (KPIs), and (U.S. Department of Health and Human Services - Food and Drug Administration: Center for Devices and Radiological Health and Center for Biologics Evaluation and Research. Use of Real-World Evidence to Support Regulatory Decision-Making for Medical Devices - Guidance for Industry and Food and Drug Administration Staff. 2017. http://www.fda.gov/BiologicsBloodVaccines/GuidanceComplianceRegulatoryInformation/Guida .) establishing metrics and case studies to assess value. KPIs are categorized as 'better, faster, or cheaper" as an indicator of value: better focusing on high-quality actionable evidence; 'faster,' denoting time-saving in evidence generation, and 'cheaper,' emphasizing cost-efficiency decision compared to methodologies that do not involve data routinely collected in clinical practice. Metrics and relevant case studies are tailored based on stakeholder value propositions and selected KPIs that can be used to assess what value has been created by using RWE compared to traditional evidence-generation approaches and comparing different RWE sources. RESULTS Operationalized through metrics and case studies drawn from the literature, the value of RWE is documented as improving treatment effect heterogeneity evaluation, expanding medical product labels, and expediting post-market compliance. RWE is also shown to reduce the cost and time required to produce evidence compared to traditional one-off approaches. An original example of a metric that measures the time saved by RWE methods to detect a signal of a product failure was presented based on analysis of the National Cardiovascular Disease Registry. CONCLUSIONS The framework presented in this manuscript offers a comprehensive approach for evaluating the value of RWE, applicable to all stakeholders engaged in leveraging RWE for healthcare decision-making. Through the proposed metrics and illustrated case studies, valuable insights are provided into the heightened efficiency, cost-effectiveness, and improved decision-making within clinical and regulatory domains facilitated by RWE. While this framework is primarily focused on medical devices, it could potentially inform the determination of RWE value in other medical products. By discerning the variations in cost, time, and data utility among various evidence-generation methods, stakeholders are empowered to invest strategically in RWE infrastructure and shape future research endeavors.
Collapse
|
11
|
Fournier J, Barret L, Khouri C, Naudet F, Boussageon R, Roustit M. The evidence base of the 10 most prescribed drugs in England, France, and the United States: a scoping review. J Clin Epidemiol 2024; 174:111478. [PMID: 39047918 DOI: 10.1016/j.jclinepi.2024.111478] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/26/2024] [Revised: 06/11/2024] [Accepted: 07/17/2024] [Indexed: 07/27/2024]
Abstract
OBJECTIVES To evaluate whether there is evidence of efficacy of the most commonly used medications in their primary indications. STUDY DESIGN AND SETTING This scoping review was executed using the Cochrane Library and MEDLINE databases up to May 2023. The 10 most prescribed medications in England, France, and the United States were identified using country-specific public databases. Up to 3 common indications in primary care were defined for each medication, based on a survey of general practitioners. The outcomes were determined by the authors to be patient-important outcomes, with placebo as the comparator. Two investigators independently conducted searches, following a predefined algorithm, to identify randomized controlled trials or meta-analyses of randomized controlled trials assessing the efficacy of these medications for each indication. The risk of bias was assessed using the ROBIS or ROB 2.0 tools. RESULTS We identified 21 drugs, covering 56 indications and 114 outcomes. Sixty-seven percent of the evaluated medications demonstrated efficacy for at least one outcome in at least one of the sought indications. Overall, evidence of efficacy was found for 48% of the indications. There was no study evaluating the efficacy of amoxicillin and salbutamol. For other drugs such as phloroglucinol or cholecalciferol, available studies suggested an absence of efficacy in the most common indications. CONCLUSION This study underscores the lack of data regarding the level of evidence for the most prescribed medications. Limitations include the choice of outcomes, and the understanding that the absence of evidence is not synonymous with the absence of efficacy.
Collapse
Affiliation(s)
- Joey Fournier
- Univ. Grenoble Alpes, Inserm CIC 1406, Grenoble Alpes University Hospital, Grenoble, France
| | - Lorraine Barret
- Univ. Grenoble Alpes, Inserm CIC 1406, Grenoble Alpes University Hospital, Grenoble, France
| | - Charles Khouri
- Univ. Grenoble Alpes, Inserm CIC 1406, Grenoble Alpes University Hospital, Grenoble, France; Univ. Grenoble Alpes, HP2, Inserm U1300, Grenoble, France
| | | | - Remy Boussageon
- Department of General Practice, Université de Lyon, Lyon, France
| | - Matthieu Roustit
- Univ. Grenoble Alpes, Inserm CIC 1406, Grenoble Alpes University Hospital, Grenoble, France; Univ. Grenoble Alpes, HP2, Inserm U1300, Grenoble, France.
| |
Collapse
|
12
|
Ko D, Kim DH, Singer DE. Letter by Ko et al Regarding Article, "Safety of Switching From a Vitamin K Antagonist to a Non-Vitamin K Antagonist Oral Anticoagulant in Frail Older Patients With Atrial Fibrillation: Results of the FRAIL-AF Randomized Controlled Trial". Circulation 2024; 150:e25-e26. [PMID: 38976608 DOI: 10.1161/circulationaha.123.067600] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 07/10/2024]
Affiliation(s)
- Darae Ko
- Hinda and Arthur Marcus Institute for Aging Research, Hebrew SeniorLife and Harvard Medical School, Boston, MA (D.K., D.H.K.)
- Section of Cardiovascular Medicine, Boston Medical Center, MA (D.K.)
| | - Dae Hyun Kim
- Hinda and Arthur Marcus Institute for Aging Research, Hebrew SeniorLife and Harvard Medical School, Boston, MA (D.K., D.H.K.)
- Division of Gerontology, Department of Medicine, Beth Israel Deaconess Medical Center and Harvard Medical School, Boston, MA (D.H.K.)
| | - Daniel E Singer
- Division of General Internal Medicine, Department of Medicine, Massachusetts General Hospital, Harvard Medical School, Boston (D.E.S.)
| |
Collapse
|
13
|
Abbasi AB, Curtis LH, Califf RM. Why Should the FDA Focus on Pragmatic Clinical Research? JAMA 2024; 332:103-104. [PMID: 38829729 DOI: 10.1001/jama.2024.6227] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 06/05/2024]
Abstract
This Viewpoint from the FDA discusses how pragmatic clinical research—assessment that uses real-world data, often in combination with research data, after initial marketing approval—can help in evaluation of new technologies, benefit research sites in underresourced settings, and better inform regulatory decisions and clinical practice.
Collapse
Affiliation(s)
- Ali B Abbasi
- US Food and Drug Administration, White Oak Campus, Silver Spring, Maryland
| | - Lesley H Curtis
- US Food and Drug Administration, White Oak Campus, Silver Spring, Maryland
| | - Robert M Califf
- US Food and Drug Administration, White Oak Campus, Silver Spring, Maryland
| |
Collapse
|
14
|
Wang C, Kaufman JS, Steele RJ, Shrier I. Target trial framework for determining the effect of changes in training load on injury risk using observational data: a methodological commentary. BMJ Open Sport Exerc Med 2024; 10:e002037. [PMID: 38975026 PMCID: PMC11227826 DOI: 10.1136/bmjsem-2024-002037] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 06/25/2024] [Indexed: 07/09/2024] Open
Abstract
In recent years, a large focus has been placed on managing training load for injury prevention. To minimise injuries, training recommendations should be based on research that examines causal relationships between load and injury risk. While observational studies can be used to estimate causal effects, conventional methods to study the relationship between load and injury are prone to bias. The target trial framework is a valuable tool that requires researchers to emulate a hypothetical randomised trial using observational data. This framework helps to explicitly define research questions and design studies in a way that estimates causal effects. This article provides an overview of the components of the target trial framework as applied to studies on load and injury and describes various considerations that should be made in study design and analyses to minimise bias.
Collapse
Affiliation(s)
- Chinchin Wang
- Department of Epidemiology, Biostatistics and Occupational Health, McGill University, Montreal, Canada
- Centre for Clinical Epidemiology, Lady Davis Institute for Medical Research, Montreal, Canada
| | - Jay S Kaufman
- Department of Epidemiology, Biostatistics and Occupational Health, McGill University, Montreal, Canada
| | - Russell J Steele
- Department of Mathematics and Statistics, McGill University, Montreal, Canada
| | - Ian Shrier
- Centre for Clinical Epidemiology, Lady Davis Institute for Medical Research, Montreal, Canada
| |
Collapse
|
15
|
Schneeweiss S. Enhancing External Control Arm Analyses through Data Calibration and Hybrid Designs. Clin Pharmacol Ther 2024. [PMID: 38952236 DOI: 10.1002/cpt.3364] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/29/2024] [Accepted: 06/08/2024] [Indexed: 07/03/2024]
Abstract
Almost all external control arm analyses to contextualize findings of a single arm trial struggle with two key issues: the lack of baseline randomization, and equally important, the difference in data collection between the experimental arm with its primary data collection, and the external control arm using secondary data. We illustrate the data calibration design to remedy issues arising from differential measurements in the two arms, and discuss the hybrid design that expands an underpowered randomized internal control arm with real-world data to mitigate the lack of randomization of the external control arm. We show how the two approaches fit into an evidence-development strategy that naturally builds on the incremental insights gained.
Collapse
Affiliation(s)
- Sebastian Schneeweiss
- Division of Pharmacoepidemiology and Pharmacoeconomics, Department of Medicine, Brigham and Women's Hospital, Boston, Massachusetts, USA
- Harvard Medical School, Boston, Massachusetts, USA
| |
Collapse
|
16
|
Auer J, Krotka P, Reichardt B, Traxler D, Wendt R, Mildner M, Ankersmit HJ, Graf A. Selection for transcatheter versus surgical aortic valve replacement and mid-term survival: results of the AUTHEARTVISIT study. Eur J Cardiothorac Surg 2024; 66:ezae214. [PMID: 38867365 PMCID: PMC11220406 DOI: 10.1093/ejcts/ezae214] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/12/2024] [Revised: 04/29/2024] [Accepted: 06/11/2024] [Indexed: 06/14/2024] Open
Abstract
OBJECTIVES Limited data are available from randomized trials comparing outcomes between transcatheter aortic valve replacement (TAVR) and surgery in patients with different risks and with follow-up of at least 4 years or longer. In this large, population-based cohort study, long-term mortality and morbidity were investigated in patients undergoing aortic valve replacement (AVR) for severe aortic stenosis using a surgically implanted bioprosthesis (surgical/biological aortic valve replacement; sB-AVR) or TAVR. METHODS Individual data from the Austrian Insurance Funds from 2010 through 2020 were analysed. The primary outcome was all-cause mortality, assessed in the overall and propensity score-matched populations. Secondary outcomes included reoperation and cardiovascular events. RESULTS From January 2010 through December 2020, a total of 18 882 patients underwent sB-AVR (n = 11 749; 62.2%) or TAVR (n = 7133; 37.8%); median follow-up was 5.8 (95% CI 5.7-5.9) years (maximum 12.3 years). The risk of all-cause mortality was higher with TAVR compared with sB-AVR: hazard ratio 1.552, 95% confidence interval (CI) 1.469-1.640, P < 0.001; propensity score-matched hazard ratio 1.510, 1.403-1.625, P < 0.001. Estimated median survival was 8.8 years (95% CI 8.6-9.1) with sB-AVR versus 5 years (4.9-5.2) with TAVR. Estimated 5-year survival probability was 0.664 (0.664-0.686) with sB-AVR versus 0.409 (0.378-0.444) with TAVR overall, and 0.690 (0.674-0.707) and 0.560 (0.540-0.582), respectively, with propensity score matching. Separate subgroup analyses for patients aged 65-75 years and >75 years indicated a significant survival benefit in patients selected for sB-AVR in both groups. Other predictors of mortality were age, sex, previous heart failure, diabetes and chronic kidney disease. CONCLUSIONS In this retrospective national population-based study, selection for TAVR was significantly associated with higher all-cause mortality compared with sB-AVR in patients ≥65 years with severe, symptomatic aortic stenosis in the >2-year follow-up.
Collapse
Affiliation(s)
- Johann Auer
- Department of Internal Medicine I with Cardiology and Intensive Care, St Josef Hospital Braunau, Braunau am Inn, Austria
| | - Pavla Krotka
- Center for Medical Data Science, Medical University of Vienna, Vienna, Austria
| | | | - Denise Traxler
- Clinic of Thoracic Surgery, Medical University of Vienna, Vienna, Austria
- Laboratory for Cardiac and Thoracic Diagnosis, Regeneration and Applied Immunology, Vienna, Austria
- Department of Oral and Maxillofacial Surgery, Medical University of Vienna, Vienna, Austria
| | - Ralph Wendt
- Department of Nephrology, Hospital St Georg Leipzig, Leipzig, Germany
| | - Michael Mildner
- Department of Dermatology, Medical University of Vienna, Vienna, Austria
| | - Hendrik Jan Ankersmit
- Clinic of Thoracic Surgery, Medical University of Vienna, Vienna, Austria
- Laboratory for Cardiac and Thoracic Diagnosis, Regeneration and Applied Immunology, Vienna, Austria
| | - Alexandra Graf
- Center for Medical Data Science, Medical University of Vienna, Vienna, Austria
| |
Collapse
|
17
|
Kirkegård J, Gaber C, Heide-Jørgensen U, Fristrup CW, Lund JL, Cronin-Fenton D, Mortensen FV. Effect of surgery versus chemotherapy in pancreatic cancer patients: a target trial emulation. J Natl Cancer Inst 2024; 116:1072-1079. [PMID: 38310365 DOI: 10.1093/jnci/djae024] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/13/2023] [Revised: 12/08/2023] [Accepted: 01/28/2024] [Indexed: 02/05/2024] Open
Abstract
BACKGROUND To estimate the causal effect of surgery vs chemotherapy on survival in patients with T1-3NxM0 pancreatic cancer in a rigorous framework addressing selection bias and immortal time bias. METHODS We used population-based Danish health-care registries to conduct a cohort study emulating a hypothetical randomized trial to estimate the absolute difference in survival, comparing surgery with chemotherapy. We included pancreatic cancer patients diagnosed during 2008-2021. Exposure was surgery or chemotherapy initiated within a 16-week grace period after diagnosis. At the time of diagnosis, data of each patient were duplicated; one copy was assigned to the surgery protocol, and one copy to the chemotherapy protocol of the hypothetical trial. Copies were censored when the assigned treatment deviated from the observed treatment. To account for informative censoring, uncensored patients were weighted according to confounders. For comparison, we also applied a more conventional analysis using propensity score-based inverse probability weighting. RESULTS We included 1744 patients with a median age of 68 years: 73.6% underwent surgery, and 18.6% had chemotherapy without surgery; 7.8% received no treatment. The 3-year survival was 39.7% (95% confidence interval [CI] = 36.7% to 42.6%) after surgery and 22.7% (95% CI = 17.7% to 28.4%) after chemotherapy, corresponding to an absolute difference of 17.0% (95% CI = 10.8% to 23.1%). In the conventional survival analysis, this difference was 23.0% (95% CI = 17.0% to 29.0%). CONCLUSION Surgery was superior to chemotherapy in achieving long-term survival for pancreatic cancer. The difference comparing surgery and chemotherapy was substantially smaller when using the clone-censor-weight approach than conventional survival analysis.
Collapse
Affiliation(s)
- Jakob Kirkegård
- Department of Surgery, HPB Section, Aarhus University Hospital, Aarhus, Denmark
- Department of Clinical Medicine, Aarhus University, Aarhus, Denmark
| | - Charles Gaber
- Department of Pharmacy Systems, Outcomes and Policy, University of Illinois, Chicago, IL, USA
| | - Uffe Heide-Jørgensen
- Department of Clinical Medicine, Aarhus University, Aarhus, Denmark
- Department of Clinical Epidemiology, Aarhus University Hospital, Aarhus, Denmark
| | | | - Jennifer L Lund
- Department of Epidemiology, Gillings School of Global Public Health, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA
| | - Deirdre Cronin-Fenton
- Department of Clinical Medicine, Aarhus University, Aarhus, Denmark
- Department of Clinical Epidemiology, Aarhus University Hospital, Aarhus, Denmark
| | - Frank Viborg Mortensen
- Department of Surgery, HPB Section, Aarhus University Hospital, Aarhus, Denmark
- Department of Clinical Medicine, Aarhus University, Aarhus, Denmark
| |
Collapse
|
18
|
Christine PJ, Lodi S, Hsu HE, Bovell-Ammon B, Yan S, Bernson D, Novo P, Lee JD, Rotrosen J, Liebschutz J, Walley AY, Larochelle MR. Target trial emulation for comparative effectiveness research with observational data: Promise and challenges for studying medications for opioid use disorder. Addiction 2024; 119:1313-1321. [PMID: 38519819 PMCID: PMC11156545 DOI: 10.1111/add.16473] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/22/2023] [Accepted: 02/09/2024] [Indexed: 03/25/2024]
Abstract
Medications for opioid use disorder (MOUD) increase retention in care and decrease mortality during active treatment; however, information about the comparative effectiveness of different forms of MOUD is sparse. Observational comparative effectiveness studies are subject to many types of bias; a robust framework to minimize bias would improve the quality of comparative effectiveness evidence. This paper discusses the use of target trial emulation as a framework to conduct comparative effectiveness studies of MOUD with administrative data. Using examples from our planned research project comparing buprenorphine-naloxone and extended-release naltrexone with respect to the rates of MOUD discontinuation, we provide a primer on the challenges and approaches to employing target trial emulation in the study of MOUD.
Collapse
Affiliation(s)
- Paul J. Christine
- Section of General Internal Medicine, Department of Medicine, University of Colorado School of Medicine, Aurora, CO, USA
- Department of General Internal Medicine, Denver Health and Hospital Authority, Denver, CO, USA
| | - Sara Lodi
- Department of Biostatistics, Boston University School of Public Health, Boston, MA, USA
| | - Heather E. Hsu
- Department of Pediatrics, Boston Medical Center and Boston University Chobanian & Avedisian School of Medicine, Boston, MA, USA
| | - Benjamin Bovell-Ammon
- Departments of Medicine and Healthcare Delivery and Population Sciences, Baystate Health and University of Massachusetts Chan Medical School - Baystate, Springfield, MA, USA
| | - Shapei Yan
- Section of General Internal Medicine, Department of Medicine, Boston Medical Center and Boston University Chobanian & Avedisian School of Medicine, Boston, MA, USA
| | - Dana Bernson
- Department of Public Health, Commonwealth of Massachusetts, Boston, MA, USA
| | - Patricia Novo
- Department of Psychiatry, New York University Grossman School of Medicine, New York, NY, USA
| | - Joshua D. Lee
- Department of Population Health, New York University Grossman School of Medicine, New York, NY, USA
| | - John Rotrosen
- Department of Psychiatry, New York University Grossman School of Medicine, New York, NY, USA
| | - Jane Liebschutz
- Division of General Internal Medicine, Center for Research on Health Care, Department of Medicine, University of Pittsburgh, UPMC, Pittsburgh, PA, USA
| | - Alexander Y. Walley
- Section of General Internal Medicine, Department of Medicine, Boston Medical Center and Boston University Chobanian & Avedisian School of Medicine, Boston, MA, USA
- Department of Public Health, Commonwealth of Massachusetts, Boston, MA, USA
| | - Marc R. Larochelle
- Section of General Internal Medicine, Department of Medicine, Boston Medical Center and Boston University Chobanian & Avedisian School of Medicine, Boston, MA, USA
| |
Collapse
|
19
|
Lazar Neto F, Mercadé-Besora N, Raventós B, Pérez-Crespo L, Castro Junior G, Ranzani OT, Duarte-Salles T. Effectiveness of COVID-19 vaccines against severe COVID-19 among patients with cancer in Catalonia, Spain. Nat Commun 2024; 15:5088. [PMID: 38898035 PMCID: PMC11187152 DOI: 10.1038/s41467-024-49285-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/02/2023] [Accepted: 05/28/2024] [Indexed: 06/21/2024] Open
Abstract
Patients with cancer were excluded from pivotal randomized clinical trials of COVID-19 vaccine products, and available observational evidence on vaccine effectiveness (VE) focused mostly on mild, and not severe COVID-19, which is the ultimate goal of vaccination for high-risk groups. Here, using primary care electronic health records from Catalonia, Spain (SIDIAP), we built two large cohorts of vaccinated and matched control cancer patients with a primary vaccination scheme (n = 184,744) and a booster (n = 108,534). Most patients received a mRNA-based product in primary (76.2%) and booster vaccination (99.9%). Patients had 51.8% (95% CI 40.3%-61.1%) and 58.4% (95% CI 29.3%-75.5%) protection against COVID-19 hospitalization and COVID-19 death respectively after full vaccination (two-doses) and 77.9% (95% CI 69.2%-84.2%) and 80.2% (95% CI 63.0%-89.4%) after booster. Compared to primary vaccination, the booster dose provided higher peak protection during follow-up. Calibration of VE estimates with negative outcomes, and sensitivity analyses with slight different population and COVID-19 outcomes definitions provided similar results. Our results confirm the role of primary and booster COVID-19 vaccination in preventing COVID-19 severe events in patients with cancer and highlight the need for the additional dose in this population.
Collapse
Affiliation(s)
- Felippe Lazar Neto
- Pulmonary Division, Heart Institute (InCor), Hospital das Clinicas HCFMUSP, Faculdade de Medicina, Universidade de São Paulo, São Paulo, Brazil
- Serviço de Oncologia Clínica, Instituto do Câncer do Estado de São Paulo (ICESP), Hospital das Clinicas HCFMUSP, Faculdade de Medicina, Universidade de São Paulo, São Paulo, Brazil
| | - Núria Mercadé-Besora
- Fundació Institut Universitari per a la recerca a l'Atenció Primària de Salut Jordi Gol i Gurina (IDIAPJGol), Barcelona, Spain
| | - Berta Raventós
- Fundació Institut Universitari per a la recerca a l'Atenció Primària de Salut Jordi Gol i Gurina (IDIAPJGol), Barcelona, Spain
- Universitat Autònoma de Barcelona, Bellaterra (Cerdanyola del Vallès), Spain
| | - Laura Pérez-Crespo
- Fundació Institut Universitari per a la recerca a l'Atenció Primària de Salut Jordi Gol i Gurina (IDIAPJGol), Barcelona, Spain
| | - Gilberto Castro Junior
- Serviço de Oncologia Clínica, Instituto do Câncer do Estado de São Paulo (ICESP), Hospital das Clinicas HCFMUSP, Faculdade de Medicina, Universidade de São Paulo, São Paulo, Brazil
| | - Otavio T Ranzani
- Pulmonary Division, Heart Institute (InCor), Hospital das Clinicas HCFMUSP, Faculdade de Medicina, Universidade de São Paulo, São Paulo, Brazil.
- ISGlobal, Hospital Clínic-Universitat de Barcelona, Barcelona, Spain.
| | - Talita Duarte-Salles
- Fundació Institut Universitari per a la recerca a l'Atenció Primària de Salut Jordi Gol i Gurina (IDIAPJGol), Barcelona, Spain.
- Department of Medical Informatics, Erasmus University Medical Center, Rotterdam, The Netherlands.
| |
Collapse
|
20
|
Signori A, Ponzano M, Kalincik T, Ozakbas S, Horakova D, Kubala Havrdova E, Alroughani R, Patti F, Kuhle J, Izquierdo G, Eichau S, Yamout B, Khoury SJ, Karabudak R, Grammond P, Duquette P, Roos I, Butzkueven H, van der Walt A, Sormani MP. Emulating randomised clinical trials in relapsing-remitting multiple sclerosis with non-randomised real-world evidence: an application using data from the MSBase Registry. J Neurol Neurosurg Psychiatry 2024; 95:620-625. [PMID: 38242680 DOI: 10.1136/jnnp-2023-332603] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/11/2023] [Accepted: 01/07/2024] [Indexed: 01/21/2024]
Abstract
BACKGROUND To mimic as closely as possible a randomised controlled trial (RCT) and calibrate the real-world evidence (RWE) studies against a known treatment effect would be helpful to understand if RWE can support causal conclusions in selected circumstances. The aim was to emulate the TRANSFORMS trial comparing Fingolimod (FTY) versus intramuscular interferon β-1a (IFN) using observational data. METHODS We extracted from the MSBase registry all the patients with relapsing-remitting multiple sclerosis (RRMS) collected in the period 2011-2021 who received IFN or FTY (0.5 mg) and with the same inclusion and exclusion criteria of the TRANSFORMS RCT. The primary endpoint was the annualised relapse rate (ARR) over 12 months. Patients were 1:1 propensity-score (PS) matched. Relapse-rate ratio (RR) was calculated by mean of a negative binomial regression. RESULTS A total of 4376 patients with RRMS (1140 in IFN and 3236 in FTY) were selected. After PS, 856 patients in each group were matched. The ARR was 0.45 in IFN and 0.25 in FTY with a significant difference between the two groups (RR: 0.55, 95% CI: 0.45 to 0.68; p<0.001). The result of the emulation was very similar and fell within the 95% CI of that observed in the RCT (RR: 0.49, 95% CI: 0.37 to 0.64; p<0.001) with a standardised difference of 0.66 (p=0.51). CONCLUSIONS By applying the same inclusion and exclusion criteria used in the RCT and employing appropriate methodology, we successfully replicated the RCT results with only minor discrepancies. Also, even if the confounding bias cannot be fully eliminated, conducting a rigorous target trial emulation could still yield valuable insights for comparative effectiveness research.
Collapse
Affiliation(s)
- Alessio Signori
- Department of Health Sciences, Section of Biostatistics, University of Genova, Genoa, Italy
| | - Marta Ponzano
- Department of Health Sciences, Section of Biostatistics, University of Genova, Genoa, Italy
| | - Tomas Kalincik
- Department of Medicine, University of Melbourne, Melbourne, Victoria, Australia
- Department of Neurology, Royal Melbourne Hospital, Melbourne, Victoria, Australia
| | | | - Dana Horakova
- Department of Neurology and Center of Clinical Neuroscience, Charles University in Prague, 1st Faculty of Medicine and General University Hospital in Prague, Prague, Czech Republic
| | - Eva Kubala Havrdova
- Department of Neurology and Center of Clinical Neuroscience, Charles University in Prague, 1st Faculty of Medicine and General University Hospital in Prague, Prague, Czech Republic
| | | | - Francesco Patti
- Department of Neuroscience, University of Catania Department of Surgical and Medical Sciences and Advanced Technologies 'G.F. Ingrassia', Catania, Italy
| | - Jens Kuhle
- Department of Neurology, University Hospital Basel, Basel, Switzerland
| | | | - Sara Eichau
- Hospital Universitario Virgen Macarena, Seville, Spain
| | - Bassem Yamout
- American University of Beirut Medical Center, Beirut, Lebanon
| | - Samia Joseph Khoury
- Nehme and Therese Tohme Multiple Sclerosis Center, American University of Beirut Medical Center, Beirut, Lebanon
- American University of Beirut, Beirut, Lebanon
| | - Rana Karabudak
- Department of Neurology, Hacettepe University Faculty of Medicine, Ankara, Turkey
| | | | - Pierre Duquette
- CHUM MS Center and Department of Neuroscience, Université de Montréal, Montreal, Québec, Canada
| | - Izanne Roos
- Clinical Outcomes Research Unit, The University of Melbourne Department of Medicine Royal Melbourne Hospital, Parkville, Victoria, Australia
| | - Helmut Butzkueven
- Monash University Central Clinical School, Melbourne, Victoria, Australia
- Alfred Hospital, Melbourne, Victoria, Australia
| | - Anneke van der Walt
- Monash University Central Clinical School, Melbourne, Victoria, Australia
- Alfred Hospital, Melbourne, Victoria, Australia
| | - Maria Pia Sormani
- Department of Health Sciences, Section of Biostatistics, University of Genova, Genoa, Italy
- Istituto di Ricovero e Cura a Carattere Scientifico, Ospedale Policlinico San Martino, Genoa, Italy
| |
Collapse
|
21
|
Tuesley KM, Spilsbury K, Webb PM, Pearson SA, Donovan P, Coory MD, Steer CB, Stewart LM, Pandeya N, Protani MM, Dixon-Suen S, Marquart-Wilson L, Jordan SJ. Use of an emulated trial to investigate the association between use of nitrogen-based bisphosphonates and risk of epithelial ovarian cancer. Int J Epidemiol 2024; 53:dyae108. [PMID: 39133937 PMCID: PMC11319644 DOI: 10.1093/ije/dyae108] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/01/2023] [Accepted: 08/02/2024] [Indexed: 08/15/2024] Open
Abstract
BACKGROUND Epithelial ovarian cancer (EOC) is the eighth most common cancer in women, with poor survival outcomes. Observational evidence suggests that nitrogen-based bisphosphonate (NBB) use may be associated with reduced risk of EOC, particularly the endometrioid and serous histotypes; however, confounding by indication is a concern. An alternative approach to investigate the chemo-preventive potential of NBBs is to emulate a target trial by identifying all women who initiate use of NBBs and investigate the risk of EOC for continued users compared with discontinued users. METHODS Using population-based linked data, we identified all Australian women aged over 50 years who first used NBBs over 2004-12. We used the year after first use to define treatment for each woman as either continued or discontinued use. We emulated randomization using stabilized inverse probability weights to balance the treatment groups using covariates including age, comorbidities and socioeconomic status. We followed women from treatment assignment until EOC diagnosis, death or 31 December 2013. We assessed the risk of EOC (overall and by histotype) using flexible parametric time-to-event models allowing for time-varying effects, and produced time-varying coefficients. RESULTS Of the 313 383 women in the study, 472 were diagnosed with EOC during follow-up (261 serous EOC), with an average age at diagnosis of 72 years. Continued use of NBBs was associated with reduced risk of EOC overall (HR = 0.87, 95% CI: 0.69, 1.10), and serous EOC (HR = 0.71, 95% CI: 0.53, 0.96), compared with discontinued treatment, with estimates remaining constant over the 9-year follow-up. CONCLUSIONS Results from our emulated trial suggest that in women who initiated NBB treatment, those who continued use had 13% and 29% lower hazards of being diagnosed with EOC overall and serous EOC, respectively, compared with women who discontinued use.
Collapse
Affiliation(s)
- Karen M Tuesley
- School of Public Health, Faculty of Medicine, University of Queensland, Brisbane, QLD, Australia
- Population Health Program, QIMR Berghofer Medical Research Institute, Brisbane, QLD, Australia
| | - Katrina Spilsbury
- Institute for Health Research, University of Notre Dame Australia, Fremantle, WA, Australia
| | - Penelope M Webb
- School of Public Health, Faculty of Medicine, University of Queensland, Brisbane, QLD, Australia
- Population Health Program, QIMR Berghofer Medical Research Institute, Brisbane, QLD, Australia
| | - Sallie-Anne Pearson
- School of Population Health, University of New South Wales, Sydney, NSW, Australia
- Centre of Research Excellence in Medicines Intelligence, University of New South Wales, Sydney, NSW, Australia
| | - Peter Donovan
- Clinical Pharmacology Department, Royal Brisbane and Women’s Hospital, Brisbane, QLD, Australia
- Faculty of Medicine, University of Queensland, Brisbane, QLD, Australia
| | - Michael D Coory
- Faculty of Medicine, Dentistry and Health Sciences, University of Melbourne, Melbourne, VIC, Australia
| | - Christopher B Steer
- Border Medical Oncology, Albury-Wodonga Regional Cancer Centre, Albury, NSW, Australia
- University of NSW Rural Clinical School, Albury Campus, Albury, NSW, Australia
| | - Louise M Stewart
- School of Population and Global Health, University of Western Australia, Perth, WA, Australia
| | - Nirmala Pandeya
- School of Public Health, Faculty of Medicine, University of Queensland, Brisbane, QLD, Australia
- Population Health Program, QIMR Berghofer Medical Research Institute, Brisbane, QLD, Australia
| | - Melinda M Protani
- School of Public Health, Faculty of Medicine, University of Queensland, Brisbane, QLD, Australia
| | - Suzanne Dixon-Suen
- Institute for Physical Activity and Nutrition, Deakin University, Geelong, VIC, Australia
- Cancer Epidemiology Division, Cancer Council Victoria, Melbourne, VIC, Australia
| | - Louise Marquart-Wilson
- School of Public Health, Faculty of Medicine, University of Queensland, Brisbane, QLD, Australia
- Clinical Malaria Group, QIMR Berghofer Medical Research Institute, Brisbane, QLD, Australia
| | - Susan J Jordan
- School of Public Health, Faculty of Medicine, University of Queensland, Brisbane, QLD, Australia
- Population Health Program, QIMR Berghofer Medical Research Institute, Brisbane, QLD, Australia
| |
Collapse
|
22
|
Honap S, Danese S, Peyrin-Biroulet L. Target Trial Emulation: Improving the Quality of Observational Studies in Inflammatory Bowel Disease Using the Principles of Randomized Trials. Inflamm Bowel Dis 2024:izae131. [PMID: 38862178 DOI: 10.1093/ibd/izae131] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/18/2024] [Indexed: 06/13/2024]
Abstract
The past decade has seen a substantial increase in the number of randomized controlled trials (RCTs) conducted in inflammatory bowel disease (IBD). Randomized controlled trials are the gold standard method for generating robust evidence of drug safety and efficacy but are expensive, time-consuming, and may have ethical implications. Observational studies in IBD are often used to fill the gaps in evidence but are typically hindered by significant bias. There are several approaches for making statistical inferences from observational data with some that focus on study design and others on statistical techniques. Target trial emulation is an emerging methodological process that aims to bridge this gap and improve the quality of observational studies by applying the principles of an ideal, or "target," randomized trial to routinely collected clinical data. There has been a rapid expansion of observational studies that have emulated trials over the past 5 years in other medical fields, but this has yet to be adopted in gastroenterology and IBD. The wealth of nonrandomized clinical data available through electronic health records, patient registries, and administrative health databases afford innumerable hypothesis-generating opportunities for IBD research. This review outlines the principles of target trial emulation, discusses the merits to IBD observational studies in reducing the most common biases and improving confidence in causality, and details the caveats of using this approach.
Collapse
Affiliation(s)
- Sailish Honap
- INFINY Institute, Nancy University Hospital, F-54500 Vandœuvre-lès-Nancy, France
- School of Immunology and Microbial Sciences, King's College London, London, UK
- Department of Gastroenterology, St George's University Hospitals NHS Foundation Trust, London, UK
| | - Silvio Danese
- Department of Gastroenterology and Endoscopy, IRCCS San Raffaele Hospital, Vita-Salute San Raffaele University, 20132 Milan, Italy
| | - Laurent Peyrin-Biroulet
- INFINY Institute, Nancy University Hospital, F-54500 Vandœuvre-lès-Nancy, France
- Department of Gastroenterology, Nancy University Hospital, F-54500 Vandœuvre-lès-Nancy, France
- INSERM, NGERE, University of Lorraine, F-54000 Nancy, France
- FHU-CURE, Nancy University Hospital, F-54500 Vandœuvre-lès-Nancy, France
- Groupe Hospitalier privé Ambroise Paré - Hartmann, Paris IBD Center, 92200 Neuilly sur Seine, France
- Division of Gastroenterology and Hepatology, McGill University Health Centre, Montreal, Quebec, Canada
| |
Collapse
|
23
|
Lee J, Lee H, Yoon D, Choi EY, Woo J, Jo B, Kim S, Shin JY, Jung HA. Lazertinib versus Platinum-Based Chemotherapy with Epidermal Growth Factor Receptor (EGFR)-Positive Non-Small-Cell Lung Cancer after Failing EGFR-Tyrosine Kinase Inhibitor: A Real-World External Comparator Study. Cancers (Basel) 2024; 16:2169. [PMID: 38927875 PMCID: PMC11202219 DOI: 10.3390/cancers16122169] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/12/2024] [Revised: 05/28/2024] [Accepted: 06/05/2024] [Indexed: 06/28/2024] Open
Abstract
BACKGROUND Lazertinib is a third-generation tyrosine kinase inhibitor of epidermal growth factor receptor (EGFR-TKI) that selectively inhibit common EGFR mutation and T790M mutation in non-small-cell lung cancer (NSCLC) patients. No previous studies have compared lazertinib to platinum-based chemotherapy. We have compared lazertinib with platinum-based chemotherapy in EGFR-mutated NSCLC patients after previous EGFR-TKI therapy. METHODS We retrospectively compared 200 patients from LASER201, LASER301, and LASER-PMS studies to 334 patients who were treated with platinum-based chemotherapy after previous EGFR-TKI from the Samsung Medical Center. After propensity score matching (PSM), we selected 156 patients from each group. The primary outcome was progression-free survival (PFS), with overall survival (OS), objective response rate (ORR), and time to treatment discontinuation (TTD) as secondary outcomes. RESULTS The median follow-up of PFS was 15.61 months in the lazertinib group and 21.67 months in the external control group. The PFS was significantly longer in patients who were treated with lazertinib than those treated with platinum-based chemotherapy (10.97 months vs. 5.10 months; adjusted hazard ratio (HR) 0.40; 95% confidence interval (CI), 0.29-0.55; p < 0.01) after PSM. Lazertinib showed superior OS (32.23 months vs. 18.73 months; adjusted HR 0.45; 95% CI, 0.29-0.69; p < 0.001), ORR (64.1% vs. 47.4%), and TTD (11.66 months vs. 6.73 months; adjusted HR 0.54; 95% CI, 0.39-0.75; p < 0.001) compared to platinum-based chemotherapy. CONCLUSION Based on this retrospective, external control study, lazertinib has demonstrated significantly better efficacy compared with platinum-based chemotherapy. The external controls provide important context to evaluate efficacy in single-arm studies.
Collapse
Affiliation(s)
- Junho Lee
- Division of Hematology and Oncology, Department of Medicine, Samsung Medical Center, Sungkyunkwan University School of Medicine, Seoul 06351, Republic of Korea;
| | - Hyesung Lee
- School of Pharmacy, Sungkyunkwan University, Suwon 16419, Republic of Korea; (H.L.); (D.Y.); (E.-Y.C.)
- Department of Biohealth Regulatory Science, Sungkyunkwan University, Suwon 16419, Republic of Korea;
| | - Dongwon Yoon
- School of Pharmacy, Sungkyunkwan University, Suwon 16419, Republic of Korea; (H.L.); (D.Y.); (E.-Y.C.)
- Department of Biohealth Regulatory Science, Sungkyunkwan University, Suwon 16419, Republic of Korea;
| | - Eun-Young Choi
- School of Pharmacy, Sungkyunkwan University, Suwon 16419, Republic of Korea; (H.L.); (D.Y.); (E.-Y.C.)
| | - Jieun Woo
- Department of Biohealth Regulatory Science, Sungkyunkwan University, Suwon 16419, Republic of Korea;
| | - Bobae Jo
- Yuhan Corporation, Seoul 06927, Republic of Korea; (B.J.); (S.K.)
| | - Sohee Kim
- Yuhan Corporation, Seoul 06927, Republic of Korea; (B.J.); (S.K.)
| | - Ju-Young Shin
- School of Pharmacy, Sungkyunkwan University, Suwon 16419, Republic of Korea; (H.L.); (D.Y.); (E.-Y.C.)
- Department of Biohealth Regulatory Science, Sungkyunkwan University, Suwon 16419, Republic of Korea;
- Department of Clinical Research Design & Evaluation, Samsung Advanced Institute for Health Sciences and Technology (SAIHST), Sungkyunkwan University, Seoul 06351, Republic of Korea
| | - Hyun Ae Jung
- Division of Hematology and Oncology, Department of Medicine, Samsung Medical Center, Sungkyunkwan University School of Medicine, Seoul 06351, Republic of Korea;
| |
Collapse
|
24
|
Berger ML, Ganz PA, Zou KH, Greenfield S. When Will Real-World Data Fulfill Its Promise to Provide Timely Insights in Oncology? JCO Clin Cancer Inform 2024; 8:e2400039. [PMID: 38950323 DOI: 10.1200/cci.24.00039] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/22/2024] [Revised: 04/25/2024] [Accepted: 05/10/2024] [Indexed: 07/03/2024] Open
Abstract
Randomized trials provide high-quality, internally consistent data on selected clinical questions, but lack generalizability for the aging population who are most often diagnosed with cancer and have comorbid conditions that may affect the interpretation of treatment benefit. The need for high-quality, relevant, and timely data is greater than ever. Promising solutions lie in the collection and analysis of real-world data (RWD), which can potentially provide timely insights about the patient's course during and after initial treatment and the outcomes of important subgroups such as the elderly, rural populations, children, and patients with greater social health needs. However, to inform practice and policy, real-world evidence must be created from trustworthy and comprehensive sources of RWD; these may include pragmatic clinical trials, registries, prospective observational studies, electronic health records (EHRs), administrative claims, and digital technologies. There are unique challenges in oncology since key parameters (eg, cancer stage, biomarker status, genomic assays, imaging response, side effects, quality of life) are not recorded, siloed in inaccessible documents, or available only as free text or unstructured reports in the EHR. Advances in analytics, such as artificial intelligence, may greatly enhance the ability to obtain more granular information from EHRs and support integrated diagnostics; however, they will need to be validated purpose by purpose. We recommend a commitment to standardizing data across sources and building infrastructures that can produce fit-for-purpose RWD that will provide timely understanding of the effectiveness of individual interventions.
Collapse
Affiliation(s)
| | - Patricia A Ganz
- UCLA Jonsson Comprehensive Cancer Center, UCLA Fielding School of Public Health, David Geffen School of Medicine at UCLA, Los Angeles, CA
| | - Kelly H Zou
- Global Medical Analytics, Real World Evidence, and Health Economics & Outcomes Research, Viatris Inc, Canonsburg, PA
| | | |
Collapse
|
25
|
Mesfin YM, Blais JE, Kibret KT, Tegegne TK, Cowling BJ, Wu P. Effectiveness of nirmatrelvir/ritonavir and molnupiravir in non-hospitalized adults with COVID-19: systematic review and meta-analysis of observational studies. J Antimicrob Chemother 2024:dkae163. [PMID: 38817046 DOI: 10.1093/jac/dkae163] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/05/2024] [Accepted: 05/05/2024] [Indexed: 06/01/2024] Open
Abstract
OBJECTIVE To determine the effectiveness of nirmatrelvir/ritonavir and molnupiravir among vaccinated and unvaccinated non-hospitalized adults with COVID-19. METHODS Observational studies of nirmatrelvir/ritonavir or molnupiravir compared to no antiviral drug treatment for COVID-19 in non-hospitalized adults with data on vaccination status were included. We searched MEDLINE, EMBASE, Scopus, Web of Science, WHO COVID-19 Research Database and medRxiv for reports published between 1 January 2022 and 8 November 2023. The primary outcome was a composite of hospitalization or mortality up to 35 days after COVID-19 diagnosis. Risk of bias was assessed with ROBINS-I. Risk ratios (RR), hazard ratios (HR) and risk differences (RD) were separately estimated using random-effects models. RESULTS We included 30 cohort studies on adults treated with nirmatrelvir/ritonavir (n = 462 279) and molnupiravir (n = 48 008). Nirmatrelvir/ritonavir probably reduced the composite outcome (RR 0.62, 95%CI 0.55-0.70; I2 = 0%; moderate certainty) with no evidence of effect modification by vaccination status (RR Psubgroup = 0.47). In five studies, RD estimates against the composite outcome for nirmatrelvir/ritonavir were 1.21% (95%CI 0.57% to 1.84%) in vaccinated and 1.72% (95%CI 0.59% to 2.85%) in unvaccinated subgroups.Molnupiravir may slightly reduce the composite outcome (RR 0.75, 95%CI 0.67-0.85; I2 = 32%; low certainty). Evidence of effect modification by vaccination status was inconsistent among studies reporting different effect measures (RR Psubgroup = 0.78; HR Psubgroup = 0.08). In two studies, RD against the composite outcome for molnupiravir were -0.01% (95%CI -1.13% to 1.10%) in vaccinated and 1.73% (95%CI -2.08% to 5.53%) in unvaccinated subgroups. CONCLUSIONS Among cohort studies of non-hospitalized adults with COVID-19, nirmatrelvir/ritonavir is effective against the composite outcome of severe COVID-19 independent of vaccination status. Further research and a reassessment of molnupiravir use among vaccinated adults are warranted. REGISTRATION PROSPERO CRD42023429232.
Collapse
Affiliation(s)
- Yonatan M Mesfin
- School of Public Health, LKS Faculty of Medicine, World Health Organization Collaborating Centre for Infectious Disease Epidemiology and Control, The University of Hong Kong, Hong Kong Special Administration Region, Hong Kong, China
- Immunity & Global Health, Murdoch Children's Research Institute (MCRI), Parkville, VIC, Australia
| | - Joseph E Blais
- School of Public Health, LKS Faculty of Medicine, World Health Organization Collaborating Centre for Infectious Disease Epidemiology and Control, The University of Hong Kong, Hong Kong Special Administration Region, Hong Kong, China
- Laboratory of Data Discovery for Health (D24H), Hong Kong Science and Technology Park, New Territories, Hong Kong Special Administration Region, Hong Kong, China
- Centre for Safe Medication Practice and Research, Department of Pharmacology and Pharmacy, LKS Faculty of Medicine, The University of Hong Kong, Hong Kong Special Administration Region, Hong Kong, China
| | - Kelemu Tilahun Kibret
- Global Centre for Preventive Health and Nutrition, Deakin University, Geelong, VIC, Australia
| | - Teketo Kassaw Tegegne
- Institute for Physical Activity and Nutrition, Deakin University, Geelong, VIC, Australia
| | - Benjamin J Cowling
- School of Public Health, LKS Faculty of Medicine, World Health Organization Collaborating Centre for Infectious Disease Epidemiology and Control, The University of Hong Kong, Hong Kong Special Administration Region, Hong Kong, China
- Laboratory of Data Discovery for Health (D24H), Hong Kong Science and Technology Park, New Territories, Hong Kong Special Administration Region, Hong Kong, China
| | - Peng Wu
- School of Public Health, LKS Faculty of Medicine, World Health Organization Collaborating Centre for Infectious Disease Epidemiology and Control, The University of Hong Kong, Hong Kong Special Administration Region, Hong Kong, China
- Laboratory of Data Discovery for Health (D24H), Hong Kong Science and Technology Park, New Territories, Hong Kong Special Administration Region, Hong Kong, China
| |
Collapse
|
26
|
Rand LZG, McGraw S, Wang J, Woloshin S, Wang SV, Darrow J, Kesselheim AS. Patient perspectives on evidence supporting drug safety and effectiveness: "What does it mean for me?". J Am Geriatr Soc 2024. [PMID: 38813805 DOI: 10.1111/jgs.19015] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/12/2024] [Revised: 04/22/2024] [Accepted: 04/29/2024] [Indexed: 05/31/2024]
Affiliation(s)
- Leah Z G Rand
- Program on Regulation, Therapeutics, and Law (PORTAL), Division of Pharmacoepidemiology and Pharmacoeconomics, Department of Medicine, Brigham and Women's Hospital, Boston, Massachusetts, USA
- Harvard Medical School, Boston, Massachusetts, USA
| | | | - Junyi Wang
- Program on Regulation, Therapeutics, and Law (PORTAL), Division of Pharmacoepidemiology and Pharmacoeconomics, Department of Medicine, Brigham and Women's Hospital, Boston, Massachusetts, USA
| | - Steven Woloshin
- The Dartmouth Institute, Geisel School of Medicine, Dartmouth, Hanover, New Hampshire, USA
- Lisa Schwartz Foundation for Truth in Medicine, Norwich, VT, USA
| | - Shirley V Wang
- Harvard Medical School, Boston, Massachusetts, USA
- Division of Pharmacoepidemiology and Pharmacoeconomics, Department of Medicine, Brigham and Women's Hospital, Boston, Massachusetts, USA
| | - Jonathan Darrow
- Program on Regulation, Therapeutics, and Law (PORTAL), Division of Pharmacoepidemiology and Pharmacoeconomics, Department of Medicine, Brigham and Women's Hospital, Boston, Massachusetts, USA
- Harvard Medical School, Boston, Massachusetts, USA
| | - Aaron S Kesselheim
- Program on Regulation, Therapeutics, and Law (PORTAL), Division of Pharmacoepidemiology and Pharmacoeconomics, Department of Medicine, Brigham and Women's Hospital, Boston, Massachusetts, USA
- Harvard Medical School, Boston, Massachusetts, USA
| |
Collapse
|
27
|
Maillard O, Bun R, Laanani M, Verga-Gérard A, Leroy T, Gault N, Estellat C, Noize P, Kaguelidou F, Sommet A, Lapeyre-Mestre M, Fourrier-Réglat A, Weill A, Quantin C, Tubach F. Use of the French National Health Data System (SNDS) in pharmacoepidemiology: A systematic review in its maturation phase. Therapie 2024:S0040-5957(24)00065-9. [PMID: 38834394 DOI: 10.1016/j.therap.2024.05.003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/30/2024] [Revised: 04/14/2024] [Accepted: 05/16/2024] [Indexed: 06/06/2024]
Abstract
AIM OF THE STUDY The French National Health Data System (SNDS) comprises healthcare data that cover 99% of the population (over 67 million individuals) in France. The aim of this study was to present an overview of published pharmacoepidemiological studies using the SNDS in its maturation phase. METHODS We conducted a systematic literature review of original research articles in the Pubmed and EMBASE databases from January 2012 until August 2018. RESULTS A total of 316 full-text articles were included, with an annual increase over the study period. Only 16 records were excluded after screening because they did not involve the SNDS but other French healthcare databases. The study design was clearly reported in only 66% of studies of which 57% were retrospective cohorts and 22% cross-sectional studies. The reported study objectives were drug utilization (65%), safety (22%) and effectiveness (9%). Almost all ATC groups were studied but the most frequent ones concerned the nervous system in 149 studies (49%), cardiovascular system drugs in 104 studies (34%) and anti-infectives for systemic use in 50 studies (16%). CONCLUSION The SNDS is of growing interest for studies on drug use and safety, which could be conducted more in specific populations, including children, pregnant women and the elderly, as these populations are often not included in clinical trials.
Collapse
Affiliation(s)
- Olivier Maillard
- Réseau de recherche en épidémiologie clinique et en santé publique/French Clinical Research Infrastructure Network (RECaP F-CRIN) Inserm network, 54500 Vandoeuvre-lès-Nancy, France; Department of Public Health and Research, CHU de La Réunion, 97400 Saint-Pierre, Ile de La Reunion, France; Clinical Investigation Center, INSERM CIC 1410, CHU de La Réunion, 97400 Saint-Pierre, Ile de La Reunion, France.
| | - René Bun
- Réseau de recherche en épidémiologie clinique et en santé publique/French Clinical Research Infrastructure Network (RECaP F-CRIN) Inserm network, 54500 Vandoeuvre-lès-Nancy, France; Department of Public Health and Research, CHU de La Réunion, 97400 Saint-Pierre, Ile de La Reunion, France; Clinical Investigation Center, INSERM CIC 1410, CHU de La Réunion, 97400 Saint-Pierre, Ile de La Reunion, France
| | - Moussa Laanani
- Réseau de recherche en épidémiologie clinique et en santé publique/French Clinical Research Infrastructure Network (RECaP F-CRIN) Inserm network, 54500 Vandoeuvre-lès-Nancy, France; French National Health Insurance, 75000 Paris, France
| | - Amandine Verga-Gérard
- Réseau de recherche en épidémiologie clinique et en santé publique/French Clinical Research Infrastructure Network (RECaP F-CRIN) Inserm network, 54500 Vandoeuvre-lès-Nancy, France; INSERM, CIC-EC 1433, 54100 Nancy, France
| | - Taylor Leroy
- Réseau de recherche en épidémiologie clinique et en santé publique/French Clinical Research Infrastructure Network (RECaP F-CRIN) Inserm network, 54500 Vandoeuvre-lès-Nancy, France; INSERM, CIC-EC 1433, 54100 Nancy, France
| | - Nathalie Gault
- Réseau de recherche en épidémiologie clinique et en santé publique/French Clinical Research Infrastructure Network (RECaP F-CRIN) Inserm network, 54500 Vandoeuvre-lès-Nancy, France; INSERM, CIC-EC 1425, hôpital Bichat, 75018 Paris, France
| | - Candice Estellat
- Réseau de recherche en épidémiologie clinique et en santé publique/French Clinical Research Infrastructure Network (RECaP F-CRIN) Inserm network, 54500 Vandoeuvre-lès-Nancy, France; Sorbonne Université, INSERM, institut Pierre-Louis d'épidémiologie et de Santé publique, AP-HP, hôpital Pitié-Salpêtrière, département de Santé publique, centre de pharmacoépidémiologie (Cephepi), CIC-1901, 75000 Paris, France
| | - Pernelle Noize
- Réseau de recherche en épidémiologie clinique et en santé publique/French Clinical Research Infrastructure Network (RECaP F-CRIN) Inserm network, 54500 Vandoeuvre-lès-Nancy, France; Université de Bordeaux, INSERM, BPH, U1219, Team AHeaD, CHU de Bordeaux, pôle de santé publique, service de pharmacologie médicale, 33000 Bordeaux, France
| | - Florentia Kaguelidou
- Réseau de recherche en épidémiologie clinique et en santé publique/French Clinical Research Infrastructure Network (RECaP F-CRIN) Inserm network, 54500 Vandoeuvre-lès-Nancy, France; INSERM, CIC-EC 1426, Department of Pediatric Pharmacology and Pharmacogenetics, Clinical Investigations Center, hôpital Robert-Debré, 75019 Paris, France; UMR-1123, ECEVE, université Paris Diderot, Sorbonne Paris Cité, 75013 Paris, France
| | - Agnès Sommet
- Réseau de recherche en épidémiologie clinique et en santé publique/French Clinical Research Infrastructure Network (RECaP F-CRIN) Inserm network, 54500 Vandoeuvre-lès-Nancy, France; Service de pharmacologie médicale et clinique, faculté de médecine, CIC 1436, CHU, université de Toulouse, 31000 Toulouse, France
| | - Maryse Lapeyre-Mestre
- Réseau de recherche en épidémiologie clinique et en santé publique/French Clinical Research Infrastructure Network (RECaP F-CRIN) Inserm network, 54500 Vandoeuvre-lès-Nancy, France; Service de pharmacologie médicale et clinique, faculté de médecine, CIC 1436, CHU, université de Toulouse, 31000 Toulouse, France
| | - Annie Fourrier-Réglat
- Réseau de recherche en épidémiologie clinique et en santé publique/French Clinical Research Infrastructure Network (RECaP F-CRIN) Inserm network, 54500 Vandoeuvre-lès-Nancy, France; Université de Bordeaux, INSERM, BPH, U1219, Team AHeaD, CHU de Bordeaux, pôle de santé publique, service de pharmacologie médicale, 33000 Bordeaux, France
| | - Alain Weill
- Réseau de recherche en épidémiologie clinique et en santé publique/French Clinical Research Infrastructure Network (RECaP F-CRIN) Inserm network, 54500 Vandoeuvre-lès-Nancy, France; Epiphare (French National Medicines Agency ANSM and French National Health Insurance CNAM), 93200 Saint-Denis, France
| | - Catherine Quantin
- Réseau de recherche en épidémiologie clinique et en santé publique/French Clinical Research Infrastructure Network (RECaP F-CRIN) Inserm network, 54500 Vandoeuvre-lès-Nancy, France; Service de biostatistiques et d'information médicale (DIM), CHU Dijon Bourgogne, INSERM, université de Bourgogne, CIC 1432, module épidémiologie clinique, 21000 Dijon, France; Université Paris-Saclay, UVSQ, Inserm, CESP, 94807 Villejuif, France
| | - Florence Tubach
- Réseau de recherche en épidémiologie clinique et en santé publique/French Clinical Research Infrastructure Network (RECaP F-CRIN) Inserm network, 54500 Vandoeuvre-lès-Nancy, France; Sorbonne Université, INSERM, institut Pierre-Louis d'épidémiologie et de Santé publique, AP-HP, hôpital Pitié-Salpêtrière, département de Santé publique, centre de pharmacoépidémiologie (Cephepi), CIC-1901, 75000 Paris, France
| |
Collapse
|
28
|
Thangaraj PM, Oikonomou EK, Dhingra LS, Aminorroaya A, Jayaram R, Suchard MA, Khera R. Computational Phenomapping of Randomized Clinical Trials to Enable Assessment of their Real-world Representativeness and Personalized Inference. MEDRXIV : THE PREPRINT SERVER FOR HEALTH SCIENCES 2024:2024.05.15.24306285. [PMID: 38798457 PMCID: PMC11118629 DOI: 10.1101/2024.05.15.24306285] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/29/2024]
Abstract
Importance Randomized clinical trials (RCTs) are the standard for defining an evidence-based approach to managing disease, but their generalizability to real-world patients remains challenging to quantify. Objective To develop a multidimensional patient variable mapping algorithm to quantify the similarity and representation of electronic health record (EHR) patients corresponding to an RCT and estimate the putative treatment effects in real-world settings based on individual treatment effects observed in an RCT. Design A retrospective analysis of the Treatment of Preserved Cardiac Function Heart Failure with an Aldosterone Antagonist Trial (TOPCAT; 2006-2012) and a multi-hospital patient cohort from the electronic health record (EHR) in the Yale New Haven Hospital System (YNHHS; 2015-2023). Setting A multicenter international RCT (TOPCAT) and multi-hospital patient cohort (YNHHS). Participants All TOPCAT participants and patients with heart failure with preserved ejection fraction (HFpEF) and ≥1 hospitalization within YNHHS. Exposures 63 pre-randomization characteristics measured across the TOPCAT and YNNHS cohorts. Main Outcomes and Measures Real-world generalizability of the RCT TOPCAT using a multidimensional phenotypic distance metric between TOPCAT and YNHHS cohorts. Estimation of the individualized treatment effect of spironolactone use on all-cause mortality within the YNHHS cohort based on phenotypic distance from the TOPCAT cohort. Results There were 3,445 patients in TOPCAT and 11,712 HFpEF patients across five hospital sites. Across the 63 TOPCAT variables mapped by clinicians to the EHR, there were larger differences between TOPCAT and each of the 5 EHR sites (median SMD 0.200, IQR 0.037-0.410) than between the 5 EHR sites (median SMD 0.062, IQR 0.010-0.130). The synthesis of these differences across covariates using our multidimensional similarity score also suggested substantial phenotypic dissimilarity between the TOPCAT and EHR cohorts. By phenotypic distance, a majority (55%) of TOPCAT participants were closer to each other than any individual EHR patient. Using a TOPCAT-derived model of individualized treatment benefit from spironolactone, those predicted to derive benefit and receiving spironolactone in the EHR cohorts had substantially better outcomes compared with predicted benefit and not receiving the medication (HR 0.74, 95% CI 0.62-0.89). Conclusions and Relevance We propose a novel approach to evaluating the real-world representativeness of RCT participants against corresponding patients in the EHR across the full multidimensional spectrum of the represented phenotypes. This enables the evaluation of the implications of RCTs for real-world patients. KEY POINTS Question: How can we examine the multi-dimensional generalizability of randomized clinical trials (RCT) to real-world patient populations?Findings: We demonstrate a novel phenotypic distance metric comparing an RCT to real-world populations in a large multicenter RCT of heart failure patients and the corresponding patients in multisite electronic health records (EHRs). Across 63 pre-randomization characteristics, pairwise assessments of members of the RCT and EHR cohorts were more discordant from each other than between members of the EHR cohort (median standardized mean difference 0.200 [0.037-0.410] vs 0.062 [0.010-0.130]), with a majority (55%) of RCT participants closer to each other than any individual EHR patient. The approach also enabled the quantification of expected real world outcomes based on effects observed in the RCT.Meaning: A multidimensional phenotypic distance metric quantifies the generalizability of RCTs to a given population while also offering an avenue to examine expected real-world patient outcomes based on treatment effects observed in the RCT.
Collapse
|
29
|
Bidulka P, Lugo-Palacios DG, Carroll O, O'Neill S, Adler AI, Basu A, Silverwood RJ, Bartlett JW, Nitsch D, Charlton P, Briggs AH, Smeeth L, Douglas IJ, Khunti K, Grieve R. Comparative effectiveness of second line oral antidiabetic treatments among people with type 2 diabetes mellitus: emulation of a target trial using routinely collected health data. BMJ 2024; 385:e077097. [PMID: 38719492 PMCID: PMC11077536 DOI: 10.1136/bmj-2023-077097] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Accepted: 03/14/2024] [Indexed: 05/12/2024]
Abstract
OBJECTIVE To compare the effectiveness of three commonly prescribed oral antidiabetic drugs added to metformin for people with type 2 diabetes mellitus requiring second line treatment in routine clinical practice. DESIGN Cohort study emulating a comparative effectiveness trial (target trial). SETTING Linked primary care, hospital, and death data in England, 2015-21. PARTICIPANTS 75 739 adults with type 2 diabetes mellitus who initiated second line oral antidiabetic treatment with a sulfonylurea, DPP-4 inhibitor, or SGLT-2 inhibitor added to metformin. MAIN OUTCOME MEASURES Primary outcome was absolute change in glycated haemoglobin A1c (HbA1c) between baseline and one year follow-up. Secondary outcomes were change in body mass index (BMI), systolic blood pressure, and estimated glomerular filtration rate (eGFR) at one year and two years, change in HbA1c at two years, and time to ≥40% decline in eGFR, major adverse kidney event, hospital admission for heart failure, major adverse cardiovascular event (MACE), and all cause mortality. Instrumental variable analysis was used to reduce the risk of confounding due to unobserved baseline measures. RESULTS 75 739 people initiated second line oral antidiabetic treatment with sulfonylureas (n=25 693, 33.9%), DPP-4 inhibitors (n=34 464 ,45.5%), or SGLT-2 inhibitors (n=15 582, 20.6%). SGLT-2 inhibitors were more effective than DPP-4 inhibitors or sulfonylureas in reducing mean HbA1c values between baseline and one year. After the instrumental variable analysis, the mean differences in HbA1c change between baseline and one year were -2.5 mmol/mol (95% confidence interval (CI) -3.7 to -1.3) for SGLT-2 inhibitors versus sulfonylureas and -3.2 mmol/mol (-4.6 to -1.8) for SGLT-2 inhibitors versus DPP-4 inhibitors. SGLT-2 inhibitors were more effective than sulfonylureas or DPP-4 inhibitors in reducing BMI and systolic blood pressure. For some secondary endpoints, evidence for SGLT-2 inhibitors being more effective was lacking-the hazard ratio for MACE, for example, was 0.99 (95% CI 0.61 to 1.62) versus sulfonylureas and 0.91 (0.51 to 1.63) versus DPP-4 inhibitors. SGLT-2 inhibitors had reduced hazards of hospital admission for heart failure compared with DPP-4 inhibitors (0.32, 0.12 to 0.90) and sulfonylureas (0.46, 0.20 to 1.05). The hazard ratio for a ≥40% decline in eGFR indicated a protective effect versus sulfonylureas (0.42, 0.22 to 0.82), with high uncertainty in the estimated hazard ratio versus DPP-4 inhibitors (0.64, 0.29 to 1.43). CONCLUSIONS This emulation study of a target trial found that SGLT-2 inhibitors were more effective than sulfonylureas or DPP-4 inhibitors in lowering mean HbA1c, BMI, and systolic blood pressure and in reducing the hazards of hospital admission for heart failure (v DPP-4 inhibitors) and kidney disease progression (v sulfonylureas), with no evidence of differences in other clinical endpoints.
Collapse
Affiliation(s)
- Patrick Bidulka
- Department of Non-Communicable Disease Epidemiology, London School of Hygiene and Tropical Medicine, London, WC1E 7HT, UK
| | - David G Lugo-Palacios
- Department of Health Services Research and Policy, London School of Hygiene and Tropical Medicine, London, UK
| | - Orlagh Carroll
- Department of Health Services Research and Policy, London School of Hygiene and Tropical Medicine, London, UK
| | - Stephen O'Neill
- Department of Health Services Research and Policy, London School of Hygiene and Tropical Medicine, London, UK
| | - Amanda I Adler
- Diabetes Trials Unit, The Oxford Centre for Diabetes, Endocrinology and Metabolism, University of Oxford, Headington, Oxford, UK
| | - Anirban Basu
- The Comparative Health Outcomes, Policy and Economics (CHOICE) Institute, University of Washington School of Pharmacy, Seattle, WA, USA
| | - Richard J Silverwood
- Centre for Longitudinal Studies, UCL Social Research Institute, University College London, London, UK
| | - Jonathan W Bartlett
- Department of Medical Statistics, London School of Hygiene and Tropical Medicine, London, UK
| | - Dorothea Nitsch
- Department of Non-Communicable Disease Epidemiology, London School of Hygiene and Tropical Medicine, London, WC1E 7HT, UK
| | - Paul Charlton
- Patient author, Patient Research Champion Team, National Institute for Health and Care Research, London, UK
| | - Andrew H Briggs
- Department of Health Services Research and Policy, London School of Hygiene and Tropical Medicine, London, UK
| | - Liam Smeeth
- Department of Non-Communicable Disease Epidemiology, London School of Hygiene and Tropical Medicine, London, WC1E 7HT, UK
| | - Ian J Douglas
- Department of Non-Communicable Disease Epidemiology, London School of Hygiene and Tropical Medicine, London, WC1E 7HT, UK
| | - Kamlesh Khunti
- Diabetes Research Centre, University of Leicester, Leicester, UK
| | - Richard Grieve
- Department of Health Services Research and Policy, London School of Hygiene and Tropical Medicine, London, UK
| |
Collapse
|
30
|
Wang SV, Schneeweiss S. Data Checks Before Registering Study Protocols for Health Care Database Analyses. JAMA 2024; 331:1445-1446. [PMID: 38587830 DOI: 10.1001/jama.2024.2988] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 04/09/2024]
Abstract
This Viewpoint discusses the challenges involved with secondary health care data collection vs primary data collection and provides a list of suggested data checks before registration of a study protocol using secondary data.
Collapse
Affiliation(s)
- Shirley V Wang
- Division of Pharmacoepidemiology and Pharmacoeconomics, Department of Medicine, Brigham and Women's Hospital and Harvard Medical School, Boston, Massachusetts
| | - Sebastian Schneeweiss
- Division of Pharmacoepidemiology and Pharmacoeconomics, Department of Medicine, Brigham and Women's Hospital and Harvard Medical School, Boston, Massachusetts
| |
Collapse
|
31
|
Wang SV, Lin KJ, Schneeweiss S. Emulation of randomized trials of direct oral anticoagulants with claims data and implications for new Factor XI inhibitors. Pharmacoepidemiol Drug Saf 2024; 33:e5813. [PMID: 38720425 PMCID: PMC11086666 DOI: 10.1002/pds.5813] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/21/2024] [Revised: 04/23/2024] [Accepted: 04/24/2024] [Indexed: 05/12/2024]
Abstract
Direct oral anticoagulants (DOACs) revolutionized the management of thromboembolic disorders. Clinical care may be further improved as Factor XIs undergo large-scale outcome trials. What role can non-randomized database studies play in expediting understanding of these drugs in clinical practice? The RCT-DUPLICATIVE Initiative emulated the design of eight DOAC randomized clinical trials (RCT) using non-randomized claims database studies. RCT study design parameters and measurements were closely emulated by the database studies and produced highly concordant results. The results of the single database study that did not meet all agreement metrics with the specific RCT it was emulating were aligned with a meta-analysis of six trials studying similar questions, suggesting the trial result was an outlier. Well-designed database studies using fit-for-purpose data came to the same conclusions as DOAC trials, illustrating how database studies could complement RCTs for Factor XI inhibitors-by accelerating insights in underrepresented populations, demonstrating effectiveness and safety in clinical practice, and testing broader indications.
Collapse
Affiliation(s)
- Shirley V Wang
- Division of Pharmacoepidemiology, Brigham and Women’s Hospital
- Department of Medicine, Harvard Medical School
| | - Kueiyu Joshua Lin
- Division of Pharmacoepidemiology, Brigham and Women’s Hospital
- Department of Medicine, Harvard Medical School
| | - Sebastian Schneeweiss
- Division of Pharmacoepidemiology, Brigham and Women’s Hospital
- Department of Medicine, Harvard Medical School
| |
Collapse
|
32
|
Zou KH, Vigna C, Talwai A, Jain R, Galaznik A, Berger ML, Li JZ. The Next Horizon of Drug Development: External Control Arms and Innovative Tools to Enrich Clinical Trial Data. Ther Innov Regul Sci 2024; 58:443-455. [PMID: 38528279 PMCID: PMC11043157 DOI: 10.1007/s43441-024-00627-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/17/2023] [Accepted: 02/04/2024] [Indexed: 03/27/2024]
Abstract
Conducting clinical trials (CTs) has become increasingly costly and complex in terms of designing and operationalizing. These challenges exist in running CTs on novel therapies, particularly in oncology and rare diseases, where CTs increasingly target narrower patient groups. In this study, we describe external control arms (ECA) and other relevant tools, such as virtualization and decentralized clinical trials (DCTs), and the ability to follow the clinical trial subjects in the real world using tokenization. ECAs are typically constructed by identifying appropriate external sources of data, then by cleaning and standardizing it to create an analysis-ready data file, and finally, by matching subjects in the external data with the subjects in the CT of interest. In addition, ECA tools also include subject-level meta-analysis and simulated subjects' data for analyses. By implementing the recent advances in digital health technologies and devices, virtualization, and DCTs, realigning of CTs from site-centric designs to virtual, decentralized, and patient-centric designs can be done, which reduces the patient burden to participate in the CTs and encourages diversity. Tokenization technology allows linking the CT data with real-world data (RWD), creating more comprehensive and longitudinal outcome measures. These tools provide robust ways to enrich the CT data for informed decision-making, reduce the burden on subjects and costs of trial operations, and augment the insights gained for the CT data.
Collapse
Affiliation(s)
| | - Chelsea Vigna
- Medidata Solutions, a Dassault Systèmes Company, Boston, MA, USA
| | - Aniketh Talwai
- Medidata Solutions, a Dassault Systèmes Company, Boston, MA, USA
| | - Rahul Jain
- Medidata Solutions, a Dassault Systèmes Company, Boston, MA, USA
| | - Aaron Galaznik
- Medidata Solutions, a Dassault Systèmes Company, Boston, MA, USA
| | - Marc L Berger
- Medidata Solutions, a Dassault Systèmes Company, Boston, MA, USA
| | | |
Collapse
|
33
|
Valsamis EM, Prats-Uribe A, Koblbauer I, Cole S, Sayers A, Whitehouse MR, Coward G, Collins GS, Pinedo-Villanueva R, Prieto-Alhambra D, Rees JL. Reverse total shoulder replacement versus anatomical total shoulder replacement for osteoarthritis: population based cohort study using data from the National Joint Registry and Hospital Episode Statistics for England. BMJ 2024; 385:e077939. [PMID: 38688550 PMCID: PMC11058468 DOI: 10.1136/bmj-2023-077939] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Accepted: 03/07/2024] [Indexed: 05/02/2024]
Abstract
OBJECTIVES To answer a national research priority by comparing the risk-benefit and costs associated with reverse total shoulder replacement (RTSR) and anatomical total shoulder replacement (TSR) in patients having elective primary shoulder replacement for osteoarthritis. DESIGN Population based cohort study using data from the National Joint Registry and Hospital Episode Statistics for England. SETTING Public hospitals and publicly funded procedures at private hospitals in England, 2012-20. PARTICIPANTS Adults aged 60 years or older who underwent RTSR or TSR for osteoarthritis with intact rotator cuff tendons. Patients were identified from the National Joint Registry and linked to NHS Hospital Episode Statistics and civil registration mortality data. Propensity score matching and inverse probability of treatment weighting were used to balance the study groups. MAIN OUTCOME MEASURES The main outcome measure was revision surgery. Secondary outcome measures included serious adverse events within 90 days, reoperations within 12 months, prolonged hospital stay (more than three nights), change in Oxford Shoulder Score (preoperative to six month postoperative), and lifetime costs to the healthcare service. RESULTS The propensity score matched population comprised 7124 RTSR or TSR procedures (126 were revised), and the inverse probability of treatment weighted population comprised 12 968 procedures (294 were revised) with a maximum follow-up of 8.75 years. RTSR had a reduced hazard ratio of revision in the first three years (hazard ratio local minimum 0.33, 95% confidence interval 0.18 to 0.59) with no clinically important difference in revision-free restricted mean survival time, and a reduced relative risk of reoperations at 12 months (odds ratio 0.45, 95% confidence interval 0.25 to 0.83) with an absolute risk difference of -0.51% (95% confidence interval -0.89 to -0.13). Serious adverse events and prolonged hospital stay risks, change in Oxford Shoulder Score, and modelled mean lifetime costs were similar. Outcomes remained consistent after weighting. CONCLUSIONS This study's findings provide reassurance that RTSR is an acceptable alternative to TSR for patients aged 60 years or older with osteoarthritis and intact rotator cuff tendons. Despite a significant difference in the risk profiles of revision surgery over time, no statistically significant and clinically important differences between RTSR and TSR were found in terms of long term revision surgery, serious adverse events, reoperations, prolonged hospital stay, or lifetime healthcare costs.
Collapse
Affiliation(s)
- Epaminondas Markos Valsamis
- Botnar Research Centre, Nuffield Department of Orthopaedics, Rheumatology and Musculoskeletal Sciences, University of Oxford, Oxford, UK
- NIHR Oxford Biomedical Research Centre, Oxford, UK
| | - Albert Prats-Uribe
- NIHR Oxford Biomedical Research Centre, Oxford, UK
- Health Data Sciences, Nuffield Department of Orthopaedics, Rheumatology and Musculoskeletal Sciences, University of Oxford, Oxford, UK
| | - Ian Koblbauer
- NIHR Oxford Biomedical Research Centre, Oxford, UK
- Centre for Statistics in Medicine, Nuffield Department of Orthopaedics, Rheumatology and Musculoskeletal Sciences, University of Oxford, Oxford, UK
| | - Sophie Cole
- Botnar Research Centre, Nuffield Department of Orthopaedics, Rheumatology and Musculoskeletal Sciences, University of Oxford, Oxford, UK
- NIHR Oxford Biomedical Research Centre, Oxford, UK
| | - Adrian Sayers
- Musculoskeletal Research Unit, Bristol Medical School, Southmead Hospital, University of Bristol, Bristol, UK
| | - Michael R Whitehouse
- Musculoskeletal Research Unit, Bristol Medical School, Southmead Hospital, University of Bristol, Bristol, UK
- NIHR Bristol Biomedical Research Centre, Bristol, UK
| | - Gillian Coward
- National Joint Registry Research Committee, National Joint Registry, UK
| | - Gary S Collins
- NIHR Oxford Biomedical Research Centre, Oxford, UK
- Centre for Statistics in Medicine, Nuffield Department of Orthopaedics, Rheumatology and Musculoskeletal Sciences, University of Oxford, Oxford, UK
| | - Rafael Pinedo-Villanueva
- Botnar Research Centre, Nuffield Department of Orthopaedics, Rheumatology and Musculoskeletal Sciences, University of Oxford, Oxford, UK
- NIHR Oxford Biomedical Research Centre, Oxford, UK
| | - Daniel Prieto-Alhambra
- NIHR Oxford Biomedical Research Centre, Oxford, UK
- Health Data Sciences, Nuffield Department of Orthopaedics, Rheumatology and Musculoskeletal Sciences, University of Oxford, Oxford, UK
| | - Jonathan L Rees
- Botnar Research Centre, Nuffield Department of Orthopaedics, Rheumatology and Musculoskeletal Sciences, University of Oxford, Oxford, UK
- NIHR Oxford Biomedical Research Centre, Oxford, UK
| |
Collapse
|
34
|
Mercadé-Besora N, Li X, Kolde R, Trinh NT, Sanchez-Santos MT, Man WY, Roel E, Reyes C, Delmestri A, Nordeng HME, Uusküla A, Duarte-Salles T, Prats C, Prieto-Alhambra D, Jödicke AM, Català M. The role of COVID-19 vaccines in preventing post-COVID-19 thromboembolic and cardiovascular complications. Heart 2024; 110:635-643. [PMID: 38471729 DOI: 10.1136/heartjnl-2023-323483] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/23/2023] [Accepted: 12/13/2023] [Indexed: 03/14/2024] Open
Abstract
OBJECTIVE To study the association between COVID-19 vaccination and the risk of post-COVID-19 cardiac and thromboembolic complications. METHODS We conducted a staggered cohort study based on national vaccination campaigns using electronic health records from the UK, Spain and Estonia. Vaccine rollout was grouped into four stages with predefined enrolment periods. Each stage included all individuals eligible for vaccination, with no previous SARS-CoV-2 infection or COVID-19 vaccine at the start date. Vaccination status was used as a time-varying exposure. Outcomes included heart failure (HF), venous thromboembolism (VTE) and arterial thrombosis/thromboembolism (ATE) recorded in four time windows after SARS-CoV-2 infection: 0-30, 31-90, 91-180 and 181-365 days. Propensity score overlap weighting and empirical calibration were used to minimise observed and unobserved confounding, respectively.Fine-Gray models estimated subdistribution hazard ratios (sHR). Random effect meta-analyses were conducted across staggered cohorts and databases. RESULTS The study included 10.17 million vaccinated and 10.39 million unvaccinated people. Vaccination was associated with reduced risks of acute (30-day) and post-acute COVID-19 VTE, ATE and HF: for example, meta-analytic sHR of 0.22 (95% CI 0.17 to 0.29), 0.53 (0.44 to 0.63) and 0.45 (0.38 to 0.53), respectively, for 0-30 days after SARS-CoV-2 infection, while in the 91-180 days sHR were 0.53 (0.40 to 0.70), 0.72 (0.58 to 0.88) and 0.61 (0.51 to 0.73), respectively. CONCLUSIONS COVID-19 vaccination reduced the risk of post-COVID-19 cardiac and thromboembolic outcomes. These effects were more pronounced for acute COVID-19 outcomes, consistent with known reductions in disease severity following breakthrough versus unvaccinated SARS-CoV-2 infection.
Collapse
Affiliation(s)
- Núria Mercadé-Besora
- Pharmaco- and Device Epidemiology Group, Health Data Sciences, Botnar Research Centre, NDORMS, University of Oxford, Oxford, UK
- Department of Physics, Universitat Politècnica de Catalunya, Barcelona, Spain
- Fundació Institut Universitari per a la recerca a l'Atenció Primària de Salut Jordi Gol i Gurina (IDIAPJGol), IDIAP Jordi Gol, Barcelona, Catalunya, Spain
| | - Xintong Li
- Pharmaco- and Device Epidemiology Group, Health Data Sciences, Botnar Research Centre, NDORMS, University of Oxford, Oxford, UK
| | - Raivo Kolde
- Institute of Computer Science, University of Tartu, Tartu, Estonia
| | - Nhung Th Trinh
- Pharmacoepidemiology and Drug Safety Research Group, Department of Pharmacy, Faculty of Mathematics and Natural Sciences, University of Oslo, Oslo, Norway
| | - Maria T Sanchez-Santos
- Pharmaco- and Device Epidemiology Group, Health Data Sciences, Botnar Research Centre, NDORMS, University of Oxford, Oxford, UK
| | - Wai Yi Man
- Pharmaco- and Device Epidemiology Group, Health Data Sciences, Botnar Research Centre, NDORMS, University of Oxford, Oxford, UK
| | - Elena Roel
- Fundació Institut Universitari per a la recerca a l'Atenció Primària de Salut Jordi Gol i Gurina (IDIAPJGol), IDIAP Jordi Gol, Barcelona, Catalunya, Spain
| | - Carlen Reyes
- Fundació Institut Universitari per a la recerca a l'Atenció Primària de Salut Jordi Gol i Gurina (IDIAPJGol), IDIAP Jordi Gol, Barcelona, Catalunya, Spain
| | - Antonella Delmestri
- Pharmaco- and Device Epidemiology Group, Health Data Sciences, Botnar Research Centre, NDORMS, University of Oxford, Oxford, UK
| | - Hedvig M E Nordeng
- School of Pharmacy, University of Oslo, Oslo, Norway
- Division of Mental Health, Norwegian Institute of Public Health, Oslo, Norway
| | - Anneli Uusküla
- Department of Family Medicine and Public Health, University of Tartu, Tartu, Estonia
| | - Talita Duarte-Salles
- Fundació Institut Universitari per a la recerca a l'Atenció Primària de Salut Jordi Gol i Gurina (IDIAPJGol), IDIAP Jordi Gol, Barcelona, Catalunya, Spain
- Department of Medical Informatics, Erasmus University Medical Center, Erasmus University Rotterdam, Rotterdam, Zuid-Holland, Netherlands
| | - Clara Prats
- Department of Physics, Universitat Politècnica de Catalunya, Barcelona, Spain
| | - Daniel Prieto-Alhambra
- Pharmaco- and Device Epidemiology Group, Health Data Sciences, Botnar Research Centre, NDORMS, University of Oxford, Oxford, UK
- Department of Medical Informatics, Erasmus University Medical Center, Erasmus University Rotterdam, Rotterdam, Zuid-Holland, Netherlands
| | - Annika M Jödicke
- Pharmaco- and Device Epidemiology Group, Health Data Sciences, Botnar Research Centre, NDORMS, University of Oxford, Oxford, UK
| | - Martí Català
- Pharmaco- and Device Epidemiology Group, Health Data Sciences, Botnar Research Centre, NDORMS, University of Oxford, Oxford, UK
| |
Collapse
|
35
|
Bibbins-Domingo K, Flanagin A, Christiansen S, Park H, Curfman G. 2023 Year in Review and What's Ahead at JAMA. JAMA 2024; 331:1181-1184. [PMID: 38457136 DOI: 10.1001/jama.2024.3643] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 03/09/2024]
Affiliation(s)
| | | | | | - Hannah Park
- Managing Director of Strategy and Planning, JAMA and the JAMA Network
| | | |
Collapse
|
36
|
Data Errors. JAMA 2024; 331:1236. [PMID: 38592399 PMCID: PMC11004825 DOI: 10.1001/jama.2024.5022] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 04/10/2024]
|
37
|
Oyelese Y. Randomized controlled trials: not always the "gold standard" for evidence in obstetrics and gynecology. Am J Obstet Gynecol 2024; 230:417-425. [PMID: 37838101 DOI: 10.1016/j.ajog.2023.10.015] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/09/2023] [Revised: 09/20/2023] [Accepted: 10/07/2023] [Indexed: 10/16/2023]
Abstract
Randomized controlled trials are considered the "gold standard" for therapeutic interventions, and it is not uncommon for sweeping changes in medical practice to follow positive results from such trials. However, randomized controlled trials are not without their limitations. Physicians frequently view randomized controlled trials as infallible, whereas they tend to dismiss evidence derived from sources other than randomized controlled trials as less credible or reliable. In several situations in obstetrics and gynecology, there are no randomized controlled trials to help guide the clinician. In these circumstances, it is important to evaluate the entire body of evidence including observational studies, rather than dismiss interventions altogether simply because no randomized controlled trials exist. Randomized controlled trials and observational studies should be viewed as complementary rather than at odds with each other. Some reversals in widely adopted clinical practice have recently been implemented following subsequent studies that contradicted the outcomes of major randomized controlled trials. The most notable of these was the withdrawal from the market of 17-hydroxyprogesterone caproate for preterm birth prevention. Such reversals could potentially have been averted if the inherent limitations of randomized controlled trials were carefully considered before implementing these universal practice changes. This Clinical Opinion underscores the limitations of an exclusive reliance on randomized controlled trials while disregarding other evidence in determining how best to care for patients. Solutions are proposed that advocate that clinicians adopt a more balanced perspective that considers the entirety of the available medical evidence and the individual patient characteristics, needs, and wishes.
Collapse
Affiliation(s)
- Yinka Oyelese
- Division of Maternal-Fetal Medicine, Department of Obstetrics and Gynecology, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, MA; Maternal Fetal Care Center, Boston Children's Hospital, Harvard Medical School, Boston, MA.
| |
Collapse
|
38
|
Buka RJ, Sutton DJ, Nicolson PL. Enoxaparin is not an oral factor Xa inhibitor. Response to Sutton et al. real-world clinical outcomes among US veterans with oral factor Xa inhibitor-related major bleeding treated with andexanet alfa or 4-factor prothrombin complex concentrate. J Thromb Thrombolysis 2024; 57:739-741. [PMID: 38358568 DOI: 10.1007/s11239-024-02948-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Accepted: 01/04/2024] [Indexed: 02/16/2024]
Affiliation(s)
- Richard J Buka
- Institute of Cardiovascular Sciences, University of Birmingham, Birmingham, UK.
| | - David J Sutton
- Staffordshire Thrombosis and Anticoagulation Service, University Hospitals North Midlands NHS Trust, Stoke-on-Trent, UK
| | - Phillip Lr Nicolson
- Institute of Cardiovascular Sciences, University of Birmingham, Birmingham, UK
- Department of Clinical Haematology, University Hospitals Birmingham NHS Foundation Trust, Birmingham, UK
| |
Collapse
|
39
|
Suissa S. Observational studies to emulate randomized trials: Some real-world barriers. Br J Clin Pharmacol 2024; 90:1193-1198. [PMID: 38225188 DOI: 10.1111/bcp.15998] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/13/2023] [Revised: 12/19/2023] [Accepted: 12/29/2023] [Indexed: 01/17/2024] Open
Abstract
The randomized controlled trial (RCT) forms the basis for drug approval by regulatory agencies. Observational studies using existing data from healthcare databases now also provide real-world evidence (RWE) in regulatory decision-making. Several initiatives are assessing the value of RWE by conducting observational studies that emulate published RCTs. While many RCTs are straightforward to emulate, others are challenging. We describe three RCT design aspects that pose challenges for observational studies. First are trials that enrol already treated subjects who must discontinue these treatments at the time of randomization, which can distort the comparison with observational studies. Second is the inclusion of a run-in phase, especially to exclude non-compliant subjects from the trial. Third are trials that evaluate the effect of weaning off treatment. In conclusion, future randomized trials that aim to be emulated by observational studies could consider study designs that allow emulation and thus provide valid and complementary RWE.
Collapse
Affiliation(s)
- Samy Suissa
- Centre for Clinical Epidemiology, Lady Davis Institute-Jewish General Hospital, and Department of Epidemiology and Biostatistics, McGill University, Montreal, Québec, Canada
| |
Collapse
|
40
|
Liu J, Rowland‐Yeo K, Winterstein A, Dagenais S, Liu Q, Barrett JS, Zhu R, Ghobadi C, Datta‐Mannan A, Hsu J, Menon S, Ahmed M, Manchandani P, Ravenstijn P. Advancing the utilization of real-world data and real-world evidence in clinical pharmacology and translational research-Proceedings from the ASCPT 2023 preconference workshop. Clin Transl Sci 2024; 17:e13785. [PMID: 38572980 PMCID: PMC10993776 DOI: 10.1111/cts.13785] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/02/2024] [Revised: 03/08/2024] [Accepted: 03/10/2024] [Indexed: 04/05/2024] Open
Abstract
Real-world data (RWD) and real-world evidence (RWE) are now being routinely used in epidemiology, clinical practice, and post-approval regulatory decisions. Despite the increasing utility of the methodology and new regulatory guidelines in recent years, there remains a lack of awareness of how this approach can be applied in clinical pharmacology and translational research settings. Therefore, the American Society of Clinical Pharmacology & Therapeutics (ASCPT) held a workshop on March 21st, 2023 entitled "Advancing the Utilization of Real-World Data (RWD) and Real-World Evidence (RWE) in Clinical Pharmacology and Translational Research." The work described herein is a summary of the workshop proceedings.
Collapse
Affiliation(s)
| | | | | | | | - Qi Liu
- Office of Clinical Pharmacology, Office of Translational Sciences, CDER, U.S. FDASilver SpringMarylandUSA
| | | | - Rui Zhu
- Genentech, Inc.South San FranciscoCaliforniaUSA
| | | | | | - Joy Hsu
- Genentech, Inc.South San FranciscoCaliforniaUSA
| | | | | | | | | |
Collapse
|
41
|
Janda GS, Wallach JD, Ross JS. Hypothetical Assessments of Trial Emulations-Reply. JAMA Intern Med 2024; 184:446-447. [PMID: 38345787 DOI: 10.1001/jamainternmed.2023.7948] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 04/04/2024]
Affiliation(s)
| | - Joshua D Wallach
- Department of Epidemiology, Rollins School of Public Health, Emory University, Atlanta, Georgia
| | - Joseph S Ross
- Section of General Medicine and the National Clinician Scholars Program, Department of Internal Medicine, Yale School of Medicine, New Haven, Connecticut
- Center for Outcomes Research and Evaluation, Yale-New Haven Health System, New Haven, Connecticut
- Department of Health Policy and Management, Yale School of Public Health, New Haven, Connecticut
| |
Collapse
|
42
|
Schneeweiss S, Wang SV. Hypothetical Assessments of Trial Emulations. JAMA Intern Med 2024; 184:446. [PMID: 38345785 DOI: 10.1001/jamainternmed.2023.7945] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 04/04/2024]
Affiliation(s)
- Sebastian Schneeweiss
- Division of Pharmacoepidemiology and Pharmacoeconomics, Department of Medicine, Brigham and Women's Hospital, Boston, Massachusetts
- Harvard Medical School, Boston, Massachusetts
| | - Shirley V Wang
- Division of Pharmacoepidemiology and Pharmacoeconomics, Department of Medicine, Brigham and Women's Hospital, Boston, Massachusetts
- Harvard Medical School, Boston, Massachusetts
| |
Collapse
|
43
|
Bosch NA, Pereira TV, Teja B. Should Fludrocortisone be Added to Hydrocortisone in Septic Shock? Probably Yes, Based on Available Evidence. Crit Care Med 2024; 52:678-682. [PMID: 38483227 DOI: 10.1097/ccm.0000000000006207] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/24/2024]
Affiliation(s)
- Nicholas A Bosch
- The Pulmonary Center, Department of Medicine, Boston University Chobanian and Avedisian School of Medicine, Boston, MA
| | - Tiago V Pereira
- Clinical Trial Service Unit and Epidemiological Studies Unit (CTSU), Nuffield Department of Population Health, University of Oxford, Oxford, United Kingdom
| | - Bijan Teja
- The Pulmonary Center, Department of Medicine, Boston University Chobanian and Avedisian School of Medicine, Boston, MA
- Clinical Trial Service Unit and Epidemiological Studies Unit (CTSU), Nuffield Department of Population Health, University of Oxford, Oxford, United Kingdom
- Interdepartmental Division of Critical Care Medicine, University of Toronto, Toronto, ON, Canada
- Department of Anesthesiology and Pain Medicine, University of Toronto, Toronto, ON, Canada
- Department of Anesthesia, St. Michael's Hospital, Toronto, ON, Canada
| |
Collapse
|
44
|
El Emam K, Mosquera L, Fang X, El-Hussuna A. An evaluation of the replicability of analyses using synthetic health data. Sci Rep 2024; 14:6978. [PMID: 38521806 PMCID: PMC10960851 DOI: 10.1038/s41598-024-57207-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/11/2023] [Accepted: 03/15/2024] [Indexed: 03/25/2024] Open
Abstract
Synthetic data generation is being increasingly used as a privacy preserving approach for sharing health data. In addition to protecting privacy, it is important to ensure that generated data has high utility. A common way to assess utility is the ability of synthetic data to replicate results from the real data. Replicability has been defined using two criteria: (a) replicate the results of the analyses on real data, and (b) ensure valid population inferences from the synthetic data. A simulation study using three heterogeneous real-world datasets evaluated the replicability of logistic regression workloads. Eight replicability metrics were evaluated: decision agreement, estimate agreement, standardized difference, confidence interval overlap, bias, confidence interval coverage, statistical power, and precision (empirical SE). The analysis of synthetic data used a multiple imputation approach whereby up to 20 datasets were generated and the fitted logistic regression models were combined using combining rules for fully synthetic datasets. The effects of synthetic data amplification were evaluated, and two types of generative models were used: sequential synthesis using boosted decision trees and a generative adversarial network (GAN). Privacy risk was evaluated using a membership disclosure metric. For sequential synthesis, adjusted model parameters after combining at least ten synthetic datasets gave high decision and estimate agreement, low standardized difference, as well as high confidence interval overlap, low bias, the confidence interval had nominal coverage, and power close to the nominal level. Amplification had only a marginal benefit. Confidence interval coverage from a single synthetic dataset without applying combining rules were erroneous, and statistical power, as expected, was artificially inflated when amplification was used. Sequential synthesis performed considerably better than the GAN across multiple datasets. Membership disclosure risk was low for all datasets and models. For replicable results, the statistical analysis of fully synthetic data should be based on at least ten generated datasets of the same size as the original whose analyses results are combined. Analysis results from synthetic data without applying combining rules can be misleading. Replicability results are dependent on the type of generative model used, with our study suggesting that sequential synthesis has good replicability characteristics for common health research workloads.
Collapse
Affiliation(s)
- Khaled El Emam
- School of Epidemiology and Public Health, University of Ottawa, Ottawa, ON, Canada.
- Replica Analytics, Ottawa, ON, Canada.
- Children's Hospital of Eastern Ontario (CHEO) Research Institute, 401 Smyth Road, Ottawa, ON, K1H 8L1, Canada.
| | - Lucy Mosquera
- Replica Analytics, Ottawa, ON, Canada
- Children's Hospital of Eastern Ontario (CHEO) Research Institute, 401 Smyth Road, Ottawa, ON, K1H 8L1, Canada
| | - Xi Fang
- Replica Analytics, Ottawa, ON, Canada
| | | |
Collapse
|
45
|
Keenan BT, Magalang UJ, Maislin G. Pro: Comparing adherent to non-adherent patients can provide useful estimates of the effect of CPAP on cardiovascular outcomes. Sleep 2024:zsae064. [PMID: 38452013 DOI: 10.1093/sleep/zsae064] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/13/2023] [Indexed: 03/09/2024] Open
Affiliation(s)
- Brendan T Keenan
- Division of Sleep Medicine, Department of Medicine, University of Pennsylvania Perelman School of Medicine, Philadelphia, PA, USA
| | - Ulysses J Magalang
- Division of Pulmonary, Critical Care and Sleep Medicine, Department of Internal Medicine, The Ohio State University Wexner Medical Center, Columbus, OH, USA
| | - Greg Maislin
- Division of Sleep Medicine, Department of Medicine, University of Pennsylvania Perelman School of Medicine, Philadelphia, PA, USA
| |
Collapse
|
46
|
Al-Yousif N, Nouraie SM, Broerman MJ, Zhang Y, Suber TL, Evankovich J, Bain WG, Kitsios GD, McVerry BJ, Shah FA. Glucocorticoid use in acute respiratory failure from pulmonary causes and association with early changes in the systemic host immune response. Intensive Care Med Exp 2024; 12:24. [PMID: 38441708 PMCID: PMC10914652 DOI: 10.1186/s40635-024-00605-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/15/2023] [Accepted: 02/21/2024] [Indexed: 03/08/2024] Open
Abstract
BACKGROUND Glucocorticoids are commonly used in patients with or at-risk for acute respiratory distress syndrome (ARDS), but optimal use remains unclear despite well-conducted clinical trials. We performed a secondary analysis in patients previously enrolled in the Acute Lung Injury and Biospecimen Repository at the University of Pittsburgh. The primary aim of our study was to investigate early changes in host response biomarkers in response to real-world use of glucocorticoids in patients with acute respiratory failure due to ARDS or at-risk due to a pulmonary insult. Participants had baseline plasma samples obtained on study enrollment and on follow-up 3 to 5 days later to measure markers of innate immunity (IL-6, IL-8, IL-10, TNFr1, ST2, fractalkine), epithelial injury (sRAGE), endothelial injury (angiopoietin-2), and host response to bacterial infections (procalcitonin, pentraxin-3). In our primary analyses, we investigated the effect of receiving glucocorticoids between baseline and follow-up samples on host response biomarkers measured at follow-up by doubly robust inverse probability weighting analysis. In exploratory analyses, we examined associations between glucocorticoid use and previously characterized host response subphenotypes (hyperinflammatory and hypoinflammatory). RESULTS 67 of 148 participants (45%) received glucocorticoids between baseline and follow-up samples. Dose and type of glucocorticoids varied. Regimens that used hydrocortisone alone were most common (37%), and median daily dose was equivalent to 40 mg methylprednisolone (interquartile range: 21, 67). Participants who received glucocorticoids were more likely to be female, to be on immunosuppressive therapy at baseline, and to have higher baseline levels of ST-2, fractalkine, IL-10, pentraxin-3, sRAGE, and TNFr1. Glucocorticoid use was associated with decreases in IL-6 and increases in fractalkine. In exploratory analyses, glucocorticoid use was more frequent in participants in the hyperinflammatory subphenotype (58% vs 40%, p = 0.05), and was not associated with subphenotype classification at the follow-up time point (p = 0.16). CONCLUSIONS Glucocorticoid use varied in a cohort of patients with or at-risk for ARDS and was associated with early changes in the systemic host immune response.
Collapse
Affiliation(s)
- Nameer Al-Yousif
- Division of Pulmonary, Critical Care, and Sleep Medicine, MetroHealth Medical Center, Cleveland, OH, USA
| | - Seyed M Nouraie
- Division of Pulmonary, Allergy, Critical Care, and Sleep Medicine, University of Pittsburgh School of Medicine, 3459 Fifth Avenue, UPMC Montefiore NW 628, Pittsburgh, PA, 15213, USA
- Acute Lung Injury and Infection Center, University of Pittsburgh School of Medicine, 3459 Fifth Avenue, UPMC Montefiore NW 628, Pittsburgh, PA, 15213, USA
| | - Matthew J Broerman
- Division of Pulmonary, Allergy, Critical Care, and Sleep Medicine, University of Pittsburgh School of Medicine, 3459 Fifth Avenue, UPMC Montefiore NW 628, Pittsburgh, PA, 15213, USA
| | - Yingze Zhang
- Division of Pulmonary, Allergy, Critical Care, and Sleep Medicine, University of Pittsburgh School of Medicine, 3459 Fifth Avenue, UPMC Montefiore NW 628, Pittsburgh, PA, 15213, USA
| | - Tomeka L Suber
- Division of Pulmonary, Allergy, Critical Care, and Sleep Medicine, University of Pittsburgh School of Medicine, 3459 Fifth Avenue, UPMC Montefiore NW 628, Pittsburgh, PA, 15213, USA
- Acute Lung Injury and Infection Center, University of Pittsburgh School of Medicine, 3459 Fifth Avenue, UPMC Montefiore NW 628, Pittsburgh, PA, 15213, USA
| | - John Evankovich
- Division of Pulmonary, Allergy, Critical Care, and Sleep Medicine, University of Pittsburgh School of Medicine, 3459 Fifth Avenue, UPMC Montefiore NW 628, Pittsburgh, PA, 15213, USA
- Acute Lung Injury and Infection Center, University of Pittsburgh School of Medicine, 3459 Fifth Avenue, UPMC Montefiore NW 628, Pittsburgh, PA, 15213, USA
- Aging Institute, University of Pittsburgh School of Medicine, 3459 Fifth Avenue, UPMC Montefiore NW 628, Pittsburgh, PA, 15213, USA
| | - William G Bain
- Division of Pulmonary, Allergy, Critical Care, and Sleep Medicine, University of Pittsburgh School of Medicine, 3459 Fifth Avenue, UPMC Montefiore NW 628, Pittsburgh, PA, 15213, USA
- Acute Lung Injury and Infection Center, University of Pittsburgh School of Medicine, 3459 Fifth Avenue, UPMC Montefiore NW 628, Pittsburgh, PA, 15213, USA
- Veteran's Affairs Pittsburgh Healthcare System, Pittsburgh, PA, USA
| | - Georgios D Kitsios
- Division of Pulmonary, Allergy, Critical Care, and Sleep Medicine, University of Pittsburgh School of Medicine, 3459 Fifth Avenue, UPMC Montefiore NW 628, Pittsburgh, PA, 15213, USA
- Acute Lung Injury and Infection Center, University of Pittsburgh School of Medicine, 3459 Fifth Avenue, UPMC Montefiore NW 628, Pittsburgh, PA, 15213, USA
- Center for Medicine and the Microbiome, University of Pittsburgh School of Medicine, 3459 Fifth Avenue, UPMC Montefiore NW 628, Pittsburgh, PA, 15213, USA
| | - Bryan J McVerry
- Division of Pulmonary, Allergy, Critical Care, and Sleep Medicine, University of Pittsburgh School of Medicine, 3459 Fifth Avenue, UPMC Montefiore NW 628, Pittsburgh, PA, 15213, USA
- Acute Lung Injury and Infection Center, University of Pittsburgh School of Medicine, 3459 Fifth Avenue, UPMC Montefiore NW 628, Pittsburgh, PA, 15213, USA
- Center for Medicine and the Microbiome, University of Pittsburgh School of Medicine, 3459 Fifth Avenue, UPMC Montefiore NW 628, Pittsburgh, PA, 15213, USA
| | - Faraaz A Shah
- Division of Pulmonary, Allergy, Critical Care, and Sleep Medicine, University of Pittsburgh School of Medicine, 3459 Fifth Avenue, UPMC Montefiore NW 628, Pittsburgh, PA, 15213, USA.
- Acute Lung Injury and Infection Center, University of Pittsburgh School of Medicine, 3459 Fifth Avenue, UPMC Montefiore NW 628, Pittsburgh, PA, 15213, USA.
- Veteran's Affairs Pittsburgh Healthcare System, Pittsburgh, PA, USA.
| |
Collapse
|
47
|
Moir J, Hyman MJ, Gonnah R, Flores A, Hariprasad SM, Skondra D. The Association Between Metformin Use and New-Onset ICD Coding of Geographic Atrophy. Invest Ophthalmol Vis Sci 2024; 65:23. [PMID: 38497512 PMCID: PMC10950036 DOI: 10.1167/iovs.65.3.23] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/13/2023] [Accepted: 02/29/2024] [Indexed: 03/19/2024] Open
Abstract
Purpose Metformin has been suggested to protect against the development of age-related macular degeneration (AMD) in multiple observational studies. However, the association between metformin and geographic atrophy (GA), a debilitating subtype of AMD, has not been analyzed. Methods We conducted a case-control study of patients ages 60 years and older with new-onset International Classification of Diseases (ICD) coding of GA in the Merative MarketScan Commercial and Medicare Databases between 2017 and 2021. Cases were matched with propensity scores estimated by age, region, hypertension, and Charlson Comorbidity Index to a control without GA of the same year. Exposure to metformin was assessed for cases and controls in the year prior to their index visit. Conditional multivariable logistic regression, adjusting for AMD risk factors, was used to calculate odd ratios and 95% confidence intervals (CIs). This study design and analysis were repeated in a sample of patients without diabetes. Results In the full sample, we identified 10,505 cases with GA and 10,502 matched controls without GA. In total, 1149 (10.9%) cases and 1277 (12.2%) controls were exposed to metformin, and in multivariable regression, metformin decreased the odds of new-onset ICD coding of GA by 12% (95% CI, 0.79-0.99). In the sample of patients without diabetes, we identified 7611 cases with GA and 7608 matched controls without GA. Twenty-nine (0.4%) cases and 63 (0.8%) controls were exposed to metformin, and in multivariable regression, metformin decreased the odds of new-onset ICD coding of GA by 47% (95% CI, 0.33-0.83). Conclusions Metformin may hold promise as a noninvasive, alternative agent to prevent the development of GA. This finding is notable due to shortcomings in recently approved therapeutics for GA and metformin's overall ease of use and few adverse effects. Additional studies are required to explore our findings further and motivate a clinical trial.
Collapse
Affiliation(s)
- John Moir
- Pritzker School of Medicine, University of Chicago, Chicago, Illinois, United States
| | - Max J. Hyman
- The Center for Health and the Social Sciences, University of Chicago, Chicago, Illinois, United States
| | - Reem Gonnah
- Department of Ophthalmology and Visual Science, University of Chicago, Chicago, Illinois, United States
| | - Andrea Flores
- The Center for Health and the Social Sciences, University of Chicago, Chicago, Illinois, United States
| | - Seenu M. Hariprasad
- Department of Ophthalmology and Visual Science, University of Chicago, Chicago, Illinois, United States
| | - Dimitra Skondra
- Department of Ophthalmology and Visual Science, University of Chicago, Chicago, Illinois, United States
| |
Collapse
|
48
|
Muntner P, Hernandez RK, Kent ST, Browning JE, Gilbertson DT, Hurwitz KE, Jick SS, Lai EC, Lash TL, Monda KL, Rothman KJ, Bradbury BD, Brookhart MA. Staging and clean room: Constructs designed to facilitate transparency and reduce bias in comparative analyses of real-world data. Pharmacoepidemiol Drug Saf 2024; 33:e5770. [PMID: 38419140 DOI: 10.1002/pds.5770] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/03/2023] [Revised: 01/29/2024] [Accepted: 01/30/2024] [Indexed: 03/02/2024]
Abstract
PURPOSE We describe constructs designed to protect the integrity of the results from comparative analyses using real-world data (RWD): staging and clean room. METHODS Staging involves performing sequential preliminary analyses and evaluating the population size available and potential bias before conducting comparative analyses. A clean room involves restricted access to data and preliminary results, policies governing exploratory analyses and protocol deviations, and audit trail. These constructs are intended to allow decisions about protocol deviations, such as changes to design or model specification, to be made without knowledge of how they might affect subsequent analyses. We describe an example for implementing staging with a clean room. RESULTS Stage 1 may involve selecting a data source, developing and registering a protocol, establishing a clean room, and applying inclusion/exclusion criteria. Stage 2 may involve attempting to achieve covariate balance, often through propensity score models. Stage 3 may involve evaluating the presence of residual confounding using negative control outcomes. After each stage, check points may be implemented when a team of statisticians, epidemiologists and clinicians masked to how their decisions may affect study outcomes, reviews the results. This review team may be tasked with making recommendations for protocol deviations to address study precision or bias. They may recommend proceeding to the next stage, conducting additional analyses to address bias, or terminating the study. Stage 4 may involve conducting the comparative analyses. CONCLUSIONS The staging and clean room constructs are intended to protect the integrity and enhance confidence in the results of analyses of RWD.
Collapse
Affiliation(s)
- Paul Muntner
- Department of Epidemiology, School of Public Health, University of Alabama at Birmingham, Birmingham, Alabama, USA
| | - Rohini K Hernandez
- Center for Observational Research, Amgen Inc., Thousand Oaks, California, USA
| | - Shia T Kent
- Center for Observational Research, Amgen Inc., Thousand Oaks, California, USA
| | - James E Browning
- Center for Observational Research, Amgen Inc., Thousand Oaks, California, USA
| | - David T Gilbertson
- Chronic Disease Research Group, Hennepin Healthcare Research Institute, Minneapolis, Minnesota, USA
| | | | - Susan S Jick
- Boston Collaborative Drug Surveillance Program, Boston University School of Public Health, Boston, Massachusetts, USA
| | - Edward C Lai
- School of Pharmacy, Institute of Clinical Pharmacy and Pharmaceutical Sciences, College of Medicine, National Cheng Kung University, Tainan, Taiwan
| | - Timothy L Lash
- Department of Epidemiology, Rollins School of Public Health, Emory University, Atlanta, Georgia, USA
| | - Keri L Monda
- Center for Observational Research, Amgen Inc., Thousand Oaks, California, USA
| | - Kenneth J Rothman
- RTI Health Solutions, Research Triangle Institute, Research Triangle Park, North Carolina, USA
- Department of Epidemiology, Boston University School of Public Health, Boston, Massachusetts, USA
| | - Brian D Bradbury
- Center for Observational Research, Amgen Inc., Thousand Oaks, California, USA
| | - M Alan Brookhart
- Department of Population Health Sciences, Duke University, Durham, North Carolina, USA
| |
Collapse
|
49
|
Hartl WH, Kopper P, Xu L, Heller L, Mironov M, Wang R, Day AG, Elke G, Küchenhoff H, Bender A. Relevance of Protein Intake for Weaning in the Mechanically Ventilated Critically Ill: Analysis of a Large International Database. Crit Care Med 2024; 52:e121-e131. [PMID: 38156913 PMCID: PMC10876180 DOI: 10.1097/ccm.0000000000006155] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/03/2024]
Abstract
OBJECTIVES The association between protein intake and the need for mechanical ventilation (MV) is controversial. We aimed to investigate the associations between protein intake and outcomes in ventilated critically ill patients. DESIGN Analysis of a subset of a large international point prevalence survey of nutritional practice in ICUs. SETTING A total of 785 international ICUs. PATIENTS A total of 12,930 patients had been in the ICU for at least 96 hours and required MV by the fourth day after ICU admission at the latest. INTERVENTIONS None. MEASUREMENTS AND MAIN RESULTS We modeled associations between the adjusted hazard rate (aHR) of death in patients requiring MV and successful weaning (competing risks), and three categories of protein intake (low: < 0.8 g/kg/d, standard: 0.8-1.2 g/kg/d, high: > 1.2 g/kg/d). We compared five different hypothetical protein diets (an exclusively low protein intake, a standard protein intake given early (days 1-4) or late (days 5-11) after ICU admission, and an early or late high protein intake). There was no evidence that the level of protein intake was associated with time to weaning. However, compared with an exclusively low protein intake, a standard protein intake was associated with a lower hazard of death in MV: minimum aHR 0.60 (95% CI, 0.45-0.80). With an early high intake, there was a trend to a higher risk of death in patients requiring MV: maximum aHR 1.35 (95% CI, 0.99-1.85) compared with a standard diet. CONCLUSIONS The duration of MV does not appear to depend on protein intake, whereas mortality in patients requiring MV may be improved by a standard protein intake. Adverse effects of a high protein intake cannot be excluded.
Collapse
Affiliation(s)
- Wolfgang H Hartl
- Department of General, Visceral, and Transplantation Surgery, University Medical Center, Campus Grosshadern, LMU Munich, Munich, Germany
| | - Philipp Kopper
- Statistical Consulting Unit, StaBLab, Department of Statistics, LMU Munich, Munich, Germany
- Munich Center for Machine Learning, LMU Munich, Munich, Germany
| | - Lisa Xu
- Statistical Consulting Unit, StaBLab, Department of Statistics, LMU Munich, Munich, Germany
| | - Luca Heller
- Statistical Consulting Unit, StaBLab, Department of Statistics, LMU Munich, Munich, Germany
| | - Maxim Mironov
- Statistical Consulting Unit, StaBLab, Department of Statistics, LMU Munich, Munich, Germany
| | - Ruiyi Wang
- Statistical Consulting Unit, StaBLab, Department of Statistics, LMU Munich, Munich, Germany
| | - Andrew G Day
- Clinical Evaluation Research Unit, Kingston Health Sciences Centre, Kingston, ON, Canada
| | - Gunnar Elke
- Department of Anaesthesiology and Intensive Care Medicine, University Medical Center Schleswig-Holstein, Campus Kiel, Kiel, Germany
| | - Helmut Küchenhoff
- Statistical Consulting Unit, StaBLab, Department of Statistics, LMU Munich, Munich, Germany
| | - Andreas Bender
- Statistical Consulting Unit, StaBLab, Department of Statistics, LMU Munich, Munich, Germany
- Munich Center for Machine Learning, LMU Munich, Munich, Germany
| |
Collapse
|
50
|
Thorlund K, Shephard C, Machado L, Bourgouin T, Hudson L, Ting E, Dempster W, Bick R. Adapting Health Technology Assessment agency standards for surrogate outcomes in early stage cancer trials: what needs to happen? Expert Rev Pharmacoecon Outcomes Res 2024; 24:331-342. [PMID: 38189086 DOI: 10.1080/14737167.2024.2302431] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/07/2023] [Accepted: 01/03/2024] [Indexed: 01/09/2024]
Abstract
INTRODUCTION An avalanche of early stage cancer clinical trials is coming. The majority of these solely use surrogate outcomes that have not been validated against a target outcome of interest (e.g. overall survival). Current HTA guidance on surrogate outcome validation are not methodologically or practically conducive to this scenario. AREAS COVERED We provide a high-level overview of methods, approaches, and conceptual thinking for making better use of limited evidence within early stage cancer HTA submissions. We outline regulatory and HTA issues and emphasize how evidence transitions from one to another, what major gaps currently exist, and how these may be bridged. We summarize current methodologies and practices, their pros and cons. We outline how complementary measurements strengthen evaluations and address fallacies and biases of conventional statistical methods for surrogate outcomes validation. The value of real-world data to support some of the necessary validity components is discussed. Lastly, we address the importance of the patient voice for better understanding which surrogate outcomes may appropriately inform HTA. EXPERT OPINION Conventional surrogate outcome validation represents a fraught and sub-optimal framework for HTA purposes, particularly for early stage cancer. Tools for optimizing use of limited evidence exist. Education of stakeholders is highly needed.
Collapse
Affiliation(s)
- Kristian Thorlund
- Department of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, Ontario, Canada
| | - Cal Shephard
- AstraZeneca Canada, Mississauga, Ontario, Canada
| | | | | | | | - Eon Ting
- AstraZeneca Canada, Mississauga, Ontario, Canada
| | | | - Robert Bick
- The CanCertainty Coalition, Toronto, Ontario, Canada
| |
Collapse
|