1
|
Hebdon R, Stamey J, Kahle D, Zhang X. unmconf : an R package for Bayesian regression with unmeasured confounders. BMC Med Res Methodol 2024; 24:195. [PMID: 39244581 PMCID: PMC11380322 DOI: 10.1186/s12874-024-02322-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/19/2024] [Accepted: 08/27/2024] [Indexed: 09/09/2024] Open
Abstract
The inability to correctly account for unmeasured confounding can lead to bias in parameter estimates, invalid uncertainty assessments, and erroneous conclusions. Sensitivity analysis is an approach to investigate the impact of unmeasured confounding in observational studies. However, the adoption of this approach has been slow given the lack of accessible software. An extensive review of available R packages to account for unmeasured confounding list deterministic sensitivity analysis methods, but no R packages were listed for probabilistic sensitivity analysis. The R package unmconf implements the first available package for probabilistic sensitivity analysis through a Bayesian unmeasured confounding model. The package allows for normal, binary, Poisson, or gamma responses, accounting for one or two unmeasured confounders from the normal or binomial distribution. The goal of unmconf is to implement a user friendly package that performs Bayesian modeling in the presence of unmeasured confounders, with simple commands on the front end while performing more intensive computation on the back end. We investigate the applicability of this package through novel simulation studies. The results indicate that credible intervals will have near nominal coverage probability and smaller bias when modeling the unmeasured confounder(s) for varying levels of internal/external validation data across various combinations of response-unmeasured confounder distributional families.
Collapse
Affiliation(s)
- Ryan Hebdon
- Department of Statistical Science, Baylor University, Waco, TX, USA.
| | - James Stamey
- Department of Statistical Science, Baylor University, Waco, TX, USA
| | - David Kahle
- Department of Statistical Science, Baylor University, Waco, TX, USA
| | - Xiang Zhang
- CSL Behring, CSL Limited, King of Prussia, PA, USA
| |
Collapse
|
2
|
Levenson M, He W, Chen J, Fang Y, Faries D, Goldstein BA, Ho M, Lee K, Mishra-Kalyani P, Rockhold F, Wang H, Zink RC. Biostatistical Considerations When Using RWD and RWE in Clinical Studies for Regulatory Purposes: A Landscape Assessment. Stat Biopharm Res 2021. [DOI: 10.1080/19466315.2021.1883473] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/08/2023]
Affiliation(s)
| | - Weili He
- Global Medical Affairs Statistics, Data and Statistical Sciences, AbbVie, North Chicago, IL
| | - Jie Chen
- Overland Pharmaceuticals, Dover, DE
| | - Yixin Fang
- Global Medical Affairs Statistics, Data and Statistical Sciences, AbbVie, North Chicago, IL
| | - Douglas Faries
- Global Statistical Sciences, Eli Lilly & Company, Indianapolis, IN
| | - Benjamin A. Goldstein
- Department of Biostatistics & Bioinformatics, Duke University, Durham, NC
- Duke Clinical Research Institute, Duke University, Durham, NC
| | | | - Kwan Lee
- Statistics and Decision Sciences, Janssen Research and Development (retired), Spring House, PA
| | | | - Frank Rockhold
- Department of Biostatistics & Bioinformatics, Duke University, Durham, NC
- Duke Clinical Research Institute, Duke University, Durham, NC
| | - Hongwei Wang
- Global Medical Affairs Statistics, Data and Statistical Sciences, AbbVie, North Chicago, IL
| | | |
Collapse
|
5
|
Guertin JR, Bowen JM, De Rose G, O'Reilly DJ, Tarride JE. Illustration of the Impact of Unmeasured Confounding Within an Economic Evaluation Based on Nonrandomized Data. MDM Policy Pract 2017; 2:2381468317697711. [PMID: 30288418 PMCID: PMC6124939 DOI: 10.1177/2381468317697711] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/09/2016] [Accepted: 02/02/2017] [Indexed: 11/17/2022] Open
Abstract
Background: Propensity score (PS) methods are frequently used
within economic evaluations based on nonrandomized data to adjust for measured
confounders, but many researchers omit the fact that they cannot adjust for
unmeasured confounders. Objective: To illustrate how confounding
due to unmeasured confounders can bias an economic evaluation despite PS
matching. Methods: We used data from a previously published
nonrandomized study to select a prematched population consisting of 121 patients
(46.5%) who received endovascular aneurysm repair (EVAR) and 139 patients
(53.5%) who received open surgical repair (OSR), in which sufficient data
regarding eight measured confounders were available. One-to-one PS matching was
used within this population to select two PS-matched subpopulations. The Matched
PS-Smoking Excluded Subpopulation was selected by matching patients using a PS
model that omitted patients’ smoking status (one of the measured confounders),
whereas the Matched PS-Smoking Included Subpopulation was selected by matching
patients using a PS model that included all eight measured confounders.
Incremental cost-effectiveness ratios (ICERs) were assessed within both
subpopulations. Results: Both subpopulations were composed of two
different sets of 164 patients. Balance within the Matched PS-Smoking Excluded
Subpopulation was achieved on all confounders except for patients’ smoking
status, whereas balance within the Matched PS-Smoking Included Subpopulation was
achieved on all confounders. Results indicated that the ICER of EVAR over OSR
differed between both subpopulations; the ICER was estimated at $157,909 per
life-year gained (LYG) within the Matched PS-Smoking Excluded Subpopulation,
while it was estimated at $235,074 per LYG within the Matched PS-Smoking
Included Subpopulation. Discussion: Although effective in
controlling for measured confounding, PS matching may not adjust for unmeasured
confounders that may bias the results of an economic evaluation based on
nonrandomized data.
Collapse
Affiliation(s)
- Jason R Guertin
- Programs for Assessment of Technology in Health, The Research Institute of St. Joe's Hamilton, St. Joseph's Healthcare Hamilton, Hamilton, Ontario, Canada (JRG, JMB, DJO, JT).,Department of Health Research Methods, Evidence, and Impact, Faculty of Health Sciences, McMaster University, Hamilton, Ontario, Canada (JRG, JMB, DJO, JT).,Department of Social and Preventive Medicine, Université Laval, Quebec City, Quebec, Canada (JRG).,Centre de recherche du CHU de Québec-Université Laval, Axe Santé des Populations et Pratiques Optimales en Santé, Hôpital du St-Sacrement, Quebec City, Quebec, Canada (JRG).,Division of Vascular Surgery, Department of Surgery, London Health Sciences Centre, London, Ontario, Canada (GDR).,Division of Vascular Surgery, Department of Surgery, Faculty of Medicine, Western University, London, Ontario, Canada (GDR)
| | - James M Bowen
- Programs for Assessment of Technology in Health, The Research Institute of St. Joe's Hamilton, St. Joseph's Healthcare Hamilton, Hamilton, Ontario, Canada (JRG, JMB, DJO, JT).,Department of Health Research Methods, Evidence, and Impact, Faculty of Health Sciences, McMaster University, Hamilton, Ontario, Canada (JRG, JMB, DJO, JT).,Department of Social and Preventive Medicine, Université Laval, Quebec City, Quebec, Canada (JRG).,Centre de recherche du CHU de Québec-Université Laval, Axe Santé des Populations et Pratiques Optimales en Santé, Hôpital du St-Sacrement, Quebec City, Quebec, Canada (JRG).,Division of Vascular Surgery, Department of Surgery, London Health Sciences Centre, London, Ontario, Canada (GDR).,Division of Vascular Surgery, Department of Surgery, Faculty of Medicine, Western University, London, Ontario, Canada (GDR)
| | - Guy De Rose
- Programs for Assessment of Technology in Health, The Research Institute of St. Joe's Hamilton, St. Joseph's Healthcare Hamilton, Hamilton, Ontario, Canada (JRG, JMB, DJO, JT).,Department of Health Research Methods, Evidence, and Impact, Faculty of Health Sciences, McMaster University, Hamilton, Ontario, Canada (JRG, JMB, DJO, JT).,Department of Social and Preventive Medicine, Université Laval, Quebec City, Quebec, Canada (JRG).,Centre de recherche du CHU de Québec-Université Laval, Axe Santé des Populations et Pratiques Optimales en Santé, Hôpital du St-Sacrement, Quebec City, Quebec, Canada (JRG).,Division of Vascular Surgery, Department of Surgery, London Health Sciences Centre, London, Ontario, Canada (GDR).,Division of Vascular Surgery, Department of Surgery, Faculty of Medicine, Western University, London, Ontario, Canada (GDR)
| | - Daria J O'Reilly
- Programs for Assessment of Technology in Health, The Research Institute of St. Joe's Hamilton, St. Joseph's Healthcare Hamilton, Hamilton, Ontario, Canada (JRG, JMB, DJO, JT).,Department of Health Research Methods, Evidence, and Impact, Faculty of Health Sciences, McMaster University, Hamilton, Ontario, Canada (JRG, JMB, DJO, JT).,Department of Social and Preventive Medicine, Université Laval, Quebec City, Quebec, Canada (JRG).,Centre de recherche du CHU de Québec-Université Laval, Axe Santé des Populations et Pratiques Optimales en Santé, Hôpital du St-Sacrement, Quebec City, Quebec, Canada (JRG).,Division of Vascular Surgery, Department of Surgery, London Health Sciences Centre, London, Ontario, Canada (GDR).,Division of Vascular Surgery, Department of Surgery, Faculty of Medicine, Western University, London, Ontario, Canada (GDR)
| | - Jean-Eric Tarride
- Programs for Assessment of Technology in Health, The Research Institute of St. Joe's Hamilton, St. Joseph's Healthcare Hamilton, Hamilton, Ontario, Canada (JRG, JMB, DJO, JT).,Department of Health Research Methods, Evidence, and Impact, Faculty of Health Sciences, McMaster University, Hamilton, Ontario, Canada (JRG, JMB, DJO, JT).,Department of Social and Preventive Medicine, Université Laval, Quebec City, Quebec, Canada (JRG).,Centre de recherche du CHU de Québec-Université Laval, Axe Santé des Populations et Pratiques Optimales en Santé, Hôpital du St-Sacrement, Quebec City, Quebec, Canada (JRG).,Division of Vascular Surgery, Department of Surgery, London Health Sciences Centre, London, Ontario, Canada (GDR).,Division of Vascular Surgery, Department of Surgery, Faculty of Medicine, Western University, London, Ontario, Canada (GDR)
| |
Collapse
|
9
|
Girman CJ, Faries D, Ryan P, Rotelli M, Belger M, Binkowitz B, O’Neill R. Pre-study feasibility and identifying sensitivity analyses for protocol pre-specification in comparative effectiveness research. J Comp Eff Res 2014; 3:259-70. [DOI: 10.2217/cer.14.16] [Citation(s) in RCA: 14] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/21/2022] Open
Abstract
The use of healthcare databases for comparative effectiveness research (CER) is increasing exponentially despite its challenges. Researchers must understand their data source and whether outcomes, exposures and confounding factors are captured sufficiently to address the research question. They must also assess whether bias and confounding can be adequately minimized. Many study design characteristics may impact on the results; however, minimal if any sensitivity analyses are typically conducted, and those performed are post hoc. We propose pre-study steps for CER feasibility assessment and to identify sensitivity analyses that might be most important to pre-specify to help ensure that CER produces valid interpretable results.
Collapse
Affiliation(s)
- Cynthia J Girman
- Comparative & Outcomes Evidence, Center for Observational & Real-world Evidence, Merck Sharp & Dohme, North Wales, PA 19454, USA
| | - Douglas Faries
- Global Statistical Sciences, Eli Lilly & Company, Indianapolis, IN, USA & UK
| | - Patrick Ryan
- Epidemiology Analytics, Janssen Research & Development, Titusville, NJ, USA
| | - Matt Rotelli
- Global PK/PD & Pharmacometrics, Eli Lilly & Company, Indianapolis, IN, USA
| | - Mark Belger
- Global Statistical Sciences, Eli Lilly & Company, Indianapolis, IN, USA & UK
| | - Bruce Binkowitz
- Late Development Statistics, Merck Sharp & Dohme, Rahway, NJ, USA
| | - Robert O’Neill
- The Office of Translational Sciences, CDER, US Food & Drug Administration, Rockville, MD, USA
| | | |
Collapse
|