1
|
Orihara S, Goto A, Taguri M. Valid instrumental variable selection method using negative control outcomes and constructing efficient estimator. Biom J 2024; 66:e2300113. [PMID: 38801216 DOI: 10.1002/bimj.202300113] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/22/2023] [Revised: 02/29/2024] [Accepted: 03/18/2024] [Indexed: 05/29/2024]
Abstract
In observational studies, instrumental variable (IV) methods are commonly applied when there are unmeasured covariates. In Mendelian randomization, constructing an allele score using many single nucleotide polymorphisms is often implemented; however, estimating biased causal effects by including some invalid IVs poses some risks. Invalid IVs are those IV candidates that are associated with unobserved variables. To solve this problem, we developed a novel strategy using negative control outcomes (NCOs) as auxiliary variables. Using NCOs, we are able to select only valid IVs and exclude invalid IVs without knowing which of the instruments are invalid. We also developed a new two-step estimation procedure and proved the semiparametric efficiency of our estimator. The performance of our proposed method was superior to some previous methods through simulations. Subsequently, we applied the proposed method to the UK Biobank dataset. Our results demonstrate that the use of an auxiliary variable, such as an NCO, enables the selection of valid IVs with assumptions different from those used in previous methods.
Collapse
Affiliation(s)
- Shunichiro Orihara
- Department of Health Data Science, Tokyo Medical University, Tokyo, Japan
- Graduate School of Data Science, Yokohama City University, Kanagawa, Japan
| | - Atsushi Goto
- Graduate School of Data Science, Yokohama City University, Kanagawa, Japan
| | - Masataka Taguri
- Department of Health Data Science, Tokyo Medical University, Tokyo, Japan
- Graduate School of Data Science, Yokohama City University, Kanagawa, Japan
| |
Collapse
|
2
|
Jiang Z, Yang S, Ding P. Multiply robust estimation of causal effects under principal ignorability. J R Stat Soc Series B Stat Methodol 2022. [DOI: 10.1111/rssb.12538] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
Affiliation(s)
- Zhichao Jiang
- Department of Biostatistics and Epidemiology University of Massachusetts Amherst Massachusetts USA
| | - Shu Yang
- Department of Statistics North Carolina State University Raleigh North Carolina USA
| | - Peng Ding
- University of California, Berkeley Berkeley California USA
| |
Collapse
|
3
|
Branson Z, Keele L. Evaluating a Key Instrumental Variable Assumption Using Randomization Tests. Am J Epidemiol 2020; 189:1412-1420. [PMID: 32432319 DOI: 10.1093/aje/kwaa089] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/04/2019] [Revised: 05/12/2020] [Accepted: 05/13/2020] [Indexed: 11/14/2022] Open
Abstract
Instrumental variable (IV) analyses are becoming common in health services research and epidemiology. Most IV analyses use naturally occurring instruments, such as distance to a hospital. In these analyses, investigators must assume that the instrument is as-if randomly assigned. This assumption cannot be tested directly, but it can be falsified. Most IV falsification tests compare relative prevalence or bias in observed covariates between the instrument and exposure. These tests require investigators to make covariate-by-covariate judgments about the validity of the IV design. Often, only some covariates are well-balanced, making it unclear whether as-if randomization can be assumed for the instrument. We propose an alternative falsification test that compares IV balance or bias with the balance or bias that would have been produced under randomization. A key advantage of our test is that it allows for global balance measures as well as easily interpretable graphical comparisons. Furthermore, our test does not rely on parametric assumptions and can be used to validly assess whether the instrument is significantly closer to being as-if randomized than the exposure. We demonstrate our approach using data from (SPOT)light, a prospective cohort study carried out in 48 National Health Service hospitals in the United Kingdom between November 1, 2010, and December 31, 2011. This study used bed availability in the intensive care unit as an instrument for admission to the intensive care unit.
Collapse
|
4
|
Pimentel SD, Kelz RR. Optimal Tradeoffs in Matched Designs Comparing US-Trained and Internationally Trained Surgeons. J Am Stat Assoc 2020. [DOI: 10.1080/01621459.2020.1720693] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/25/2022]
Affiliation(s)
- Samuel D. Pimentel
- Department of Statistics, University of California, Berkeley, Berkeley, CA
| | - Rachel R. Kelz
- Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA
| |
Collapse
|
5
|
Does Transfer to Intensive Care Units Reduce Mortality? A Comparison of an Instrumental Variables Design to Risk Adjustment. Med Care 2020; 57:e73-e79. [PMID: 30830008 DOI: 10.1097/mlr.0000000000001093] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
Abstract
BACKGROUND Instrumental variable (IV) analysis can estimate treatment effects in the presence of residual or unmeasured confounding. In settings wherein measures of baseline risk severity are unavailable, IV designs are, therefore, particularly appealing, but, where established measures of risk severity are available, it is unclear whether IV methods are preferable. OBJECTIVE We compared regression with an IV design to estimate the effect of intensive care unit (ICU) transfer on mortality in a study with well-established measures of risk severity. RESEARCH DESIGN We use ICU bed availability at the time of assessment for ICU transfer as an instrument. Bed availability increases the chance of ICU admission, contains little information about patient characteristics, and it is unlikely that bed availability has any direct effect on in-hospital mortality. SUBJECTS We used a cohort study of deteriorating ward patients assessed for critical care unit admission, in 49 UK National Health Service hospitals between November 1, 2010, and December 31, 2011. MEASURES Detailed demographic, physiological, and comorbidity data were collected for all patients. RESULTS The risk adjustment methods reported that, after controlling for all measured covariates including measures of risk severity, ICU transfer was associated with higher 28-day mortality, with a risk difference of 7.2% (95% confidence interval=5.3%-9.1%). The IV estimate of ICU transfer was -5.4% (95% confidence interval=-47.1% to 36.3%) and applies to the subsample of patients whose transfer was "encouraged" by bed availability. CONCLUSIONS IV estimates indicate that ICU care is beneficial but are imprecisely estimated. Risk-adjusted estimates are more precise but, even with a rich set of covariates, report that ICU care is harmful.
Collapse
|
6
|
Harris RA, Kranzler HR, Chang KM, Doubeni CA, Gross R. Long-term use of hydrocodone vs. oxycodone in primary care. Drug Alcohol Depend 2019; 205:107524. [PMID: 31707268 PMCID: PMC9338763 DOI: 10.1016/j.drugalcdep.2019.06.026] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/09/2019] [Revised: 05/20/2019] [Accepted: 06/19/2019] [Indexed: 12/20/2022]
Abstract
BACKGROUND Hydrocodone and oxycodone are the Schedule II opioids most often prescribed in primary care. Notwithstanding the dangers of prescription opioid use, the likelihood of long-term use with either drug is presently unknown. METHODS Using a retrospective cohort design and data from a commerical healthcare claims repository, we compared the likelihood of long-term use of hydrocodone and oxycodone in primary care patients presenting with acute back pain. Treatment was categorized as long-term if the prescription dates spanned ≥90 days from initial prescription to the run-out date of the last prescription, and included ≥120 days' supply or ≥10 fills. Instrumental variable methods and probit regression were used to model the effect of drug choice on long-term use, estimate the average treatment effect, and correct for confounding by indication. RESULTS A total of 3,983 patients who were prescribed only hydrocodone or only oxycodone were followed for 270 days in 2016. Long-term opioid use was observed in 320 patients (8%). Controlling for potential confounders including morphine milligram equivalents and dosage, an estimated 12% (95 CI, 10%-14%) treated with hydrocodone transitioned to long-term use vs. 2% (95 CI, 1%-3%) on oxycodone. Among patients who received more than one prescription (n = 1,866), an estimated 23% (95 CI, 19%-26%) treated with hydrocodone transitioned to long-term use vs. 5% (95 CI, 3%-7%) on oxycodone. The difference between drugs was supported in sensitivity and subgroup analyses. Sample selection bias was not detected. CONCLUSIONS Long-term use was substantially greater for patients treated with hydrocodone than oxycodone, despite equianalgesia.
Collapse
Affiliation(s)
- Rebecca Arden Harris
- Department of Family Medicine and Community Health, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, United States.
| | - Henry R Kranzler
- Department of Psychiatry, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, United States; VISN 4 Mental Illness Research, Education and Clinical Center, The Corporal Michael Crescenz VA Medical Center, United States
| | - Kyong-Mi Chang
- Department of Medicine, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, United States; The Corporal Michael J. Crescenz VA Medical Center, Philadelphia, Pennsylvania, United States
| | - Chyke A Doubeni
- Department of Family Medicine and Community Health, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, United States
| | - Robert Gross
- Department of Medicine, Infectious Diseases, Department of Epidemiology, Biostatistics, Informatics, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, United States
| |
Collapse
|
7
|
Falsification Tests for Instrumental Variable Designs With an Application to Tendency to Operate. Med Care 2019; 57:167-171. [PMID: 30520835 DOI: 10.1097/mlr.0000000000001040] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
Abstract
BACKGROUND Instrumental variable (IV) methods are becoming an increasingly important tool in health services research as they can provide consistent estimates of causal effects in the presence of unobserved confounding. However, investigators must provide justifications that the IV is independent with any unmeasured confounder and its effect on the outcome occurs only through receipt of the exposure. These assumptions, while plausible in some contexts, cannot be verified from the data. METHODS Falsification tests can be applied to provide evidence for the key IV assumptions. A falsification test cannot prove the assumptions hold, but can provide decisive evidence when the assumption fails. We provide a general overview of falsification tests for IV designs. We highlight a falsification test that utilizes a subpopulation of the data where an overwhelming proportion of units are treated or untreated. If the IV assumptions hold, we should find the intention-to-treat effect is zero within these subpopulations. RESULTS We demonstrate the usage of falsification tests for IV designs using an IV known as tendency to operate from health services research. We show that the falsification test provides no evidence against the IV assumptions in this application.
Collapse
|
8
|
Keele L, Small D. Instrumental variables: Don't throw the baby out with the bathwater. Health Serv Res 2019; 54:543-546. [PMID: 30859577 DOI: 10.1111/1475-6773.13130] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022] Open
Affiliation(s)
- Luke Keele
- University of Pennsylvania, Philadelphia, Pennsylvania
| | - Dylan Small
- University of Pennsylvania, Philadelphia, Pennsylvania
| |
Collapse
|
9
|
Ertefaie A, Small DS, Rosenbaum PR. Quantitative Evaluation of the Trade-Off of Strengthened Instruments and Sample Size in Observational Studies. J Am Stat Assoc 2018. [DOI: 10.1080/01621459.2017.1305275] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
Affiliation(s)
- Ashkan Ertefaie
- Department of Biostatistics and Computational Biology at the University of Rochester, Rochester, NY
| | - Dylan S. Small
- Department of Statistics, Wharton School, University of Pennsylvania, Philadelphia, PA
| | - Paul R. Rosenbaum
- Department of Statistics, Wharton School, University of Pennsylvania, Philadelphia, PA
| |
Collapse
|
10
|
Fogarty CB, Shi P, Mikkelsen ME, Small DS. Randomization Inference and Sensitivity Analysis for Composite Null Hypotheses With Binary Outcomes in Matched Observational Studies. J Am Stat Assoc 2017. [DOI: 10.1080/01621459.2016.1138865] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/22/2022]
Affiliation(s)
- Colin B. Fogarty
- MIT Sloan School of Management and Operations Research Center, Massachusetts Institute of Technology, Cambridge, MA
- Department of Statistics, The Wharton School, University of Pennsylvania, Philadelphia, PA
| | - Pixu Shi
- Center for Clinical Epidemiology and Biostatistics, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA
| | - Mark E. Mikkelsen
- Division of Pulmonary and Critical Care Medicine, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA
| | - Dylan S. Small
- Department of Statistics, The Wharton School, University of Pennsylvania, Philadelphia, PA
| |
Collapse
|
11
|
de Los Angeles Resa M, Zubizarreta JR. Evaluation of subset matching methods and forms of covariate balance. Stat Med 2016; 35:4961-4979. [PMID: 27442072 DOI: 10.1002/sim.7036] [Citation(s) in RCA: 26] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/26/2015] [Revised: 02/10/2016] [Accepted: 06/05/2016] [Indexed: 01/25/2023]
Abstract
This paper conducts a Monte Carlo simulation study to evaluate the performance of multivariate matching methods that select a subset of treatment and control observations. The matching methods studied are the widely used nearest neighbor matching with propensity score calipers and the more recently proposed methods, optimal matching of an optimally chosen subset and optimal cardinality matching. The main findings are: (i) covariate balance, as measured by differences in means, variance ratios, Kolmogorov-Smirnov distances, and cross-match test statistics, is better with cardinality matching because by construction it satisfies balance requirements; (ii) for given levels of covariate balance, the matched samples are larger with cardinality matching than with the other methods; (iii) in terms of covariate distances, optimal subset matching performs best; (iv) treatment effect estimates from cardinality matching have lower root-mean-square errors, provided strong requirements for balance, specifically, fine balance, or strength-k balance, plus close mean balance. In standard practice, a matched sample is considered to be balanced if the absolute differences in means of the covariates across treatment groups are smaller than 0.1 standard deviations. However, the simulation results suggest that stronger forms of balance should be pursued in order to remove systematic biases due to observed covariates when a difference in means treatment effect estimator is used. In particular, if the true outcome model is additive, then marginal distributions should be balanced, and if the true outcome model is additive with interactions, then low-dimensional joints should be balanced. Copyright © 2016 John Wiley & Sons, Ltd.
Collapse
Affiliation(s)
- María de Los Angeles Resa
- Department of Statistics, Columbia University, 1255 Amsterdam Avenue, 901 SSW, New York, 10027, NY, U.S.A..
| | - José R Zubizarreta
- Division of Decision, Risk and Operations, and Department of Statistics, Columbia University, 3022 Broadway, 417 Uris Hall, New York, 10027, NY, U.S.A
| |
Collapse
|
12
|
Ding P, Lu J. Principal stratification analysis using principal scores. J R Stat Soc Series B Stat Methodol 2016. [DOI: 10.1111/rssb.12191] [Citation(s) in RCA: 42] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/27/2022]
Affiliation(s)
- Peng Ding
- University of California at Berkeley; USA
| | | |
Collapse
|
13
|
Kang H, Kreuels B, May J, Small DS. Full matching approach to instrumental variables estimation with application to the effect of malaria on stunting. Ann Appl Stat 2016. [DOI: 10.1214/15-aoas894] [Citation(s) in RCA: 15] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/19/2022]
|
14
|
Baiocchi M, Cheng J, Small DS. Instrumental variable methods for causal inference. Stat Med 2014; 33:2297-340. [PMID: 24599889 PMCID: PMC4201653 DOI: 10.1002/sim.6128] [Citation(s) in RCA: 357] [Impact Index Per Article: 35.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/20/2013] [Revised: 01/24/2014] [Accepted: 02/10/2014] [Indexed: 01/03/2023]
Abstract
A goal of many health studies is to determine the causal effect of a treatment or intervention on health outcomes. Often, it is not ethically or practically possible to conduct a perfectly randomized experiment, and instead, an observational study must be used. A major challenge to the validity of observational studies is the possibility of unmeasured confounding (i.e., unmeasured ways in which the treatment and control groups differ before treatment administration, which also affect the outcome). Instrumental variables analysis is a method for controlling for unmeasured confounding. This type of analysis requires the measurement of a valid instrumental variable, which is a variable that (i) is independent of the unmeasured confounding; (ii) affects the treatment; and (iii) affects the outcome only indirectly through its effect on the treatment. This tutorial discusses the types of causal effects that can be estimated by instrumental variables analysis; the assumptions needed for instrumental variables analysis to provide valid estimates of causal effects and sensitivity analysis for those assumptions; methods of estimation of causal effects using instrumental variables; and sources of instrumental variables in health studies.
Collapse
Affiliation(s)
- Michael Baiocchi
- Department of Statistics, Stanford University, Stanford, CA, U.S.A
| | | | | |
Collapse
|