Multivariate one-sided testing in matched observational studies as an adversarial game

We present a multivariate one-sided sensitivity analysis for matched observational studies, appropriate when the researcher has specified that a given causal mechanism should manifest itself in effects on multiple outcome variables in a known direction. The test statistic can be thought of as the solution to an adversarial game, where the researcher determines the best linear combination of test statistics to combat nature’s presentation of the worst-case pattern of hidden bias. The corresponding optimization problem is convex, and can be solved efficiently even for reasonably sized observational studies. Asymptotically, the test statistic converges to a chi-bar-squared distribution under the null, a common distribution in order-restricted statistical inference. The test attains the largest possible design sensitivity over a class of coherent test statistics, and facilitates one-sided sensitivity analyses for individual outcome variables while maintaining familywise error control through its incorporation into closed testing procedures.

EVIDENCE FACTORS IN A CASE-CONTROL STUDY WITH APPLICATION TO THE EFFECT OF FLEXIBLE SIGMOIDOSCOPY SCREENING ON COLORECTAL CANCER

As in any observational study, in a case-control study a primary concern is potential unmeasured confounders. Bias, due to unmeasured confounders, can result in a false discovery of an apparent treatment effect when there is none. Replication of an observational study, which tries to provide multiple analyses of the data where the biases affecting each analysis are thought to be different, is one way to strengthen the evidence from an observational study. Evidence factors allow for internal replication by testing a hypothesis using multiple comparisons in a way that the comparisons yield independent evidence and differ in the sources of potential bias. We construct evidence factors in a case-control study in which there are two types of cases, "narrow" cases which are thought to be potentially more affected by the exposure and "marginal" cases which are thought to have more heterogeneous causes. We develop and study an inference procedure for using such evidence factors and apply it to a study of the effect of sigmoidoscopy screening on colorectal cancer.

Using Evidence Factors to Clarify Exposure Biomarkers

A study has 2 evidence factors if it permits 2 statistically independent inferences about 1 treatment effect such that each factor is immune to some bias that would invalidate the other factor. Because the 2 factors are statistically independent, the evidence they provide can be combined using methods associated with meta-analysis for independent studies, despite using the same data twice in different ways. We illustrate evidence factors, applying them in a new way in investigations that have both an exposure biomarker and a coarse external measure of exposure to a treatment. To illustrate, we consider the possible effects of cigarette smoking on homocysteine levels, with self-reported smoking and a cotinine biomarker. We examine joint sensitivity of 2 factors to bias from confounding, a central aspect of any observational study.

Long-term use of hydrocodone vs. oxycodone in primary care

BACKGROUND

Hydrocodone and oxycodone are the Schedule II opioids most often prescribed in primary care. Notwithstanding the dangers of prescription opioid use, the likelihood of long-term use with either drug is presently unknown.

METHODS

Using a retrospective cohort design and data from a commerical healthcare claims repository, we compared the likelihood of long-term use of hydrocodone and oxycodone in primary care patients presenting with acute back pain. Treatment was categorized as long-term if the prescription dates spanned ≥90 days from initial prescription to the run-out date of the last prescription, and included ≥120 days' supply or ≥10 fills. Instrumental variable methods and probit regression were used to model the effect of drug choice on long-term use, estimate the average treatment effect, and correct for confounding by indication.

RESULTS

A total of 3,983 patients who were prescribed only hydrocodone or only oxycodone were followed for 270 days in 2016. Long-term opioid use was observed in 320 patients (8%). Controlling for potential confounders including morphine milligram equivalents and dosage, an estimated 12% (95 CI, 10%-14%) treated with hydrocodone transitioned to long-term use vs. 2% (95 CI, 1%-3%) on oxycodone. Among patients who received more than one prescription (n = 1,866), an estimated 23% (95 CI, 19%-26%) treated with hydrocodone transitioned to long-term use vs. 5% (95 CI, 3%-7%) on oxycodone. The difference between drugs was supported in sensitivity and subgroup analyses. Sample selection bias was not detected.

CONCLUSIONS

Long-term use was substantially greater for patients treated with hydrocodone than oxycodone, despite equianalgesia.