Preference-based instrumental variables in health research rely on important and underreported assumptions: a systematic review

Effect of ADHD medication on risk of injuries: a preference-based instrumental variable analysis

ADHD is associated with an increased risk of injury. Causal evidence for effects of pharmacological treatment on injuries is scarce. We estimated effects of ADHD medication on injuries using variation in provider preference as an instrumental variable (IV). Using Norwegian registry data, we followed 8051 patients who were diagnosed with ADHD aged 5 to 18 between 2009 and 2011 and recorded their ADHD medication and injuries treated in emergency rooms and emergency wards up to 4 years after diagnosis. Persons with ADHD had an increased risk of injuries compared to the general population (RR 1.35; 95% CI: 1.30-1.39), with higher risk in females (RR 1.47; 95% CI: 1.38-1.56) than males (RR 1.23; 95% CI: 1.18-1.28). The between-clinics variation in provider preference for ADHD medication was large and had a considerable impact on patients' treatment status. There was no causal evidence for protective effects of pharmacological treatment on injuries overall for young individuals with ADHD characterized by milder or atypical symptoms. However, there was an apparent effect of pharmacological treatment over time on the risk of injuries treated at emergency wards in this patient group.

Effect of Pharmacological Treatment of Attention-Deficit/Hyperactivity Disorder on Criminality

OBJECTIVE

Criminality rates are higher among persons with attention-deficit/hyperactivity disorder (ADHD), and evidence that medication reduces crime is limited. Medication rates between clinics vary widely even within universal health care systems, partly because of providers' treatment preferences. We used this variation to estimate causal effects of pharmacological treatment of ADHD on 4-year criminal outcomes.

METHOD

We used Norwegian population-level registry data to identify all unique patients aged 10 to 18 years diagnosed with ADHD between 2009 and 2011 (n = 5,624), their use of ADHD medication, and subsequent criminal charges. An instrumental variable design, exploiting variation in provider preference for ADHD medication between clinics, was used to identify causal effects of ADHD medication on crime among patients on the margin of treatment, that is, patients who receive treatment because of their provider's preference.

RESULTS

Criminality was higher in patients with ADHD relative to the general population. Medication preference varied between clinics and strongly affected patients' treatment. Instrumental variable analyses supported a protective effect of pharmacological treatment on violence-related and public-order-related charges with numbers needed to treat of 14 and 8, respectively. There was no evidence for effects on drug-, traffic-, sexual-, or property-related charges.

CONCLUSION

This is the first study to demonstrate causal effects of pharmacological treatment of ADHD on some types of crimes in a population-based natural experiment. Pharmacological treatment of ADHD reduced crime related to impulsive-reactive behavior in patients with ADHD on the margin of treatment. No effects were found on crimes requiring criminal intent, conspiracy, and planning.

STUDY PREREGISTRATION INFORMATION

The ADHD controversy project: Long-term effects of ADHD medication; https://www.isrctn.com/; 11891971.

Comparative Analysis of Instrumental Variables on the Assignment of Buprenorphine/Naloxone or Methadone for the Treatment of Opioid Use Disorder

BACKGROUND

Instrumental variable (IV) analysis provides an alternative set of identification assumptions in the presence of uncontrolled confounding when attempting to estimate causal effects. Our objective was to evaluate the suitability of measures of prescriber preference and calendar time as potential IVs to evaluate the comparative effectiveness of buprenorphine/naloxone versus methadone for treatment of opioid use disorder (OUD).

METHODS

Using linked population-level health administrative data, we constructed five IVs: prescribing preference at the individual, facility, and region levels (continuous and categorical variables), calendar time, and a binary prescriber's preference IV in analyzing the treatment assignment-treatment discontinuation association using both incident-user and prevalent-new-user designs. Using published guidelines, we assessed and compared each IV according to the four assumptions for IVs, employing both empirical assessment and content expertise. We evaluated the robustness of results using sensitivity analyses.

RESULTS

The study sample included 35,904 incident users (43.3% on buprenorphine/naloxone) initiated on opioid agonist treatment by 1585 prescribers during the study period. While all candidate IVs were strong (A1) according to conventional criteria, by expert opinion, we found no evidence against assumptions of exclusion (A2), independence (A3), monotonicity (A4a), and homogeneity (A4b) for prescribing preference-based IV. Some criteria were violated for the calendar time-based IV. We determined that preference in provider-level prescribing, measured on a continuous scale, was the most suitable IV for comparative effectiveness of buprenorphine/naloxone and methadone for the treatment of OUD.

CONCLUSIONS

Our results suggest that prescriber's preference measures are suitable IVs in comparative effectiveness studies of treatment for OUD.

The Association between Direct Oral Anticoagulants Prescribing Behavior and Non-Valvular Atrial Fibrillation Outcomes: An Instrumental Variable Analysis of Real-World Data

Several observational studies have compared apixaban with rivaroxaban in patients with non-valvular atrial fibrillation (NVAF), but these analyses may be confounded by unmeasured characteristics. This study used provider prescribing preference (PPP) as an instrumental variable (IV) to assess the association between prescriber choice of rivaroxaban vs. apixaban and the study outcomes of stroke/systemic embolism (SE), major bleeding, and death in a retrospective cohort of NVAF patients in the US. Initiators of either medication were linked to their prescribers and followed until the first of the study outcome, the end of rivaroxaban/apixaban use, or 365 days after initiation. PPP for each patient was the percent of rivaroxaban initiations issued by the provider for the prior 10 NVAF patients. Cox regression models tested associations between quintiles of PPP and each outcome. A total of 61,155 patients and 1726 providers were included. The IV was a strong predictor of rivaroxaban prescription (OR = 17.9; 95% CI: 16.6, 19.3). There were statistically significant associations between increasing preference for rivaroxaban and rates of major bleeding (ptrend = 0.041) and death (ptrend = 0.031), but not stroke/SE (ptrend = 0.398). This analysis provides evidence of the relative safety of apixaban over rivaroxaban for the risk of major bleeding and death.

Bicarbonate, calcium, and magnesium for in-hospital cardiac arrest - An instrumental variable analysis

INTRODUCTION

Bicarbonate, calcium, and magnesium are commonly used during in-hospital cardiac arrest. Whether these drugs are associated with survival in cardiac arrest patients is uncertain.

METHODS

This was an observational study using data from the Get With The Guidelines registry. Adult patients with an in-hospital cardiac arrest between January 2008 and December 2021 were included. An instrumental variable approach was used based on hospital preferences for bicarbonate, calcium, and magnesium, respectively. The primary outcome was survival to hospital discharge.

RESULTS

A total of 319,230 patients were included. The median age was 66 years, 59% patients were male, and 85% patients presented with a non-shockable rhythm. Bicarbonate was administered in 58% patients, calcium in 33% patients, and magnesium in 10% patients. When considering drug use in the previous cardiac arrest patient at a given hospital as an instrument, the absolute difference in survival to hospital discharge was estimated at -14.2% (95% CI, -19.9 to -8.6) for bicarbonate, -3.0% (95% CI, -8.6 to 2.6) for calcium, and 10.7% (95% CI, -0.8 to 22.2) for magnesium as compared to no drug. When considering the proportion of drug use within the past year at a given hospital as an instrument, the confidence intervals were very wide, making the results difficult to interpret.

CONCLUSIONS

In this analysis, the results for bicarbonate, calcium, and magnesium were inconclusive due to wide confidence intervals and inconsistencies in estimates across instrumental variables. Randomized trials are needed to investigate the effect of these drugs on patient outcomes.

Geographical variation in ADHD: do diagnoses reflect symptom levels?

Rates of ADHD diagnosis vary across regions in many countries. However, no prior study has investigated how much within-country geographic variation in ADHD diagnoses is explained by variation in ADHD symptom levels. We examine whether ADHD symptom levels explain variation in ADHD diagnoses among children and adolescents using nationwide survey and register data in Norway. Geographical variation in incidence of ADHD diagnosis was measured using Norwegian registry data from the child and adolescent mental health services for 2011-2016. Geographical variation in ADHD symptom levels in clinics' catchment areas was measured using data from the Norwegian mother, father and child cohort study for 2011-2016 (n = 39,850). Cross-sectional associations between ADHD symptom levels and the incidence of ADHD diagnoses were assessed with fractional response models. Geographical variation in ADHD diagnosis rates is much larger than what can be explained by geographical variation in ADHD symptoms levels. Treatment in the Norwegian child and adolescent mental health services is free, universally available upon referral, and practically without competition from the private sector. Factors beyond health care access and unequal symptom levels seem responsible for the geographical variation in ADHD diagnosis.

Long term outcomes and causal modelling of compulsory inpatient and outpatient mental health care using Norwegian registry data: Protocol for a controversies in psychiatry research project

OBJECTIVES

Compulsory mental health care includes compulsory hospitalisation and outpatient commitment with medication treatment without consent. Uncertain evidence of the effects of compulsory care contributes to large geographical variations and a controversy on its use. Some argue that compulsion can rarely be justified and should be reduced to an absolute minimum, while others claim compulsion can more frequently be justified. The limited evidence base has contributed to variations in care that raise issues about the quality/appropriateness of care as well as ethical concerns. To address the question whether compulsory mental health care results in superior, worse or equivalent outcomes for patients, this project will utilise registry-based longitudinal data to examine the effect of compulsory inpatient and outpatient care on multiple outcomes, including suicide and overall mortality; emergency care/injuries; crime and victimisation; and participation in the labour force and welfare dependency.

METHODS

By using the natural variation in health providers' preference for compulsory care as a source of quasi-randomisation we will estimate causal effects of compulsory care on short- and long-term trajectories.

CONCLUSIONS

This project will provide valuable insights for service providers and policy makers in facilitating high quality clinical care pathways for a high risk population group.

A Gentle Introduction to Instrumental Variables

Instrumental variables (IV) is a central strategy for identifying causal effects in absence of randomized experiments. Clinicians and epidemiologists may find the intuition of IV easy to grasp by comparison to randomized experiments. Randomization is an ideal IV because treatment is assigned randomly, and hence unaffected by everything else. IV methods in non-experimental settings mimic a randomized experiment by using a source of "as good as" random variation in treatment instead. The main challenge with IV designs is to find IVs that are as good as randomization. Discovering potential IVs require substantive knowledge and an understanding of IV design principles. Moreover, IV methods recover causal effects for a subset of the population who take treatment when induced by the IV. Sometimes these estimates are informative, other times their relevance is questionable. We provide an introduction to IV methods in clinical epidemiology. First, we introduce the main principles and assumptions. Second, we present practical examples based on mendelian randomization and provider preference IVs and refer to other common IVs in health. Third, practical steps in IV analysis are presented. Fourth, the promise and perils of IV methods are discussed. Finally, we suggest further readings.

Local Instrumental Variable Methods to Address Confounding and Heterogeneity when Using Electronic Health Records: An Application to Emergency Surgery

Background

Electronic health records (EHRs) offer opportunities for comparative effectiveness research to inform decision making. However, to provide useful evidence, these studies must address confounding and treatment effect heterogeneity according to unmeasured prognostic factors. Local instrumental variable (LIV) methods can help studies address these challenges, but have yet to be applied to EHR data. This article critically examines a LIV approach to evaluate the cost-effectiveness of emergency surgery (ES) for common acute conditions from EHRs.

Methods

This article uses hospital episodes statistics (HES) data for emergency hospital admissions with acute appendicitis, diverticular disease, and abdominal wall hernia to 175 acute hospitals in England from 2010 to 2019. For each emergency admission, the instrumental variable for ES receipt was each hospital’s ES rate in the year preceding the emergency admission. The LIV approach provided individual-level estimates of the incremental quality-adjusted life-years, costs and net monetary benefit of ES, which were aggregated to the overall population and subpopulations of interest, and contrasted with those from traditional IV and risk-adjustment approaches.

Results

The study included 268,144 (appendicitis), 138,869 (diverticular disease), and 106,432 (hernia) patients. The instrument was found to be strong and to minimize covariate imbalance. For diverticular disease, the results differed by method; although the traditional approaches reported that, overall, ES was not cost-effective, the LIV approach reported that ES was cost-effective but with wide statistical uncertainty. For all 3 conditions, the LIV approach found heterogeneity in the cost-effectiveness estimates across population subgroups: in particular, ES was not cost-effective for patients with severe levels of frailty.

Conclusions

EHRs can be combined with LIV methods to provide evidence on the cost-effectiveness of routinely provided interventions, while fully recognizing heterogeneity.

Highlights