Sensitivity and specificity of the gain short-screener for predicting substance use disorders in a large national sample of emerging adults

A systematic review of validity of US survey measures for assessing substance use and substance use disorders

BACKGROUND

The steep rise in substance use and substance use disorder (SUD) shows an urgency to assess its prevalence using valid measures. This systematic review summarizes the validity of measures to assess the prevalence of substance use and SUD in the US estimated in population and sub-population-based surveys.

METHODS

A literature search was performed using nine online databases. Studies were included in the review if they were published in English and tested the validity of substance use and SUD measures among US adults at the general or sub-population level. Independent reviews were conducted by the authors to complete data synthesis and assess the risk of bias.

RESULTS

Overall, 46 studies validating substance use/SUD (n = 46) measures were included in this review, in which 63% were conducted in clinical settings and 89% assessed the validity of SUD measures. Among the studies that assessed SUD screening measures, 78% examined a generic SUD measure, and the rest screened for specific disorders. Almost every study used a different survey measure. Overall, sensitivity and specificity tests were conducted in over a third of the studies for validation, and 10 studies used receiver operating characteristics curve.

CONCLUSION

Findings suggest a lack of standardized methods in surveys measuring and reporting prevalence of substance use/SUD among US adults. It highlights a critical need to develop short measures for assessing SUD that do not require lengthy, time-consuming data collection that would be difficult to incorporate into population-based surveys assessing a multitude of health dimensions.

SYSTEMATIC REVIEW REGISTRATION

PROSPERO CRD42022298280.

The Association Between Depression and Substance Use Among Primary Care Patients With Comorbid Medical and Behavioral Health Conditions

INTRODUCTION

The scope of primary care increasingly encompasses patient behavioral health problems, manifest typically through depression screening and treatment. Although substance use is highly comorbid with depression, it is not commonly identified and addressed in the primary care context. This study aimed to examine the association between the likelihood of substance use disorder and increased depression severity, both cross-sectionally and longitudinally, among a sample of 2409 patients from 41 geographically dispersed and diverse primary care clinics across the US.

METHODS

This is secondary analysis of data obtained from a multi-site parent study of integrated behavioral health in primary care, among patients with both chronic medical and behavioral health conditions. Patient reported outcome surveys were gathered from patients at 3 time points. The primary care practices were blind to which of their patients completed surveys. Included were standardized measures of depression severity (Patient Health Questionnaire-9) [PHQ-9] and substance use disorder likelihood (Global Appraisal of Individual Needs-Short Screener [GSS]).

RESULTS

Four percent of the study population screened positive for substance use disorder. PHQ-9 scores indicated depression among 43% of all patients. There was a significant association between the likelihood of substance use disorder and depression initially, at a 9-month follow-up, and over time. These associations remained significant after adjusting for age, gender, race, ethnicity, education, income, and other patient and contextual characteristics.

CONCLUSIONS

The findings suggest that substance use disorder is associated with depression severity cross-sectionally and over time. Primary care clinics and health systems might consider implementing substance use screening in addition to the more common screening strategies for depression. Especially for patients with severe depression or those who do not respond to frontline depression treatments, the undermining presence of a substance use disorder should be explored.

Impact Potpourri: A Multimethod Survey Study on Youth Substance Use During COVID-19

BACKGROUND

Given the important implications of youth substance use, it is essential to document and describe changes in substance use during the coronavirus disease 2019 pandemic.

METHODS

This multimethod survey study examines the impacts of the coronavirus disease 2019 pandemic on youth substance use among 149 Canadian youth who were using substances at a mid-pandemic period. Participants were 21.9 years of age on average (SD=2.2), including 99 girls/young women, 42 boys/young men, and 8 transgender or nonbinary individuals. The majority were Caucasian and born in Canada. Qualitative and quantitative findings are reported, with thematic analysis combined with descriptive and inferential statistical analyses.

RESULTS

Qualitatively, many youth reported increases or shifts in their substance use over the course of the pandemic. Youth reported using substances with limited numbers of peers, with family, or alone. Many reported using substances out of boredom and to cope. While legal substances remained highly accessible, illegal substances were reported to be more difficult to acquire and less trustworthy. Spending had increased. Quantitative findings suggested alcohol use has decreased, but other substance use has remained stable in the sample as a whole, although for each substance, some youth reported increases.

DISCUSSION

Despite minimal quantitative change, qualitative findings show that some youth increased their use of some substances during the pandemic, decreased others, changed their motivation to use, and decreased in safety behaviors. Youth-serving organizations should be aware of individual differences, the changing context of substance use, and the potential long-term impacts.

Usability and Acceptability of a Mobile App to Help Emerging Adults Address their Friends' Substance Use (Harbor): Quantitative Study

BACKGROUND

Technology-assisted intervention and prevention strategies present opportunities for substance use-related research with emerging adults (EAs) and their peers. Emerging adulthood is a developmentally distinct period in which individuals between the ages of 18 and 29 years undergo unique emotional, cultural, developmental, and biological changes as they transition into adulthood. Crowdsourcing, or gathering feedback from a large group within web-based communities, offers researchers a unique and cost-effective way to obtain large amounts of information in a short period.

OBJECTIVE

This paper presents market feedback obtained via Amazon's Mechanical Turk from EAs (N=458) on the acceptability and utility of brief intervention scripts for a smartphone app currently under development. The mobile app, Harbor, teaches friends of EAs with substance use problems effective and supportive strategies for helping their friend make changes in their substance use behavior.

METHODS

We examined feedback on the wording of the intervention scripts and estimated the market size of EAs who may use this app. Furthermore, we calculated correlations between script ratings and measures of personal risky drinking (ie, Alcohol Use Disorder Identification Test) and the participants' use of confrontational, enabling, or supportive behaviors with an existing friend.

RESULTS

Approximately half of our sample (208/458, 45.4%) indicated that they had a close friend for whom they had concerns about their substance use, suggesting a potentially high demand for an app such as Harbor. Initial findings suggest that peers who engage in less enabling behaviors with friends who have a substance use problem exhibited lower risky drinking behaviors overall (r₂₀₆=-0.501; P<.001). Concerning acceptability, 98.0% (449/458) of the sample rated the scripts' dialogue as either somewhat, moderately, or extremely realistic (mean 3.92, SD 0.48) on 5-point Likert scale items. Finally, 95.4% (437/454) of respondents indicated that the scripts would be at least slightly helpful for training peers to help their friends with substance use issues. Finally, individuals who were better able to identify enabling language in enabling scripts self-reported fewer enabling behaviors toward their friend's substance use (r₂₀₆=-0.236; P=.001).

CONCLUSIONS

There exists a demonstrated level of desirability and acceptability among EAs for a mobile app such as Harbor. EAs who wish to engage in more supportive behaviors with their friends who engage in substance use and who are amenable to assisting their friends with sobriety likely would use and benefit from this app.

Measuring problem prescription opioid use among patients receiving long-term opioid analgesic treatment: development and evaluation of an algorithm for use in EHR and claims data

Objective

Opioid surveillance in response to the opioid epidemic will benefit from scalable, automated algorithms for identifying patients with clinically documented signs of problem prescription opioid use. Existing algorithms lack accuracy. We sought to develop a high-sensitivity, high-specificity classification algorithm based on widely available structured health data to identify patients receiving chronic extended-release/long-acting (ER/LA) therapy with evidence of problem use to support subsequent epidemiologic investigations.

Methods

Outpatient medical records of a probability sample of 2,000 Kaiser Permanente Washington patients receiving ≥60 days’ supply of ER/LA opioids in a 90-day period from 1 January 2006 to 30 June 2015 were manually reviewed to determine the presence of clinically documented signs of problem use and used as a reference standard for algorithm development. Using 1,400 patients as training data, we constructed candidate predictors from demographic, enrollment, encounter, diagnosis, procedure, and medication data extracted from medical claims records or the equivalent from electronic health record (EHR) systems, and we used adaptive least absolute shrinkage and selection operator (LASSO) regression to develop a model. We evaluated this model in a comparable 600-patient validation set. We compared this model to ICD-9 diagnostic codes for opioid abuse, dependence, and poisoning. This study was registered with ClinicalTrials.gov as study NCT02667262 on 28 January 2016.

Results

We operationalized 1,126 potential predictors characterizing patient demographics, procedures, diagnoses, timing, dose, and location of medication dispensing. The final model incorporating 53 predictors had a sensitivity of 0.582 at positive predictive value (PPV) of 0.572. ICD-9 codes for opioid abuse, dependence, and poisoning had a sensitivity of 0.390 at PPV of 0.599 in the same cohort.

Conclusions

Scalable methods using widely available structured EHR/claims data to accurately identify problem opioid use among patients receiving long-term ER/LA therapy were unsuccessful. This approach may be useful for identifying patients needing clinical evaluation.