Predictive Validity of the K-CAT-SS in High-Risk Adolescents and Young Adults

OBJECTIVE

Suicide is a leading cause of death in adolescents and young adults and has increased substantially in the past 15 years. Accurate suicide risk stratification based on rapid screening can help reverse these trends. To study the ability of the K-CAT-SS, a brief computerized adaptive test of suicidality, to predict suicide attempts (SA) in high-risk youth.

METHOD

652 participants aged 12-24, 78% of whom presented with suicidal ideation or behavior, were recruited within one month of mental health contact. The K-CAT-SS, scaled from 0-100, was administered at baseline, and participants were assessed at around 1-, 3-, and 6-months post-intake. Weekly incidence of SAs, assessed using the Adolescent Longitudinal Interval Follow-up Evaluation and Columbia-Suicide Severity Rating Scale. A secondary outcome was suicidal behavior (SB), including aborted, interrupted, and actual SA.

RESULTS

The K-CAT-SS showed a 4.91-fold increase in SAs for every 25-point increase in the baseline score, (95% CI=2.83,8.52) and a 3.51-fold increase in SBs (95% CI=2.32,5.30) These relationships persisted following adjustment for prior attempts, and demographic variables including age, sex, gender identity, sexual orientation, race/ethnicity, and other measures of psychopathology. No moderating effects were identified. At 3 months, the Area Under the Receiver Operating Curve [AUROC]=0.83 (95% CI=0.72, 0.93) for 1 or more SA.

CONCLUSION

The K-CAT-SS is an excellent tool for suicide risk stratification, particularly in higher-risk populations where other measures have shown lower predictive validity.

Risk of suicide attempts and intentional self-harm on alprazolam

BACKGROUND

From 2000-2021, U.S. suicide deaths have risen 36 %. Identification of pharmacological agents associated with increased suicide risk and safer alternatives may help reduce this trend.

METHODS

An exposure-only within-subject time-to-event pharmacoepidemiologic study of the dynamic association between alprazolam treatment and suicide attempts over 2-years. Parallel analyses were conducted for diazepam, lorazepam and buspirone. Data for 2,495,520 patients were obtained from U.S. private insurance medical claims MarketScan from 2010 to 2019.

FINDINGS

Alprazolam was associated with over a doubling of risk of suicide attempts (HR=2.21, 95 % CI=2.06,2.38). A duration-response analysis for the modal dose (0.5 mg) revealed a 5 % increase in suicidal events per additional month of treatment (HR=1.05, 95 % CI=1.04,1.07). Parallel analyses with long-acting (diazepam) and short-acting (lorazepam), found similar associations (diazepam HR=2.87, 95 % CI=2.56,3.21; lorazepam HR=1.83, 95 % CI=1.69,2.00), whereas the non-benzodiazepine anxiolytic, buspirone, showed significantly less risk (HR=1.25, 95 % CI=1.13,1.38), and no increased risk in patients with an attempt history (HR=1.05, 95 % CI=0.70,1.59).

INTERPRETATION

This study confirmed an earlier signal linking alprazolam to increased suicide attempt risk. The increased risk extends to benzodiazepines in general, regardless of half-life and risk of withdrawal seizure. Buspirone appears to be a safer treatment than benzodiazepines, particularly in patients at increased risk for suicide.

Initial Validation of a Computerized Adaptive Test for Substance Use Disorder Identification in Adolescents

PURPOSE

Computerized adaptive tests (CATs) are highly efficient assessment tools that couple low patient and clinician time burden with high diagnostic accuracy. A CAT for substance use disorders (CAT-SUD-E) has been validated in adult populations but has yet to be tested in adolescents. The purpose of this study was to perform initial evaluation of the K-CAT-SUD-E (i.e., Kiddy-CAT-SUD-E) in an adolescent sample compared to a gold-standard diagnostic interview.

METHODS

Adolescents (N = 156; aged 11-17) with diverse substance use histories completed the K-CAT-SUD-E electronically and the substance related disorders portion of a clinician-conducted diagnostic interview (K-SADS) via tele-videoconferencing platform. The K-CAT-SUD-E assessed both current and lifetime overall SUD and substance-specific diagnoses for nine substance classes.

RESULTS

Using the K-CAT-SUD-E continuous severity score and diagnoses to predict the presence of any K-SADS SUD diagnosis, the classification accuracy ranged from excellent for current SUD (AUC = 0.89, 95% CI = 0.81, 0.95) to outstanding (AUC = 0.93, 95% CI = 0.82, 0.97) for lifetime SUD. Regarding current substance-specific diagnoses, the classification accuracy was excellent for alcohol (AUC = 0.82), cannabis (AUC = 0.83) and nicotine/tobacco (AUC = 0.90). For lifetime substance-specific diagnoses, the classification accuracy ranged from excellent (e.g., opioids, AUC = 0.84) to outstanding (e.g., stimulants, AUC = 0.96). K-CAT-SUD-E median completion time was 4 min 22 s compared to 45 min for the K-SADS.

CONCLUSIONS

This study provides initial support for the K-CAT-SUD-E as a feasible accurate diagnostic tool for assessing SUDs in adolescents. Future studies should further validate the K-CAT-SUD-E in a larger sample of adolescents and examine its acceptability, feasibility, and scalability in youth-serving settings.

Clinical characterization and differentiation of B-SNIP psychosis Biotypes: Algorithmic Diagnostics for Efficient Prescription of Treatments (ADEPT)-1

Clinically defined psychosis diagnoses are neurobiologically heterogeneous. The B-SNIP consortium identified and validated more neurobiologically homogeneous psychosis Biotypes using an extensive battery of neurocognitive and psychophysiological laboratory measures. However, typically the first step in any diagnostic evaluation is the clinical interview. In this project, we evaluated if psychosis Biotypes have clinical characteristics that can support their differentiation in addition to obtaining laboratory testing. Clinical interview data from 1907 individuals with a psychosis Biotype were used to create a diagnostic algorithm. The features were 58 ratings from standard clinical scales. Extremely randomized tree algorithms were used to evaluate sensitivity, specificity, and overall classification success. Biotype classification accuracy peaked at 91 % with the use of 57 items on average. A reduced feature set of 28 items, though, also showed 81 % classification accuracy. Using this reduced item set, we found that only 10-11 items achieved a one-vs-all (Biotype-1 or not, Biotype-2 or not, Biotype-3 or not) area under the sensitivity-specificity curve of .78 to .81. The top clinical characteristics for differentiating psychosis Biotypes, in order of importance, were (i) difficulty in abstract thinking, (ii) multiple indicators of social functioning, (iii) conceptual disorganization, (iv) severity of hallucinations, (v) stereotyped thinking, (vi) suspiciousness, (vii) unusual thought content, (viii) lack of spontaneous speech, and (ix) severity of delusions. These features were remarkably different from those that differentiated DSM psychosis diagnoses. This low-burden adaptive algorithm achieved reasonable classification accuracy and will support Biotype-specific etiological and treatment investigations even in under-resourced clinical and research environments.

Folic acid prescription and suicide attempt prevention: effect of past suicidal behaviour, psychiatric diagnosis and psychotropic medication

We previously showed that folic acid prescriptions for any indication were associated with lower rates of suicidal behaviour. Given that future randomised clinical trials are likely to focus on psychiatric disorders carrying elevated risk for suicide, we now report on the moderating effects of prior suicidal behaviour, psychiatric diagnoses and psychotropic medications on potential antisuicidal effects of folic acid. Data were obtained from the MarketScan Commercial Claims and Encounters databases that cover 164 million insured persons from 2005-2017, from which a cohort of 866 586 patients was derived. Analysis revealed no significant moderation effects on the antisuicidal effect of folic acid. These findings indicate that the potential benefit of folic acid for preventing suicidal behaviour is comparable in psychiatric populations at higher risk of suicide and that it may be additive to any benefit from psychotropic medications.

A randomized controlled trial on using predictive algorithm to adapt level of psychological care for community college students: STAND triaging and adapting to level of care study protocol

BACKGROUND

There is growing interest in using personalized mental health care to treat disorders like depression and anxiety to improve treatment engagement and efficacy. This randomized controlled trial will compare a traditional symptom severity decision-making algorithm to a novel multivariate decision-making algorithm for triage to and adaptation of mental health care. The stratified levels of care include a self-guided online wellness program, coach-guided online cognitive behavioral therapy, and clinician-delivered psychotherapy with or without pharmacotherapy. The novel multivariate algorithm will be comprised of baseline (for triage and adaptation) and time-varying variables (for adaptation) in four areas: social determinants of mental health, early adversity and life stressors, predisposing, enabling, and need influences on health service use, and comprehensive mental health status. The overarching goal is to evaluate whether the multivariate algorithm improves adherence to treatment, symptoms, and functioning above and beyond the symptom-based algorithm.

METHODS/DESIGN

This trial will recruit a total of 1000 participants over the course of 5 years in the greater Los Angeles Metropolitan Area. Participants will be recruited from a highly diverse sample of community college students. For the symptom severity approach, initial triaging to level of care will be based on symptom severity, whereas for the multivariate approach, the triaging will be based on a comprehensive set of baseline measures. After the initial triaging, level of care will be adapted throughout the duration of the treatment, utilizing either symptom severity or multivariate statistical approaches. Participants will complete computerized assessments and self-report questionnaires at baseline and up to 40 weeks. The multivariate decision-making algorithm will be updated annually to improve predictive outcomes.

DISCUSSION

Results will provide a comparison on the traditional symptom severity decision-making and the novel multivariate decision-making with respect to treatment adherence, symptom improvement, and functional recovery. Moreover, the developed multivariate decision-making algorithms may be used as a template in other community college settings. Ultimately, findings will inform the practice of level of care triage and adaptation in psychological treatments, as well as the use of personalized mental health care broadly.

TRIAL REGISTRATION

ClinicalTrials.gov NCT05591937, submitted August 2022, published October 2022.

Population Health Management Approach to Depression Symptom Monitoring in Primary Care via Patient Portal: A Randomized Controlled Trial

Depression is undertreated in primary care. Using patient portals to administer regular symptom assessments could facilitate more timely care. At an urban academic medical center outpatient clinic, patients with active portal accounts and depression on their problem list or a positive screen in the past year were randomized to assessment during triage at visits (usual care) versus usual care plus assessment via portal (population health care). Portal invitations were sent regardless of whether patients had scheduled appointments. More patients completed assessments in the population health care arm than usual care: 59% versus 18%, P < 0.001. Depression symptoms were more common among patients who completed their initial assessment via the portal versus in the clinic. In the population health care arm, 57% (N = 80/140) of patients with moderate-to-severe symptoms completed at least 1 follow-up assessment versus 37% (N = 13/35) in usual care. A portal-based population health approach could improve depression monitoring in primary care.

Social Vulnerability and Risk of Suicide in US Adults, 2016-2020

Importance

There were over 45 000 suicides in the US in 2020, making suicide the 12th leading cause of death. If social vulnerability is associated with suicide rates, targeted interventions for at-risk segments of the population may reduce US suicide rates.

Objective

To determine the association between social vulnerability and suicide in adults.

Design, Setting, and Participants

This cohort study analyzed 2 county-level social vulnerability measures (the Social Vulnerability Index [SVI] and the Social Vulnerability Metric [SVM]) and US Centers for Disease Control and Prevention-reported county-level suicides from 2016 to 2020. Data were analyzed November and December 2022.

Exposures

County-level variability in social vulnerability.

Main Outcomes and Measures

The primary outcome measure was number of county-level adult suicides from 2016 to 2020, offset by county adult population during those years. The association between social vulnerability (measured using the SVI and the newly created SVM for 2018) and suicide was modeled using a bayesian-censored Poisson regression model to account for the CDC's suppression of county-level suicide counts of less than 10, adjusted for age, racial and ethnic minority, and urban-rural county characteristics.

Results

From 2016 to 2020, there were a total of 222 018 suicides in 3141 counties. Comparing the least socially vulnerable (0% to 10%) to the most socially vulnerable (90% to 100%) counties, there was a 56% increase in suicide rate (17.3 per 100 000 persons to 27.0 per 100 000 persons) as measured by the SVI (incidence rate ratio, 1.56; 95% credible interval, 1.51-1.60) and an 82% increase in suicide rate (13.8 per 100 000 persons to 25.1 per 100 000 persons) as measured by the SVM (incidence rate ratio, 1.82; 95% credible interval, 1.72-1.92).

Conclusions and Relevance

This cohort study found that social vulnerability had a direct association with risk for adult suicide. Reducing social vulnerability may lead to life-saving reduction in the rate of suicide.

Association between prescribed opioid dose and risk of motor vehicle crashes

ABSTRACT

Opioid-involved motor vehicle traffic fatalities have increased over the past 2 decades. However, the extent to which prescribed opioids increase the risk of motor vehicle crashes remains uncertain. This study used real-world healthcare claims data to examine the association between prescription opioid dose and motor vehicle crash risk. Using nationwide US commercial insurance claims data for 2010 to 2018, we identified 772,404 adults who received incident, noncancer opioid therapy. We examined associations between daily prescription opioid dose, calculated in morphine milligram equivalents (MME) from filled prescription claims, and risk of motor vehicle crashes, assessed as diagnoses of motor vehicle injuries in claims for emergency visits, inpatient hospitalizations, and ambulance transportation. We estimated associations using a within-individual design, which ruled out all time-stable confounding. We complemented the design with time-varying statistical adjustment for other pharmacotherapies and a negative control pain pharmacotherapy analysis (with incident cyclic antidepressant prescriptions). During 2,150,009 person-years of follow-up, there were 12,123 motor vehicle crashes (5.64 crashes per 1000 person-years). In within-individual comparisons, crash risk was greater during opioid prescription periods involving doses ≤60 MME/day (odds ratio [OR], 3.86; 95% confidence interval [CI], 3.54, 4.21), >60 to 120 MME/day (OR, 5.46; 95% CI, 4.44, 6.73), and >120 MME/day (OR, 3.45; 95% CI, 2.31, 5.15) than during off-treatment periods. The negative control analysis supported the specificity of the results to opioids rather than to other processes associated with pharmacologic pain management. These findings suggest that the receipt of prescription opioids, even at doses ≤60 MME/day, is associated with an increased risk of motor vehicle crashes.

The Association Between USMLE Step 2 Clinical Knowledge Scores and Residency Performance: A Systematic Review and Meta-Analysis

PURPOSE

With the change in Step 1 score reporting, Step 2 Clinical Knowledge (CK) may become a pivotal factor in resident selection. This systematic review and meta-analysis seeks to synthesize existing observational studies that assess the relationship between Step 2 CK scores and measures of resident performance.

METHOD

The authors searched MEDLINE, Web of Science, and Scopus databases using terms related to Step 2 CK in 2021. Two researchers identified studies investigating the association between Step 2 CK and measures of resident performance and included studies if they contained a bivariate analysis examining Step 2 CK scores' association with an outcome of interest: in-training examination (ITE) scores, board certification examination scores, select Accreditation Council for Graduate Medical Education core competency assessments, overall resident performance evaluations, or other subjective measures of performance. For outcomes that were investigated by 3 or more studies, pooled effect sizes were estimated with random-effects models.

RESULTS

Among 1,355 potential studies, 68 met inclusion criteria and 43 were able to be pooled. There was a moderate positive correlation between Step 2 CK and ITE scores (0.52, 95% CI 0.45-0.59, P < .01). There was a moderate positive correlation between Step 2 CK and ITE scores for both nonsurgical (0.59, 95% CI 0.51-0.66, P < .01) and surgical specialties (0.41, 95% CI 0.33-0.48, P < .01). There was a very weak positive correlation between Step 2 CK scores and subjective measures of resident performance (0.19, 95% CI 0.13-0.25, P < .01).

CONCLUSIONS

This study found Step 2 CK scores have a statistically significant moderate positive association with future examination scores and a statistically significant weak positive correlation with subjective measures of resident performance. These findings are increasingly relevant as Step 2 CK scores will likely become more important in resident selection.

Accounting for Context in Randomized Trials after Assignment

Many preventive trials randomize individuals to intervention condition which is then delivered in a group setting. Other trials randomize higher levels, say organizations, and then use learning collaboratives comprised of multiple organizations to support improved implementation or sustainment. Other trials randomize or expand existing social networks and use key opinion leaders to deliver interventions through these networks. We use the term contextually driven to refer generally to such trials (traditionally referred to as clustering, where groups are formed either pre-randomization or post-randomization - i.e., a cluster-randomized trial), as these groupings or networks provide fixed or time-varying contexts that matter both theoretically and practically in the delivery of interventions. While such contextually driven trials can provide efficient and effective ways to deliver and evaluate prevention programs, they all require analytical procedures that take appropriate account of non-independence, something not always appreciated. Published analyses of many prevention trials have failed to take this into account. We discuss different types of contextually driven designs and then show that even small amounts of non-independence can inflate actual Type I error rates. This inflation leads to rejecting the null hypotheses too often, and erroneously leading us to conclude that there are significant differences between interventions when they do not exist. We describe a procedure to account for non-independence in the important case of a two-arm trial that randomizes units of individuals or organizations in both arms and then provides the active treatment in one arm through groups formed after assignment. We provide sample code in multiple programming languages to guide the analyst, distinguish diverse contextually driven designs, and summarize implications for multiple audiences.

Association Between Folic Acid Prescription Fills and Suicide Attempts and Intentional Self-harm Among Privately Insured US Adults

Importance

Suicide is a leading cause of death in the United States, having increased more than 30% from 2000 to 2018. An inexpensive, safe, widely available treatment for preventing suicidal behavior could reverse this trend.

Objective

To confirm a previous signal for decreased risk of suicide attempt following prescription fills for folic acid in a national pharmacoepidemiologic study of patients treated with folic acid.

Design, Setting, and Participants

A within-person exposure-only cohort design was used to study the dynamic association between folic acid (vitamin B9) prescription fills over a 24-month period and suicide attempts and intentional self-harm. Data were collected from a pharmacoepidemiologic database of US medical claims (MarketScan) for patients with private health insurance who filled a folic acid prescription between 2012 and 2017. The same analysis was repeated with a control supplement (cyanocobalamin, vitamin B12). Data were analyzed from August 2021 to June 2022.

Exposure

Folic acid prescription fills.

Main Outcome and Measure

Suicide attempt or intentional self-harm resulting in an outpatient visit or inpatient admission as identified by codes from the International Statistical Classification of Diseases, Ninth and Tenth Revisions, Clinical Modification.

Results

Data on 866 586 patients were collected; 704 514 (81.30%) were female, and 90 296 (10.42%) were 60 years and older. Overall, there were 261 suicidal events during months covered by a folic acid prescription (5 521 597 person-months) for a rate of 4.73 per 100 000 person-months, compared with 895 suicidal events during months without folic acid (8 432 340) for a rate of 10.61 per 100 000 person-months. Adjusting for age and sex, diagnoses related to suicidal behavior, diagnoses related to folic acid deficiency, folate-reducing medications, history of folate-reducing medications, and history of suicidal events, the hazard ratio (HR) for folic acid for suicide events was 0.56 (95% CI, 0.48-0.65), with similar results for the modal dosage of 1 mg of folic acid per day (HR, 0.57; 95% CI, 0.48-0.69) and women of childbearing age (HR, 0.60; 95% CI, 0.50-0.73). A duration-response analysis (1-mg dosage) revealed a 5% decrease in suicidal events per month of additional treatment (HR, 0.95; 95% CI, 0.93-0.97). The same analysis for the negative control, cyanocobalamin, found no association with suicide attempt (HR, 1.01; 95% CI, 0.80-1.27).

Conclusions and Relevance

This large-scale pharmacoepidemiologic study of folic acid found a beneficial association in terms of lower rates of suicide attempts. The results warrant the conduct of a randomized clinical trial with suicidal ideation and behavior as outcomes of interest. If confirmed, folic acid may be a safe, inexpensive, and widely available treatment for suicidal ideation and behavior.

Awareness of illness moderates self-assessment of psychotic symptoms

OBJECTIVE

Self-reports or patient-reported outcome measures are seldom used in psychosis due to concerns about the ability of patients to accurately report their symptomatology, particularly in cases of low awareness of illness. The aim of this study was to assess the effect of insight on the accuracy of self-reported psychotic symptoms using a computerized adaptive testing tool (CAT-Psychosis).

METHODS

A secondary analysis of data drawn from the CAT-Psychosis development and validation study was performed. The Brief Psychiatric Rating Scale and the Scale of Unawareness of Mental Disorders were administered by clinicians. Patients completed the self-reported version of the CAT-Psychosis. Patients were median-split regarding their insight level to compare the correlation between the two psychosis severity measures. A subgroup sensitivity analysis was performed only on patients with schizophrenia spectrum disorders.

RESULTS

A total of 159 patients with a psychotic disorder who completed both CAT-Psychosis and Scale of Unawareness of Mental Disorders were included. For the whole sample, CAT-Psychosis scores showed convergent validity with Brief Psychiatric Rating Scale ratings (r = 0.517, 95% confidence interval = [0.392, 0.622], p < 0.001). Insight was found to moderate this correlation (β = -0.511, p = 0.005), yet agreement between both measures remained statistically significant for both high (r = 0.621, 95% confidence interval = [0.476, 0.733], p < 0.001) and low insight patients (r = 0.408, 95% confidence interval = [0.187, 0.589], p < 0.001), while psychosis severity was comparable between these groups (for Brief Psychiatric Rating Scale: U = 3057, z = -0.129, p = 0.897; disorganization: U = 2986.5, z = -0.274, p = 0.784 and for CAT-Psychosis: U = 2800.5, z = -1.022, p = 0.307). Subgroup of patients with schizophrenia spectrum disorders showed very similar results.

CONCLUSIONS

Insight moderates the correlation between self-reported and clinician-rated severity of psychosis, yet CAT-Psychosis remains valid in patients with both high and low awareness of illness.

Computer adaptive testing to assess impairing behavioral health problems in emergency department patients with somatic complaints

Objectives

To assess: (1) the prevalence of mental health and substance use in patients presenting to the emergency department (ED) through use of a computer adaptive test (CAT‐MH), (2) the correlation among CAT‐MH scores and self‐ and clinician‐reported assessments, and (3) the association between CAT‐MH scores and ED utilization in the year prior and 30 days after enrollment.

Methods

This was a single‐center observational study of adult patients presenting to the ED for somatic complaints (97%) from May 2019 to March 2020. The main outcomes were computer‐adaptive‐assessed domains of suicidality, depression, anxiety, post‐traumatic stress disorder (PTSD), and substance use. We conducted Pearson correlations and logistic regression for objectives 2 and 3, respectively.

Results

From a sample of 794 patients, the proportion of those at moderate/severe risk was: 24.1% (suicidality), 8.3% (depression), 16.5% (anxiety), 12.3% (PTSD), and 20.4% (substance use). CAT‐MH domains were highly correlated with self‐report assessments (r = 0.49–0.79). Individuals who had 2 or more ED visits in the prior year had 62% increased odds of being in the intermediate‐high suicide risk category (odds ratio [OR], 1.62; 95% confidence interval [CI], 1.07–2.44) compared to those with zero prior ED visits. Individuals who scored in the intermediate‐high‐suicide risk group had 63% greater odds of an ED visit within 30 days after enrollment compared to those who scored as low risk (OR, 1.63; 95% CI, 1.09, 2.44).

Conclusion

The CAT‐MH documented that a considerable proportion of ED patients presenting for somatic problems had mental health conditions, even if mild. Mental health problems were also associated with ED utilization.

Outcomes During and After Early Intervention Services for First-Episode Psychosis: Results Over 5 Years From the RAISE-ETP Site-Randomized Trial

To examine long-term effects of early intervention services (EIS) for first-episode psychosis, we compared Heinrichs-Carpenter Quality of Life (QLS) and Positive and Negative Syndrome Scale (PANSS) scores and inpatient hospitalization days over 5 years with data from the site-randomized RAISE-ETP trial that compared the EIS NAVIGATE (17 sites; 223 participants) and community care (CC) (17 sites; 181 participants). Inclusion criteria were: age 15-40 years; DSM-IV diagnoses of schizophrenia, schizoaffective disorder, schizophreniform disorder, brief psychotic disorder, or psychotic disorder not otherwise specified; first psychotic episode; antipsychotic medication taken for ≤6 months. NAVIGATE-randomized participants could receive NAVIGATE from their study entry date until NAVIGATE ended when the last-enrolled NAVIGATE participant completed 2 years of treatment. Assessments occurred every 6 months. 61% of participants had assessments conducted ≥2 years; 31% at 5 years. Median follow-up length was CC 30 months and NAVIGATE 38 months. Primary analyses assumed data were not-missing-at-random (NMAR); sensitivity analyses assumed data were missing-at-random (MAR). MAR analyses found no significant treatment-by-time interactions for QLS or PANSS. NMAR analyses revealed that NAVIGATE was associated with a 13.14 (95%CI:6.92,19.37) unit QLS and 7.73 (95%CI:2.98,12.47) unit PANSS better improvement and 2.53 (95%CI:0.59,4.47) fewer inpatient days than CC (all comparisons significant). QLS and PANSS effect sizes were 0.856 and 0.70. NAVIGATE opportunity length (mean 33.8 (SD = 5.1) months) was not associated (P = .72) with QLS outcome; duration of untreated psychosis did not moderate (P = .32) differential QLS outcome. While conclusions are limited by the low rate of five-year follow-up, the data support long-term benefit of NAVIGATE compared to community care.

Radiological risk assessment of the Hunters Point Naval Shipyard (HPNS)

Hunters Point Naval Shipyard in San Francisco, California was deemed a Superfund site by the USEPA in 1989 due to chemical and radiological contamination resulting from U.S. Navy operations from 1939 to 1974. During characterization and remediation efforts, over 50,000 radiological soil samples and 19,000 air samples were collected. This risk assessment, conducted in accordance with federal guidelines, represents the first comprehensive evaluation of past, present, and future health risks associated with radionuclides present at the site. The assessment indicated that before site remediation, most radionuclide soil concentrations were at or near local background concentrations. Had such low remedial goals not been established, significant remediation of surface soils would not have been necessary to protect human health. The pre-remediation lifetime incremental cancer morbidity risks for on-site workers and theoretical on-site residents due to radionuclide contamination were found to be 1.3 × 10^-6 and 3.2 × 10^-6, respectively. The post-remediation risks to future on-site residents were found to be 6.3 × 10^-8 (without durable cover) and 3.7 × 10^-8 (with durable cover), while post-remediation risks to on-site workers were found to be 2.6 × 10^-8 (without durable cover) and 1.6 × 10^-8 (with durable cover). Risk estimates for all scenarios were found to be significantly below the acceptable risk of 3 × 10^-4 approved by regulatory agencies. Upwind and downwind air samples collected during remediation indicate that remediation activities never posed a measurable risk to off-site residents. This risk assessment emphasizes the importance of establishing clear and scientifically rigorous soil remedial goals at sites as well as understanding local radionuclide background concentrations.

Development of a computerized adaptive diagnostic screening tool for psychosis

We develop a two-stage diagnostic classification system for psychotic disorders using an extremely randomized trees machine learning algorithm. Item bank was developed from clinician-rated items drawn from an inpatient and outpatient sample. In stage 1, we differentiate schizophrenia and schizoaffective disorder from depression and bipolar disorder (with psychosis). In stage 2 we differentiate schizophrenia from schizoaffective disorder. Out of sample classification accuracy, determined by area under the receiver operator characteristic (ROC) curve, was outstanding for stage 1 (Area under the ROC curve (AUC) = 0.93, 95% confidence interval (CI) = 0.89, 0.94), and excellent for stage 2 (AUC = 0.86, 95% CI = 0.83, 0.88). This is achieved based on an average of 5 items for stage 1 and an average of 6 items for stage 2, out of a bank of 73 previously validated items.

Association of Zip Code Vaccination Rate With COVID-19 Mortality in Chicago, Illinois

Importance

There has been large geographic inequity in vaccination coverage across Chicago, Illinois, with higher vaccination rates in zip codes with residents who predominantly have high incomes and are White.

Objective

To determine the association between inequitable zip code-level vaccination coverage and COVID-19 mortality in Chicago.

Design, Setting, and Participants

This retrospective cohort study used Chicago Department of Public Health vaccination and mortality data and Cook County Medical Examiner mortality data from March 1, 2020, through November 6, 2021, to assess the association of COVID-19 mortality with zip code-level vaccination rates. Data were analyzed from June 1, 2021, to April 13, 2022.

Exposures

Zip code-level first-dose vaccination rates before the Alpha and Delta waves of COVID-19.

Main Outcomes and Measures

The primary outcome was deaths from COVID-19 during the Alpha and Delta waves. The association of a marginal increase in zip code-level vaccination rate with weekly mortality rates was estimated with a mixed-effects Poisson regression model, and the total number of preventable deaths in the least vaccinated quartile of zip codes was estimated with a linear difference-in-difference design.

Results

The study population was 2 686 355 Chicago residents in 52 zip codes (median [IQR] age 34 [32-38] years; 1 378 658 [51%] women; 773 938 Hispanic residents [29%]; 783 916 non-Hispanic Black residents [29%]; 894 555 non-Hispanic White residents [33%]). Among residents in the least vaccinated quartile, 80% were non-Hispanic Black, compared with 8% of residents identifying as non-Hispanic Black in the most vaccinated quartile (P < .001). After controlling for age distribution and recovery from COVID-19, a 10-percentage point increase in zip code-level vaccination 6 weeks before the peak of the Alpha wave was associated with a 39% lower relative risk of death from COVID-19 (incidence rate ratio [IRR], 0.61 [95% CI, 0.52-0.72]). A 10-percentage point increase in zip code vaccination rate 6 weeks before the peak of the Delta wave was associated with a 24% lower relative risk of death (IRR, 0.76 [95% CI, 0.66-0.87]). The difference-in-difference estimate was that 119 Alpha wave deaths (72% [95% CI, 63%-81%]) and 108 Delta wave deaths (75% [95% CI, 66%-84%]) might have been prevented in the least vaccinated quartile of zip codes if it had had the vaccination coverage of the most vaccinated quartile.

Conclusions and Relevance

These findings suggest that low zip code-level vaccination rates in Chicago were associated with more deaths during the Alpha and Delta waves of COVID-19 and that inequitable vaccination coverage exacerbated existing racial and ethnic disparities in COVID-19 deaths.

Associations of opioid prescription dose and discontinuation with risk of substance-related morbidity in long-term opioid therapy

ABSTRACT

Efforts to reduce opioid-related harms have decreased opioid prescription but have provoked concerns about unintended consequences, particularly for long-term opioid therapy (LtOT) recipients. Research is needed to address the knowledge gap regarding how risk of substance-related morbidity changes across LtOT and its discontinuation. This study used nationwide commercial insurance claims data and a within-individual design to examine associations of LtOT dose and discontinuation with substance-related morbidity. We identified 194,839 adolescents and adults who initiated opioid prescription in 2010 to 2018 and subsequently received LtOT. The cohort was followed for a median of 965 days (interquartile range, 525-1550), of which a median of 176 days (119-332) were covered by opioid prescription. During follow-up, there were 17,582 acute substance-related morbidity events, defined as claims for emergency visits, inpatient hospitalizations, and ambulance transportation with substance use disorder or overdose diagnoses. Relative to initial treatment, risk was greater within individual during subsequent periods of >60 to 120 (adjusted odds ratio [OR], 1.29; 95% CI, 1.12 to 1.49) and >120 (OR, 1.48; 95% CI, 1.24-1.76) daily morphine milligram equivalents. Risk was also greater during days 1 to 30 after discontinuations than during initial treatment (OR, 1.19; 95% CI, 1.05-1.35). However, it was no greater than during the 30 days before discontinuations, indicating that the risk may not be wholly attributable to discontinuation itself. Results were supported by a negative control pharmacotherapy analysis and additional sensitivity analyses. They suggest that LtOT recipients may experience increased substance-related morbidity risk during treatment subsequent to initial opioid prescription, particularly in periods involving higher doses.

Development of a computerized adaptive substance use disorder scale for screening, measurement and diagnosis - The CAT-SUD-E

Introduction

The Computerized Adaptive Test for Substance Use Disorder (CAT-SUD), an adaptive test based on multidimensional item response theory, has been expanded to include 7 specific Diagnostic and Statistical Manual, 5th edition (DSM-5) defined SUDs. Initial testing of the new measure, the CAT-SUD expanded (CAT-SUD-E) is reported here.

Methods

275 Community-dwelling adults (ages 18-68) responded to public and social-media advertisements. Participants virtually completed both the CAT-SUD-E and the Structured Clinical Interview for DSM-5, Research Version (SCID) to assess the validity of the CAT-SUD-E in determining whether participants met criteria for specific DSM-5 SUDs. Diagnostic classifications were based on 7 SUDs, each with 5 items, for current and lifetime SUDs.

Results

For SCID-based presence of any lifetime SUD, predictions based on the overall CAT-SUD-E diagnosis and severity score were AUC=0.92, 95% CI = 0.88, 0.95 for current and AUC=0.94, 95% CI = 0.91, 0.97 for lifetime. For individual diagnoses, classification accuracy for current SUDs ranged from an AUC=0.76 for alcohol to AUC=0.92 for nicotine/tobacco. Classification accuracy for lifetime SUDs ranged from an AUC=0.81 for hallucinogens to AUC=0.96 for stimulants. Median CAT-SUD-E completion time was under 4 min.

Conclusions

The CAT-SUD-E quickly produces similar results as lengthy structured clinical interviews for overall SUD and substance-specific SUDs, with high precision and accuracy, through a combination of fixed-item responses for diagnostic classification and adaptive SUD severity measurement. The CAT-SUD-E harmonizes information from mental health, trauma, social support and traditional SUD items to provide a more complete characterization of SUD and provides both diagnostic classification and severity measurement.

Psychosis Biotypes: Replication and Validation from the B-SNIP Consortium

Current clinical phenomenological diagnosis in psychiatry neither captures biologically homologous disease entities nor allows for individualized treatment prescriptions based on neurobiology. In this report, we studied two large samples of cases with schizophrenia, schizoaffective, and bipolar I disorder with psychosis, presentations with clinical features of hallucinations, delusions, thought disorder, affective, or negative symptoms. A biomarker approach to subtyping psychosis cases (called psychosis Biotypes) captured neurobiological homology that was missed by conventional clinical diagnoses. Two samples (called "B-SNIP1" with 711 psychosis and 274 healthy persons, and the "replication sample" with 717 psychosis and 198 healthy persons) showed that 44 individual biomarkers, drawn from general cognition (BACS), motor inhibitory (stop signal), saccadic system (pro- and anti-saccades), and auditory EEG/ERP (paired-stimuli and oddball) tasks of psychosis-relevant brain functions were replicable (r's from .96-.99) and temporally stable (r's from .76-.95). Using numerical taxonomy (k-means clustering) with nine groups of integrated biomarker characteristics (called bio-factors) yielded three Biotypes that were virtually identical between the two samples and showed highly similar case assignments to subgroups based on cross-validations (88.5%-89%). Biotypes-1 and -2 shared poor cognition. Biotype-1 was further characterized by low neural response magnitudes, while Biotype-2 was further characterized by overactive neural responses and poor sensory motor inhibition. Biotype-3 was nearly normal on all bio-factors. Construct validation of Biotype EEG/ERP neurophysiology using measures of intrinsic neural activity and auditory steady state stimulation highlighted the robustness of these outcomes. Psychosis Biotypes may yield meaningful neurobiological targets for treatments and etiological investigations.

Validation of a Computerized Adaptive Test Suicide Scale (CAT-SS) among United States Military Veterans

To validate the Computerized Adaptive Test Suicide Scale (CAT-SS), Veterans completed measures at baseline (n = 305), and 6- (n = 249), and 12-months (n = 185), including the CAT-SS (median items 11, duration of administration 107 seconds) and the Columbia-Suicide Severity Rating Scale (C-SSRS). Logistic regression was used to relate CAT-SS scores (baseline) to C-SSRS assessed outcomes (active ideation with plan and intent; attempt; interrupted, aborted or self-interrupted attempt, or preparatory acts or behaviors; all outcomes combined). A mixed-effects logistic regression model was used to evaluate the relationship between the lagged CAT-SS scores and outcomes (6- and 12-months). The baseline CAT-SS demonstrated predictive accuracy for all outcomes at 6-months, and similar results were found for baseline and all outcomes at and through 12-months. Longitudinal analysis revealed for every 10-point change in the CAT-SS there was a 50-77% increase in the likelihood of suicide-related outcomes. The CAT-SS demonstrated added value when compared to current suicide risk prediction practices.

Use of central nervous system drugs in combination with selective serotonin reuptake inhibitor treatment: A Bayesian screening study for risk of suicidal behavior

BACKGROUND

Using other central nervous system (CNS) medications in combination with selective serotonin reuptake inhibitor (SSRI) treatment is common. Despite this, there is limited evidence on the impact on suicidal behavior of combining specific medications. We aim to provide evidence on signals for suicidal behavior risk when initiating CNS drugs during and outside of SSRI treatment.

MATERIALS AND METHODS

Using a linkage of Swedish national registers, we identified a national cohort of SSRI users aged 6-59 years residing in Sweden 2006-2013. We used a two-stage Bayesian Poisson model to estimate the incidence rate ratio (IRR) of suicidal behavior in periods up to 90 days before and after a CNS drug initiation during SSRI treatment, while accounting for multiple testing. For comparison, and to assess whether there were interactions between SSRIs and other CNS drugs, we also estimated the IRR of initiating the CNS drug without SSRI treatment.

RESULTS

We identified 53 common CNS drugs initiated during SSRI treatment, dispensed to 262,721 individuals. We found 20 CNS drugs with statistically significant IRRs. Of these, two showed a greater risk of suicidal behavior after versus before initiating the CNS drug (alprazolam, IRR = 1.39; flunitrazepam, IRR = 1.83). We found several novel signals of drugs that were statistically significantly associated with a reduction in the suicidal behavior risk. We did not find evidence of harmful interactions between SSRIs and the selected CNS drugs.

CONCLUSION

Several of the detected signals for reduced risk correspond to drugs where there is previous evidence of benefit for antidepressant augmentation (e.g., olanzapine, quetiapine, lithium, buspirone, and mirtazapine). Novel signals of reduced suicidal behavior risk, including for lamotrigine, valproic acid, risperidone, and melatonin, warrant further investigation.

Preoperative Assessment of Anxiety and Depression Using Computerized Adaptive Screening Tools: A Pilot Prospective Cohort Study

BACKGROUND

Serious mental health conditions (eg, anxiety and depression) are common in surgical patients, yet likely underassessed due to the time-consuming and cumbersome traditional screening process. A recently developed computerized adaptive mental health assessment tool (computerized adaptive test-mental health [CAT-MH]) allows rapid, precise, and accurate assessment of numerous mental health disorders, including anxiety and depression, without the need for a trained interviewer. The goal of this investigation was to determine the feasibility of administering CAT-MH for anxiety and depression in the preoperative setting and to obtain preliminary evidence of the prevalence of anxiety and depression in preoperative patients.

METHODS

In this prospective cohort study, 100 adult patients scheduled for elective surgery were enrolled and asked to complete the CAT-MH in the preoperative clinic. Urgent and emergency surgeries were excluded as were pregnant patients. Primary feasibility outcomes were completion rate and time to completion. Secondary outcomes were prevalence estimates of anxiety and depression.

RESULTS

All 100 enrolled patients completed the study. All patients were able to complete the mental health assessment (mean time: 3.6 ± 1.8 minutes standard deviation). Sixteen patients (16%) screened positive for anxiety (severity: mild, n = 7 [7%]; moderate, n = 7 [7%]); severe, n = 2 [2%]); 12 of 16 (75%) did not have a previous diagnosis of anxiety disorder. Twenty-eight (28%) patients screened positive for depression (severity: mild, n = 26 [26%]; moderate and severe, n = 1 each [1%]); 23 of 28 (82%) had no previous diagnosis of depressive disorder. Nineteen patients (19%) met the screening criteria for major depressive disorder; 14 of 19 (74%) of which had no previous diagnosis of major depressive disorder.

CONCLUSIONS

The results of this pilot study support the feasibility of using CAT-MH in a preoperative evaluation and indicate that there is a substantial prevalence of undiagnosed anxiety and depression in surgical patients.

Depression and anxiety symptoms across pregnancy and the postpartum in low-income Black and Latina women

Underserved women of color experience high rates of perinatal affective disorders, but most research to date on the natural history of these disorders has been conducted on White women. The present study investigated longitudinal changes in anxiety and depression in a sample of perinatal non-Hispanic Black and Latina women. Categorical (yes/no) measures of positive anxiety and depression screens, as well as total symptom scores, were measured longitudinally across the perinatal period in 178 women (115 non-Hispanic Black, 63 Latina) using the CAT-MH™, a computerized adaptive test. Time (up to 4 visits) and race/ethnicity effects were assessed in linear mixed effects models. Rates of positive anxiety screenings were 13.6%, 3.2%, 8.5%, and 0% in Latina women and 2.6%, 4.2%, 6.1%, and 5.8% in non-Hispanic Black women in the 1^st, 2^nd, and 3^rd trimesters, and postpartum, respectively. Rates of positive anxiety screenings overall were highest in the first trimester (OR = 0.20; 95% CI 0.04-0.98), and there was a significant time-by-race/ethnicity interaction for positive anxiety screens (OR = 8.88; 95% CI 1.42-55.51), as positive screens were most frequent in the first trimester and sharply declined for Latina women, while rates were relatively consistent across the perinatal period in non-Hispanic Black women. Rates of positive depression screens did not change over time, but there was a trend (OR = 1.93; 95% CI 0.93-4.03) for a time-by-race/ethnicity interaction in a direction similar to that seen for anxiety. The odds of positive anxiety screens vary by race/ethnicity and trimester, suggesting that anxiety screening and anxiety interventions may be most resourcefully used in the first trimester for Latina women in particular.

Assessment of Comorbid Depression and Anxiety in Inflammatory Bowel Disease Using Adaptive Testing Technology

Background

Depression and anxiety are comorbidities of inflammatory bowel disease (IBD), and it is now recommended to screen IBD patients for these conditions. We screened patients using a novel computerized adaptive testing technology and compared the screening results to measures of disease activity.

Methods

Consecutive patients at our tertiary IBD clinic were asked to complete the validated CAT-MH™ survey (Adaptive Testing Technologies, Chicago, IL); we then reviewed disease and patient characteristics. Clinical remission status was determined based on clinical, laboratory, endoscopy and imaging results. Statistical methods included Fisher's exact test and Pearson Chi-square tests to assess association. Univariable and multivariable analyses were performed.

Results

We included 134 patients, of which 34 (25.3%) screened positive for depression and 18 (13.4%) screened positive for anxiety. We identified 19 (55.9 %) and 10 (55.5%) patients who were previously undiagnosed for depression and anxiety, respectively. Patients in clinical remission were less likely to screen positive for depression (OR 0.19; 95%CI 0.07-0.50) and for anxiety (OR 0.30; 95%CI 0.10-0.91). Compared to patients with negative CRP values, patients with positive CRP were more likely to also screen positive for depression (p=0.025) and anxiety (p=0.15).

Conclusions

We demonstrate the utility of a novel testing technology for screening patients with IBD for depression and anxiety. We found a large number of patients with previously undiagnosed anxiety or depression and a significant positive association between clinically active IBD and these mental health conditions. This work supports and informs recommendations for mental health screening in the IBD population.

Between-center variation in high-priority listing status under the new heart allocation policy

Under the new US heart allocation policy, transplant centers listed significantly more candidates at high priority statuses (Status 1 and 2) with mechanical circulatory support devices than expected. We determined whether the practice change was widespread or concentrated among certain transplant centers. Using data from the Scientific Registry of Transplant Recipients, we used mixed-effect logistic regression to compare the observed listings of adult, heart-alone transplant candidates post-policy (December 2018 to February 2020) to seasonally matched pre-policy cohort (December 2016 to February 2018). US transplant centers (N = 96) listed similar number of candidates in each policy period (4472 vs. 4498) but listed significantly more at high priority status (25.5% vs. 7.0%, p < .001) than expected. Adjusted for candidate characteristics, 91 of 96 (94.8%) centers listed significantly more candidates at high-priority status than expected, with the unexpected increase varying from 4.8% to 50.4% (interquartile range [IQR]: 14.0%-23.3%). Centers in OPOs with highest Status 1A transplant rate pre-policy were significantly more likely to utilize high-priority status under the new policy (OR: 9.73, p = .01). The new heart allocation policy was associated with widespread and significantly variable changes in transplant center practice that may undermine the effectiveness of the new system.

Development and Validation of Computerized Adaptive Assessment Tools for the Measurement of Posttraumatic Stress Disorder Among US Military Veterans

IMPORTANCE

Veterans from recent and past conflicts have high rates of posttraumatic stress disorder (PTSD). Adaptive testing strategies can increase accuracy of diagnostic screening and symptom severity measurement while decreasing patient and clinician burden.

OBJECTIVE

To develop and validate a computerized adaptive diagnostic (CAD) screener and computerized adaptive test (CAT) for PTSD symptom severity.

DESIGN, SETTING, AND PARTICIPANTS

A diagnostic study of measure development and validation was conducted at a Veterans Health Administration facility. A total of 713 US military veterans were included. The study was conducted from April 25, 2017, to November 10, 2019.

MAIN OUTCOMES AND MEASURES

The participants completed a PTSD-symptom questionnaire from the item bank and provided responses on the PTSD Checklist for Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition (DSM-5) (PCL-5). A subsample of 304 participants were interviewed using the Clinician-Administered Scale for PTSD for DSM-5.

RESULTS

Of the 713 participants, 585 were men; mean (SD) age was 52.8 (15.0) years. The CAD-PTSD reproduced the Clinician-Administered Scale for PTSD for DSM-5 PTSD diagnosis with high sensitivity and specificity as evidenced by an area under the curve of 0.91 (95% CI, 0.87-0.95). The CAT-PTSD demonstrated convergent validity with the PCL-5 (r = 0.88) and also tracked PTSD diagnosis (area under the curve = 0.85; 95% CI, 0.79-0.89). The CAT-PTSD reproduced the final 203-item bank score with a correlation of r = 0.95 with a mean of only 10 adaptively administered items, a 95% reduction in patient burden.

CONCLUSIONS AND RELEVANCE

Using a maximum of only 6 items, the CAD-PTSD developed in this study was shown to have excellent diagnostic screening accuracy. Similarly, using a mean of 10 items, the CAT-PTSD provided valid severity ratings with excellent convergent validity with an extant scale containing twice the number of items. The 10-item CAT-PTSD also outperformed the 20-item PCL-5 in terms of diagnostic accuracy. The results suggest that scalable, valid, and rapid PTSD diagnostic screening and severity measurement are possible.

Predicting suicidality using a computer adaptive test: Two longitudinal studies of sexual and gender minority youth

OBJECTIVE

Over the past decade, rates of death by suicide have increased among youth. Efficient and effective screening approaches are needed for suicide prevention. Sexual and gender minority youth (SGMY) experience profound disparities, but little is known about subgroups and risk assessments need to be validated. This study tested the psychometric properties and predictive value of a highly efficient computerized adaptive test for suicide risk (CAT-SS) among SGMY.

METHODS

Participants in two cohort studies of SGMY completed the CAT-SS and validated measures of suicidality in 2018 (n = 1,073) and at their follow-up visit 6 months later (n = 936). Tests of psychometrics and predictive validity were performed.

RESULTS

Younger, assigned female at birth, nonmonosexual (e.g., bisexual; relative to monosexual), and gender nonconforming or nongender binary (relative to cisgender and transgender) participants had significantly higher CAT-SS scores. None of the CAT-SS items met the threshold for differential item functioning. In longitudinal analyses, prediction of suicidality moved from poor to good accuracy once CAT-SS was included in the model. CAT-SS significantly improved prediction of suicidality over-and-above reported suicidality at a prior wave.

CONCLUSIONS

The current study validated CAT-SS as a brief predictor of suicide risk in the disproportionately affected population of SGMY. Screening of SGMY in clinical and community settings using CAT-SS could allow for the identification of participants that need services to reduce their risk of future suicide. Results support the need for particular attention to suicide prevention among SGMY who are teenagers, assigned female at birth, nonmonosexual, and gender nonconforming or nongender binary. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

Dr. Gibbons et al. Reply

We thank Kaufman et al.¹ for their comprehensive review of the many commendable features of the Kiddie-Computerized Adaptive Test (K-CAT). We do wish to clarify what may be a misunderstanding of the intent of the K-CAT and our view of its role in treatment planning.

Development and Validation of a Computerized Adaptive Assessment Tool for Discrimination and Measurement of Psychotic Symptoms

OBJECTIVE

Time constraints limit the use of measurement-based approaches in research and routine clinical management of psychosis. Computerized adaptive testing (CAT) can reduce administration time, thus increasing measurement efficiency. This study aimed to develop and test the capacity of the CAT-Psychosis battery, both self-administered and rater-administered, to measure the severity of psychotic symptoms and discriminate psychosis from healthy controls.

METHODS

An item bank was developed and calibrated. Two raters administered CAT-Psychosis for inter-rater reliability (IRR). Subjects rated themselves and were retested within 7 days for test-retest reliability. The Brief Psychiatric Rating Scale (BPRS) was administered for convergent validity and chart diagnosis, and the Structured Clinical Interview (SCID) was used to test psychosis discriminant validity.

RESULTS

Development and calibration study included 649 psychotic patients. Simulations revealed a correlation of r = .92 with the total 73-item bank score, using an average of 12 items. Validation study included 160 additional patients and 40 healthy controls. CAT-Psychosis showed convergent validity (clinician: r = 0.690; 95% confidence interval [95% CI]: 0.610-0.757; self-report: r = .690; 95% CI: 0.609-0.756), IRR (intraclass correlation coefficient [ICC] = 0.733; 95% CI: 0.611-0.828), and test-retest reliability (clinician ICC = 0.862; 95% CI: 0.767-0.922; self-report ICC = 0.815; 95%CI: 0.741-0.871). CAT-Psychosis could discriminate psychosis from healthy controls (clinician: area under the receiver operating characteristic curve [AUC] = 0.965, 95% CI: 0.945-0.984; self-report AUC = 0.850, 95% CI: 0.807-0.894). The median length of the clinician-administered assessment was 5 minutes (interquartile range [IQR]: 3:23-8:29 min) and 1 minute, 20 seconds (IQR: 0:57-2:09 min) for the self-report.

CONCLUSION

CAT-Psychosis can quickly and reliably assess the severity of psychosis and discriminate psychotic patients from healthy controls, creating an opportunity for frequent remote assessment and patient/population-level follow-up.

Reducing Opioid Mortality in Illinois (ROMI): A case management/peer recovery coaching critical time intervention clinical trial protocol

Individuals with a history of opioid use are disproportionately represented in Illinois jails and prisons and face high risks of overdose and relapse at community reentry. Case management and peer recovery coaching are established interventions that may be leveraged to improve linkage to substance use treatment and supportive services during these critical periods of transition. We present the protocol for the Reducing Opioid Mortality in Illinois (ROMI), a type I hybrid effectiveness-implementation randomized trial of a case management, peer recovery coaching and overdose education and naloxone distribution (CM/PRC + OEND) critical time intervention (CTI) compared to OEND alone. The CM/PRC + OEND is a novel, 12-month intervention that involves linkage to substance use treatment and support for continuity of care, skills building, and navigation and engagement of social services that will be implemented using a hub-and-spoke model of training and supervision across the study sites. At least 1000 individuals released from jails and prisons spanning urban and rural settings will be enrolled. The primary outcome is engagement in medication for opioid use disorder. Secondary outcomes include health insurance enrollment, mental health service engagement, and re-arrest/recidivism, parole violation, and/or reincarceration. Mixed methods will be used to evaluate process and implementation outcomes including fidelity to, barriers to, facilitators of, and cost of the intervention. Videoconferencing and other remote processes will be leveraged to modify the protocol for safety during the COVID-19 pandemic. Results of the study may improve outcomes for vulnerable persons at the margin of behavioral health and the criminal legal system.

Computerized-Adaptive vs. Traditional Ratings of Depression and Suicidal Thoughts: An Assay Sensitivity Pilot Study in a Ketamine Clinical Trial

There is a public health need for improved suicide risk assessment tools. This pilot methodology study compared the assay sensitivity of computerized adaptive tests (CAT) of depression and suicidal ideation vs. traditional ratings in a randomized trial subgroup. The last 20 persons to enroll in a published ketamine trial in suicidal depression were studied. This subgroup received traditional and CAT ratings at baseline, 24 h post-infusion and follow-up week 2, 4, and 6: Hamilton Depression Rating Scale, Beck Depression Inventory, and Beck Scale for Suicidal Ideation vs. the CAT-Depression Inventory and CAT-Suicide Scale. Results showed larger effect sizes (ES) for CAT compared with traditional clinician-rated and self-report scales. Coefficients of variation for baseline measurements were lower for CAT compared with traditional scales. This is the first study to show that CAT may have greater assay sensitivity for treatment effects, particularly for suicidal ideation, compared with traditional clinician-rated and non-adaptive self-rated scales in a randomized trial. The findings suggest CAT can enable quick long-term follow-up assessments via cellphone, tablet, or computer while minimizing response bias due to repeated measurement of the same symptom items. Clinical Trial Registration: www.ClinicalTrials.gov, identifier: NCT01700829.

Effect of Long-Acting Injectable Antipsychotics vs Usual Care on Time to First Hospitalization in Early-Phase Schizophrenia: A Randomized Clinical Trial

IMPORTANCE

Long-acting injectable antipsychotics (LAIs) can potentially reduce hospitalization risk by enhancing medication adherence but are rarely considered for early-phase schizophrenia treatment.

OBJECTIVE

To determine whether encouraging use of a LAI compared with usual care delays the time to first hospitalization with patients with early-phase illness.

DESIGN, SETTING, AND PARTICIPANTS

The Prevention of Relapse in Schizophrenia (PRELAPSE) trial was cluster randomized with a follow-up duration of 2 years. The study began in December 2014, was completed in March 2019, and was conducted in 39 mental health centers in 19 US states. Site randomization assigned 19 clinics to encourage treatment with long-acting aripiprazole monohydrate (aripiprazole once monthly [AOM] condition) and 20 to provide treatment as usual (clinician's choice [CC] condition). Participant eligibility criteria included (1) schizophrenia diagnosis confirmed by a structured clinical interview, (2) fewer than 5 years of lifetime antipsychotic use, and (3) age 18 to 35 years. The AOM sites identified 576 potentially eligible participants, of whom 234 (40.6%) enrolled; CC sites identified 685 potentially eligible participants, of whom 255 (37.2%) enrolled.

INTERVENTIONS

There were no restrictions on treatment at CC sites (including using LAIs) or at AOM sites with the exception that aripiprazole monohydrate had to be prescribed within US Food and Drug Administration-approved guidelines.

MAIN OUTCOMES AND MEASURES

The primary outcome was time to first psychiatric hospitalization based on participant interviews every 2 months, the service use resource form administered every 4 months, and other sources (eg, health records) as available. Potential events were adjudicated by an independent committee masked to treatment assignment.

RESULTS

The 489 participants (368 men [75.3%]) had a mean (SD) age of 25.2 (4.2) years and 225 (46.0%) had 1 year or less lifetime antipsychotic use. Fifty-two AOM (22%) and 91 CC participants (36%) had at least 1 hospitalization. The mean survival time until first hospitalization was 613.7 days (95% CI, 582.3-645.1 days) for AOM participants and 530.6 days (95% CI, 497.3-563.9 days) for CC participants. For time to first hospitalization, the hazard ratio was 0.56 (95% CI, 0.34- 0.92; P = .02), favoring AOM. Survival probabilities were 0.73 (95% CI, 0.65-0.83) for AOM participants and 0.58 (95% CI, 0.50-0.67) for CC participants. The number needed to treat to prevent 1 additional hospitalization was 7 participants treated with AOM compared with CC.

CONCLUSIONS AND RELEVANCE

Long-acting injectable antipsychotic use by patients with early-phase schizophrenia can significantly delay time to hospitalization, a personally and economically important outcome. Clinicians should more broadly consider LAI treatment for patients with early-phase illness.

TRIAL REGISTRATION

ClinicalTrials.gov Identifier: NCT02360319.

Computerized Adaptive Tests for Rapid and Accurate Assessment of Psychopathology Dimensions in Youth

OBJECTIVE

At least half of youths with mental disorders are unrecognized and untreated. Rapid, accurate assessment of child mental disorders could facilitate identification and referral and potentially reduce the occurrence of functional disability that stems from early-onset mental disorders.

METHOD

Computerized adaptive tests (CATs) based on multidimensional item response theory were developed for depression, anxiety, mania/hypomania, attention-deficit/hyperactivity disorder, conduct disorder, oppositional defiant disorder, and suicidality, based on parent and child ratings of 1,060 items each. In phase 1, CATs were developed from 801 participants. In phase 2, predictive, discriminant, and convergent validity were tested against semi-structured research interviews for diagnoses and suicidality in 497 patients and 104 healthy controls. Overall strength of association was determined by area under the receiver operating characteristic curve (AUC).

RESULTS

The child and parent independently completed the Kiddie-Computerized Adaptive Tests (K-CATs) in a median time of 7.56 and 5.03 minutes, respectively, with an average of 7 items per domain. The K-CATs accurately captured the presence of diagnoses (AUCs from 0.83 for generalized anxiety disorder to 0.92 for major depressive disorder) and suicidal ideation (AUC = 0.996). Strong correlations with extant measures were found (r ≥ 0.60). Test-retest reliability averaged r = 0.80.

CONCLUSION

These K-CATs provide a new approach to child psychopathology screening and measurement. Testing can be completed by child and parent in less than 8 minutes and yields results that are highly convergent with much more time-consuming structured clinical interviews and dimensional severity assessment and measurement. Testing of the implementation of the K-CAT is now indicated.

Effect of the Wingman-Connect Upstream Suicide Prevention Program for Air Force Personnel in Training: A Cluster Randomized Clinical Trial

IMPORTANCE

Suicide has been a leading manner of death for US Air Force personnel in recent years. Universal prevention programs that reduce suicidal thoughts and behaviors in military populations have not been identified.

OBJECTIVES

To determine whether the Wingman-Connect program for Airmen-in-training reduces suicidal ideation, depression, and occupational problems compared with a stress management program and to test the underlying network health model positing that cohesive, healthy units are protective against suicidal ideation.

DESIGN, SETTING, AND PARTICIPANTS

This cluster randomized clinical trial was conducted from October 2017 to October 2019 and compared classes of personnel followed up for 6 months. The setting was a US Air Force technical training school, with participants studied to their first base assignment, whether US or international. Participants in 216 classes were randomized, with an 84% retention rate. Data analysis was performed from November 2019 to May 2020.

INTERVENTIONS

The Wingman-Connect program used group skill building for cohesion, shared purpose, and managing career and personal stressors (3 blocks of 2 hours each). Stress management training covered cognitive and behavioral strategies (2 hours). Both conditions had a 1-hour booster session, plus text messages.

MAIN OUTCOMES AND MEASURES

The primary outcomes were scores on the suicidal ideation and depression scales of the Computerized Adaptive Test for Mental Health and self-reports of military occupational impairment. Class network protective factors hypothesized to mediate the effect of Wingman-Connect were assessed with 4 measures: cohesion assessed perceptions that classmates cooperate, work well together, and support each other; morale was measured with a single item used in other studies with military samples; healthy class norms assessed perceptions of behaviors supported by classmates; and bonds to classmates were assessed by asking each participant to name classmates whom they respect and would choose to spend time with.

RESULTS

A total of 215 classes including 1485 individuals (1222 men [82.3%]; mean [SD] age, 20.9 [3.1] years) participated; 748 individuals were enrolled in the Wingman-Connect program and 737 individuals were enrolled in the stress management program. At 1 month, the Wingman-Connect group reported lower suicidal ideation severity (effect size [ES], -0.23; 95% CI, -0.39 to -0.09; P = .001) and depression symptoms (ES, -0.24; 95% CI, -0.41 to -0.08; P = .002) and fewer occupational problems (ES, -0.14; 95% CI, -0.31 to -0.02; P = .02). At 6 months, the Wingman-Connect group reported lower depression symptoms (ES, -0.16; 95% CI, -0.34 to -0.02; P = .03), whereas the difference in suicidal ideation severity was not significant (ES, -0.13; 95% CI, -0.29 to 0.01; P = .06). The number needed to treat to produce 1 fewer participant with elevated depression at either follow-up point was 21. The benefits of the training on occupational problems did not extend past 1 month. The Wingman-Connect program strengthened cohesive, healthy class units, which helped reduce suicidal ideation severity (estimate, -0.035; 95% CI, -0.07 to -0.01; P = .02) and depression symptom scores (estimate, -0.039; 95% CI, -0.07 to -0.01; P = .02) at 1 month.

CONCLUSIONS AND RELEVANCE

Wingman-Connect is the first universal prevention program to reduce suicidal ideation and depression symptoms in a general Air Force population. Group training that builds cohesive, healthy military units is promising for upstream suicide prevention and may be essential for ecological validity. Extension of the program to the operational Air Force is recommended for maintaining continuity and testing the prevention impact on suicidal behavior.

TRIAL REGISTRATION

ClinicalTrials.gov Identifier: NCT04067401.

Attention-Deficit/Hyperactivity Disorder Medication and Unintentional Injuries in Children and Adolescents

OBJECTIVE

Our objective was to determine whether attention-deficit/hyperactivity disorder (ADHD) medication is associated with a decreased risk of unintentional injuries in children and adolescents in the United States across sexes, age groups and injury types.

METHOD

We used de-identified inpatient, outpatient, and filled prescription claims data from the Truven Health MarketScan Research Databases. Individuals were followed from January 1, 2005, date of first ADHD diagnosis, or medication prescription, or age 6 years, whichever occurred last, until December 31, 2014, first healthcare insurance disenrollment, or the first year at which their age was recorded as 19 years, whichever occurred first. A person was considered on ADHD medication during a given month if a prescription was filled in that month. The outcome was defined as emergency department visits for injuries, including traumatic brain injuries, with unintentional causes. Odds of having the outcome were compared between medicated and unmedicated months at the population-level and in within-individual analyses using logistic regression.

RESULTS

Among 1,968,146 individuals diagnosed with ADHD or receiving ADHD medication, 87,154 had at least one event. At the population level, medication use was associated with a lower risk of injuries, both in boys (odds ratio [OR] = 0.85; 95% CI = 0.84-0.86) and girls (OR = 0.87; 95% CI = 0.85-0.89). Similar results were obtained from within-individual analysis among male (OR = 0.72; 95% CI = 0.70-0.74) and female (OR = 0.72; 95% CI = 0.69-0.75) children, and among male (OR = 0.64; 95% CI = 0.60-0.67) and female (OR = 0.65; 95% CI = 0.60-0.71) adolescents. Similar results were found for traumatic brain injuries.

CONCLUSION

ADHD medication use was associated with a reduction of different types of unintentional injuries in children and adolescents of both sexes.

Development of a computerized adaptive substance use disorder scale for screening and measurement: the CAT-SUD

BACKGROUND AND AIMS

The focus of this paper is on the improvement of substance use disorder (SUD) screening and measurement. Using a multi-dimensional item response theory model, the bifactor model, we provide a psychometric harmonization between SUD, depression, anxiety, trauma, social isolation, functional impairment and risk-taking behavior symptom domains, providing a more balanced view of SUD. The aims are to (1) develop the item-bank, (2) calibrate the item-bank using a bifactor model that includes a primary dimension and symptom-specific subdomains, (3) administer using computerized adaptive testing (CAT) and (4) validate the CAT-SUD in Spanish and English in the United States and Spain.

DESIGN

Item bank construction, item calibration phase, CAT-SUD validation phase.

SETTING

Primary care, community clinics, emergency departments and patient-to-patient referrals in Spain (Barcelona and Madrid) and the United States (Boston and Los Angeles).

PARTICIPANTS/CASES

Calibration phase: the CAT-SUD was developed via simulation from complete item responses in 513 participants. Validation phase: 297 participants received the Composite International Diagnostic Interview (CIDI) and the CAT-SUD.

MEASUREMENTS

A total of 252 items from five subdomains: (1) SUD, (2) psychological disorders, (3) risky behavior, (4) functional impairment and (5) social support. CAT-SUD scale scores and CIDI SUD diagnosis.

FINDINGS

Calibration: the bifactor model provided excellent fit to the multi-dimensional item bank; 168 items had high loadings (> 0.4 with the majority > 0.6) on the primary SUD dimension. Using an average of 11 items (four to 26), which represents a 94% reduction in respondent burden (average administration time of approximately 2 minutes), we found a correlation of 0.91 with the 168-item scale (precision of 5 points on a 100-point scale).

VALIDATION

strong agreement was found between the primary CAT-SUD dimension estimate and the results of a structured clinical interview. There was a 20-fold increase in the likelihood of a CIDI SUD diagnosis across the range of the CAT-SUD (AUC = 0.85).

CONCLUSIONS

We have developed a new approach for the screening and measurement of SUD and related severity based on multi-dimensional item response theory. The bifactor model harmonized information from mental health, trauma, social support and traditional SUD items to provide a more complete characterization of SUD. The CAT-SUD is highly predictive of a current SUD diagnosis based on a structured clinical interview, and may be predictive of the development of SUD in the future.

Associating Psychotic Symptoms with Altered Brain Anatomy in Psychotic Disorders Using Multidimensional Item Response Theory Models

Reduced cortical thickness has been demonstrated in psychotic disorders, but its relationship to clinical symptoms has not been established. We aimed to identify the regions throughout neocortex where clinical psychosis manifestations correlate with cortical thickness. Rather than perform a traditional correlation analysis using total scores on psychiatric rating scales, we applied multidimensional item response theory to identify a profile of psychotic symptoms that was related to a region where cortical thickness was reduced. This analysis was performed using a large population of probands with psychotic disorders (N = 865), their family members (N = 678) and healthy volunteers (N = 347), from the 5-site Bipolar-Schizophrenia Network for Intermediate Phenotypes. Regional cortical thickness from structural magnetic resonance scans was measured using FreeSurfer; individual symptoms were rated using the Positive and Negative Syndrome Scale, Montgomery-Asberg Depression Rating Scale, and Young Mania Rating Scale. A cluster of cortical regions whose thickness was inversely related to severity of psychosis symptoms was identified. The regions turned out to be located contiguously in a large region of heteromodal association cortex including temporal, parietal and frontal lobe regions, suggesting a cluster of contiguous neocortical regions important to psychosis expression. When we tested the relationship between reduced cortical surface area and high psychotic symptoms we found no linked regions describing a related cortical set.

Association of Transplant Center With Survival Benefit Among Adults Undergoing Heart Transplant in the United States

IMPORTANCE

In the United States, the number of deceased donor hearts available for transplant is limited. As a proxy for medical urgency, the US heart allocation system ranks heart transplant candidates largely according to the supportive therapy prescribed by transplant centers.

OBJECTIVE

To determine if there is a significant association between transplant center and survival benefit in the US heart allocation system.

DESIGN, SETTING, AND PARTICIPANTS

Observational study of 29 199 adult candidates for heart transplant listed on the national transplant registry from January 2006 through December 2015 with follow-up complete through August 2018.

EXPOSURES

Transplant center.

MAIN OUTCOMES AND MEASURES

The survival benefit associated with heart transplant as defined by the difference between survival after heart transplant and waiting list survival without transplant at 5 years. Each transplant center's mean survival benefit was estimated using a mixed-effects proportional hazards model with transplant as a time-dependent covariate, adjusted for year of transplant, donor quality, ischemic time, and candidate status.

RESULTS

Of 29 199 candidates (mean age, 52 years; 26% women) on the transplant waiting list at 113 centers, 19 815 (68%) underwent heart transplant. Among heart transplant recipients, 5389 (27%) died or underwent another transplant operation during the study period. Of the 9384 candidates who did not undergo heart transplant, 5669 (60%) died (2644 while on the waiting list and 3025 after being delisted). Estimated 5-year survival was 77% (interquartile range [IQR], 74% to 80%) among transplant recipients and 33% (IQR, 17% to 51%) among those who did not undergo heart transplant, which is a survival benefit of 44% (IQR, 27% to 59%). Survival benefit ranged from 30% to 55% across centers and 31 centers (27%) had significantly higher survival benefit than the mean and 30 centers (27%) had significantly lower survival benefit than the mean. Compared with low survival benefit centers, high survival benefit centers performed heart transplant for patients with lower estimated expected waiting list survival without transplant (29% at high survival benefit centers vs 39% at low survival benefit centers; survival difference, -10% [95% CI, -12% to -8.1%]), although the adjusted 5-year survival after transplant was not significantly different between high and low survival benefit centers (77.6% vs 77.1%, respectively; survival difference, 0.5% [95% CI, -1.3% to 2.3%]). Overall, for every 10% decrease in estimated transplant candidate waiting list survival at a given center, there was an increase of 6.2% (95% CI, 5.2% to 7.3%) in the 5-year survival benefit associated with heart transplant.

CONCLUSIONS AND RELEVANCE

In this registry-based study of US heart transplant candidates, transplant center was associated with the survival benefit of transplant. Although the adjusted 5-year survival after transplant was not significantly different between high and low survival benefit centers, compared with centers with survival benefit significantly below the mean, centers with survival benefit significantly above the mean performed heart transplant for recipients who had significantly lower estimated expected 5-year waiting list survival without transplant.

Improving the Evaluation of Adult Mental Disorders in the Criminal Justice System With Computerized Adaptive Testing

OBJECTIVE

The authors sought to develop and validate a suite of dimensional measures of psychiatric syndromes for use in a criminal justice population.

METHODS

The previously validated Computerized Adaptive Test-Mental Health (CAT-MH) was administered to a sample of 475 defendants in the Cook County Bond Court. Item-level data were used to determine which test items exhibited differential item functioning in this population compared with the population used for the original calibration.

RESULTS

After removal of nine items that exhibited differential item functioning from the CAT-MH, correlations between scores based on the original calibration from a nonjustice-involved population and the newly computed scores based on a sample of bond court defendants showed a correlation coefficient of r=0.96 to r=0.99.

CONCLUSIONS

With a slight modification of the original CAT-MH, the tool was successfully used to measure severity of depression, anxiety, mania and/or hypomania, suicidality, and substance use disorder in an English- and Spanish-speaking criminal justice population.

Association Between Parental Medical Claims for Opioid Prescriptions and Risk of Suicide Attempt by Their Children

IMPORTANCE

The rate of youth suicide has increased over the past 15 years in the United States as has the rate of death due to opioid overdose in adults of parental age.

OBJECTIVE

To explore the possible connection between parental use of prescription opioids and the increasing rate of youth suicide.

DESIGN, SETTING, AND PARTICIPANTS

A pharmacoepidemiologic study was conducted from January 1, 2010, to December 31, 2016, linking medical claims for parental opioid prescriptions with medical claims for suicide attempts by their children. The study used MarketScan medical claims data covering more than 150 million privately insured people in the United States. The study included 121 306 propensity score-matched 30- to 50-year-old parents who used opioids and parents who did not use opioids and their 10- to 19-year-old children (148 395 children of parents who did not use opioids and 184 142 children of parents who used opioids). Propensity score matching was used to identify relevant control families based on demographic features and concomitant use of psychotropic medication.

EXPOSURES

Opioid use in a parent was defined as having prescription fills covering more than 365 days of an opioid between 2010 and 2016.

MAIN OUTCOMES AND MEASURES

Suicide attempt rate in the children of parents who used opioids and those who did not use opioids.

RESULTS

A total of 148 395 children (75 575 sons and 72 820 daughters; mean [SD] age, 11.5 [1.6] years at the start of follow-up) had parents who did not use opioids and 184 142 children (94 502 sons and 89 640 daughters; mean [SD] age, 11.8 [1.8] years at the start of follow-up) with parents who did use opioids. There were 100 899 children aged 10 to 14 years and 47 496 children aged 15 to 19 years with parents who did not use opioids and 96 975 children aged 10 to 14 years and 87 163 children aged 15 to 19 years with parents who did use opioids. Of the children with parents who did not use opioids, 212 (0.14%) attempted suicide; of the children with parents who did use opioids, 678 (0.37%) attempted suicide. Parental use of opioids was associated with a doubling of the risk of a suicide attempt by their offspring (odds ratio [OR], 1.99; 95% CI, 1.71-2.33). The association remained significant after adjusting for child age and sex (OR, 1.85; 95% CI, 1.58-2.17), addition of child and parental depression and diagnoses of substance use disorder (OR, 1.46; 95% CI, 1.24-1.72), and addition of parental history of suicide attempt (OR, 1.45; 95% CI, 1.23-1.71). Geographical variation in opioid use did not change the association (OR, 2.00; 95% CI, 1.71-2.34).

CONCLUSIONS AND RELEVANCE

Children of parents who use prescription opioids are at increased risk for suicide attempts, which could be a contributing factor to the time trend in adolescent suicidality. The care of families with a parent who uses opioids should include mental health screening of their children.

Depression in Emergency Department Patients and Association With Health Care Utilization

BACKGROUND

Depression is one of the most common illnesses in the United States, with increased prevalence among people with lower socioeconomic status and chronic mental illness who often seek care in the emergency department (ED). We sought to estimate the rate and severity of major depressive disorder (MDD) in a nonpsychiatric ED population and its association with subsequent ED visits and hospitalizations.

METHODS

This prospective cohort study enrolled a convenience sample of English-speaking adults presenting to an urban academic medical center ED without psychiatric complaints between January 1, 2015, and September 21, 2015. Patients completed a computerized adaptive depression diagnostic screen (CAD-MDD) and dimensional depression severity measurement test (CAT-DI) via tablet computer. Primary outcomes included number of ED visits and hospitalizations assessed from index visit until January 1, 2016. Negative binomial regression modeling was performed to assess associations between depression, depression severity, clinical covariates, and utilization outcomes.

RESULTS

Of 999 enrolled patients, 27% screened positive for MDD. The presence of MDD conveyed a 61% increase in the rate of ED visits (incidence rate ratio [IRR] = 1.61, 95% confidence interval [CI] = 1.27 to 2.03) and a 49% increase in the rate of hospitalizations (IRR = 1.49, 95% CI = 1.06-2.09). For each 10% increase in MDD severity, there was a 10% increase in the relative rate of subsequent ED visits (IRR = 1.10, 95% CI = 1.04 to 1.16) and hospitalizations (IRR = 1.10, 95% CI = 1.02 to 1.18). Across the range of the severity scale there was over a 2.5-fold increase in the rate of ED visits and hospitalization rates.

CONCLUSIONS

Rates of depression were high among a convenience sample of English-speaking adult ED patients presenting with nonpsychiatric complaints and independently associated with increased risk of subsequent ED utilization and hospitalization. Standardized assessment tools that provide rapid, accurate, and precise classification of MDD severity have the potential to play an important role in identifying ED patients in need of urgent psychiatric resource referral.

Without Wasting a Word: Extreme Improvements in Efficiency and Accuracy Using Computerized Adaptive Testing for Mental Health Disorders (CAT-MH)

PURPOSE OF REVIEW

We review recent literature on the adaptive assessment of complex mental health disorders and provide a detailed comparison of classical test theory and adaptive testing based on multidimensional item response theory.

RECENT FINDINGS

Adaptive tests for a wide variety of mental health traits (e.g., depression, anxiety, mania, substance misuse, suicidality) are now available in a cloud-based environment. These tests have been validated in a variety of settings against lengthy structured clinical interviews with excellent results and even higher reliability than fixed-length tests. Applications include screening and assessments in emergency departments, psychiatric and primary care clinics, student health clinics, perinatal medicine clinics, child welfare settings, and the judicial system. The future of mental health measurement will be based on automated screening and assessments. Adaptive tests will provide increased precision of measurement and decreased burden of measurement. Integration into the electronic health record is important and now easily accomplished.

Development of a Computerized Adaptive Test Suicide Scale-The CAT-SS

OBJECTIVE

Current suicide risk screening and measurement are inefficient, have limited measurement precision, and focus entirely on suicide-related items. For this study, a psychometric harmonization between related suicide, depression, and anxiety symptom domains that provides a more balanced and complete spectrum of suicidal symptomatology was developed. The objective of this article is to describe the results of the early stages of computerized adaptive testing development for a suicide scale and pave the way for the final stage of validation.

METHODS

Data from psychiatric outpatients at the University of Pittsburgh and a community health clinic were collected from January 2010 through June 2012. 789 participants were enrolled in the calibration phase; 70% were female, and 30% were male. The rate of major depressive disorder as diagnosed by DSM-5 was 47%. The item bank contained 1,008 items related to depression, anxiety, and mania, including 11 suicide items. Data were analyzed using a bifactor model to identify a core dimension between suicidal ideation, depression, anxiety, and mania items. A computerized adaptive test was developed via simulation from the actual complete item responses in 308 subjects.

RESULTS

111 items were identified that provided an extension of suicidality assessment to include statistically related responses from depression and anxiety domains that are syndromally associated with suicidality. All items had high loadings on the primary suicide dimension (average = 0.67; range, 0.49-0.88). Analyses revealed that a mean of 10 items (5-20) had a correlation of 0.96 with the 111-item scale, with a precision of 5 points on a 100-point scale metric. Preliminary validation data based on 290 clinician interviews revealed a 52-fold increase in the likelihood of current suicidal ideation across the range of the Computerized Adaptive Test Suicide Scale (CAT-SS).

CONCLUSIONS

The CAT-SS is able to accurately measure the latent suicide dimension with a mean of 10 items in approximately 2 minutes. Further validation against an independent clinician-administered assessment of suicide risk (ideation and attempts) and prediction of suicidal behavior is underway.