An evaluation of clinical decision support tools for Patient Health Questionnaire-9 administration

Randomized Controlled Comparative Effectiveness Trial of Risk Model-Guided Clinical Decision Support for Suicide Screening

Suicide prevention requires risk identification, appropriate intervention, and follow-up. Traditional risk identification relies on patient self-reporting, support network reporting, or face-to-face screening with validated instruments or history and physical exam. In the last decade, statistical risk models have been studied and more recently deployed to augment clinical judgment. Models have generally been found to be low precision or problematic at scale due to low incidence. Few have been tested in clinical practice, and none have been tested in clinical trials to our knowledge.

Methods

We report the results of a pragmatic randomized controlled trial (RCT) in three outpatient adult Neurology clinic settings. This two-arm trial compared the effectiveness of Interruptive and Non-Interruptive Clinical Decision Support (CDS) to prompt further screening of suicidal ideation for those predicted to be high risk using a real-time, validated statistical risk model of suicide attempt risk, with the decision to screen as the primary end point. Secondary outcomes included rates of suicidal ideation and attempts in both arms. Manual chart review of every trial encounter was used to determine if suicide risk assessment was subsequently documented.

Results

From August 16, 2022, through February 16, 2023, our study randomized 596 patient encounters across 561 patients for providers to receive either Interruptive or Non-Interruptive CDS in a 1:1 ratio. Adjusting for provider cluster effects, Interruptive CDS led to significantly higher numbers of decisions to screen (42%=121/289 encounters) compared to Non-Interruptive CDS (4%=12/307) (odds ratio=17.7, p-value <0.001). Secondarily, no documented episodes of suicidal ideation or attempts occurred in either arm. While the proportion of documented assessments among those noting the decision to screen was higher for providers in the Non-Interruptive arm (92%=11/12) than in the Interruptive arm (52%=63/121), the interruptive CDS was associated with more frequent documentation of suicide risk assessment (63/289 encounters compared to 11/307, p-value<0.001).

Conclusions

In this pragmatic RCT of real-time predictive CDS to guide suicide risk assessment, Interruptive CDS led to higher numbers of decisions to screen and documented suicide risk assessments. Well-powered large-scale trials randomizing this type of CDS compared to standard of care are indicated to measure effectiveness in reducing suicidal self-harm. ClinicalTrials.gov Identifier: NCT05312437.

Meaningful time-related aspects of alerts in Clinical Decision Support Systems. A unified framework

Alerts are a common functionality of clinical decision support systems (CDSSs). Although they have proven to be useful in clinical practice, the alert burden can lead to alert fatigue and significantly reduce their usability and acceptance. Based on a literature review, we propose a unified framework consisting of a set of meaningful timestamps that allows the use of state-of-the-art measures for alert burden, such as alert dwell time, alert think time, and response time. In addition, it can be used to investigate other measures that could be relevant as regards dealing with this problem. Furthermore, we provide a case study concerning three different types of alerts to which the framework was successfully applied. We consider that our framework can easily be adapted to other CDSSs and that it could be useful for dealing with alert burden measurement thus contributing to its appropriate management.

A validation study of PHQ-9 suicide item with the Columbia Suicide Severity Rating Scale in outpatients with mood disorders at National Network of Depression Centers

BACKGROUND

In the United States, suicide is one of the serious public health problems and a major cause of death. Several researchers and clinical settings use the patient health questionnaires (PHQ-9) to gauge depression and psychological distress among adults and to predict suicide and death. This study aimed to assess the sensitivity, specificity, and predictive potential of suicide Q9 of the PHQ-9 compared to the Columbia-suicide severity rating scale (C-SSRS).

METHODS

Adults aged 19 or older, identified with a primary mood disorder diagnosis during their initial clinic visit between 2012 and 2020 from the National Network of Depression Centers, were included in the study. The accuracy of the PHQ-9 suicide item was compared with the gold standard, the C-SSRS.

RESULTS

Out of 2677 study participants, 31.6 % (n = 846) and 11.65 % (n = 312) had positive responses to the PHQ-9 suicide item and C-SSRS response, respectively. The sensitivity of the PHQ-9 compared to the C-SSR was 74.7 % (95%CI: 69.6 %-79.2 %), specificity 74.1 % (95%CI: 72.3 %-75.8 %), positive predictive value 27.5 % (95%CI: 24.6 %-30.6 %), and negative predictive value 95.7 % (95%CI: 94.7 %-96.5 %). The secondary analysis results showed better validity results of the PHQ-9 suicide item when compared to the suicide ideation item of the C-SSRS.

LIMITATIONS

This study is among mood disorder patients so additional research would be necessary among populations with different conditions.

CONCLUSION

For initial suicide screening, the PHQ-9 suicide item would over identify patients as at risk for suicide and the C-SSRS should be used mood disorder clinics to identify suicide risk.