Longitudinal risk of suicide outcomes in people with severe mental illness following an emergency department visit and the effects of suicide prevention treatment

BACKGROUND

Individuals with severe mental illness (SMI), including bipolar disorder (BD) and schizophrenia-spectrum disorders (SSD), are at high risk for suicide. However, suicide research often excludes individuals with SMI. The current research examined differences in suicide outcomes (i.e., suicide attempt or death) for adults with and without BD and SSD diagnoses following an emergency department (ED) visit and investigated the efficacy of the Coping Long Term with Active Suicide Program (CLASP) intervention in reducing suicide outcomes among people with SMI.

METHODS

1235 adults presenting with recent suicidality were recruited from 8 different EDs across the United States. Using a quasi-experimental, stepped wedge series design, participants were followed for 52-weeks with or without subsequent provision of CLASP.

RESULTS

Participants in the SSD group and the BD group had significantly shorter time to and higher rate of suicide outcomes than participants with other psychiatric diagnoses in all study phases and in non-CLASP phases, respectively. Participants with BD receiving the CLASP intervention had significantly longer time to suicide outcomes than those not receiving CLASP; these differences were not observed among those with SSD.

LIMITATIONS

Study limitations include self-reported psychiatric diagnosis, exclusion of homeless participants, and small sample size of participants with SSD.

CONCLUSIONS

Participants with SMI were at higher risk for suicide outcomes than participants with other psychiatric diagnoses. CLASP was efficacious among those participants with BD. Psychiatric diagnosis may be a key indicator of prospective suicide risk. More intensive and specialized follow-up mental health treatment may be necessary for those with SSD.

Clinician Attitudes Toward Suicide Prevention Practices and Their Implementation: Findings From the System of Safety Study

OBJECTIVE

The authors aimed to assess clinicians' attitudes toward suicide-related practices and their implementation, across roles and settings, before implementation of the Zero Suicide model in a health care system.

METHODS

Clinicians (N=5,559) were invited to complete a survey assessing demographic characteristics; confidence and self-reported suicide-related practice; leadership buy-in; and attitudes toward suicide prevention, safety planning, and continuous quality improvement (CQI).

RESULTS

Of 1,224 respondents, most felt confident conducting suicide screening but less confident performing other suicide-related care. Provider role and care setting were significantly associated with confidence (p<0.001, Kruskal-Wallis H test) and practice (p<0.001, Kruskal-Wallis H test) of providing suicide prevention care, with behavioral health providers and providers in the emergency department (ED) reporting the highest confidence. Attitudes toward safety planning were more positive among women (p<0.001, t test) and behavioral health providers (p<0.001, F test) than among their counterparts or peers. Positive attitudes toward CQI were significantly associated with male sex (p=0.01), non-White race (p=0.03), younger age (p=0.02), fewer years working in health care (p<0.001), administrative role (p<0.001), working in the ED (p<0.001), outpatient settings (p<0.02), and medical provider role (p<0.001).

CONCLUSIONS

Behavioral health providers and those in the ED reported feeling prepared to deliver suicide-related care, with nurses feeling less confident and less supported. Initiatives to improve suicide-related care should account for clinical role and care setting during planning. CQI could help engage a broader range of clinicians in suicide-related care improvements.

Comparing the Acceptability and Quality of Intervention Modalities for Suicidality in the Emergency Department: Randomized Feasibility Trial

BACKGROUND

Emergency departments (EDs) manage many patients with suicide risk, but effective interventions for suicidality are challenging to implement in this setting. ReachCare is a technology-facilitated version of an evidence-based intervention for suicidal ED patients. Here, we present findings on the acceptability and quality of ReachCare in the ED, as well as a comparison of these measures across 3 potential delivery modalities.

OBJECTIVE

Our aim was to test the feasibility of the ReachCare intervention in its entirety through conducting a pilot study with patients presenting with suicidality to the ED. We tested three different ways of receiving the ED-based components of ReachCare: (1) self-administered on the tablet app using a chatbot interface, (2) administered by an in-person clinician, or (3) administered by a telehealth clinician.

METHODS

In total, 47 ED patients who screened positive for suicide risk were randomly allocated to receive one of three delivery modalities of ReachCare in the ED: (1) self-administered on the patient-facing tablet app with a chatbot interface, (2) delivered by an in-person clinician, or (3) delivered by a telehealth clinician, with the latter two using a clinician-facing web app. We measured demographic and clinical characteristics, acceptability and appropriateness of the intervention, and quality and completeness of the resulting safety plans.

RESULTS

Patients assigned high ratings for the acceptability (median 4.00/5, IQR 4.00-4.50) and appropriateness (median 4.00/5, IQR 4.00-4.25) of ReachCare's ED components, and there were no substantial differences across the 3 delivery modalities [H(acceptability)=3.90, P=.14; H(appropriateness)=1.05, P=.59]. The self-administered modality took significantly less time than the 2 clinician modalities (H=27.91, P<.001), and the usability of the self-administered version was in the "very high" range (median 93.75/100, IQR 80.00-97.50). The safety plans created across all 3 modalities were high-quality (H=0.60, P=.74).

CONCLUSIONS

Patients rated ReachCare in the ED as highly acceptable and appropriate regardless of modality. Self-administration may be a feasible way to ensure patients with suicide risk receive an intervention in resource constrained EDs. Limitations include small sample size and demographic differences between those enrolled versus not enrolled. Further research will examine the clinical outcomes of patients receiving both the in-ED and post-ED components of ReachCare.

TRIAL REGISTRATION

ClinicalTrials.gov NCT04720911; https://clinicaltrials.gov/ct2/show/NCT04720911.

Preventing Suicide in Health Systems: How Can Implementation Science Help?

Suicide prevention is an emotive, complex goal for clinicians and health systems. Effective interventions for suicidality do exist; however, many patients do not receive them because implementation efforts tend to be time-limited and unsystematic. Implementation science is the study of methods to promote the systematic uptake of research findings and other evidence-based practices into routine practice. This narrative review introduces implementation science to suicide researchers, with a special focus on healthcare settings. We outline prominent theories, methods, and measures, as well as examples of implementation research from suicidology. By embracing the principles of implementation science, suicidologists can help to close the gap between evidence-based practice and routine practice, thereby improving the delivery and uptake of suicide-related interventions and prevention programs.

Can psychological interventions prevent or reduce risk for perinatal anxiety disorders? A systematic review and meta-analysis

OBJECTIVE

Little is known about the extent to which interventions can prevent perinatal anxiety disorders. We conducted a systematic review and meta-analysis to examine whether interventions can decrease the onset and symptoms of perinatal anxiety among individuals without an anxiety disorder diagnosis.

METHOD

We conducted a comprehensive literature search across five databases related to key concepts: (1) anxiety disorders/anxiety symptom severity (2) perinatal (3) interventions (4) prevention. We included studies that examined a perinatal population without an anxiety disorder diagnosis, included a comparator group, and assessed perinatal anxiety. We included interventions focused on perinatal anxiety as well as interventions to prevent perinatal depression or influence related outcomes (e.g., physical activity).

RESULTS

Thirty-six studies were included. No study assessing the incidence of perinatal anxiety disorder (n = 4) found a significant effect of an intervention. Among studies assessing anxiety symptom severity and included in the quantitative analysis (n = 30), a meta-analysis suggested a small standardized mean difference of -0.31 (95% CI [-0.46, -0.16], p < .001) for anxiety at post intervention, favoring the intervention group. Both mindfulness (n = 6), and cognitive behavioral therapy approaches (n = 10) were effective.

CONCLUSIONS

Interventions developed for perinatal anxiety were more effective than interventions to prevent perinatal depression. Psychological interventions show promise for reducing perinatal anxiety symptom severity, though interventions specifically targeting anxiety are needed.

Acute and intensive care nurses' perspectives on suicide prevention with medically hospitalized patients: Exploring barriers, facilitators, interests, and training opportunities

AIMS

To explore opportunities for acute and intensive care nurses to engage in suicide prevention activities with patients hospitalized for medical, surgical or traumatic injury reasons.

DESIGN

A qualitative descriptive study.

METHODS

We conducted two studies consisting of 1-h focus groups with nurses. Study 1 occurred prior to the onset of the COVID-19 pandemic during January and February of 2020 and identified barriers and facilitators of engaging in an eLearning training in suicide safety planning and engaging patients on their units in suicide safety planning. Study 2 occurred in December of 2020 and explored nurses' perspectives on their role in suicide prevention with patients on their units and training needs related to this. The research took place at an urban level 1 trauma center and safety net hospital where nurses universally screen all admitted patients for suicide risk. We conducted a rapid analysis of the focus group transcripts using a top-down, framework-driven approach to identify barriers, facilitators, strategies around barriers, and training interests mentioned.

RESULTS

Twenty-seven registered nurses participated. Nurses indicated they serve a population in need of suicide prevention and that the nursing role is an important part of suicide care. A primary barrier was having adequate uninterrupted time for suicide prevention activities and training; however, nurses identified various strategies around barriers and offered suggestions to make training successful.

CONCLUSION

Findings suggest training in suicide prevention is important for nurses in this context and there are opportunities for nurses to engage patients in interventions beyond initial screening; however, implementation will require tailoring interventions and training to accommodate nurses' workload in the hospital context.

IMPACT

Acute and intensive care nurses play a key role in the public health approach to suicide prevention. Understanding perspectives of bedside nurses is critical for guiding development and deployment of effective brief interventions.

NO PUBLIC OR PATIENT INVOLVEMENT

This study is focused on eliciting and exploring perspectives of acute and intensive care nurses.

Effect of an Emergency Department Process Improvement Package on Suicide Prevention: The ED-SAFE 2 Cluster Randomized Clinical Trial

Importance

Suicide is a leading cause of deaths in the US. Although the emergency department (ED) is an opportune setting, ED-initiated interventions remain underdeveloped and understudied.

Objective

To determine if an ED process improvement package, with a subfocus on improving the implementation of collaborative safety planning, reduces subsequent suicide-related behaviors.

Design, Setting, and Participants

The Emergency Department Safety Assessment and Follow-up Evaluation 2 (ED-SAFE 2) trial, a stepped-wedge cluster randomized clinical trial conducted in 8 EDs across the US, used an interrupted time series design with three 12-month sequential phases: baseline, implementation, and maintenance. A random sample of 25 patients per month per site 18 years and older who screened positive on the Patient Safety Screener, a validated suicide risk screener, were included. The primary analyses focused on those who were discharged from the ED, while secondary analyses focused on all patients who screened positive, regardless of disposition. Data were collected on patients who presented for care from January 2014 to April 2018, and data were analyzed from April to December 2022.

Interventions

Each site received lean training and built a continuous quality improvement (CQI) team to evaluate the current suicide-related workflow in the ED, identify areas of improvement, and implement efforts to improve. Each site was expected to increase their universal suicide risk screening and implement collaborative safety planning for patients at risk of suicide who were discharged home from the ED. Site teams were centrally coached by engineers experienced in lean CQI and suicide prevention specialists.

Main Outcomes and Measures

The primary outcome was a composite comprising death by suicide or suicide-related acute health care visits, measured over a 6-month follow-up window.

Results

Across 3 phases, 2761 patient encounters were included in the analyses. Of these, 1391 (50.4%) were male, and the mean (SD) age was 37.4 (14.5) years. A total of 546 patients (19.8%) exhibited the suicide composite during the 6-month follow-up (9 [0.3%] died by suicide and 538 [19.5%] of a suicide-related acute health care visit). A significant difference was observed for the suicide composite outcome between the 3 phases (baseline, 216 of 1030 [21%]; implementation, 213 of 967 [22%]; maintenance, 117 of 764 [15.3%]; P = .001). The adjusted odds ratios of risk of the suicide composite during the maintenance phase was 0.57 (95% CI, 0.43-0.74) compared with baseline and 0.61 (0.46-0.79) compared with the implementation phase, which reflect a 43% and 39% reduction, respectively.

Conclusions and Relevance

In this multisite randomized clinical trial, using CQI methods to implement a department-wide change in suicide-related practices, including the implementation of a safety plan intervention, yielded a significant decrease in suicide behaviors in the maintenance period of the study.

Trial Registration

ClinicalTrials.gov Identifier: NCT02453243.

Systems Approach to Suicide Prevention: Strengthening Culture, Practice, and Education

Contemporary approaches to suicide prevention extend beyond an individual's interactions with care providers to seek opportunities for improvement in the wider care system. A systems-based analysis can yield opportunities to improve prevention and recovery across the care continuum. This article uses an example of an individual seeking care in an emergency department to show how a traditional clinical case formulation can be framed in terms of the outer and inner contexts of the EPIS (Exploration, Preparation, Implementation, Sustainment) framework to illuminate the impact of systemic factors on outcomes and to identify opportunities for improvement. Three mutually reinforcing domains (a culture of safety and prevention; best practices, policies, and pathways; and workforce education and development) of a systems approach to suicide prevention are outlined, along with their defining characteristics. A culture of safety and prevention requires engaged, informed leaders who prioritize prevention; lived experience integrated into leadership teams; and adverse events review in a Restorative Just Culture focused on healing and improvement. Best practices, policies, and pathways that promote safety, recovery, and health require codesign of processes and services and evolve through continuous measurement and improvement. To support a culture of safety and prevention, and caring, competent application of policy, organizations benefit from a longitudinal approach to workforce education. This includes a common framework and language; models clinical and lived experience collaboration; and supports continuous learning, as well as onboarding of new staff, rather than following a "one-and-done" approach, so that suicide prevention training remains top of mind across the workforce.

Screening and Assessing Suicide Risk in Medical Settings: Feasible Strategies for Early Detection

Early detection of risk is a key suicide prevention strategy. Given that most individuals who die by suicide visit a health care provider in the year leading up to their death, medical settings are ideal venues for identifying those at elevated risk and bridging them to life-saving care. Clinicians are presented with an opportunity to engage in proactive suicide prevention efforts through practical and adaptable suicide risk screening, assessment, and management processes. Psychiatrists and mental health clinicians are well positioned to assist nonpsychiatric clinicians on the frontlines of this public health problem. This article discusses the importance of identifying people at elevated suicide risk through screening, differentiates screening from assessment procedures, and presents practical strategies for implementing evidence-based screening and assessment tools into practice as part of a three-tiered clinical pathway. Specifically, this article discusses key components that guide embedding suicide prevention strategies into the workflows of busy medical settings.

ReachCare Mobile Apps for Patients Experiencing Suicidality in the Emergency Department: Development and Usability Testing Using Mixed Methods

BACKGROUND

Many individuals with suicide risk present to acute care settings such as emergency departments (EDs). However, staffing and time constraints mean that many EDs are not well equipped to deliver evidence-based interventions for patients experiencing suicidality. An existing intervention initiated in the ED for patients with suicide risk (Emergency Department Safety Assessment and Follow-up Evaluation [ED-SAFE]) has been found to be effective but faces trenchant barriers for widespread adoption.

OBJECTIVE

On the basis of the ED-SAFE intervention, we aimed to develop 2 apps for patients with suicide risk: a web app guiding patients through safety planning in the ED (ED app) and a smartphone app providing patients components of the ED-SAFE program on their phones after discharge (patient app). We then tested the usability of these apps with patients presenting to the ED with suicide risk.

METHODS

Using a user-centered design framework, we first developed user personas to explore the needs and characteristics of patients who are at risk for suicide using inputs from clinicians (n=3) and suicidologists (n=4). Next, we validated these personas during interviews with individuals with lived experience of suicidality (n=6) and used them to inform our application designs. We field-tested the apps with ED patients presenting with suicide risk (n=14) in 2 iterative cycles to assess their usability and engagement using a mixed methods approach. We also rated the quality and fidelity of the safety plans created.

RESULTS

We developed 2 interoperable and complementary apps. The first is a web app designed for use on a tablet device during ED admission that guides the patient by creating a safety plan using a chatbot-style interface. The second is a smartphone app for use after discharge and allows the patient to view, edit, and share their completed safety plan; access self-care education, helplines, and behavioral health referrals; and track follow-up appointments with the study clinician. The initial prototype usability testing (n=9) demonstrated satisfactory scores (ED app System Usability Scale [SUS], mean 78.6/100, SD 24.1; User Engagement Scale, mean 3.74/5, SD 0.72; patient app SUS, mean 81.7/100, SD 20.1). After refining the apps based on participant feedback, the second cycle testing (n=5) showed improvement (ED app SUS, mean 90.5/100, SD 9.9; User Engagement Scale, mean 4.07/5, SD 0.36; patient app SUS, mean 97.0/100, SD 1.9). The quality ratings for completed safety plans were satisfactory (Safety Planning Intervention Scoring Algorithm-Brief, mean 27.4, SD 3.4).

CONCLUSIONS

By adopting a user-centered approach and creating personas to guide development, we were able to create apps for ED patients with suicide risk and obtain satisfactory usability, engagement, and quality scores. Developing digital health tools based on user-centered design principles that deliver evidence-based intervention components may help overcome trenchant implementation barriers in challenging health care settings.

Studying the implementation of Zero Suicide in a large health system: Challenges, adaptations, and lessons learned

Background

Suicide remains the 10th leading cause of death in the United States. Many patients presenting to healthcare settings with suicide risk are not identified and their risk mitigated during routine care. Our aim is to describe the planned methodology for studying the implementation of the Zero Suicide framework, a systems-based model designed to improve suicide risk detection and treatment, within a large healthcare system.

Methods

We planned to use a stepped wedge design to roll-out the Zero Suicide framework over 4 years with a total of 39 clinical units, spanning emergency department, inpatient, and outpatient settings, involving ∼310,000 patients. We used Lean, a widely adopted a continuous quality improvement (CQI) model, to implement improvements using a centralize "hub" working with smaller "spoke" teams comprising CQI personnel, unit managers, and frontline staff.

Results

Over the course of the study, five major disruptions impacted our research methods, including a change in The Joint Commission's safety standards for suicide risk mitigation yielding massive system-wide changes and the COVID-19 pandemic. What had been an ambitious program at onset became increasingly challenging because of the disruptions, requiring significant adaptations to our implementation approach and our study methods.

Conclusions

Real-life obstacles interfered markedly with our plans. While we were ultimately successful in implementing Zero Suicide, these obstacles led to adaptations to our approach and timeline and required substantial changes in our study methodology. Future studies of quality improvement efforts that cut across multiple units and settings within a given health system should avoid using a stepped-wedge design with randomization at the unit level if there is the potential for sentinel, system-wide events.

Harmonization of Four Delirium Instruments: Creating Crosswalks and the Delirium Item-Bank (DEL-IB)

OBJECTIVES

Over 30 instruments are in current, active use for delirium identification. In a recent systematic review, we recommended 4 commonly used and well-validated instruments for clinical and research use. The goal of this study is to harmonize the four instruments on the same metric using modern methods in psychometrics.

DESIGN

Secondary data analysis from 3 studies, and a simulation study based on the observed data.

SETTING

Hospitalized (non-ICU) adults over 65 years old in the United States, Ireland, and Belgium.

PARTICIPANTS

The total sample comprised 600 participants, contributing 1,623 assessments.

MEASUREMENTS

Confusion Assessment Method (long-form and short-form), Delirium Observation Screening Scale, Delirium Rating Scale-Revised-98 (DRS-R-98) (total and severity scores), and Memorial Delirium Assessment Scale.

RESULTS

Using item response theory, we linked scores across instruments, placing all four instruments and their separate scorings on the same metric (the propensity to delirium). Kappa statistics comparing agreement in delirium identification among the instruments ranged from 0.37 to 0.75, with the highest agreement between the DRS-R-98 total score and MDAS. After linking scores, we created a harmonized item bank, called the Delirium Item Bank (DEL-IB), consisting of 50 items. The DEL-IB allowed us to create six crosswalks, to allow scores to be translated across instruments.

CONCLUSIONS

With our results, individual instrument scores can be directly compared to aid in clinical decision-making, and quantitatively combined in meta-analyses.

Survivorship care planning, quality of life, and confidence to transition to survivorship: A randomized controlled trial with women ending treatment for breast cancer

PURPOSE

The Polaris Oncology Survivorship Transition (POST) system is a computer-based program that integrates information from the electronic health record, oncology team, and the patient to produce a personalized Survivorship Care Plan. The purpose of this study was to compare the POST to treatment as usual on confidence, quality of life, and interest in mental health referrals in women ending treatment for breast cancer.

SAMPLE

Two hundred women (100 POST, 100 treatment as usual) ending treatment for breast cancer were enrolled in a randomized controlled trial.

DESIGN

Women randomized to the POST condition received a personalized care plan during a baseline/intervention appointment. At enrollment and baseline/intervention, a number of outcomes were examined in this study, including confidence to enter survivorship measured by the Confidence in Survivorship Index (CSI) and Quality of Life (QOL). One, three, and six month follow up assessments were also conducted.

FINDINGS

Treatment groups did not differ in terms of QOL scores at any time points. Mean CSI scores were statistically different between POST and treatment as usual at baseline for the total CSI score and both subscales, but only for confidence in knowledge about prevention and treatment at the 1-month follow-up. All significant differences were in favor of the POST intervention as mean CSI scores were higher for participants who received the POST intervention as opposed to treatment as usual. These findings disappeared at the 3 and 6 month follow up assessments. Finally, patients who received the POST intervention were twice as likely to request mental health/social services referrals compared to women who received treatment as usual.

IMPLICATIONS

Oncologists may use the POST to build personalized care plans for women ending treatment for cancer, which may enhance patients' confidence in the short term as well as encourage use of mental health resources.

Delirium Item Bank: Utilization to Evaluate and Create Delirium Instruments

INTRODUCTION

The large number of heterogeneous instruments in active use for identification of delirium prevents direct comparison of studies and the ability to combine results. In a recent systematic review we performed, we recommended four commonly used and well-validated instruments and subsequently harmonized them using advanced psychometric methods to develop an item bank, the Delirium Item Bank (DEL-IB). The goal of the present study was to find optimal cut-points on four existing instruments and to demonstrate use of the DEL-IB to create new instruments.

METHODS

We used a secondary analysis and simulation study based on data from three previous studies of hospitalized older adults (age 65+ years) in the USA, Ireland, and Belgium. The combined dataset included 600 participants, contributing 1,623 delirium assessments, and an overall incidence of delirium of about 22%. The measurements included the Diagnostic and Statistical Manual of Mental Disorders, 5th Edition diagnostic criteria for delirium, Confusion Assessment Method (long form and short form), Delirium Observation Screening Scale, Delirium Rating Scale-Revised-98 (total and severity scores), and Memorial Delirium Assessment Scale (MDAS).

RESULTS

We identified different cut-points for each existing instrument to optimize sensitivity or specificity, and compared instrument performance at each cut-point to the author-defined cut-point. For instance, the cut-point on the MDAS that maximizes both sensitivity and specificity was at a sum score of 6 yielding 89% sensitivity and 79% specificity. We then created four new example instruments (two short forms and two long forms) and evaluated their performance characteristics. In the first example short form instrument, the cut-point that maximizes sensitivity and specificity was at a sum score of 3 yielding 90% sensitivity, 81% specificity, 30% positive predictive value, and 99% negative predictive value.

DISCUSSION/CONCLUSION

We used the DEL-IB to better understand the psychometric performance of widely used delirium identification instruments and scorings, and also demonstrated its use to create new instruments. Ultimately, we hope that the DEL-IB might be used to create optimized delirium identification instruments and to spur the development of a unified approach to identify delirium.

Suicide Screening Tools for Pediatric Emergency Department Patients: A Systematic Review

BACKGROUND

According to the Centers for Disease Control and Prevention, suicidality and suicidal behavior among youth continues to increase significantly each year. Many of those who die by suicide interact with health services in the year before death. This systematic review sought to identify and describe empirically tested screening tools for suicidality in youth presenting to Emergency Departments (ED).

OBJECTIVE

(1) To identify and compare existing tools used to screen for suicidality in children and adolescents who present to the ED and (2) to ascertain the prevalence of suicidality in pediatric populations found with these tools.

METHODS

We searched Ovid Medline, CINAHL, Scopus, and Cochrane databases for primary research studies that identified and evaluated screening tools for suicide risk in pediatric ED patients. A total of 7,597 publications published before August 25, 2021 met search criteria and were screened by two independent reviewers based on our inclusion and exclusion criteria, with any conflicts resolved via consensus meetings or an independent reviewer. A total of 110 papers were selected for full text review, of which 67 were excluded upon further inspection. Covidence was used to extract and synthesize results.

RESULTS

43 articles were eligible for inclusion. Most studies (n = 33) took place in general pediatric EDs; the quality was generally high. Patients ranged from 4-24 years old, with most screening tested in patients 12 years and older. The most researched tools were the Ask-Suicide Screening Questions (ASQ) (n = 15), Columbia-Suicide Severity Rating Scale (C-SSRS) (n = 12), Suicidal Ideation Questionnaire (SIQ) (n = 11), and the Risk of Suicide Questionnaire (RSQ) (n = 7). Where screening was applied to all patients, about one-fifth of pediatric ED patients screened positive; where suicide screening was applied to psychiatric patients only, over half screened positive. Positive screens were more likely to be female and older than negative screens and they were more likely to be assessed and admitted.

CONCLUSION

Several validated screening tools exist for the purpose of screening pediatric populations in EDs for suicidality. Such tools may help to support early detection and appropriate intervention for youth at risk of suicide.

SYSTEMATIC REVIEW REGISTRATION

https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=276328, identifier: 276328.

Harnessing Innovative Technologies to Train Nurses in Suicide Safety Planning With Hospitalized Patients: Protocol for Formative and Pilot Feasibility Research

Background

Suicide is the 10th leading cause of death in the United States, with >47,000 deaths in 2019. Most people who died by suicide had contact with the health care system in the year before their death. Health care provider training is a top research priority identified by the National Action Alliance for Suicide Prevention; however, evidence-based approaches that target skill-building are resource intensive and difficult to implement. Advances in artificial intelligence technology hold promise for improving the scalability and sustainability of training methods, as it is now possible for computers to assess the intervention delivery skills of trainees and provide feedback to guide skill improvements. Much remains to be known about how best to integrate these novel technologies into continuing education for health care providers.

Objective

In Project WISE (Workplace Integrated Support and Education), we aim to develop e-learning training in suicide safety planning, enhanced with novel skill-building technologies that can be integrated into the routine workflow of nurses serving patients hospitalized for medical or surgical reasons or traumatic injury. The research aims include identifying strategies for the implementation and workflow integration of both the training and safety planning with patients, adapting 2 existing technologies to enhance general counseling skills for use in suicide safety planning (a conversational agent and an artificial intelligence–based feedback system), observing training acceptability and nurse engagement with the training components, and assessing the feasibility of recruitment, retention, and collection of longitudinal self-report and electronic health record data for patients identified as at risk of suicide.

Methods

Our developmental research includes qualitative and observational methods to explore the implementation context and technology usability, formative evaluation of the training paradigm, and pilot research to assess the feasibility of conducting a future cluster randomized pragmatic trial. The trial will examine whether patients hospitalized for medical or surgical reasons or traumatic injury who are at risk of suicide have better suicide-related postdischarge outcomes when admitted to a unit with nurses trained using the skill-building technology than those admitted to a unit with untrained nurses. The research takes place at a level 1 trauma center, which is also a safety-net hospital and academic medical center.

Results

Project WISE was funded in July 2019. As of September 2021, we have completed focus groups and usability testing with 27 acute care and 3 acute and intensive care nurses. We began data collection for research aims 3 and 4 in November 2021. All research has been approved by the University of Washington institutional review board.

Conclusions

Project WISE aims to further the national agenda to improve suicide prevention in health care settings by training nurses in suicide prevention with medically hospitalized patients using novel e-learning technologies.

International Registered Report Identifier (IRRID)

DERR1-10.2196/33695

Applying Machine Learning Approaches to Suicide Prediction Using Healthcare Data: Overview and Future Directions

Objective: Early identification of individuals who are at risk for suicide is crucial in supporting suicide prevention. Machine learning is emerging as a promising approach to support this objective. Machine learning is broadly defined as a set of mathematical models and computational algorithms designed to automatically learn complex patterns between predictors and outcomes from example data, without being explicitly programmed to do so. The model's performance continuously improves over time by learning from newly available data. Method: This concept paper explores how machine learning approaches applied to healthcare data obtained from electronic health records, including billing and claims data, can advance our ability to accurately predict future suicidal behavior. Results: We provide a general overview of machine learning concepts, summarize exemplar studies, describe continued challenges, and propose innovative research directions. Conclusion: Machine learning has potential for improving estimation of suicide risk, yet important challenges and opportunities remain. Further research can focus on incorporating evolving methods for addressing data imbalances, understanding factors that affect generalizability across samples and healthcare systems, expanding the richness of the data, leveraging newer machine learning approaches, and developing automatic learning systems.

Reconciling Statistical and Clinicians' Predictions of Suicide Risk

Statistical models, including those based on electronic health records, can accurately identify patients at high risk for a suicide attempt or death, leading to implementation of risk prediction models for population-based suicide prevention in health systems. However, some have questioned whether statistical predictions can really inform clinical decisions. Appropriately reconciling statistical algorithms with traditional clinician assessment depends on whether predictions from these two methods are competing, complementary, or merely duplicative. In June 2019, the National Institute of Mental Health convened a meeting, "Identifying Research Priorities for Risk Algorithms Applications in Healthcare Settings to Improve Suicide Prevention." Here, participants of this meeting summarize key issues regarding the potential clinical application of suicide prediction models. The authors attempt to clarify the key conceptual and technical differences between traditional risk prediction by clinicians and predictions from statistical models, review the limited evidence regarding both the accuracy of and the concordance between these alternative methods of prediction, present a conceptual framework for understanding agreement and disagreement between statistical and clinician predictions, identify priorities for improving data regarding suicide risk, and propose priority questions for future research. Future suicide risk assessment will likely combine statistical prediction with traditional clinician assessment, but research is needed to determine the optimal combination of these two methods.

Using a Tablet-Based App to Deliver Evidence-Based Practices for Suicidal Patients in the Emergency Department: Pilot Randomized Controlled Trial

BACKGROUND

Emergency departments (EDs) have the potential to provide evidence-based practices for suicide prevention to patients who are acutely suicidal. However, few EDs have adequate time and personnel resources to deliver recommended evidence-based assessment and interventions. To raise the clinical standard of care for patients who are suicidal and seeking psychiatric crisis services in the ED, we developed Jaspr Health, a tablet-based app for direct use by such patients, which enables the delivery of 4 evidence-based practices.

OBJECTIVE

This study aims to evaluate the feasibility, acceptability, and effectiveness of Jaspr Health among suicidal adults in EDs.

METHODS

Patients who were acutely suicidal and seeking psychiatric crisis services participated in an unblinded pilot randomized controlled trial while in the ED. Participants were randomly assigned to Jaspr Health (n=14) or care as usual (control; n=17) groups. Participants were assessed at baseline, and a 2-hour posttest using self-report measures and a semistructured interview were conducted.

RESULTS

Conditions differed significantly at baseline with regard to age but not other demographic variables or baseline measures. On average, participants had been in the ED for 17 hours before enrolling in the study. Over their lifetime, 84% (26/31) of the sample had made a suicide attempt (mean 3.4, SD 6.4) and 61% (19/31) had engaged in nonsuicidal self-injurious behaviors, with an average rate of 8.8 times in the past 3 months. All established feasibility and acceptability criteria were met: no adverse events occurred, participants' app use was high, Jaspr Health app user satisfaction ratings were high, and all participants using Jaspr Health recommended its use for other suicidal ED patients. Comparisons between study conditions provide preliminary support for the effectiveness of the app: participants using Jaspr Health reported a statistically significant increase in receiving 4 evidence-based suicide prevention interventions and overall satisfaction ratings with their ED experience. In addition, significant decreases in distress and agitation, along with significant increases in learning to cope more effectively with current and future suicidal thoughts, were observed among participants using Jaspr Health compared with those receiving care as usual.

CONCLUSIONS

Even with limited statistical power, the results showed that Jaspr Health is feasible, acceptable, and clinically effective for use by ED patients who are acutely suicidal and seeking ED-based psychiatric crisis services.

TRIAL REGISTRATION

ClinicalTrials.gov NCT03584386; https://clinicaltrials.gov/ct2/show/NCT03584386.

Limitations of Screening for Depression as a Proxy for Suicide Risk in Adult Medical Inpatients

BACKGROUND

Medically ill hospitalized patients are at elevated risk for suicide. Hospitals that already screen for depression often use depression screening as a proxy for suicide risk screening. Extant research has indicated that screening for depression may not be sufficient to identify all patients at risk for suicide.

OBJECTIVE

The present study aims to determine the effectiveness of a depression screening tool, the Patient Health Questionnaire-9, in detecting suicide risk among adult medical inpatients.

METHODS

Participants were recruited from inpatient medical/surgical units in 4 hospitals as part of a larger validation study. Participants completed the Patient Health Questionnaire-9 and 2 suicide risk measures: the Ask Suicide-Screening Questions and the Adult Suicidal Ideation Questionnaire.

RESULTS

The sample consisted of 727 adult medical inpatients (53.4% men; 61.8% white; mean age 50.1 ± 16.3 years). A total of 116 participants (116 of 727 [16.0%]) screened positive for suicide risk and 175 (175 of 727 [24.1%]) screened positive for depression. Of the 116 patients who screened positive for suicide risk, 36 (31.0%) screened negative for depression on the Patient Health Questionnaire-9. Of 116, 73 (62.9%) individuals who were at risk for suicide did not endorse item 9 (thoughts of harming oneself or of being better off dead) on the Patient Health Questionnaire-9.

CONCLUSION

Using depression screening tools as a proxy for suicide risk may be insufficient to detect adult medical inpatients at risk for suicide. Asking directly about suicide risk and using validated tools is necessary to effectively and efficiently screen for suicide risk in this population.

A randomized, controlled trial of the safety planning intervention: Research design and methods

BACKGROUND

Brief interventions for suicide risk among patients treated in acute care settings like the emergency department are needed. The Safety Planning Intervention is a promising approach but has yet to undergo a high quality, individual level randomized controlled trial.

PURPOSE

This paper describes the methods associated with an individual level randomized controlled trial of the Safety Planning Intervention compared to a control condition comprised of reviewing risk factors and warning signs.

METHODS

The sample comprised patients 18 years and older presenting to one of three different emergency departments with suicide related emergencies (target n = 484). Eligible patients were approached, consented, and randomized to the intervention (Safety Planning Intervention) or control (risk factors and warning signs). They were assessed at 1, 3 and 6 months after their index visit. The primary outcome is suicidal behavior. The study also assessed mechanisms of action. Data analyses are pending.

CONCLUSIONS

We identified and addressed key challenges to studying suicidal patients in the emergency department, including difficulty enrolling during the emergency department visit, ascertaining outcomes in patients that are historically very difficult to follow, and addressing the ambiguity of suicidal behavior. ClinicalTrials.gov Identifier: NCT03227991.

Alcohol Use Disorder in the Age of Technology: A Review of Wearable Biosensors in Alcohol Use Disorder Treatment

Biosensors enable observation and understanding of latent physiological occurrences otherwise unknown or invasively detected. Wearable biosensors monitoring physiological constructs across a wide variety of mental and physical health conditions have become an important trend in innovative research methodologies. Within substance use research, explorations of biosensor technology commonly focus on identifying physiological indicators of intoxication to increase understanding of addiction etiology and to inform treatment recommendations. In this review, we examine the state of research in this area as it pertains to treatment of alcohol use disorders specifically highlighting the gaps in our current knowledge with recommendations for future research. Annually, alcohol use disorders affect approximately 15 million individuals. A primary focus of existing wearable technology-based research among people with alcohol use disorders is identifying alcohol intoxication. A large benefit of wearable biosensors for this purpose is they provide continuous readings in a passive manner compared with the gold standard measure of blood alcohol content (BAC) traditionally measured intermittently by breathalyzer or blood draw. There are two primary means of measuring intoxication with biosensors: gait and sweat. Gait changes have been measured via smart sensors placed on the wrist, in the shoe, and mobile device sensors in smart phones. Sweat measured by transdermal biosensors detects the presence of alcohol in the blood stream correlating to BAC. Transdermal biosensors have been designed in tattoos/skin patches, shirts, and most commonly, devices worn on the ankle or wrist. Transdermal devices were initially developed to help monitor court-ordered sobriety among offenders with alcohol use disorder. These devices now prove most useful in continuously tracking consumption throughout clinical trials for behavioral treatment modalities. More recent research has started exploring the uses for physical activity trackers and physiological arousal sensors to guide behavioral interventions for relapse prevention. While research has begun to demonstrate wearable devices' utility in reducing alcohol consumption among individuals aiming to cutdown on their drinking, monitoring sustained abstinence in studies exploring contingency management for alcohol use disorders, and facilitating engagement in activity-based treatment interventions, their full potential to further aid in understanding of, and treatment for, alcohol use disorders has yet to be explored.

C-SSRS performance in emergency department patients at high risk for suicide

OBJECTIVE

To evaluate the psychometric and predictive performance of the Columbia-Suicide Severity Rating Scale (C-SSRS) in emergency department (ED) patients with suicidal ideation or attempts (SI/SA).

METHODS

Participants (n = 1,376, mean age 36.8, 55% female, 76.8% white) completed the C-SSRS during the ED visit and were followed for one year. Reliability analyses, exploratory structural equation modeling, and prediction of future SA were explored.

RESULTS

Reliability of the Suicidal Ideation subscale was adequate, but was poor for the Intensity of Ideation and Suicidal Behavior subscales. Three empirically derived factors characterized the C-SSRS. Only Factor 1 (Suicidal Ideation and Attempts) was a reliable predictor of subsequent SA, though odds ratios were small (ORs: 1.09-1.10, CI_95% : 1.04, 1.15). The original C-SSRS Suicidal Ideation and Suicidal Behavior subscales and the C-SSRS ED screen predicted subsequent SA, again with small odds ratios (ORs: 1.07-1.19, CI_95% : 1.01, 1.29). In participants without a SA history, no C-SSRS subscale predicted subsequent SA. History of any SA (OR: 1.98, CI_95% : 1.43, 2.75) was the strongest predictor of subsequent SA.

CONCLUSIONS

The psychometric evidence for the C-SSRS was mixed. History of a prior SA, as measured by the C-SSRS, provided the most parsimonious and powerful assessment for predicting future SA.

Detecting Delirium: A Systematic Review of Identification Instruments for Non-ICU Settings

BACKGROUND/OBJECTIVES

Delirium manifests clinically in varying ways across settings. More than 40 instruments currently exist for characterizing the different manifestations of delirium. We evaluated all delirium identification instruments according to their psychometric properties and frequency of citation in published research.

DESIGN

We conducted the systematic review by searching Cumulative Index to Nursing and Allied Health Literature (CINAHL), Cochrane Library, Excerpta Medica Database (Embase), PsycINFO, PubMed, and Web of Science from January 1, 1974, to January 31, 2020, with the keywords "delirium" and "instruments," along with their known synonyms. We selected only systematic reviews, meta-analyses, or narrative literature reviews including multiple delirium identification instruments.

MEASUREMENTS

Two reviewers assessed the eligibility of articles and extracted data on all potential delirium identification instruments. Using the original publication on each instrument, the psychometric properties were examined using the Consensus-based Standards for the Selection of Health Measurement Instruments (COSMIN) framework.

RESULTS

Of 2,542 articles identified, 75 met eligibility criteria, yielding 30 different delirium identification instruments. A count of citations was determined using Scopus for the original publication for each instrument. Each instrument underwent methodological quality review of psychometric properties using COSMIN definitions. An expert panel categorized key domains for delirium identification based on criteria from the Diagnostic and Statistical Manual of Mental Disorders (DSM)-III through DSM-5. Four instruments were notable for having at least two of three of the following: citation count of 200 or more, strong validation methodology in their original publication, and fulfillment of DSM-5 criteria. These were, alphabetically, Confusion Assessment Method, Delirium Observation Screening Scale, Delirium Rating Scale-Revised-98, and Memorial Delirium Assessment Scale.

CONCLUSION

Four commonly used and well-validated instruments can be recommended for clinical and research use. An important area for future investigation is to harmonize these measures to compare and combine studies on delirium.

Current reporting of usability and impact of mHealth interventions for substance use disorder: A systematic review

BACKGROUND

Connected interventions use data collected through mobile/wearable devices to trigger real-time interventions and have great potential to improve treatment for substance use disorder (SUD). This review aims to describe the current landscape, effectiveness and usability of connected interventions for SUD.

METHODS

A systematic review was conducted to identify articles evaluating connected health interventions for SUD in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines. Three databases (PubMed, IEEE, and Scopus) were searched over a five-year period. Included articles described a connected health intervention targeting SUD and provided outcomes data. Data were extracted using a standardized reporting tool.

RESULTS

A total of 1676 unique articles were identified during the initial search, with 32 articles included in the final analysis. Seven articles of the 32 were derived from two large studies. The most commonly studied SUD was alcohol use disorder. Sixteen articles reported at least one statistically significant result with respect to reduced craving and/or substance use. The majority of articles used ecological momentary assessment to trigger interventions, while four used biologic/physiologic data. Two articles used a wearable device. Common intervention types included craving management, coping assistance, and tailored feedback. Twenty-three articles measured usability factors, and acceptability was generally reported as high.

CONCLUSION

Identified themes included a focus on AUD, use of smart phones, use of EMA for intervention delivery, positive effects on SUD related outcomes, and overall high acceptability. Wearables that directly monitor biologic data and predictive analytics using integrated data streams represent understudied opportunities for new research.

Validation of a Secondary Screener for Suicide Risk: Results from the Emergency Department Safety Assessment and Follow-up Evaluation (ED-SAFE)

BACKGROUND

Validated secondary screeners are needed to stratify suicide risk among those with nonnegligible risk. This study tested the predictive utility of the Emergency Department Safety Assessment and Follow-up Evaluation (ED-SAFE) Secondary Screener (ESS), one of the screeners listed by The Joint Commission's Patient Safety Goal 15 resources as a potential secondary screener for acute care settings.

METHODS

The researchers performed secondary analyses of data collected for the ED-SAFE study. Data were collected during an emergency department (ED) visit for 1,376 patients who endorsed active suicide ideation or a suicide attempt in the past week. Participants were followed for 12 months using telephone-based assessments, review of health care records, and National Death Index query. The study examined the predictive validity of the individual items, total score, and a scoring algorithm using the total score and critical items. Bivariable analyses, multivariable logistic regression, and test operating characteristics were calculated.

RESULTS

Of the 1,376 patients enrolled, most were positive for at least one indicator. Four of the indicators were significantly associated with several outcomes. Based on score and critical items, the patients were trichotomized: The three strata were associated with significantly different rates of prospective suicidal behavior, with 52% of the high-risk group engaging in suicidal behavior within 12 months.

CONCLUSION

The ESS possesses adequate operating characteristics for triage purposes. The researchers recommend validation in new samples to confirm its operating characteristics and potentially reduce its length by removing the substance and agitation items, which offered little predictive utility in this study.

Development and pilot study of simple suicide risk rulers for use in the emergency department

BACKGROUND

Many patients treated in the emergency department (ED) for non-psychiatric complaints have elevated suicide risk. Universal screening can detect occult suicide risk, but gold standard risk measurement tools, such as the Beck Scale for Suicidal Ideation (BSS), are too long and cumbersome for ED use.

OBJECTIVE

To test the performance of seven novel 0- to 10-point suicide risk "rulers" against the BSS.

METHOD

399 patients from three EDs completed seven novel risk rulers, traditional binary screening items, and the BSS. Using BSS criterion references, we tested the diagnostic performance of each risk ruler and examined correlations between the rulers and BSS scores.

RESULTS

By varying thresholds on the risk rulers, high levels of sensitivity and specificity were obtained. A threshold of 3 on the "sadness" ruler gave 89% sensitivity for the BSS criterion reference, and a threshold of 1 on the "wish to be dead" ruler provided 94-97% specificity.

CONCLUSION

Our novel risk rulers may be an efficient way to detect risk and triage potentially suicidal patients, showing good concurrent validity with the BSS. Clinicians can obtain high sensitivity and high specificity using just two rulers. Further research should examine the rulers' ability to predict independent clinician risk ratings and prospective suicidal behavior.

Impact of the mental health and dynamic referral for oncology (MHADRO) program on oncology patient outcomes, health care utilization, and health provider behaviors: A multi-site randomized control trial

OBJECTIVE

The MHADRO assesses psychosocial and medical needs, provides tailored feedback reports, and connects patients to mental health providers. This study examined the MHADRO's effect on patient outcomes, health care utilization, and oncology provider documentation and behaviors.

METHODS

836 patients were part of a multi-site RCT and assessments were conducted at baseline, 2, 6 and 12 months.

RESULTS

The intervention group engaged in less emergency calls to providers. There were no differences in psychosocial outcomes at follow up assessments. Providers of patients in the intervention group were more likely to: document psychosocial symptoms and history; refer to psychosocial services; encourage support groups; seek psychological evaluations during visits. Patients who agreed to a mental health referral had decreased hospitalizations, increased mental health care interactions, and stronger ratings of counseling potential benefits. This group also reported increased psychosocial distress at all follow-up assessments.

CONCLUSION

The MHADRO may increase access to mental health care, lessen utilization, and improve providers' management of psychosocial needs, but does not appear to impact overall functioning over time.

PRACTICE IMPLICATIONS

Providers are encouraged to consider incorporating programs, like the MHADRO, into patient care as they may have the potential to impact screening and management of patients' psychosocial needs.

An Interactive Web-Based Lethal Means Safety Decision Aid for Suicidal Adults (Lock to Live): Pilot Randomized Controlled Trial

BACKGROUND

Counseling to reduce access to lethal means such as firearms and medications is recommended for suicidal adults but does not routinely occur. We developed the Web-based Lock to Live (L2L) decision aid to help suicidal adults and their families choose options for safer home storage.

OBJECTIVE

This study aimed to test the feasibility and acceptability of L2L among suicidal adults in emergency departments (EDs).

METHODS

At 4 EDs, we enrolled participants (English-speaking, community-dwelling, suicidal adults) in a pilot randomized controlled trial. Participants were randomized in a 13:7 ratio to L2L or control (website with general suicide prevention information) groups and received a 1-week follow-up telephone call.

RESULTS

Baseline characteristics were similar between the intervention (n=33) and control (n=16) groups. At baseline, many participants reported having access to firearms (33/49, 67%), medications (46/49, 94%), or both (29/49, 59%). Participants viewed L2L for a median of 6 min (IQR 4-10 min). L2L also had very high acceptability; almost all participants reported that they would recommend it to someone in the same situation, that the options felt realistic, and that L2L was respectful of values about firearms. In an exploratory analysis of this pilot trial, more participants in the L2L group reported reduced firearm access at follow-up, although the differences were not statistically significant.

CONCLUSIONS

The L2L decision aid appears feasible and acceptable for use among adults with suicide risk and may be a useful adjunct to lethal means counseling and other suicide prevention interventions. Future large-scale studies are needed to determine the effect on home access to lethal means.

TRIAL REGISTRATION

ClinicalTrials.gov NCT03478501; https://clinicaltrials.gov/ct2/show/NCT03478501.

What do emergency department physicians and nurses feel? A qualitative study of emotions, triggers, regulation strategies, and effects on patient care

BACKGROUND

Despite calls to study how healthcare providers' emotions may impact patient safety, little research has addressed this topic. The current study aimed to develop a comprehensive understanding of emergency department (ED) providers' emotional experiences, including what triggers their emotions, the perceived effects of emotions on clinical decision making and patient care, and strategies providers use to manage their emotions to reduce patient safety risks.

METHODS

Employing grounded theory, we conducted 86 semi-structured qualitative interviews with experienced ED providers (45 physicians and 41 nurses) from four academic medical centres and four community hospitals in the Northeastern USA. Constant comparative analysis was used to develop a grounded model of provider emotions and patient safety in the ED.

RESULTS

ED providers reported experiencing a wide range of emotions in response to patient, hospital, and system-level factors. Patients triggered both positive and negative emotions; hospital and system-level factors largely triggered negative emotions. Providers expressed awareness of possible adverse effects of negative emotions on clinical decision making, highlighting concerns about patient safety. Providers described strategies they employ to regulate their emotions, including emotional suppression, distraction, and cognitive reappraisal. Many providers believed that these strategies effectively guarded against the risk of emotions negatively influencing their clinical decision making.

CONCLUSION

The role of emotions in patient safety is in its early stages and many opportunities exist for researchers, educators, and clinicians to further address this important issue. Our findings highlight the need for future work to (1) determine whether providers' emotion regulation strategies are effective at mitigating patient safety risk, (2) incorporate emotional intelligence training into healthcare education, and (3) shift the cultural norms in medicine to support meaningful discourse around emotions.

Screening and Intervention for Suicide Prevention: A Cost-Effectiveness Analysis of the ED-SAFE Interventions

OBJECTIVE

Suicide screening followed by an intervention may identify suicidal individuals and prevent recurring self-harm, but few cost-effectiveness studies have been conducted. This study sought to determine whether the increased costs of implementing screening and intervention in hospital emergency departments (EDs) are justified by improvements in patient outcomes (decreased attempts and deaths by suicide).

METHODS

The Emergency Department Safety Assessment and Follow-up Evaluation (ED-SAFE) study recruited participants in eight U.S. EDs between August 2010 and November 2013. The eight sites sequentially implemented two interventions: universal screening added to treatment as usual and universal screening plus a telephone-based intervention delivered over 12 months post-ED visit. This study calculated incremental cost-effectiveness ratios and cost-effectiveness acceptability curves to evaluate screening and suicide outcome measures and costs for the two interventions relative to treatment as usual. Costs were calculated from the provider perspective (e.g., wage and salary data and rental costs for hospital space) per patient and per site.

RESULTS

Average per-patient costs to a participating ED of universal screening plus intervention were $1,063 per month, approximately $500 more than universal screening added to treatment as usual. Universal screening plus intervention was more effective in preventing suicides compared with universal screening added to treatment as usual and treatment as usual alone.

CONCLUSIONS

Although the choice of universal screening plus intervention depends on the value placed on the outcome by decision makers, results suggest that implementing such suicide prevention measures can lead to significant cost savings.

Higher Educational Attainment is Associated with Lower Risk of a Future Suicide Attempt Among Non-Hispanic Whites but not Non-Hispanic Blacks

PURPOSE

In a sample of patients presenting to the emergency department (ED), the current study was conducted with two aims: (1) to investigate the protective effects of educational attainment (i.e., completing college) on subsequent risk of suicide attempt/death among patients presenting to the ED and (2) to compare this effect between non-Hispanic Black and non-Hispanic White ED patients.

METHODS

The current study analyzed data from the Emergency Department Safety Assessment and Follow-Up Evaluation (ED-SAFE) study, a quasi-experimental, eight-center study of universal suicide screening and follow-up of ED patients presenting for suicidal ideation and behavior. Our sample included 937 non-Hispanic White and 211 non-Hispanic Blacks. The dependent variable was suicide attempt/death during the 52-week follow-up. The independent variable was completing college. Age, gender, lesbian/gay/bisexual status, psychiatric history, and previous suicide attempts at baseline were covariates. Race/ethnicity was the focal effect modifier. Logistic regression models were used to test the protective effects of educational attainment on suicide risk in the overall sample and by race/ethnicity.

RESULTS

In the overall sample, educational attainment was not associated with suicide risk over the follow-up period. A significant interaction was found between race/ethnicity and educational attainment on suicide risk, suggesting a larger protective effect for non-Hispanic Whites compared with non-Hispanic Blacks. In race/ethnicity-specific models, completing college was associated with decreased future suicide risk for non-Hispanic Whites but not Blacks.

CONCLUSIONS

Consistent with the Minorities' Diminished Return theory, educational attainment better protected non-Hispanic White than non-Hispanic Blacks against future suicide attempt/death. While Whites who have not completed college may be at an increased risk of suicide, risk of suicide seems to be independent of educational attainment for non-Hispanic Blacks.

Applying Computer Adaptive Testing Methods to Suicide Risk Screening in the Emergency Department

OBJECTIVE

Combine test theory with technology to develop brief, reliable suicide risk measures in the emergency department.

METHODS

A computer adaptive test for suicide risk was built using the Beck Scale for Suicide Ideation and tested among the emergency department population. Data were analyzed from a sample of 1,350 patients in several Massachusetts emergency departments. The test was built as outlined by the National Institutes of Health Patient-Reported Outcomes Measurement Information System.

RESULTS

Of 1,350 patients, 74 (5%) scored above the cutoff of BSS > 2. Item 2, "Wish to die", was the most informative item. When using only Item 2, 20% (n = 15/74) of at-risk patients and 3% (n = 40/1,276) of not-at-risk patients were misclassified. Patients were classified after four items with computer adaptive testing trait estimates highly comparable to those of the full scale. The precision rule model did not reduce the scale.

CONCLUSIONS

This study models the creation of a computer adaptive test for suicide ideation and marks the start of the development of computer adaptive tests as a novel suicide risk screening tool in the emergency department. Computer adaptive tests hold promise for revolutionizing behavioral health screening by addressing barriers including time and knowledge deficits.

Which Chart Elements Accurately Identify Emergency Department Visits for Suicidal Ideation or Behavior?

In an emergency department (ED) sample, we investigated the concordance between identification of suicide-related visits through standardized comprehensive chart review versus a subset of 3 specific chart elements: ICD-9-CM codes, free-text presenting complaints, and free-text physician discharge diagnoses. The method for this study was review of medical records for adults (≥18 years) at 8 EDs across the United States. A total of 3,776 charts were reviewed. A combination of the 3 chart elements (ICD-9-CM, presenting complaints, and discharge diagnoses) provided the most robust data with 85% sensitivity, 96% specificity, 92% PPV, and 92% NPV. These findings highlight the use of key discrete fields in the medical record that can be extracted to facilitate identification of whether an ED visit was suicide-related.

Scholarly Productivity and Impact: Developing a Quantifiable, Norm-based Benchmarking Methodology for Academic Emergency Medicine

BACKGROUND

Quantifying and benchmarking scholarly productivity of emergency medicine faculty is challenging. While performance indicators including publication and citation counts are available, use of indicators to create normative references has lagged. The authors developed methodology to benchmark emergency medicine academician scholarly productivity (e.g., publications over time) and impact (e.g., citations per publication over time) against an appropriate reference group.

METHODS

The methodology includes: 1) define time frame and scholarly metrics; 2) identify representative population; 3) reconcile alternative author names; 4) use analytic tool to identify scholarly output; 5) build database containing metrics; and 6) create benchmarking statistics, including subsamples. This study included emergency medicine faculty from 2011 to 2015, with total peer-reviewed publications and citations per publication as scholarly metrics.

RESULTS

In the United States at the time of the search (2016) there were 200 academic emergency departments, 186 with public faculty listings, which yielded 6,727 academicians. For each academician, the authors calculated statistics about peer-reviewed publications and average citations per publication from 2011 to 2015 and created benchmarking rulers using percentile ranks. Productivity by year of graduation with terminal degree was compared within each subsample, finding that newly graduated faculty demonstrated higher productivity than their within-rank peers who graduated earlier. Finally, benchmarking tables were created that allow comparison of peer-reviewed publication counts and citations per publication for individual academicians against the norm.

CONCLUSIONS

This benchmarking method can serve as a model for norm-based scaling of scholarly productivity for emergency medicine. This has important implications for performance review, promotion and hiring, and evaluating group productivity.

Development of a Computerized Adaptive Test Suicide Scale-The CAT-SS

OBJECTIVE

Current suicide risk screening and measurement are inefficient, have limited measurement precision, and focus entirely on suicide-related items. For this study, a psychometric harmonization between related suicide, depression, and anxiety symptom domains that provides a more balanced and complete spectrum of suicidal symptomatology was developed. The objective of this article is to describe the results of the early stages of computerized adaptive testing development for a suicide scale and pave the way for the final stage of validation.

METHODS

Data from psychiatric outpatients at the University of Pittsburgh and a community health clinic were collected from January 2010 through June 2012. 789 participants were enrolled in the calibration phase; 70% were female, and 30% were male. The rate of major depressive disorder as diagnosed by DSM-5 was 47%. The item bank contained 1,008 items related to depression, anxiety, and mania, including 11 suicide items. Data were analyzed using a bifactor model to identify a core dimension between suicidal ideation, depression, anxiety, and mania items. A computerized adaptive test was developed via simulation from the actual complete item responses in 308 subjects.

RESULTS

111 items were identified that provided an extension of suicidality assessment to include statistically related responses from depression and anxiety domains that are syndromally associated with suicidality. All items had high loadings on the primary suicide dimension (average = 0.67; range, 0.49-0.88). Analyses revealed that a mean of 10 items (5-20) had a correlation of 0.96 with the 111-item scale, with a precision of 5 points on a 100-point scale metric. Preliminary validation data based on 290 clinician interviews revealed a 52-fold increase in the likelihood of current suicidal ideation across the range of the Computerized Adaptive Test Suicide Scale (CAT-SS).

CONCLUSIONS

The CAT-SS is able to accurately measure the latent suicide dimension with a mean of 10 items in approximately 2 minutes. Further validation against an independent clinician-administered assessment of suicide risk (ideation and attempts) and prediction of suicidal behavior is underway.

Predictive utility of an emergency department decision support tool in patients with active suicidal ideation

Emergency department (ED) clinicians routinely decide the disposition of patients with suicidal ideation, with potential consequences for patient safety, liability, and system costs and resources. An expert consensus panel recently created a 6-item decision support tool for patients with passive or active suicidal ideation. Individuals scoring a 0 (exhibiting none of the tool's 6 items) are considered "lower risk" and suitable for discharge, while those with non-0 scores are considered "elevated risk" and should receive further evaluation. The current study tested the predictive utility of this tool using existing data from the Emergency Department Safety Assessment and Follow-up Evaluation. ED patients with active suicide ideation (n = 1368) were followed for 12 months after an index visit using telephone assessment and medical chart review. About 1 in 5 patients had attempted suicide during follow-up. Because of the frequency of serious warning signs and risk factors in this population, only three patients met tool criteria for "lower risk" at baseline. The tool had perfect sensitivity, but exceptionally low specificity, in predicting suicidal behavior within 6 weeks and 12 months. In logistic regression analyses, several tool items were significantly associated with suicidal behavior within 6 weeks (suicide plan, past attempt) and 12 months (suicide plan, past attempt, suicide intent, significant mental health condition, irritability/agitation/aggression). Although the tool did not perform well as a binary instrument among those with active suicidal ideation, having a suicide plan identified almost all attempters while suicide plan and past attempt identified over four-fifths of near-term attempts. (PsycINFO Database Record

Emergency Department patients with suicide risk: Differences in care by acute alcohol use

OBJECTIVE

To compare Emergency Department (ED) care of suicidal patients with and without documented acute alcohol use.

METHODS

Retrospective chart review of randomly sampled patient visits (n = 800; January 2014 to December 2015) at an urban ED with universal screening for suicide risk. Eligible visits were by adults (18+ years) who screened positive for suicide risk at the ED visit (i.e., suicidal ideation in past two weeks or suicide attempt in past six months). Analyses compared those with and without documentation of acute alcohol use.

RESULTS

Among these patients with suicide risk, 19% had documented acute alcohol use (versus 43% with no use and 38% without documentation); individuals with acute alcohol use were more often male and aged 35-59 years. Overall, 62% were evaluated by a mental health professional in the ED. Individuals with acute alcohol use were significantly less likely (vs those without use) to be evaluated by a mental health professional in the ED (odds ratio 0.49, 95%CI 0.28-0.87) after adjustment for age, recent suicide ideation, current suicide plan, self-harm as a chief complaint, contact with family, and ED disposition.

CONCLUSIONS

Although alcohol use can increase suicide risk, ED patients with acute use appear to receive less thorough suicide risk assessments.

A systematic review of smartphone applications for smoking cessation

Tobacco use is the leading cause of preventable disease and death in the USA. However, limited data exists regarding smoking cessation mobile app quality and intervention effectiveness. Innovative and scalable interventions are needed to further alleviate the public health implications of tobacco addiction. The proliferation of the smartphone and the advent of mobile phone health interventions have made treatment more accessible than ever. The purpose of this review was to examine the relation between published scientific literature and available commercial smartphone health apps for smoking cessation to identify the percentage of scientifically supported apps that were commercially available to consumers and to determine how many of the top commercially available apps for smoking cessation were supported by the published scientific literature. Adhering to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines, apps were reviewed in four phases: (1) identified apps from the scientific literature, (2) searched app stores for apps identified in the literature, (3) identified top apps available in leading app stores, and (4) determined which top apps available in stores had scientific support. Seven articles identified six apps with some level of scientific support, three (50%) were available in at least one app store. Conversely, among the top 50 apps suggested by each of the leading app stores, only two (4%) had any scientific support. While half of the scientifically vetted apps remain available to consumers, they are difficult to find among the many apps that are identified through app store searches.

Ecological momentary assessment and first smoking cessation lapse after an acute cardiac event: A pilot study

This 28-day pilot study assessed the feasibility of cell phone ecological momentary assessment in 40 smokers who received emergency department evaluations for acute coronary syndrome. Ecological momentary assessments used familiar touch tone response technology during a cell phone call to capture ratings of illness perceptions, emotion, behavioral intentions, and smoking. Ecological momentary assessments were conducted 1-8 times/day and took 1-2 minutes to complete. The mean ecological momentary assessment call compliance for all 40 subjects was 56.3 percent (standard deviation = 29.4), and during an ecological momentary assessment, 72.5 percent of participants reported a first lapse. We found that first-week call compliance was significantly correlated with subsequent compliance (r = 0.55, p < 0.001).

Methods for Evaluating the Content, Usability, and Efficacy of Commercial Mobile Health Apps

Commercial mobile apps for health behavior change are flourishing in the marketplace, but little evidence exists to support their use. This paper summarizes methods for evaluating the content, usability, and efficacy of commercially available health apps. Content analyses can be used to compare app features with clinical guidelines, evidence-based protocols, and behavior change techniques. Usability testing can establish how well an app functions and serves its intended purpose for a target population. Observational studies can explore the association between use and clinical and behavioral outcomes. Finally, efficacy testing can establish whether a commercial app impacts an outcome of interest via a variety of study designs, including randomized trials, multiphase optimization studies, and N-of-1 studies. Evidence in all these forms would increase adoption of commercial apps in clinical practice, inform the development of the next generation of apps, and ultimately increase the impact of commercial apps.

Disparities in Treatment of Older Adults with Suicide Risk in the Emergency Department

BACKGROUND/OBJECTIVE

We described characteristics and treatment received for older (≥60 years) vs younger (<60 years) adult emergency department (ED) patients with suicide risk.

DESIGN

Retrospective chart review.

SETTING

An ED with universal screening for suicide risk.

PARTICIPANTS

Eligible charts included a random sample of adults (≥18 years) who screened positive for suicidal ideation (SI) in past 2 weeks and/or a suicide attempt (SA) within the past 6 months. Visit dates were from May 2014 to September 2016.

RESULTS

A total of 800 charts were reviewed, with oversampling of older adults. Of the 200 older adults sampled, fewer older adults compared to younger adults (n = 600) had a chief complaint involving psychiatric behavior (53% vs 70%) or self-harm behavior (26% vs 36%). Although a higher number of older adults (93%) had documentation of current SI compared to younger adults (79%), fewer older adults (17%) reported SA in the past 2 weeks compared to younger adults (23%). Of those with a positive suicide screen who were discharged home, less than half of older adults received a mental health evaluation during their visit (42%, 95% CI 34-52) compared to 66% (95% CI 61-70) of younger adults who met the same criteria. Similarly, fewer older, than younger, adult patients with current SI/SA received referral resources (34%; 95% CI 26-43; vs 60%; 95% CI 55-65).

CONCLUSIONS

Significantly fewer suicidal older adult patients who were discharged home received a mental health evaluation when compared to similar younger adults. These findings highlight an important area for improvement in the treatment of older adults at risk for suicide.

Suicide Prevention in an Emergency Department Population: The ED-SAFE Study

IMPORTANCE

Suicide is a leading cause of deaths in the United States. Although the emergency department (ED) is an opportune setting for initiating suicide prevention efforts, ED-initiated suicide prevention interventions remain underdeveloped.

OBJECTIVE

To determine whether an ED-initiated intervention reduces subsequent suicidal behavior.

DESIGN, SETTING, AND PARTICIPANTS

This multicenter study of 8 EDs in the United States enrolled adults with a recent suicide attempt or ideation and was composed of 3 sequential phases: (1) a treatment as usual (TAU) phase from August 2010 to December 2011, (2) a universal screening (screening) phase from September 2011 to December 2012, and (3) a universal screening plus intervention (intervention) phase from July 2012 to November 2013.

INTERVENTIONS

Screening consisted of universal suicide risk screening. The intervention phase consisted of universal screening plus an intervention, which included secondary suicide risk screening by the ED physician, discharge resources, and post-ED telephone calls focused on reducing suicide risk.

MAIN OUTCOMES AND MEASURES

The primary outcome was suicide attempts (nonfatal and fatal) over the 52-week follow-up period. The proportion and total number of attempts were analyzed.

RESULTS

A total of 1376 participants were recruited, including 769 females (55.9%) with a median (interquartile range) age of 37 (26-47) years. A total of 288 participants (20.9%) made at least 1 suicide attempt, and there were 548 total suicide attempts among participants. There were no significant differences in risk reduction between the TAU and screening phases (23% vs 22%, respectively). However, compared with the TAU phase, patients in the intervention phase showed a 5% absolute reduction in suicide attempt risk (23% vs 18%), with a relative risk reduction of 20%. Participants in the intervention phase had 30% fewer total suicide attempts than participants in the TAU phase. Negative binomial regression analysis indicated that the participants in the intervention phase had significantly fewer total suicide attempts than participants in the TAU phase (incidence rate ratio, 0.72; 95% CI, 0.52-1.00; P = .05) but no differences between the TAU and screening phases (incidence rate ratio, 1.00; 95% CI, 0.71-1.41; P = .99).

CONCLUSIONS AND RELEVANCE

Among at-risk patients in the ED, a combination of brief interventions administered both during and after the ED visit decreased post-ED suicidal behavior.

Computer Administered Safety Planning for Individuals at Risk for Suicide: Development and Usability Testing

BACKGROUND

Safety planning is a brief intervention that has become an accepted practice in many clinical settings to help prevent suicide. Even though it is quick compared to other approaches, it frequently requires 20 min or more to complete, which can impede adoption. A self-administered, Web-based safety planning application could potentially reduce clinician time, help promote standardization and quality, and provide enhanced ability to share the created plan.

OBJECTIVE

The aim of this study was to design, build, and test the usability of a Web-based, self-administered safety planning application.

METHODS

We employed a user-centered software design strategy led by a multidisciplinary team. The application was tested for usability with a target sample of suicidal patients. Detailed observations, structured usability ratings, and Think Aloud procedures were used. Suicidal ideation intensity and perceived ability to cope were assessed pre-post engagement with the Web application.

RESULTS

A total of 30 participants were enrolled. Usability ratings were generally strong, and all patients successfully built a safety plan. However, the completeness of the safety plan varied. The mean number of steps completed was 5.5 (SD 0.9) out of 6, with 90% (27/30) of participants completing at least 5 steps and 67% (20/30) completing all 6 steps. Some safety planning steps were viewed as inapplicable to some individuals. Some confusion in instructions led to modifications to improve understandability of each step. Ratings of suicide intensity after completion of the application were significantly lower than preratings, pre: mean 5.11 (SD 2.9) versus post: mean 4.46 (SD 3.0), t27=2.49, P=.02. Ratings of ability to cope with suicidal thoughts after completion of the application were higher than preratings, with the difference approaching statistical significance, pre: mean 5.93 (SD 2.9), post: mean 6.64 (SD 2.4), t27=-2.03, P=.05.

CONCLUSIONS

We have taken the first step toward identifying the components needed to maximize usability of a self-administered, Web-based safety planning application. Results support initial consideration of the application as an adjunct to clinical contact. This allows for the clinician or other personnel to provide clarification, when needed, to help the patient build the plan, and to help review and revise the draft.

Health Evaluation and Referral Assistant: A Randomized Controlled Trial of a Web-Based Screening, Brief Intervention, and Referral to Treatment System to Reduce Risky Alcohol Use Among Emergency Department Patients

Background

Computer technologies hold promise for implementing alcohol screening, brief intervention, and referral to treatment (SBIRT). Questions concerning the most effective and appropriate SBIRT model remain.

Objective

The aim of this study was to evaluate the impact of a computerized SBIRT system called the Health Evaluation and Referral Assistant (HERA) on risky alcohol use treatment initiation.

Methods

Alcohol users (N=319) presenting to an emergency department (ED) were considered for enrollment. Those enrolled (n=212) were randomly assigned to the HERA, to complete a patient-administered assessment using a tablet computer, or a minimal-treatment control, and were followed for 3 months. Analyses compared alcohol treatment provider contact, treatment initiation, treatment completion, and alcohol use across condition using univariate comparisons, generalized estimating equations (GEEs), and post hoc chi-square analyses.

Results

HERA participants (n=212; control=115; intervention=97) did not differ between conditions on initial contact with an alcohol treatment provider, treatment initiation, treatment completion, or change in risky alcohol use behavior. Subanalyses indicated that HERA participants, who accepted a faxed referral, were more likely to initiate contact with a treatment provider and initiate treatment for risky alcohol use, but were not more likely to continue engaging in treatment, or to complete treatment and change risky alcohol use behavior over the 3-month period following the ED visit.

Conclusions

The HERA promoted initial contact with an alcohol treatment provider and initiation of treatment for those who accepted the faxed referral, but it did not lead to reduced risky alcohol use behavior. Factors which may have limited the HERA’s impact include lack of support for the intervention by clinical staff, the low intensity of the brief and stand-alone design of the intervention, and barriers related to patient follow-through, (eg, a lack of transportation or childcare, fees for services, or schedule conflicts).

Trial Registration

International Standard Randomized Controlled Trial Number (ISRCTN): NCT01153373; https://clinicaltrials.gov/ct2/show/NCT01153373 (Archived by WebCite at http://www.webcitation.org/6pHQEpuIF)