Validation of the Stanford Proxy Test for Delirium (S-PTD) among critical and noncritical patients

Reliability and Validity of the Spanish Adaptation of the Stanford Proxy Test for Delirium in Two Clinical Spanish-Speaking Communities

BACKGROUND

Delirium is the most prevalent neuropsychiatric syndrome experienced by patients admitted to inpatient clinical units, occurring in at least 20% of medically hospitalized patients and up to 85% of those admitted to critical care units. Although current guidelines recommend the implementation of universal prevention strategies, the use of management strategies largely depends on constant surveillance and screening. This allows for the timely diagnosis and correction of its underlying causes and implementation of management strategies.

OBJECTIVE

It was to adapt and analyze the Spanish adaptation of the Stanford Proxy Test for Delirium (S-PTDsv) instrument for its use among Spanish-speaking populations. The S-PTD is an instrument consisting of 13 observational items to be completed by a clinician observer, usually the patient's nurse. The completion of the questionnaire takes about 1 minute and does not require the active participation of the person evaluated, which has important clinical advantages compared to other available instruments (e.g., the Confusion Assessment Method).

METHODS

The psychometric properties of the S-PTDsv were evaluated in a population of 123 patients using a quantitative, cross-sectional design. All subjects were over 18 years of age and hospitalized in various inpatient medico-surgical and intensive care unit services, either at the Barcelona Clinical Hospital (Barcelona, Spain) or the UC-Christus Health Network Clinical Hospital (Santiago, Chile, S.A.). The ultimate diagnosis of delirium was made by a member of the Psychiatry Consult Service by means of an independent neuropsychiatric evaluation based on the Fifth Edition of the Diagnostic and Statistical Manual of Mental Disorders (DSM-5) criteria, published in 2013, which is the latest version of the diagnostic manual. All study tests were performed by study personnel who were blinded to each other's test results within an hour of each other.

RESULTS

In the receiver operator characteristic (ROC) curve analysis, the S-PTDsv demonstrated excellent classification qualities when compared with the DSM-5 as the classification reference standard. Using a cutoff point of ≥3, the S-PTDsv had a sensitivity of 94% and a specificity of 97%. The area under the curve indicator was equal to 0.95, suggesting the S-PTDsv has an excellent overall performance in accurately identifying cases of delirium. Accordingly, the S-PTDsv's positive predictive value = 0.93, and the negative predictive value = 0.97. The internal reliability measured with Cronbach's alpha was 0.96. Confirmatory factor analysis revealed a 1-dimensional structure with high loadings (>0.72), demonstrating that all items similarly contribute to the total diagnostic dimension, suggesting adequate construct validity. This provided evidence of convergent validity.

CONCLUSIONS

The performance of the S-PTDsv, as compared to a blinded neuropsychiatric assessment based on DSM-5, indicates that it is an effective instrument for the detection of delirium, in the Spanish-speaking populations. These results are comparable and consistent with previously published studies in the English language version.

A health system's journey to preventing workplace violence: Use of multidisciplinary teamwork to unify efforts across a health system

Workplace violence (WPV) is known to threaten the safety of patients and staff. In 2018, a wellness survey showed many employees had not received training on WPV prevention and felt unprepared to manage aggression. The health network's leaders knew they needed to take action. From various multidisciplinary committees, the leaders were able to create a comprehensive WPV prevention program. Some of the highlights of this program include forming a centralized security department, codes of conduct, and crisis response process, adopting tools to predict violence, and providing a range of education. Data from WPV events showed the health network had a statistically significant reduction in WPV events from 2020 to 2021. However, WPV events increased in 2022. This increase in 2022 mirrors national trends in WPV. There are a number of factors that may have impacted this increase. Regardless, the leaders at the health network are dedicated to continuously improving the WPV prevention program. Some of the ongoing projects include improving data collection methods and building a long-term notification for highly violent individuals. This WPV prevention program relies on the commitment of its multidisciplinary team members and focuses on taking care of patients while also prioritizing the wellness of the staff.

Current Trends for Delirium Screening within the Emergency Department

Delirium is an acute neurological disorder that involves attention and cognition. It is associated with a high risk of morbidity and mortality among older people (>65 years old). In the context of the Emergency Department (ED), it is frequently experienced by patients but often not recognized. Literature studies have identified some screening instruments for an initial evaluation of delirium. Most of these tools have not been validated yet in the context of emergencies, but, in other settings, they were very useful for assessing and maximizing the recognition of this condition among older patients. We conducted a review of the literature, including randomized control trials, clinical and observational studies, and research studies published in recent years, confirming that most of the screening tools for delirium used in the intensive care unit (ICU) or the geriatric department have not been tested in the ED, and the ideal timing and form of the delirium assessment process for older adults have not been defined yet. The aim of our review is to summarize the updated evidence about the screening tools for delirium in the context of the ED, due to the fact that overcrowding of the ED and the stressful condition of emergency situations (that contribute to the onset of delirium) could expose older patients to a high risk of complications and mortality if delirium is not promptly recognized. In conclusion, we support the evidence that delirium is a current and real condition that emergency physicians have to face daily, and we are aware that more research is needed to explore this field in order to improve the overall outcomes of older patients admitted to the ED.

An Interdisciplinary Reappraisal of Delirium and Proposed Subtypes

An interdisciplinary plenary session entitled "Rethinking and Rehashing Delirium" was held during the 2021 Annual Meeting of the Academy of Consultation-Liaison Psychiatry to facilitate dialog on the prevalent approach to delirium. Panel members included a psychiatrist, neurointensivist, and critical care specialist, and attendee comments were solicited with the goal of developing a statement. Discussion was focused on a reappraisal of delirium and, in particular, its disparate terminology and history in relation to acute encephalopathy. The authors endorse a recent joint position statement that describes acute encephalopathy as a rapidly evolving (<4 weeks) pathobiological brain process that presents as subsyndromal delirium, delirium, or coma and suggest the following points of refinement: (1) to suggest that "delirium disorder" describe the diagnostic construct including its syndrome, precipitant(s), and unique pathophysiology; (2) to restrict the term "delirium" to describing the clinical syndrome encountered at the bedside; (3) to clarify that the disfavored term "altered mental status" may occasionally be an appropriate preliminary designation where the diagnosis cannot yet be specified further; and (4) to provide rationale for rejecting the terms acute brain injury, failure, or dysfunction. The final common pathway of delirium appears to involve higher-level brain network dysfunction, but there are many insults that can disrupt functional connectivity. We propose that future delirium classification systems should seek to characterize the unique pathophysiological disturbances ("endotypes") that underlie delirium and delirium's individual neuropsychiatric symptoms. We provide provisional means of classification in hopes that novel subtypes might lead to specific intervention to improve patient experience and outcomes. This paper concludes by considering future directions for the field. Key areas of opportunity include interdisciplinary initiatives to harmonize efforts across specialties and settings, enhance underrepresented groups in research, integration of delirium and encephalopathy in coding, development of relevant quality and safety measures, and exploration of opportunities for translational science.

Development and External Validation of a Delirium Prediction Model for Hospitalized Patients With Coronavirus Disease 2019

Background

The coronavirus disease 2019 pandemic has placed unprecedented stress on health systems and has been associated with elevated risk for delirium. The convergence of pandemic resource limitation and clinical demand associated with delirium requires careful risk stratification for targeted prevention efforts.

Objectives

To develop an incident delirium predictive model among coronavirus disease 2019 patients.

Methods

We applied supervised machine learning to electronic health record data for inpatients with coronavirus disease 2019 at three hospitals to build an incident delirium diagnosis prediction model. We validated this model in three different hospitals. Both hospital cohorts included academic and community settings.

Results

Among 2907 patients across 6 hospitals, 488 (16.8%) developed delirium. Applying the predictive model in the external validation cohort of 755 patients, the c-index was 0.75 (0.71–0.79) and the lift in the top quintile was 2.1. At a sensitivity of 80%, the specificity was 56%, negative predictive value 92%, and positive predictive value 30%. Equivalent model performance was observed in subsamples stratified by age, sex, race, need for critical care and care at community vs. academic hospitals.

Conclusion

Machine learning applied to electronic health records available at the time of inpatient admission can be used to risk-stratify patients with coronavirus disease 2019 for incident delirium. Delirium is common among patients with coronavirus disease 2019, and resource constraints during a pandemic demand careful attention to the optimal application of predictive models.

Implementing an intensive care unit (ICU) diary program at a large academic medical center: Results from a randomized control trial evaluating psychological morbidity associated with critical illness

BACKGROUND

Psychological morbidity in both patients and family members related to the intensive care unit (ICU) experience is an often overlooked, and potentially persistent, healthcare problem recognized by the Society of Critical Care Medicine as Post-intensive Care Syndrome (PICS). ICU diaries are an intervention increasingly under study with potential to mitigate ICU-related psychological morbidity, including ICU-related post-traumatic stress disorder (PTSD), depression and anxiety. As we encounter a growing number of ICU survivors, in particular in the wake of the coronavirus pandemic, clinicians must be equipped to understand the severity and prevalence of significant psychiatric complications of critical illness.

METHODS

We compared the efficacy of the ICU diary, written by family and healthcare workers during the patient's intensive care course, versus education alone in reducing acute PTSD symptoms after discharge. Patients with an ICU stay >72 h, who were intubated and mechanically ventilated over 24 h, were recruited and randomized to either receive a diary at bedside with psychoeducation or psychoeducation alone. Intervention patients received their ICU diary within the first week of admission into the intensive care unit. Psychological symptom screening with IES-R, PHQ-8, HADS and GAD-7 was conducted at baseline within 1 week of ICU discharge and at weeks 4, 12, and 24 after ICU discharge. Change from baseline in these scores was assessed using Wilcoxon rank sum tests.

RESULTS

From September 26, 2017 to September 25, 2018, our team screened 265 patients from the surgical and medical ICUs at a single large academic urban hospital. 60 patients were enrolled and randomized, of which 35 patients completed post-discharge follow-up, (n = 18) in the diary intervention group and (n = 17) in the education-only control group. The control group had a significantly greater decrease in PTSD, hyperarousal, and depression symptoms at week 4 compared to the intervention group. There were no significant differences in other measures, or at other follow-up intervals. Both study groups exhibited clinically significant PTSD symptoms at all timepoints after ICU discharge. Follow-up phone interviews with patients revealed that while many were interested in getting follow-up for their symptoms, there were many barriers to accessing appropriate therapy and clinical attention.

CONCLUSIONS

Results from psychological screening tools demonstrate no benefit of ICU diaries versus bedside education-alone in reducing PTSD symptoms related to the intensive care stay. However, our study finds an important gap in clinical practice - patients at high risk for PICS are infrequently connected to appropriate follow-up care. Perhaps ICU diaries would prove beneficial if utilized to support the work within a program providing wrap-around services and close psychiatric follow up for PICS patients. This study demonstrates the high prevalence of ICU-related PTSD in our cohort of survivors, the high barrier to accessing care for appropriate treatment of PICS, and the consequence of that barrier-prolonged psychological morbidity.

TRIAL REGISTRATION

NCT04305353.

GRANT IDENTIFICATION

GH-17-022 (Arnold P. Gold Foundation).

Diagnostic Performance of Delirium Assessment Tools in Critically Ill Patients: A Systematic Review and Meta-Analysis

BACKGROUND

Critical care nurses are in the best position to detect and monitor delirium in critically ill patients. Therefore, an optimum delirium assessment tool with strong evidence should be identified with critical care nurses to perform in the daily assessment.

AIM

To evaluate and compare the diagnostic performance of delirium assessment tools in diagnosing delirium in critically ill patients.

METHODS

We searched five electronic databases including the Cochrane Library, PubMed, Embase, CINAHL, and a Chinese database for eligible diagnostic studies published in English or Mandarin up to December 2018. This diagnostic test accuracy meta-analysis was limited to studies in intensive care unit (ICU) settings, using the Diagnostic and Statistical Manual of Mental Disorders (DSM) as a standard reference to test the accuracy of delirium assessment tools. Eligible studies were critically appraised by two investigators independently. The summary of evidence was conducted for pooling and comparing diagnostic accuracy by a bivariate random effects meta-analysis model. The pooled sensitivities and specificities, summary receiver operating characteristic curve (sROC), the area under the curve (AUC), and diagnostic odds ratio (DOR) were calculated and plotted. The possibility of publication bias was assessed by Deeks' funnel plot.

DATA SYNTHESIS

We identified and evaluated 23 and 8 articles focused on CAM-ICU and ICDSC, respectively. The summary sensitivities of 0.85 and 0.87, and summary specificities of 0.95 and 0.91 were found for CAM-ICU and ICDSC, respectively. The AUC of the CAM-ICU was 0.96 (95% CI, 0.94-0.98), with DOR at 99 (95% CI, 55-177). The AUC of the ICDSC was 0.95 (95% CI, 0.92-0.96), and the DOR was 65 (95% CI, 27-153).

LINKING EVIDENCE TO ACTION

CAM-ICU demonstrated higher diagnostic test accuracy and is recommended as the optimal delirium assessment tool. However, the results should be interpreted with caution due to the between-study heterogeneity of this diagnostic test accuracy meta-analysis.