The development of a web-based app employing machine learning for delirium prevention in long-term care facilities in South Korea

Background

Long-term care facilities (LCFs) in South Korea have limited knowledge of and capability to care for patients with delirium. They also often lack an electronic medical record system. These barriers hinder systematic approaches to delirium monitoring and intervention. Therefore, this study aims to develop a web-based app for delirium prevention in LCFs and analyse its feasibility and usability.

Methods

The app was developed based on the validity of the AI prediction model algorithm. A total of 173 participants were selected from LCFs to participate in a study to determine the predictive risk factors for delerium.

The app was developed in five phases: (1) the identification of risk factors and preventive intervention strategies from a review of evidence-based literature, (2) the iterative design of the app and components of delirium prevention, (3) the development of a delirium prediction algorithm and cloud platform, (4) a pilot test and validation conducted with 33 patients living in a LCF, and (5) an evaluation of the usability and feasibility of the app, completed by nurses (Main users).

Results

A web-based app was developed to predict high risk of delirium and apply preventive interventions accordingly. Moreover, its validity, usability, and feasibility were confirmed after app development. By employing machine learning, the app can predict the degree of delirium risk and issue a warning alarm. Therefore, it can be used to support clinical decision-making, help initiate the assessment of delirium, and assist in applying preventive interventions.

Conclusions

This web-based app is evidence-based and can be easily mobilised to support care for patients with delirium in LCFs. This app can improve the recognition of delirium and predict the degree of delirium risk, thereby helping develop initiatives for delirium prevention and providing interventions. Moreover, this app can be extended to predict various risk factors of LCF and apply preventive interventions. Its use can ultimately improve patient safety and quality of care.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12911-022-01966-8.

Non-pharmacological interventions for preventing delirium in hospitalised non-ICU patients

BACKGROUND

Delirium is an acute neuropsychological disorder that is common in hospitalised patients. It can be distressing to patients and carers and it is associated with serious adverse outcomes. Treatment options for established delirium are limited and so prevention of delirium is desirable. Non-pharmacological interventions are thought to be important in delirium prevention.  OBJECTIVES: To assess the effectiveness of non-pharmacological interventions designed to prevent delirium in hospitalised patients outside intensive care units (ICU).

SEARCH METHODS

We searched ALOIS, the specialised register of the Cochrane Dementia and Cognitive Improvement Group, with additional searches conducted in MEDLINE, Embase, PsycINFO, CINAHL, LILACS, Web of Science Core Collection, ClinicalTrials.gov and the World Health Organization Portal/ICTRP to 16 September 2020. There were no language or date restrictions applied to the electronic searches, and no methodological filters were used to restrict the search.

SELECTION CRITERIA

We included randomised controlled trials (RCTs) of single and multicomponent non-pharmacological interventions for preventing delirium in hospitalised adults cared for outside intensive care or high dependency settings. We only included non-pharmacological interventions which were designed and implemented to prevent delirium.  DATA COLLECTION AND ANALYSIS: Two review authors independently examined titles and abstracts identified by the search for eligibility and extracted data from full-text articles. Any disagreements on eligibility and inclusion were resolved by consensus. We used standard Cochrane methodological procedures. The primary outcomes were: incidence of delirium; inpatient and later mortality; and new diagnosis of dementia. We included secondary and adverse outcomes as pre-specified in the review protocol. We used risk ratios (RRs) as measures of treatment effect for dichotomous outcomes and between-group mean differences for continuous outcomes. The certainty of the evidence was assessed using GRADE. A complementary exploratory analysis was undertaker using a Bayesian component network meta-analysis fixed-effect model to evaluate the comparative effectiveness of the individual components of multicomponent interventions and describe which components were most strongly associated with reducing the incidence of delirium.

MAIN RESULTS

We included 22 RCTs that recruited a total of 5718 adult participants. Fourteen trials compared a multicomponent delirium prevention intervention with usual care. Two trials compared liberal and restrictive blood transfusion thresholds. The remaining six trials each investigated a different non-pharmacological intervention. Incidence of delirium was reported in all studies.  Using the Cochrane risk of bias tool, we identified risks of bias in all included trials. All were at high risk of performance bias as participants and personnel were not blinded to the interventions. Nine trials were at high risk of detection bias due to lack of blinding of outcome assessors and three more were at unclear risk in this domain.  Pooled data showed that multi-component non-pharmacological interventions probably reduce the incidence of delirium compared to usual care (10.5% incidence in the intervention group, compared to 18.4% in the control group, risk ratio (RR) 0.57, 95% confidence interval (CI) 0.46 to 0.71, I2 = 39%; 14 studies; 3693 participants; moderate-certainty evidence, downgraded due to risk of bias).  There may be little or no effect of multicomponent interventions on inpatient mortality compared to usual care (5.2% in the intervention group, compared to 4.5% in the control group, RR 1.17, 95% CI 0.79 to 1.74, I2 = 15%; 10 studies; 2640 participants; low-certainty evidence downgraded due to inconsistency and imprecision).  No studies of multicomponent interventions reported data on new diagnoses of dementia.  Multicomponent interventions may result in a small reduction of around a day in the duration of a delirium episode (mean difference (MD) -0.93, 95% CI -2.01 to 0.14 days, I2 = 65%; 351 participants; low-certainty evidence downgraded due to risk of bias and imprecision). The evidence is very uncertain about the effect of multicomponent interventions on delirium severity (standardised mean difference (SMD) -0.49, 95% CI -1.13 to 0.14, I2=64%; 147 participants; very low-certainty evidence downgraded due to risk of bias and serious imprecision). Multicomponent interventions may result in a reduction in hospital length of stay compared to usual care (MD -1.30 days, 95% CI -2.56 to -0.04 days, I2=91%; 3351 participants; low-certainty evidence downgraded due to risk of bias and inconsistency), but little to no difference in new care home admission at the time of hospital discharge (RR 0.77, 95% CI 0.55 to 1.07; 536 participants; low-certainty evidence downgraded due to risk of bias and imprecision). Reporting of other adverse outcomes was limited.  Our exploratory component network meta-analysis found that re-orientation (including use of familiar objects), cognitive stimulation and sleep hygiene were associated with reduced risk of incident delirium. Attention to nutrition and hydration, oxygenation, medication review, assessment of mood and bowel and bladder care were probably associated with a reduction in incident delirium but estimates included the possibility of no benefit or harm.  Reducing sensory deprivation, identification of infection, mobilisation and pain control all had summary estimates that suggested potential increases in delirium incidence, but the uncertainty in the estimates was substantial.  Evidence from two trials suggests that use of a liberal transfusion threshold over a restrictive transfusion threshold probably results in little to no difference in incident delirium (RR 0.92, 95% CI 0.62 to 1.36; I2 = 9%; 294 participants; moderate-certainty evidence downgraded due to risk of bias).  Six other interventions were examined, but evidence for each was limited to single studies and we identified no evidence of delirium prevention.  AUTHORS' CONCLUSIONS: There is moderate-certainty evidence regarding the benefit of multicomponent non-pharmacological interventions for the prevention of delirium in hospitalised adults, estimated to reduce incidence by 43% compared to usual care. We found no evidence of an effect on mortality. There is emerging evidence that these interventions may reduce hospital length of stay, with a trend towards reduced delirium duration, although the effect on delirium severity remains uncertain. Further research should focus on implementation and detailed analysis of the components of the interventions to support more effective, tailored practice recommendations.

Non-pharmacological interventions for preventing delirium in hospitalised non-ICU patients

BACKGROUND

Delirium is an acute neuropsychological disorder that is common in hospitalised patients. It can be distressing to patients and carers and it is associated with serious adverse outcomes. Treatment options for established delirium are limited and so prevention of delirium is desirable. Non-pharmacological interventions are thought to be important in delirium prevention.  OBJECTIVES: To assess the effectiveness of non-pharmacological interventions designed to prevent delirium in hospitalised patients outside intensive care units (ICU).

SEARCH METHODS

We searched ALOIS, the specialised register of the Cochrane Dementia and Cognitive Improvement Group, with additional searches conducted in MEDLINE, Embase, PsycINFO, CINAHL, LILACS, Web of Science Core Collection, ClinicalTrials.gov and the World Health Organization Portal/ICTRP to 16 September 2020. There were no language or date restrictions applied to the electronic searches, and no methodological filters were used to restrict the search.

SELECTION CRITERIA

We included randomised controlled trials (RCTs) of single and multicomponent non-pharmacological interventions for preventing delirium in hospitalised adults cared for outside intensive care or high dependency settings. We only included non-pharmacological interventions which were designed and implemented to prevent delirium.  DATA COLLECTION AND ANALYSIS: Two review authors independently examined titles and abstracts identified by the search for eligibility and extracted data from full-text articles. Any disagreements on eligibility and inclusion were resolved by consensus. We used standard Cochrane methodological procedures. The primary outcomes were: incidence of delirium; inpatient and later mortality; and new diagnosis of dementia. We included secondary and adverse outcomes as pre-specified in the review protocol. We used risk ratios (RRs) as measures of treatment effect for dichotomous outcomes and between-group mean differences for continuous outcomes. The certainty of the evidence was assessed using GRADE. A complementary exploratory analysis was undertaker using a Bayesian component network meta-analysis fixed-effect model to evaluate the comparative effectiveness of the individual components of multicomponent interventions and describe which components were most strongly associated with reducing the incidence of delirium.

MAIN RESULTS

We included 22 RCTs that recruited a total of 5718 adult participants. Fourteen trials compared a multicomponent delirium prevention intervention with usual care. Two trials compared liberal and restrictive blood transfusion thresholds. The remaining six trials each investigated a different non-pharmacological intervention. Incidence of delirium was reported in all studies.  Using the Cochrane risk of bias tool, we identified risks of bias in all included trials. All were at high risk of performance bias as participants and personnel were not blinded to the interventions. Nine trials were at high risk of detection bias due to lack of blinding of outcome assessors and three more were at unclear risk in this domain.  Pooled data showed that multi-component non-pharmacological interventions probably reduce the incidence of delirium compared to usual care (10.5% incidence in the intervention group, compared to 18.4% in the control group, risk ratio (RR) 0.57, 95% confidence interval (CI) 0.46 to 0.71, I2 = 39%; 14 studies; 3693 participants; moderate-certainty evidence, downgraded due to risk of bias).  There may be little or no effect of multicomponent interventions on inpatient mortality compared to usual care (5.2% in the intervention group, compared to 4.5% in the control group, RR 1.17, 95% CI 0.79 to 1.74, I2 = 15%; 10 studies; 2640 participants; low-certainty evidence downgraded due to inconsistency and imprecision).  No studies of multicomponent interventions reported data on new diagnoses of dementia.  Multicomponent interventions may result in a small reduction of around a day in the duration of a delirium episode (mean difference (MD) -0.93, 95% CI -2.01 to 0.14 days, I2 = 65%; 351 participants; low-certainty evidence downgraded due to risk of bias and imprecision). The evidence is very uncertain about the effect of multicomponent interventions on delirium severity (standardised mean difference (SMD) -0.49, 95% CI -1.13 to 0.14, I2=64%; 147 participants; very low-certainty evidence downgraded due to risk of bias and serious imprecision). Multicomponent interventions may result in a reduction in hospital length of stay compared to usual care (MD -1.30 days, 95% CI -2.56 to -0.04 days, I2=91%; 3351 participants; low-certainty evidence downgraded due to risk of bias and inconsistency), but little to no difference in new care home admission at the time of hospital discharge (RR 0.77, 95% CI 0.55 to 1.07; 536 participants; low-certainty evidence downgraded due to risk of bias and imprecision). Reporting of other adverse outcomes was limited.  Our exploratory component network meta-analysis found that re-orientation (including use of familiar objects), cognitive stimulation and sleep hygiene were associated with reduced risk of incident delirium. Attention to nutrition and hydration, oxygenation, medication review, assessment of mood and bowel and bladder care were probably associated with a reduction in incident delirium but estimates included the possibility of no benefit or harm.  Reducing sensory deprivation, identification of infection, mobilisation and pain control all had summary estimates that suggested potential increases in delirium incidence, but the uncertainty in the estimates was substantial.  Evidence from two trials suggests that use of a liberal transfusion threshold over a restrictive transfusion threshold probably results in little to no difference in incident delirium (RR 0.92, 95% CI 0.62 to 1.36; I2 = 9%; 294 participants; moderate-certainty evidence downgraded due to risk of bias).  Six other interventions were examined, but evidence for each was limited to single studies and we identified no evidence of delirium prevention.  AUTHORS' CONCLUSIONS: There is moderate-certainty evidence regarding the benefit of multicomponent non-pharmacological interventions for the prevention of delirium in hospitalised adults, estimated to reduce incidence by 43% compared to usual care. We found no evidence of an effect on mortality. There is emerging evidence that these interventions may reduce hospital length of stay, with a trend towards reduced delirium duration, although the effect on delirium severity remains uncertain. Further research should focus on implementation and detailed analysis of the components of the interventions to support more effective, tailored practice recommendations.

Interventions for preventing delirium in older people in institutional long-term care

BACKGROUND

Delirium is a common and distressing mental disorder. It is often caused by a combination of stressor events in susceptible people, particularly older people living with frailty and dementia. Adults living in institutional long-term care (LTC) are at particularly high risk of delirium. An episode of delirium increases risks of admission to hospital, development or worsening of dementia and death. Multicomponent interventions can reduce the incidence of delirium by a third in the hospital setting. However, it is currently unclear whether interventions to prevent delirium in LTC are effective. This is an update of a Cochrane Review first published in 2014.

OBJECTIVES

To assess the effectiveness of interventions for preventing delirium in older people in institutional long-term care settings.

SEARCH METHODS

We searched ALOIS (www.medicine.ox.ac.uk/alois), the Cochrane Dementia and Cognitive Improvement Group (CDCIG) 's Specialised Register of dementia trials (dementia.cochrane.org/our-trials-register), to 27 February 2019. The search was sufficiently sensitive to identify all studies relating to delirium. We ran additional separate searches in the Cochrane Central Register of Controlled Trials (CENTRAL), major healthcare databases, trial registers and grey literature sources to ensure that the search was comprehensive.

SELECTION CRITERIA

We included randomised controlled trials (RCTs) and cluster-randomised controlled trials (cluster-RCTs) of single and multicomponent, non-pharmacological and pharmacological interventions for preventing delirium in older people (aged 65 years and over) in permanent LTC residence.

DATA COLLECTION AND ANALYSIS

We used standard methodological procedures expected by Cochrane. Primary outcomes were prevalence, incidence and severity of delirium; and mortality. Secondary outcomes included falls, hospital admissions and other adverse events; cognitive function; new diagnoses of dementia; activities of daily living; quality of life; and cost-related outcomes. We used risk ratios (RRs) as measures of treatment effect for dichotomous outcomes, hazard ratios (HR) for time-to-event outcomes and mean difference (MD) for continuous outcomes. For each outcome, we assessed the overall certainty of the evidence using GRADE methods.

MAIN RESULTS

We included three trials with 3851 participants. All three were cluster-RCTs. Two of the trials were of complex, single-component, non-pharmacological interventions and one trial was a feasibility trial of a complex, multicomponent, non-pharmacological intervention. Risk of bias ratings were mixed across the three trials. Due to the heterogeneous nature of the interventions, we did not combine the results statistically, but produced a narrative summary.It was not possible to determine the effect of a hydration-based intervention on delirium incidence (RR 0.85, 95% confidence interval (CI) 0.18 to 4.00; 1 study, 98 participants; very low-certainty evidence downgraded for risk of bias and very serious imprecision). This study did not assess delirium prevalence, severity or mortality.The introduction of a computerised system to identify medications that may contribute to delirium risk and trigger a medication review was probably associated with a reduction in delirium incidence (12-month HR 0.42, CI 0.34 to 0.51; 1 study, 7311 participant-months; moderate-certainty evidence downgraded for risk of bias) but probably had little or no effect on mortality (HR 0.88, CI 0.66 to 1.17; 1 study, 9412 participant-months; moderate-certainty evidence downgraded for imprecision), hospital admissions (HR 0.89, CI 0.72 to 1.10; 1 study, 7599 participant-months; moderate-certainty evidence downgraded for imprecision) or falls (HR 1.03, CI 0.92 to 1.15; 1 study, 2275 participant-months; low-certainty evidence downgraded for imprecision and risk of bias). Delirium prevalence and severity were not assessed.In the enhanced educational intervention study, aimed at changing practice to address key delirium risk factors, it was not possible to determine the effect of the intervention on delirium incidence (RR 0.62, 95% CI 0.16 to 2.39; 1 study, 137 resident months; very low-certainty evidence downgraded for risk of bias and serious imprecision) or delirium prevalence (RR 0.57, 95% CI 0.15 to 2.19; 1 study, 160 participants; very low-certainty evidence downgraded for risk of bias and serious imprecision). There was probably little or no effect on mortality (RR 0.82, CI 0.50 to 1.34; 1 study, 215 participants; moderate-certainty evidence downgraded for imprecision). The intervention was probably associated with a reduction in hospital admissions (RR 0.67, CI 0.57 to 0.79; 1 study, 494 participants; moderate-certainty evidence downgraded due to indirectness).

AUTHORS' CONCLUSIONS

Our review identified limited evidence on interventions for preventing delirium in older people in LTC. A software-based intervention to identify medications that could contribute to delirium risk and trigger a pharmacist-led medication review, probably reduces incidence of delirium in older people in institutional LTC. This is based on one large RCT in the US and may not be practical in other countries or settings which do not have comparable information technology services available in care homes. In the educational intervention aimed at identifying risk factors for delirium and developing bespoke solutions within care homes, it was not possible to determine the effect of the intervention on delirium incidence, prevalence or mortality. This evidence is based on a small feasibility trial. Our review identified three ongoing trials of multicomponent delirium prevention interventions. We identified no trials of pharmacological agents. Future trials of multicomponent non-pharmacological delirium prevention interventions for older people in LTC are needed to help inform the provision of evidence-based care for this vulnerable group.

Interventions for preventing delirium in older people in institutional long-term care

BACKGROUND

Delirium is a common and distressing complication of a range of stressor events including infection, new medications and environment change that is often experienced by older people with frailty and dementia. Older people living in institutional long-term care (LTC)are at high risk of delirium, which increases the risk of admission to hospital, development of or worsening of dementia, and mortality.Delirium is also associated with substantial healthcare costs. Although it is possible to prevent delirium in the hospital setting by providing multicomponent delirium prevention interventions it is currently unclear whether interventions to prevent delirium in LTCare effective.

OBJECTIVES

To assess the effectiveness of interventions for preventing delirium in older people in long term care.

SEARCH METHODS

We searched ALOIS (www.medicine.ox.ac.uk/alois) - the Cochrane Dementia and Cognitive Improvement Group's Specialised Register- on 23 April 2013. The search was as sensitive as possible to identify all studies on ALOIS relating to delirium. We ran additional separate searches in major healthcare databases, trial registers, the Cochrane Central Register of Controlled Trials (CENTRAL) and grey literature sources, to ensure that the search was as comprehensive as possible.

SELECTION CRITERIA

We included randomised controlled trials (RCTs) and cluster-randomised controlled trials (cluster-RCTs) of single- and multi componentn on-pharmacological and pharmacological interventions for preventing delirium in older people (aged 65 years and over) in permanent LTC residence.

DATA COLLECTION AND ANALYSIS

Two independent review authors examined the titles and abstracts of citations identified by the search for eligibility and extracted data, with any disagreements settled by consensus. Primary outcomes were prevalence, incidence and severity of delirium. Secondary outcomes included new diagnosis of dementia, activities of daily living, quality of life and adverse outcomes. We used risk ratios (RRs)as measures of treatment effect for dichotomous outcomes and hazard ratios (HR) for time to event data.Main results We included two trials that recruited 3636 participants.Both were complex single-component non-pharmacological delirium prevention interventions. Risk of bias for many items was unclear due to inadequate reporting. Notably, there was no evidence of blinding of trial participants or assessors in either trial. One small cluster-RCT (n = 98) of a hydration-based intervention reported no reduction in delirium incidence in the intervention group compared to control (RR 0.85, 95% confidence interval (CI) 0.18 to 4.00, analysis not adjusted for clustering, very low quality evidence). Results were imprecise and there were serious limitations evident in trial design.One large cluster-RCT (n = 3538) of a computerised system to identify medications that may contribute to delirium risk and trigger a pharmacist-led medication review reported a large reduction in delirium incidence (12-month HR 0.42, CI 0.34 to 0.51, moderat equality evidence) but no clear evidence of reduction in hospital admissions (HR 0.89, CI 0.72 to 1.10, moderate quality evidence), in mortality (HR 0.88, CI 0.66 to 1.17, moderate quality evidence) or in falls risk (HR 1.03, CI 0.92 to 1.15, moderate quality evidence).Authors' conclusions Our review identified very limited evidence on interventions for preventing deliriumin older people in LTC. Introduction of a software based intervention to identify medications that could contribute to delirium risk so that a pharmacist-led medication review and monitoring plan can be initiated may reduce incidence of delirium for older people in institutional LTC. This is based on one large RCT in the United States and may not be practical in other countries which do not have comparable information technology services available in care homes. Our review identified only one ongoing pilot trial of a multicomponent delirium prevention intervention and no trials of pharmacological agents. Future trials of computerised medication management systems and multicomponent non-pharmacological and pharmacological delirium prevention interventions for older people in LTC are needed to help inform the provision of evidence based care for this vulnerable group.