The Role of Data Science in Closing the Implementation Gap

Delirium and Coronavirus Disease 2019: Looking Back, Moving Forward

During the coronavirus disease 2019 pandemic, crisis changes in clinical care increased rates of delirium in the intensive care unit (ICU). Deep sedation, unfamiliar environments with visitor restrictions, and such factors due to high workload and health system strain contributed to the occurrence of delirium doubling in the ICU. As the pandemic wanes, health care systems and ICU leadership must emphasize post-pandemic recovery, integrating lessons learned about delirium management, evidence-based care, and family involvement. Strategies to empower clinicians, creatively deliver care, and integrate families pave the way forward for a more holistic approach to patient care in the post-pandemic era.

The value of artificial intelligence for the treatment of mechanically ventilated intensive care unit patients: An early health technology assessment

PURPOSE

The health and economic consequences of artificial intelligence (AI) systems for mechanically ventilated intensive care unit patients often remain unstudied. Early health technology assessments (HTA) can examine the potential impact of AI systems by using available data and simulations. Therefore, we developed a generic health-economic model suitable for early HTA of AI systems for mechanically ventilated patients.

MATERIALS AND METHODS

Our generic health-economic model simulates mechanically ventilated patients from their hospitalisation until their death. The model simulates two scenarios, care as usual and care with the AI system, and compares these scenarios to estimate their cost-effectiveness.

RESULTS

The generic health-economic model we developed is suitable for estimating the cost-effectiveness of various AI systems. By varying input parameters and assumptions, the model can examine the cost-effectiveness of AI systems across a wide range of different clinical settings.

CONCLUSIONS

Using the proposed generic health-economic model, investors and innovators can easily assess whether implementing a certain AI system is likely to be cost-effective before an exact clinical impact is determined. The results of the early HTA can aid investors and innovators in deployment of AI systems by supporting development decisions, informing value-based pricing, clinical trial design, and selection of target patient groups.

Leveraging Artificial Intelligence for Expediting Implementation Efforts

Expedited implementation of evidence into practice and policymaking is critical to ensure the delivery of effective care and improve health-care outcomes. Implementation science deals with the designing of methods and strategies for increasing and facilitating the uptake of evidence into practice and policymaking. Nevertheless, the process of designing and selecting methods and strategies for implementing evidence is complicated because of the complexity of health-care settings where implementation is desired. Artificial intelligence (AI) has revolutionized a range of fields, including genomics, education, drug trials, research, and health care. This commentary discusses how AI can be leveraged to expedite implementation science efforts for transforming health-care practice. Four key aspects of AI use in implementation science are highlighted: (a) AI for implementation planning (e.g., needs assessment, predictive analytics, and data management), (b) AI for developing implementation tools and guidelines, (c) AI for designing and applying implementation strategies, and (d) AI for monitoring and evaluating implementation outcomes. Use of AI along the implementation continuum from planning to delivery and evaluation can enable more precise and accurate implementation of evidence into practice.

Machine learning-based prediction of low-value care for hospitalized patients

Objective

Low-value care (i.e., costly health care treatments that provide little or no benefit) is an ongoing problem in United States hospitals. Traditional strategies for reducing low-value care are only moderately successful. Informed by behavioral science principles, we sought to use machine learning to inform a targeted prompting system that suggests preferred alternative treatments at the point of care but before clinicians have made a decision.

Methods

We used intravenous administration of albumin for fluid resuscitation in intensive care unit (ICU) patients as an exemplar of low-value care practice, identified using the electronic health record of a multi-hospital health system. We divided all ICU episodes into 4-h periods and defined a set of relevant clinical features at the period level. We then developed two machine learning models: a single-stage model that directly predicts if a patient will receive albumin in the next period; and a two-stage model that first predicts if any resuscitation fluid will be administered and then predicts albumin only among the patients with a high probability of fluid use.

Results

We examined 87,489 ICU episodes divided into approximately 1.5 million 4-h periods. The area under the receiver operating characteristic curve was 0.86 for both prediction models. The positive predictive value was 0.21 (95% confidence interval: 0.20, 0.23) for the single-stage model and 0.22 (0.20, 0.23) for the two-stage model. Applying either model in a targeted prompting system could prevent 10% of albumin administrations, with an attending physician receiving one prompt every 4.2 days of ICU service.

Conclusion

Prediction of low-value care is feasible and could enable a point-of-care, targeted prompting system that offers suggestions ahead of the moment of need before clinicians have already decided. A two-stage approach does not improve performance but does interject new levers for the calibration of such a system.

A voice-based digital assistant for intelligent prompting of evidence-based practices during ICU rounds

OBJECTIVE

To evaluate the technical feasibility and potential value of a digital assistant that prompts intensive care unit (ICU) rounding teams to use evidence-based practices based on analysis of their real-time discussions.

METHODS

We evaluated a novel voice-based digital assistant which audio records and processes the ICU care team's rounding discussions to determine which evidence-based practices are applicable to the patient but have yet to be addressed by the team. The system would then prompt the team to consider indicated but not yet delivered practices, thereby reducing cognitive burden compared to traditional rigid rounding checklists. In a retrospective analysis, we applied automatic transcription, natural language processing, and a rule-based expert system to generate personalized prompts for each patient in 106 audio-recorded ICU rounding discussions. To assess technical feasibility, we compared the system's prompts to those created by experienced critical care nurses who directly observed rounds. To assess potential value, we also compared the system's prompts to a hypothetical paper checklist containing all evidence-based practices.

RESULTS

The positive predictive value, negative predictive value, true positive rate, and true negative rate of the system's prompts were 0.45 ± 0.06, 0.83 ± 0.04, 0.68 ± 0.07, and 0.66 ± 0.04, respectively. If implemented in lieu of a paper checklist, the system would generate 56% fewer prompts per patient, with 50%±17% greater precision.

CONCLUSION

A voice-based digital assistant can reduce prompts per patient compared to traditional approaches for improving evidence uptake on ICU rounds. Additional work is needed to evaluate field performance and team acceptance.