Automation failures and patient safety

An inherently dangerous fluid warmer design

A Hotline® fluid warmer is a device commonly used by anesthesia providers in the operating room to warm and infuse blood products and large fluid volumes. The purpose of the fluid warmer is to counter heat loss, which occurs under anesthesia. Despite normal checks performed prior to its use, we discovered a breach in the fluid warming set attached to the Hotline® fluid warmer during blood administration. The breach contaminated the patient's sterile intravenous line. We describe the quality and safety processes we undertook in detail. We discuss the notion that monitoring alarms are an important safety feature of most modern devices utilized by anesthesia providers. We believe the Hotline® fluid warmer lacks a crucial monitor for detecting a breach within the fluid warming set, and therefore recommend the addition of an alarm to improve this device's safety.

Research Trends in Artificial Intelligence Applications in Human Factors Health Care: Mapping Review

BACKGROUND

Despite advancements in artificial intelligence (AI) to develop prediction and classification models, little research has been devoted to real-world translations with a user-centered design approach. AI development studies in the health care context have often ignored two critical factors of ecological validity and human cognition, creating challenges at the interface with clinicians and the clinical environment.

OBJECTIVE

The aim of this literature review was to investigate the contributions made by major human factors communities in health care AI applications. This review also discusses emerging research gaps, and provides future research directions to facilitate a safer and user-centered integration of AI into the clinical workflow.

METHODS

We performed an extensive mapping review to capture all relevant articles published within the last 10 years in the major human factors journals and conference proceedings listed in the "Human Factors and Ergonomics" category of the Scopus Master List. In each published volume, we searched for studies reporting qualitative or quantitative findings in the context of AI in health care. Studies are discussed based on the key principles such as evaluating workload, usability, trust in technology, perception, and user-centered design.

RESULTS

Forty-eight articles were included in the final review. Most of the studies emphasized user perception, the usability of AI-based devices or technologies, cognitive workload, and user's trust in AI. The review revealed a nascent but growing body of literature focusing on augmenting health care AI; however, little effort has been made to ensure ecological validity with user-centered design approaches. Moreover, few studies (n=5 against clinical/baseline standards, n=5 against clinicians) compared their AI models against a standard measure.

CONCLUSIONS

Human factors researchers should actively be part of efforts in AI design and implementation, as well as dynamic assessments of AI systems' effects on interaction, workflow, and patient outcomes. An AI system is part of a greater sociotechnical system. Investigators with human factors and ergonomics expertise are essential when defining the dynamic interaction of AI within each element, process, and result of the work system.