A continuous usability evaluation of an electronic medication administration record application

Human factors and safety analysis methods used in the design and redesign of electronic medication management systems: A systematic review

INTRODUCTION

Poorly designed electronic medication management systems (EMMS) or computerized physician order entry (CPOE) systems in hospital settings can result in usability issues and in turn, patient safety risks. As a safety science, human factors and safety analysis methods have potential to support the safe and usable design of EMMS.

OBJECTIVE

To identify and describe human factors and safety analysis methods that have been used in the design or redesign of EMMS used in hospital settings.

MATERIALS AND METHODS

A systematic review, following PRISMA guidelines, was conducted by searching online databases and relevant journals from January 2011 to May 2022. Studies were included if they described the practical application of human factors and safety analysis methods to support the design or redesign of a clinician-facing EMMS, or its components. Methods used were extracted and mapped to human centered design (HCD) activities: understanding context of use; specifying user requirements; producing design solutions; and evaluating the design.

RESULTS

Twenty-one papers met the inclusion criteria. Overall, 21 human factors and safety analysis methods were used in the design or redesign of EMMS with prototyping, usability testing, participant surveys/questionnaires and interviews the most frequent. Human factors and safety analysis methods were most frequently used to evaluate the design of a system (n = 67; 56.3%). Nineteen of 21 (90%) methods used aimed to identify usability issues and/or support iterative design; only one paper utilized a safety-oriented method and one, a mental workload assessment method.

DISCUSSION AND CONCLUSION

While the review identified 21 methods, EMMS design primarily utilized a subset of available methods, and rarely a method focused on safety. Given the high-risk nature of medication management in complex hospital environments, and the potential for harm due to poorly designed EMMS, there is significant potential to apply more safety-oriented human factors and safety analysis methods to support EMMS design.

Nursing staff's assessments of medication management process in the psychiatric and operative domains: A cross-sectional study after introduction of an electronic medication chart

AIMS AND OBJECTIVES

To describe nursing staff's assessments of medication management process in the psychiatric and operative domains after introduction of an electronic medication chart.

BACKGROUND

The medication management process includes all structures and practices within the organisation that guide and support medication administration and related procedures.

DESIGN

A cross-sectional survey.

METHODS

A Finnish version of the Medication Administration System - Nurses Assessment of Satisfaction (modified MAS-NAS) paper-based questionnaire was sent to all nursing staff (N = 855) working in operative (n = 498) and psychiatric (n = 357) domains in one central hospital. Data were analysed using statistical methods.

RESULTS

In total, 324 nursing staff members participated. More than half agreed that medication management is efficient (64%), safe for patients (76%), and that the current medication administration system provides the necessary medical treatment information (e.g. prescriptions by physicians, medication data) (64%). Respondents' overall satisfaction with medication management process was slightly above average on a scale from 1 to 10 (mean = 6.2; SD = 1.8; median = 7, range 2-9). Respondents who used electronic medication chart reported higher overall satisfaction with medication management process (median = 7, mean = 6.1, SD = 1.8 and range 2-9) than those not using it (median = 6.5, mean = 6.3, SD = 1.6 and range 2-9). No statistically significant difference was found (U = 8552.000, p = 0.33).

CONCLUSIONS

This study revealed several problems in the medication management process. The results can be used in developing the medication management process.

RELEVANCE TO CLINICAL PRACTICE

Electronic medication chart should be used and developed further in terms of efficacy, safety and access. One year after the electronic medication chart was introduced, only half of the respondents had used it. That is why implementation of electronic systems or technological applications should be carefully considered as a whole.

Identifying Health Information Technology Usability Issues Contributing to Medication Errors Across Medication Process Stages

OBJECTIVE

Different health information technology (health IT) systems are intended to support medication ordering, reviewing, and administration. We sought to identify the types of medication errors associated with health IT use, whether they reached the patient, where in the medication process those errors occurred, and the specific usability issues contributing to those errors.

METHODS

Patient safety event reports from more than 595 healthcare facilities entered between January 2013 and September 2018 were analyzed. We computationally identified reports associated with health IT intended to support the medication process, including computerized provider order entry, electronic medication administration record, and barcode medication administration. From these, 2700 reports were manually reviewed to determine the type of medication error, medication process stage, and health IT usability issue.

RESULTS

Of the 2700 manually reviewed reports, 1508 (55.9%) described a medication error that was associated with health IT use and 750 (49.7%) reached the patient. Improper dose errors were frequent (1214 of 1508, 80.5%) with most errors during ordering (673 of 1508, 44.6%) and reviewing medications (639 of 1508, 42.4%). Most health IT-associated medication error reports described usability issues (n = 1468 of 1508, 97.3%) including data entry, workflow support, and alerting. Data entry usability issues impacted few medication process stages, whereas workflow support and alerting impacted several stages.

CONCLUSIONS

Health IT usability issues are a prevalent contributing factor to medication errors, many of which reach the patient. Data entry, workflow support, and alerting should be prioritized during usability and safety optimization efforts.

Dose Verification Errors in Hospitals: Literature Review of the eMAR-based Systems Used by Nurses

BACKGROUND

The effectiveness of the dose verification features of the electronic medication administration record (eMAR) and complementary systems in the hospital setting is not well understood.

PURPOSE

The authors completed a narrative synthesis of literature findings on the effectiveness of eMAR-based systems in the hospital setting.

METHODS

A literature review was carried out across 5 bibliographic databases to evaluate the safety features of current eMAR-based systems in preventing dosing errors and design issues that impede their usability.

RESULTS

While eMAR-based systems are beneficial to reducing order and drug cross-checking errors, safe dose verification features are sporadically available for targeted tasks. Overall, the eMAR had little impact on preventing low to moderate dosing errors. Dosing errors may occur because of error-prone activities that result from system design and work process issues during medication administration.