Development and evaluation of a novel user interface for reviewing clinical microbiology results

A visual representation of microbiological culture data improves comprehension: a randomized controlled trial

OBJECTIVE

While the judicious use of antibiotics takes past microbiological culture results into consideration, this data's typical format in the electronic health record (EHR) may be unwieldy when incorporated into clinical decision-making. We hypothesize that a visual representation of sensitivities may aid in their comprehension.

MATERIALS AND METHODS

A prospective parallel unblinded randomized controlled trial was undertaken at an academic urban tertiary care center. Providers managing emergency department (ED) patients receiving antibiotics and having previous culture sensitivity testing were included. Providers were randomly selected to use standard EHR functionality or a visual representation of patients' past culture data as they answered questions about previous sensitivities. Concordance between provider responses and past cultures was assessed using the kappa statistic. Providers were surveyed about their decision-making and the usability of the tool using Likert scales.

RESULTS

518 ED encounters were screened from 3/5/2018 to 9/30/18, with providers from 144 visits enrolled and analyzed in the intervention arm and 129 in the control arm. Providers using the visualization tool had a kappa of 0.69 (95% CI: 0.65-0.73) when asked about past culture results while the control group had a kappa of 0.16 (95% CI: 0.12-0.20). Providers using the tool expressed improved understanding of previous cultures and found the tool easy to use (P < .001). Secondary outcomes showed no differences in prescribing practices.

CONCLUSION

A visual representation of culture sensitivities improves comprehension when compared to standard text-based representations.

Physicians' gender and their use of electronic health records: findings from a mixed-methods usability study

OBJECTIVE

Physician burnout associated with EHRs is a major concern in health care. A comprehensive assessment of differences among physicians in the areas of EHR performance, efficiency, and satisfaction has not been conducted. The study sought to study relationships among physicians' performance, efficiency, perceived workload, satisfaction, and usability in using the electronic health record (EHR) with comparisons by age, gender, professional role, and years of experience with the EHR.

MATERIALS AND METHODS

Mixed-methods assessments of the medical intensivists' EHR use and perceptions. Using simulated cases, we employed standardized scales, performance measures, and extensive interviews. NASA Task Load Index (TLX), System Usability Scale (SUS), and Questionnaire on User Interface Satisfaction surveys were deployed.

RESULTS

The study enrolled 25 intensive care unit (ICU) physicians (11 residents, 9 fellows, 5 attendings); 12 (48%) were men, with a mean age of 33 (range, 28-55) years and a mean of 4 (interquartile range, 2.0-5.5) years of Epic experience. Overall task performance scores were similar for men (90% ± 9.3%) and women (92% ± 4.4%), with no statistically significant differences (P = .374). However, female physicians demonstrated higher efficiency in completion time (difference = 7.1 minutes; P = .207) and mouse clicks (difference = 54; P = .13). Overall, men reported significantly higher perceived EHR workload stress compared with women (difference = 17.5; P < .001). Men reported significantly higher levels of frustration with the EHR compared with women (difference = 33.15; P < .001). Women reported significantly higher satisfaction with the ease of use of the EHR interface than men (difference = 0.66; P =.03). The women's perceived overall usability of the EHR is marginally higher than that of the men (difference = 10.31; P =.06).

CONCLUSIONS

Among ICU physicians, we measured significant gender-based differences in perceived EHR workload stress, satisfaction, and usability-corresponding to objective patterns in EHR efficiency. Understanding the reasons for these differences may help reduce burnout and guide improvements to physician performance, efficiency, and satisfaction with EHR use.

DESIGN

Mixed-methods assessments of the medical intensivists' EHR use and perceptions. Using simulated cases, we employed standardized scales, performance measures, and extensive interviews.