A retrospective analysis of interruptive versus non-interruptive clinical decision support for identification of patients needing contact isolation.
Appl Clin Inform 2013;
4:569-82. [PMID:
24454583 PMCID:
PMC3885916 DOI:
10.4338/aci-2013-04-ra-0021]
[Citation(s) in RCA: 6] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/18/2013] [Accepted: 10/28/2013] [Indexed: 11/23/2022] Open
Abstract
BACKGROUND
In determining whether clinical decision support (CDS) should be interruptive or non-interruptive, CDS designers need more guidance to balance the potential for interruptive CDS to overburden clinicians and the potential for non-interruptive CDS to be overlooked by clinicians.
OBJECTIVE
(1)To compare performance achieved by clinicians using interruptive CDS versus using similar, non-interruptive CDS. (2)To compare performance achieved using non-interruptive CDS among clinicians exposed to interruptive CDS versus clinicians not exposed to interruptive CDS.
METHODS
We studied 42 emergency medicine physicians working in a large hospital where an interruptive CDS to help identify patients requiring contact isolation was replaced by a similar, but non-interruptive CDS. The first primary outcome was the change in sensitivity in identifying these patients associated with the conversion from an interruptive to a non-interruptive CDS. The second primary outcome was the difference in sensitivities yielded by the non-interruptive CDS when used by providers who had and who had not been exposed to the interruptive CDS. The reference standard was an epidemiologist-designed, structured, objective assessment.
RESULTS
In identifying patients needing contact isolation, the interruptive CDS-physician dyad had sensitivity of 24% (95% CI: 17%-32%), versus sensitivity of 14% (95% CI: 9%-21%) for the non-interruptive CDS-physician dyad (p = 0.04). Users of the non-interruptive CDS with prior exposure to the interruptive CDS were more sensitive than those without exposure (14% [95% CI: 9%-21%] versus 7% [95% CI: 3%-13%], p = 0.05).
LIMITATIONS
As with all observational studies, we cannot confirm that our analysis controlled for every important difference between time periods and physician groups.
CONCLUSIONS
Interruptive CDS affected clinicians more than non-interruptive CDS. Designers of CDS might explicitly weigh the benefits of interruptive CDS versus its associated increased clinician burden. Further research should study longer term effects of clinician exposure to interruptive CDS, including whether it may improve clinician performance when using a similar, subsequent non-interruptive CDS.
Collapse