1
|
Salwei ME, Hoonakker PL, Pulia M, Wiegmann D, Patterson BW, Carayon P. Post-implementation usability evaluation of a human factors-based clinical decision support for pulmonary embolism (PE) diagnosis (Dx): PE Dx Study Part 1. HUMAN FACTORS IN HEALTHCARE 2023; 4:100056. [PMID: 38765769 PMCID: PMC11099629 DOI: 10.1016/j.hfh.2023.100056] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/22/2024]
Abstract
While there is promise for health IT, such as Clinical Decision Support (CDS), to improve patient safety and clinician efficiency, poor usability has hindered widespread use of these tools. Human Factors (HF) principles and methods remain the gold standard for health IT design; however, there is limited information on how HF methods and principles influence CDS usability "in the wild". In this study, we explore the usability of an HF-based CDS used in the clinical environment; the CDS was designed according to a human-centered design process, which is described in Carayon et al. (2020). In this study, we interviewed 12 emergency medicine physicians, identifying 294 excerpts of barriers and facilitators of the CDS. Sixty-eight percent of excerpts related to the HF principles applied in the human-centered design of the CDS. The remaining 32% of excerpts related to 18 inductively-created categories, which highlight gaps in the CDS design process. Several barriers were related to the physical environment and organization work system elements as well as physicians' broader workflow in the emergency department (e.g., teamwork). This study expands our understanding of the usability outcomes of HF-based CDS "in the wild". We demonstrate the value of HF principles in the usability of CDS and identify areas for improvement to future human-centered design of CDS. The relationship between these usability outcomes and the HCD process is explored in an accompanying Part 2 manuscript.
Collapse
Affiliation(s)
- Megan E. Salwei
- Center for Research and Innovation in Systems Safety, Department of Anesthesiology, Vanderbilt University Medical Center, Nashville, TN, USA
- Department of Biomedical Informatics, Vanderbilt University Medical Center, Nashville, TN, USA
| | - Peter L.T. Hoonakker
- Wisconsin Institute for Healthcare Systems Engineering, Department of Industrial and Systems Engineering, University of Wisconsin-Madison, Madison, WI, USA
| | - Michael Pulia
- Wisconsin Institute for Healthcare Systems Engineering, Department of Industrial and Systems Engineering, University of Wisconsin-Madison, Madison, WI, USA
- BerbeeWalsh Department of Emergency Medicine, University of Wisconsin-Madison, Madison, WI, USA
| | - Douglas Wiegmann
- Wisconsin Institute for Healthcare Systems Engineering, Department of Industrial and Systems Engineering, University of Wisconsin-Madison, Madison, WI, USA
| | - Brian W. Patterson
- Wisconsin Institute for Healthcare Systems Engineering, Department of Industrial and Systems Engineering, University of Wisconsin-Madison, Madison, WI, USA
- BerbeeWalsh Department of Emergency Medicine, University of Wisconsin-Madison, Madison, WI, USA
| | - Pascale Carayon
- Wisconsin Institute for Healthcare Systems Engineering, Department of Industrial and Systems Engineering, University of Wisconsin-Madison, Madison, WI, USA
| |
Collapse
|
2
|
Godin MR, Nasr AS. Assessing the Impact of a New Pediatric Healthcare Facility on Medication Administration: A Human Factors Approach. J Nurs Adm 2023; 53:331-336. [PMID: 37219885 DOI: 10.1097/nna.0000000000001295] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/24/2023]
Abstract
OBJECTIVE This observational descriptive study was designed to measure the effect a new evidence-based design (EBD) hospital has on pediatric medication safety. BACKGROUND Medication safety is a priority for nurse leaders. Controlling system design by increasing the understanding of the impact human factors have could improve medication delivery. METHODS Medication administration data from 2 studies conducted at the same hospital, 1 at an older facility in 2015 and the other at a new EBD facility in 2019, were compared using a similar research design. RESULTS Results indicate that rates of distractions per 100 drug administrations were all statistically significant, favoring the 2015 data regardless of the EBD. No statistically significant differences were observed in error rates of any type when comparing the data collected in the older facility versus the newer EBD facility. CONCLUSION This study demonstrated that EBD alone does not ensure the absence of medication errors. By comparing 2 data sets, unanticipated associations were found that could impact safety. Despite the new facility's contemporary design, distractions persisted that could inform nurse leaders in developing interventions to support a safer patient care environment using a human factors approach.
Collapse
Affiliation(s)
- Margaret R Godin
- Author Affiliations: Manager (Godin), Nurse Informatics; Informatics Nurse Specialist (Godin); and Director of Nursing Research and EBP (Dr Nasr), Stanford Children's Health, Palo Alto; and Associate Professor (Dr Nasr), Department of Pediatrics, Stanford School of Medicine, California
| | | |
Collapse
|
3
|
Carayon P, Thuemling T, Parmasad V, Bao S, O'Horo J, Bennett NT, Safdar N. Implementation of An Antibiotic Stewardship Intervention to Reduce Prescription of Fluoroquinolones: A Human Factors Analysis in Two Intensive Care Units. JOURNAL OF PATIENT SAFETY AND RISK MANAGEMENT 2022; 26:161-171. [PMID: 35146329 DOI: 10.1177/25160435211025417] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/23/2022]
Abstract
Antibiotic use is often the target of interventions in health care organizations that aim to decrease healthcare-associated infections (HAI) such as Clostridioides difficile (CDI); this is particularly important for fluoroquinolones (FQ), which are frequently used in critical care settings. In this study, using a multiple case study research approach, we conduct an in-depth analysis of an intervention aimed at limiting ICU prescriber access to FQ in two ICUs of two hospitals. The data collection and analysis were guided by a human factors engineering approach based on the SEIPS (Systems Engineering Initiative for Patient Safety) model and evidence-based implementation principles. Our results show some differences in the implementation of the FQ intervention between the two ICUs, such as level and method of FQ restriction, and training and communication with physicians and pharmacists. In both ICUs, several organizational learning mechanisms helped to quickly identify problems with the intervention and ensure that changes were made in a just-in-time manner (e.g. just-in-time training, removal of FQ in order set for pneumonia). Despite their organizational differences, both sites developed strategies to successfully implement the FQ intervention.
Collapse
Affiliation(s)
- Pascale Carayon
- Department of Industrial and Systems Engineering, Wisconsin Institute for Healthcare Systems Engineering; University of Wisconsin-Madison
| | - Teresa Thuemling
- Wisconsin Institute for Healthcare Systems Engineering; University of Wisconsin-Madison
| | | | - Songtao Bao
- School of Journalism and Mass Communication; University of Wisconsin-Madison
| | | | | | - Nasia Safdar
- Department of Medicine; University of Wisconsin-Madison
| |
Collapse
|
4
|
Iqbal AR, Parau CA, Kazi S, Adams KT, La L, Hettinger AZ, Ratwani RM. Identifying Electronic Medication Administration Record (eMAR) Usability Issues from Patient Safety Event Reports. Jt Comm J Qual Patient Saf 2021; 47:793-801. [PMID: 34657817 DOI: 10.1016/j.jcjq.2021.09.004] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/29/2021] [Revised: 08/31/2021] [Accepted: 09/08/2021] [Indexed: 10/20/2022]
Abstract
BACKGROUND Improving our understanding of the association between medication errors and health information technology (health IT) usability has the potential to reduce errors and improve patient safety. This study used patient safety event reports (PSEs) to investigate the contribution of usability challenges associated with the electronic medication administration record (eMAR) to medication errors. METHODS Free-text descriptions of 849 medication-related PSEs selected from 2.3 million reports were analyzed. Coders identified the specific health IT components, usability challenge categories, and nuanced usability themes that contributed to each PSE. Thematic analysis was conducted to refine categorizations and identify emerging themes. Final analysis was limited to PSEs involving a contribution from eMAR, either as the point of origin or as a downstream contributor to error. RESULTS eMAR contributed to 473 PSEs. eMAR was the point of origin for 84 (17.8% of 473) PSEs. Usability challenge categories included Workflow support (n = 52, 11.0%) and Display/Visual clutter (n = 30, 6.3%). eMAR contributed downstream from the point of origin in 389 (82.2% of 473) PSEs, with errors stemming primarily from Pharmacy IT and computerized provider order entry (CPOE). Prominent secondary eMAR-associated usability challenges included Display/Visual clutter (n = 327, 69.1%) and Alerting (n = 32, 6.8%). CONCLUSION This study identified several eMAR usability challenges, through the analysis of PSEs, that contribute to medication errors. Findings highlight the critical need for improving the eMAR user interface. Improved interface design, better vendor usability testing, eMAR-focused certification testing, consideration of work system factors, and eMAR-focused usability and safety testing by health care facilities can improve eMAR technology and patient safety.
Collapse
|
5
|
Odberg KR, Hansen BS, Aase K, Wangensteen S. A work system analysis of the medication administration process in a Norwegian nursing home ward. APPLIED ERGONOMICS 2020; 86:103100. [PMID: 32342890 DOI: 10.1016/j.apergo.2020.103100] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/29/2019] [Revised: 02/20/2020] [Accepted: 03/19/2020] [Indexed: 06/11/2023]
Abstract
Nursing home patients often have multiple diagnoses and a high prevalence of polypharmacy and are at risk of experiencing adverse drug events. The study aims to explore the dynamic interactions of stakeholders and work system elements in the medication administration process in a nursing home ward. Data were collected using observations and interviews. A deductive content analysis led to a SEIPS-based process map and an accompanying work system analysis. The study increases knowledge of the complexity of the medication administration process by portraying the dynamic interactions between the major stakeholders in the work system, and the temporal flow of the activities involved. Secondly, it identifies facilitators and barriers in the work system linked to the medication administration process. Most barriers and facilitators are associated with the work system elements - tools & technology, organisation and tasks - and occur early in the medication administration process.
Collapse
Affiliation(s)
- Kristian Ringsby Odberg
- Norwegian University of Science and Technology (NTNU), Department of Health Sciences in Gjøvik, Norway.
| | | | - Karina Aase
- University of Stavanger, Department of Health Studies, Centre Director, SHARE - Centre for Resilience in Healthcare, Norway
| | - Sigrid Wangensteen
- Norwegian University of Science and Technology (NTNU), Department of Health Sciences in Gjøvik, Norway.
| |
Collapse
|
6
|
Evans M, He Y, Maglaras L, Yevseyeva I, Janicke H. Evaluating information security core human error causes (IS-CHEC) technique in public sector and comparison with the private sector. Int J Med Inform 2019; 127:109-119. [PMID: 31128822 DOI: 10.1016/j.ijmedinf.2019.04.019] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/23/2018] [Revised: 01/08/2019] [Accepted: 04/23/2019] [Indexed: 10/26/2022]
Abstract
BACKGROUND The number of reported public sector information security incidents has significantly increased recently including 22% related to the UK health sector. Over two thirds of these incidents pertain to human error, but despite this, there are limited published related works researching human error as it affects information security. METHOD This research conducts an empirical case study into the feasibility and implementation of the Information Security Core Human Error Causes (IS-CHEC) technique which is an information security adaptation of Human Error Assessment and Reduction Technique (HEART). We analysed 12 months of reported information security incidents for a participating public sector organisation providing healthcare services and mapped them to the IS-CHEC technique. RESULTS The results show that the IS-CHEC technique is applicable to the field of information security but identified that the underpinning HEART human error probability calculations did not align to the recorded incidents. The paper then proposes adaptation of the IS-CHEC technique based on the feedback from users during the implementation. We then compared the results against those of a private sector organisation established using the same approach. CONCLUSIONS The research concluded that the proportion of human error is far higher than reported in current literature. The most common causes of human error within the participating public sector organisation were lack of time for error detection and correction, no obvious means of reversing an unintended action and people performing repetitious tasks.
Collapse
Affiliation(s)
- Mark Evans
- Cyber Security Centre, De Montfort University, England, United Kingdom
| | - Ying He
- Cyber Security Centre, De Montfort University, England, United Kingdom.
| | - Leandros Maglaras
- Cyber Security Centre, De Montfort University, England, United Kingdom
| | - Iryna Yevseyeva
- Cyber Security Centre, De Montfort University, England, United Kingdom
| | - Helge Janicke
- Cyber Security Centre, De Montfort University, England, United Kingdom
| |
Collapse
|
7
|
Abstract
An important domain of patient safety is the management of medications in home and community settings by patients and their caregiving network. This study applied human factors/ergonomics theories and methods to data about medication adherence collected from 61 patients with heart failure accompanied by 31 informal caregivers living in the US. Seventy non-adherence events were identified, described, and analysed for performance shaping factors. Half were classified as errors and half as violations. Performance shaping factors included elements of the person or team (e.g. patient limitations), task (e.g. complexity), tools and technologies (e.g. tool quality) and organisational, physical, and social context (e.g. resources, support, social influence). Study findings resulted in a dynamic systems model of medication safety applicable to patient medication adherence and the medication management process. Findings and the resulting model offer implications for future research on medication adherence, medication safety interventions, and resilience in home and community settings. Practitioner Summary: We describe situational and habitual errors and violations in medication use among older patients and their family members. Multiple factors pushed performance towards risk and harm. These factors can be the target for redesign or various forms of support, such as education, changes to the plan of care, and technology design.
Collapse
Affiliation(s)
- Robin Sue Mickelson
- a Vanderbilt School of Nursing , Vanderbilt University , Nashville , TN , USA
- b The Center for Research and Innovation in Systems Safety (CRISS) , Vanderbilt University Medical Center , Nashville , TN , USA
| | - Richard J Holden
- c Department of BioHealth Informatics , Indiana University School of Informatics and Computing , Indianapolis , IN , USA
- d Indiana University Center for Aging Research , Regenstrief Institute, Inc. , Indianapolis , IN , USA
| |
Collapse
|
8
|
Ellsworth MA, Dziadzko M, O'Horo JC, Farrell AM, Zhang J, Herasevich V. An appraisal of published usability evaluations of electronic health records via systematic review. J Am Med Inform Assoc 2017; 24:218-226. [PMID: 27107451 PMCID: PMC7654077 DOI: 10.1093/jamia/ocw046] [Citation(s) in RCA: 66] [Impact Index Per Article: 9.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/04/2015] [Revised: 02/25/2016] [Accepted: 03/01/2016] [Indexed: 02/07/2023] Open
Abstract
OBJECTIVE In this systematic review, we aimed to evaluate methodological and reporting trends present in the current literature by investigating published usability studies of electronic health records (EHRs). METHODS A literature search was conducted for articles published through January 2015 using MEDLINE (Ovid), EMBASE, Scopus, and Web of Science, supplemented by citation and reference list reviews. Studies were included if they tested the usability of hospital and clinic EHR systems in the inpatient, outpatient, emergency department, or operating room setting. RESULTS A total of 4848 references were identified for title and abstract screening. Full text screening was performed for 197 articles, with 120 meeting the criteria for study inclusion. CONCLUSION A review of the literature demonstrates a paucity of quality published studies describing scientifically valid and reproducible usability evaluations at various stages of EHR system development. A lack of formal and standardized reporting of EHR usability evaluation results is a major contributor to this knowledge gap, and efforts to improve this deficiency will be one step of moving the field of usability engineering forward.
Collapse
Affiliation(s)
- Marc A Ellsworth
- Division of Neonatal Medicine, Mayo Clinic, Rochester, MN, USA
- Multidisciplinary Epidemiology and Translational Research in Critical Care, Emergency and Perioperative Medicine (METRIC-PM) Group, Mayo Clinic, Rochester, MN, USA
| | - Mikhail Dziadzko
- Multidisciplinary Epidemiology and Translational Research in Critical Care, Emergency and Perioperative Medicine (METRIC-PM) Group, Mayo Clinic, Rochester, MN, USA
- Department of Anesthesiology, Mayo Clinic, Rochester, MN, USA
| | - John C O'Horo
- Multidisciplinary Epidemiology and Translational Research in Critical Care, Emergency and Perioperative Medicine (METRIC-PM) Group, Mayo Clinic, Rochester, MN, USA
- Division of Infectious Diseases, Mayo Clinic, Rochester, MN, USA
| | - Ann M Farrell
- Mayo Clinic Libraries, Mayo Clinic, Rochester, MN, USA
| | - Jiajie Zhang
- School of Health Information Sciences, University of Texas Health Science Center at Houston, Houston, TX, USA
| | - Vitaly Herasevich
- Multidisciplinary Epidemiology and Translational Research in Critical Care, Emergency and Perioperative Medicine (METRIC-PM) Group, Mayo Clinic, Rochester, MN, USA
- Department of Anesthesiology, Mayo Clinic, Rochester, MN, USA
| |
Collapse
|
9
|
van Engen-Verheul MM, Peute LW, de Keizer NF, Peek N, Jaspers MW. Optimizing the user interface of a data entry module for an electronic patient record for cardiac rehabilitation: A mixed method usability approach. Int J Med Inform 2016; 87:15-26. [DOI: 10.1016/j.ijmedinf.2015.12.007] [Citation(s) in RCA: 16] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/11/2015] [Revised: 12/07/2015] [Accepted: 12/11/2015] [Indexed: 01/31/2023]
|
10
|
Otte-Trojel T, de Bont A, Rundall TG, van de Klundert J. What do we know about developing patient portals? a systematic literature review. J Am Med Inform Assoc 2015; 23:e162-8. [PMID: 26335985 DOI: 10.1093/jamia/ocv114] [Citation(s) in RCA: 66] [Impact Index Per Article: 7.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/07/2015] [Accepted: 06/29/2015] [Indexed: 11/15/2022] Open
Abstract
OBJECTIVE Numerous articles have reported on the development of patient portals, including development problems and solutions. We review these articles to inform future patient portal development efforts and to provide a summary of the evidence base that can guide future research. MATERIALS AND METHODS We performed a systematic review of relevant literature to answer 5 questions: (1) What categories of problems related to patient portal development have been defined? (2) What causal factors have been identified by problem analysis and diagnosis? (3) What solutions have been proposed to ameliorate these causal factors? (4) Which proposed solutions have been implemented and in which organizational contexts? (5) Have implemented solutions been evaluated and what learning has been generated? Through searches on PubMed, ScienceDirect and LISTA, we included 109 articles. RESULTS We identified 5 main problem categories: achieving patient engagement, provider engagement, appropriate data governance, security and interoperability, and a sustainable business model. Further, we identified key factors contributing to these problems as well as solutions proposed to ameliorate them. While about half (45) of the 109 articles proposed solutions, fewer than half of these solutions (18) were implemented, and even fewer (5) were evaluated to generate learning about their effects. DISCUSSION Few studies systematically report on the patient portal development processes. As a result, the review does not provide an evidence base for portal development. CONCLUSION Our findings support a set of recommendations for advancement of the evidence base: future research should build on existing evidence, draw on principles from design sciences conveyed in the problem-solving cycle, and seek to produce evidence within various different organizational contexts.
Collapse
Affiliation(s)
- Terese Otte-Trojel
- Institute of Health Policy and Management, Erasmus University Rotterdam, The Netherlands
| | - Antoinette de Bont
- Institute of Health Policy and Management, Erasmus University Rotterdam, The Netherlands
| | - Thomas G Rundall
- School of Public Health, University of California Berkeley, Berkeley, California, USA
| | - Joris van de Klundert
- Institute of Health Policy and Management, Erasmus University Rotterdam, The Netherlands
| |
Collapse
|
11
|
Pelayo S, Marcilly R, Anceaux F, Bernonville S, Beuscart-Zephir MC. Human-Machine task allocation: Impact on patient safety in hospital settings. PSYCHOLOGIE FRANCAISE 2015. [DOI: 10.1016/j.psfr.2014.09.002] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
|
12
|
Xie A, Carayon P. A systematic review of human factors and ergonomics (HFE)-based healthcare system redesign for quality of care and patient safety. ERGONOMICS 2014; 58:33-49. [PMID: 25323570 PMCID: PMC4297241 DOI: 10.1080/00140139.2014.959070] [Citation(s) in RCA: 71] [Impact Index Per Article: 7.1] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/24/2023]
Abstract
Healthcare systems need to be redesigned to provide care that is safe, effective and efficient, and meets the multiple needs of patients. This systematic review examines how human factors and ergonomics (HFE) is applied to redesign healthcare work systems and processes and improve quality and safety of care. We identified 12 projects representing 23 studies and addressing different physical, cognitive and organisational HFE issues in a variety of healthcare systems and care settings. Some evidence exists for the effectiveness of HFE-based healthcare system redesign in improving process and outcome measures of quality and safety of care. We assessed risk of bias in 16 studies reporting the impact of HFE-based healthcare system redesign and found varying quality across studies. Future research should further assess the impact of HFE on quality and safety of care, and clearly define the mechanisms by which HFE-based system redesign can improve quality and safety of care.
Collapse
Affiliation(s)
- Anping Xie
- Armstrong Institute for Patient Safety and Quality, Department of Anesthesiology and Critical Care Medicine, Johns Hopkins University School of Medicine, Baltimore, MD, USA
| | - Pascale Carayon
- Center for Quality and Productivity Improvement, Department of Industrial and Systems Engineering, University of Wisconsin-Madison, Madison, WI, USA
| |
Collapse
|
13
|
Patel VL, Kannampallil TG. Human factors and health information technology: current challenges and future directions. Yearb Med Inform 2014; 9:58-66. [PMID: 25123724 DOI: 10.15265/iy-2014-0005] [Citation(s) in RCA: 23] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Abstract
OBJECTIVES Recent federal mandates and incentives have spurred the rapid growth, development and adoption of health information technology (HIT). While providing significant benefits for better data integration, organization, and availability, recent reports have raised questions regarding their potential to cause medication errors, decreased clinician performance, and lowered efficiency. The goal of this survey article is to (a) examine the theoretical and foundational models of human factors and ergonomics (HFE) that are being advocated for achieving patient safety and quality, and their use in the evaluation of healthcare systems; (b) and the potential for macroergonomic HFE approaches within the context of current research in biomedical informatics. METHODS We reviewed literature (2007-2013) on the use of HFE approaches in healthcare settings, from databases such as Pubmed, CINAHL, and Cochran. RESULTS Based on the review, we discuss the systems-oriented models, their use in the evaluation of HIT, and examples of their use in the evaluation of EHR systems, clinical workflow processes, and medication errors. We also discuss the opportunities for better integrating HFE methods within biomedical informatics research and its potential advantages. CONCLUSIONS The use of HFE methods is still in its infancy - better integration of HFE within the design lifecycle, and quality improvement efforts can further the ability of informatics researchers to address the key concerns regarding the complexity in clinical settings and develop HIT solutions that are designed within the social fabric of the considered setting.
Collapse
Affiliation(s)
- V L Patel
- Vimla L. Patel, Center for Cognitive Studies, in Medicine and Public Health, The New York Academy of Medicine, 1216 5th Avenue, New York, NY, E-mail:
| | | |
Collapse
|
14
|
Le T, Chaudhuri S, Chung J, Thompson HJ, Demiris G. Tree testing of hierarchical menu structures for health applications. J Biomed Inform 2014; 49:198-205. [PMID: 24582924 DOI: 10.1016/j.jbi.2014.02.011] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/03/2013] [Revised: 01/21/2014] [Accepted: 02/12/2014] [Indexed: 11/30/2022]
Abstract
To address the need for greater evidence-based evaluation of Health Information Technology (HIT) systems we introduce a method of usability testing termed tree testing. In a tree test, participants are presented with an abstract hierarchical tree of the system taxonomy and asked to navigate through the tree in completing representative tasks. We apply tree testing to a commercially available health application, demonstrating a use case and providing a comparison with more traditional in-person usability testing methods. Online tree tests (N=54) and in-person usability tests (N=15) were conducted from August to September 2013. Tree testing provided a method to quantitatively evaluate the information structure of a system using various navigational metrics including completion time, task accuracy, and path length. The results of the analyses compared favorably to the results seen from the traditional usability test. Tree testing provides a flexible, evidence-based approach for researchers to evaluate the information structure of HITs. In addition, remote tree testing provides a quick, flexible, and high volume method of acquiring feedback in a structured format that allows for quantitative comparisons. With the diverse nature and often large quantities of health information available, addressing issues of terminology and concept classifications during the early development process of a health information system will improve navigation through the system and save future resources. Tree testing is a usability method that can be used to quickly and easily assess information hierarchy of health information systems.
Collapse
Affiliation(s)
- Thai Le
- Biomedical Informatics and Medical Education, School of Medicine, University of Washington, WA, USA.
| | - Shomir Chaudhuri
- Biomedical Informatics and Medical Education, School of Medicine, University of Washington, WA, USA
| | - Jane Chung
- Biobehavioral Nursing and Health Systems, School of Nursing, University of Washington, WA, USA
| | - Hilaire J Thompson
- Biobehavioral Nursing and Health Systems, School of Nursing, University of Washington, WA, USA
| | - George Demiris
- Biomedical Informatics and Medical Education, School of Medicine, University of Washington, WA, USA; Biobehavioral Nursing and Health Systems, School of Nursing, University of Washington, WA, USA
| |
Collapse
|
15
|
Carayon P, Xie A, Kianfar S. Human factors and ergonomics as a patient safety practice. BMJ Qual Saf 2014; 23:196-205. [PMID: 23813211 PMCID: PMC3932984 DOI: 10.1136/bmjqs-2013-001812] [Citation(s) in RCA: 88] [Impact Index Per Article: 8.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/09/2013] [Revised: 03/25/2013] [Accepted: 06/05/2013] [Indexed: 01/09/2023]
Abstract
BACKGROUND Human factors and ergonomics (HFE) approaches to patient safety have addressed five different domains: usability of technology; human error and its role in patient safety; the role of healthcare worker performance in patient safety; system resilience; and HFE systems approaches to patient safety. METHODS A review of various HFE approaches to patient safety and studies on HFE interventions was conducted. RESULTS This paper describes specific examples of HFE-based interventions for patient safety. Studies show that HFE can be used in a variety of domains. CONCLUSIONS HFE is a core element of patient safety improvement. Therefore, every effort should be made to support HFE applications in patient safety.
Collapse
Affiliation(s)
- Pascale Carayon
- Department of Industrial and Systems Engineering, Center for Quality and Productivity Improvement, University of Wisconsin-Madison, , Madison, Wisconsin, USA
| | | | | |
Collapse
|
16
|
Lichtner V, Venters W, Hibberd R, Cornford T, Barber N. The fungibility of time in claims of efficiency: the case of making transmission of prescriptions electronic in English general practice. Int J Med Inform 2013; 82:1152-70. [PMID: 24008176 DOI: 10.1016/j.ijmedinf.2013.08.001] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/01/2013] [Revised: 07/28/2013] [Accepted: 08/01/2013] [Indexed: 11/18/2022]
Abstract
OBJECTIVES This paper presents a study of the effects of the implementation of the NHS Electronic Prescription Service (EPS) on time spent on repeat prescribing in English general practice. EPS is a new network service for the electronic transmission of primary care prescriptions, principally between GP practices and community pharmacies. This service is promoted on the basis of the importance of safe and timely supply of medicines, and the level of medicines use by many patients with treatable chronic conditions. The service is also based on presumptions of significant time-savings and efficiency gains for general practices and GPs. Our objective was to assess the time-related changes (including time savings) conditioned by digital transmission of prescriptions, specifically for repeat prescribing activity in primary care practices. METHODS As part of the official evaluation of EPS in the English NHS we undertook a qualitative research design with field studies in four of the first GP practices adopting EPS. This research was based on interviews with clinical and administrative staff, and non-participant observation of repeat prescribing related activities. RESULTS We found that the use of EPS reduced turnaround time and conditioned changes in the workflow, with time-savings found mainly in relation to administrative tasks. But the use of this technology also created additional tasks and shifted existing tasks and responsibilities. Thus elimination of tasks did not automatically correspond to potential staff savings or cost savings. Tasks that were eliminated and new tasks that were created were not equivalent in terms of time spent, quality of attention required, and roles involved. CONCLUSIONS The wider claim that healthcare information technology saves time and increases efficiency is often based on assumptions of the fungibility of time and people - i.e. that units of time added or saved on different steps of the workflow can be summed up as if they were all of the same kind, and thus reveal any net efficiency gain. But workflow time savings involve changes in the quality of tasks, redistribution of work and responsibility that mean that time can hardly be added or subtracted to obtain 'efficiency totals'.
Collapse
Affiliation(s)
- Valentina Lichtner
- Decision Making Research Group, School of Healthcare, University of Leeds, United Kingdom.
| | | | | | | | | |
Collapse
|
17
|
Middleton B, Bloomrosen M, Dente MA, Hashmat B, Koppel R, Overhage JM, Payne TH, Rosenbloom ST, Weaver C, Zhang J. Enhancing patient safety and quality of care by improving the usability of electronic health record systems: recommendations from AMIA. J Am Med Inform Assoc 2013; 20:e2-8. [PMID: 23355463 PMCID: PMC3715367 DOI: 10.1136/amiajnl-2012-001458] [Citation(s) in RCA: 338] [Impact Index Per Article: 30.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022] Open
Abstract
In response to mounting evidence that use of electronic medical record systems may cause unintended consequences, and even patient harm, the AMIA Board of Directors convened a Task Force on Usability to examine evidence from the literature and make recommendations. This task force was composed of representatives from both academic settings and vendors of electronic health record (EHR) systems. After a careful review of the literature and of vendor experiences with EHR design and implementation, the task force developed 10 recommendations in four areas: (1) human factors health information technology (IT) research, (2) health IT policy, (3) industry recommendations, and (4) recommendations for the clinician end-user of EHR software. These AMIA recommendations are intended to stimulate informed debate, provide a plan to increase understanding of the impact of usability on the effective use of health IT, and lead to safer and higher quality care with the adoption of useful and usable EHR systems.
Collapse
Affiliation(s)
- Blackford Middleton
- Clinical Informatics Research and Development, Partners HealthCare System, Harvard Medical School, Wellesley, Massachusetts 02481, USA.
| | | | | | | | | | | | | | | | | | | |
Collapse
|
18
|
Cho E, Kim HJ, Kim GM, Kum J, Chung HK, Lyu CJ, Ahn JB, Shin SJ. Assessment of efficiency and safety of the comprehensive Chemotherapy Assistance Program for ordering oncology medications. Int J Med Inform 2013; 82:504-13. [PMID: 23481407 DOI: 10.1016/j.ijmedinf.2013.02.001] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/11/2012] [Revised: 01/31/2013] [Accepted: 02/03/2013] [Indexed: 10/27/2022]
Abstract
PURPOSE To assess whether the newly developed Comprehensive Chemotherapy Assistance Program (CAP) decreases errors and increases performance efficiency in ordering oncology medications as compared to the existing Computerized Physician Order Entry (CPOE) system, the Order Communication System (OCS). METHODS All chemotherapy prescriptions ordered using OCS and CAP systems during the first year of CAP implementation were prospectively analyzed to identify near-miss cases. The efficiency outcomes were determined in a trial setting with eight predefined hypothetical chemotherapy regimens, each with four measures of the average time, movement distance on the screen, maximum input interval time, and number of mouse or keystrokes per order. A total of 14 physicians participated in the study, and each regimen was ordered twice, once using CAP and once using OCS. RESULTS For all near-miss types, CAP orders showed significant improvements as compared with OCS orders (p<0.0001). For CAP orders, incorrect dose and agent errors were reduced by 43.9% and 31.6%, respectively. Compared with OCS orders, regimen defects, drug omissions, and incorrect data input errors were reduced by more than 70% for CAP orders. For all four efficiency measures, a statistically significant competence was identified when physicians ordered a chemotherapy prescription with CAP as compared with OCS (p<0.0001). CONCLUSIONS These results demonstrate the superiority of CAP over the existing CPOE system for ordering oncology medications with regard to safety and efficiency.
Collapse
Affiliation(s)
- Eun Cho
- College of Pharmacy, Sookmyung Women's University, Seoul, Republic of Korea
| | | | | | | | | | | | | | | |
Collapse
|
19
|
E-prescribing: a focused review and new approach to addressing safety in pharmacies and primary care. Res Social Adm Pharm 2012; 9:996-1003. [PMID: 23062769 DOI: 10.1016/j.sapharm.2012.09.004] [Citation(s) in RCA: 23] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/17/2012] [Revised: 09/12/2012] [Accepted: 09/13/2012] [Indexed: 11/23/2022]
Abstract
E-prescribing, the health information technology (HIT) that enables prescribers to electronically transmit prescriptions to community pharmacies, has been touted as a solution for improving patient safety and overall quality of care. However, the impact of HIT, such as e-prescribing on medication errors in acute care settings, has been widely studied and shows that if poorly designed or implemented, HIT can pose a risk to patient safety by introducing a source of medication errors. Unlike acute care settings, safety issues related to e-prescribing in primary care settings (where e-prescriptions are generated and transmitted) and pharmacies (where e-prescriptions are received) have not received as much attention in the literature. This paper provides a focused review of patient safety issues related to using e-prescribing systems in primary care and pharmacies. In addition, the paper proposes using human factors engineering concepts to study e-prescribing safety in pharmacies and primary care settings to identify safety problems and possible mechanisms for improvement.
Collapse
|
20
|
Khajouei R, Peute L, Hasman A, Jaspers M. Classification and prioritization of usability problems using an augmented classification scheme. J Biomed Inform 2011; 44:948-57. [DOI: 10.1016/j.jbi.2011.07.002] [Citation(s) in RCA: 28] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/30/2010] [Revised: 06/29/2011] [Accepted: 07/04/2011] [Indexed: 11/30/2022]
|
21
|
Ahlers-Schmidt CR, Hart T, Chesser A, Williams KS, Yaghmai B, Shah-Haque S, Wittler RR. Using human factors techniques to design text message reminders for childhood immunization. HEALTH EDUCATION & BEHAVIOR 2011; 39:538-43. [PMID: 21986245 DOI: 10.1177/1090198111420866] [Citation(s) in RCA: 11] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
This study engaged parents to develop concise, informative, and comprehensible text messages for an immunization reminder system using Human Factors techniques. Fifty parents completed a structured interview including demographics, technology questions, willingness to receive texts from their child's doctor, and health literacy. Each participant was assigned to one user-centered design test: card sort, needs analysis, or comprehension. The majority of respondents were female (90%), White non-Hispanic (62%), and averaged 29 years (SD = 5). Nearly all (96%) had "adequate" health literacy. The card sort, an activity in which end users organize information into categories, identified six pieces of critical information. These were compiled into eight example texts, which were ranked in the needs assessment. The top two were assessed for comprehension, with 100% of participants able to understand the content and describe intention to act. Using user-centered design methods, the authors developed concise, informative text messages that parents indicated would prompt them to schedule their child's immunization appointment.
Collapse
|
22
|
Springman SR. Integration of the enterprise electronic health record and anesthesia information management systems. Anesthesiol Clin 2011; 29:455-483. [PMID: 21871405 DOI: 10.1016/j.anclin.2011.05.007] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/31/2023]
Abstract
Fewer than 5% of anesthesia departments use an electronic medical record (EMR) that is anesthesia specific. Many anesthesia information management systems (AIMS) have been developed with a focus only on the unique needs of anesthesia providers, without being fully integrated into other electronic health record components of the entire enterprise medical system. To understand why anesthesia providers should embrace health information technology (HIT) on a health system-wide basis, this article reviews recent HIT history and reviews HIT concepts. The author explores current developments in efforts to expand enterprise HIT, and the pros and cons of full enterprise integration with an AIMS.
Collapse
Affiliation(s)
- Scott R Springman
- Anesthesiology Department, University of Wisconsin School of Medicine and Public Health, Madison, USA.
| |
Collapse
|
23
|
ASHP guidelines on pharmacy planning for implementation of computerized provider-order-entry systems in hospitals and health systems. Am J Health Syst Pharm 2011; 68:e9-31. [PMID: 21378288 DOI: 10.2146/sp100011e] [Citation(s) in RCA: 17] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/23/2022] Open
|
24
|
Khajouei R, Wierenga PC, Hasman A, Jaspers MWM. Clinicians satisfaction with CPOE ease of use and effect on clinicians' workflow, efficiency and medication safety. Int J Med Inform 2011; 80:297-309. [PMID: 21419695 DOI: 10.1016/j.ijmedinf.2011.02.009] [Citation(s) in RCA: 53] [Impact Index Per Article: 4.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/17/2010] [Revised: 02/17/2011] [Accepted: 02/17/2011] [Indexed: 11/17/2022]
Abstract
OBJECTIVES To study the satisfaction of end-users of a computerized physician order entry (CPOE) system concerning ease of use and the effect on users' workflow, efficiency, and medication safety and to seek users' opinions regarding required improvements of the system. Usability evaluation had shown that this system, which was in use for almost a decade, contained a number of severe usability problems. So another objective of the study was to determine whether there was a direct relation between user satisfaction and the results of a usability evaluation of the system. METHODS Two survey questionnaires were distributed to CPOE system users (physicians and nurses) working in inpatient departments of a university hospital. Questionnaires included items that were rated using a five point Likert scale. Multiple choice questions with space for free text additions also were used to collect qualitative data concerning the use of the CPOE system and the users' opinion concerning system requirements for improvement. Data were analyzed using descriptive statistics and by the use of Mann-Whitney U and Kruskal Wallis tests. RESULTS Two hundred seventeen physicians and 587 nurses were eligible to participate in this study (response rate 49% and 56% respectively). Physicians were satisfied with the CPOE ease of use (median 3.8, interquartile range [IQR] 3.3-4), and the effect on workflow (median 3.7, IQR 3.3-4), medication safety (median 3.75, IQR 3-4), and efficiency (median 4, IQR 3-4). Nurses also had a positive attitude towards CPOE ease of use (median 3.6, IQR 3-4), and its effect on workflow (median 3, IQR 3-3.6), medication safety (median 3, IQR 2.5-3.5), and efficiency (median 3.5, IQR 3-4). Users mainly indicated that the system needs: supplementary functionalities (e.g. alerts for allergies), improvement of current functionalities, integration with other hospital information systems and improvement of information presentation (e.g. a clear medication overview). Users did not use some current functionalities because of lack of awareness of the functionalities or having difficulty in using them. CONCLUSIONS Users of this CPOE system, which was used for almost a decade, were satisfied with the system's ease of use and its effect on efficiency, workflow and medication safety although the system showed many usability problems and lacked some functionalities. In this case study, therefore, there seems no direct relation between the results of the earlier performed usability evaluation and user satisfaction as determined in the current study.
Collapse
Affiliation(s)
- R Khajouei
- Department of Medical Informatics, Academic Medical Center, University of Amsterdam, The Netherlands.
| | | | | | | |
Collapse
|
25
|
Chan AJ, Islam MK, Rosewall T, Jaffray DA, Easty AC, Cafazzo JA. The use of human factors methods to identify and mitigate safety issues in radiation therapy. Radiother Oncol 2010; 97:596-600. [PMID: 21044802 DOI: 10.1016/j.radonc.2010.09.026] [Citation(s) in RCA: 26] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/06/2010] [Revised: 09/22/2010] [Accepted: 09/26/2010] [Indexed: 10/18/2022]
Abstract
BACKGROUND AND PURPOSE New radiation therapy technologies can enhance the quality of treatment and reduce error. However, the treatment process has become more complex, and radiation dose is not always delivered as intended. Using human factors methods, a radiotherapy treatment delivery process was evaluated, and a redesign was undertaken to determine the effect on system safety. MATERIAL AND METHODS An ethnographic field study and workflow analysis was conducted to identify human factors issues of the treatment delivery process. To address specific issues, components of the user interface were redesigned through a user-centered approach. Sixteen radiation therapy students were then used to experimentally evaluate the redesigned system through a usability test to determine the effectiveness in mitigating use errors. RESULTS According to findings from the usability test, the redesigned system successfully reduced the error rates of two common errors (p<.04 and p<.01). It also improved the mean task completion time by 5.5% (p<.02) and achieved a higher level of user satisfaction. CONCLUSIONS These findings demonstrated the importance and benefits of applying human factors methods in the design of radiation therapy systems. Many other opportunities still exist to improve patient safety in this area using human factors methods.
Collapse
Affiliation(s)
- Alvita J Chan
- Healthcare Human Factors, University Health Network, Ontario, Canada.
| | | | | | | | | | | |
Collapse
|