Are We There Yet? Human Factors Knowledge and Health Information Technology - the Challenges of Implementation and Impact

The Human-Technology Continuum

BACKGROUND AND OBJECTIVES

Managers in health care today face an array of digital technologies that assist or augment certain human tasks. But these technologies are often fraught and present challenges to managers, whose competencies must evolve to keep pace with technological advancements.

METHODS

Drawing on theory about technology, work, and organizations, we present a human-technology continuum to facilitate this discussion for managers. Furthermore, we illustrate how managerial competencies are linked to the entire human-technology continuum, rather than to specific technologies, using diabetes management examples.

RESULTS

The human-technology continuum indicates that augmentative technologies are layered onto assistive ones in health care settings. This suggests that technological advancements not only enhance but alter managerial competencies.

CONCLUSIONS

Digital technology stretches the boundaries of managers' day-to-day work in health care. Therefore, we make the following suggestions so the managers can be responsive to ongoing digital transformations: restructuring work, training the workforce, neutralizing threats, establishing ethical boundaries, and building partnerships.

Work system barriers and facilitators of a team health information technology

Designing health IT aimed at supporting team-based care and improving patient safety is difficult. This requires a work system (i.e., SEIPS) evaluation of the technology by care team members. This study aimed to identify work system barriers and facilitators to the use of a team health IT that supports care transitions for pediatric trauma patients. We conducted an analysis on 36 interviews - representing 12 roles - collected from a scenario-based evaluation of T3. We identified eight dimensions with both barriers and facilitators in all five work system elements: person (experience), task (task performance, workload/efficiency), technology (usability, specific features of T3), environment (space, location), and organization (communication/coordination). Designing technology that meets every role's needs is challenging; in particular, when trade-offs need to be managed, e.g., additional workload for one role or divergent perspectives regarding specific features. Our results confirm the usefulness of a continuous work system approach to technology design and implementation.

Implementation and use of technology-enabled blood pressure monitoring and teleconsultation in Singapore's primary care: a qualitative evaluation using the socio-technical systems approach

BACKGROUND

Telemedicine is becoming integral in primary care hypertension management, and is associated with improved blood pressure control, self-management and cost-effectiveness. This study explored the experiences of patients and healthcare professionals and their perceived barriers and facilitators in implementing and using a technology-enabled blood pressure monitoring intervention with teleconsultation in the Singapore primary care setting.

METHODS

This was a qualitative study embedded within the Primary Technology-Enhanced Care Hypertension pilot trial. Patients were selected purposively and invited to participate by telephone; healthcare professionals involved in the trial were invited to participate by email. Individual semi-structured interviews were conducted in English or Mandarin with thirteen patients and eight healthcare professionals. Each interview was audio-recorded and transcribed verbatim. Data were analyzed inductively to identify emergent themes which were then grouped into the dimensions of the socio-technical systems model to study the interactions between the technical, individual and organizational factors involved in the process.

RESULTS

Several emergent themes were identified. The factors involved in the implementation and use of the intervention are complex and interdependent. Patients and healthcare professionals liked the convenience resulting from the intervention and saw an improvement in the patient-provider relationship. Patients appreciated that the intervention helped form a habit of regular blood pressure monitoring, improved their self-management, and provided reassurance that they were being monitored by the care team. Healthcare professionals found that the intervention helped to manage workload by freeing up time for other urgent matters. Nevertheless, participants highlighted challenges with usability of the equipment and management portal, data access, and some expressed technology anxiety. Participants suggested patient segmentation for the intervention to be more targeted, wished for a more user-friendly equipment and proposed allocating more resources to the intervention.

CONCLUSIONS

The implementation and use of telemedicine for hypertension management can engender various benefits and challenges to patients, healthcare professionals and the healthcare system. Stakeholder feedback gathered on the sociotechnical aspects of the technology should be taken into consideration to guide the design, implementation and evaluation of future telemedicine interventions in primary care.

TRIAL REGISTRATION

This study was registered on ClinicalTrials.gov on October 9, 2018. ID: NCT03698890.

A Remote Patient-Monitoring System for Intensive Care Medicine: Mixed Methods Human-Centered Design and Usability Evaluation

Background

Continuous monitoring of vital signs is critical for ensuring patient safety in intensive care units (ICUs) and is becoming increasingly relevant in general wards. The effectiveness of health information technologies such as patient-monitoring systems is highly determined by usability, the lack of which can ultimately compromise patient safety. Usability problems can be identified and prevented by involving users (ie, clinicians).

Objective

In this study, we aim to apply a human-centered design approach to evaluate the usability of a remote patient-monitoring system user interface (UI) in the ICU context and conceptualize and evaluate design changes.

Methods

Following institutional review board approval (EA1/031/18), a formative evaluation of the monitoring UI was performed. Simulated use tests with think-aloud protocols were conducted with ICU staff (n=5), and the resulting qualitative data were analyzed using a deductive analytic approach. On the basis of the identified usability problems, we conceptualized informed design changes and applied them to develop an improved prototype of the monitoring UI. Comparing the UIs, we evaluated perceived usability using the System Usability Scale, performance efficiency with the normative path deviation, and effectiveness by measuring the task completion rate (n=5). Measures were tested for statistical significance using a 2-sample t test, Poisson regression with a generalized linear mixed-effects model, and the N-1 chi-square test. P<.05 were considered significant.

Results

We found 37 individual usability problems specific to monitoring UI, which could be assigned to six subcodes: usefulness of the system, response time, responsiveness, meaning of labels, function of UI elements, and navigation. Among user ideas and requirements for the UI were high usability, customizability, and the provision of audible alarm notifications. Changes in graphics and design were proposed to allow for better navigation, information retrieval, and spatial orientation. The UI was revised by creating a prototype with a more responsive design and changes regarding labeling and UI elements. Statistical analysis showed that perceived usability improved significantly (System Usability Scale design A: mean 68.5, SD 11.26, n=5; design B: mean 89, SD 4.87, n=5; P=.003), as did performance efficiency (normative path deviation design A: mean 8.8, SD 5.26, n=5; design B: mean 3.2, SD 3.03, n=5; P=.001), and effectiveness (design A: 18 trials, failed 7, 39% times, passed 11, 61% times; design B: 20 trials, failed 0 times, passed 20 times; P=.002).

Conclusions

Usability testing with think-aloud protocols led to a patient-monitoring UI with significantly improved usability, performance, and effectiveness. In the ICU work environment, difficult-to-use technology may result in detrimental outcomes for staff and patients. Technical devices should be designed to support efficient and effective work processes. Our results suggest that this can be achieved by applying basic human-centered design methods and principles.

Trial Registration

ClinicalTrials.gov NCT03514173; https://clinicaltrials.gov/ct2/show/NCT03514173

Human-centered design of team health IT for pediatric trauma care transitions

BACKGROUND

As problems of acceptance, usability and workflow integration continue to emerge with health information technologies (IT), it is critical to incorporate human factors and ergonomics (HFE) methods and design principles. Human-centered design (HCD) provides an approach to integrate HFE and produce usable technologies. However, HCD has been rarely used for designing team health IT, even though team-based care is expanding.

OBJECTIVE

To describe the HCD process used to develop a usable team health IT (T3 or Teamwork Transition Technology) that provides cognitive support to pediatric trauma care teams during transitions from the emergency department to the operating room and the pediatric intensive care unit.

METHODS

The HCD process included seven steps in three phases of analysis, design activities and feedback.

RESULTS

The HCD process involved multiple perspectives and clinical roles that were engaged in inter-related activities, leading to design requirements, i.e., goals for the technology, a set of 47 information elements, and a list of HFE design principles applied to T3. Results of the evaluation showed a high usability score for T3.

CONCLUSIONS

HFE can be integrated in the HCD process through a range of methods and design principles. That design process can produce a usable technology that provides cognitive support to a large diverse team involved in pediatric trauma care transitions. Future research should continue to focus on HFE-based design of team health IT.

Collaborative design and implementation of a clinical decision support system for automated fall-risk identification and referrals in emergency departments

Of the 3 million older adults seeking fall-related emergency care each year, nearly one-third visited the Emergency Department (ED) in the previous 6 months. ED providers have a great opportunity to refer patients for fall prevention services at these initial visits, but lack feasible tools for identifying those at highest-risk. Existing fall screening tools have been poorly adopted due to ED staff/provider burden and lack of workflow integration. To address this, we developed an automated clinical decision support (CDS) system for identifying and referring older adult ED patients at risk of future falls. We engaged an interdisciplinary design team (ED providers, health services researchers, information technology/predictive analytics professionals, and outpatient Falls Clinic staff) to collaboratively develop a system that successfully met user requirements and integrated seamlessly into existing ED workflows. Our rapid-cycle development and evaluation process employed a novel combination of human-centered design, implementation science, and patient experience strategies, facilitating simultaneous design of the CDS tool and intervention implementation strategies. This included defining system requirements, systematically identifying and resolving usability problems, assessing barriers and facilitators to implementation (e.g., data accessibility, lack of time, high patient volumes, appointment availability) from multiple vantage points, and refining protocols for communicating with referred patients at discharge. ED physician, nurse, and patient stakeholders were also engaged through online surveys and user testing. Successful CDS design and implementation required integration of multiple new technologies and processes into existing workflows, necessitating interdisciplinary collaboration from the onset. By using this iterative approach, we were able to design and implement an intervention meeting all project goals. Processes used in this Clinical-IT-Research partnership can be applied to other use cases involving automated risk-stratification, CDS development, and EHR-facilitated care coordination.

Perceptual Gaps Between Clinicians and Technologists on Health Information Technology-Related Errors in Hospitals: Observational Study

BACKGROUND

Health information technology (HIT) has been widely adopted in hospital settings, contributing to improved patient safety. However, many types of medical errors attributable to information technology (IT) have negatively impacted patient safety. The continued occurrence of many errors is a reminder that HIT software testing and validation is not adequate in ensuring errorless software functioning within the health care organization.

OBJECTIVE

This pilot study aims to classify technology-related medical errors in a hospital setting using an expanded version of the sociotechnical framework to understand the significant differences in the perceptions of clinical and technology stakeholders regarding the potential causes of these errors. The paper also provides some recommendations to prevent future errors.

METHODS

Medical errors were collected from previous studies identified in leading health databases. From the main list, we selected errors that occurred in hospital settings. Semistructured interviews with 5 medical and 6 IT professionals were conducted to map the events on different dimensions of the expanded sociotechnical framework.

RESULTS

Of the 2319 identified publications, 36 were included in the review. Of the 67 errors collected, 12 occurred in hospital settings. The classification showed the "gulf" that exists between IT and medical professionals in their perspectives on the underlying causes of medical errors. IT experts consider technology as the source of most errors and suggest solutions that are mostly technical. However, clinicians assigned the source of errors within the people, process, and contextual dimensions. For example, for the error "Copied and pasted charting in the wrong window: Before, you could not easily get into someone else's chart accidentally...because you would have to pull the chart and open it," medical experts highlighted contextual issues, including the number of patients a health care provider sees in a short time frame, unfamiliarity with a new electronic medical record system, nurse transitions around the time of error, and confusion due to patients having the same name. They emphasized process controls, including failure modes, as a potential fix. Technology experts, in contrast, discussed the lack of notification, poor user interface, and lack of end-user training as critical factors for this error.

CONCLUSIONS

Knowledge of the dimensions of the sociotechnical framework and their interplay with other dimensions can guide the choice of ways to address medical errors. These findings lead us to conclude that designers need not only a high degree of HIT know-how but also a strong understanding of the medical processes and contextual factors. Although software development teams have historically included clinicians as business analysts or subject matter experts to bridge the gap, development teams will be better served by more immersive exposure to clinical environments, leading to better software design and implementation, and ultimately to enhanced patient safety.

Barriers and facilitators to clinical information seeking: a systematic review

OBJECTIVE

The study sought to identify barriers to and facilitators of point-of-care information seeking and use of knowledge resources.

MATERIALS AND METHODS

We searched MEDLINE, Embase, PsycINFO, and Cochrane Library from 1991 to February 2017. We included qualitative studies in any language exploring barriers to and facilitators of point-of-care information seeking or use of electronic knowledge resources. Two authors independently extracted data on users, study design, and study quality. We inductively identified specific barriers or facilitators and from these synthesized a model of key determinants of information-seeking behaviors.

RESULTS

Forty-five qualitative studies were included, reporting data derived from interviews (n = 26), focus groups (n = 21), ethnographies (n = 6), logs (n = 4), and usability studies (n = 2). Most studies were performed within the context of general medicine (n = 28) or medical specialties (n = 13). We inductively identified 58 specific barriers and facilitators and then created a model reflecting 5 key determinants of information-seeking behaviors: time includes subthemes of time availability, efficiency of information seeking, and urgency of information need; accessibility includes subthemes of hardware access, hardware speed, hardware portability, information restriction, and cost of resources; personal skills and attitudes includes subthemes of computer literacy, information-seeking skills, and contextual attitudes about information seeking; institutional attitudes, cultures, and policies includes subthemes describing external individual and institutional information-seeking influences; and knowledge resource features includes subthemes describing information-seeking efficiency, information content, information organization, resource familiarity, information credibility, information currency, workflow integration, compatibility of recommendations with local processes, and patient educational support.

CONCLUSIONS

Addressing these determinants of information-seeking behaviors may facilitate clinicians' question answering to improve patient care.

Human Factors and Usability for Health Information Technology: Old and New Challenges

OBJECTIVES

Despite national mandates, incentives, and other programs, the design of health information technology (IT) remains problematic and usability problems continue to be reported. This paper reviews recent literature on human factors and usability of health IT, with a specific focus on research aimed at applying human factors methods and principles to improve the actual design of health IT, its use, and associated patient and clinician outcomes.

METHODS

We reviewed recent literature on human factors and usability problems of health IT and research on human-centered design of health IT for clinicians and patients.

RESULTS

Studies continue to show usability problems of health IT experienced by multiple groups of health care professionals (e.g., physicians and nurses) as well as patients. Recent research shows that usability is influenced by both designers (e.g., IT vendors) and implementers in health care organizations, and that the application of human-centered design practices needs to be further improved and extended. We welcome emerging research on the design of health IT for teams as team-based care is increasingly implemented throughout health care.

CONCLUSIONS

Progress in the application of human factors methods and principles to the design of health IT is occurring, with important information provided on their actual impact on care processes and patient outcomes. Future research should examine the work of health IT designers and implementers, which would help to develop strategies for further embedding human factors engineering in IT design processes.

The new frontiers of rehabilitation medicine in people with chronic disabling illnesses

Because of the demographic shift and the increased proportion of patients surviving acute critical illnesses, the number of people living with severely disabling chronic diseases and, consequently, the demand for rehabilitation are expected to increase sharply over time. As underscored by the World Health Organization, there is substantial evidence that the provision of inpatient rehabilitation in specialized rehabilitation units to people with complex needs is effective in fostering functional recovery, improving health-related quality of life, increasing independence, reducing institutionalization rate, and improving prognosis. Recent studies in the real world setting reinforce the evidence that patients with ischemic heart disease or stroke benefit from rehabilitation in terms of improved prognosis. In addition, there is evidence of the effectiveness of rehabilitation for the prevention of functional deterioration in patients with complex and/or severe chronic diseases. Given this evidence of effectiveness, rehabilitation should be regarded as an essential part of the continuum of care. Nonetheless, rehabilitation still is underdeveloped and underused. Efforts should be devoted to foster healthcare professional awareness of the benefits of rehabilitation and to increase referral and participation.

Learning health systems need to bridge the ‘two cultures’ of clinical informatics and data science

Background

UK health research policy and plans for population health management are predicated upon transformative knowledge discovery from operational ‘Big Data’. Learning health systems require not only data, but feedback loops of knowledge into changed practice. This depends on knowledge management and application, which in turn depends upon effective system design and implementation. Biomedical informatics is the interdisciplinary field at the intersection of health science, social science and information science and technology that spans this entire scope.

Issues

In the UK, the separate worlds of health data science (bioinformatics, ‘Big Data’) and effective healthcare system design and implementation (clinical informatics, ‘Digital Health’) have operated as ‘two cultures’. Much National Health Service and social care data is of very poor quality. Substantial research funding is wasted on ‘data cleansing’ or by producing very weak evidence. There is not yet a sufficiently powerful professional community or evidence base of best practice to influence the practitioner community or the digital health industry.

Recommendation

The UK needs increased clinical informatics research and education capacity and capability at much greater scale and ambition to be able to meet policy expectations, address the fundamental gaps in the discipline’s evidence base and mitigate the absence of regulation. Independent evaluation of digital health interventions should be the norm, not the exception.

Conclusions

Policy makers and research funders need to acknowledge the existing gap between the ‘two cultures’ and recognise that the full social and economic benefits of digital health and data science can only be realised by accepting the interdisciplinary nature of biomedical informatics and supporting a significant expansion of clinical informatics capacity and capability.

Clinical Data Warehouse Query and Learning Tool Using a Human-Centered Participatory Design Process

BMI Investigator (BMII) is an interactive web-based tool with a learning knowledge base, which provides a way for researchers to query structured, unstructured, genomic and image data contained in a data warehouse. We demonstrate how development of an efficient, usable, and learnable web interface for a diverse group of research stakeholders benefits from an iterative human-centered participatory design process utilizing a team of clinicians, students, programmers, and informatics experts.

Trends and Progress in Human Factors and Organizational Issues in 2016: Learning from Experience

Objective: To summarize significant research contributions on human factors and organizational issues in medical informatics published in 2016. Methods: An extensive search using PubMed/Medline and Web of Science® was conducted to identify the scientific contributions published in 2016 that address human factors and organizational issues in medical informatics. The selection process comprised three steps: (i) 15 candidate best papers were first selected by the two section editors, (ii) external reviewers from internationally renowned research teams reviewed each candidate best paper, and (iii) the final selection of five best papers was conducted by the editorial board of the Yearbook. Results: The five selected best papers present studies with rigorous methods, properly designed and described and are, therefore, efficiently reusable for other researches. Conclusion: Human factors and ergonomics- based interventions must be tailored to the context, but meaningful ways must be simultaneously found to generate a stronger evidence base for research and to provide efficient, easy to implement, and useful methods.