A Survey of the Literature on Unintended Consequences Associated with Health Information Technology: 2014-2015

Strategies used to detect and mitigate system-related errors over time: A qualitative study in an Australian health district

BACKGROUND

Electronic medical record (EMR) systems provide timely access to clinical information and have been shown to improve medication safety. However, EMRs can also create opportunities for error, including system-related errors or errors that were unlikely or not possible with the use of paper medication charts. This study aimed to determine the detection and mitigation strategies adopted by a health district in Australia to target system-related errors and to explore stakeholder views on strategies needed to curb future system-related errors from emerging.

METHODS

A qualitative descriptive study design was used comprising semi-structured interviews. Data were collected from three hospitals within a health district in Sydney, Australia, between September 2020 and May 2021. Interviews were conducted with EMR users and other key stakeholders (e.g. clinical informatics team members). Participants were asked to reflect on how system-related errors changed over time, and to describe approaches taken by their organisation to detect and mitigate these errors. Thematic analysis was conducted iteratively using a general inductive approach, where codes were assigned as themes emerged from the data.

RESULTS

Interviews were conducted with 25 stakeholders. Participants reported that most system-related errors were detected by front-line clinicians. Following error detection, clinicians either reported system-related errors directly to the clinical informatics team or submitted reports to the incident information management system. System-related errors were also reported to be detected via reports run within the EMR, or during organisational processes such as incident investigations or system enhancement projects. EMR redesign was the main approach described by participants for mitigating system-related errors, however other strategies, like regular user education and minimising the use of hybrid systems, were also reported.

CONCLUSIONS

Initial detection of system-related errors relies heavily on front-line clinicians, however other organisational strategies that are proactive and layered can improve the systemic detection, investigation, and management of errors. Together with EMR design changes, complementary error mitigation strategies, including targeted staff education, can support safe EMR use and development.

How might the rapid development of artificial intelligence affect the delivery of UK Defence healthcare?

Artificial intelligence (AI) has developed greatly and is now at the centre of technological advancements. Current and recent military conflicts have highlighted the evolving complexity of warfare with rapid technological change at the heart of it. AI aims to understand and design systems that show signs of intelligence and are able to learn by deriving knowledge from data. There have been multiple AI-related developments in the medical field in areas such as diagnostics, triage, wearable technology and training with direct translations that may benefit UK Defence healthcare. With the increasing use of AI in society and medical practice, it is important to consider whether AI can be trustworthy and has any legal implications, and evaluate its use through an ethical lens. In conclusion, the rapid development of AI presents exciting opportunities for UK Defence to enhance its healthcare delivery. This paper was selected as the BMJ Military Health Essay Prize winner at the Royal Society of Medicine Colt Foundation Meeting 2023.

Frameworks, Dimensions, Definitions of Aspects, and Assessment Methods for the Appraisal of Quality of Health Data for Secondary Use: Comprehensive Overview of Reviews

BACKGROUND

Health care has not reached the full potential of the secondary use of health data because of-among other issues-concerns about the quality of the data being used. The shift toward digital health has led to an increase in the volume of health data. However, this increase in quantity has not been matched by a proportional improvement in the quality of health data.

OBJECTIVE

This review aims to offer a comprehensive overview of the existing frameworks for data quality dimensions and assessment methods for the secondary use of health data. In addition, it aims to consolidate the results into a unified framework.

METHODS

A review of reviews was conducted including reviews describing frameworks of data quality dimensions and their assessment methods, specifically from a secondary use perspective. Reviews were excluded if they were not related to the health care ecosystem, lacked relevant information related to our research objective, and were published in languages other than English.

RESULTS

A total of 22 reviews were included, comprising 22 frameworks, with 23 different terms for dimensions, and 62 definitions of dimensions. All dimensions were mapped toward the data quality framework of the European Institute for Innovation through Health Data. In total, 8 reviews mentioned 38 different assessment methods, pertaining to 31 definitions of the dimensions.

CONCLUSIONS

The findings in this review revealed a lack of consensus in the literature regarding the terminology, definitions, and assessment methods for data quality dimensions. This creates ambiguity and difficulties in developing specific assessment methods. This study goes a step further by assigning all observed definitions to a consolidated framework of 9 data quality dimensions.

A Systematic Review of Digital Ophthalmoscopes in Medicine

Purpose

Recent advances in telemedicine have led to increased use of digital ophthalmoscopes (DO) in clinical settings. This review aims to assess commercially available DOs, including smartphone (SP), desktop, and handheld ophthalmoscopes, and evaluate their applications.

Methods

A literature review was performed by searching PubMed (pubmed.ncbi.nlm.nih.gov), Web of Science (webofknowledge.com), and Science Direct (sciencedirect.com). All English-language papers that resulted from the search terms "digital ophthalmoscope", "screening tool", "glaucoma screening", "diabetic retinopathy screening", "cataract screening", and "papilledema screening" were reviewed. Studies that contained randomized clinical trials with human participants between January 2010 and December 2020 were included. The Risk of Bias in Systematic Reviews (ROBIS) tool was used to assess the methodological quality of each included paper.

Results

Of the 1307 studies identified, 35 met inclusion and exclusion criteria. The ROBIS tool determined that 29/35 studies (82.8%) had a low risk of bias, 3/35 (8.5%) had a moderate risk of bias, and 3/35 (8.5%) had a high risk of bias.

Conclusion

The continued adoption of DOs remains uncertain because of concerns about the image quality for non-mydriatic eyes and the confidence in data captured from the device. Likewise, there is a lack of guidelines for the use of DOs, which makes it difficult for providers to determine the best device for their practice and to ensure appropriate use. Even so, DOs continue to gain acceptance as technology and practice integration improve, especially in underserved areas with limited access to ophthalmologists.

Impacts of an Electronic Health Record Transition on Veterans Health Administration Health Professions Trainee Experience

BACKGROUND

Adoption of electronic health care records (EHRs) has proliferated since 2000. While EHR transitions are widely understood to be disruptive, little attention has been paid to their effect on health professions trainees' (HPTs) ability to learn and conduct work. Veterans Health Administration's (VA) massive transition from its homegrown EHR (CPRS/Vista) to the commercial Oracle Cerner presents an unparalleled-in-scope opportunity to gain insight on trainee work functions and their ability to obtain requisite experience during transitions.

OBJECTIVE

To identify how an organizational EHR transition affected HPT work and learning at the third VA go-live site.

DESIGN

A formative mixed-method evaluation of HPT experiences with VHA's EHR transition including interviews with HPTs and supervisors at Chalmers P. Wylie VA Outpatient Clinic in Columbus, OH, before (~60 min), during (15-30 min), and after (~60 min) go-live (December 2021-July 2022). We also conducted pre- (March 2022-April 2022) and post-go live (May 2022-June 2022) HPT and employee surveys.

PARTICIPANTS

We conducted 24 interviews with HPTs (n=4), site leaders (n=2), and academic affiliates (n=2) using snowball sampling. We recruited HPTs in pre- (n=13) and post-go-live (n=10) surveys and employees in pre- (n=408) and post-go-live (n=458) surveys.

APPROACH

We conducted interviews using a semi-structured guide and grounded prompts. We coded interviews and survey free text data using a priori and emergent codes, subsequently conducting thematic analysis. We conducted descriptive statistical analysis of survey responses and merged interview and survey data streams.

KEY RESULTS

Our preliminary findings indicate that the EHR transition comprehensively affected HPT experiences, disrupting processes from onboarding and training to clinical care contributions and training-to-career retention.

CONCLUSIONS

Understanding HPTs' challenges during EHR transitions is critical to effective training. Mitigating the identified barriers to HPT training and providing patient care may lessen their dissatisfaction and ensure quality patient care during EHR transitions.

Digital Health Data Quality Issues: Systematic Review

BACKGROUND

The promise of digital health is principally dependent on the ability to electronically capture data that can be analyzed to improve decision-making. However, the ability to effectively harness data has proven elusive, largely because of the quality of the data captured. Despite the importance of data quality (DQ), an agreed-upon DQ taxonomy evades literature. When consolidated frameworks are developed, the dimensions are often fragmented, without consideration of the interrelationships among the dimensions or their resultant impact.

OBJECTIVE

The aim of this study was to develop a consolidated digital health DQ dimension and outcome (DQ-DO) framework to provide insights into 3 research questions: What are the dimensions of digital health DQ? How are the dimensions of digital health DQ related? and What are the impacts of digital health DQ?

METHODS

Following the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines, a developmental systematic literature review was conducted of peer-reviewed literature focusing on digital health DQ in predominately hospital settings. A total of 227 relevant articles were retrieved and inductively analyzed to identify digital health DQ dimensions and outcomes. The inductive analysis was performed through open coding, constant comparison, and card sorting with subject matter experts to identify digital health DQ dimensions and digital health DQ outcomes. Subsequently, a computer-assisted analysis was performed and verified by DQ experts to identify the interrelationships among the DQ dimensions and relationships between DQ dimensions and outcomes. The analysis resulted in the development of the DQ-DO framework.

RESULTS

The digital health DQ-DO framework consists of 6 dimensions of DQ, namely accessibility, accuracy, completeness, consistency, contextual validity, and currency; interrelationships among the dimensions of digital health DQ, with consistency being the most influential dimension impacting all other digital health DQ dimensions; 5 digital health DQ outcomes, namely clinical, clinician, research-related, business process, and organizational outcomes; and relationships between the digital health DQ dimensions and DQ outcomes, with the consistency and accessibility dimensions impacting all DQ outcomes.

CONCLUSIONS

The DQ-DO framework developed in this study demonstrates the complexity of digital health DQ and the necessity for reducing digital health DQ issues. The framework further provides health care executives with holistic insights into DQ issues and resultant outcomes, which can help them prioritize which DQ-related problems to tackle first.

Electronic Health Records' Support for Primary Care Physicians' Situation Awareness: A Metanarrative Review

OBJECTIVE

Situation awareness (SA) refers to people's perception and understanding of their dynamic environment. In primary care, reduced SA among physicians increases errors in clinical decision-making and, correspondingly, patients' risk of experiencing adverse outcomes. Our objective was to understand the extent to which electronic health records (EHRs) support primary care physicians (PCPs)' SA during clinical decision-making.

METHOD

We conducted a metanarrative review of papers in selected academic databases, including CINAHL and MEDLINE. Eligible studies included original peer-reviewed research published between January 2012 and August 2020 on PCP-EHR interactions. We iteratively queried, screened, and summarized literature focused on EHRs supporting PCPs' clinical decision-making and care management for adults. Then, we mapped findings to an established SA framework to classify external factors (individual, task, and system) affecting PCPs' levels of SA (1-Perception, 2-Comprehension, and 3-Projection) and identified SA barriers.

RESULTS

From 1504 articles identified, we included and synthesized 19 studies. Study designs were largely noninterventional. Studies described EHR workflow misalignments, usability issues, and communication challenges. EHR information, including lab results and care plans, was characterized as incomplete, untimely, or irrelevant. Unmet information needs made it difficult for PCPs to obtain even basic SA, Level 1 SA. Prevalent barriers to PCPs developing SA with EHRs were errant mental models, attentional tunneling, and data overload.

CONCLUSION

Based on our review, EHRs do not support the development of higher levels of SA among PCPs. Review findings suggest SA-oriented design processes for health information technology could improve PCPs' SA, satisfaction, and decision-making.

Unintended consequences of pharmacy information systems: A case study

BACKGROUND

Pharmacy information systems (PhIS) can cause medication errors that pharmacists may overlook due to their increased workload and lack of understanding of maintaining information quality. This study seeks to identify factors influencing unintended consequences of PhIS and how they affect the information quality, which can pose a risk to patient safety.

MATERIALS AND METHODS

This qualitative, explanatory case study evaluated PhIS in ambulatory pharmacies in a hospital and a clinic. Data were collected through observations, interviews, and document analysis. We applied the socio-technical interactive analysis (ISTA) framework to investigate the socio-technical interactions of pharmacy information systems that lead to unintended consequences. We then adopted the human-organization-process-technology-fit (HOPT-fit) framework to identify their contributing and dominant factors, misfits, and mitigation measures.

RESULTS

We identified 28 unintended consequences of PhIS, their key contributing factors, and their interrelations with the systems. The primary causes of unintended consequences include system rigidity and complexity, unclear knowledge, understanding, skills, and purpose of using the system, use of hybrid paper and electronic documentation, unclear and confusing transitions, additions and duplication of tasks and roles in the workflow, and time pressure, causing cognitive overload and workarounds. Recommended mitigating mechanisms include human factor principles in system design, data quality improvement for PhIS in terms of effective use of workspace, training, PhIS master data management, and communication by standardizing workarounds.

CONCLUSION

Threats to information quality emerge in PhIS because of its poor design, a failure to coordinate its functions and clinical tasks, and pharmacists' lack of understanding of the system use. Therefore, safe system design, fostering awareness in maintaining the information quality of PhIS and cultivating its safe use in organizations is essential to ensure patient safety. The proposed evaluation approach facilitates the evaluator to identify complex socio-technical interactions and unintended consequences factors, impact, and mitigation mechanisms.

State of the evidence on simulation-based electronic health records training: A scoping review

This study synthesized the available evidence of simulation-based electronic health records (EHRs) training in educational and clinical environments for healthcare providers in the literature. The Arksey and O'Malley methodological framework was employed. A systematic search was carried out in relevant databases from inception to January 2020, identifying 24 studies for inclusion. Three themes emerged: (a) role of simulation-based EHR training in evaluating improvement interventions, (b) debriefing and feedback methods used, and (c) challenges of evaluating simulation-based EHR training. The majority of the studies aimed to emphasize the practical skills of individual medical trainees and employed post-simulation feedback as the feedback method. Future research should focus on (a) using simulation-based EHR training to achieve specific learning goals, (b) investigating aspects of clinical performance that are susceptible to skill decay, and (c) examining the influence of simulation-based EHR training on team dynamics.

Synthesizing Dimensions of Digital Maturity in Hospitals: Systematic Review

Background

Digital health in hospital settings is viewed as a panacea for achieving the “quadruple aim” of health care, yet the outcomes have been largely inconclusive. To optimize digital health outcomes, a strategic approach is necessary, requiring digital maturity assessments. However, current approaches to assessing digital maturity have been largely insufficient, with uncertainty surrounding the dimensions to assess.

Objective

The aim of this study was to identify the current dimensions used to assess the digital maturity of hospitals.

Methods

A systematic literature review was conducted of peer-reviewed literature (published before December 2020) investigating maturity models used to assess the digital maturity of hospitals. A total of 29 relevant articles were retrieved, representing 27 distinct maturity models. The articles were inductively analyzed, and the maturity model dimensions were extracted and consolidated into a maturity model framework.

Results

The consolidated maturity model framework consisted of 7 dimensions: strategy; information technology capability; interoperability; governance and management; patient-centered care; people, skills, and behavior; and data analytics. These 7 dimensions can be evaluated based on 24 respective indicators.

Conclusions

The maturity model framework developed for this study can be used to assess digital maturity and identify areas for improvement.

Unintended consequences of online consultations: a qualitative study in UK primary care

Background

Health services are increasingly using digital tools to deliver care, and online consultations are being widely adopted in primary care settings. The intended consequences of online consultations are to increase patient access to care and increase the efficiency of care.

Aim

To identify and understand the unintended consequences of online consultations in primary care.

Design and setting

Qualitative interview study in eight general practices using online consultation tools in South West and North West England between February 2019 and January 2020.

Method

Thematic analysis of semi-structured interviews with 19 patients and 18 general practice staff.

Results

Consequences of online consultations were identified that restricted patient access to care by making it difficult for some patients to communicate effectively with a GP and disadvantaging digitally-excluded patients. This stemmed from patient uncertainty about how their queries were dealt with, and whether practices used online consultations as their preferred method for patients to contact the practice. Consequences were identified that limited increases in practice efficiency by creating additional work, isolation, and dissatisfaction for some staff.

Conclusion

Unintended consequences often present operational challenges that are foreseeable and partly preventable. However, these challenges must be recognised and solutions resourced sufficiently. Not everyone may benefit and local decisions will need to be made about trade-offs. Process changes tailored to local circumstances are critical to making effective use of online consultation tools. Unintended consequences also present clinical challenges that result from asynchronous communication. Online consultation tools favour simple, well-formulated information exchange that leads to diffuse relationships and a more transactional style of medicine.

What Oncologists Want: Identifying Challenges and Preferences on Diagnosis Data Entry to Reduce EHR-Induced Burden and Improve Clinical Data Quality

PURPOSE

Accurate recording of diagnosis (DX) data in electronic health records (EHRs) is important for clinical practice and learning health care. Previous studies show statistically stable patterns of data entry in EHRs that contribute to inaccurate DX, likely because of a lack of data entry support. We conducted qualitative research to characterize the preferences of oncological care providers on cancer DX data entry in EHRs during clinical practice.

METHODS

We conducted semistructured interviews and focus groups to uncover common themes on DX data entry preferences and barriers to accurate DX recording. Then, we developed a survey questionnaire sent to a cohort of oncologists to verify the generalizability of our initial findings. We constrained our participants to a single specialty and institution to ensure similar clinical backgrounds and clinical experience with a single EHR system.

RESULTS

A total of 12 neuro-oncologists and thoracic oncologists were involved in the interviews and focus groups. The survey developed from these two initial thrusts was distributed to 19 participants yielding a 94.7% survey response rate. Clinicians reported similar user interface experiences, barriers, and dissatisfaction with current DX entry systems including repetitive entry operations, difficulty in finding specific DX options, time-consuming interactions, and the need for workarounds to maintain efficiency. The survey revealed inefficient DX search interfaces and challenging entry processes as core barriers.

CONCLUSION

Oncologists seem to be divided between specific DX data entry and time efficiency because of current interfaces and feel hindered by the burdensome and repetitive nature of EHR data entry. Oncologists' top concern for adopting data entry support interventions is ensuring that it provides significant time-saving benefits and increasing workflow efficiency. Future interventions should account for time efficiency, beyond ensuring data entry effectiveness.

Physician-Nurse Communication Surrounding Computerized Physician Order Entry Systems From Social and Technical Perspective: An Ethnographic Study

Although computerized physician order entry systems improve order transmission and patient safety, overdependence on these systems can impede users' communication. This ethnographic study explored physician-nurse communication surrounding computerized physician order entry systems using a sociotechnical framework. Fieldwork conducted in a tertiary teaching hospital comprised 89 hours of participant observation, and individual semistructured interviews were held with seven nurses and five physicians. In addition, documents and artifacts were collected. Three core themes emerged. First, computerized physician order entry quality-related issues undermined the work efficiency of physicians and nurses. Specifically, usability was error prone because of cognitive overload, and the system was unable to perform relevant traces and raise alerts, demonstrating poor interoperability. Second, social factors, including insufficient training, unclear responsibilities, and a lack of awareness concerning interdisciplinary communication, compounded communication problems. Last, environmental factors, including noncoterminous spaces and times and insufficient technical support, impeded the resolution of communication problems. Technical and social contextual factors relating to computerized physician order entry systems jointly affected physician-nurse communication. Cognitive issues and insufficient alerts impacted work efficiency the most and were compounded by contextual individual- and team-related factors and environmental factors. Therefore, improved functions of computerized physician order entry systems and interprofessional communication training are required to optimize technical and social aspects of physician-nurse communication.

Managing the tension between caring and charting: Labor and delivery nurses' experiences of the electronic health record

Over a decade following the nationwide push to implement electronic health records (EHRs), the focus has shifted to addressing the cognitive burden associated with their use. Most research and discourse about the EHR's impact on clinicians' cognitive work has focused on physicians rather than on nursing-specific issues. Labor and delivery nurses may encounter unique challenges when using EHRs because they also interact with an electronic fetal monitoring system, continuously managing and synthesizing both maternal and fetal data. This grounded theory study explored labor and delivery nurses' perceptions of the EHR's impact on their cognitive work. Data were individual interviews and participant observations with twenty-one nurses from two labor and delivery units in the western U.S. and were analyzed using dimensional analysis. Nurses managed the tension between caring and charting using various strategies to integrate the EHR into their dynamic, high-acuity, specialty practice environment while using EHRs that were not designed for perinatal patients. Use of the EHR and associated technologies disrupted nurses' ability to locate and synthesize information, maintain an overview of the patient's status, and connect with patients and families. Individual-, group-, and environmental-level factors facilitated or constrained nurses' integration of the EHR. These findings represent critical safety failures requiring comprehensive changes to EHR designs and better processes for responding to end-user experiences. More research is needed to develop EHRs that support the dynamic and relationship-based nature of nurses' work and to align with specialty practice environments.

Impact of Data Entry Interface Design on Cognitive Workload, Documentation Correctness, and Documentation Efficiency

Clinical documentation serves as the legal record of patient care and used to guide clinical decision making. Inadequately designed data entry user-interfaces may result in unintended consequences that negatively impact patient safety and outcomes because inaccurate information is used to guide clinical decision making. This study utilized an electronic simulated documentation interface (i.e., artificial electronic health record) combined with eye-tracking hardware to analyze documentation correctness, documentation efficiency, and cognitive workload of anesthesia providers (N = 20) generating documentation using different computer-assisted data entry types (drop-down box, radio button, check-box, and free text with autocomplete suggestions). Our study methodology incorporating eye-tracking with electronic health record user interfaces to assess documentation correctness, efficiency, and cognitive workload can be translated to other health care provider types.

Perceptual Gaps Between Clinicians and Technologists on Health Information Technology-Related Errors in Hospitals: Observational Study

BACKGROUND

Health information technology (HIT) has been widely adopted in hospital settings, contributing to improved patient safety. However, many types of medical errors attributable to information technology (IT) have negatively impacted patient safety. The continued occurrence of many errors is a reminder that HIT software testing and validation is not adequate in ensuring errorless software functioning within the health care organization.

OBJECTIVE

This pilot study aims to classify technology-related medical errors in a hospital setting using an expanded version of the sociotechnical framework to understand the significant differences in the perceptions of clinical and technology stakeholders regarding the potential causes of these errors. The paper also provides some recommendations to prevent future errors.

METHODS

Medical errors were collected from previous studies identified in leading health databases. From the main list, we selected errors that occurred in hospital settings. Semistructured interviews with 5 medical and 6 IT professionals were conducted to map the events on different dimensions of the expanded sociotechnical framework.

RESULTS

Of the 2319 identified publications, 36 were included in the review. Of the 67 errors collected, 12 occurred in hospital settings. The classification showed the "gulf" that exists between IT and medical professionals in their perspectives on the underlying causes of medical errors. IT experts consider technology as the source of most errors and suggest solutions that are mostly technical. However, clinicians assigned the source of errors within the people, process, and contextual dimensions. For example, for the error "Copied and pasted charting in the wrong window: Before, you could not easily get into someone else's chart accidentally...because you would have to pull the chart and open it," medical experts highlighted contextual issues, including the number of patients a health care provider sees in a short time frame, unfamiliarity with a new electronic medical record system, nurse transitions around the time of error, and confusion due to patients having the same name. They emphasized process controls, including failure modes, as a potential fix. Technology experts, in contrast, discussed the lack of notification, poor user interface, and lack of end-user training as critical factors for this error.

CONCLUSIONS

Knowledge of the dimensions of the sociotechnical framework and their interplay with other dimensions can guide the choice of ways to address medical errors. These findings lead us to conclude that designers need not only a high degree of HIT know-how but also a strong understanding of the medical processes and contextual factors. Although software development teams have historically included clinicians as business analysts or subject matter experts to bridge the gap, development teams will be better served by more immersive exposure to clinical environments, leading to better software design and implementation, and ultimately to enhanced patient safety.

Opportunities and Challenges Surrounding the Use of Data From Wearable Sensor Devices in Health Care: Qualitative Interview Study

BACKGROUND

Wearable sensors connected via networked devices have the potential to generate data that may help to automate processes of care, engage patients, and increase health care efficiency. The evidence of effectiveness of such technologies is, however, nascent and little is known about unintended consequences.

OBJECTIVE

Our objective was to explore the opportunities and challenges surrounding the use of data from wearable sensor devices in health care.

METHODS

We conducted a qualitative, theoretically informed, interview-based study to purposefully sample international experts in health care, technology, business, innovation, and social sciences, drawing on sociotechnical systems theory. We used in-depth interviews to capture perspectives on development, design, and use of data from wearable sensor devices in health care, and employed thematic analysis of interview transcripts with NVivo to facilitate coding.

RESULTS

We interviewed 16 experts. Although the use of data from wearable sensor devices in health and care has significant potential in improving patient engagement, there are a number of issues that stakeholders need to negotiate to realize these benefits. These issues include the current gap between data created and meaningful interpretation in health and care contexts, integration of data into health care professional decision making, negotiation of blurring lines between consumer and medical care, and pervasive monitoring of health across previously disconnected contexts.

CONCLUSIONS

Stakeholders need to actively negotiate existing challenges to realize the integration of data from wearable sensor devices into electronic health records. Viewing wearables as active parts of a connected digital health and care infrastructure, in which various business, personal, professional, and health system interests align, may help to achieve this.

Effects of interorganisational information technology networks on patient safety: a realist synthesis

OBJECTIVE

Health services in many countries are investing in interorganisational networks, linking patients' records held in different organisations across a city or region. The aim of the systematic review was to establish how, why and in what circumstances these networks improve patient safety, fail to do so, or increase safety risks, for people living at home.

DESIGN

Realist synthesis, drawing on both quantitative and qualitative evidence, and including consultation with stakeholders in nominal groups and semistructured interviews.

ELIGIBILITY CRITERIA

The coordination of services for older people living at home, and medicine reconciliation for older patients returning home from hospital.

INFORMATION SOURCES

17 sources including Medline, Embase, CINAHL, Cochrane Library, Web of Science, ACM Digital Library, and Applied Social Sciences Index and Abstracts.

OUTCOMES

Changes in patients' clinical risks.

RESULTS

We did not find any detailed accounts of the sequences of events that policymakers and others believe will lead from the deployment of interoperable networks to improved patient safety. We were, though, able to identify a substantial number of theory fragments, and these were used to develop programme theories.There is good evidence that there are problems with the coordination of services in general, and the reconciliation of medication lists in particular, and it indicates that most problems are social and organisational in nature. There is also good evidence that doctors and other professionals find interoperable networks difficult to use. There was limited high-quality evidence about safety-related outcomes associated with the deployment of interoperable networks.

CONCLUSIONS

Empirical evidence does not currently justify claims about the beneficial effects of interoperable networks on patient safety. There appears to be a mismatch between technology-driven assumptions about the effects of networks and the sociotechnical nature of coordination problems.

PROSPERO REGISTRATION NUMBER

CRD42017073004.

[Beyond benefit evaluation: Considering the unintended consequences of telehealth]

La télésanté est considérée comme un levier incontournable dans les choix des politiques en santé. Toutefois, il subsiste de nombreux enjeux face à son intégration réussie dans les pratiques cliniques. À ce jour, un grand nombre d’initiatives en télésanté peine à dépasser le stade de projet pilote. Cette situation s’explique en partie par une culture de l’innovation qui est principalement focalisée sur les bénéfices attendus de la technologie et moins sur les changements et les transformations qu’elle peut entraîner. La télésanté est utilisée dans des établissements de santé dont la dynamique sociale est pour le moins complexe. Son introduction entraîne des conséquences inattendues pouvant affecter aussi bien les patients, les communautés, les professionnels, les établissements que les systèmes de santé et la société dans son ensemble. L’objectif de cet article est de discuter de certaines des conséquences inattendues découlant de l’utilisation de la télésanté dans les établissements et systèmes de santé.

The effects of interoperable information technology networks on patient safety: a realist synthesis

Background

Interoperable networks connect information technology systems of different organisations, allowing professionals in one organisation to access patient data held in another one. Health policy-makers in many countries believe that they will improve the co-ordination of services and, hence, the quality of services and patient safety. To the best of our knowledge, there have not been any previous systematic reviews of the effects of these networks on patient safety.

Objectives

The aim of the study was to establish how, why and in what circumstances interoperable information technology networks improved patient safety, failed to do so or increased safety risks. The objectives of the study were to (1) identify programme theories and prioritise theories to review; (2) search systematically for evidence to test the theories; (3) undertake quality appraisal, and use included texts to support, refine or reject programme theories; (4) synthesise the findings; and (5) disseminate the findings to a range of audiences.

Design

Realist synthesis, including consultation with stakeholders in nominal groups and semistructured interviews.

Settings and participants

Following a stakeholder prioritisation process, several domains were reviewed: older people living at home requiring co-ordinated care, at-risk children living at home and medicines reconciliation services for any patients living at home. The effects of networks on services in health economies were also investigated.

Intervention

An interoperable network that linked at least two organisations, including a maximum of one hospital, in a city or region.

Outcomes

Increase, reduction or no change in patients’ risks, such as a change in the risk of taking an inappropriate medication.

Results

We did not find any detailed accounts of the ways in which interoperable networks are intended to work and improve patient safety. Theory fragments were identified and used to develop programme and mid-range theories. There is good evidence that there are problems with the co-ordination of services in each of the domains studied. The implicit hypothesis about interoperable networks is that they help to solve co-ordination problems, but evidence across the domains showed that professionals found interoperable networks difficult to use. There is insufficient evidence about the effectiveness of interoperable networks to allow us to establish how and why they affect patient safety.

Limitations

The lack of evidence about patient-specific measures of effectiveness meant that we were not able to determine ‘what works’, nor any variations in what works, when interoperable networks are deployed and used by health and social care professionals.

Conclusions

There is a dearth of evidence about the effects of interoperable networks on patient safety. It is not clear if the networks are associated with safer treatment and care, have no effects or increase clinical risks.

Future work

Possible future research includes primary studies of the effectiveness of interoperable networks, of economies of scope and scale and, more generally, on the value of information infrastructures.

Study registration

This study is registered as PROSPERO CRD42017073004.

Funding

This project was funded by the National Institute for Health Research (NIHR) Health Services and Delivery Research programme and will be published in full in Health Services and Delivery Research; Vol. 8, No. 40. See the NIHR Journals Library website for further project information.

Improving the informatics competency of critical care nurses: results of an interventional study in the southeast of Iran

BACKGROUND

Nursing informatics (NI) along with growth and development of health information technology (HIT) is becoming a fundamental part of all domains of nursing practice especially in critical care settings. Nurses are expected to equip with NI competency for providing patient-centered evidence-based care. Therefore, it is important and necessary to improve nurses' NI competency through educational programs for effective using of HIT. This study aimed to evaluate the impact of a training program on NI competency of critical care nurses.

METHODS

This interventional study was conducted in 2019. Stratified sampling technique was used to select 60 nurses working in critical care units of three hospitals affiliated with a large University of Medical Sciences in the southeast of Iran. These nurses were assigned randomly and equally to the control and intervention groups. NI competency was trained to the intervention group in a three-day workshop. Data were collected using demographic questionnaire and the adapted Nursing Informatics Competency Assessment Tool (NICAT) before and 1 month after the intervention. Rahman in the US (2015) developed and validated the original NICAT to assess self-reported NI competency of nurses with 30 items and three dimensions (Computer literacy, Informatics literacy Information management skills). The NICAT is scored on a five-point Likert scale and the overall score ranges from 30 to150. Two medical informatics specialists and eight nursing faculty members approved the validity of the adapted version of NICAT and its reliability was confirmed by Cronbach's alpha (95%).

RESULTS

All 60 participants completed the educational program and returned the completed questionnaire. Majority of participants in the intervention and control groups were female (83.30%), married nurses (70.90, 73.30%) aged 30-40 years (51.6, 35.5%). In the pretest stage, both intervention and control groups were competent in terms of the NI competency and its dimensions, and no significant difference was observed between them (p = 0.65). However, in the posttest, the NI competency and its dimensions in the intervention group significantly increased with a large effect size compared with the control group (p = 0.001). This difference showed that the intervention group was proficient in the posttest stage. The highest mean difference in the intervention group was associated with the informatics literacy dimension and the lowest mean difference was associated with the informatics management skills dimension.

CONCLUSIONS

The improved scores of NI competency and its dimensions after using the training program implied the effectiveness of this method in enhancing the NI competency of nurses working in the critical care units. The application of the training program in diverse domains of nursing practice shows its high efficiency. The project is fundamental for improving nurses' NI competency through continuous educational programs in Iran, other cultures and contexts.

Studying Workflow and Workarounds in Electronic Health Record-Supported Work to Improve Health System Performance

Clinical workflow is the enactment of a series of steps to perform a clinical activity. The transition from paper to electronic health records (EHRs) over the past decade has been characterized by profound challenges supporting clinical workflow, impeding frontline clinicians' ability to deliver safe, efficient, and effective care. In response, there has been substantial effort to study clinical workflow as well as workarounds-exceptions to routine workflow-in order to identify opportunities for improvement. This article describes predominant methods of studying workflow and workarounds and provides examples of the applications of these methods along with the resulting insights. Challenges to studying workflow and workarounds are described, and recommendations for how to approach such studies are given. Although there is not yet a set of standard approaches, this article helps advance workflow research that ultimately serves to inform how to coevolve the design of EHR systems and organizational decisions about processes, roles, and responsibilities in order to support clinical workflow that more consistently delivers on the potential benefits of a digitized health care system.

Electronic Health Records in Ophthalmology: Source and Method of Documentation

PURPOSE

This study analyzed and quantified the sources of electronic health record (EHR) text documentation in ophthalmology progress notes.

DESIGN

EHR documentation review and analysis.

METHODS

Setting: a single academic ophthalmology department.

STUDY POPULATION

a cohort study conducted between November 1, 2016, and December 31, 2018, using secondary EHR data and a follow-up manual review of a random samples. The cohort study included 123,274 progress notes documented by 42 attending providers. These notes were for patients with the 5 most common primary International Statistical Classification of Diseases and Related Health Problems, version 10, parent codes for each provider. For the manual review, 120 notes from 8 providers were randomly sampled. Main outcome measurements were characters or number of words in each note categorized by attribution source, author type, and time of creation.

RESULTS

Imported text entries made up the majority of text in new and return patients, 2,978 characters (77%) and 3,612 characters (91%). Support staff members authored substantial portions of notes; 3,024 characters (68%) of new patient notes, 3,953 characters (83%) of return patient notes. Finally, providers completed large amounts of documentation after clinical visits: 135 words (35%) of new patient notes, 102 words (27%) of return patient notes.

CONCLUSIONS

EHR documentation consists largely of imported text, is often authored by support staff, and is often written after the end of a visit. These findings raise questions about documentation accuracy and utility and may have implications for quality of care and patient-provider relationships.

Concept Analysis of Unintended Consequences

The concept of unintended consequences is widely discussed in the realms of politics or economics, but not as frequently as related to health care. Nursing professionals act with the intent to improve health outcomes for patients; however, with every action, there are risks and consequences that may or may not be anticipated. This article utilizes a modified version of Walker and Avant's framework for concept analysis (2011) to identify the characteristics, defining attributes, and antecedents of the concept of unintended consequences, present a model case and empirical referents, and provide a practical and theoretical application to nursing. Opportunities for future research related to the concept of unintended consequences include a closer study of nurses' choices that may affect their well-being or productivity, as well as educational opportunities to better inform nurses of the impact unintended consequences may have on them and the care they provide.

Effects of eHealth on hospital practice: synthesis of the current literature

Objective The transition to digital hospitals is fast-moving. Although US hospitals are further ahead than some others in implementing eHealth technologies, their early experiences are not necessarily generalisable to contemporary healthcare because both the systems and technologies have been rapidly evolving. It is important to provide up-to-date assessments of the evidence available. The aim of this paper is to provide an assessment of the current literature on the effects to be expected from hospital implementations of eHealth technologies. Methods A narrative review was conducted of systematic reviews investigating the effects of eHealth technologies (clinical decision support systems (CDSS), computerised provider order entry (CPOE), ePrescribing, electronic medical records (EMRs)) published between November 2015 and August 2017 and compared the findings with those of a previous narrative review that examined studies published between January 2010 and October 2015. The same search strategy and selection criteria were used in both studies. Results Of the seven relevant articles, three (42.9%) examined the effects of more than one eHealth system: only two (28.6%) studies were high quality, three (42.9%) were of intermediate quality and two (28.6%) were of low quality. We identified that EMRs are largely associated with conflicting findings. Previous reviews suggested that CPOE are associated with significant positive results of cost savings, organisational efficiency gains, less resource utilisation and improved individual performance. However, these effects were not investigated in the more recent reviews, and only mixed findings for communication between clinicians were reported. Similarly, for ePrescribing, later reviews reported limited evidence of benefits, although when coupled with CDSS, more consistent positive findings were reported. Conclusion This overview can help inform other hospitals in Australia and elsewhere of the likely effects resulting from eHealth technologies. The findings suggest that the effects of these systems are largely mixed, but there are positive findings, which encourage ongoing digital transformation of hospital practice. What is known about the topic? Governments are increasingly devoting substantial resources towards implementing eHealth technologies in hospital practice with the goals of improving clinical and financial outcomes. Yet, these outcomes are yet to be fully realised in practice and conflicting findings are often reported in the literature. What does this paper add? This paper extends a previous narrative review of systematic reviews and categorises the effects of eHealth technologies into a typology of outcomes to enable overall findings to be reported and comparisons to be made. In doings so, we synthesise 7 years of eHealth effects. Mixed results are largely reported for EMRs, with many benefits being compromised by practices stemming from resistance to EMRs. Limited evidence of effectiveness exists for CPOE and ePrescribing. CDSS are associated with the most consistent positive findings for clinician- and hospital-level effects. We observed renewed interest in the literature for the effect of eHealth technologies on communication both between clinicians and with patients. Other new insights have emerged relating to effects on clinical judgement, changing practice and staff retention. What are the implications for practitioners? eHealth technologies have the potential to positively affect clinical and financial outcomes. However, these benefits are not guaranteed, and mixed results are often reported. This highlights the need for hospitals and decision makers to clearly identify and act on the drivers of successful implementations if eHealth technologies are to facilitate the creation of new, more effective models of patient care in an increasingly complex healthcare environment.

Digitising an Australian university hospital: qualitative analysis of staff-reported impacts

Objective This study aims to assist hospitals contemplating digital transformation by assessing the reported qualitative effects of rapidly implementing an integrated eHealth system in a large Australian hospital and determining whether existing literature offers a reliable framework to assess the effects of digitisation. Methods A qualitative, single-site case study was performed using semistructured interviews supplemented by focus groups, observations and documentation. In all, 92 individuals across medical, nursing, allied health, administrative and executive roles provided insights into the eHealth system, which consisted of an electronic medical record, computerised decision support, computerised physician order entry, ePrescribing systems and wireless device integration. These results were compared against a known framework of the effects of hospital digitisation. Results Diverse, mostly positive, effects were reported, largely consistent with existing literature. Several new effects not reported in literature were reported, namely: (1) improvements in accountability for care, individual career development and time management; (2) mixed findings for the availability of real-time data; and (3) positive findings for the secondary use of data. Conclusions The overall positive perceptions of the effects of digitisation should give confidence to health services contemplating rapid digital transformation. Although existing literature provides a reliable framework for impact assessment, new effects are still emerging, and research and practice need to shift towards understanding how clinicians and hospitals can maximise the benefits of digital transformation. What is known about the topic? Hospitals outside the US are increasingly becoming engaged in eHealth transformations. Yet, the reported effects of these technologies are diverse and mixed with qualitative effects rarely reported. What does this paper add? This study provides a qualitative assessment of the effects of an eHealth transformation at a large Australian tertiary hospital. The results provide renewed confidence in the literature because the findings are largely consistent with expectations from prior systematic reviews of impacts. The qualitative approach followed also resulted in the identification of new effects, which included improvements in accountability, time management and individual development, as well as mixed results for real-time data. In addition, substantial improvements in patient outcomes and clinician productivity were reported from the secondary use of data within the eHealth systems. What are the implications for practitioners? The overall positive findings in this large case study should give confidence to other health services contemplating rapid digital transformation. To achieve substantial benefits, hospitals need to understand how they can best leverage the data within these systems to improve the quality and efficiency of patient care. As such, both research and practice need to shift towards understanding how these systems can be used more effectively.

Changes in Electronic Health Record Use Time and Documentation over the Course of a Decade

PURPOSE

With the current wide adoption of electronic health records (EHRs) by ophthalmologists, there are widespread concerns about the amount of time spent using the EHR. The goal of this study was to examine how the amount of time spent using EHRs as well as related documentation behaviors changed 1 decade after EHR adoption.

DESIGN

Single-center cohort study.

PARTICIPANTS

Six hundred eighty-five thousand three hundred sixty-one office visits with 70 ophthalmology providers.

METHODS

We calculated time spent using the EHR associated with each individual office visit using EHR audit logs and determined chart closure times and progress note length from secondary EHR data. We tracked and modeled how these metrics changed from 2006 to 2016 with linear mixed models.

MAIN OUTCOME MEASURES

Minutes spent using the EHR associated with an office visit, chart closure time in hours from the office visit check-in time, and progress note length in characters.

RESULTS

Median EHR time per office visit in 2006 was 4.2 minutes (interquartile range [IQR], 3.5 minutes), and increased to 6.4 minutes (IQR, 4.5 minutes) in 2016. Median chart closure time was 2.8 hours (IQR, 21.3 hours) in 2006 and decreased to 2.3 hours (IQR, 18.5 hours) in 2016. In 2006, median note length was 1530 characters (IQR, 1435 characters) and increased to 3838 characters (IQR, 2668.3 characters) in 2016. Linear mixed models found EHR time per office visit was 31.9±0.2% (P < 0.001) greater from 2014 through 2016 than from 2006 through 2010, chart closure time was 6.7±0.3 hours (P < 0.001) shorter from 2014 through 2016 versus 2006 through 2010, and note length was 1807.4±6.5 characters (P < 0.001) longer from 2014 through 2016 versus 2006 through 2010.

CONCLUSIONS

After 1 decade of use, providers spend more time using the EHR for an office visit, generate longer notes, and close the chart faster. These changes are likely to represent increased time and documentation pressure for providers. Electronic health record redesign and new documentation regulations may help to address these issues.

Some Multidimensional Unintended Consequences of Telehealth Utilization: A Multi-Project Evaluation Synthesis

Background: Telehealth initiatives have bloomed around the globe, but their integration and diffusion remain challenging because of the complex issues they raise. Available evidence around telehealth usually deals with its expected effects and benefits, but its unintended consequences (UCs) and influencing factors are little documented. This study aims to explore, describe and analyze multidimensional UCs that have been associated with the use of telehealth.

Methods: We performed a secondary analysis of the evaluations of 10 telehealth projects conducted over a 22-year period in the province of Quebec (Canada). All material was subjected to a qualitative thematic-pragmatic content analysis with triangulation of methodologies and data sources. We used the conceptual model of the UCs of health information technologies proposed by Bloomrosen et al to structure our analysis.

Results: Four major findings emerged from our analysis. First, telehealth utilization requires many adjustments, changes and negotiations often underestimated in the planning and initial phases of the projects. Second, telehealth may result in the emergence of new services corridors that disturb existing ones and involve several adjustments for organizations, such as additional investments and resources, but also the risk of fragmentation of services and the need to balance between standardization of practices and local innovation. Third, telehealth may accentuate power relations between stakeholders. Fourth, it may lead to significant changes in the responsibilities of each actor in the supply chain of services. Finally, current legislative and regulatory frameworks appear ill-adapted to many of the new realities brought by telehealth.

Conclusion: This study provides a first attempt for an overview of the UCs associated with the use of telehealth. Future research-evaluation studies should be more sensitive to the multidimensional and interdependent factors that influence telehealth implementation and utilization as well as its impacts, intended or unintended, at all levels. Thus, a consideration of potential UCs should inform telehealth projects, from their planning until their scaling-up.

Involving Citizen-Patients in the Development of Telehealth Services: Qualitative Study of Experts' and Citizen-Patients' Perspectives

Background

Decisions regarding telehealth services in Quebec (Canada) have been largely technocratic by nature for the last 15 years, and the involvement of citizen-patients in the development of telehealth services is virtually nonexistent. In view of the societal challenges that telehealth raises, citizen-patient involvement could ensure more balance between evidence from traditional research methodologies and technical experts and the needs and expectations of populations in decisions about telehealth services.

Objective

This study aimed to explore the perception of various stakeholders (decision makers, telehealth program and policy managers, clinicians, researchers, evaluators, and citizen-patients) regarding the involvement of citizen-patients in the development of telehealth services in Quebec. In particular, we explored its potential advantages, added value, obstacles, and challenges it raises for decision making.

Methods

We used a qualitative research approach based on semistructured individual interviews, with a total of 29 key actors. Respondents were identified by the contact network method. Interviews were recorded and transcribed verbatim. A pragmatic content thematic analysis was performed. To increase the capacity for interpretation and analysis, we were guided by the principle of data triangulation.

Results

Citizen-patient involvement in decision making is perceived more as a theoretical idea than as a practical reality in health care organizations or in the health system. There is very little connection between citizen involvement structures or patient and user groups and telehealth leaders. For the respondents, citizen-patient involvement in telehealth could increase the accountability and transparency of decision making and make it more pragmatic within an innovation-driven health system. This involvement could also make citizen-patients ambassadors and promoters of telehealth and improve the quality and organization of health services while ensuring they are more socially relevant. Challenges and constraints that were reported include the ambiguity of the citizen-patient, who should be involved and how, claimant citizen-patient, the risk of professionalization of citizen-patient involvement, and the gap between decision time versus time to involve the citizen-patient.

Conclusions

This study provides a basis for future research on the potential of involving citizen-patients in telehealth. There is a great need for research on the issue of citizen-patient involvement as an organizational innovation (in terms of decision-making model). Research on the organizational predisposition and preparation for such a change becomes central. More efforts to synthesize and translate knowledge on public participation in decision making in the health sector, particularly in the field of technology development, are needed.

Improving Patient-Provider Communication and Therapeutic Practice Through Better Integration of Electronic Health Records in the Exam Room: A Pilot Study

BACKGROUND

The rapid proliferation of electronic health records (EHRs) in clinics has had mixed impact on patient-centered communication, yet few evaluated interventions exist to train practicing providers in communication practices.

AIMS

We extended the evidence-based Physician Asthma Care Education (PACE) program with EHR-specific communication strategies, and tested whether training providers with the extended program (EHR-PACE) would improve provider and patient perceptions of provider communication skills and asthma outcomes of patients.

METHOD

A pilot randomized design was used to compare EHR-PACE with usual care. Participants were providers ( n = 18) and their adult patients with persistent asthma ( n = 126). Outcomes were assessed at baseline and 3- and 6-month postintervention, including patient perception of their provider's communication skills and provider confidence in using EHRs during clinical encounters.

RESULTS

Compared with the control group, providers who completed the EHR-PACE program reported significant improvements at 3-month follow-up in their confidence with asthma counseling practices (estimate 0.90, standard error [ SE] 0.4); p < .05) and EHR-specific communication practices (estimate 2.3, SE 0.8; p < .01), and at 6-month follow-up, a significant decrease in perception that the computer interferes with the patient-provider relationship (estimate -1.0, SE 0.3; p < .01). No significant changes were observed in patient asthma outcomes or their perception of their provider's communication skills.

DISCUSSION

Training providers with skills to accommodate EHR use in the exam room increases provider confidence and their perceived skills in maintaining patient-centered communications in the short term.

CONCLUSION

Evidence-supported training initiatives that can increase capacity of busy providers to manage increased computing demands shows promise. More research is needed to fully evaluate EHR-PACE on patients' health status and their perceptions of their provider's care through a large-scale trial.

Unintended Consequences: New Problems, New Solutions. Contributions From 2015

OBJECTIVE

To select the best of the 2015 published papers on unintended consequences of healthcare information technology (HIT).

METHOD

Literature searches in several areas of scholarship, including IT, human factors, evaluation studies, medical errors, medical informatics, and implementation science. Also, because the specific terms "unintended consequences" were not often included in abstracts and titles, a more nuanced search algorithm was developed.

RESULTS

We identified 754 papers that had some empirical research on unintended consequences of HIT. An initial screen of titles and abstracts reduced this to 171 papers of potential interest. We then further filtered out papers that did not meet the following criteria: 1) the paper had to report an original empirical investigation, and 2) the impact reported had to be not negligible, i.e., in quantitative studies, the results related to unintended consequences were statistically significant; and in qualitative studies the relevant themes emerged were prominent. This resulted in 33 papers of which 15 were selected as best paper candidates. Each of these 15 papers was then separately evaluated by four reviewers. The final selection of four papers was made jointly by the external reviewers and the two section editors.

CONCLUSIONS

There is a growing awareness of the importance of HIT's unintended consequences-be they generated by the HIT vendors, the implementation process, the consultants, the users, or most probably, some combination of the above. There has also been greater creativity in use of data sources, including secondary data (e.g., medical malpractice cases and surveys) and a wider acceptance of mixed methods to identify unintended consequences. Unfortunately, the complexity of causes mitigates the value of recommendations to avoid unwanted outcomes. Suggestions are often contentious rather than obvious, setting-specific, and not universally applicable. "Lessons learned" often take on generalized-and perhaps platitudinous-forms, such as: "plan extra time," "involve all of the stakeholders," "recognize the different needs of different units or disciplines." The greater awareness of these problems, and the increased desire to identify and eliminate them is clearly reflected in the area's growing literature. We are hopeful the topic will receive additional attention and the discipline will improve its ability to identify and address these unexpected and usually adverse outcomes.