A National Survey of EMR Usability: Comparisons between medical and nursing professions in the hospital and primary care sectors in Australia and Finland

Development and validation of an instrument to evaluate the perspective of using the electronic health record in a hospital setting

BACKGROUND

Evaluating healthcare information systems, such as the Electronic Health Records (EHR), is both challenging and essential, especially in resource-limited countries. This study aims to psychometrically develop and validate an instrument (questionnaire) to assess the factors influencing the successful adoption of the EHR system by healthcare professionals in Moroccan university hospitals.

METHODS

The questionnaire validation process occurred in two main stages. Initially, data collected from a pilot sample of 164 participants underwent analysis using exploratory factor analysis (EFA) to evaluate the validity and reliability of the retained factor structure. Subsequently, the validity of the overall measurement model was confirmed using confirmatory factor analysis (CFA) in a sample of 368 healthcare professionals.

RESULTS

The structure of the modified HOT-fit model, comprising seven constructs (System Quality, Information Quality, Information technology Service Quality, User Satisfaction, Organization, Environment, and Clinical Performance), was confirmed through confirmatory factor analysis. Absolute, incremental, and parsimonious fit indices all indicated an appropriate level of acceptability, affirming the robustness of the measurement model. Additionally, the instrument demonstrated adequate reliability and convergent validity, with composite reliability values ranging from 0.75 to 0.89 and average variance extracted (AVE) values ranging from 0.51 to 0.63. Furthermore, the square roots of AVE values exceeded the correlations between different pairs of constructs, and the heterotrait-monotrait ratio of correlations (HTMT) was below 0.85, confirming suitable discriminant validity.

CONCLUSIONS

The resulting instrument, due to its rigorous development and validation process, can serve as a reliable and valid tool for assessing the success of information technologies in similar contexts.

Medical and nursing clinician perspectives on the usability of the hospital electronic medical record: A qualitative analysis

BACKGROUND

Electronic medical records (EMRs) have been widely implemented in Australian hospitals. Their usability and design to support clinicians to effectively deliver and document care is essential, as is their impact on clinical workflow, safety and quality, communication, and collaboration across health systems. Perceptions of, and data about, usability of EMRs implemented in Australian hospitals are key to successful adoption.

OBJECTIVE

To explore perspectives of medical and nursing clinicians on EMR usability utilising free-text data collected in a survey.

METHOD

Qualitative analysis of one free-text optional question included in a web-based survey. Respondents included medical and nursing/midwifery professionals in Australian hospitals (85 doctors and 27 nurses), who commented on the usability of the main EMR used.

RESULTS

Themes identified related to the status of EMR implementation, system design, human factors, safety and risk, system response time, and stability, alerts, and supporting the collaboration between healthcare sectors. Positive factors included ability to view information from any location; ease of medication documentation; and capacity to access diagnostic test results. Usability concerns included lack of intuitiveness; complexity; difficulties communicating with primary and other care sectors; and time taken to perform clinical tasks.

CONCLUSION

If the benefits of EMRs are to be realised, there are good reasons to address the usability challenges identified by clinicians. Easy solutions that could improve the usability experience of hospital-based clinicians include resolving sign-on issues, use of templates, and more intelligent alerts and warnings to avoid errors.

IMPLICATIONS

These essential improvements to the usability of the EMR, which are the foundation of the digital health system, will enable hospital clinicians to deliver safer and more effective health care.

The Impact of Digital Hospitals on Patient and Clinician Experience: Systematic Review and Qualitative Evidence Synthesis

BACKGROUND

The digital transformation of health care is advancing rapidly. A well-accepted framework for health care improvement is the Quadruple Aim: improved clinician experience, improved patient experience, improved population health, and reduced health care costs. Hospitals are attempting to improve care by using digital technologies, but the effectiveness of these technologies is often only measured against cost and quality indicators, and less is known about the clinician and patient experience.

OBJECTIVE

This study aims to conduct a systematic review and qualitative evidence synthesis to assess the clinician and patient experience of digital hospitals.

METHODS

The PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) and ENTREQ (Enhancing the Transparency in Reporting the Synthesis of Qualitative Research) guidelines were followed. The PubMed, Embase, Scopus, CINAHL, and PsycINFO databases were searched from January 2010 to June 2022. Studies that explored multidisciplinary clinician or adult inpatient experiences of digital hospitals (with a full electronic medical record) were included. Study quality was assessed using the Mixed Methods Appraisal Tool. Data synthesis was performed narratively for quantitative studies. Qualitative evidence synthesis was performed via (1) automated machine learning text analytics using Leximancer (Leximancer Pty Ltd) and (2) researcher-led inductive synthesis to generate themes.

RESULTS

A total of 61 studies (n=39, 64% quantitative; n=15, 25% qualitative; and n=7, 11% mixed methods) were included. Most studies (55/61, 90%) investigated clinician experiences, whereas few (10/61, 16%) investigated patient experiences. The study populations ranged from 8 to 3610 clinicians, 11 to 34,425 patients, and 5 to 2836 hospitals. Quantitative outcomes indicated that clinicians had a positive overall satisfaction (17/24, 71% of the studies) with digital hospitals, and most studies (11/19, 58%) reported a positive sentiment toward usability. Data accessibility was reported positively, whereas adaptation, clinician-patient interaction, and workload burnout were reported negatively. The effects of digital hospitals on patient safety and clinicians' ability to deliver patient care were mixed. The qualitative evidence synthesis of clinician experience studies (18/61, 30%) generated 7 themes: inefficient digital documentation, inconsistent data quality, disruptions to conventional health care relationships, acceptance, safety versus risk, reliance on hybrid (digital and paper) workflows, and patient data privacy. There was weak evidence of a positive association between digital hospitals and patient satisfaction scores.

CONCLUSIONS

Clinicians' experience of digital hospitals appears positive according to high-level indicators (eg, overall satisfaction and data accessibility), but the qualitative evidence synthesis revealed substantive tensions. There is insufficient evidence to draw a definitive conclusion on the patient experience within digital hospitals, but indications appear positive or agnostic. Future research must prioritize equitable investigation and definition of the digital clinician and patient experience to achieve the Quadruple Aim of health care.

Effectiveness of Medication Reconciliation in a Chinese Hospital: A Pilot Randomized Controlled Trial

Background

Implementing medication reconciliation (MR) was complex and challenging because of the variability in the guidance provided for conducting. The processes of MR adopted in China were different from that recommended by the World Health Organization. A pilot study to inform the design of a future randomized controlled trial to determine the effectiveness of these two workflows was undertaken.

Methods

Patients taking at least one home/regular medication for hypertension, diabetes, or coronary heart disease were recruited at admission, and then were randomized using a computer-generated random number in a closed envelope. In the study group, the pharmacist reviewed electronic medical record systems before communication with patients. In the control group, pharmacists communicated with patients at patient's admission. The time investment of pharmacists for MR process, the number of unintended medication discrepancies, and physician acceptance were tested as outcome measures.

Results

One hundred and forty adult patients were randomized, of which 66 patients in the intervention received MR within 24 hours, while 58 patients in control received MR at some point during admission. The most common condition in the study group was hypertension (coronary heart disease in the control group). The workflow of the study group can save an average 7 minutes per patient compared with the WHO recommended process [17.5 minutes (IQR 14.00, 28.25) vs 24.5 minutes (IQR17.75, 35.25), p = 0.004]. The number of unintended discrepancies was 42 in the study group and 34 in the control group (p = 0.33). Physicians' acceptance in the study and control groups were 87.5% and 92.3%, respectively (p = 0.87).

Conclusion

The results suggest that changes in outcome measures were in the appropriate direction and that the time limit for implementing MR can be set within 48 hours. A future multi-centre RCT study to determine the effectiveness of MR is feasible and warranted.

National survey of user-reported usability of electronic medical record software in ophthalmology in Germany

PURPOSE

A nationwide, comparative survey of the physician-reported usability of electronic medical record (EMR) software used by ophthalmologists in Germany using the System Usability Scale (SUS) as a standardized metric.

METHODS

A cross-sectional survey of members of the German Ophthalmological Society (DOG) and professional association of ophthalmologists (BVA) was conducted in May 2022. All 7788 physician members of both societies were invited to participate in an anonymous online-survey by individualized links. User-reported usability of the participants main software used for electronic medical recordkeeping was assessed using the SUS (range 0-100).

RESULTS

A total of 881 participants with 51 different EMRs completed the entire questionnaire. Mean EMR-SUS score was 65.7 (SD ± 23.5). Significant differences in mean SUS of several EMR programs were observed with a range of 31.5 to 87.2 in programs with 10 or more responses. 31.8% of all main program SUS ratings were below 50 points. Female gender was associated with 4.02 higher SUS score (95% CI 0.46-7.59). Main program SUS was positively correlated with overall work-related satisfaction and work environment SUS but negatively correlated with the number of programs in the work environment. The SUS of the entire digital work environment including all programs used daily was closely correlated with the main EMR SUS, but not the number of programs used.

CONCLUSION

Our survey revealed a fragmented pattern of EMR use by ophthalmologists in Germany with many competing software products and widely diverging mean System Usability Scale scores. A considerable share of ophthalmologists report EMR usability below what is commonly considered acceptable.

Allied health professionals' experiences and lessons learned in response to a big bang electronic medical record implementation: A prospective observational study

INTRODUCTION

There is limited evidence describing the impact of electronic medical record (EMR) implementation on allied health professionals' acceptance, expectations, and work efficiencies. This study aims to: A) identify clinician expectations and factors that influence EMR acceptance; B) evaluate perceived usability, technology proficiency and satisfaction; and C) assess the impact of EMR big bang implementation on allied health workflows at three Australian tertiary hospitals.

METHODS

Repeated measures study pre and six-months post EMR implementation. User acceptance was evaluated with online surveys: Unified Theory of Acceptance and Use of Technology (pre), System Usability Scale and open-ended questions (post). A four-hour time-motion study evaluated changes in allied health inpatient workflows.

RESULTS

Surveys were completed by 224 allied health clinicians (47% response rate) pre, and 196 (41%) post-implementation. Pre-implementation, 96% of respondents felt using the EMR was a good idea and they would find it useful. Six-months post-implementation 88% liked interacting with the EMR. 64% found it easy to use and most didn't require technical support (78%). While 68% of participants felt very confident, 51% believed they were not using the EMR's full potential. Post-implementation half of participants agreed significant upskilling was required and that EMR workflows were not quick to learn. Live demonstrations were considered the most helpful activity prior to training; hands-on practice in the training environment and superuser support were invaluable preparing for and during go-live. Time-motion data (mean difference (MD) (95% CI)) indicated that following implementation participants spent 2.27% (-3.53, 8.09, p = 0.731) more time in clinical tasks. More time was spent performing clinical documentation (5.39% (1.98, 8.8), p = 0.002).

CONCLUSIONS

Many factors can impact allied health professional's adoption of a new EMR. Institution-wide, simultaneous big bang EMR implementation, with strong allied health leadership, can lead to positive benefits, particularly in user experience. Ongoing evaluation will drive future improvements.

Nurses’ Experiences After Implementation of an Organization-Wide Electronic Medical Record: Qualitative Descriptive Study

Background

Reports on the impact of electronic medical record (EMR) systems on clinicians are mixed. Currently, nurses’ experiences of adopting a large-scale, multisite EMR system have not been investigated. Nurses are the largest health care workforce; therefore, the impact of EMR implementation must be investigated and understood to ensure that patient care quality, changes to nurses’ work, and nurses themselves are not negatively impacted.

Objective

This study aims to explore Australian nurses’ postimplementation experiences of an organization-wide EMR system.

Methods

This qualitative descriptive study used focus group and individual interviews and an open-ended survey question to collect data between 12 and 18 months after the implementation of an EMR across 6 hospital sites of a large health care organization in Victoria, Australia. Data were collected between November 2020 and June 2021, coinciding with the COVID-19 pandemic. Analysis comprised complementary inductive and deductive approaches. Specifically, reflexive thematic analysis was followed by framework analysis by the coding of data as barriers or facilitators to nurses’ use of the EMR using the Theoretical Domains Framework.

Results

A total of 158 nurses participated in this study. The EMR implementation dramatically changed nurses’ work and how they viewed their profession, and nurses were still adapting to the EMR implementation 18 months after implementation. Reflexive thematic analysis led to the development of 2 themes: An unintentional divide captured nurses’ feelings of division related to how using the EMR affected nurses, patient care, and the broader nursing profession. This time, it’s personal detailed nurses’ beliefs about the EMR implementation leading to bigger changes to nurses as individuals and nursing as a profession than other changes that nurses have experienced within the health care organization. The most frequent barriers to EMR use by nurses were related to the Theoretical Domains Framework domain of environmental context and resources. Facilitators of EMR use were most often related to memory, attention, and decision processes. Most barriers and facilitators were related to motivation.

Conclusions

Nurses perceived EMR implementation to have a mixed impact on the provision of quality patient care and on their colleagues. Implementing technology in a health care setting was perceived as a complex endeavor that impacted nurses’ perceptions of their autonomy, ways of working, and professional roles. Potential negative consequences were related to nursing workforce retention and patient care delivery. Motivation was the main behavioral driver for nurses’ adoption of EMR systems and hence a key consideration for implementing interventions or organizational changes directed at nurses.

The Effect of the Electronic Health Record on Interprofessional Practice: A Systematic Review

BACKGROUND

Interprofessional practice and teamwork are critical components to patient care in a complex hospital environment. The implementation of electronic health records (EHRs) in the hospital environment has brought major change to clinical practice for clinicians which could impact interprofessional practice.

OBJECTIVES

The aim of the study is to identify, describe, and evaluate studies on the effect of an EHR or modification/enhancement to an EHR on interprofessional practice in a hospital setting.

METHODS

Seven databases were searched including PubMed, Scopus, Web of Science, CINAHL, Cochrane, EMBASE, and ACM Digital Library until November 2021. Subject heading and title/abstract searches were undertaken for three search concepts: "interprofessional" and "electronic health records" and "hospital, personnel." No date limits were applied. The search generated 5,400 publications and after duplicates were removed, 3,255 remained for title/abstract screening. Seventeen studies met the inclusion criteria and were included in this review. Risk of bias was quantified using the Quality Assessment Tool for Studies with Diverse Designs. A narrative synthesis of the findings was completed based on type of intervention and outcome measures which included: communication, coordination, collaboration, and teamwork.

RESULTS

The majority of publications were observational studies and of low research quality. Most studies reported on outcomes of communication and coordination, with few studies investigating collaboration or teamwork. Studies investigating the EHR demonstrated mostly negative or no effects on interprofessional practice (23/31 outcomes; 74%) in comparison to studies investigating EHR enhancements which showed more positive results (20/28 outcomes; 71%). Common concepts identified throughout the studies demonstrated mixed results: sharing of information, visibility of information, closed-loop feedback, decision support, and workflow disruption.

CONCLUSION

There were mixed effects of the EHR and EHR enhancements on all outcomes of interprofessional practice, however, EHR enhancements demonstrated more positive effects than the EHR alone. Few EHR studies investigated the effect on teamwork and collaboration.

Electronic medical record implementation in a large healthcare system from a leadership perspective

Background

Information on the use of change management models to guide electronic medical records (EMR) implementation is limited. This case study describes the leadership aspects of a large-scale EMR implementation using Kotter’s change management model.

Methods

This case study presents the experience in implementing a new EMR system from the leadership perspective at King Abdulaziz Medical City, a large tertiary care hospital in Riyadh, Kingdom of Saudi Arabia. We described the process of implementation and outlined the challenges and opportunities, throughout the journey from the pre-implementation to the post-implementation phases.

Results

We described the corresponding actions to the eight domains of Kotter’s change management model: creating a sense of urgency, building the guiding team, developing a change vision and strategy, understanding and buy-in, removing obstacles, creating short-term wins, building on the change and anchoring the changes in corporate culture.

Conclusions

The case study highlights that EMR implementation is not a pure information technology project but rather is a technical-based complex social adaptive project that requires a specific set of leadership competencies that are central to its success. It demonstrates that change management models might be useful for large-scale EMR implementation.