Optimizing the electronic health record: An inpatient sprint addresses provider burnout and improves electronic health record satisfaction

Artificial Intelligence-Generated Draft Replies to Patient Inbox Messages

Importance

The emergence and promise of generative artificial intelligence (AI) represent a turning point for health care. Rigorous evaluation of generative AI deployment in clinical practice is needed to inform strategic decision-making.

Objective

To evaluate the implementation of a large language model used to draft responses to patient messages in the electronic inbox.

Design, Setting, and Participants

A 5-week, prospective, single-group quality improvement study was conducted from July 10 through August 13, 2023, at a single academic medical center (Stanford Health Care). All attending physicians, advanced practice practitioners, clinic nurses, and clinical pharmacists from the Divisions of Primary Care and Gastroenterology and Hepatology were enrolled in the pilot.

Intervention

Draft replies to patient portal messages generated by a Health Insurance Portability and Accountability Act-compliant electronic health record-integrated large language model.

Main Outcomes and Measures

The primary outcome was AI-generated draft reply utilization as a percentage of total patient message replies. Secondary outcomes included changes in time measures and clinician experience as assessed by survey.

Results

A total of 197 clinicians were enrolled in the pilot; 35 clinicians who were prepilot beta users, out of office, or not tied to a specific ambulatory clinic were excluded, leaving 162 clinicians included in the analysis. The survey analysis cohort consisted of 73 participants (45.1%) who completed both the presurvey and postsurvey. In gastroenterology and hepatology, there were 58 physicians and APPs and 10 nurses. In primary care, there were 83 physicians and APPs, 4 nurses, and 8 clinical pharmacists. The mean AI-generated draft response utilization rate across clinicians was 20%. There was no change in reply action time, write time, or read time between the prepilot and pilot periods. There were statistically significant reductions in the 4-item physician task load score derivative (mean [SD], 61.31 [17.23] presurvey vs 47.26 [17.11] postsurvey; paired difference, -13.87; 95% CI, -17.38 to -9.50; P < .001) and work exhaustion scores (mean [SD], 1.95 [0.79] presurvey vs 1.62 [0.68] postsurvey; paired difference, -0.33; 95% CI, -0.50 to -0.17; P < .001).

Conclusions and Relevance

In this quality improvement study of an early implementation of generative AI, there was notable adoption, usability, and improvement in assessments of burden and burnout. There was no improvement in time. Further code-to-bedside testing is needed to guide future development and organizational strategy.

Sprint-inspired One-on-One Post-Go-Live Training Session (Mini-Sprint) Improves Provider Electronic Health Record Efficiency and Satisfaction

BACKGROUND

 Inefficient electronic health record (EHR) usage increases the documentation burden on physicians and other providers, which increases cognitive load and contributes to provider burnout. Studies show that EHR efficiency sessions, optimization sprints, reduce burnout using a resource-intense five-person team. We implemented sprint-inspired one-on-one post-go-live efficiency training sessions (mini-sprints) as a more economical training option directed at providers.

OBJECTIVES

 We evaluated a post-go-live mini-sprint intervention to assess provider satisfaction and efficiency.

METHODS

 NorthShore University HealthSystem implemented one-on-one provider-to-provider mini-sprint sessions to optimize provider workflow within the EHR platform. The physician informaticist completed a 9-point checklist of efficiency tips with physician trainees covering schedule organization, chart review, speed buttons, billing, note personalization/optimization, preference lists, quick actions, and quick tips. We collected postsession survey data assessing for net promoter score (NPS) and open-ended feedback. We conducted financial analysis of pre- and post-mini-sprint efficiency levels and financial data.

RESULTS

 Seventy-six sessions were conducted with 32 primary care physicians, 28 specialty physicians, and 16 nonphysician providers within primary care and other areas. Thirty-seven physicians completed the postsession survey. The average NPS for the completed mini-sprint sessions was 97. The proficiency score had a median of 6.12 (Interquartile range (IQR): 4.71-7.64) before training, and a median of 7.10 (IQR: 6.25-8.49) after training. Financial data analysis indicates that higher level billing codes were used at a greater frequency post-mini-sprint. The revenue increase 12 months post-mini-sprint was $213,234, leading to a return of $75,559.50 for 40 providers, or $1,888.98 per provider in a 12-month period.

CONCLUSION

 Our data show that mini-sprint sessions were effective in optimizing efficiency within the EHR platform. Financial analysis demonstrates that this type of training program is sustainable and pays for itself. There was high satisfaction with the mini-sprint training modality, and feedback indicated an interest in further mini-sprint training sessions for physicians and nonphysician staff.

Interventions to Reduce Electronic Health Record-Related Burnout: A Systematic Review

BACKGROUND

Electronic health records are a significant contributing factor in clinician burnout, which negatively impacts patient care.

OBJECTIVES

To identify and appraise published solutions that aim to reduce EHR-related burnout in clinicians.

METHODS

A literature search strategy was developed following the guidelines of the Preferred Reporting Items for Systematic Reviews and Meta-Analyses. Six databases were searched for articles published between January 1950 and March 2023. The inclusion criteria were peer-reviewed, full-text, English language articles that described interventions targeting EHR-related burnout in any type of clinician, with reported outcomes related to burnout, wellness, EHR satisfaction, or documentation workload. Studies describing interventions without an explicit focus on reducing burnout or enhancing EHR-related satisfaction were excluded.

RESULTS

We identified 44 articles describing interventions to reduce EHR-related burnout. These interventions included the use of scribes, EHR training, and EHR modifications. These interventions were generally well received by the clinicians and patients, with subjective improvements in documentation time and EHR satisfaction, although objective data were limited.

CONCLUSION

The findings of this review underscore the potential benefits of interventions to reduce EHR-related burnout as well as the need for further research with more robust study designs involving randomized trials, control groups, longer study durations, and validated, objective outcome measurements.

Assessing Usability and Ambulatory Clinical Staff Satisfaction with Two Electronic Health Records

BACKGROUND

A growing body of literature has linked usability limitations within electronic health records (EHRs) to adverse outcomes which may in turn affect EHR system transitions. NewYork-Presbyterian Hospital, Columbia University College of Physicians and Surgeons (CU), and Weill Cornell Medical College (WC) are a tripartite organization with large academic medical centers that initiated a phased transition of their EHRs to one system, EpicCare.

OBJECTIVES

This article characterizes usability perceptions stratified by provider roles by surveying WC ambulatory clinical staff already utilizing EpicCare and CU ambulatory clinical staff utilizing iterations of Allscripts before the implementation of EpicCare campus-wide.

METHODS

A customized 19-question electronic survey utilizing usability constructs based on the Health Information Technology Usability Evaluation Scale was anonymously administered prior to EHR transition. Responses were recorded with self-reported demographics.

RESULTS

A total of 1,666 CU and 1,065 WC staff with ambulatory self-identified work setting were chosen. Select demographic statistics between campus staff were generally similar with small differences in patterns of clinical and EHR experience. Results demonstrated significant differences in EHR usability perceptions among ambulatory staff based on role and EHR system. WC staff utilizing EpicCare accounted for more favorable usability metrics than CU across all constructs. Ordering providers (OPs) denoted less usability than non-OPs. The Perceived Usefulness and User Control constructs accounted for the largest differences in usability perceptions. The Cognitive Support and Situational Awareness construct was similarly low for both campuses. Prior EHR experience demonstrated limited associations.

CONCLUSION

Usability perceptions can be affected by role and EHR system. OPs consistently denoted less usability overall and were more affected by EHR system than non-OPs. While there was greater perceived usability for EpicCare to perform tasks related to care coordination, documentation, and error prevention, there were persistent shortcomings regarding tab navigation and cognitive burden reduction, which have implications on provider efficiency and wellness.

Electronic Health Record Maturity Matters! Texas Nurses Speak Out in Their Second Statewide Study

With the passage of the Health Information Technology for Economic and Clinical Health Act in 2009, Texas nurses were faced with the rapid uptake of technology driven by this legislation. Texas Nurses Association and Texas Organization for Nursing Leadership formed a partnership to collectively track the impact on practicing nurses. The Health IT Committee was commissioned to evaluate the changing health information technology environment and associated solutions. As such, a study in 2015, entitled "Statewide Study Assessing the Experiences of Nurses with their Electronic Health Records," was conducted. The follow-up study in 2020 was conducted to compare 2015 and 2020 findings to identify improvements made on nurses' satisfaction with EHRs and identify improvement opportunities. The study design was an exploratory descriptive comparative analysis with a cross-sectional survey from a random sample of Texas nurses for the two study periods of 2015 (n = 1177) and 2020 (n = 1117). The Clinical Information Systems Implementation Evaluation Scale and a demographic survey including the Meaningful Use Maturity-Sensitive Index were the measurement instruments. Results and key covariates are discussed along with recommendations for achieving more mature EHRs and more mature organizational culture and leadership.

Using event logs to observe interactions with electronic health records: an updated scoping review shows increasing use of vendor-derived measures

OBJECTIVE

The aim of this article is to compare the aims, measures, methods, limitations, and scope of studies that employ vendor-derived and investigator-derived measures of electronic health record (EHR) use, and to assess measure consistency across studies.

MATERIALS AND METHODS

We searched PubMed for articles published between July 2019 and December 2021 that employed measures of EHR use derived from EHR event logs. We coded the aims, measures, methods, limitations, and scope of each article and compared articles employing vendor-derived and investigator-derived measures.

RESULTS

One hundred and two articles met inclusion criteria; 40 employed vendor-derived measures, 61 employed investigator-derived measures, and 1 employed both. Studies employing vendor-derived measures were more likely than those employing investigator-derived measures to observe EHR use only in ambulatory settings (83% vs 48%, P = .002) and only by physicians or advanced practice providers (100% vs 54% of studies, P < .001). Studies employing vendor-derived measures were also more likely to measure durations of EHR use (P < .001 for 6 different activities), but definitions of measures such as time outside scheduled hours varied widely. Eight articles reported measure validation. The reported limitations of vendor-derived measures included measure transparency and availability for certain clinical settings and roles.

DISCUSSION

Vendor-derived measures are increasingly used to study EHR use, but only by certain clinical roles. Although poorly validated and variously defined, both vendor- and investigator-derived measures of EHR time are widely reported.

CONCLUSION

The number of studies using event logs to observe EHR use continues to grow, but with inconsistent measure definitions and significant differences between studies that employ vendor-derived and investigator-derived measures.

Electronic medical record-related burnout in healthcare providers: a scoping review of outcomes and interventions

OBJECTIVE

Healthcare provider (HCP) burnout is on the rise with electronic medical record (EMR) use being cited as a factor, particularly with the rise of the COVID-19 pandemic. Burnout in HCPs is associated with negative patient outcomes, and, therefore, it is crucial to understand and address each factor that affects HCP burnout. This study aims to (a) assess the relationship between EMR use and burnout and (b) explore interventions to reduce EMR-related burnout.

METHODS

We searched MEDLINE (Ovid), CINAHL and SCOPUS on 29 July 2021. We selected all studies in English from any publication year and country that discussed burnout in HCPs (physicians, nurse practitioners and registered nurses) related to EMR use. Studies must have reported a quantitative relationship to be included. Studies that implemented an intervention to address this burnout were also included. All titles and abstracts were screened by two reviewers, and all full-text articles were reviewed by two reviewers. Any conflicts were addressed with a third reviewer and resolved through discussion. Quality of evidence of all included articles was assessed using the Quality Rating Scheme for Studies and Other Evidence.

FINDINGS

The search identified 563 citations with 416 citations remaining after duplicate removal. A review of abstracts led to 59 studies available for full-text assessment, resulting in 25 studies included in the scoping review. Commonly identified associations between EMR-related burnout in HCPs included: message and alert load, time spent on EMRs, organisational support, EMR functionality and usability and general use of EMRs. Two articles employed team-based interventions to improve burnout symptoms without significant improvement in burnout scores.

CONCLUSIONS AND RELEVANCE

Current literature supports an association between EMR use and provider burnout. Very limited evidence exists for burnout-reducing interventions that address factors such as time spent on EMRs, organisational support or EMR design.

Stress and Burnout Related to Electronic Health Record Use among Healthcare Providers during the COVID-19 Pandemic in Saudi Arabia: A Preliminary National Randomized Survey

Healthcare providers' burnout may potentially have a negative impact on patient care. The use of the electronic health record (EHR) increases the burden for healthcare providers (HCPs), particularly during the coronavirus disease-2019 (COVID-19) pandemic. This study assessed the stress and burnout related to the use of EHRs and health information technology (HIT) tools among HCPs during COVID-19 in Saudi Arabia. We used a self-developed survey tool. It consisted of five sections; demographics and professional data, experience using EHR, effects of EHR use, use of EHR and technology tools during COVID-19, and health and wellbeing. The survey link was emailed to a random sample of HCPs registered with a national scientific regulatory body. Univariate, bivariate, and multivariate analyses were performed to measure the association between burnout and study variables. A total of 182 participants completed the survey. 50.5% of participants reported a presence of HIT-related stress, and 40.1% reported a presence of burnout. The variables independently associated with burnout were providing tertiary level of care, working with COVID-19 suspected cases, dissatisfaction with EHRs, and agreement with the statement that using EHRs added frustration to the workday. Further research that explores possible solutions is warranted to minimize burnout among HCPs, especially during infectious outbreaks.