Physicians' gender and their use of electronic health records: findings from a mixed-methods usability study

Assessing Primary Care Blood Pressure Documentation for Hypertension Management During the COVID-19 Pandemic by Patient and Provider Groups

Background

Primary care electronic medical record (EMR) data can be used to identify, manage, and screen hypertension cases. However, this approach relies on completeness and accessibility of documented blood pressure (BP) values. With the large switch to virtual care due to the COVID-19 pandemic, we assessed BP documentation in primary care EMRs during the pandemic, across patient and physician groups.

Methods

Hypertension-related visits were identified during the pre-pandemic (January 2017 to February 2020) and pandemic (March 2020 to December 2021) periods from a primary care EMR database in Ontario, Canada. Clustered logistic regression models were used to analyze the relationship of physician and patient characteristics with an outcome variable of documented BP. A chart review of 3200 hypertension visits without a BP recorded in structured data fields was conducted to determine if BP was recorded in progress notes.

Results

Pre-pandemic, 75.7% of hypertension-related visits (113,966 of 150,511) had a BP recorded in structured documentation, but this significantly decreased to 36.4% (26,660 of 73,239) during the pandemic (odds ratio [OR] = 0.18, 95% confidence interval [CI]: 0.18-0.19). For virtual visits, 14.3% (6357 of 44,572) had a documented BP, vs 74.0% (20,056 of 27,089) for in-person visits. Chart review found that 55.9% of hypertension visits had no associated BP in structured documentation, but did have a BP recorded in the progress note. Male providers, compared to female providers, were less likely to record BPs pre-pandemic (OR = 0.45, 95% CI: 0.32-0.63) and during the pandemic, for both virtual visits (OR = 0.48, 95% CI: 0.32-0.71) and in-person visits (OR = 0.46, 95% CI: 0.33-0.64).

Conclusions

BP documented in primary care EMRs declined during the pandemic, most likely due to high rates of virtual visits impacting hypertension detection and management.

National survey of user-reported usability of electronic medical record software in ophthalmology in Germany

PURPOSE

A nationwide, comparative survey of the physician-reported usability of electronic medical record (EMR) software used by ophthalmologists in Germany using the System Usability Scale (SUS) as a standardized metric.

METHODS

A cross-sectional survey of members of the German Ophthalmological Society (DOG) and professional association of ophthalmologists (BVA) was conducted in May 2022. All 7788 physician members of both societies were invited to participate in an anonymous online-survey by individualized links. User-reported usability of the participants main software used for electronic medical recordkeeping was assessed using the SUS (range 0-100).

RESULTS

A total of 881 participants with 51 different EMRs completed the entire questionnaire. Mean EMR-SUS score was 65.7 (SD ± 23.5). Significant differences in mean SUS of several EMR programs were observed with a range of 31.5 to 87.2 in programs with 10 or more responses. 31.8% of all main program SUS ratings were below 50 points. Female gender was associated with 4.02 higher SUS score (95% CI 0.46-7.59). Main program SUS was positively correlated with overall work-related satisfaction and work environment SUS but negatively correlated with the number of programs in the work environment. The SUS of the entire digital work environment including all programs used daily was closely correlated with the main EMR SUS, but not the number of programs used.

CONCLUSION

Our survey revealed a fragmented pattern of EMR use by ophthalmologists in Germany with many competing software products and widely diverging mean System Usability Scale scores. A considerable share of ophthalmologists report EMR usability below what is commonly considered acceptable.

A scoping review of emotions and related constructs in simulation-based education research articles

BACKGROUND

While acknowledgement of emotions' importance in simulation-based education is emerging, there are concerns regarding how education researchers understand the concept of emotions for them to deliberately incorporate emotionally charged scenarios into simulation-based education. This concern is highlighted especially in the context of medical education often lacking strong theoretical integration. To map out how current simulation-based education literature conceptualises emotion, we conducted a scoping review on how emotions and closely related constructs (e.g. stress, and emotional intelligence) are conceptualised in simulation-based education articles that feature medical students, residents, and fellows.

METHODS

The scoping review was based on articles published in the last decade identified through database searches (EMBASE and Medline) and hand-searched articles. Data extraction included the constructs featured in the articles, their definitions, instruments used, and the types of emotions captured. Only empirical articles were included (e.g. no review or opinion articles). Data were charted via descriptive analyses.

RESULTS

A total of 141 articles were reviewed. Stress was featured in 88 of the articles, while emotions and emotional intelligence were highlighted in 45 and 34 articles respectively. Conceptualisations of emotions lacked integration of theory. Measurements of emotions mostly relied on self-reports while stress was often measured via physiological and self-report measurements. Negative emotions such as anxiety were sometimes seen as interchangeable with the term stress. No inferences were made about specific emotions of participants from their emotional intelligence.

CONCLUSIONS

Our scoping review illustrates that learners in simulation-based education are most often anxious and fearful. However, this is partially due to medical education prioritising measuring negative emotions. Further theoretical integration when examining emotions and stress may help broaden the scope towards other kinds of emotions and better conceptualisations of their impact. We call for simulation education researchers to reflect on how they understand emotions, and whether their understanding may neglect any specific aspect of affective experiences their simulation participants may have.

Facilitators and Barriers to Interacting With Clinical Decision Support in the ICU: A Mixed-Methods Approach

OBJECTIVES

Clinical decision support systems (CDSSs) are used in various aspects of healthcare to improve clinical decision-making, including in the ICU. However, there is growing evidence that CDSS are not used to their full potential, often resulting in alert fatigue which has been associated with patient harm. Clinicians in the ICU may be more vulnerable to desensitization of alerts than clinicians in less urgent parts of the hospital. We evaluated facilitators and barriers to appropriate CDSS interaction and provide methods to improve currently available CDSS in the ICU.

DESIGN

Sequential explanatory mixed-methods study design, using the BEhavior and Acceptance fRamework.

SETTING

International survey study.

PATIENT/SUBJECTS

Clinicians (pharmacists, physicians) identified via survey, with recent experience with clinical decision support.

INTERVENTIONS

An initial survey was developed to evaluate clinician perspectives on their interactions with CDSS. A subsequent in-depth interview was developed to further evaluate clinician (pharmacist, physician) beliefs and behaviors about CDSS. These interviews were then qualitatively analyzed to determine themes of facilitators and barriers with CDSS interactions.

MEASUREMENTS AND MAIN RESULTS

A total of 48 respondents completed the initial survey (estimated response rate 15.5%). The majority believed that responding to CDSS alerts was part of their job (75%) but felt they experienced alert fatigue (56.5%). In the qualitative analysis, a total of five facilitators (patient safety, ease of response, specificity, prioritization, and feedback) and four barriers (excess quantity, work environment, difficulty in response, and irrelevance) were identified from the in-depth interviews.

CONCLUSIONS

In this mixed-methods survey, we identified areas that institutions should focus on to improve appropriate clinician interactions with CDSS, specific to the ICU. Tailoring of CDSS to the ICU may lead to improvement in CDSS and subsequent improved patient safety outcomes.

Assessing the efficient use of the lightwave health information management system for health service delivery in Ghana

BACKGROUND

In achieving the WHO's Universal Health Coverage and the Global Developmental Agenda: Sustainable Development Goal 3 and 9, the Ministry of Health launched a nationwide deployment of the lightwave health information management system (LHIMS) in the Central Region to facilitate health service delivery. This paper assessed the efficient use of the LHIMS among health professionals in the Central Region.

METHODS

A non-interventional descriptive cross-sectional study design was employed for this research. The study used stratified and simple random sampling for selecting 1126 study respondents from 10 health facilities that use the LHIMS. The respondents included prescribers, nurses, midwives and auxiliary staff. Descriptive statistics (weighted mean) was computed to determine the average weighted score for all the indicators under efficiency. Also, bivariate (χ2) and multivariate (ordinal logistic regression) analyses were conducted to test the study's hypotheses.

RESULTS

Findings revealed that the LHIMS enhanced efficient health service delivery. From the bivariate analysis, external factors; sex, educational qualification, work experience, profession type and computer literacy were associated with the efficient use of the LHIMS. However, training offered prior to the use of the LHIMS, and the duration of training had no association. At the multivariate level, only work experience and computer literacy significantly influenced the efficient use of the LHIMS.

CONCLUSION

The implementation of LHIMS has the potential to significantly improve health service delivery. General computing skills should be offered to system users by the Ministry of Health to improve literacy in the use of computers. Active participation in the use of LHIMS by all relevant healthcare professionals should be encouraged.

Interviews with HIV Experts for Development of a Mobile Health Application in HIV Care-A Qualitative Study

The Communication and Tracing App HIV (COMTRAC-HIV) project aims to develop a mobile health application for integrated care of HIV patients due to the low availability of those apps in Germany. This study addressed organizational conditions and necessary app functionalities, especially for the care of late diagnosed individuals (late presenters) and those using pre-exposure prophylaxis. We followed a human-centered design approach and interviewed HIV experts in Germany to describe the context of use of the app. The interviews were paraphrased and analyzed with a qualitative content analysis. To define the context of use, user group profiles were defined and tasks derived, which will represent the functionalities of the app. A total of eight experts were included in the study. The results show that the app should include a symptom diary for entering symptoms, side effects, and their intensity. It offers chat/video call functionality for communication with an HIV expert, appointment organization, and sharing findings. The app should also provide medication overview and reminders for medications and appointments. This qualitative study is a first step towards the development of an app for HIV individuals in Germany. Further research includes involving patients in the initial app design and test design usability.

The Application of Dental Fluoride Varnish in Children: A Low Cost, High-Value Implementation Aided by Passive Clinical Decision Support

BACKGROUND

Fluoride is vital in the prevention of dental caries in children. In 2014, the U.S. Preventive Services Task Force deemed fluoride varnish a recommended preventive service (grade B). Electronic health record-based clinical decision support (CDS) tools have shown variable ability to alter physicians' ordering behaviors.

OBJECTIVES

This study aimed to increase the application of fluoride varnish in children while analyzing the effect of two passive CDS tools-an order set and a note template.

METHODS

Data on outpatient pediatric visits over an 18-month period before and after CDS implementation (October 15, 2020-April 15, 2022) were queried, while trends in application rate of fluoride were examined. We constructed a multiple logistic regression model with a primary outcome of whether a patient received fluoride at his/her visit. The primary predictor was a "phase" variable representing the CDS implemented. Physician interaction with CDS as well as the financial effects of the resulting service use were also examined.

RESULTS

There were 3,049 well-child visits of children aged 12 months to 5 years. The addition of a fluoride order to a "Well Child Check" order set led to a 10.6% increase in ordering over physician education alone (25.4 vs. 14.8%, p = 0.001), while the insertion of fluoride-specific text to drop-down lists in clinical notes led to a 6.2% increase (31.5 vs. 25.4%, p = 0.005). Whether a patient received topical fluoride was positively associated with order set implementation (odds ratio [OR] = 5.87, 95% confidence interval [CI]: 4.20-8.21) and fluoride-specific drop-down lists (OR = 7.81, 95% CI: 5.41-11.28). Female providers were more likely to use order sets when ordering fluoride (56.2 vs. 40.9% for males, p ≤ 0.0001). Added revenue totaled $15,084.

CONCLUSION

The targeted use of order sets and note templates was positively associated with the ordering of topical fluoride by physicians.

Production and Provision of Context-Based Patient-Specific Educational Resources

BACKGROUND

Patient education is generally accompanied by instructive materials. The Korean government has recommended the provision of patient-specific educational materials (PEMs) via an electronic medical record (EMR) certification system. However, there are currently no clear standards or guidelines for including PEMs in current domestic educational materials. We investigated the benefits of integrating PEMs with the EMR certification system and the methods by which this integration can be achieved.

METHODS

We developed and administered three structured Delphi surveys to 26 healthcare providers in clinical settings based on data collected from separate semi-structured advisory interviews with five experts. The surveys included the following topics: 1) expected effects of patient-specific education and health-related notifications/alarms, 2) desirable methods for providing PEMs, and 3) appropriate fee-setting and government support. We distributed the Delphi surveys via e-mail and calculated the average and standard deviation of the survey responses.

RESULTS

PEMs are expected to have significant educational effects, such as the provision of surgery/intervention-related information, and will improve the understanding of various treatment processes/procedures. The preferred method for providing PEMs was via automatic request after receiving confirmation from healthcare providers. The provision of these materials was based on set fees and government support. The average fee per session was set at approximately USD 23 (as of October 2021, USD 1 = KRW 1,196).

CONCLUSION

In this study, we investigated the prerequisites, contents, methods, and fees related to the provision of effective and efficient PEMs. The study findings can facilitate the production and provision of PEMs.

Design, Development, and Evaluation of the Blood Collection Management Workstation

Purpose

To design and develop a blood collection management workstation with high usability to reduce the risk of preanalytical errors and improve patient safety.

Methods

A five-phase mobile application development lifecycle model (MADLC) and experience-based co-design (EBCD) were used for design and development. Subsequently, the blood collection management workstation was evaluated using the Chinese System Usability Scale (SUS) in a general ward setting from January to June 2021.

Results

It was used on 2593 in-patients who underwent phlebotomy with 12,378 tubes being labeled. The rate of errors and meantime for blood sampling were decreased compared with the same period in the previous year. A total of 14 nurses agreed to participate in the evaluation, and the overall raw SUS score was 69.26 ± 10.39, which indicated above average results.

Conclusion

The blood collection management workstation has shown the potential to decrease errors and improve working efficiency in a clinical setting. The study also identified some weaknesses, which will be amended in the future.

Patient Safety Issues From Information Overload in Electronic Medical Records

BACKGROUND AND OBJECTIVE

Electronic health records (EHRs) have become ubiquitous in medicine and continue to grow in informational content. Little has been documented regarding patient safety from the resultant information overload. The objective of this literature review is to better understand how information overload in EHR affects patient safety.

METHODS

A literature search was performed using the Transparent Reporting of Systematic Reviews and Meta-Analyses standards for literature review. PubMed and Web of Science were searched and articles selected that were relevant to EHR information overload based on keywords.

RESULTS

The literature search yielded 28 articles meeting the criteria for the study. Information overload was found to increase physician cognitive load and error rates in clinical simulations. Overabundance of clinically irrelevant information, poor data display, and excessive alerting were consistently identified as issues that may lead to information overload.

CONCLUSIONS

Information overload in EHRs may result in higher error rates and negatively impact patient safety. Further studies are necessary to define the role of EHR in adverse patient safety events and to determine methods to mitigate these errors. Changes focused on the usability of EHR should be considered with the end user (physician) in mind. Federal agencies have a role to play in encouraging faster adoption of improved EHR interfaces.

Perceived Value of the Electronic Health Record and Its Association with Physician Burnout

BACKGROUND

There is a common belief that seniority and gender are associated with clinicians' perceptions of the value of electronic health record (EHR) technology and the propensity for burnout. Insufficient evidence exists on the relationship between these variables.

OBJECTIVE

The aim of this study was to investigate how seniority/years of practice, gender, and screened burnout status are associated with opinions of EHR use on quality, cost, and efficiency of care.

METHODS

We surveyed ambulatory primary care and subspecialty clinicians at three different institutions to screen for burnout status and to measure their opinions (positive, none, negative, don't know) on how EHR technology has impacted three important attributes of health care: quality, cost, and efficiency of care. We used chi-square tests to analyze association between years of practice (≤10 years or 11+ years), gender, and screened burnout status and the reported attributes. We used a Bonferroni-corrected α = 0.0167 for significance to protect against type I error among multiple comparisons.

RESULTS

Overall, 281 clinicians responded from 640 that were surveyed with 44% overall response rate. There were no significant associations of years in practice (≤10 years or 11+ years) or gender (p > 0.0167 for both) with any of the health care attributes. Clinicians who screened burnout negative (n = 154, 55%) were more likely to indicate that EHR technology has a positive impact on both the quality (p = 0.0025) and efficiency (p = 0.0003) health care attributes compared with those who screened burnout positive (n = 127, 45%).

CONCLUSION

Burnout status is significantly associated with clinicians' perceived value of EHR technologies, while years of practice and gender are not. This contests the popular notion that junior clinicians view EHR technology more favorably than their more senior counterparts. Hence, burnout status may be an important factor associated with the overall value clinicians ascribe to EHR technologies.

Time difference in retrieving clinical information in Patient-overview Prostate Cancer compared to electronic health records

BACKGROUND

Patients with advanced prostate cancer (PCa) typically undergo numerous lines of treatment leading to large amounts of information in Electronic Health Records (EHRs). The Patient-overview Prostate Cancer (PPC) presents clinical information in a graphical overview. The aim of this study was to measure time spent on retrieving clinical information in PPC compared to EHRs, to assess if retrieved data was correct and to explore usability of PPC.

MATERIAL AND METHODS

Oncologists, urologists and nurses in three hospitals in Sweden were timed when filling out questionnaires about patients using PPC and two different EHRs; Melior and COSMIC. Time and number of errors were analysed using linear mixed models (LMMs). Usability of PPC was measured with the System Usability Scale.

RESULTS

The LMM showed a significantly shorter time to retrieve information in PPC compared to EHRs. The estimated time to complete one questionnaire was 8 minutes (95% CI = 6-10, p < 0.001) in PPC compared to 25 minutes in Melior and 21 minutes in COSMIC. Compared to PPC, the estimated time difference was 17 minutes longer in Melior (95% CI = 14-20, p < 0.001) and 13 minutes longer in COSMIC (95% CI = 10-17, p < 0.001). The LMM showed significantly fewer errors in PPC compared to Melior. No significant difference in the number of errors was found between PPC and COSMIC. The usability of PPC was rated as excellent by oncologists, urologists and nurses.

CONCLUSION

A graphical overview of a patient's medical history, as in PPC, gives health staff rapid access to relevant information with a high degree of usability.

Evaluation of Physicians' Electronic Health Records Experience Using Actual and Perceived Measures

BACKGROUND

Inadequate electronic health record (EHR) interface design hinders the physician-EHR experience, which may lead to increase physician frustration and fatigue levels.

OBJECTIVES

The objective of this study was to examine the physician EHR experience by evaluating the congruency between actual and perceived measures among physicians with different EHR expertise and utilization levels.

METHODS

We conducted a cross-sectional EHR usability study of intensive care unit (ICU) physicians at a major Southeastern medical center. We used eye-tracking glasses to measure provider EHR-related fatigue and three surveys to measure the perceived EHR experience.

RESULTS

Of the 25 ICU physicians, 11 were residents, nine were fellows, and five were attending physicians. No significant differences were found between actual fatigue levels and their perceived EHR usability (p=0.159), workload (p=0.753), and satisfaction (p=0.773).

CONCLUSION

We found that there was low congruency between physicians' EHR-related fatigue and the perceived ratings for usability, satisfaction, and workload, which suggests using actual and perceived measures for a comprehensive assessment of the user experience. EHR-related fatigue may not be instantly felt by some physicians, hence the similar rating of perceived EHR experience among physicians.

Which Electronic Health Record System Should We Use? A Systematic Review

The UK government had intended to introduce a comprehensive Electronic Health Record (EHR) system in England by 2020. These EHRs would run across primary, secondary, and social care, linking data in a single digital platform. The objectives of this systematic review were to identify studies that compare EHR in terms of direct comparison between systems and to evaluate them using System and Software Quality Requirements and Evaluation (SQuaRE) ISO/IEC 25010. A systematic review was performed by searching Embase and Ovid MEDLINE databases between 1974 and April 2021. All original studies that appraised EHR systems and their providers were included. The main outcome measures were EHR system comparison and the eight characteristics of SQuaRE: functional suitability, performance efficiency, compatibility, usability, reliability, security, maintainability, and portability. A total of 724 studies were identified using the search criteria. After a review of titles and abstracts, this was filtered down to 40 studies as per the exclusion and inclusion criteria set out in our study. Seven studies compared more than one EHR. The following number of studies looked at the various aspects of the SQuaRE, respectively - 19 studies: functional suitability, performance efficiency: 18 studies, compatibility: 12 studies, usability: 25 studies, reliability: 6 studies, security: 2 studies, maintainability: 16 studies, portability: 13 studies. Epic was the most studied EHR system and one of the most implemented systems in the US market and one of the top ten in the UK. It is difficult to assess which is the most advantageous EHR system when they are assessed by SQuaRE's 8 characteristics for software evaluation.

Association Between Proficiency and Efficiency in Electronic Health Records Among Pediatricians at a Major Academic Health System

Objective: The purpose of this study was to evaluate the variations in electronic health record (EHR) activity among General and Specialty pediatricians by investigating the time spent and documentation length, normalized for workload.

Materials and Methods: We conducted a cross-sectional study of pediatric physicians using Epic EHR at a major Southeastern academic healthcare system. We collected user-level EHR activity data of 104 pediatric physicians over 91 days from April 1 to June 30, 2020.

Results: Of the 104 pediatrics physicians, 56 (54%) were General pediatricians and 48 (46%) were Specialists pediatricians. General pediatricians spent an average of 17.6 min [interquartile range (IQR): 12.9–37] using the EHR per appointment, while Specialists spent 35.7 min (IQR: 28–48.4) per appointment.

Significant negative associations were found between proficiency scores and the amount of time spent in the system for Generalists (p < 0.001). On the contrary, significant positive associations were found between proficiency scores and the amount of time spent in the system for Specialists (p < 0.01).

Conclusions: We report an association between EHR proficiency and efficiency levels among pediatricians within the same healthcare system, receiving the same EHR training, and using the same EHR system. The profound differences in EHR activity suggest that higher priority should be given to redesigning EHR training methods to accommodate the learning needs of physicians.

A Gender-Based Analysis of Predictors and Sequelae of Burnout Amongst Practicing American Vascular Surgeons

OBJECTIVE

Surgeons report higher burnout and suicidal ideation (SI) rates than the general population. This study sought to identify the prevalence and gender-specific risk factors for burnout and SI among men and women vascular surgeons to guide future interventions.

METHODS

In 2018, active Society for Vascular Surgery (SVS) members were surveyed confidentially using the Maslach Burnout Index embedded in a questionnaire that captured demographic and practice-related characteristics. Results were stratified by gender. Univariate and multivariate logistic regression models were developed to identify predictors for the end points of burnout and SI.

RESULTS

Overall survey response rate was 34.3% (N=878) of practicing vascular surgeons. A higher percentage of women responded (19%) than compose SVS membership (13.7%). Women respondents were significantly younger, with fewer years in practice, and were less likely to be in private practice than the men who responded. Women were also less likely to be married/partnered, or to have children. The prevalence of burnout was similar for women and men (42.3% and 40.9% [NS]); however, the prevalence of SI was significantly higher in women (12.9% vs 6.6%; P < .007). Whereas there was no difference in mean hours worked or call taken, women were more likely to have had a recent conflict between work and home responsibilities and to have resolved this conflict in favor of work. Although men and women had the same incidence of reported recent medical errors, women were less likely to self-report a recent malpractice suit or to think that a fair resolution was reached. There was no gender difference in reported work-related pain. Multivariable analysis revealed that not enough family time and work-related pain were predictors for burnout in both men and women. Additional factors were associated with burnout in men, such as malpractice and EMR dissatisfaction. Multivariable analysis revealed that work-related pain was an independent predictor for SI for the entire cohort.

CONCLUSION

The prevalence of burnout among vascular surgeons is high. Women vascular surgeons have double the rates of SI compared to male vascular surgeons. Taken together, this study demonstrated that many of the same factors are associated with burnout in women and men, which include not enough family time, conflict between work and personal life, and work-related pain. Additional factors in men included conflict between work and family, work-related pain, and EMR dissatisfaction.

The relationship between health IT characteristics and organizational variables among German healthcare workers

Health information technologies (HITs) are widely employed in healthcare and are supposed to improve quality of care and patient safety. However, so far, their implementation has shown mixed results, which might be explainable by understudied psychological factors of human-HIT interaction. Therefore, the present study investigates the association between the perception of HIT characteristics and psychological and organizational variables among 445 healthcare workers via a cross-sectional online survey in Germany. The proposed hypotheses were tested using structural equation modeling. The results showed that good HIT usability was associated with lower levels of techno-overload and lower IT-related strain. In turn, experiencing techno-overload and IT-related strain was associated with lower job satisfaction. An effective error management culture at the workplace was linked to higher job satisfaction and a slightly lower frequency of self-reported medical errors. About 69% of surveyed healthcare workers reported making errors less frequently than their colleagues, suggesting a bias in either the perception or reporting of errors. In conclusion, the study's findings indicate that ensuring high perceived usability when implementing HITs is crucial to avoiding frustration among healthcare workers and keeping them satisfied. Additionally healthcare facilities should invest in error management programs since error management culture is linked to other important organizational variables.

Physicians' electronic inbox work patterns and factors associated with high inbox work duration

OBJECTIVES

Electronic health record systems are increasingly used to send messages to physicians, but research on physicians' inbox use patterns is limited. This study's aims were to (1) quantify the time primary care physicians (PCPs) spend managing inboxes; (2) describe daily patterns of inbox use; (3) investigate which types of messages consume the most time; and (4) identify factors associated with inbox work duration.

MATERIALS AND METHODS

We analyzed 1 month of electronic inbox data for 1275 PCPs in a large medical group and linked these data with physicians' demographic data.

RESULTS

PCPs spent an average of 52 minutes on inbox management on workdays, including 19 minutes (37%) outside work hours. Temporal patterns of electronic inbox use differed from other EHR functions such as charting. Patient-initiated messages (28%) and results (29%) accounted for the most inbox work time. PCPs with higher inbox work duration were more likely to be female (P < .001), have more patient encounters (P < .001), have older patients (P < .001), spend proportionally more time on patient messages (P < .001), and spend more time per message (P < .001). Compared with PCPs with the lowest duration of time on inbox work, PCPs with the highest duration had more message views per workday (200 vs 109; P < .001) and spent more time on the inbox outside work hours (30 minutes vs 9.7 minutes; P < .001).

CONCLUSIONS

Electronic inbox work by PCPs requires roughly an hour per workday, much of which occurs outside scheduled work hours. Interventions to assist PCPs in handling patient-initiated messages and results may help alleviate inbox workload.

Physician experiences of screen-level features in a prominent electronic health record: Design recommendations from a qualitative study

The goal of this qualitative study was to assess physicians' perceptions around features of key screens within a prominent commercial EHR, and to solicit end-user recommendations for improved retrieval of high-priority clinical information. We conducted a qualitative, descriptive study of 25 physicians in a medical ICU setting. at a tertiary academic medical center. An in-depth, semi-structured interview guide was developed to elicit physician perceptions on information retrieval as well as favorable and unfavorable features of specific EHR screens. Transcripts were independently coded in a qualitative software management tool by at least two trained coders using a common code book. We successfully obtained vendor permission to map physicians perception's on full Epic© screenshots. Among the 25 physician participants (13 female; 5 attending physicians, 9 fellows, 11 residents), the majority of participants reported experiencing challenges finding clinical information in the EHR. We present the most favorable and unfavorable screen-level features for four central EHR screens: Flowsheet, Notes/Chart Review, Results Review, and Vital Signs. We also compiled participants' recommendations for a comprehensive EHR dashboard screen to better support clinical workflow and information retrieval in the medical ICU through User-Centered Design. ICU physicians demonstrated a mix of positive and negative attitudes toward specific screen-level features in a major vendor-based EHR system. Physician perceptions of information overload emerged as a theme across multiple EHR screens. Our findings underscore the importance of qualitative research and end-user feedback in EHR software design and interface optimization at both the vendor and institutional level.

A Scoping Review of Health Information Technology in Clinician Burnout

BACKGROUND

Clinician burnout is a prevalent issue in healthcare, with detrimental implications in healthcare quality and medical costs due to errors. The inefficient use of health information technologies (HIT) is attributed to having a role in burnout.

OBJECTIVE

This paper seeks to review the literature with the following two goals: (1) characterize and extract HIT trends in burnout studies over time, and (2) examine the evidence and synthesize themes of HIT's roles in burnout studies.

METHODS

A scoping literature review was performed by following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines with two rounds of searches in PubMed, IEEE Xplore, ACM, and Google Scholar. The retrieved papers and their references were screened for eligibility by using developed inclusion and exclusion criteria. Data were extracted from included papers and summarized either statistically or qualitatively to demonstrate patterns.

RESULTS

After narrowing down the initial 945 papers, 36 papers were included. All papers were published between 2013 and 2020; nearly half of them focused on primary care (n = 16; 44.4%). The most commonly studied variable was electronic health record (EHR) practices (e.g., number of clicks). The most common study population was physicians. HIT played multiple roles in burnout studies: it can contribute to burnout; it can be used to measure burnout; or it can intervene and mitigate burnout levels.

CONCLUSION

This scoping review presents trends in HIT-centered burnout studies and synthesizes three roles for HIT in contributing to, measuring, and mitigating burnout. Four recommendations were generated accordingly for future burnout studies: (1) validate and standardize HIT burnout measures; (2) focus on EHR-based solutions to mitigate clinician burnout; (3) expand burnout studies to other specialties and types of healthcare providers, and (4) utilize mobile and tracking technology to study time efficiency.

The Importance of Incorporating Human Factors in the Design and Implementation of Artificial Intelligence for Skin Cancer Diagnosis in the Real World

Artificial intelligence (AI) algorithms have been shown to diagnose skin lesions with impressive accuracy in experimental settings. The majority of the literature to date has compared AI and dermatologists as opponents in skin cancer diagnosis. However, in the real-world clinical setting, the clinician will work in collaboration with AI. Existing evidence regarding the integration of such AI diagnostic tools into clinical practice is limited. Human factors, such as cognitive style, personality, experience, preferences, and attitudes may influence clinicians' use of AI. In this review, we consider these human factors and the potential cognitive errors, biases, and unintended consequences that could arise when using an AI skin cancer diagnostic tool in the real world. Integrating this knowledge in the design and implementation of AI technology will assist in ensuring that the end product can be used effectively. Dermatologist leadership in the development of these tools will further improve their clinical relevance and safety.

Perceived Electronic Health Record Usability as a Predictor of Task Load and Burnout Among US Physicians: Mediation Analysis

BACKGROUND

Electronic health record (EHR) usability and physician task load both contribute to physician professional burnout. The association between perceived EHR usability and workload has not previously been studied at a national level. Better understanding these interactions could give further information as to the drivers of extraneous task load.

OBJECTIVE

This study aimed to determine the relationship between physician-perceived EHR usability and workload by specialty and evaluate for associations with professional burnout.

METHODS

A secondary analysis of a cross-sectional survey of US physicians from all specialties was conducted from October 2017 to March 2018. Among the 1250 physicians invited to respond to the subsurvey analyzed here, 848 (67.8%) completed it. EHR usability was assessed with the System Usability Scale (SUS; range: 0-100). Provider task load (PTL) was assessed using the mental demand, physical demand, temporal demand, and effort required subscales of the National Aeronautics and Space Administration Task Load Index (range: 0-400). Burnout was measured using the Maslach Burnout Inventory.

RESULTS

The mean scores were 46.1 (SD 22.1) for SUS and 262.5 (SD 71.7) for PTL. On multivariable analysis adjusting for age, gender, relationship status, medical specialty, practice setting, hours worked per week, and number of nights on call per week, physician-rated EHR usability was associated with PTL, with each 1-point increase in SUS score (indicating more favorable) associated with a 0.57-point decrease in PTL score (P<.001). On mediation analysis, higher SUS score was associated with lower PTL score, which was associated with lower odds of burnout.

CONCLUSIONS

A strong association was observed between EHR usability and workload among US physicians, with more favorable usability associated with less workload. Both outcomes were associated with the odds of burnout, with task load acting as a mediator between EHR usability and burnout. Improving EHR usability while decreasing task load has the potential to allow practicing physicians more working memory for medical decision making and patient communication.

Clinical Decision Support and Implications for the Clinician Burnout Crisis

OBJECTIVES

This survey aimed to review aspects of clinical decision support (CDS) that contribute to burnout and identify key themes for improving the acceptability of CDS to clinicians, with the goal of decreasing said burnout.

METHODS

We performed a survey of relevant articles from 2018-2019 addressing CDS and aspects of clinician burnout from PubMed and Web of Science™. Themes were manually extracted from publications that met inclusion criteria.

RESULTS

Eighty-nine articles met inclusion criteria, including 12 review articles. Review articles were either prescriptive, describing how CDS should work, or analytic, describing how current CDS tools are deployed. The non-review articles largely demonstrated poor relevance and acceptability of current tools, and few studies showed benefits in terms of efficiency or patient outcomes from implemented CDS. Encouragingly, multiple studies highlighted steps that succeeded in improving both acceptability and relevance of CDS.

CONCLUSIONS

CDS can contribute to clinician frustration and burnout. Using the techniques of improving relevance, soliciting feedback, customization, measurement of outcomes and metrics, and iteration, the effects of CDS on burnout can be ameliorated.

The Influence of Electronic Health Record Use on Physician Burnout: Cross-Sectional Survey

Background

Physician burnout has a direct impact on the delivery of high-quality health care, with health information technology tools such as electronic health records (EHRs) adding to the burden of practice inefficiencies.

Objective

The aim of this study was to determine the extent of burnout among physicians and learners (residents and fellows); identify significant EHR-related contributors of physician burnout; and explore the differences between physicians and learners with regard to EHR-related factors such as time spent in EHR, documentation styles, proficiency, training, and perceived usefulness. In addition, the study aimed to address gaps in the EHR-related burnout research methodologies by determining physicians’ patterns of EHR use through usage logs.

Methods

This study used a cross-sectional survey methodology and a review of administrative data for back-end log measures of survey respondents’ EHR use, which was conducted at a large Canadian academic mental health hospital. Chi-square and Fisher exact tests were used to examine the association of EHR-related factors with general physician burnout. The survey was sent out to 474 individuals between May and June 2019, including physicians (n=407), residents (n=53), and fellows (n=14), and we measured physician burnout and perceptions of EHR stressors (along with demographic and practice characteristics).

Results

Our survey included 208 respondents, including physicians (n=176) and learners (n=32). The response rate was 43.2% for physicians (full-time: 156/208, 75.0%; part-time: 20/199, 10.1%), and 48% (32/67) for learners. A total of 25.6% (45/176) of practicing physicians and 19% (6/32) of learners reported having one or more symptoms of burnout, and 74.5% (155/208) of all respondents who reported burnout symptoms identified the EHR as a contributor. Lower satisfaction and higher frustration with the EHRs were significantly associated with perceptions of EHR contributing toward burnout. Physicians’ and learners’ experiences with the EHR, gathered through open-ended survey responses, identified challenges around the intuitiveness and usability of the technology as well as workflow issues. Metrics gathered from back-end usage logs demonstrated a 13.6-min overestimation in time spent on EHRs per patient and a 5.63-hour overestimation of after-hours EHR time, when compared with self-reported survey data.

Conclusions

This study suggests that the use of EHRs is a perceived contributor to physician burnout. There should be a focus on combating physician burnout by reducing the unnecessary administrative burdens of EHRs through efficient implementation of systems and effective postimplementation strategies.

Understanding the Association Between Electronic Health Record Satisfaction and the Well-Being of Nurses: Survey Study

Background

Intensive care unit (ICU) nurses experience high levels of burnout related to the high-stress environment. Management of electronic health records (EHR) is a contributing factor to physician burnout. However, limited research has established the relationship between the nurse’s well-being and EHR use.

Objective

The objective of this study was to examine the association between EHR use and the well-being of nurses.

Methods

We surveyed registered nurses employed at a major Southeastern medical center in the United States about their demographics, experience with EHRs, satisfaction with EHRs, and elements of well-being. The correlation between subgroup demographics and survey questions was examined using Kendall and Fisher tests.

Results

A total of 113 ICU registered nurses responded to the survey, of which 93 (82.3%) were females. The population had a mean age of 35.18 years (SD 10.65). A significant association was found between satisfaction and well-being scores, where higher EHR satisfaction was associated with higher self-reported well-being (correlation 0.35, P<.001). Nurses who were unhappy with the time spent in EHR use compared with direct patient care reported higher levels of stress (P<.001) and isolation (P=.009). Older nurses reported higher dissatisfaction with the amount of time spent on EHR tasks related to direct patient care compared to younger nurses (P<.001).

Conclusions

Although nurses reported acceptable satisfaction scores with EHR use, deeper analysis suggests that EHR indirectly affects the well-being of nurses. These findings strongly indicate that lower EHR satisfaction can impact the well-being of nurses. More research is needed to optimize the nurse-EHR experience through more user-centered design approaches.

Association of Electronic Health Record Use With Physician Fatigue and Efficiency

IMPORTANCE

The use of electronic health records (EHRs) is directly associated with physician burnout. An underlying factor associated with burnout may be EHR-related fatigue owing to insufficient user-centered interface design and suboptimal usability.

OBJECTIVE

To examine the association between EHR use and fatigue, as measured by pupillometry, and efficiency, as measured by mouse clicks, time, and number of EHR screens, among intensive care unit (ICU) physicians completing a simulation activity in a prominent EHR.

DESIGN, SETTING, AND PARTICIPANTS

A cross-sectional, simulation-based EHR usability assessment of a leading EHR system was conducted from March 20 to April 5, 2018, among 25 ICU physicians and physician trainees at a southeastern US academic medical center. Participants completed 4 simulation patient cases in the EHR that involved information retrieval and task execution while wearing eye-tracking glasses. Fatigue was quantified through continuous eye pupil data; EHR efficiency was characterized through task completion time, mouse clicks, and EHR screen visits. Data were analyzed from June 1, 2018, to August 31, 2019.

MAIN OUTCOMES AND MEASURES

Primary outcomes were physician fatigue, measured by pupillometry (with lower scores indicating greater fatigue), and EHR efficiency, measured by task completion times, number of mouse clicks, and number of screens visited during EHR simulation.

RESULTS

The 25 ICU physicians (13 women; mean [SD] age, 32.1 [6.1] years) who completed a simulation exercise involving 4 patient cases (mean [SD] completion time, 34:43 [11:41] minutes) recorded a total of 14 hours and 27 minutes of EHR activity. All physician participants experienced physiological fatigue at least once during the exercise, and 20 of 25 participants (80%) experienced physiological fatigue within the first 22 minutes of EHR use. Physicians who experienced EHR-related fatigue in 1 patient case were less efficient in the subsequent patient case, as demonstrated by longer task completion times (r = -0.521; P = .007), higher numbers of mouse clicks (r = -0.562; P = .003), and more EHR screen visits (r = -0.486; P = .01).

CONCLUSIONS AND RELEVANCE

This study reports high rates of fatigue among ICU physicians during short periods of EHR simulation, which were negatively associated with EHR efficiency and included a carryover association across patient cases. More research is needed to investigate the underlying causes of EHR-associated fatigue, to support user-centered EHR design, and to inform safe EHR use policies and guidelines.