Virtual Scribes and Physician Time Spent on Electronic Health Records

Importance

Time on the electronic health record (EHR) is associated with burnout among physicians. Newer virtual scribe models, which enable support from either a real-time or asynchronous scribe, have the potential to reduce the burden of the EHR and EHR-related documentation.

Objective

To characterize the association of use of virtual scribes with changes in physicians' EHR time and note and order composition and to identify the physician, scribe, and scribe response factors associated with changes in EHR time upon virtual scribe use.

Design, Setting, and Participants

Retrospective, pre-post quality improvement study of 144 physicians across specialties who had used a scribe for at least 3 months from January 2020 to September 2022, were affiliated with Brigham and Women's Hospital and Massachusetts General Hospital, and cared for patients in the outpatient setting. Data were analyzed from November 2022 to January 2024.

Exposure

Use of either a real-time or asynchronous virtual scribe.

Main Outcomes

Total EHR time, time on notes, and pajama time (5:30 pm to 7:00 am on weekdays and nonscheduled weekends and holidays), all per appointment; proportion of the note written by the physician and team contribution to orders.

Results

The main study sample included 144 unique physicians who had used a virtual scribe for at least 3 months in 152 unique scribe participation episodes (134 [88.2%] had used an asynchronous scribe service). Nearly two-thirds of the physicians (91 physicians [63.2%]) were female and more than half (86 physicians [59.7%]) were in primary care specialties. Use of a virtual scribe was associated with significant decreases in total EHR time per appointment (mean [SD] of 5.6 [16.4] minutes; P < .001) in the 3 months after vs the 3 months prior to scribe use. Scribe use was also associated with significant decreases in note time per appointment and pajama time per appointment (mean [SD] of 1.3 [3.3] minutes; P < .001 and 1.1 [4.0] minutes; P = .004). In a multivariable linear regression model, the following factors were associated with significant decreases in total EHR time per appointment with a scribe use at 3 months: practicing in a medical specialty (-7.8; 95% CI, -13.4 to -2.2 minutes), greater baseline EHR time per appointment (-0.3; 95% CI, -0.4 to -0.2 minutes per additional minute of baseline EHR time), and decrease in the percentage of the note contributed by the physician (-9.1; 95% CI, -17.3 to -0.8 minutes for every percentage point decrease).

Conclusions and Relevance

In 2 academic medical centers, use of virtual scribes was associated with significant decreases in total EHR time, time spent on notes, and pajama time, all per appointment. Virtual scribes may be particularly effective among medical specialists and those physicians with greater baseline EHR time.

Quantifying EHR and Policy Factors Associated with the Gender Productivity Gap in Ambulatory, General Internal Medicine

BACKGROUND

The gender gap in physician compensation has persisted for decades. Little is known about how differences in use of the electronic health record (EHR) may contribute.

OBJECTIVE

To characterize how time on clinical activities, time on the EHR, and clinical productivity vary by physician gender and to identify factors associated with physician productivity.

DESIGN, SETTING, AND PARTICIPANTS

This longitudinal study included general internal medicine physicians employed by a large ambulatory practice network in the Northeastern United States from August 2018 to June 2021.

MAIN MEASURES

Monthly data on physician work relative value units (wRVUs), physician and practice characteristics, metrics of EHR use and note content, and temporal trend variables.

KEY RESULTS

The analysis included 3227 physician-months of data for 108 physicians (44% women). Compared with men physicians, women physicians generated 23.8% fewer wRVUs per month, completed 22.1% fewer visits per month, spent 4.0 more minutes/visit and 8.72 more minutes on the EHR per hour worked (all p < 0.001), and typed or dictated 36.4% more note characters per note (p = 0.006). With multivariable adjustment for physician age, practice characteristics, EHR use, and temporal trends, physician gender was no longer associated with productivity (men 4.20 vs. women 3.88 wRVUs/hour, p = 0.31). Typing/dictating fewer characters per note, relying on greater teamwork to manage orders, and spending less time on documentation were associated with higher wRVUs/hour. The 2021 E/M code change was associated with higher wRVUs/hour for all physicians: 10% higher for men physicians and 18% higher for women physicians (p < 0.001 and p = 0.009, respectively).

CONCLUSIONS

Increased team support, briefer documentation, and the 2021 E/M code change were associated with higher physician productivity. The E/M code change may have preferentially benefited women physicians by incentivizing time-intensive activities such as medical decision-making, preventive care discussion, and patient counseling that women physicians have historically spent more time performing.

Formative evaluation of an emergency department clinical decision support system for agitation symptoms: a study protocol

INTRODUCTION

The burden of mental health-related visits to emergency departments (EDs) is growing, and agitation episodes are prevalent with such visits. Best practice guidance from experts recommends early assessment of at-risk populations and pre-emptive intervention using de-escalation techniques to prevent agitation. Time pressure, fluctuating work demands, and other systems-related factors pose challenges to efficient decision-making and adoption of best practice recommendations during an unfolding behavioural crisis. As such, we propose to design, develop and evaluate a computerised clinical decision support (CDS) system, Early Detection and Treatment to Reduce Events with Agitation Tool (ED-TREAT). We aim to identify patients at risk of agitation and guide ED clinicians through appropriate risk assessment and timely interventions to prevent agitation with a goal of minimising restraint use and improving patient experience and outcomes.

METHODS AND ANALYSIS

This study describes the formative evaluation of the health record embedded CDS tool. Under aim 1, the study will collect qualitative data to design and develop ED-TREAT using a contextual design approach and an iterative user-centred design process. Participants will include potential CDS users, that is, ED physicians, nurses, technicians, as well as patients with lived experience of restraint use for behavioural crisis management during an ED visit. We will use purposive sampling to ensure the full spectrum of perspectives until we reach thematic saturation. Next, under aim 2, the study will conduct a pilot, randomised controlled trial of ED-TREAT at two adult ED sites in a regional health system in the Northeast USA to evaluate the feasibility, fidelity and bedside acceptability of ED-TREAT. We aim to recruit a total of at least 26 eligible subjects under the pilot trial.

ETHICS AND DISSEMINATION

Ethical approval by the Yale University Human Investigation Committee was obtained in 2021 (HIC# 2000030893 and 2000030906). All participants will provide informed verbal consent prior to being enrolled in the study. Results will be disseminated through publications in open-access, peer-reviewed journals, via scientific presentations or through direct email notifications.

TRIAL REGISTRATION NUMBER

NCT04959279; Pre-results.

Why Do Physicians Depart Their Practice? A Qualitative Study of Attrition in a Multispecialty Ambulatory Practice Network

BACKGROUND

Physician departure causes considerable disruption for patients, colleagues, and staff. The cost of finding a new physician to replace the loss coupled with lost productivity as they build their practice can cost as much as $1 million per departure. Therefore, we sought to characterize drivers of departure from practice with the goal of informing retention efforts (with a special emphasis on the connection between electronic health record (EHR)-related stress and physician departure).

METHODS

This qualitative study of semistructured interviews was conducted between October 2021 and April 2022 among 13 attending physicians who had voluntarily departed their position from 2018 to 2021 in a large multispecialty, productivity-based, ambulatory practice network in the Northeast with a 5% annual turnover rate to understand their reasons for departing practice.

RESULTS

Among the 13 participants, 8 were women (61.5%), 3 retired (23.1%), and 6 (46.2%) left for new positions. Major domains surrounding the decision to depart included current features of the health care delivery landscape, leadership/local practice culture, and personal considerations. Major factors within these domains included the EHR, compensation model, emphasis on metrics, leadership support, teamwork/staffing, burnout, and work-life integration.

CONCLUSIONS

Opportunities for medical practices to prevent ambulatory physicians' turnover include: (1) addressing workflow by distributing responsibility across team members to better address patient expectations and documentation requirements, (2) ensuring adequate staffing across disciplines and roles, and (3) considering alternative care or payment models.

Structure and Funding of Clinical Informatics Fellowships: A National Survey of Program Directors

BACKGROUND

In 2011, the American Board of Medical Specialties established clinical informatics (CI) as a subspecialty in medicine, jointly administered by the American Board of Pathology and the American Board of Preventive Medicine. Subsequently, many institutions created CI fellowship training programs to meet the growing need for informaticists. Although many programs share similar features, there is considerable variation in program funding and administrative structures.

OBJECTIVES

The aim of our study was to characterize CI fellowship program features, including governance structures, funding sources, and expenses.

METHODS

We created a cross-sectional online REDCap survey with 44 items requesting information on program administration, fellows, administrative support, funding sources, and expenses. We surveyed program directors of programs accredited by the Accreditation Council for Graduate Medical Education between 2014 and 2021.

RESULTS

We invited 54 program directors, of which 41 (76%) completed the survey. The average administrative support received was $27,732/year. Most programs (85.4%) were accredited to have two or more fellows per year. Programs were administratively housed under six departments: Internal Medicine (17; 41.5%), Pediatrics (7; 17.1%), Pathology (6; 14.6%), Family Medicine (6; 14.6%), Emergency Medicine (4; 9.8%), and Anesthesiology (1; 2.4%). Funding sources for CI fellowship program directors included: hospital or health systems (28.3%), clinical departments (28.3%), graduate medical education office (13.2%), biomedical informatics department (9.4%), hospital information technology (9.4%), research and grants (7.5%), and other sources (3.8%) that included philanthropy and external entities.

CONCLUSION

CI fellowships have been established in leading academic and community health care systems across the country. Due to their unique training requirements, these programs require significant resources for education, administration, and recruitment. There continues to be considerable heterogeneity in funding models between programs. Our survey findings reinforce the need for reformed federal funding models for informatics practice and training.

CT With CTA Versus MRI in Patients Presenting to the Emergency Department With Dizziness: Analysis Using Propensity Score Matching

BACKGROUND. CT with CTA is widely used to exclude stroke in patients with dizziness, although MRI has higher sensitivity. OBJECTIVE. The purpose of this article was to compare patients presenting to the emergency department (ED) with dizziness who undergo CT with CTA alone versus those who undergo MRI in terms of stroke-related management and outcomes. METHODS. This retrospective study included 1917 patients (mean age, 59.5 years; 776 men, 1141 women) presenting to the ED with dizziness from January 1, 2018, to December 31, 2021. A first propensity score matching analysis incorporated demographic characteristics, medical history, findings from the review of systems, physical examination findings, and symptoms to construct matched groups of patients discharged from the ED after undergoing head CT with head and neck CTA alone and patients who underwent brain MRI (with or without CT and CTA). Outcomes were compared. A second analysis compared matched patients discharged after CT with CTA alone and patients who underwent specialized abbreviated MRI using multiplanar high-resolution DWI for increased sensitivity for posterior circulation stroke. Sensitivity analyses were performed involving MRI examinations performed as the first or only neuroimaging examination and involving alternative matching and imputation techniques. RESULTS. In the first analysis (406 patients per group), patients who underwent MRI, compared with patients who underwent CT with CTA alone, showed greater frequency of critical neuroimaging results (10.1% vs 4.7%, p = .005), change in secondary stroke prevention medication (9.6% vs 3.2%, p = .001), and subsequent echocardiography evaluation (6.4% vs 1.0%, p < .001). In the second analysis (100 patients per group), patients who underwent specialized abbreviated MRI, compared with patients who underwent CT with CTA alone, showed greater frequency of critical neuroimaging results (10.0% vs 2.0%, p = .04), change in secondary stroke prevention medication (14.0% vs 1.0%, p = .001), and subsequent echocardiography evaluation (12.0% vs 2.0%, p = .01) and lower frequency of 90-day ED readmissions (12.0% vs 28.0%, p = .008). Sensitivity analyses showed qualitatively similar findings. CONCLUSION. A proportion of patients discharged after CT with CTA alone may have benefitted from alternative or additional evaluation by MRI (including MRI using a specialized abbreviated protocol). CLINICAL IMPACT. Use of MRI may motivate clinically impactful management changes in patients presenting with dizziness.

Adoption of Emergency Department-Initiated Buprenorphine for Patients With Opioid Use Disorder: Secondary Analysis of a Cluster Randomized Trial

Importance

Emergency department (ED) initiation of buprenorphine is safe and effective but underutilized in practice. Understanding the factors affecting adoption of this practice could inform more effective interventions.

Objective

To quantify the factors, including social contagion, associated with the adoption of the practice of ED initiation of buprenorphine for patients with opioid use disorder.

Design, Setting, and Participants

This is a secondary analysis of the EMBED (Emergency Department-Initiated Buprenorphine For Opioid Use Disorder) trial, a multicentered, cluster randomized trial of a clinical decision support intervention targeting ED initiation of buprenorphine. The trial occurred from November 2019 to May 2021. The study was conducted at ED clusters across health care systems from the northeast, southeast, and western regions of the US and included attending physicians, resident physicians, and advanced practice practitioners. Data analysis was performed from August 2022 to June 2023.

Exposures

This analysis included both the intervention and nonintervention groups of the EMBED trial. Graph methods were used to construct the network of clinicians who shared in the care of patients for whom buprenorphine was initiated during the trial before initiating the practice themselves, termed exposure.

Main Outcomes and Measures

Cox proportional hazard modeling with time-dependent covariates was performed to assess the association of the number of these exposures with self-adoption of the practice of ED initiation of buprenorphine while adjusting for clinician role, health care system, and intervention site status.

Results

A total of 1026 unique clinicians in 18 ED clusters across 5 health care systems were included. Analysis showed associations of the cumulative number of exposures to others initiating buprenorphine with the self-practice of buprenorphine initiation. This increased in a dose-dependent manner (1 exposure: hazard ratio [HR], 1.31; 95% CI, 1.16-1.48; 5 exposures: HR, 2.85; 95% CI, 1.66-4.89; 10 exposures: HR, 3.55; 95% CI, 1.47-8.58). Intervention site status was associated with practice adoption (HR, 1.50; 95% CI, 1.04-2.18). Health care system and clinician role were also associated with practice adoption.

Conclusions and Relevance

In this secondary analysis of a multicenter, cluster randomized trial of a clinical decision support tool for buprenorphine initiation, the number of exposures to ED initiation of buprenorphine and the trial intervention were associated with uptake of ED initiation of buprenorphine. Although systems-level approaches are necessary to increase the rate of buprenorphine initiation, individual clinicians may change practice of those around them.

Trial Registration

ClinicalTrials.gov Identifier: NCT03658642.

Identifying and Addressing Barriers to Implementing Core Electronic Health Record Use Metrics for Ambulatory Care: Virtual Consensus Conference Proceedings

Precise, reliable, valid metrics that are cost-effective and require reasonable implementation time and effort are needed to drive electronic health record (EHR) improvements and decrease EHR burden. Differences exist between research and vendor definitions of metrics. PROCESS:  We convened three stakeholder groups (health system informatics leaders, EHR vendor representatives, and researchers) in a virtual workshop series to achieve consensus on barriers, solutions, and next steps to implementing the core EHR use metrics in ambulatory care. CONCLUSION:  Actionable solutions identified to address core categories of EHR metric implementation challenges include: (1) maintaining broad stakeholder engagement, (2) reaching agreement on standardized measure definitions across vendors, (3) integrating clinician perspectives, and (4) addressing cognitive and EHR burden. Building upon the momentum of this workshop's outputs offers promise for overcoming barriers to implementing EHR use metrics.

National trends in emergency conditions through the Omicron COVID-19 wave in commercial and Medicare Advantage enrollees

Objective

To evaluate trends in emergency care sensitive conditions (ECSCs) from pre-COVID (March 2018-February 2020) through Omicron (December 2021-February 2022).

Methods

This cross-sectional analysis evaluated trends in ECSCs using claims (OptumLabs Data Warehouse) from commercial and Medicare Advantage enrollees. Emergency department (ED) visits for ECSCs (acute appendicitis, aortic aneurysm/dissection, cardiac arrest/severe arrhythmia, cerebral infarction, myocardial infarction, pulmonary embolism, opioid overdose, pre-eclampsia) were reported per 100,000 person months from March 2018 to February 2022 by pandemic wave. We calculated the percent change for each pandemic wave compared to the pre-pandemic period.

Results

There were 10,268,554 ED visits (March 2018-February 2022). The greatest increases in ECSCs were seen for pulmonary embolism, cardiac arrest/severe arrhythmia, myocardial infarction, and pre-eclampsia. For commercial enrollees, pulmonary embolism visit rates increased 22.7% (95% confidence interval [CI], 18.6%-26.9%) during Waves 2-3, 37.2% (95% CI, 29.1%-45.8%] during Delta, and 27.9% (95% CI, 20.3%-36.1%) during Omicron, relative to pre-pandemic rates. Cardiac arrest/severe arrhythmia visit rates increased 4.0% (95% CI, 0.2%-8.0%) during Waves 2-3; myocardial infarction rates increased 4.9% (95% CI, 2.1%-7.8%) during Waves 2-3. Similar patterns were seen in Medicare Advantage enrollees. Pre-eclampsia visit rates among reproductive-age female enrollees increased 31.1% (95% CI, 20.9%-42.2%), 23.7% (95% CI, 7.5%,-42.3%), and 34.7% (95% CI, 16.8%-55.2%) during Waves 2-3, Delta, and Omicron, respectively. ED visits for other ECSCs declined or exhibited smaller increases.

Conclusions

ED visit rates for acute cardiovascular conditions, pulmonary embolism and pre-eclampsia increased despite declines or stable rates for all-cause ED visits and ED visits for other conditions. Given the changing landscape of ECSCs, studies should identify drivers for these changes and interventions to mitigate them.

Racial and ethnic disparities in emergency department-initiated buprenorphine across five health care systems

BACKGROUND

Opioid overdose deaths have disproportionately impacted Black and Hispanic populations, in part due to disparities in treatment access. Emergency departments (EDs) serve as a resource for patients with opioid use disorder (OUD), many of whom have difficulty accessing outpatient addiction programs. However, inequities in ED treatment for OUD remain poorly understood.

METHODS

This secondary analysis examined racial and ethnic differences in buprenorphine access using data from EMBED, a study of 21 EDs across five health care systems evaluating a clinical decision support system for initiating ED buprenorphine. The primary outcome was receipt of buprenorphine, ED administered or prescribed. Hospital type (academic vs. community) was evaluated as an effect modifier. Hierarchical models with cluster effects for site and clinician were used to assess buprenorphine receipt by race and ethnicity.

RESULTS

Black patients were less likely to receive buprenorphine (6.4% [51/801] vs. White patients 8.5% [268/3154], odds ratio [OR] 0.59, 95% confidence interval [CI] 0.45-0.78). This association persisted after adjusting for age, insurance, gender, clinician X-waiver, hospital type, and urbanicity (adjusted OR [aOR] 0.64, 95% CI 0.48-0.84) but not when discharge diagnosis was included (aOR 0.75, 95% CI 0.56-1.02). Hispanic patients were more likely to receive buprenorphine (14.8% [122/822] vs. non-Hispanic patients, 11.6% [475/4098]) in unadjusted (OR 1.57, 95% CI 1.09-1.83) and adjusted models (aOR 1.41, 95% CI 1.08-1.83) but not including discharge diagnosis (aOR 1.32, 95% CI 0.99-1.77). Odds of buprenorphine were similar in academic and community EDs by race (interaction p = 0.97) and ethnicity (interaction p = 0.64).

CONCLUSIONS

Black patients with OUD were less likely to receive buprenorphine whereas Hispanic patients were more likely to receive buprenorphine in academic and community EDs. Differences were attenuated with discharge diagnosis, as fewer Black and non-Hispanic patients were diagnosed with opioid withdrawal. Barriers to medication treatment are heterogenous among patients with OUD; research must continue to address the multiple drivers of health inequities at the patient, clinician, and community level.

Implementation strategies to address the determinants of adoption, implementation, and maintenance of a clinical decision support tool for emergency department buprenorphine initiation: a qualitative study

BACKGROUND

Untreated opioid use disorder (OUD) is a significant public health problem. Buprenorphine is an evidence-based treatment for OUD that can be initiated in and prescribed from emergency departments (EDs) and office settings. Adoption of buprenorphine initiation among ED clinicians is low. The EMBED pragmatic clinical trial investigated the effectiveness of a clinical decision support (CDS) tool to promote ED clinicians' behavior related to buprenorphine initiation in the ED. While the CDS intervention was not associated with increased rates of buprenorphine treatment for patients with OUD at intervention ED sites, attending physicians at intervention EDs were more likely to initiate buprenorphine at least once over the duration of the study compared to those in the usual care arms (44.4% vs 34.0%, P = 0.01). This suggests the CDS intervention may be associated with increased adoption of buprenorphine initiation. As a secondary aim, we sought to identify the determinants of CDS adoption, implementation, and maintenance in a variety of ED settings and geographic locations.

METHODS

We purposively sampled and conducted semi-structured, in-depth interviews with clinicians across EMBED trial sites randomized to the intervention arm from five healthcare systems. Interviews elicited clinician experiences regarding buprenorphine initiation and CDS use. Interviews were analyzed using directed content analysis informed by the Practical, Robust Implementation and Sustainability Model (PRISM). We used a hybrid approach (a priori codes informed by PRISM and emergent codes) for codebook development. ATLAS.ti (version 9.0) was used for data management. Coded data were analyzed within individual interview transcripts and across all interviews to identify major themes. This process involved (1) combining, comparing, and making connections between codes; (2) writing analytic memos about observed patterns; and (3) frequent team meetings to discuss emerging patterns.

RESULTS

Twenty-eight interviews were conducted. Major themes that influenced the successful adoption, implementation, and maintenance of the EMBED intervention and ED-initiated BUP were organizational culture and commitment, clinician training and support, the ability to connect patients to ongoing treatment, and the ability to tailor implementation to each ED. These findings informed the identification of implementation strategies (framed using PRISM domains) to enhance the ED initiation of buprenorphine.

CONCLUSION

The findings from this qualitative analysis can provide guidance to build better systems to promote the adoption of ED-initiated buprenorphine.

Funding Research on Health Workforce Well-being to Optimize the Work Environment

This Viewpoint discusses the need for public funding for research that supports health workforce well-being and addresses occupational burnout among health care practitioners.

Predicting physician departure with machine learning on EHR use patterns: A longitudinal cohort from a large multi-specialty ambulatory practice

Physician turnover places a heavy burden on the healthcare industry, patients, physicians, and their families. Having a mechanism in place to identify physicians at risk for departure could help target appropriate interventions that prevent departure. We have collected physician characteristics, electronic health record (EHR) use patterns, and clinical productivity data from a large ambulatory based practice of non-teaching physicians to build a predictive model. We use several techniques to identify possible intervenable variables. Specifically, we used gradient boosted trees to predict the probability of a physician departing within an interval of 6 months. Several variables significantly contributed to predicting physician departure including tenure (time since hiring date), panel complexity, physician demand, physician age, inbox, and documentation time. These variables were identified by training, validating, and testing the model followed by computing SHAP (SHapley Additive exPlanation) values to investigate which variables influence the model's prediction the most. We found these top variables to have large interactions with other variables indicating their importance. Since these variables may be predictive of physician departure, they could prove useful to identify at risk physicians such who would benefit from targeted interventions.

Using event logs to observe interactions with electronic health records: an updated scoping review shows increasing use of vendor-derived measures

OBJECTIVE

The aim of this article is to compare the aims, measures, methods, limitations, and scope of studies that employ vendor-derived and investigator-derived measures of electronic health record (EHR) use, and to assess measure consistency across studies.

MATERIALS AND METHODS

We searched PubMed for articles published between July 2019 and December 2021 that employed measures of EHR use derived from EHR event logs. We coded the aims, measures, methods, limitations, and scope of each article and compared articles employing vendor-derived and investigator-derived measures.

RESULTS

One hundred and two articles met inclusion criteria; 40 employed vendor-derived measures, 61 employed investigator-derived measures, and 1 employed both. Studies employing vendor-derived measures were more likely than those employing investigator-derived measures to observe EHR use only in ambulatory settings (83% vs 48%, P = .002) and only by physicians or advanced practice providers (100% vs 54% of studies, P < .001). Studies employing vendor-derived measures were also more likely to measure durations of EHR use (P < .001 for 6 different activities), but definitions of measures such as time outside scheduled hours varied widely. Eight articles reported measure validation. The reported limitations of vendor-derived measures included measure transparency and availability for certain clinical settings and roles.

DISCUSSION

Vendor-derived measures are increasingly used to study EHR use, but only by certain clinical roles. Although poorly validated and variously defined, both vendor- and investigator-derived measures of EHR time are widely reported.

CONCLUSION

The number of studies using event logs to observe EHR use continues to grow, but with inconsistent measure definitions and significant differences between studies that employ vendor-derived and investigator-derived measures.

Pragmatic clinical trial design in emergency medicine: Study considerations and design types

Pragmatic clinical trials (PCTs) focus on correlation between treatment and outcomes in real-world clinical practice, yet a guide highlighting key study considerations and design types for emergency medicine investigators pursuing this important study type is not available. Investigators conducting emergency department (ED)-based PCTs face multiple decisions within the planning phase to ensure robust and meaningful study findings. The PRagmatic Explanatory Continuum Indicator Summary 2 (PRECIS-2) tool allows trialists to consider both pragmatic and explanatory components across nine domains, shaping the trial design to the purpose intended by the investigators. Aside from the PRECIS-2 tool domains, ED-based investigators conducting PCTs should also consider randomization techniques, human subjects concerns, and integration of trial components within the electronic health record. The authors additionally highlight the advantages, disadvantages, and rationale for the use of four common randomized study design types to be considered in PCTs: parallel, crossover, factorial, and stepped-wedge. With increasing emphasis on the conduct of PCTs, emergency medicine investigators will benefit from a rigorous approach to clinical trial design.

Hospital Occupancy and Emergency Department Boarding During the COVID-19 Pandemic

This cross-sectional study uses national benchmarking data to evaluate hospital occupancy and emergency department boarding during the COVID-19 pandemic.

Monthly Rates of Patients Who Left Before Accessing Care in US Emergency Departments, 2017-2021

This cross-sectional study investigates rates of patients who left emergency departments without being seen from 2017 to 2021.

User centered clinical decision support to implement initiation of buprenorphine for opioid use disorder in the emergency department: EMBED pragmatic cluster randomized controlled trial

OBJECTIVE

To determine the effect of a user centered clinical decision support tool versus usual care on rates of initiation of buprenorphine in the routine emergency care of individuals with opioid use disorder.

DESIGN

Pragmatic cluster randomized controlled trial (EMBED).

SETTING

18 emergency department clusters across five healthcare systems in five states representing the north east, south east, and western regions of the US, ranging from community hospitals to tertiary care centers, using either the Epic or Cerner electronic health record platform.

PARTICIPANTS

599 attending emergency physicians caring for 5047 adult patients presenting with opioid use disorder.

INTERVENTION

A user centered, physician facing clinical decision support system seamlessly integrated into user workflows in the electronic health record to support initiating buprenorphine in the emergency department by helping clinicians to diagnose opioid use disorder, assess the severity of withdrawal, motivate patients to accept treatment, and complete electronic health record tasks by automating clinical and after visit documentation, order entry, prescribing, and referral.

MAIN OUTCOME MEASURES

Rate of initiation of buprenorphine (administration or prescription of buprenorphine) in the emergency department among patients with opioid use disorder. Secondary implementation outcomes were measured with the RE-AIM (reach, effectiveness, adoption, implementation, and maintenance) framework.

RESULTS

1 413 693 visits to the emergency department (775 873 in the intervention arm and 637 820 in the usual care arm) from November 2019 to May 2021 were assessed for eligibility, resulting in 5047 patients with opioid use disorder (2787 intervention arm, 2260 usual care arm) under the care of 599 attending physicians (340 intervention arm, 259 usual care arm) for analysis. Buprenorphine was initiated in 347 (12.5%) patients in the intervention arm and in 271 (12.0%) patients in the usual care arm (adjusted generalized estimating equations odds ratio 1.22, 95% confidence interval 0.61 to 2.43, P=0.58). Buprenorphine was initiated at least once by 151 (44.4%) physicians in the intervention arm and by 88 (34.0%) in the usual care arm (1.83, 1.16 to 2.89, P=0.01).

CONCLUSIONS

User centered clinical decision support did not increase patient level rates of initiating buprenorphine in the emergency department. Although streamlining and automating electronic health record workflows can potentially increase adoption of complex, unfamiliar evidence based practices, more interventions are needed to look at other barriers to the treatment of addiction and increase the rate of initiating buprenorphine in the emergency department in patients with opioid use disorder.

TRIAL REGISTRATION

ClinicalTrials.gov NCT03658642.

Trends and Disparities in Access to Buprenorphine Treatment Following an Opioid-Related Emergency Department Visit Among an Insured Cohort, 2014-2020

This cross-sectional study examines trends in access to buprenorphine treatment following an opioid-related emergency department (ED) visit among adults with commercial or Medicare Advantage health insurance between 2014 and 2020.

Clinical decision support in cardiovascular medicine

Despite considerable progress in tackling cardiovascular disease over the past 50 years, many gaps in the quality of care for cardiovascular disease remain. Multiple missed opportunities have been identified at every step in the prevention and treatment of cardiovascular disease, such as failure to make risk factor modifications, failure to diagnose cardiovascular disease, and failure to use proper evidence based treatments. With the digital transformation of medicine and advances in health information technology, clinical decision support (CDS) tools offer promise to enhance the efficiency and effectiveness of delivery of cardiovascular care. However, to date, the promise of CDS delivering scalable and sustained value for patient care in clinical practice has not been realized. This article reviews the evidence on key emerging questions around the development, implementation, and regulation of CDS with a focus on cardiovascular disease. It first reviews evidence on the effectiveness of CDS on healthcare process and clinical outcomes related to cardiovascular disease and design features associated with CDS effectiveness. It then reviews the barriers encountered during implementation of CDS in cardiovascular care, with a focus on unintended consequences and strategies to promote successful implementation. Finally, it reviews the legal and regulatory environment of CDS with specific examples for cardiovascular disease.

Gender Differences in Time Spent on Documentation and the Electronic Health Record in a Large Ambulatory Network

This cross-sectional study assesses gender differences in time spent on documentation and electronic health records in a large ambulatory care network.

Pilot MRI-based strategies to improve the detection of stroke in patients with dizziness/vertigo

Posterior strokes are frequently misdiagnosed as they present with non-specific complaints such as dizziness/vertigo. Emergency department (ED) practice often relies on CT/CTA to "exclude" infarct in such patients, providing false reassurance due to lower sensitivity of CT (42%) for stroke in the posterior circulation. We describe a pilot at our institution using a specialized MRI protocol with 95% sensitivity for posterior stroke, which may be used in place of CT/CTA or conventional MRI for stroke evaluation. Further development of this approach may help reduce the high rate of missed posterior stroke in patients presenting with dizziness.

Analysis of Electronic Health Record Use and Clinical Productivity and Their Association With Physician Turnover

Importance

Physician turnover takes a heavy toll on patients, physicians, and health care organizations. Survey research has established associations of electronic health record (EHR) use with professional burnout and reduction in professional effort, but these findings are subject to response fatigue and bias.

Objective

To evaluate the association of physician productivity and EHR use patterns, as determined by vendor-derived EHR use data platforms, with physician turnover.

Design, Setting, and Participants

This retrospective cohort study was conducted among nonteaching ambulatory physicians at a large ambulatory practice network based in New England. Data were collected from March 2018 to February 2020.

Main Outcomes and Measures

Physician departure from the practice network; 4 time-based core measures of EHR use, normalized to 8 hours of scheduled clinical time; teamwork, percentage of a physician's orders that are placed by other members of the care team; and productivity measures of patient volume, intensity, and demand.

Results

Among 335 physicians assessed for eligibility, 314 unique physicians (89.2%) were included in the analysis (123 [39%] women; 100 [32%] aged 45-54 years), with 5663 physician-months of data. The turnover rate was 5.1%/year (32 of 314 physicians). Physicians completed a mean 2.6 appointments/hour (95% CI, 2.5-2.6 appointments/hour) and 206 appointments/month (95% CI, 197-215 appointments/month) with 5.5 hours (95% CI, 5.3-5.8 hours) of EHR time for every 8 hours of scheduled patient time. After controlling for gender, medical specialty, and time, the following variables were associated with turnover: inbox time (odds ratio [OR], 0.70; 95% CI, 0.61-0.82; P < .001), teamwork (OR, 0.68; 95% CI, 0.52-0.87; P = .003), demand (ie, proportion of available appointments filled: OR, 0.49; 95% CI, 0.35-0.70; P < .001), and age 45 to 54 years vs 25 to 34 years (OR, 0.19; 95% CI, 0.04-0.93; P = .04).

Conclusions and Relevance

In this study, physician productivity and EHR use metrics were associated with physician departure. Prospectively tracking these metrics could identify physicians at high risk of departure who would benefit from early, team-based, targeted interventions. The counterintuitive finding that less time spent on the EHR (in particular inbox management) was associated with physician departure warrants further investigation.

Advancing electronic health record vendor usability maturity: Progress and next steps

Despite basic federal requirements promoting a user-centered design approach to electronic health record (EHR) development and usability testing there have been usability and safety risks with EHR technology. Four EHR vendors were asked to provide written descriptions of their usability practices, and we reviewed these descriptions to identify areas where there has been advancement and areas for improvement. All 4 vendors described user-centered design processes and usability testing methods that demonstrate advancement from previous studies of vendor practices. Importantly, vendors are also beginning to address aspects of EHR implementation that play a critical role in shaping EHR usability. There are important areas for improvement in vendor practices including a greater focus on safety and on measurement and benchmarking. Vendors sharing their current usability practices demonstrates a step toward greater transparency which has typically been lacking.

The association between perceived electronic health record usability and professional burnout among US nurses

OBJECTIVES

To measure nurse-perceived electronic health records (EHR) usability with a standardized metric of technology usability and evaluate its association with professional burnout.

METHODS

A cross-sectional survey of a random sample of US nurses was conducted in November 2017. EHR usability was measured with the System Usability Scale (SUS; range 0-100) and burnout with the Maslach Burnout Inventory.

RESULTS

Among the 86 858 nurses who were invited, 8638 (9.9%) completed the survey. The mean nurse-rated EHR SUS score was 57.6 (SD 16.3). A score of 57.6 is in the bottom 24% of scores across previous studies and categorized with a grade of "F." On multivariable analysis adjusting for age, gender, race, ethnicity, relationship status, children, highest nursing-related degree, mean hours worked per week, years of nursing experience, advanced certification, and practice setting, nurse-rated EHR usability was associated with burnout with each 1 point more favorable SUS score and associated with a 2% lower odds of burnout (OR 0.98; 95% CI, 0.97-0.99; P < .001).

CONCLUSIONS

Nurses rated the usability of their current EHR in the low marginal range of acceptability using a standardized metric of technology usability. EHR usability and the odds of burnout were strongly associated with a dose-response relationship.

Characterizing physician EHR use with vendor derived data: a feasibility study and cross-sectional analysis

OBJECTIVE

To derive 7 proposed core electronic health record (EHR) use metrics across 2 healthcare systems with different EHR vendor product installations and examine factors associated with EHR time.

MATERIALS AND METHODS

A cross-sectional analysis of ambulatory physicians EHR use across the Yale-New Haven and MedStar Health systems was performed for August 2019 using 7 proposed core EHR use metrics normalized to 8 hours of patient scheduled time.

RESULTS

Five out of 7 proposed metrics could be measured in a population of nonteaching, exclusively ambulatory physicians. Among 573 physicians (Yale-New Haven N = 290, MedStar N = 283) in the analysis, median EHR-Time8 was 5.23 hours. Gender, additional clinical hours scheduled, and certain medical specialties were associated with EHR-Time8 after adjusting for age and health system on multivariable analysis. For every 8 hours of scheduled patient time, the model predicted these differences in EHR time (P < .001, unless otherwise indicated): female physicians +0.58 hours; each additional clinical hour scheduled per month -0.01 hours; practicing cardiology -1.30 hours; medical subspecialties -0.89 hours (except gastroenterology, P = .002); neurology/psychiatry -2.60 hours; obstetrics/gynecology -1.88 hours; pediatrics -1.05 hours (P = .001); sports/physical medicine and rehabilitation -3.25 hours; and surgical specialties -3.65 hours.

CONCLUSIONS

For every 8 hours of scheduled patient time, ambulatory physicians spend more than 5 hours on the EHR. Physician gender, specialty, and number of clinical hours practicing are associated with differences in EHR time. While audit logs remain a powerful tool for understanding physician EHR use, additional transparency, granularity, and standardization of vendor-derived EHR use data definitions are still necessary to standardize EHR use measurement.

Mixed-effects models for the design and analysis of stepped wedge cluster randomized trials: An overview

The stepped wedge cluster randomized design has received increasing attention in pragmatic clinical trials and implementation science research. The key feature of the design is the unidirectional crossover of clusters from the control to intervention conditions on a staggered schedule, which induces confounding of the intervention effect by time. The stepped wedge design first appeared in the Gambia hepatitis study in the 1980s. However, the statistical model used for the design and analysis was not formally introduced until 2007 in an article by Hussey and Hughes. Since then, a variety of mixed-effects model extensions have been proposed for the design and analysis of these trials. In this article, we explore these extensions under a unified perspective. We provide a general model representation and regard various model extensions as alternative ways to characterize the secular trend, intervention effect, as well as sources of heterogeneity. We review the key model ingredients and clarify their implications for the design and analysis. The article serves as an entry point to the evolving statistical literatures on stepped wedge designs.

Perceived Electronic Health Record Usability as a Predictor of Task Load and Burnout Among US Physicians: Mediation Analysis

BACKGROUND

Electronic health record (EHR) usability and physician task load both contribute to physician professional burnout. The association between perceived EHR usability and workload has not previously been studied at a national level. Better understanding these interactions could give further information as to the drivers of extraneous task load.

OBJECTIVE

This study aimed to determine the relationship between physician-perceived EHR usability and workload by specialty and evaluate for associations with professional burnout.

METHODS

A secondary analysis of a cross-sectional survey of US physicians from all specialties was conducted from October 2017 to March 2018. Among the 1250 physicians invited to respond to the subsurvey analyzed here, 848 (67.8%) completed it. EHR usability was assessed with the System Usability Scale (SUS; range: 0-100). Provider task load (PTL) was assessed using the mental demand, physical demand, temporal demand, and effort required subscales of the National Aeronautics and Space Administration Task Load Index (range: 0-400). Burnout was measured using the Maslach Burnout Inventory.

RESULTS

The mean scores were 46.1 (SD 22.1) for SUS and 262.5 (SD 71.7) for PTL. On multivariable analysis adjusting for age, gender, relationship status, medical specialty, practice setting, hours worked per week, and number of nights on call per week, physician-rated EHR usability was associated with PTL, with each 1-point increase in SUS score (indicating more favorable) associated with a 0.57-point decrease in PTL score (P<.001). On mediation analysis, higher SUS score was associated with lower PTL score, which was associated with lower odds of burnout.

CONCLUSIONS

A strong association was observed between EHR usability and workload among US physicians, with more favorable usability associated with less workload. Both outcomes were associated with the odds of burnout, with task load acting as a mediator between EHR usability and burnout. Improving EHR usability while decreasing task load has the potential to allow practicing physicians more working memory for medical decision making and patient communication.

Trends in Emergency Department Visits and Hospital Admissions in Health Care Systems in 5 States in the First Months of the COVID-19 Pandemic in the US

IMPORTANCE

As coronavirus disease 2019 (COVID-19) spread throughout the US in the early months of 2020, acute care delivery changed to accommodate an influx of patients with a highly contagious infection about which little was known.

OBJECTIVE

To examine trends in emergency department (ED) visits and visits that led to hospitalizations covering a 4-month period leading up to and during the COVID-19 outbreak in the US.

DESIGN, SETTING, AND PARTICIPANTS

This retrospective, observational, cross-sectional study of 24 EDs in 5 large health care systems in Colorado (n = 4), Connecticut (n = 5), Massachusetts (n = 5), New York (n = 5), and North Carolina (n = 5) examined daily ED visit and hospital admission rates from January 1 to April 30, 2020, in relation to national and the 5 states' COVID-19 case counts.

EXPOSURES

Time (day) as a continuous variable.

MAIN OUTCOMES AND MEASURES

Daily counts of ED visits, hospital admissions, and COVID-19 cases.

RESULTS

A total of 24 EDs were studied. The annual ED volume before the COVID-19 pandemic ranged from 13 000 to 115 000 visits per year; the decrease in ED visits ranged from 41.5% in Colorado to 63.5% in New York. The weeks with the most rapid rates of decrease in visits were in March 2020, which corresponded with national public health messaging about COVID-19. Hospital admission rates from the ED were stable until new COVID-19 case rates began to increase locally; the largest relative increase in admission rates was 149.0% in New York, followed by 51.7% in Massachusetts, 36.2% in Connecticut, 29.4% in Colorado, and 22.0% in North Carolina.

CONCLUSIONS AND RELEVANCE

From January through April 2020, as the COVID-19 pandemic intensified in the US, temporal associations were observed with a decrease in ED visits and an increase in hospital admission rates in 5 health care systems in 5 states. These findings suggest that practitioners and public health officials should emphasize the importance of visiting the ED during the COVID-19 pandemic for serious symptoms, illnesses, and injuries that cannot be managed in other settings.

Trends in Emergency Department Visits and Hospital Admissions in Health Care Systems in 5 States in the First Months of the COVID-19 Pandemic in the US

IMPORTANCE

As coronavirus disease 2019 (COVID-19) spread throughout the US in the early months of 2020, acute care delivery changed to accommodate an influx of patients with a highly contagious infection about which little was known.

OBJECTIVE

To examine trends in emergency department (ED) visits and visits that led to hospitalizations covering a 4-month period leading up to and during the COVID-19 outbreak in the US.

DESIGN, SETTING, AND PARTICIPANTS

This retrospective, observational, cross-sectional study of 24 EDs in 5 large health care systems in Colorado (n = 4), Connecticut (n = 5), Massachusetts (n = 5), New York (n = 5), and North Carolina (n = 5) examined daily ED visit and hospital admission rates from January 1 to April 30, 2020, in relation to national and the 5 states' COVID-19 case counts.

EXPOSURES

Time (day) as a continuous variable.

MAIN OUTCOMES AND MEASURES

Daily counts of ED visits, hospital admissions, and COVID-19 cases.

RESULTS

A total of 24 EDs were studied. The annual ED volume before the COVID-19 pandemic ranged from 13 000 to 115 000 visits per year; the decrease in ED visits ranged from 41.5% in Colorado to 63.5% in New York. The weeks with the most rapid rates of decrease in visits were in March 2020, which corresponded with national public health messaging about COVID-19. Hospital admission rates from the ED were stable until new COVID-19 case rates began to increase locally; the largest relative increase in admission rates was 149.0% in New York, followed by 51.7% in Massachusetts, 36.2% in Connecticut, 29.4% in Colorado, and 22.0% in North Carolina.

CONCLUSIONS AND RELEVANCE

From January through April 2020, as the COVID-19 pandemic intensified in the US, temporal associations were observed with a decrease in ED visits and an increase in hospital admission rates in 5 health care systems in 5 states. These findings suggest that practitioners and public health officials should emphasize the importance of visiting the ED during the COVID-19 pandemic for serious symptoms, illnesses, and injuries that cannot be managed in other settings.

Interrupted Time Series of User-centered Clinical Decision Support Implementation for Emergency Department-initiated Buprenorphine for Opioid Use Disorder

OBJECTIVES

Adoption of emergency department (ED) initiation of buprenorphine (BUP) for opioid use disorder (OUD) into routine emergency care has been slow, partly due to clinicians' unfamiliarity with this practice and perceptions that it is complicated and time-consuming. To address these barriers and guide emergency clinicians through the process of BUP initiation, we implemented a user-centered computerized clinical decision support system (CDS). This study was conducted to assess the feasibility of implementation and to evaluate the preliminary efficacy of the intervention to increase the rate of ED-initiated BUP.

METHODS

An interrupted time series study was conducted in an urban, academic ED from April 2018 to February 2019 (preimplementation phase), March 2019 to August 2019 (implementation phase), and September 2019 to December 2019 (maintenance phase) to study the effect of the intervention on adult ED patients identified by a validated electronic health record (EHR)-based computable phenotype consisting of structured data consistent with potential cases of OUD who would benefit from BUP treatment. The intervention offers flexible CDS for identification of OUD, assessment of opioid withdrawal, and motivation of readiness to start treatment and automates EHR activities related to ED initiation of BUP (including documentation, orders, prescribing, and referral). The primary outcome was the rate of ED-initiated BUP. Secondary outcomes were launch of the intervention, prescription for naloxone at ED discharge, and referral for ongoing addiction treatment.

RESULTS

Of the 141,041 unique patients presenting to the ED over the preimplementation and implementation phases (i.e., the phases used in primary analysis), 906 (574 preimplementation and 332 implementation) met OUD phenotype and inclusion criteria. The rate of BUP initiation increased from 3.5% (20/574) in the preimplementation phase to 6.6% (22/332) in the implementation phase (p = 0.03). After the temporal trend of the number of physician's with X-waiver training and other covariates were adjusted for, the relative risk of BUP initiation rate was 2.73 (95% confidence interval [CI] = 0.62 to 12.0, p = 0.18). Similarly, the number of unique attendings who initiated BUP increased modestly 7/53 (13.0%) to 13/57 (22.8%, p = 0.10) after offering just-in-time training during the implementation period. The rate of naloxone prescribed at discharge also increased (6.5% preimplementation and 11.5% implementation; p < 0.01). The intervention received a system usability scale score of 82.0 (95% CI = 76.7 to 87.2).

CONCLUSION

Implementation of user-centered CDS at a single ED was feasible, acceptable, and associated with increased rates of ED-initiated BUP and naloxone prescribing in patients with OUD and a doubling of the number of unique physicians adopting the practice. We have implemented this intervention across several health systems in an ongoing trial to assess its effectiveness, scalability, and generalizability.

Association of Perceived Electronic Health Record Usability With Patient Interactions and Work-Life Integration Among US Physicians

This cross-sectional survey assesses the association of perceived electronic health record usability with patient interaction and work-life integration among US physicians.

The Association Between Perceived Electronic Health Record Usability and Professional Burnout Among US Physicians

OBJECTIVE

To describe and benchmark physician-perceived electronic health record (EHR) usability as defined by a standardized metric of technology usability and evaluate the association with professional burnout among physicians.

PARTICIPANTS AND METHODS

This cross-sectional survey of US physicians from all specialty disciplines was conducted between October 12, 2017, and March 15, 2018, using the American Medical Association Physician Masterfile. Among the 30,456 invited physicians, 5197 (17.1%) completed surveys. A random 25% (n=1250) of respondents in the primary survey received a subsurvey evaluating EHR usability, and 870 (69.6%) completed it. EHR usability was assessed using the System Usability Scale (SUS; range 0-100). SUS scores were normalized to percentile rankings across more than 1300 previous studies from other industries. Burnout was measured using the Maslach Burnout Inventory.

RESULTS

Mean ± SD SUS score was 45.9±21.9. A score of 45.9 is in the bottom 9% of scores across previous studies and categorized in the "not acceptable" range or with a grade of F. On multivariate analysis adjusting for age, sex, medical specialty, practice setting, hours worked, and number of nights on call weekly, physician-rated EHR usability was independently associated with the odds of burnout with each 1 point more favorable SUS score associated with a 3% lower odds of burnout (odds ratio, 0.97; 95% CI, 0.97-0.98; P<.001).

CONCLUSION

The usability of current EHR systems received a grade of F by physician users when evaluated using a standardized metric of technology usability. A strong dose-response relationship between EHR usability and the odds of burnout was observed.

Treatment-Related Complications of Systemic Therapy and Radiotherapy

Importance

Systemic therapy and radiotherapy can be associated with acute complications that may require emergent care. However, there are limited data characterizing complications and the financial burden of cancer therapy that are treated in emergency departments (EDs) in the United States.

Objectives

To estimate the incidence of treatment-related complications of systemic therapy or radiotherapy, examine factors associated with inpatient admission, and investigate the overall financial burden.

Design, Setting, and Participants

A retrospective analysis of the Healthcare Cost and Utilization Project Nationwide Emergency Department Sample was performed. Between January 2006 and December 2015, there was a weighted total of 1.3 billion ED visits; of these, 1.5 million were related to a complication of systemic therapy or radiotherapy for cancer. Data analysis was conducted from February 22 to December 23, 2018. External cause of injury codes, Clinical Classifications Software, International Classification of Diseases, Ninth Revision, Clinical Modification, and International Statistical Classification of Diseases and Related Health Problems, Tenth Revision (ICD-10), Clinical Modification codes were used to identify patients with complications of systemic therapy or radiotherapy.

Main Outcomes and Measures

Patterns in treatment-related complications, patient- and hospital-related factors associated with inpatient admission, and median and total charges for treatment-related complications were the main outcomes.

Results

Of the 1.5 million ED visits included in the analysis, 53.2% of patients were female and mean age was 63.3 years. Treatment-related ED visits increased by a rate of 10.8% per year compared with 2.0% for overall ED visits. Among ED visits, 90.9% resulted in inpatient admission to the hospital and 4.9% resulted in death during hospitalization. Neutropenia (136 167 [8.9%]), sepsis (128 171 [8.4%]), and anemia (117 557 [7.7%]) were both the most common and costliest (neutropenia: $5.52 billion; sepsis: $11.21 billion; and anemia: $6.78 billion) complications diagnosed on presentation to EDs; sepsis (odds ratio [OR], 21.00; 95% CI, 14.61-30.20), pneumonia (OR, 9.73; 95% CI, 8.08-11.73), and acute kidney injury (OR, 9.60; 95% CI, 7.77-11.85) were associated with inpatient admission. Costs related to the top 10 most common complications totaled $38 billion and comprised 48% of the total financial burden of the study cohort.

Conclusions and Relevance

Emergency department visits for complications of systemic therapy or radiotherapy increased at a 5.5-fold higher rate over 10 years compared with overall ED visits. Neutropenia, sepsis, and anemia appear to be the most common complications; sepsis, pneumonia, and acute kidney injury appear to be associated with the highest rates of inpatient admission. These complications suggest that significant charges are incurred on ED visits.

Opportunities for addressing gaps in primary care shared decision-making with technology: a mixed-methods needs assessment

Objectives

To analyze current practices in shared decision-making (SDM) in primary care and perform a needs assessment for the role of information technology (IT) interventions.

Materials and Methods

A mixed-methods study was conducted in three phases: (1) ethnographic observation of clinical encounters, (2) patient interviews, and (3) physician interviews. SDM was measured using the validated OPTION scale. Semistructured interviews followed an interview guide (developed by our multidisciplinary team) informed by the Traditional Decision Conflict Scale and Shared Decision Making Questionnaire. Field notes were independently coded and analyzed by two reviewers in Dedoose.

Results

Twenty-four patient encounters were observed in 3 diverse practices with an average OPTION score of 57.2 (0-100 scale; 95% confidence interval [CI], 51.8-62.6). Twenty-two patient and 8 physician interviews were conducted until thematic saturation was achieved. Cohen's kappa, measuring coder agreement, was 0.42. Patient domains were: establishing trust, influence of others, flexibility, frustrations, values, and preferences. Physician domains included frustrations, technology (concerns, existing use, and desires), and decision making (current methods used, challenges, and patients' understanding).

Discussion

Given low SDM observed, multiple opportunities for technology to enhance SDM exist based on specific OPTION items that received lower scores, including: (1) checking the patient's preferred information format, (2) asking the patient's preferred level of involvement in decision making, and (3) providing an opportunity for deferring a decision. Based on data from interviews, patients and physicians value information exchange and are open to technologies that enhance communication of care options.

Conclusion

Future primary care IT platforms should prioritize the 3 quantitative gaps identified to improve physician-patient communication and relationships. Additionally, SDM tools should seek to standardize common workflow steps across decisions and focus on barriers to increasing adoption of effective SDM tools into routine primary care.

Efficacy and unintended consequences of hard-stop alerts in electronic health record systems: a systematic review

Objective

Clinical decision support (CDS) hard-stop alerts-those in which the user is either prevented from taking an action altogether or allowed to proceed only with the external override of a third party-are increasingly common but can be problematic. To understand their appropriate application, we asked 3 key questions: (1) To what extent are hard-stop alerts effective in improving patient health and healthcare delivery outcomes? (2) What are the adverse events and unintended consequences of hard-stop alerts? (3) How do hard-stop alerts compare to soft-stop alerts?

Methods and Materials

Studies evaluating computerized hard-stop alerts in healthcare settings were identified from biomedical and computer science databases, gray literature sites, reference lists, and reviews. Articles were extracted for process outcomes, health outcomes, unintended consequences, user experience, and technical details.

Results

Of 32 studies, 15 evaluated health outcomes, 16 process outcomes only, 10 user experience, and 4 compared hard and soft stops. Seventy-nine percent showed improvement in health outcomes and 88% in process outcomes. Studies reporting good user experience cited heavy user involvement and iterative design. Eleven studies reported on unintended consequences including avoidance of hard-stopped workflow, increased alert frequency, and delay to care. Hard stops were superior to soft stops in 3 of 4 studies.

Conclusions

Hard stops can be effective and powerful tools in the CDS armamentarium, but they must be implemented judiciously with continuous user feedback informing rapid, iterative design. Investigators must report on associated health outcomes and unintended consequences when implementing IT solutions to clinical problems.