Physician practice variation in the pediatric emergency department and its impact on resource use and quality of care

Emergency Severity Index Version 4 and Triage of Pediatric Emergency Department Patients

Importance

Most emergency departments (EDs) across the US use the Emergency Severity Index (ESI) to predict acuity and resource needs. A comprehensive assessment of ESI accuracy among pediatric patients is lacking.

Objective

To assess the frequency of mistriage using ESI (version 4) among pediatric ED visits using automated measures of mistriage and identify characteristics associated with mistriage.

Design, Setting, and Participants

This cohort study used operational measures for each ESI level to classify encounters as undertriaged, overtriaged, or correctly triaged to assess the accuracy of the ESI and identify characteristics of mistriage. Participants were pediatric patients at 21 EDs within Kaiser Permanente Northern California from January 1, 2016, to December 31, 2020. During that time, version 4 of the ESI was in use by these EDs. Visits with missing ESI, incomplete ED time variables, patients transferred from another ED, and those who left against medical advice or without being seen were excluded. Data were analyzed between January 2022 and June 2023.

Exposures

Assigned ESI level.

Main Outcomes and Measures

Rates of undertriage and overtriage by assigned ESI level based on mistriage algorithm, patient and visit characteristics associated with undertriage and overtriage.

Results

This study included 1 016 816 pediatric ED visits; the mean (SD) age of patients was 7.3 (5.6) years, 479 610 (47.2%) were female, and 537 206 (52.8%) were male. Correct triage occurred in 346 918 visits (34.1%; 95% CI, 34.0%-34.2%), while overtriage and undertriage occurred in 594 485 visits (58.5%; 95% CI, 58.4%-58.6%) and 75 413 visits (7.4%; 95% CI, 7.4%-7.5%), respectively. In adjusted analyses, undertriage was more common among children at least 6 years old compared with those younger 6 years; male patients compared with female patients; patients with Asian, Black, or Hispanic or other races or ethnicities compared with White patients; patients with comorbid illnesses compared with those without; and patients who arrived by ambulance compared with nonambulance patients.

Conclusions and Relevance

This multicenter retrospective study found that mistriage with ESI version 4 was common in pediatric ED visits. There is an opportunity to improve pediatric ED triage, both in early identification of critically ill patients (limit undertriage) and in more accurate identification of low-acuity patients with low resource needs (limit overtriage). Future research should include assessments based on version 5 of the ESI, which was released after this study was completed.

Disparities in Management of Acute Gastroenteritis in Hospitalized Children

BACKGROUND AND OBJECTIVES

Acute gastroenteritis (AGE) is a common health care problem accounting for up to 200 000 pediatric hospitalizations annually. Previous studies show disparities in the management of children from different ethnic backgrounds presenting to the emergency department with AGE. Our aim was to evaluate whether differences in medical management also exist between Hispanic and non-Hispanic children hospitalized with AGE.

METHODS

We performed a single-center retrospective study of children aged 2 months to 12 years admitted to the pediatric hospital medicine service from January 2016 to December 2020 with a diagnosis of (1) acute gastroenteritis or (2) dehydration with feeding intolerance, vomiting, and/or diarrhea. Differences in clinical pathway use, diagnostic studies performed, and medical interventions ordered were compared between Hispanic and non-Hispanic patients.

RESULTS

Of 512 admissions, 54.9% were male, 51.6% were Hispanic, and 59.2% were on Medicaid. There was no difference between Hispanic and non-Hispanic patients in reported nausea or vomiting at admission, pathway use, or laboratory testing including stool studies. However, after adjusting for covariates, Hispanic patients had more ultrasound scans performed (odds ratio 1.65, 95% confidence interval 1.04-2.64) and fewer orders for antiemetics (odds ratio 0.53, 95% CI 0.29-0.95) than non-Hispanic patients.

CONCLUSIONS

Although there were no differences in many aspects of AGE management between Hispanic and non-Hispanic patients, there was still variability in ultrasound scans performed and antiemetics ordered, despite similarities in reported abdominal pain, nausea, and vomiting. Prospective and/or qualitative studies may be needed to clarify underlying reasons for these differences.

Clinician factors associated with delayed diagnosis of appendicitis

OBJECTIVES

To evaluate the association of clinician demographics and practice patterns with delayed diagnosis of appendicitis.

METHODS

We included children with appendicitis at 13 regional emergency departments (EDs). We screened patients with a previous ED visit within 7 days for delayed diagnosis by chart review. We evaluated the association of clinician characteristics using logistic regression with random intercepts for site and clinician and delay as the outcome.

RESULTS

Among 7,452 children with appendicitis, 105 (1.4%) had delayed diagnosis. Clinicians in the lowest quartile of obtaining blood in their general practice were more likely to have delayed diagnosis (odds ratio 4.9 compared to highest quartile, 95% confidence interval 1.8, 13.8). Clinicians' imaging rates, specialty, sex, and experience were not associated with delayed diagnosis.

CONCLUSIONS

Clinicians who used more blood tests in their general practice had a lower risk of delayed diagnosis of appendicitis, possible evidence that lower risk tolerance has benefits.

Evaluation of the Emergency Severity Index in US Emergency Departments for the Rate of Mistriage

Importance

Accurate emergency department (ED) triage is essential to prioritize the most critically ill patients and distribute resources appropriately. The most used triage system in the US is the Emergency Severity Index (ESI).

Objectives

To derive and validate an algorithm to assess the rate of mistriage and to identify characteristics associated with mistriage.

Design, Setting, and Participants

This retrospective cohort study created operational definitions for each ESI level that use ED visit electronic health record data to classify encounters as undertriaged, overtriaged, or correctly triaged. These definitions were applied to a retrospective cohort to assess variation in triage accuracy by facility and patient characteristics in 21 EDs within the Kaiser Permanente Northern California (KPNC) health care system. All ED encounters by patients 18 years and older between January 1, 2016, and December 31, 2020, were assessed for eligibility. Encounters with missing ESI or incomplete ED time variables and patients who left against medical advice or without being seen were excluded. Data were analyzed between January 1, 2021, and November 30, 2022.

Exposures

Assigned ESI level.

Main Outcomes and Measures

Rate of undertriage and overtriage by assigned ESI level based on a mistriage algorithm and patient and visit characteristics associated with undertriage and overtriage.

Results

A total of 5 315 176 ED encounters were included. The mean (SD) patient age was 52 (21) years; 44.3% of patients were men and 55.7% were women. In terms of race and ethnicity, 11.1% of participants were Asian, 15.1% were Black, 21.4% were Hispanic, 44.0% were non-Hispanic White, and 8.5% were of other (includes American Indian or Alaska Native, Native Hawaiian or other Pacific Islander, and multiple races or ethnicities), unknown, or missing race or ethnicity. Mistriage occurred in 1 713 260 encounters (32.2%), of which 176 131 (3.3%) were undertriaged and 1 537 129 (28.9%) were overtriaged. The sensitivity of ESI to identify a patient with high-acuity illness (correctly assigning ESI I or II among patients who had a life-stabilizing intervention) was 65.9%. In adjusted analyses, Black patients had a 4.6% (95% CI, 4.3%-4.9%) greater relative risk of overtriage and an 18.5% (95% CI, 16.9%-20.0%) greater relative risk of undertriage compared with White patients, while Black male patients had a 9.9% (95% CI, 9.8%-10.0%) greater relative risk of overtriage and a 41.0% (95% CI, 40.0%-41.9%) greater relative risk of undertriage compared with White female patients. High relative risk of undertriage was found among patients taking high-risk medications (30.3% [95% CI, 28.3%-32.4%]) and those with a greater comorbidity burden (22.4% [95% CI, 20.1%-24.4%]) and recent intensive care unit utilization (36.7% [95% CI, 30.5%-41.4%]).

Conclusions and Relevance

In this retrospective cohort study of over 5 million ED encounters, mistriage with ESI was common. Quality improvement should focus on limiting critical undertriage, optimizing resource allocation by patient need, and promoting equity.

Machine Learning-Based Prediction of Hospital Admission Among Children in an Emergency Care Center

OBJECTIVES

Machine learning-based prediction of hospital admissions may have the potential to optimize patient disposition and improve clinical outcomes by minimizing both undertriage and overtriage in crowded emergency care. We developed and validated the predictive abilities of machine learning-based predictions of hospital admissions in a pediatric emergency care center.

METHODS

A prognostic study was performed using retrospectively collected data of children younger than 16 years who visited a single pediatric emergency care center in Osaka, Japan, between August 1, 2016, and October 15, 2019. Generally, the center treated walk-in children and did not treat trauma injuries. The main outcome was hospital admission as determined by the physician. The 83 potential predictors available at presentation were selected from the following categories: demographic characteristics, triage level, physiological parameters, and symptoms. To identify predictive abilities for hospital admission, maximize the area under the precision-recall curve, and address imbalanced outcome classes, we developed the following models for the preperiod training cohort (67% of the samples) and also used them in the 1-year postperiod validation cohort (33% of the samples): (1) logistic regression, (2) support vector machine, (3) random forest, and (4) extreme gradient boosting.

RESULTS

Among 88,283 children who were enrolled, the median age was 3.9 years, with 47,931 (54.3%) boys and 1985 (2.2%) requiring hospital admission. Among the models, extreme gradient boosting achieved the highest predictive abilities (eg, area under the precision-recall curve, 0.26; 95% confidence interval, 0.25-0.27; area under the receiver operating characteristic curve, 0.86; 95% confidence interval, 0.84-0.88; sensitivity, 0.77; and specificity, 0.82). With an optimal threshold, the positive and negative likelihood ratios were 4.22, and 0.28, respectively.

CONCLUSIONS

Machine learning-based prediction of hospital admissions may support physicians' decision-making for hospital admissions. However, further improvements are required before implementing these models in real clinical settings.

Comparison Between Physicians' and Nurse Practitioners' Resource Utilization in the Diagnosis and Management of Bronchiolitis in the Pediatric Emergency Department

OBJECTIVE

This study aimed to describe the resource utilization of nurse practitioners (NPs) in the pediatric emergency department (ED) and compare among physicians.

METHODS

A retrospective cross-sectional study of secondary data analysis in a level 1 academic pediatric trauma center was conducted. Patients were aged 1 to 24 months, evaluated in the ED between January 1, 2014, and November 30, 2018, with a diagnosis of bronchiolitis or wheezing. Data included age group, length of stay, disposition, diagnostic tests (chest radiography [CXR], viral testing, respiratory syncytial virus test), treatment (bronchodilator, corticosteroid, antibiotic), and medical provider (physician, NP, combination of both). Resources were evaluated before (early era) and after (late era) the implementation of an institutional clinical practice guideline.Comparisons between groups were done through χ2, Fisher exact, or Kruskal-Wallis test, as appropriate.

RESULTS

A total of 5311 cases were treated by a physician (65.3%), an NP (30.3%), or a combination of both (4.3%). The was a difference in the use of CXR, respiratory syncytial virus testing, bronchodilators, and corticosteroids among providers (P = 0.001). In the late era, NPs were less likely to order a bronchodilator (odds ratio [OR], 0.390 [95% confidence interval, 0.318-0.478; P < 0.001]), whereas physicians were less likely to order a CXR (OR, 0.772 [0.667-0.894, P = 0.001]), bronchodilator (OR, 0.518 [0.449-0.596, P < 0.001]), or a corticosteroid (OR, 0.630 [0.531-0.749, P < 0.001]).

CONCLUSIONS

Nurse practitioners made fewer diagnostic and therapeutic orders. A clinical practice guideline on the diagnosis and management of children with bronchiolitis successfully decreased the use of nonrecommended tests and therapies among NP and physicians.

Discrepancies Between the Management of Fever in Young Infants Admitted From Urban General Emergency Departments and Pediatric Emergency Departments

INTRODUCTION/OBJECTIVE

Most pediatric emergency visits occur in general emergency departments (GED). Our study aims to assess whether medical decision making regarding the management of febrile infants differs in GEDs from pediatric EDs (PED) and deviates from pediatric expert consensus.

METHODS

We conducted a retrospective chart review on patients younger than 60 days with fever admitted from 13 GEDs versus 1 PED to a children's hospital over a 3-year period. Adherence to consensus guidelines was measured by frequency of performing critical components of initial management, including blood culture, urine culture, attempted lumbar puncture, and antibiotic administration (<29 days old), or complete blood count and/or C-reactive protein, blood culture, and urine culture (29-60 days old). Additional outcomes included lumbar puncture, collecting urine specimens via catheterization, and timing of antibiotics.

RESULTS

A total of 176 patient charts were included. Sixty-four (36%) patients were younger than 29 days, and 112 (64%) were 29 to 60 days old. Eighty-eight (50%) patients were admitted from GEDs.In infants younger than 29 days managed in the GEDs (n = 32), 65.6% (n = 21) of patients underwent all 4 critical items compared with 96.9% (n = 31, P = 0.003) in the PED. In infants 29 to 60 days old managed in GEDs (n = 56), 64.3% (n = 36) patients underwent all 3 critical items compared with 91.1% (n = 51, P < 0.001) in the PED.

CONCLUSIONS

This retrospective study suggests that providers managing young infants with fever in 13 GEDs differ significantly from providers in the PED examined and literature consensus. Inconsistent testing and treatment practices may put young infants at risk for undetected bacterial infection.

Practice variation across five European paediatric emergency departments: a prospective observational study

OBJECTIVES

To compare paediatric healthcare practice variation among five European emergency departments (EDs) by analysing variability in decisions about diagnostic testing, treatment and admission.

DESIGN AND POPULATION

Consecutive paediatric visits in five European EDs in four countries (Austria, Netherlands, Portugal, UK) were prospectively collected during a study period of 9-36 months (2012-2015).

PRIMARY OUTCOME MEASURES

Practice variation was studied for the following management measures: lab testing, imaging, administration of intravenous medication and patient disposition after assessment at the ED.

ANALYSIS

Multivariable logistic regression was used to adjust for general patient characteristics and markers of disease severity. To assess whether ED was significantly associated with management, the goodness-of-fit of regression models based on all variables with and without ED as explanatory variable was compared. Management measures were analysed across different categories of presenting complaints.

RESULTS

Data from 111 922 children were included, with a median age of 4 years (IQR 1.7-9.4). There were large differences in frequencies of Manchester Triage System (MTS) urgency and selected MTS presentational flow charts. ED was a significant covariate for management measures. The variability in management among EDs was fairly consistent across different presenting complaints after adjustment for confounders. Adjusted OR (aOR) for laboratory testing were consistently higher in one hospital while aOR for imaging were consistently higher in another hospital. Iv administration of medication and fluids and admission was significantly more likely in two other hospitals, compared with others, for most presenting complaints.

CONCLUSIONS

Distinctive hospital-specific patterns in variability of management could be observed in these five paediatric EDs, which were consistent across different groups of clinical presentations. This could indicate fundamental differences in paediatric healthcare practice, influenced by differences in factors such as organisation of primary care, diagnostic facilities and available beds, professional culture and patient expectations.

Variation in hospital admission from the emergency department for children with cancer: A Pediatric Health Information System study

BACKGROUND

Children with cancer experience a wide range of conditions that require urgent evaluation in the emergency department (ED), yet variation in admission rates is poorly documented.

PROCEDURE

We performed a retrospective cohort study using the Pediatric Health Information System of ED encounters by children with cancer between July 2012 and June 2015. We compared demographics for admitted versus discharged using univariate statistics, and calculated admission rates by hospital, diagnosis, day of the week, and weekend versus weekday. We assessed the degree of interhospital admission rates using the index of dispersion (ID).

RESULTS

Children with cancer had 60 054 ED encounters at 37 hospitals. Overall, 62.5% were admitted (range 43.2%-92.1%, ID 2.6) indicating overdispersed admission rates with high variability. Children with cancer that visited the ED for a primary diagnosis of fever experienced the largest amount of variability in admission with rates ranging from 10.4% to 74.1% (ID 8.1). Less variability existed among hospital admission rates for both neutropenia (range 60%-100%, ID 1.0) and febrile neutropenia (FN) (range 66.7%-100%, ID 0.83). Admission rates by day of the week did not demonstrate significant variability for any of the scenarios examined (overall P = 0.91). There were no differences by weekend versus weekday either (overall P = 0.52).

CONCLUSION

The percentage of children with cancer admitted through the ED varies widely by institution and diagnosis. Standardization of best practices for children with cancer admitted through the ED should be an area of continued improvement.

The impact of pediatric emergency department crowding on patient and health care system outcomes: a multicentre cohort study

BACKGROUND

Emergency department overcrowding has been associated with increased odds of hospital admission and mortality after discharge from the emergency department in predominantly adult cohorts. The objective of this study was to evaluate the association between crowding and the odds of several adverse outcomes among children seen at a pediatric emergency department.

METHODS

We conducted a retrospective cohort study involving all children visiting 8 Canadian pediatric emergency departments across 4 provinces between 2010 and 2014. We analyzed the association between mean departmental length of stay for each index visit and hospital admission within 7 days or death within 14 days of emergency department discharge, as well as hospital admission at index visit and return visits within 7 days, using mixed-effects logistic regression modelling.

RESULTS

A total of 1 931 465 index visits occurred across study sites over the 5-year period, with little variation in index visit hospital admission or median length of stay. Hospital admission within 7 days of discharge and 14-day mortality were low across provinces (0.8%-1.5% and < 10 per 100 000 visits, respectively), and their association with mean departmental length of stay varied by triage categories and across sites but was not significant. There were increased odds of hospital admission at the index visit with increasing departmental crowding among visits triaged to Canadian Triage and Acuity Scale (CTAS) score 1-2 (odds ratios [ORs] ranged from 1.01 to 1.08) and return visits among patients with a CTAS score of 4-5 discharged at the index visit at some sites (ORs ranged from 1.00 to 1.06).

INTERPRETATION

Emergency department crowding was not significantly associated with hospital admission within 7 days of the emergency department visit or mortality in children. However, it was associated with increased hospital admission at the index visit for the sickest children, and with return visits to the emergency department for those less sick.

Factors Influencing Prescribing Decisions of Physicians: A Review

Background

The pharmaceutical bill is increasing at an alarming rate. The physician practice variation has a pronounced effect on healthcare spending. A number of factors can influence the prescribing behavior of physicians. The aim of this review was to identify the factors affecting the prescribing decision of physicians.

Methods

Electronic databases including Scopus, PubMed/MEDLINE CENTRAL, Cochrane Libraries and Google scholar were searched systematically for literatures on factors influencing prescribing decisions of physicians from 2000 to 2016. There was no restriction on the study designs.

Results

Thirty-three studies met the inclusion criteria from 1122 search results. A total of 33 factors were identified. The most frequent factors were patients' clinical condition, pharmaceutical industries, physician attributes, patient preference and cost of medicine.

Conclusion

Physicians' personal attributes, cost of the medicine and pharmaceutical industries' marketing and promotion strategies were mostly mentioned to influence prescribing decision. The identified factors showed that prescribing is not only geared for patient benefit, but also towards personal interest. The use of valid and reliable practice guidelines could reduce the negative impact of wide ranges of factors and promote the rational prescribing effectively.

Diversity in the emergency care for febrile children in Europe: a questionnaire study

OBJECTIVE

To provide an overview of care in emergency departments (EDs) across Europe in order to interpret observational data and implement interventions regarding the management of febrile children.

DESIGN AND SETTING

An electronic questionnaire was sent to the principal investigators of an ongoing study (PERFORM (Personalised Risk assessment in Febrile illness to Optimise Real-life Management), www.perform2020.eu) in 11 European hospitals in eight countries: Austria, Germany, Greece, Latvia, the Netherlands, Slovenia, Spain and the UK.

OUTCOME MEASURES

The questionnaire covered indicators in three domains: local ED quality (supervision, guideline availability, paper vs electronic health records), organisation of healthcare (primary care, immunisation), and local factors influencing or reflecting resource use (availability of point-of-care tests, admission rates).

RESULTS

Reported admission rates ranged from 4% to 51%. In six settings (Athens, Graz, Ljubljana, Riga, Rotterdam, Santiago de Compostela), the supervising ED physicians were general paediatricians, in two (Liverpool, London) these were paediatric emergency physicians, in two (Nijmegen, Newcastle) supervision could take place by either a general paediatrician or a general emergency physician, and in one (München) this could be either a general paediatrician or a paediatric emergency physician. The supervising physician was present on site in all settings during office hours and in five out of eleven settings during out-of-office hours. Guidelines for fever and sepsis were available in all settings; however, the type of guideline that was used differed. Primary care was available in all settings during office hours and in eight during out-of-office hours. There were differences in routine immunisations as well as in additional immunisations that were offered; immunisation rates varied between and within countries.

CONCLUSION

Differences in local, regional and national aspects of care exist in the management of febrile children across Europe. This variability has to be considered when trying to interpret differences in the use of diagnostic tools, antibiotics and admission rates. Any future implementation of interventions or diagnostic tests will need to be aware of this European diversity.

Variation in Pediatric Care Between Academic and Nonacademic US Emergency Departments, 1995-2010

OBJECTIVES

The aim of this study was to describe the resource utilization for children with common pediatric conditions treated in academic and nonacademic emergency departments (EDs).

METHODS

We performed a retrospective, cross-sectional descriptive study using the National Hospital Ambulatory Medical Care Survey Data from 1995 to 2010 including children less than 18 years old with a diagnosis of asthma, bronchiolitis, croup, gastroenteritis, fever, febrile seizure, or afebrile seizure. Academic EDs (A-ED) were those with greater than 25% of patients seen by a trainee. For each condition, we reported the proportion of testing, medications, and disposition between A-ED and nonacademic EDs (NA-ED).

RESULTS

From 1995 to 2010, approximately 450,000,000 estimated pediatric visits are represented by the survey based on 122,811 actual visits. For most common conditions, testing and disposition were comparable; however, some variation was noted. Among patients with bronchiolitis, a higher proportion of patients was admitted and had radiographs in NA-EDs (18% vs 10% and 56% vs 45%, respectively). For children with croup, radiographs were performed more often at NA-EDs (27% vs 6%). Among those with febrile seizures, more lumbar punctures were performed in NA-EDs (14% vs 0%). In children with afebrile seizures, more head computed tomography scans were obtained at NA-EDs (34% vs 21%).

CONCLUSION

Among pediatric patients with croup, bronchiolitis, and febrile and afebrile seizure, higher resource utilization and admissions were observed in NA-EDs. These preliminary findings from a national survey require a more detailed investigation into the variation in care between A-ED and NA-ED settings.

Implementing evidence-based medicine in a busy general hospital department: results and critical success factors

Implementing evidence-based medicine (EBM) in a busy hospital department is challenging, but when successful, may contribute to quality of care. This paper is a narrative review of the successes and challenges of deliberate implementation of EBM in a paediatric department in a general teaching hospital in Zwolle, the Netherlands. Key elements in this project were providing basic EBM education to the entire team of consultants and nurse practitioners, structurally embedding EBM activities into our weekly schedule and development of local practice guidelines. This deliberate practice of EBM principles has changed the way we treat common paediatric problems. It likely reduced unwarranted practice variation and promoted a reserved attitude towards the use of unnecessary diagnostics, which might improve delivery of effective, cost-conscious care. The project also positively influenced our group culture and learning environment. In accordance with previous reports, lack of time and reluctance to change routines and habits hindered the practice of EBM in our department. In our experience, these barriers can be overcome by promoting a team-wide endorsement of EBM, a willingness to acknowledge uncertainty and by deliberate practice. If these can be achieved, systematic application of EBM principles in a busy hospital department is feasible and worthwhile.

Overuse of CT and MRI in paediatric emergency departments

The aim of this review is to survey CT and MRI overuse in the paediatric emergency department (ED) population. CT is one of the most important modalities employed in the ED. Not surprisingly, its high accuracy, rapid acquisition and availability have resulted in overuse. An obvious limitation of CT is ionizing radiation; in addition there are economic implications to overuse. Studies from the last two decades have shown increase in paediatric ED CT utilization in the first decade, reaching a plateau forming around 2008, followed by a decrease in the last decade. This decrease occurred in conjunction with campaigns raising awareness to the risks of radiation exposure. Although a trend of decrease in overuse have been observed, great variability has been shown across different facilities, as well as among physicians, with more pronounced overuse in non-teaching and non-children dedicated EDs. The leading types of paediatric ED CTs are head and abdominal scans. Decision rules, such as PECARN for head injury and the Alvarado score for abdominal pain, as well as using alternative imaging modalities, have been shown to reduce CT overuse in these two categories. MRI has the obvious benefit of avoiding radiation exposure, but the disadvantages of higher costs, less availability and less tolerability in younger children. Although anecdotally paediatric ED MRI usage has increased in recent years, only scarce reports have been published. In our opinion, there is need to conduct up-to-date studies covering paediatric CT and MRI overuse trends, usage variability and adherence to clinical protocols.

Practice Variation and Effects of E-mail-only Performance Feedback on Resource Use in the Emergency Department

OBJECTIVES

Higher resource utilization in the management of pediatric patients with undifferentiated vomiting and/or diarrhea does not correlate consistently with improved outcomes or quality of care. Performance feedback has been shown to change physician practice behavior and may be a mechanism to minimize practice variation. We aimed to evaluate the effects of e-mail-only, provider-level performance feedback on the ordering and admission practice variation of pediatric emergency physicians for patients presenting with undifferentiated vomiting and/or diarrhea.

METHODS

We conducted a prospective, quality improvement intervention and collected data over 3 consecutive fiscal years. The setting was a single, tertiary care pediatric emergency department. We collected admission and ordering practices data on 19 physicians during baseline, intervention, and postintervention periods. We provided physicians with quarterly e-mail-based performance reports during the intervention phase. We measured admission rate and created four categories for ordering practices: no orders, laboratory orders, pharmacy orders, and radiology orders.

RESULTS

There was wide (two- to threefold) practice variation among physicians. Admission rates ranged from 15% to 30%, laboratory orders from 19% to 43%, pharmacy orders from 29% to 57%, and radiology orders from 11% to 30%. There was no statistically significant difference in the proportion of patients admitted or with radiology or pharmacy orders placed between preintervention, intervention, or postintervention periods (p = 0.58, p = 0.19, and p = 0.75, respectively). There was a significant but very small decrease in laboratory orders between the preintervention and postintervention periods.

CONCLUSIONS

Performance feedback provided only via e-mail to pediatric emergency physicians on a quarterly basis does not seem to significantly impact management practices for patients with undifferentiated vomiting and/or diarrhea.

Self-awareness of computed tomography ordering in the emergency department

OBJECTIVES

Physician variation in the use of computed tomography (CT) is concerning due to the risks of ionizing radiation, cost, and downstream effects of unnecessary testing. The objectives of this study were to describe variation in CT-ordering rates among emergency physicians (EPs), to measure correlation between perceived and actual CT-ordering rates, to assess attitudes that influence decisions to order imaging tests, and to identify EP attitudes associated with higher CT utilization.

METHODS

This study was a retrospective review of imaging and administrative billing records at two emergency department sites of a tertiary care adult teaching hospital. The study also included a cross-sectional survey of EPs at this hospital. We asked physicians about their perceived ordering behaviour, and what factors influenced their decision to order a CT. We examined correlations between perceived and actual CT-ordering rates. We adjusted ordering rates for shift distribution using a logistic regression model and identified outlier physicians whose ordering rate was significantly lower or higher than expected. We used multivariable regression analysis to determine which survey responses predicted higher CT utilization.

RESULTS

During the study period, 59 EPs saw 45,854 patients, and ordered 6,609 CTs - a mean ordering rate of 14.4% (standard deviation (SD)=4.3%). The ordering rate for individual physicians ranged from 5.9% to 25.9%. Of the 59 EPs, 13 EPs were low-ordering outliers; 12 were high-ordering outliers. Forty-five EPs (76.3%) completed the survey. Mean perceived ordering rate was 12.6%, and was weakly correlated with actual ordering (r=0.19, p=0.21). 42 EPs (93.3%) believed they ordered "about the same" or "fewer" CTs than their peers. Of the 17 EPs in the two highest ordering quintiles, only 3 (18%) knew they were high orderers. In the multivariable analysis, higher ordering was associated with increasing strength of response to the following predictors: medico-legal risk (relative risk [RR]=1.18, 95% CI: 1.03-1.21), risk of contrast (RR=1.14, 95% CI: 1.07-1.22), what colleagues would do (RR=1.09, 95% CI: 0.99-1.19), risk of missing a diagnosis (RR=1.08, 95% CI: 0.98-1.21), and patient wishes (RR=1.07, 95% CI: 0.97-1.17).

CONCLUSIONS

There is large variation in CT ordering among EPs. Physicians' self-reported ordering rate correlates poorly with actual ordering. High CT orderers were rarely aware that they ordered more than their colleagues. Higher rates of ordering were observed among physicians who reported increased concern with 1) risk of missing a diagnosis, 2) medico-legal risk, 3) risk of contrast, 4) patient wishes, and 5) what colleagues would do.

Association of Hospital Resources and Imaging Choice for Appendicitis in Pediatric Emergency Departments

OBJECTIVE

Abdominal pain and concern for appendicitis are common chief complaints in patients presenting to the pediatric emergency department (PED). Although many professional organizations recommend decreasing use of computed tomography (CT) and choosing ultrasound as first-line imaging for pediatric appendicitis, significant variability persists in imaging utilization. This study investigated practice variation across children's hospitals in the diagnostic imaging evaluation of appendicitis and determined hospital-level characteristics associated with the likelihood of ultrasound as the first imaging modality.

METHODS

This was a multicenter (seven children's hospitals) retrospective investigation. Data from chart review of 160 consecutive patients aged 3-18 years diagnosed with appendicitis from each site were compared with a survey of site medical directors regarding hospital resource availability, usual practices, and departmental-level demographics.

RESULTS

In the diagnostic evaluation of 1,090 children with appendicitis, CT scan was performed first for 22.4% of patients, with a range across PEDs of 3.1% to 83.8%. Ultrasound was performed for 54.0% of patients with a range of 2.5% to 96.9%. The only hospital-level factor significantly associated with ultrasound as the first imaging modality was 24-hour availability of in-house ultrasound (odds ratio = 29.2, 95% confidence interval = 1.2-691.8).

CONCLUSION

Across children's hospitals, significant practice variation exists regarding diagnostic imaging in the evaluation of patients with appendicitis. Variation in hospital-level resources may impact the diagnostic evaluation of patients with appendicitis. Availability of 24-hour in-house ultrasound significantly increases the likelihood of ultrasound as first imaging and decreases CT scans. Hospitals aiming to increase the use of ultrasound should consider adding 24-hour in-house coverage.

Variation in Computed Tomography Use for Evaluation of Head Injury in a Pediatric Emergency Department

OBJECTIVES

Recent research has shown significant variation in rates of computed tomography (CT) use among pediatric hospital emergency departments (ED) for evaluation of head injured children. We examined the rates of CT use by individual ED attending physicians for evaluation of head injured children in a pediatric hospital ED.

METHODS

We used an administrative database to identify children younger than 18 years evaluated for head injury from January 2011 through March 2013 at our children's hospital ED, staffed by pediatric emergency medicine (PEM) fellowship trained physicians and pediatricians. We excluded encounters with trauma team activation or previous head CT performed elsewhere. We excluded physicians whose patient volume was less than 1 standard deviation below the group mean.

RESULTS

After exclusions, we evaluated 5340 encounters for head injury by 27 ED attending physicians. For individual physicians, CT rates ranged from 12.4% to 37.3%, with a mean group rate of 28.4%. Individual PEM physician CT rates ranged from 18.9% to 37.3%, versus 12.4% to 31.8% for pediatricians. Of the 1518 encounters in which CT was done, 128 (8.4%) had a traumatic brain injury on CT, and 125 (8.2%) had a simple skull fracture without traumatic brain injury on CT. Patient factors associated with CT use included age younger than 2 years, higher triage acuity, arrival time of 10:00 PM to 6:00 AM, hospital admission, and evaluation by a PEM physician.

CONCLUSIONS

Physicians at our pediatric hospital ED varied in the use of CT for the evaluation of head-injured children.

The Association Between Physician Empathy and Variation in Imaging Use

BACKGROUND

Variation in emergency physician computed tomography (CT) imaging utilization is well described, but little is known about what drives it. Physician empathy has been proposed as a potential characteristic affecting CT utilization.

OBJECTIVES

The objective was to describe empathy in a cohort of emergency physicians and evaluate its association with CT utilization. We also sought to compare emergency physician performance on an empathy psychometric test with performance on other psychometric tests previously proposed as predictors of CT utilization.

METHODS

This cross-sectional study included two parts: 1) a secondary analysis of emergency department (ED) CT imaging utilization data in a large health system from July 2013 to June 2014 and 2) a survey study of the cohort of physicians responsible for this imaging using four psychometric scales: the Jefferson Scale of Empathy (JSE), a risk-taking subset of the Jackson Personality Index (RTS), the Stress from Uncertainty Scale (SUS), and the Malpractice Fear Scale (MFS). The study included data and physicians from four EDs: one urban, academic ED, two community, and one free-standing. A hierarchical, mixed-effects regression model was used to evaluate the association between emergency physician performance on the four scales and risk-adjusted CT imaging utilization. The model incorporated physician-specific CT utilization rates adjusted for propensity scores that were calculated using over 500 patient-level variables via random forest methods, physician demographics, and a random provider effect to account for the clustering of observations.

RESULTS

CT variation analysis included 113,517 patients seen during the study period by the 74 eligible emergency physician survey respondents; 20,972 (18.5%) of these patients had at least one CT. The survey response rate was 74 of 82 (90.2%). Correlation coefficients between JSE and the other scales were not statistically significant. In subset analysis, there was a trend toward a physician's number of years in practice and RTS score contributing to CT utilization for traumatic head CT. There were no significant associations between performance on any of the psychometric scales and CT utilization.

CONCLUSIONS

Performance on the JSE, RTS, SUS, or MFS was not predictive of risk-adjusted CT utilization in the ED. The underlying physician-based factors that mediate interphysician variation remain to be clearly identified.

Tools for 'safety netting' in common paediatric illnesses: a systematic review in emergency care

CONTEXT

Follow-up strategies after emergency department (ED) discharge, alias safety netting, is often based on the gut feeling of the attending physician.

OBJECTIVE

To systematically identify evaluated safety-netting strategies after ED discharge and to describe determinants of paediatric ED revisits.

DATA SOURCES

MEDLINE, Embase, CINAHL, Cochrane central, OvidSP, Web of Science, Google Scholar, PubMed.

STUDY SELECTION

Studies of any design reporting on safety netting/follow-up after ED discharge and/or determinants of ED revisits for the total paediatric population or specifically for children with fever, dyspnoea and/or gastroenteritis. Outcomes included complicated course of disease after initial ED visit (eg, revisits, hospitalisation).

DATA EXTRACTION

Two reviewers independently assessed studies for eligibility and study quality. As meta-analysis was not possible due to heterogeneity of studies, we performed a narrative synthesis of study results. A best-evidence synthesis was used to identify the level of evidence.

RESULTS

We summarised 58 studies, 36% (21/58) were assessed as having low risk of bias. Limited evidence was observed for different strategies of safety netting, with educational interventions being mostly studied. Young children, a relevant medical history, infectious/respiratory symptoms or seizures and progression/persistence of symptoms were strongly associated with ED revisits. Gender, emergency crowding, physicians' characteristics and diagnostic tests and/or therapeutic interventions at the index visit were not associated with revisits.

CONCLUSIONS

Within the heterogeneous available evidence, we identified a set of strong determinants of revisits that identify high-risk groups in need for safety netting in paediatric emergency care being related to age and clinical symptoms. Gaps remain on intervention studies concerning specific application of a uniform safety-netting strategy and its included time frame.

Variation in Utilization of Computed Tomography Imaging at Tertiary Pediatric Hospitals

BACKGROUND

Recent efforts have focused on reducing computed tomography (CT) imaging in children. Although published reports show variability in CT scanning for specific indications, an assessment of the effects of institutional factors (case-mix or hospital volume) on the rate of CT scanning for any indication is necessary to better understand variability across pediatric hospitals.

METHODS

Data from 2009 to 2013 on inpatient, observation, and emergency department (ED) encounters were extracted from the Pediatric Health Information System. Chronological trends and institutional variability in CT scan rates were examined by using negative binomial regression models. Case-mix was adjusted by using All Patient Refined Diagnosis Related Groups and severity level.

RESULTS

Thirty hospitals were included. There were 12 531 184 patient encounters and 701 644 CT scans resulting in a mean of 56 scans per 1000 encounters (range: 26-108). The most common scan types were head (60.1%) and abdomen/pelvis (19.9%). There was an inverse relationship between the CT scan rate and hospital volume (P = .002) and a direct relationship between the CT scan rates for inpatient/observation and ED encounters (P < .001). The rate of CT imaging decreased from 69.2 to 49.6 scans per 1000 encounters during the study period (P < .001).

CONCLUSIONS

The overall use of CT imaging is decreasing, and significant variability remains in CT use across tertiary pediatric hospitals. Hospital volume and institutional-level practices account for a significant portion of the variability. This finding suggests an opportunity for standardization through multi-institutional quality improvement projects to reduce CT imaging.

Impact of Physician Scorecards on Emergency Department Resource Use, Quality, and Efficiency

BACKGROUND AND OBJECTIVES

Variability in practice patterns and resource use in the emergency department (ED) can affect costs without affecting outcomes. ED quality measures have not included resource use in relation to ED outcomes and efficiency. Our objectives were to develop a tool for comprehensive physician feedback on practice patterns relative to peers and to study its impact on resource use, quality, and efficiency.

METHODS

We evaluated condition-specific resource use (laboratory tests; imaging; antibiotics, intravenous fluids, and ondansetron; admission) by physicians at 2 tertiary pediatric EDs for 4 common conditions (fever, head injury, respiratory illness, gastroenteritis). Resources used, ED length of stay (efficiency measure), and 72-hour return to ED (return rate [RR]) (balancing measure) were reported on scorecards with boxplots showing physicians their practice relative to peers. Quarterly scorecards were distributed for baseline (preintervention, July 2009-August 2010) and postintervention (September 2010-December 2011). Preintervention, postintervention, and trend analyses were performed.

RESULTS

In 51 450 patient visits (24 834 preintervention, 26 616 postintervention) seen by 96 physicians, we observed reduced postintervention use of abdominal and pelvic and head computed tomography scans, chest radiographs, intravenous antibiotics, and ondansetron (P < .01 for all). Hospital admissions decreased from 7.4% to 6.7% (P = .002), length of stay from 112 to 108 minutes (P < .001), and RR from 2.2% to 2.0%. Trends for use of laboratory tests and intravenous antibiotics showed significant reduction (P < .001 and P < .05, respectively); admission trends increased, and trends for use of computed tomography scans and plain abdominal radiographs showed no change.

CONCLUSIONS

Physician feedback on practice patterns relative to peers results in reduction in resource use for several common ED conditions without adversely affecting ED efficiency or quality of care.

Variation in the Diagnosis and Management of Appendicitis at Canadian Pediatric Hospitals

OBJECTIVES

The objective was to characterize the variations in practice in the diagnosis and management of children admitted to hospitals from Canadian pediatric emergency departments (EDs) with suspected appendicitis, specifically the timing of surgical intervention, ED investigations, and management strategies.

METHODS

Twelve sites participated in this retrospective health record review. Children aged 3 to 17 years admitted to the hospital with suspected appendicitis were eligible. Site-specific demographics, investigations, and interventions performed were recorded and compared. Factors associated with after-hours surgery were determined using generalized estimating equations logistic regression.

RESULTS

Of the 619 children meeting eligibility criteria, surgical intervention was performed in 547 (88%). After-hours surgery occurred in 76 of the 547 children, with significant variation across sites (13.9%, 95% confidence interval = 7.1% to 21.6%, p < 0.001). The overall perforation rate was 17.4% (95 of 547), and the negative appendectomy rate was 6.8% (37 of 547), varying across sites (p = 0.004 and p = 0.036, respectively). Use of inflammatory markers (p < 0.001), blood cultures (p < 0.001), ultrasound (p = 0.001), and computed tomography (p = 0.001) also varied by site. ED administration of narcotic analgesia and antibiotics varied across sites (p < 0.001 and p = 0.001, respectively), as did the type of surgical approach (p < 0.001). After-hours triage had a significant inverse association with after-hours surgery (p = 0.014).

CONCLUSIONS

Across Canadian pediatric EDs, there exists significant variation in the diagnosis and management of children with suspected appendicitis. These results indicate that the best diagnostic and management strategies remain unclear and support the need for future prospective, multicenter studies to identify strategies associated with optimal patient outcomes.

Cost-effectiveness of diagnostic approaches to suspected appendicitis in children

BACKGROUND

Our group recently published a clinical pathway (Le Bonheur Clinical Pathway [LeB-P]) that used the Samuel Pediatric Appendicitis Score with selective use of ultrasonography (USG) for diagnosis of children at risk for appendicitis. The objective of this study was to model the cost-effectiveness of implementing the LeB-P compared with usual care.

STUDY DESIGN

We constructed a decision analytic model comparing hospital costs for the following diagnostic strategies for suspected appendicitis: emergency department clinician judgment alone, USG on all patients, CT on all patients, overnight observation with surgical evaluation without studies, and the LeB-P. Prevalence of disease, outcomes probabilities, and hospital and professional costs for each option were derived from published literature, national cost data, and our previous study results. Cost-effectiveness was calculated using these 3 sets of parameters.

RESULTS

In the base case model, USG was the preferred strategy over LeB-P and overnight observation with surgical evaluation without studies. Emergency department clinician judgment alone and CT were dominated by the other pathways, based on either lower diagnostic accuracy or increased costs. Compared with LeB-P, USG costs $337 less per patient evaluated, but increased the diagnostic error rate by 2%. Using LeB-P rather than USG would cost an institution an additional $17,206 to eliminate one misdiagnosis, which is known as the incremental cost-effectiveness ratio.

CONCLUSIONS

Although performing USG on all children with suspected appendicitis was determined to be the most cost-effective strategy, using the Pediatric Appendicitis Score with selective use of USG (LeB-P) improved diagnostic accuracy at a moderate increase in cost and decreased CT use.

Factors associated with prolonged stay in a pediatric emergency observation unit of an urban tertiary children's hospital in China

OBJECTIVES

This study aimed to examine the factors associated with increased length of stay (LOS > 24 hours) in the pediatric emergency observation unit (OU) of an urban tertiary children's hospital in China.

METHODS

This study was a retrospective cohort study. We retrieved and examined all the records of patients (age, 0-16 years) who were admitted to the OU (n = 10,852) during July 1, 2008, to June 30, 2009. The primary outcome was LOS and prolonged stay (LOS > 24 hours). We also performed a sensitivity analysis by using LOS of 3 days or greater and LOS of 6 days or greater as dependent variables in logistic regression and compared with LOS of greater than 24 hours regression to examine the robustness of the associations.

RESULTS

The overall mean (SD) LOS was 24.0 (24.4) hours; 31.3% had LOS of greater than 24 hours, of which the mean (SD) LOS was 50.2 (28.6) hours. The following factors were associated with LOS of greater than 24 hours: age, 28 days to 3 months (odds ratio, [OR], 1.87; 95% confidence interval, 1.36-2.59) and older than 3 months to 12 months (OR, 1.83; 95% CI, 1.35-2.50) compared with age 0 to 28 days; neurologic diseases (OR, 1.50; 95% CI, 1.31-1.72), infectious diseases (OR, 2.00; 95% CI, 1.61-2.49), and visits for non-respiratory-related signs and symptoms (OR, 2.00; 95% CI, 1.61-2.49); acuity level of emergent (OR, 1.79; 95% CI, 1.57-2.04); procedures (OR, 7.09; 95% CI, 4.16-12.10); emergency transfusions (OR, 1.33; 95% CI, 1.01-1.75); staffed by residents (OR, 1.12; 95% CI, 1.01-1.24); and patients living in low-annual gross domestic product districts (OR, 1.14; 95% CI, 1.01-1.29). Arrival at evening (OR, 0.54; 95% CI, 0.49-0.60) and overnight (OR, 0.43; 95% CI, 0.38-0.49) were less likely to have LOS of greater than 24 hours than arrival during day shifts.

CONCLUSIONS

We identified some risk factors for prolonged stay in an OU. These factors are the starting points in understanding issues related to prolonged stay and are needed to assess efficiency and quality of care in pediatric emergency department and OU. Our results have provided information basis for making improvements in the system and may be important considerations for similar institutions, which encounter similar challenges.

Physician performance assessment using a composite quality index

Assessing physician performance is important for the purposes of measuring and improving quality of service and reducing healthcare delivery costs. In recent years, physician performance scorecards have been used to provide feedback on individual measures; however, one key challenge is how to develop a composite quality index that combines multiple measures for overall physician performance evaluation. A controversy arises over establishing appropriate weights to combine indicators in multiple dimensions, and cannot be easily resolved. In this study, we proposed a generic unsupervised learning approach to develop a single composite index for physician performance assessment by using non-negative principal component analysis. We developed a new algorithm named iterative quadratic programming to solve the numerical issue in the non-negative principal component analysis approach. We conducted real case studies to demonstrate the performance of the proposed method. We provided interpretations from both statistical and clinical perspectives to evaluate the developed composite ranking score in practice. In addition, we implemented the root cause assessment techniques to explain physician performance for improvement purposes.

Advanced nursing directives: integrating validated clinical scoring systems into nursing care in the pediatric emergency department

In an effort to improve the quality and flow of care provided to children presenting to the emergency department the implementation of nurse-initiated protocols is on the rise. We review the current literature on nurse-initiated protocols, validated emergency department clinical scoring systems, and the merging of the two to create Advanced Nursing Directives (ANDs). The process of developing a clinical pathway for children presenting to our pediatric emergency department (PED) with suspected appendicitis will be used to demonstrate the successful integration of validated clinical scoring systems into practice through the use of Advanced Nursing Directives. Finally, examples of 2 other Advanced Nursing Directives for common clinical PED presentations will be provided.

Pediatric emergency department crowding is associated with a lower likelihood of hospital admission

OBJECTIVES

Emergency department (ED) crowding may affect disposition decision-making. The objective was to measure the effect of ED crowding on probability of admission and return visit to the ED after discharge.

METHODS

The authors studied a historical cohort at a large pediatric ED over 40 months. Each patient was assigned a score on arrival based on the ED occupancy rate (the ratio of patients to beds). Patients were divided into quintiles by occupancy rate. The proportion admitted for each quintile was compared to the least crowded quintile adjusting for acuity, hospital occupancy, and time of arrival. The same analysis was performed for return visits to the ED within 48 hours. The analyses were repeated for the subsets of patients with asthma and with gastroenteritis and/or dehydration.

RESULTS

From the 40 months of historical data, 198,778 visits were analyzed. The adjusted odds ratio (aOR) for admission among the whole cohort was 0.85 (95% confidence interval [CI]=0.81 to 0.89) comparing the highest to the lowest crowding quintiles (occupancy rate >1.17 and <0.54, respectively). For asthma patients, aOR=0.93 (95% CI=0.72 to 1.20), and for gastroenteritis patients, aOR=0.87 (95% CI=0.65 to 1.17). The aOR of return visits comparing the highest to the lowest crowding quintiles for all patients was aOR=0.87 (95% CI=0.79 to 0.97), for asthma patients was aOR=1.52 (95% CI=0.95 to 2.46), and for gastroenteritis patients was aOR=0.83 (95% CI=0.54 to 1.28).

CONCLUSIONS

Increasing ED crowding is associated with a lower likelihood of hospital admission and lower frequency of return visits within 48 hours.

Assessment of Medicare's imaging efficiency measure for emergency department patients with atraumatic headache

STUDY OBJECTIVE

Computed tomography (CT) use has increased rapidly, raising concerns about radiation exposure and cost. The Centers for Medicare & Medicaid Services (CMS) developed an imaging efficiency measure (Outpatient Measure 15 [OP-15]) to evaluate the use of brain CT in the emergency department (ED) for atraumatic headache. We aim to determine the reliability, validity, and accuracy of OP-15.

METHODS

This was a retrospective record review at 21 US EDs. We identified 769 patient visits that CMS labeled as including an inappropriate brain CT to identify clinical indications for CT and reviewed the 748 visits with available records. The primary outcome was the reliability of OP-15 as determined by CMS from administrative data compared with medical record review. Secondary outcomes were the measure's validity and accuracy. Outcome measures were defined according to the testing protocol of the American Medical Association's Physician Consortium for Performance Improvement.

RESULTS

On record review, 489 of 748 ED brain CTs identified as inappropriate by CMS had a measure exclusion documented that was not identified by administrative data; the measure was 34.6% reliable (95% confidence interval [CI] 31.2% to 38.0%). Among the 259 patient visits without measure exclusions documented in the record, the measure's validity was 47.5% (95% CI 41.4% to 53.6%), according to a consensus list of indications for brain CT. Overall, 623 of the 748 ED visits had either a measure exclusion or a consensus indication for CT; the measure's accuracy was 16.7% (95% CI 14% to 19.4%). Hospital performance as reported by CMS did not correlate with the proportion of CTs with a documented clinical indication (r=-0.11; P=.63).

CONCLUSION

The CMS imaging efficiency measure for brain CTs (OP-15) is not reliable, valid, or accurate and may produce misleading information about hospital ED performance.

Emergency medicine: an operations management view

Operations management (OM) is the science of understanding and improving business processes. For the emergency department (ED), OM principles can be used to reduce and alleviate the effects of crowding. A fundamental principle of OM is the waiting time formula, which has clear implications in the ED given that waiting time is fundamental to patient-centered emergency care. The waiting time formula consists of the activity time (how long it takes to complete a process), the utilization rate (the proportion of time a particular resource such a staff is working), and two measures of variation: the variation in patient interarrival times and the variation in patient processing times. Understanding the waiting time formula is important because it presents the fundamental parameters that can be managed to reduce waiting times and length of stay. An additional useful OM principle that is applicable to the ED is the efficient frontier. The efficient frontier compares the performance of EDs with respect to two dimensions: responsiveness (i.e., 1/wait time) and utilization rates. Some EDs may be "on the frontier," maximizing their responsiveness at their given utilization rates. However, most EDs likely have opportunities to move toward the frontier. Increasing capacity is a movement along the frontier and to truly move toward the frontier (i.e., improving responsiveness at a fixed capacity), we articulate three possible options: eliminating waste, reducing variability, or increasing flexibility. When conceptualizing ED crowding interventions, these are the major strategies to consider.

Achieving efficiency in crowded emergency departments: a research agenda

In 2011, Academic Emergency Medicine convened a consensus conference entitled "Interventions to Assure Quality in the Crowded Emergency Department." This article, a product of the breakout session on "interventions to safeguard efficiency of care," explores various elements of the research agenda on efficiency and quality in crowded emergency departments (EDs). The authors discuss four areas identified as critical to achieving progress in the research agenda for improving ED efficiency: 1) What measures can be used to understand and improve the efficiency and quality of interventions in the ED? 2) Which factors outside of the ED's control affect ED efficiency? 3) How do workforce factors affect ED efficiency? 4) How do ED design, patient flow structures, and use of technology affect efficiency? Filling these knowledge gaps is vital to identifying interventions that improve the delivery of emergency care in all EDs.