A qualitative study of emergency physicians' perspectives on PROMS in the emergency department

INTRODUCTION

There is a growing emphasis on including patients' perspectives on outcomes as a measure of quality care. To date, this has been challenging in the emergency department (ED) setting. To better understand the root of this challenge, we looked to ED physicians' perspectives on their role, relationships and responsibilities to inform future development and implementation of patient-reported outcome measures (PROMs).

METHODS

ED physicians from hospitals across Canada were invited to participate in interviews using a snowballing sampling technique. Semistructured interviews were conducted by phone with questions focused on the role and practice of ED physicians, their relationship with their patients and their thoughts on patient-reported feedback as a mechanism for quality improvement. Transcripts were analysed using a modified constant comparative method and interpretive descriptive framework.

RESULTS

Interviews were completed with 30 individual physicians. Respondents were diverse in location, training and years in practice. Physicians reported being interested in 'objective' postdischarge information including adverse events, readmissions, other physicians' notes, etc in a select group of complex patients, but saw 'patient-reported' feedback as less valuable due to perceived biases. They were unsure about the impact of such feedback mainly because of the episodic nature of their work. Concerns about timing, as well as about their legal and ethical responsibilities to follow-up if poor patient outcomes are reported, were raised.

CONCLUSIONS

Data collection and feedback are key elements of a learning health system. While patient-reported outcomes may have a role in feedback, ED physicians are conflicted about the actionability of such data and ethical implications, given the inherently episodic nature of their work. These findings have important implications for PROM design and implementation in this unique clinical setting.

Building Bridges to Integrate Care (BRIDGES): Incubating Health Service Innovation across the Continuum of Care for Patients with Multiple Chronic Conditions

Integrating care for people with complex needs is challenging. Indeed, evidence of solutions is mixed, and therefore, well-designed, shared evaluation approaches are needed to create cumulative learning. The Toronto-based Building Bridges to Integrate Care (BRIDGES) collaborative provided resources to refine and test nine new models linking primary, hospital and community care. It used mixed methods, a cross-project meta-evaluation and shared outcome measures. Given the range of skills required to develop effective interventions, a novel incubator was used to test and spread opportunities for system integration that included operational expertise and support for evaluation and process improvement.

Institute for Clinical Evaluative Sciences (ICES) Exploratory Data & Analytic Services Private Sector Pilot Project

ABSTRACTObjectivesPrior to the launch of ICES Data & Analytic Services (DAS) in March 2014, only ICES scientists and analysts could access ICES data, and data could only be accessed at physical ICES locations. The DAS infrastructure, which allows public sector researchers to work with coded record level data remotely through a secure virtual environment, together with broader trends including high profile reports that call for increased access to data and the Ontario government’s Open Data initiative, prompted ICES to launch a pilot project to explore potential DAS work with the private sector. ApproachThree mandatory principles were established for all work with the private sector: (i) alignment with ICES’ mission, vision and values; (ii) transparency; (iii) private sector work must not detract from ICES’ research institute work. The pilot included: a jurisdictional scan; informal conversations with private sector organizations to determine potential services/studies of interest; extensive discussions with data partners; the selection and conduct of two pilot studies; focus groups with members of the general public and scientists; external advice on business model options; and an external evaluation of the pilot. No changes to data sharing agreements or ICES processes were required as work with the private sector and public sector are equally allowed under Ontario law. ResultsThe two pilot studies were successfully completed. The first study “The disease burden of gout in Ontario: A real world data retrospective study” was performed by researchers at IMS Brogan (a healthcare analytic services provider) who were provided with access to coded record-level data using the DAS iDAVE environment and performed their own analyses. In the second pilot study, “The impact of adherence to biologics on healthcare resource utilization in rheumatoid arthritis”, Janssen researchers established the research question and study design, and DAS staff and scientists provided advice about data holdings, performed the analyses, and provided Janssen and three government-funded decision making bodies with results tables. Research Ethics Board approval was required for both studies, and both private sector organizations are in the process of publishing findings. ConclusionsICES was able to work with private sector organizations without compromising the three principles. Based on the evaluation of the private sector pilot, and the findings from the focus groups, ICES will begin offering limited analytic services to private sector researchers beginning June 2016 under ICES’ existing corporate structure, and bring recommendations regarding ongoing operations to the ICES Board in June 2017.

Study protocol for evaluating the implementation and effectiveness of an emergency department longitudinal patient monitoring system using a mixed-methods approach

BACKGROUND

Early detection of patient deterioration is a key element of patient safety as it allows timely clinical intervention and potential rescue, thus reducing the risks of serious patient safety incidents. Longitudinal patient monitoring systems have been widely recommended for use to detect clinical deterioration. However, there is conflicting evidence on whether they improve patient outcomes. This may in part be related to variation in the rigour with which they are implemented and evaluated. This study aims to evaluate the implementation and effectiveness of a longitudinal patient monitoring system designed for adult patients in the unique environment of the Emergency Department (ED).

METHODS

A novel participatory action research (PAR) approach is taken where socio-technical systems (STS) theory and analysis informs the implementation through the improvement methodology of 'Plan Do Study Act' (PDSA) cycles. We hypothesise that conducting an STS analysis of the ED before beginning the PDSA cycles will provide for a much richer understanding of the current situation and possible challenges to implementing the ED-specific longitudinal patient monitoring system. This methodology will enable both a process and an outcome evaluation of implementing the ED-specific longitudinal patient monitoring system. Process evaluations can help distinguish between interventions that have inherent faults and those that are badly executed.

DISCUSSION

Over 1.2 million patients attend EDs annually in Ireland; the successful implementation of an ED-specific longitudinal patient monitoring system has the potential to affect the care of a significant number of such patients. To the best of our knowledge, this is the first study combining PAR, STS and multiple PDSA cycles to evaluate the implementation of an ED-specific longitudinal patient monitoring system and to determine (through process and outcome evaluation) whether this system can significantly improve patient outcomes by early detection and appropriate intervention for patients at risk of clinical deterioration.

CAEP 2015 Academic Symposium: Recommendations for University Governance and Administration for Emergency Medicine

OBJECTIVE

1) To identify the strengths and challenges of governance structures in academic emergency medicine (EM), and 2) to make recommendations on principles and approaches that may guide improvements.

METHODS

Over the course of 9 months, eight established EM leaders met by teleconference, reviewed the literature, and discussed their findings and experiences to arrive at recommendations on governance in academic units of EM. The results and recommendations were presented at the annual Canadian Association of Emergency Physicians (CAEP) Academic Symposium, where attendees provided feedback. The updated recommendations were subsequently distributed to the CAEP Academic Section for further input, and the final recommendations were decided by consensus.

RESULTS

The panel identified four governance areas of interest: 1) the elements of governance; 2) the relationships between emergency physicians and academic units of EM, and between the academic units of EM and faculty of medicine; 3) current status of governance in Canadian academic units of EM; and 4) essential elements of good governance. Six recommendations were developed around three themes, including 1) the importance of good governance; 2) the purposes of an academic unit of EM; and 3) essential elements for better governance for academic units of EM. Recommendations included identifying the importance of good governance, recognizing the need to adapt to the different models depending on the local environment; seeking full departmental status, provided it is mutually beneficial to EM and the faculty of medicine (and health authority); using a consultation service to learn from the experience of other academic units of EM; and establishing an annual forum for EM leaders.

CONCLUSION

Although governance of academic EM is complex, there are ways to iteratively improve the mission of academic units of EM: providing exceptional patient care through research and education. Although there is no one-size-fits-all guide, there are practical recommended steps for academic units of EM to consider.

Capturing the experiences of patients across multiple complex interventions: a meta-qualitative approach

OBJECTIVES

The perspectives, needs and preferences of individuals with complex health and social needs can be overlooked in the design of healthcare interventions. This study was designed to provide new insights on patient perspectives drawing from the qualitative evaluation of 5 complex healthcare interventions.

SETTING

Patients and their caregivers were recruited from 5 interventions based in primary, hospital and community care in Ontario, Canada.

PARTICIPANTS

We included 62 interviews from 44 patients and 18 non-clinical caregivers.

INTERVENTION

Our team analysed the transcripts from 5 distinct projects. This approach to qualitative meta-evaluation identifies common issues described by a diverse group of patients, therefore providing potential insights into systems issues.

OUTCOME MEASURES

This study is a secondary analysis of qualitative data; therefore, no outcome measures were identified.

RESULTS

We identified 5 broad themes that capture the patients' experience and highlight issues that might not be adequately addressed in complex interventions. In our study, we found that: (1) the emergency department is the unavoidable point of care; (2) patients and caregivers are part of complex and variable family systems; (3) non-medical issues mediate patients' experiences of health and healthcare delivery; (4) the unanticipated consequences of complex healthcare interventions are often the most valuable; and (5) patient experiences are shaped by the healthcare discourses on medically complex patients.

CONCLUSIONS

Our findings suggest that key assumptions about patients that inform intervention design need to be made explicit in order to build capacity to better understand and support patients with multiple chronic diseases. Across many health systems internationally, multiple models are being implemented simultaneously that may have shared features and target similar patients, and a qualitative meta-evaluation approach, thus offers an opportunity for cumulative learning at a system level in addition to informing intervention design and modification.

Are reductions in emergency department length of stay associated with improvements in quality of care? A difference-in-differences analysis

Background

We sought to determine whether patients seen in hospitals who had reduced overall emergency department (ED) length of stay (LOS) in the 2 years following the introduction of the Ontario Emergency Room Wait Time Strategy were more likely to experience improvements in other measures of ED quality of care for three important conditions.

Methods

Retrospective medical record review using difference-in-differences analysis to compare changes in performance on quality indicators over the 3-year period between 11 Ontario hospitals where the median ED LOS had improved from fiscal year 2008 to 2010 and 13 matched sites where ED LOS was unchanged or worsened. Patients with acute myocardial infarction (AMI), asthma and paediatric and adult upper limb fractures in these hospitals in 2008 and 2010 were evaluated with respect to 18 quality indicators reflecting timeliness and safety/effectiveness of care in the ED. In a secondary analysis, we examined shift-level ED crowding at the time of the patient visit and performance on the quality indicators.

Results

Median ED LOS improved by up to 26% (63 min) from 2008 to 2010 in the improved hospitals, and worsened by up to 47% (91 min) in the unimproved sites. We abstracted 4319 and 4498 charts from improved and unimproved hospitals, respectively. Improvement in a hospital's overall median ED LOS from 2008 to 2010 was not associated with a change in any of the other ED quality indicators over the same time period. In our secondary analysis, shift-level crowding was associated only with indicators that reflected timeliness of care. During less crowded shifts, patients with AMI were more likely to be reperfused within target intervals (rate ratio 1.59, 95% CI 1.03 to 2.45), patients with asthma more often received timely administration of steroids (rate ratio 1.88, 95% CI 1.59 to 2.24) and beta-agonists (rate ratio 1.47, 95% CI 1.25 to 1.74), and adult (but not paediatric) patients with fracture were more likely to receive analgesia or splinting within an hour (rate ratio 1.66, 95% CI 1.22 to 2.26).

Conclusions

These results suggest that a policy approach that targets only reductions in ED LOS is not associated with broader improvements in selected quality measures. At the same time, there is no evidence that efforts to address crowding have a detrimental effect on quality of care.

Implementing wait-time reductions under Ontario government benchmarks (Pay-for-Results): a Cluster Randomized Trial of the Effect of a Physician-Nurse Supplementary Triage Assistance team (MDRNSTAT) on emergency department patient wait times

Background

Internationally, emergency departments are struggling with crowding and its associated morbidity, mortality, and decreased patient and health-care worker satisfaction. The objective was to evaluate the addition of a MDRNSTAT (Physician (MD)-Nurse (RN) Supplementary Team At Triage) on emergency department patient flow and quality of care.

Methods

Pragmatic cluster randomized trial. From 131 weekday shifts (8:00–14:30) during a 26-week period, we randomized 65 days (3173 visits) to the intervention cluster with a MDRNSTAT presence, and 66 days (3163 visits) to the nurse-only triage control cluster. The primary outcome was emergency department length-of-stay (EDLOS) for patients managed and discharged only by the emergency department. Secondary outcomes included EDLOS for patients initially seen by the emergency department, and subsequently consulted and admitted, patients reaching government-mandated thresholds, time to initial physician assessment, left-without being seen rate, time to investigation, and measurement of harm.

Results

The intervention’s median EDLOS for discharged, non-consulted, high acuity patients was 4:05 [95^th% CI: 3:58 to 4:15] versus 4:29 [95^th% CI: 4:19–4:38] during comparator shifts. The intervention’s median EDLOS for discharged, non-consulted, low acuity patients was 1:55 [95^th% CI: 1:48 to 2:05] versus 2:08 [95^th% CI: 2:02–2:14]. The intervention’s median physician initial assessment time was 0:55 [95^th% CI: 0:53 to 0:58] versus 1:21 [95^th% CI: 1:18 to 1:25]. The intervention’s left-without-being-seen rate was 1.5% versus 2.2% for the control (p = 0.06). The MDRNSTAT subgroup analysis resulted in significant decreases in median EDLOS for discharged, non-consulted high (4:01 [95^th% CI: 3:43–4:16]) and low acuity patients (1:10 95^th% CI: 0:58–1:19]), as well as physician initial assessment time (0:25 [95^th% CI: 0:23–0:26]). No patients returned to the emergency department after being discharged by the MDRNSTAT at triage.

Conclusions

The intervention reduced delays and left-without-being-seen rate without increased return visits or jeopardizing urgent care of severely ill patients.

Trial registration number

NCT00991471 ClinicalTrials.gov

The role of full capacity protocols on mitigating overcrowding in EDs

OBJECTIVE

Overcrowding is an important issue facing many emergency departments (EDs). Access block (admitted patients occupying ED stretchers) is a leading contributor, and expeditious placement of admitted patients is an area of research interest. This review examined the effectiveness of full capacity protocols (FCPs) on mitigating ED overcrowding.

METHODS

A comprehensive literature search was undertaken to identify potentially relevant studies between 1966 and 2009. Intervention studies in which an FCP was used to influence ED/hospital length of stay and ED/hospital access block were included as a single program or part of a systemwide intervention. Two reviewers independently assessed citation relevance, inclusion, study quality, and extracted data; because of limited data, pooling was not undertaken.

RESULTS

From 14 446 potentially relevant studies, 2 abstracts from the same comparative study were included. From 29 studies on systemwide intervention, 4 contained an FCP component. The included study was a single-center ED study using a before-after design; its methodological quality was rated as weak. One of the abstracts reported that an FCP was associated with less ED length of stay (5-hour reduction) when compared with the comparison period; the other reported that an FCP decreased ED and hospital access block (28% and 37% reduction, respectively). The ED triggers, format, and implementation of FCP protocols varied widely.

CONCLUSION

Although FCPs may be a promising alternative for overcrowded EDs, the available evidence upon which to support implementation of an FCP is limited. Additional efforts are required to improve the outcome reporting of FCP research using high-quality research methods.

The role of triage liaison physicians on mitigating overcrowding in emergency departments: a systematic review

OBJECTIVES

The objective was to examine the effectiveness of triage liaison physicians (TLPs) on mitigating the effects of emergency department (ED) overcrowding.

METHODS

Electronic databases (Cochrane Central Register of Controlled Trials, MEDLINE, EMBASE, Web of Science, HealthSTAR, Dissertation Abstracts, and ABI/INFORM Global), controlled trial registry websites, conference proceedings, study references, contact with experts in the field, and correspondence with authors were used to identify potentially relevant TLP studies. Intervention studies in which a TLP was used to influence ED overcrowding metrics (length of stay [LOS] in minutes, physician initial assessment [PIA], and left without being seen [LWBS]) were included in the review. Two reviewers independently conducted data extraction and assessed the citation relevance, inclusion, and study quality. For continuous outcomes, weighted mean differences (WMD) were calculated and reported with corresponding 95% confidence intervals (CIs). For dichotomous variables, individual and pooled statistics were calculated as relative risk (RR) with 95% CI.

RESULTS

From 14,446 potentially relevant studies, 28 were included in the systematic review. Thirteen were journal publications, 12 were abstracts, and three were Web-based articles. Most studies employed before-after designs; 23 of the 28 studies were considered of weak quality. Based on the statistical pooling of data from two randomized controlled trials (RCTs), TLP resulted in shorter ED LOS compared to nurse-led triage (WMD = -36.85 min; 95% CI = -51.11 to -22.58). One of these RCTs showed a significant reduction in the PIA associated to TLP presence (WMD = -30.00 min; 95% CI = -56.91 to -3.09); the other RCT showed no change in LWBS due to a CI that included unity (RR = 0.82; 95% CI = 0.67 to 1.00).

CONCLUSIONS

While the evidence summarized here suggests that to have a TLP is an effective intervention to mitigate the effects of ED overcrowding, due to the weak research methods identified, more research is required before its widespread implementation.

The effect of emergency department crowding on clinically oriented outcomes

BACKGROUND

An Institute of Medicine (IOM) report defines six domains of quality of care: safety, patient-centeredness, timeliness, efficiency, effectiveness, and equity. The effect of emergency department (ED) crowding on these domains of quality has not been comprehensively evaluated.

OBJECTIVES

The objective was to review the medical literature addressing the effects of ED crowding on clinically oriented outcomes (COOs).

METHODS

We reviewed the English-language literature for the years 1989-2007 for case series, cohort studies, and clinical trials addressing crowding's effects on COOs. Keywords searched included "ED crowding,""ED overcrowding,""mortality,""time to treatment,""patient satisfaction,""quality of care," and others.

RESULTS

A total of 369 articles were identified, of which 41 were kept for inclusion. Study quality was modest; most articles reflected observational work performed at a single institution. There were no randomized controlled trials. ED crowding is associated with an increased risk of in-hospital mortality, longer times to treatment for patients with pneumonia or acute pain, and a higher probability of leaving the ED against medical advice or without being seen. Crowding is not associated with delays in reperfusion for patients with ST-elevation myocardial infarction. Insufficient data were available to draw conclusions on crowding's effects on patient satisfaction and other quality endpoints.

CONCLUSIONS

A growing body of data suggests that ED crowding is associated both with objective clinical endpoints, such as mortality, as well as clinically important processes of care, such as time to treatment for patients with time-sensitive conditions such as pneumonia. At least two domains of quality of care, safety and timeliness, are compromised by ED crowding.

Frequency, determinants and impact of overcrowding in emergency departments in Canada: a national survey

Several reports have documented the prevalence and severity of emergency department (ED) overcrowding at specific hospitals or cities in Canada; however, no study has examined the issue at a national level. A 54-item, self-administered, postal and web-based questionnaire was distributed to 243 ED directors in Canada to collect data on the frequency, impact and factors associated with ED overcrowding. The survey was completed by 158 (65% response rate) ED directors, 62% of whom reported overcrowding as a major or severe problem during the past year. Directors attributed overcrowding to a variety of issues including a lack of admitting beds (85%), lack of acute care beds (74%) and the increased length of stay of admitted patients in the ED (63%). They perceived ED overcrowding to have a major impact on increasing stress among nurses (82%), ED wait times (79%) and the boarding of admitted patients in the ED while waiting for beds (67%). Overcrowding is not limited to large urban centres; nor is it limited to academic and teaching hospitals. The perspective of ED directors reinforces the need for further examination of effective policies and interventions to reduce ED overcrowding.

Effectiveness of emergency department asthma management strategies on return visits in children: a population-based study

BACKGROUND

Emergency departments play an important role in the care of children with asthma. Emergency department return-visit rates provide a measure of the quality of acute asthma care.

OBJECTIVE

Our goal was to describe the characteristics of children treated in emergency departments for asthma, the resources and asthma management strategies used by emergency departments, and their effect on return visits within 72 hours.

DESIGN, SETTING, AND PATIENTS

We used a population-based cohort study that incorporated both comprehensive administrative heath and survey data from all 152 emergency departments in Ontario, Canada. We studied all 2- to 17-year-old children who had a visit to an emergency department for asthma from April 2003 to March 2005.

RESULTS

A total of 32,996 children (>9% of children with asthma in Ontario) had at least 1 visit to an emergency department for the care of asthma, and most of these visits (68.5%) were triaged as high acuity. The vast majority (148 of 152 [97%]) of emergency departments reported using at least 1 asthma management strategy, and 74% used 3 or more. The overall return-visit rate was 5.6%. Logistic regression models that accounted for the clustering of patients in emergency departments and controlled for patient and emergency department characteristics indicated that preprinted order sheets and access to a pediatrician for consultation were strategies significantly associated with a reduction in return visits. The 11 (17%) emergency departments that used both of these strategies had return visit rates of 4.4% compared with 6.9% in the 95 (63%) that used neither strategy.

CONCLUSIONS

Emergency departments use a range of strategies to manage asthma in children. Preprinted order sheets and access to pediatricians are associated with important reductions in return-visit rates, and more emergency departments should consider using these strategies.

Data collection on patients in emergency departments in Canada

OBJECTIVE

Relatively little is known about the ability of Canadian emergency departments (EDs) and the federal, provincial and territorial governments to quantify ED activity. The objectives of this study were to determine the use of electronic patient data in Canadian EDs, the accessibility of provincial data on ED visits, and to identify the data elements and current methods of ED information system (EDIS) data collection nationally.

METHODS

Surveys were conducted of the following 3 groups: 1) all ED directors of Canadian hospitals located in communities of >10,000 people, 2) all electronic EDIS vendors, and 3) representatives from the ministries of health from 13 provincial and territorial jurisdictions who had knowledge of ED data collection.

RESULTS

Of the 243 ED directors contacted, 158 completed the survey (65% response rate) and 39% of those reported using an electronic EDIS. All 11 EDIS vendor representatives responded. Most of the vendors provide a similar package of basic EDIS options, with add-on features. All 13 provincial or territorial government representatives completed the survey. Nine (69%) provinces and territories collect ED data, however the source of this information varies. Five provinces and territories collect triage data, and 3 have a comprehensive, jurisdiction-wide, population-based ED database. Thirty-nine percent of EDs in larger Canadian communities track patients using electronic methods. A variety of EDIS vendor options are available and used in Canada.

CONCLUSION

The wide variation in methods and in data collected presents serious barriers to meaningful comparison of ED services across the country. It is little wonder that the majority of information regarding ED overcrowding in Canada is anecdotal, when the collection of this critical health information is so variable. There is an urgent need to place the collection of ED information on the provincial and national agenda and to ensure that the collection of this information consistent, comprehensive and mandatory.