Emergency Medical Services Outcomes Project (EMSOP) II: developing the foundation and conceptual models for out-of-hospital outcomes research

Association between out-of-hospital cardiac arrest quality indicator and prehospital management and clinical outcomes for major trauma

INTRODUCTION

It is unclear whether emergency medical service (EMS) agencies with good out-of-hospital cardiac arrest (OHCA) quality indicators also perform well in treating other emergency conditions. We aimed to evaluate the association of an EMS agency's non-traumatic OHCA quality indicators with prehospital management processes and clinical outcomes of major trauma.

METHODS

This retrospective cross-sectional study analyzed data from registers of nationwide, population-based OHCA (adult EMS-treated non-traumatic OHCA patients from 2017 to 2018) and major trauma (adult, EMS-treated, and injury severity score ≥16 trauma patients in 2018) in South Korea. We developed a prehospital ROSC prediction model to categorize EMS agencies into quartiles (Q1-Q4) based on the observed-to-expected (O/E) ROSC ratio for each EMS agency. We evaluated the national EMS protocol compliance of on-scene management according to O/E ROSC ratio quartile. The association between O/E ROSC ratio quartiles and trauma-related early mortality was determined in a multi-level logistic regression model by adjusted odds ratios (OR) and 95 % confidence intervals (95 % CI).

RESULTS

Among 30,034 severe trauma patients, 4,836 were analyzed. Patients in Q4 showed the lowest early mortality rate (5.6 %, 5.5 %, 4.8 %, and 3.4 % in Q1, Q2, Q3, and Q4, respectively). In groups Q1 to Q4, increasing compliance with the national EMS on-scene management protocol (trauma center transport, basic airway management for patients with altered mentality, spinal motion restriction for patients with spinal injury, and intravenous access for patients with hypotension) was observed (p for trend <0.05). Multivariable multi-level logistic regression analysis showed significantly lower early mortality in Q4 than in Q1 (adjusted OR [95 % CI] 0.56 [0.35-0.91]).

CONCLUSION

Major trauma patients managed by EMS agencies with high success rates in achieving prehospital ROSC in non-traumatic OHCA were more likely to receive protocol-based care and exhibited lower early mortality.

How can quality be measured within a physician-led Community Emergency Medical service? A scoping review protocol

BACKGROUND

Quality measurement as part of quality improvement in healthcare is integral for service delivery and development. This is particularly pertinent for health services that deliver care in ways that differ from traditional practice. Community Emergency Medicine (CEM) is a novel and evolving concept of care delivered by services in parts of the UK and Ireland. This scoping review aims to provide a broad overview of how quality may be measured within services delivering CEM.

METHODS AND ANALYSIS

The methodology follows both the Preferred Reporting Items for Systematic Review and Meta-Analysis extension for Scoping Reviews (PRISMA-ScR). It is guided by recognised work of Arksey and O'Malley and the guidelines developed by the Joanna Briggs Institute. Several databases will be searched: MEDLINE, EMbase, EMcare, CINAHL, Scopus, the Cochrane Library and grey literature. Search terms have been developed by representatives within Community Emergency Medicine services. Two reviewers will independently screen eligible studies for final study selection. Results will be collected and analysed in descriptive and tabular form to illustrate the breadth of quality indicators that may be applicable to CEM services. This scoping review protocol has been registered with the Open Science Framework platform (osf.io/e7qxg).

DISCUSSION

This is the first stage of a larger research study aimed at developing national quality indicators for CEM. The purpose of this scoping review is to provide a comprehensive review of quality indicators that could be used within CEM. The results will be mapped using a framework and identify gaps in the literature to help guide future-focused research.

Opioids for Treatment of Pre-hospital Acute Pain: A Systematic Review

INTRODUCTION

Acute pain is a frequent symptom among patients in the pre-hospital setting, and opioids are the most widely used class of drugs for the relief of pain in these patients. However, the evidence base for opioid use in this setting appears to be weak. The aim of this systematic review was to explore the efficacy and safety of opioid analgesics in the pre-hospital setting and to assess potential alternative therapies.

METHODS

The PubMed, EMBASE, Cochrane Library, Centre for Reviews and Dissemination, Scopus, and Epistemonikos databases were searched for studies investigating adult patients with acute pain prior to their arrival at hospital. Outcomes on efficacy and safety were assessed. Risk of bias for each included study was assessed according to the Cochrane approach, and confidence in the evidence was assessed using the GRADE method.

RESULTS

A total of 3453 papers were screened, of which the full text of 125 was assessed. Twelve studies were ultimately included in this systematic review. Meta-analysis was not undertaken due to substantial clinical heterogeneity among the included studies. Several studies had high risk of bias resulting in low or very low quality of evidence for most of the outcomes. No pre-hospital studies compared opioids with placebo, and no studies assessed the risk of opioid administration for subgroups of frail patients. The competency level of the attending healthcare provider did not seem to affect the efficacy or safety of opioids in two observational studies of very low quality. Intranasal opioids had a similar effect and safety profile as intravenous opioids. Moderate quality evidence supported a similar efficacy and safety of synthetic opioid compared to morphine.

CONCLUSIONS

Available evidence for pre-hospital opioid administration to relieve acute pain is scarce and the overall quality of evidence is low. Intravenous administration of synthetic, fast-acting opioids may be as effective and safe as intravenous administration of morphine. More controlled studies are needed on alternative routes for opioid administration and pre-hospital pain management for potentially more frail patient subgroups.

Spatio-temporal epidemiology of emergency medical requests in a large urban area. A scan-statistic approach

Pre-hospital care is provided by emergency medical services (EMS) staff, the initial health care providers at the scene of disaster. This study aimed to describe the characteristics of EMS callers and space-time distribution of emergency requests in a large urban area. Descriptive thematic maps of EMS requests were created using an empirical Bayesian smoothing approach. Spatial, temporal and spatio-temporal clustering techniques were applied to EMS data based on Kulldorff scan statistics technique. Almost 225,000 calls were registered in the EMS dispatch centre during the study period. Approximately two-thirds of these calls were associated with an altered level of patient consciousness, and the median response time for rural and urban EMS dispatches was 12.2 and 10.1 minutes, respectively. Spatio-temporal clusters of EMS requests were mostly located in central parts of the city, particularly near the downtown area. However, high-response time clustered areas had a low overlap with these general, spatial clusters. This low convergence shows that some unknown factors, other than EMS requests, influence the high-response times. The findings of this study can help policymakers to better allocate EMS resources and implement tailored interventions to enhance EMS system in urban areas.

Evaluating a Novel Prehospital Emergency Trauma Care Assessment Tool (PETCAT) for Low- and Middle-Income Countries in Sierra Leone

BACKGROUND

WHO recommends training lay first responders (LFRs) as the first step toward formal emergency medical services development, yet no tool exists to evaluate LFR programs.

METHODS

We developed Prehospital Emergency Trauma Care Assessment Tool (PETCAT), a seven-question survey administered to first-line hospital-based healthcare providers, to independently assess LFR prehospital intervention frequency and quality. PETCAT surveys were administered one month pre-LFR program launch (June 2019) in Makeni, Sierra Leone and again 14 months post-launch (August 2020). Using a difference-in-differences approach, PETCAT was also administered in a control city (Kenema) with no LFR training intervention during the study period at the same intervals to control for secular trends. PETCAT measured change in both the experimental and control locations. Cronbach's alpha, point bi-serial correlation, and inter-rater reliability using Cohen's Kappa assessed PETCAT reliability.

RESULTS

PETCAT administration to 90 first-line, hospital-based healthcare providers found baseline prehospital intervention were rare in Makeni and Kenema prior to LFR program launch (1.2/10 vs. 1.8/10). Fourteen months post-LFR program implementation, PETCAT demonstrated prehospital interventions increased in Makeni with LFRs (5.2/10, p < 0.0001) and not in Kenema (1.2/10) by an adjusted difference of + 4.6 points/10 (p < 0.0001) ("never/rarely" to "half the time"), indicating negligible change due to secular trends. PETCAT demonstrated high reliability (Cronbach's α = 0.93, Cohen's K = 0.62).

CONCLUSIONS

PETCAT measures changes in rates of prehospital care delivery by LFRs in a resource-limited African setting and may serve as a robust tool for independent EMS quality assessment.

Multi-method versus single method appraisal of clinical quality indicators for the emergency medical services

BACKGROUND

Quality Indicator (QI) appraisal protocol is a novel methodology that combines multiple appraisal methods to comprehensively assess the 'appropriateness' of QIs for a particular healthcare setting. However, they remain inadequately explored compared to the single appraisal method approach.

OBJECTIVES

To describe and test a multi-method QI appraisal protocol versus the single method approach, against a series of QIs previously identified as potentially relevant to the prehospital emergency care setting.

METHODS

An appraisal protocol was developed consisting of two categorical-based appraisal methods, combined with the qualitative analysis of the discussion generated during the consensus application of each method. The output of the protocol was assessed and compared with the application and output of each method. Inter-rater reliability (IRR) of each particular method was evaluated prior to group consensus rating. Variation in the number of non-valid QIs and the proportion of non-valid QIs identified between each method and the protocol were compared and assessed.

RESULTS

There was mixed IRR of the individual methods. There was similarly low-to-moderate correlation of the results obtained between the particular methods (Spearman's rank correlation = 0.42, P < 0.001). From a series of 104 QIs, 11 non-valid QIs were identified that were shared between the individual methods. A further 19 non-valid QIs were identified and not shared by each method, highlighting the benefits of a multi-method approach. The outcomes were additionally evident in the group discussion analysis, which in and of itself added further input that would not have otherwise been captured by the individual methods alone.

CONCLUSION

The utilization of a multi-method appraisal protocol offers multiple benefits, when compared to the single appraisal approach, and can provide the confidence that the outcomes of the appraisal will ensure a strong foundation on which the QI framework can be successfully implemented.

Youth Victims of Violence Report Worse Quality of Life Than Youth With Chronic Diseases

OBJECTIVES

Measuring health-related quality of life (HRQOL) provides the patient's perspective of his/her well-being and offers a unique outcome measure to demonstrate the impact of violence on the victim. To date, no study has described HRQOL in youth victims of violence in the United States. The purpose of this study was to describe HRQOL in youth victims of violence as compared with healthy youth and youth with chronic disease.

METHODS

We conducted an exploratory cross-sectional study of the HRQOL of victims of violence aged 8 to 18 years. Descriptive statistics were reported for participant and injury demographics. One sample t tests were used to compare the sample population's HRQOL to known HRQOL of healthy populations and specific disease populations.

RESULTS

Fifty-eight victims of violence participated in the study. Youth victims of violence had significantly worse mean HRQOL scores (mean, 71.4) compared with healthy youth in overall functioning (mean, 83.9), P < 0.001. Youth victims of violence reported worse psychosocial (mean, 67.6), emotional (mean, 62.9), and school (mean, 63.8) functioning than youth with obesity (mean, 72.1, 68.6, 75.0, respectively) and cancer (mean, 72.1, 72.2, 68.3, respectively). Mean Patient-Reported Outcomes Measurement Information System T scores for youth victims of violence were significantly worse in anxiety (T = 51.9) and depression (T = 52.4) compared with youth with obesity (T = 48.3, 49.2), cancer (T = 47.7, 47.6), and sickle cell disease (T = 43, 44).

CONCLUSIONS

Youth victims of violence suffer significant impairment in HRQOL compared with healthy populations and youth with specific disease burdens. Future studies into violence prevention effectiveness should use HRQOL as a comparative outcome measure to better tailor post injury management and interventions.

Epidemiological profile of emergency medical services in Japan: a population-based descriptive study in 2016

Aim

The aim of our study is to describe the characteristics of patients who use emergency medical services (EMS), EMS performance, and regional variations in Japan.

Methods

We undertook a nationwide, population‐based, descriptive review of anonymized ambulance transport records obtained from the Fire and Disaster Management Agency in Japan. All emergency patients transported to emergency medical institutions by EMS personnel from January to December 2016 were enrolled in this study, excluding patients who were not transported.

Results

During the study period, 5,097,838 patients were transported to a hospital. Their median age was 69 years, 51.4% were male, and 56.5% were over 65 years old. Median durations from EMS call to EMS arrival on scene were similar among the regions, ranging from 7 to 9 min. However, the longest median duration from EMS call to hospital arrival was 38 min, and the shortest was 31 min across the regions. Among all patients, 350,865 (6.9%) were assessed as being in a severe condition, 14,410 (0.3%) were in very severe condition, and 74,780 (1.5%) were confirmed to be dead at the time of initial medical examination in the emergency department.

Conclusions

We described the characteristics of emergency patients and EMS performance in Japan. This registry serves as a basis for providing relevant information to improve prehospital emergency medical systems.

Identifying quality indicators for prehospital emergency care services in the low to middle income setting: The South African perspective

INTRODUCTION

Historically, performance within the Prehospital Emergency Care (PEC) setting has been assessed primarily based on response times. While easy to measure and valued by the public, overall, response time targets are a poor predictor of quality of care and clinical outcomes. Over the last two decades however, significant progress has been made towards improving the assessment of PEC performance, largely in the form of the development of PEC-specific quality indicators (QIs). Despite this progress, there has been little to no development of similar systems within the low- to middle-income country setting. As a result, the aim of this study was to identify a set of QIs appropriate for use in the South African PEC setting.

METHODS

A three-round modified online Delphi study design was conducted to identify, refine and review a list of QIs for potential use in the South African PEC setting. Operational definitions, data components and criteria for use were developed for 210 QIs for inclusion into the study.

RESULTS

In total, 104 QIs reached consensus agreement including, 90 clinical QIs, across 15 subcategories, and 14 non-clinical QIs across two subcategories. Amongst the clinical category, airway management (n = 13 QIs; 14%); out-of-hospital cardiac arrest (n = 13 QIs; 14%); and acute coronary syndromes (n = 11 QIs; 12%) made up the majority. Within the non-clinical category, adverse events made up the significant majority with nine QIs (64%).

CONCLUSION

Within the South Africa setting, there are a multitude of QIs that are relevant and appropriate for use in PEC. This was evident in the number, variety and type of QIs reaching consensus agreement in our study. Furthermore, both the methodology employed, and findings of this study may be used to inform the development of PEC specific QIs within other LMIC settings.

Indicators to measure prehospital care quality: a scoping review

OBJECTIVE

The purpose of this scoping review was to locate, examine and describe the literature on indicators used to measure prehospital care quality.

INTRODUCTION

The performance of ambulance services and quality of prehospital care has traditionally been measured using simple indicators, such as response time intervals, based on low-level evidence. The discipline of paramedicine has evolved significantly over the last few decades. Consequently, the validity of utilizing such measures as holistic prehospital care quality indicators (QIs) has been challenged. There is growing interest in finding new and more significant ways to measure prehospital care quality.

INCLUSION CRITERIA

This scoping review examined the concepts of prehospital care quality and QIs developed for ambulance services. This review considered primary and secondary research in any paradigm and utilizing any methods, as well as text and opinion research.

METHODS

Joanna Briggs Institute methodology for conducting scoping reviews was employed. Separate searches were conducted for two review questions; review question 1 addressed the definition of prehospital care quality and review question 2 addressed characteristics of QIs in the context of prehospital care. The following databases were searched: PubMed, CINAHL, Embase, Scopus, Cochrane Library and Web of Science. The searches were limited to publications from January 1, 2000 to the day of the search (April 16, 2017). Non-English articles were excluded. To supplement the above, searches for gray literature were performed, experts in the field of study were consulted and applicable websites were perused.

RESULTS

Review question 1: Nine articles were included. These originated mostly from England (n = 3, 33.3%) and the USA (n = 3, 33.3%). Only one study specifically aimed at defining prehospital care quality. Five articles (55.5%) described attributes specific to prehospital care quality and four (44.4%) articles considered generic healthcare quality attributes to be applicable to the prehospital context. A total of 17 attributes were identified. The most common attributes were Clinical effectiveness (n = 17, 100%), Efficiency (n = 7, 77.8%), Equitability (n = 7, 77.8%) and Safety (n = 6, 66.7%). Timeliness and Accessibility were referred to by four and three (44.4% and 33.3%) articles, respectively.Review question 2: Thirty articles were included. The predominant source of articles was research literature (n = 23; 76.7%) originating mostly from the USA (n = 13; 43.3%). The most frequently applied QI development method was a form of consensus process (n = 15; 50%). A total of 526 QIs were identified. Of these, 283 (53.8%) were categorized as Clinical and 243 (46.2%) as System/Organizational QIs. Within these categories respectively, QIs related to Out-of-hospital cardiac arrest (n = 57; 10.8%) and Time intervals (n = 75; 14.3%) contributed the most. The most commonly addressed prehospital care quality attributes were Appropriateness (n = 250, 47.5%), Clinical effectiveness (n = 174, 33.1%) and Accessibility (n = 124, 23.6%). Most QIs were process indicators (n = 386, 73.4%).

CONCLUSION

Whilst there is paucity in research aiming to specifically define prehospital care quality, the attributes of generic healthcare quality definitions appear to be accepted and applicable to the prehospital context. There is growing interest in developing prehospital care QIs. However, there is a need for validation of existing QIs and de novo development addressing broader aspects of prehospital care.

Developing new ways of measuring the quality and impact of ambulance service care: the PhOEBE mixed-methods research programme

Background

Ambulance service quality measures have focused on response times and a small number of emergency conditions, such as cardiac arrest. These quality measures do not reflect the care for the wide range of problems that ambulance services respond to and the Prehospital Outcomes for Evidence Based Evaluation (PhOEBE) programme sought to address this.

Objectives

The aim was to develop new ways of measuring the impact of ambulance service care by reviewing and synthesising literature on prehospital ambulance outcome measures and using consensus methods to identify measures for further development; creating a data set linking routinely collected ambulance service, hospital and mortality data; and using the linked data to explore the development of case-mix adjustment models to assess differences or changes in processes and outcomes resulting from ambulance service care.

Design

A mixed-methods study using a systematic review and synthesis of performance and outcome measures reported in policy and research literature; qualitative interviews with ambulance service users; a three-stage consensus process to identify candidate indicators; the creation of a data set linking ambulance, hospital and mortality data; and statistical modelling of the linked data set to produce novel case-mix adjustment measures of ambulance service quality.

Setting

East Midlands and Yorkshire, England.

Participants

Ambulance services, patients, public, emergency care clinical academics, commissioners and policy-makers between 2011 and 2015.

Interventions

None.

Main outcome measures

Ambulance performance and quality measures.

Data sources

Ambulance call-and-dispatch and electronic patient report forms, Hospital Episode Statistics, accident and emergency and inpatient data, and Office for National Statistics mortality data.

Results

Seventy-two candidate measures were generated from systematic reviews in four categories: (1) ambulance service operations (n = 14), (2) clinical management of patients (n = 20), (3) impact of care on patients (n = 9) and (4) time measures (n = 29). The most common operations measures were call triage accuracy; clinical management was adherence to care protocols, and for patient outcome it was survival measures. Excluding time measures, nine measures were highly prioritised by participants taking part in the consensus event, including measures relating to pain, patient experience, accuracy of dispatch decisions and patient safety. Twenty experts participated in two Delphi rounds to refine and prioritise measures and 20 measures scored ≥ 8/9 points, which indicated good consensus. Eighteen patient and public representatives attending a consensus workshop identified six measures as important: time to definitive care, response time, reduction in pain score, calls correctly prioritised to appropriate levels of response, proportion of patients with a specific condition who are treated in accordance with established guidelines, and survival to hospital discharge for treatable emergency conditions. From this we developed six new potential indicators using the linked data set, of which five were constructed using case-mix-adjusted predictive models: (1) mean change in pain score; (2) proportion of serious emergency conditions correctly identified at the time of the 999 call; (3) response time (unadjusted); (4) proportion of decisions to leave a patient at scene that were potentially inappropriate; (5) proportion of patients transported to the emergency department by 999 emergency ambulance who did not require treatment or investigation(s); and (6) proportion of ambulance patients with a serious emergency condition who survive to admission, and to 7 days post admission. Two indicators (pain score and response times) did not need case-mix adjustment. Among the four adjusted indicators, we found that accuracy of call triage was 61%, rate of potentially inappropriate decisions to leave at home was 5–10%, unnecessary transport to hospital was 1.7–19.2% and survival to hospital admission was 89.5–96.4% depending on Clinical Commissioning Group area. We were unable to complete a fourth objective to test the indicators in use because of delays in obtaining data. An economic analysis using indicators (4) and (5) showed that incorrect decisions resulted in higher costs.

Limitations

Creation of a linked data set was complex and time-consuming and data quality was variable. Construction of the indicators was also complex and revealed the effects of other services on outcome, which limits comparisons between services.

Conclusions

We identified and prioritised, through consensus processes, a set of potential ambulance service quality measures that reflected preferences of services and users. Together, these encompass a broad range of domains relevant to the population using the emergency ambulance service. The quality measures can be used to compare ambulance services or regions or measure performance over time if there are improvements in mechanisms for linking data across services.

Future work

The new measures can be used to assess different dimensions of ambulance service delivery but current data challenges prohibit routine use. There are opportunities to improve data linkage processes and to further develop, validate and simplify these measures.

Funding

The National Institute for Health Research Programme Grants for Applied Research programme.

Quality measurement in physician-staffed emergency medical services: a systematic literature review

PURPOSE

Quality measurement of physician-staffed emergency medical services (P-EMS) is necessary to improve service quality. Knowledge and consensus on this topic are scarce, making quality measurement of P-EMS a high-priority research area. The aim of this review was to identify, describe and evaluate studies of quality measurement in P-EMS.

DATA SOURCES

The databases of MEDLINE and Embase were searched initially, followed by a search for included article citations in Scopus.

STUDY SELECTION

The study eligibility criteria were: (1) articles describing the use of one quality indicator (QI) or more in P-EMS, (2) original manuscripts, (3) articles published from 1 January 1968 until 5 October 2016. The literature search identified 4699 records. 4543 were excluded after reviewing title and abstract. An additional 129 were excluded based on a full-text review. The remaining 27 papers were included in the analysis. Methodological quality was assessed using an adapted critical appraisal tool.

DATA EXTRACTION

The description of used QIs and methods of quality measurement was extracted. Variables describing the involved P-EMSs were extracted as well.

RESULTS OF DATA SYNTHESIS

In the included papers, a common understanding of which QIs to use in P-EMS did not exist. Fifteen papers used only a single QI. The most widely used QIs were 'Adherence to medical protocols', 'Provision of advanced interventions', 'Response time' and 'Adverse events'.

CONCLUSION

The review demonstrated a lack of shared understanding of which QIs to use in P-EMS. Moreover, papers using only one QI dominated the literature, thus increasing the risk of a narrow perspective in quality measurement. Future quality measurement in P-EMS should rely on a set of consensus-based QIs, ensuring a comprehensive approach to quality measurement.

Acute pain in the prehospital setting: a register-based study of 41.241 patients

BACKGROUND

Acute pain is a frequent symptom, but little is known about the frequency and causes of acute pain in the prehospital population. The objectives of this study were to investigate the frequency of moderate to severe pain among prehospital patients and the underlying causes according to primary hospital diagnose codes.

METHODS

This was a register-based study on 41.241 patients transported by ambulance. Information on moderate to severe pain [Numeric Rating Scale (NRS, 0-10) > 3 or moderate pain or higher on 4-point likert scale] was extracted from a national electronic prehospital patient record. Patient information was merged with primary hospital diagnose codes based on the 10th version of the International Classification of Diseases (ICD-10) to investigate underlying causes of pain.

RESULTS

11.430 patients (27.7%) reported moderate to severe pain during ambulance transport. As a measure of opioid demanding acute pain, 3.275 of 41.241 patients (7.9%) were treated with intravenous fentanyl. Underlying causes of pain were heterogenic according to ICD-10 chapters with injuries being the largest group of patients with moderate to severe pain (XIX: 42.8% of 8.041 patients), followed by non-specific diagnoses (XVIII: 28.5% of 7.101 patients and XXI: 31.6% of 5.148 patients), diseases of the circulatory system (IX: 22.1% of 4.812 patients) and other (20.3% of 16.139 miscellaneous patients).

DISCUSSION

Due to the high frequency of moderate to severe pain affecting a wide range of patients, more attention on acute pain is necessary. Whether ambulance personnel have sufficient options for treating various pain conditions might be a subject of future evaluation. Non-specific diagnoses accounted for surprisingly many patients with moderate to severe pain, of which many were treated with intravenous fentanyl. This may be substance of further investigation.

CONCLUSIONS

Moderate to severe pain is a highly frequent and probably underestimated symptom among patients transported by ambulance. Underlying causes of pain are heterogenic as described by primary hospital diagnose codes. More focus on the treatment of acute pain is needed.

Quality Indicators for Evaluating Prehospital Emergency Care: A Scoping Review

Introduction Historically, the quality and performance of prehospital emergency care (PEC) has been assessed largely based on surrogate, non-clinical endpoints such as response time intervals or other crude measures of care (eg, stakeholder satisfaction). However, advances in Emergency Medical Services (EMS) systems and services world-wide have seen their scope and reach continue to expand. This has dictated that novel measures of performance be implemented to compliment this growth. Significant progress has been made in this area, largely in the form of the development of evidence-informed quality indicators (QIs) of PEC. Problem Quality indicators represent an increasingly popular component of health care quality and performance measurement. However, little is known about the development of QIs in the PEC environment. The purpose of this study was to assess the development and characteristics of PEC-specific QIs in the literature.

METHODS

A scoping review was conducted through a search of PubMed (National Center for Biotechnology Information, National Institutes of Health; Bethesda, Maryland USA); EMBase (Elsevier; Amsterdam, Netherlands); CINAHL (EBSCO Information Services; Ipswich, Massachusetts USA); Web of Science (Thomson Reuters; New York, New York USA); and the Cochrane Library (The Cochrane Collaboration; Oxford, United Kingdom). To increase the sensitivity of the literature, a search of the grey literature and review of select websites was additionally conducted. Articles were selected that proposed at least one PEC QI and whose aim was to discuss, analyze, or promote quality measurement in the PEC environment.

RESULTS

The majority of research (n=25 articles) was published within the last decade (68.0%) and largely originated within the USA (68.0%). Delphi and observational methodologies were the most commonly employed for QI development (28.0%). A total of 331 QIs were identified via the article review, with an additional 15 QIs identified via the website review. Of all, 42.8% were categorized as primarily Clinical, with Out-of-Hospital Cardiac Arrest contributing the highest number within this domain (30.4%). Of the QIs categorized as Non-Clinical (57.2%), Time-Based Intervals contributed the greatest number (28.8%). Population on Whom the Data Collection was Constructed made up the most commonly reported QI component (79.8%), followed by a Descriptive Statement (63.6%). Least reported were Timing of Data Collection (12.1%) and Timing of Reporting (12.1%). Pilot testing of the QIs was reported on 34.7% of QIs identified in the review.

CONCLUSION

Overall, there is considerable interest in the understanding and development of PEC quality measurement. However, closer attention to the details and reporting of QIs is required for research of this type to be more easily extrapolated and generalized. Howard I , Cameron P , Wallis L , Castren M , Lindstrom V . Quality indicators for evaluating prehospital emergency care: a scoping review. Prehosp Disaster Med. 2018;33(1):43-52.

Developing quality indicators for physician-staffed emergency medical services: a consensus process

Background

There is increasing interest for quality measurement in health care services; pre-hospital emergency medical services (EMS) included. However, attempts of measuring the quality of physician-staffed EMS (P-EMS) are scarce. The aim of this study was to develop a set of quality indicators for international P-EMS to allow quality improvement initiatives.

Methods

A four-step modified nominal group technique process (expert panel method) was used.

Results

The expert panel reached consensus on 26 quality indicators for P-EMS. Fifteen quality indicators measure quality of P-EMS responses (response-specific quality indicators), whereas eleven quality indicators measure quality of P-EMS system structures (system-specific quality indicators).

Discussion

When measuring quality, the six quality dimensions defined by The Institute of Medicine should be appraised. We argue that this multidimensional approach to quality measurement seems particularly reasonable for services with a highly heterogenic patient population and complex operational contexts, like P-EMS. The quality indicators in this study were developed to represent a broad and comprehensive approach to quality measurement of P-EMS.

Conclusions

The expert panel successfully developed a set of quality indicators for international P-EMS. The quality indicators should be prospectively tested for feasibility, validity and reliability in clinical datasets. The quality indicators should then allow for adjusted quality measurement across different P-EMS systems.

Electronic supplementary material

The online version of this article (doi:10.1186/s13049-017-0362-4) contains supplementary material, which is available to authorized users.

Development of a trigger tool to identify adverse events and harm in Emergency Medical Services

BACKGROUND

Adverse event(AE) detection in healthcare has traditionally relied upon several methods including: patient care documentation review, mortality and morbidity review, voluntary reporting, direct observation and complaint systems. A novel sampling strategy, known as the trigger tool (TT) methodology, has been shown to provide a more robust and valid method of detection. The aim of this research was to develop and assess a TT specific to ground-based Emergency Medical Services, to identify cases with the potential risk for adverse events and harm.

METHODS

The study was conducted between March and December 2015. A literature review identified 57 potential triggers, which were grouped together by experts using an affinity process. Triggers for other areas of potential AE/harm were additionally considered for inclusion. An interim TT consisting of nine triggers underwent five iterative rounds of derivation tests of 20 random patient care records (n=100) in two emergency medical services. A final eight-item trigger list underwent a large sample (n=9836) assessment of test characteristics.

RESULTS

The final eight-item TT consisted of triggers divided amongst four categories: Clinical, Medication, Procedural and Return-Call. The TT demonstrated an AE identification rate of 41.5% (sensitivity 79.8% (95% CI, 69.9% to 87.6%); specificity 58.5% (95% CI, 52% to 64.8%)). When identifying potential risk for harm, the TT demonstrated a harm identification rate of 19.3% (sensitivity 97.1% (95% CI, 84.7% to 99.9%); specificity 53.5% (95% CI, 47.7% to 59.3%)).

DISCUSSION

The Emergency Medical Services Trigger Tool (EMSTT) may be used as a sampling strategy similar to the Global Trigger Tool, to identify and measure AE and harm over time, and monitor the success of improvement initiatives within the Emergency Medical Services setting.

Development of key performance indicators for prehospital emergency care

INTRODUCTION

Key performance indicators (KPIs) are used to monitor and evaluate critical areas of clinical and support functions that influence patient outcome. Traditional prehospital emergency care performance monitoring has focused solely on response time metrics. The landscape of emergency care delivery in Ireland is in the process of significant national reconfiguration. The development of KPIs is therefore considered one of the key priorities in prehospital research.

AIMS

The aim of this study was to develop a suite of KPIs for prehospital emergency care in Ireland.

METHODS

A systematic literature review of prehospital care performance measurement was undertaken followed by a three-round Delphi consensus process facilitated by a broad-based multidisciplinary group of panellists. The consensus process was conducted between June 2012 and October 2013. Each candidate indicator on the Delphi survey questionnaire was rated using a 5-point Likert-type rating scale. Agreement was defined as at least 70% of responders rating an indicator as 'agree' or 'strongly agree' on the rating scale. Data were analysed using descriptive statistics. Sensitivity of the ratings was examined for robustness by bootstrapping the original sample.

RESULTS

Of the 78 citations identified by the systematic review, 5 relevant publications were used to select candidate indicators for the Delphi round 1 questionnaire. Response rates in Delphi rounds 1 and 2 were 89% and 83%, respectively. Following the consensus development conference, 101 KPIs reached consensus. Based on the Donabedian framework for quality-of-care indicators, 7 of the KPIs which reached agreement were structure KPIs, 74 were process KPIs and 20 were outcome KPIs. The highest ranked indicator was a process KPI ('Direct transport of ST-elevation myocardial infarction patients to a primary percutaneous intervention (PCI)-capable facility for ECG to PCI time <90 min').

CONCLUSION

Improving the quality of prehospital care requires the development and implementation of performance measurement using scientifically valid and reliable KPIs. Employing a Delphi panel of key multidisciplinary Emergency Medical Service stakeholders, it was feasible to develop a suite of 101 KPIs for performance monitoring of prehospital emergency care in Ireland. This suite of KPIs may contribute to a framework for achieving safer, better care in the prehospital environment.

Research in Prehospital Care: Overcoming the Barriers to Success

OBJECTIVE

The objective of this project was to determine how investigators conduct clinical trials in the prehospital setting and to suggest how emergency medical services (EMS) systems can develop the capacity to conduct prehospital clinical research.

METHODS

A representative sample of U.S.-based study sites was selected from all studies registered on clinicaltrials.gov since the year 2000, where prehospital care providers conducted study-related activities in the prehospital setting. The site principal investigator and the research coordinator or EMS liaison were invited to participate in a structured discussion. A single interviewer conducted each discussion following a structured guide that generically asked for barriers and enablers to the sites' research success and then reviewed commonly identified prehospital research barriers. Notes were taken during each discussion and reviewed for common themes. Themes were reviewed by the project team and sent for comment to all participants.

RESULTS

Discussions were held with 25 principal investigators, 9 coordinators, and 7 EMS liaisons. A total of 27 communities were represented in the discussions from 22 different states. The communities had a range of research experience from one prehospital trial to multiple trials. Key barriers were funding, ethics approval, data collection, protocol training and compliance, randomizing and blinding interventions, obtaining patient outcomes, adequate study staffing, and partnering with EMS agencies.

CONCLUSION

This project identified many challenges to EMS research, but they were not insurmountable. Not every community can conduct every prehospital study. Communities should engage in studies that align with their values and resources. Investigators need to develop honest relationships where issues can be openly discussed and the community can collaborate on prehospital research. Learning from those who have overcome challenges may be a key to expanding the quality and quantity of EMS research.

Probabilistic Linkage of Prehospital and Outcomes Data in Out-of-hospital Cardiac Arrest

OBJECTIVE

Lack of longitudinal patient outcome data is an important barrier in emergency medical services (EMS) research. We aimed to demonstrate the feasibility of linking prehospital data from the California EMS Information Systems (CEMSIS) database to outcomes data from the California Office of Statewide Health Planning and Development (OSHPD) database for patients with out-of-hospital cardiac arrest (OHCA).

METHODS

We included patients age 18 years or older who sustained nontraumatic OHCA and were included in the 2010-2011 CEMSIS databases. The CEMSIS database is a unified EMS data collection system for California. The OSHPD database is a comprehensive data collection system for patient-level inpatient and emergency department encounters in California. OHCA patients were identified in the CEMSIS database using cardiac rhythm, procedures, medications, and provider impression. Probabilistic linkage blocks were created using in-hospital death or one of the following primary or secondary diagnoses (ICD-9-CM) in the OSHPD databases: cardiac arrest (427.5), sudden death (798), ventricular tachycardia (427.1), ventricular fibrillation (427.4), and acute myocardial infarction (410.xx). Blocking variables included incident date, gender, date of birth, age, and/or destination facility. Due to the volume of cases, match thresholds were established based on clerical record review for each block individually. Match variables included incident date, destination facility, date of birth, sex, race, and ethnicity.

RESULTS

Of the 14,603 cases of OHCA we identified in CEMSIS, 91 (0.6%) duplicate records were excluded. Overall, 46% of the data used in the linkage algorithm were missing in CEMSIS. We linked 4,961/14,512 (34.2%) records. Linkage rates varied significantly by local EMS agency, ranging from 1.4 to 61.1% (OR for linkage 0.009-0.76; p < 0.0001). After excluding the local EMS agency with the outlying low linkage rate, we linked 4,934/12,596 (39.2%) records.

CONCLUSION

Probabilistic linkage of CEMSIS prehospital data with OSHPD outcomes data was severely limited by the completeness of the EMS data. States and EMS agencies should aim to overcome data limitations so that more effective linkages are possible.

Trends of pre-hospital emergency medical services activity over 10 years: a population-based registry analysis

Background

The number of requests to pre-hospital emergency medical services (PEMS) has increased in Europe over the last 20 years, but epidemiology of PEMS interventions has little be investigated. The aim of this analysis was to describe time trends of PEMS activity in a region of western Switzerland.

Methods

Use of data routinely and prospectively collected for PEMS intervention in the Canton of Vaud, Switzerland, from 2001 to 2010. This Swiss Canton comprises approximately 10% of the whole Swiss population.

Results

We observed a 40% increase in the number of requests to PEMS between 2001 and 2010. The overall rate of requests was 35/1000 inhabitants for ambulance services and 10/1000 for medical interventions (SMUR), with the highest rate among people aged ≥ 80. Most frequent reasons for the intervention were related to medical problems, predominantly unconsciousness, chest pain respiratory distress, or cardiac arrest, whereas severe trauma interventions decreased over time. Overall, 89% were alive after 48 h. The survival rate after 48 h increased regularly for cardiac arrest or myocardial infarction.

Conclusion

Routine prospective data collection of prehospital emergency interventions and monitoring of activity was feasible over time. The results we found add to the understanding of determinants of PEMS use and need to be considered to plan use of emergency health services in the near future. More comprehensive analysis of the quality of services and patient safety supported by indicators are also required, which might help to develop prehospital emergency services and new processes of care.

Evaluation of the impact of implementing the emergency medical services traumatic brain injury guidelines in Arizona: the Excellence in Prehospital Injury Care (EPIC) study methodology

Traumatic brain injury (TBI) exacts a great toll on society. Fortunately, there is growing evidence that the management of TBI in the early minutes after injury may significantly reduce morbidity and mortality. In response, evidence-based prehospital and in-hospital TBI treatment guidelines have been established by authoritative bodies. However, no large studies have yet evaluated the effectiveness of implementing these guidelines in the prehospital setting. This article describes the background, design, implementation, emergency medical services (EMS) treatment protocols, and statistical analysis of a prospective, controlled (before/after), statewide study designed to evaluate the effect of implementing the EMS TBI guidelines-the Excellence in Prehospital Injury Care (EPIC) study (NIH/NINDS R01NS071049, "EPIC"; and 3R01NS071049-S1, "EPIC4Kids"). The specific aim of the study is to test the hypothesis that statewide implementation of the international adult and pediatric EMS TBI guidelines will significantly reduce mortality and improve nonmortality outcomes in patients with moderate or severe TBI. Furthermore, it will specifically evaluate the effect of guideline implementation on outcomes in the subgroup of patients who are intubated in the field. Over the course of the entire study (~9 years), it is estimated that approximately 25,000 patients will be enrolled.

Quality improvement in pre-hospital critical care: increased value through research and publication

Pre-hospital critical care is considered to be a complex intervention with a weak evidence base. In quality improvement literature, the value equation has been used to depict the inevitable relationship between resources expenditure and quality. Increased value of pre-hospital critical care involves moving a system from quality assurance to quality improvement. Agreed quality indicators can be integrated in existing quality improvement and complex intervention methodology. A QI system for pre-hospital critical care includes leadership involvement, multi-disciplinary buy-in, data collection infrastructure and long-term commitment. Further, integrating process control with governance systems allows evidence-based change of practice and publishing of results.

Epinephrine use and outcomes in anaphylaxis patients transported by emergency medical services

BACKGROUND

Anaphylaxis is a potentially life-threatening allergic reaction that may require emergency medical system (EMS) transport. Fatal anaphylaxis is associated with delayed epinephrine administration. Patient outcome data to assess appropriateness of EMS epinephrine administration are sparse.

OBJECTIVES

The objectives of this study are to (1) determine the frequency of epinephrine administration in EMS-transported patients with allergic complaints, (2) identify predictors of epinephrine administration, and (3) determine frequency of emergency department (ED) epinephrine administration after EMS transport.

METHODS

A cohort study was conducted from over 5 years. A total of 59187 EMS transports of an Advanced Life Support (ALS) ambulance service were studied.

RESULTS

One hundred and three patient transports for allergic complaints were analyzed. Fifteen patients received EMS epinephrine, and epinephrine was recommended for 2 additional patients who refused, for a total of 17 (17%) patients for whom epinephrine was administered or recommended. Emergency medical system epinephrine administration or recommendation was associated with venom as a trigger (29% vs 8%; odds ratio [OR], 4.70; 95% confidence interval [CI], 1.28-17.22; P = .013), respiratory symptoms (88% vs 52%; OR, 6.83; 95% CI, 1.47-31.71; P = .006), and fulfillment of anaphylaxis diagnostic criteria (82% vs 49%; OR, 3.50; 95% CI, 0.94-13.2; P = .0498). Four (4%) patients received epinephrine after ED arrival.

CONCLUSION

Low rates of epinephrine administration were observed. The association of EMS administration of epinephrine with respiratory symptoms, fulfillment of anaphylaxis diagnostic criteria, and low rate of additional epinephrine administration in the ED suggest that ALS EMS administered epinephrine based on symptom severity. Additional studies of EMS anaphylaxis management including ED management and outcomes are needed.

National characteristics of emergency medical services responses in the United States

OBJECTIVE

Despite its long history and current prominence in U.S. communities, only limited data describe the national characteristics of emergency medical services (EMS) care in the United States. We sought to characterize out-of-hospital EMS care in the United States.

METHODS

We conducted an analysis of the 2010 National Emergency Medical Services Information System (NEMSIS) research data set, encompassing EMS emergency response data from 29 states. From these data, we estimated the national number and incidence of EMS responses. We also characterized EMS responses and the patients receiving care.

RESULTS

There were 7,563,843 submitted EMS responses, corresponding to an estimated national incidence of 17.4 million EMS emergency responses per year (56 per 1,000 person-years). The EMS response incidence varied by U.S. Census region (South 137.4 per 1,000 population per year, Northeast 85.2, West 39.7, and Midwest 33.3). The use of lights and sirens varied across Census regions (Northeast 90.3%, South 76.7%, West 68.8%, and Midwest 67.5%). The percentage of responses resulting in patient contact varied across Census regions (range 78.4% to 95.7%). The EMS time intervals were similar between Census regions; response median 5 minutes (interquartile range [IQR] 3-9), scene 14 minutes (10-20), and transport 11 minutes (7-19). Underserved populations (the elderly, minorities, rural residents, and the uninsured) were large users of EMS resources.

CONCLUSION

These data highlight the breadth and diversity of EMS demand and care in the United States.

Value generation and health reform in emergency medical services

American Emergency Medical Services (EMS) agencies largely have been untouched by the dramatic health care reform efforts underway, although change seems imminent. Clarifying the role of the modern EMS system, and the yardsticks used to evaluate its performance, will be a challenge.This paper introduces the concept of value (or outcomes to cost ratio) in EMS, and offers value assessment as a means by which reform decisions can be framed. The best reform decisions are those that optimize both costs and outcomes. This includes: (1) attention to the patient experience; (2) disallowing the provision of unhelpful, harmful or disproven prehospital care; and (3) expanding patient dispositions beyond Emergency Departments. Costs of care will need to be tracked carefully and acknowledged. Value generation should serve as the goal of ongoing EMS reform efforts.

Health-related quality of life in pediatric minor injury: reliability, validity, and responsiveness of the Pediatric Quality of Life Inventory in the emergency department

OBJECTIVE

To evaluate the feasibility, reliability, validity, and responsiveness of the Pediatric Quality of Life Inventory 4.0 Generic Core Scales (PedsQL) in the first 2 weeks after pediatric emergency department care of minor injury.

DESIGN

Prospective cohort study.

SETTING

Pediatric hospital emergency department.

PARTICIPANTS

Children and adolescents with minor injury (n = 334).

MAIN OUTCOME MEASURES

Child- and parent-reported clinical outcomes and PedsQL scale scores.

RESULTS

The PedsQL had good to excellent internal consistency reliability (α range, 0.73-0.93). For each day that the clinical symptoms persisted, there were consistent decreases in mean health-related quality of life (HRQOL) scores (validity testing). There were significantly greater negative changes in mean HRQOL scores for fractures vs soft-tissue injuries and for lower vs upper extremity injuries. Clinical outcomes categorized as poor had large negative changes in HRQOL not seen in good outcome groups. Distribution-based indicators of change supported good responsiveness (effect sizes for the physical summary score, 0.01-2.44; group differences at follow-up exceeded estimates of the minimal importance difference).

CONCLUSIONS

The PedsQL is feasible, reliable, and demonstrates good construct and discriminant validity and responsiveness in measuring short-term outcome after minor injury care in the pediatric emergency department. Assessing short-term outcome from the patient perspective with HRQOL measures may greatly enhance our ability to evaluate the effectiveness of emergency department care.

A national model for developing, implementing, and evaluating evidence-based guidelines for prehospital care

In 2007, the Institute of Medicine's (IOM's) Committee on the Future of Emergency Care recommended that a multidisciplinary panel establish a model for developing evidence-based protocols for the treatment of emergency medical systems (EMS) patients. In response, the National EMS Advisory Council (NEMSAC) and the Federal Interagency Committee on EMS (FICEMS) convened a panel of multidisciplinary experts to review current strategies for developing evidence-based guidelines (EBGs) and to propose a model for developing such guidelines for the prehospital milieu. This paper describes the eight-step model endorsed by FICEMS, NEMSAC, and a panel of EMS and evidence-based medicine experts. According to the model, prehospital EBG development would begin with the input of evidence from various external sources. Potential EBG topics would be suggested following a preliminary evidentiary review; those topics with sufficient extant foundational evidence would be selected for development. Next, the Grading of Recommendations, Assessment, Development, and Evaluation (GRADE) methodology would be used to determine a quality-of-evidence rating and a strength of recommendation related to the patient care guidelines. More specific, contextualized patient care protocols would then be generated and disseminated to the EMS community. After educating EMS professionals using targeted teaching materials, the protocols would be implemented in local EMS systems. Finally, effectiveness and uptake would be measured with integrated quality improvement and outcomes monitoring systems. The constituencies and experts involved in the model development process concluded that the use of such transparent, objective, and scientifically rigorous guidelines could significantly increase the quality of EMS care in the future.

A qualitative assessment of factors that influence emergency medical services partnerships in prehospital research

OBJECTIVES

  Recent efforts to increase emergency medical services (EMS) prehospital research productivity by focusing on reducing systems-related barriers to research participation have had limited effect. The objective of this study was to explore the barriers and motivators to participating in research at the agency and provider levels and to solicit suggestions for improving the success of prehospital research projects.

METHODS

  The authors conducted a qualitative exploratory study of EMS personnel using focus group and focused interview methodology. EMS personnel affiliated with the Pediatric Emergency Care Applied Research Network (PECARN) hospitals were selected for participation using a purposive sampling plan. Exploratory questioning identified identified factors that influence participation in research and suggestions for ensuring successful research partnerships. Through iterative coding and analysis, the factors and suggestions that emerged from the data were organized into a behavioral change planning model.

RESULTS

  Fourteen focus groups were conducted, involving 88 EMS prehospital providers from 11 agencies. Thirty-five in-depth interviews with EMS administrators and researchers were also conducted. This sample was representative of prehospital personnel servicing the PECARN catchment area and was sufficient for analytical saturation. From the transcripts, the authors identified 17 barriers and 12 motivators to EMS personnel participation in research. Central to these data were patient safety, clarity of research purpose, benefits, liability, professionalism, research training, communication with the research team, reputation, administrators' support, and organizational culture. Interviewees also made 29 suggestions for increasing EMS personnel participation in research. During data analysis, the PRECEDE/PROCEED planning model was chosen for behavioral change to organize the data. Important to this model, factors and suggestions were mapped into those that predispose (knowledge, attitudes, and beliefs), reinforce (social support and norms), and/or enable (organizational) the participation in prehospital research.

CONCLUSIONS

  This study identified factors that influence the participation of EMS personnel in research and gathered suggestions for improvement. These findings were organized into the PRECEDE/PROCEED planning model that may help researchers successfully plan, implement, and complete prehospital research projects. The authors provide guidance to improve the research process including directly involving EMS providers throughout, a strong theme that emerged from the data. Future work is needed to determine the validity of this model and to assess if these findings are generalizable across prehospital settings other than those affiliated with PECARN.

Measuring quality in emergency medical services: a review of clinical performance indicators

Measuring quality in Emergency Medical Services (EMSs) systems is challenging. This paper reviews the current approaches to measuring quality in health care and EMS with a focus on currently used clinical performance indicators in EMS systems (US and international systems). The different types of performance indicators, the advantages and limitations of each type, and the evidence-based prehospital clinical bundles are discussed. This paper aims at introducing emergency physicians and health care providers to quality initiatives in EMS and serves as a reference for tools that EMS medical directors can use to launch new or modify existing quality control programs in their systems.

Risk adjustment measures and outcome measures for prehospital trauma research: recommendations from the emergency medical services outcomes project (EMSOP)

OBJECTIVES

The objectives were to conduct a comprehensive, systematic review of the literature for risk adjustment measures (RAMs) and outcome measures (OMs) for prehospital trauma research and to use a structured expert panel process to recommend measures for use in future emergency medical services (EMS) trauma outcomes research.

METHODS

A systematic literature search and review was performed identifying the published studies evaluating RAMs and OMs for prehospital injury research. An explicit structured review of all articles pertaining to each measure was conducted using the previously established methodology developed by the Canadian Physiotherapy Association ("Physical Rehabilitation Outcome Measures").

RESULTS

Among the 4,885 articles reviewed, 96 RAMs and/or OMs were identified from the existing literature (January 1958 to February 2010). Only one measure, the Glasgow Coma Scale (GCS), currently meets Level 1 quality of evidence status and a Category 1 (strong) recommendation for use in EMS trauma research. Twelve RAMs or OMs received Category 2 status (promising, but not sufficient current evidence to strongly recommend), including the motor component of GCS, simplified motor score (SMS), the simplified verbal score (SVS), the revised trauma score (RTS), the prehospital index (PHI), EMS provider judgment, the revised trauma index (RTI), the rapid acute physiology score (RAPS), the rapid emergency medicine score (REMS), the field trauma triage (FTT), the pediatric triage rule, and the out-of-hospital decision rule for pediatrics.

CONCLUSIONS

Using a previously published process, a structured literature review, and consensus expert panel opinion, only the GCS can currently be firmly recommended as a specific RAM or OM for prehospital trauma research (along with core measures that have already been established and published). This effort highlights the paucity of reliable, validated RAMs and OMs currently available for outcomes research in the prehospital setting and hopefully will encourage additional, methodologically sound evaluations of the promising, Category 2 RAMs and OMs, as well as the development of new measures.

Linking ambulance, emergency department and hospital admissions data: understanding the emergency journey

OBJECTIVE

To assess the accuracy of data linkage across the spectrum of emergency care in the absence of a unique patient identifier, and to use the linked data to examine service delivery outcomes in an emergency department (ED) setting.

DESIGN

Automated data linkage and manual data linkage were compared to determine their relative accuracy. Data were extracted from three separate health information systems: ambulance, ED and hospital inpatients, then linked to provide information about the emergency journey of each patient. The linking was done manually through physical review of records and automatically using a data linking tool (Health Data Integration) developed by the CSIRO (Commonwealth Scientific and Industrial Research Organisation). Match rate and quality of the linking were compared.

SETTING

10,835 patient presentations to a large, regional teaching hospital ED over a 2-month period (August - September 2007).

RESULTS

Comparison of the manual and automated linkage outcomes for each pair of linked datasets demonstrated a sensitivity of between 95% and 99%; a specificity of between 75% and 99%; and a positive predictive value of between 88% and 95%.

CONCLUSIONS

Our results indicate that automated linking provides a sound basis for health service analysis, even in the absence of a unique patient identifier. The use of an automated linking tool yields accurate data suitable for planning and service delivery purposes and enables the data to be linked regularly to examine service delivery outcomes.

Prehospital care and new models of regionalization

This article summarizes the discussions of the emergency medical services (EMS) breakout session at the June 2010 Academic Emergency Medicine consensus conference "Beyond Regionalization: Integrated Networks of Emergency Care." The group focused on prehospital issues such as the identification of patients by EMS personnel, protocol-driven destination selection, bypassing closer nondesignated centers to transport patients directly to more distant designated specialty centers, and the modes of transport to be used as they relate to the regionalization of emergency care. It is our hope that the proposed research agenda will be advanced in a way that begins to rigorously approach the unanswered research questions and that these answers, in turn, will lead to an evidence-based, cohesive, comprehensive, and more uniform set of guidelines that govern the delivery and practice of prehospital emergency care.

Validation of length of hospital stay as a surrogate measure for injury severity and resource use among injury survivors

OBJECTIVES

While hospital length of stay (LOS) has been used as a surrogate injury outcome when more detailed outcomes are unavailable, it has not been validated. This project sought to validate LOS as a proxy measure of injury severity and resource use in heterogeneous injury populations.

METHODS

This observational study used four retrospective cohorts: patients presenting to 339 California emergency departments (EDs) with a primary International Classification of Diseases, Ninth Revision (ICD-9), injury diagnosis (years 2005-2006); California hospital injury admissions (a subset of the ED population); trauma patients presenting to 48 Oregon EDs (years 1998-2003); and injured Medicare patients admitted to 171 Oregon and Washington hospitals (years 2001-2002). In-hospital deaths were excluded, as they represent adverse outcomes regardless of LOS. Duration of hospital stay was defined as the number of days from ED admission to hospital discharge. The primary composite outcome (dichotomous) was serious injury (Injury Severity Score [ISS] >or= 16 or ICD-9 ISS <or= 0.90) or resource use (major surgery, blood transfusion, or prolonged ventilation). The discriminatory accuracy of LOS for identifying the composite outcome was evaluated using receiver operating characteristic (ROC) analysis. Analyses were also stratified by age (0-14, 15-64, and >or=65 years), hospital type, and hospital annual admission volume.

RESULTS

The four cohorts included 3,989,409 California ED injury visits (including admissions), 236,639 California injury admissions, 23,817 Oregon trauma patients, and 30,804 Medicare injury admissions. Composite outcome rates for the four cohorts were 2.1%, 29%, 27%, and 22%, respectively. Areas under the ROC curves for overall LOS were 0.88 (California ED), 0.74 (California admissions), 0.82 (Oregon trauma patients), and 0.68 (Medicare patients). In general, the discriminatory value of LOS was highest among children, tertiary trauma centers, and higher volume hospitals, although this finding differed by the injury population and outcome assessed.

CONCLUSIONS

Hospital LOS may be a reasonable proxy for serious injury and resource use among injury survivors when more detailed outcomes are unavailable, although the discriminatory value differs by age and the injury population being studied.

Paramedic Rapid Sequence Intubation for Severe Traumatic Brain Injury: Perspectives from an Expert Panel

Although early intubation has become standard practice in the prehospital management of severe traumatic brain injury (TBI), many patients cannot be intubated without neuromuscular blockade. Several emergency medical services (EMS) systems have implemented paramedic rapid sequence intubation (RSI) protocols, with published reports documenting apparently conflicting outcomes effects. In response, the Brain Trauma Foundation assembled a panel of experts to interpret the existing literature regarding paramedic RSI for severe TBI and offer guidance for EMS systems considering adding this skill to the paramedic scope of practice. The interpretation of this panel can be summarized as follows: (1) the existing literature regarding paramedic RSI is inconclusive, and apparent differences in outcome can be explained by use of different methodologies and variability in comparison groups; (2) the use of Glasgow Coma Scale score alone to identify TBI patients requiring RSI is limited, with additional research needed to refine our screening criteria; (3) suboptimal RSI technique as well as subsequent hyperventilation may account for some of the mortality increase reported with the procedure; (4) initial and ongoing training as well as experience with RSI appear to affect performance; and (5) the success of a paramedic RSI program is dependent on particular EMS and trauma system characteristics.

Impact of Liberalization of Protocols for the Use of Morphine Sulfate in an Urban Emergency Medical Services System

OBJECTIVE

To investigate the impact of liberalization of paramedic management protocols for the use of morphine sulfate (MS).

METHODS

A retrospective database analysis tallied and categorized MS use into seven conditions during two intervals--six months before (control) and six months after (study) the protocol change.

RESULTS

In the control interval, 760 of 34,020 (2.2%) patients received MS. In the study interval, 999 of 30,320 (3.3%) received the drug, a 50% relative increase in MS use. MS use dramatically increased in two assessment categories: other painful medical conditions (19.0% vs. 2.8% of transports, relative risk [RR] 6.8, 95% confidence interval [CI] 5.2-8.9) and nontraumatic abdominal pain (9.2% vs. 1.9% of transports, RR 4.8, 95% CI 3.3-6.9).

CONCLUSION

Liberalization of pain management protocols resulted in an appreciable increase in the use of MS only in medical categories, predominantly abdominal pain, with no apparent safety or misuse issues.

The Resuscitation Outcomes Consortium Epistry-Trauma: design, development, and implementation of a North American epidemiologic prehospital trauma registry

Injury is a major public health problem generating substantial morbidity, mortality, and economic burden on society. The majority of seriously injured persons are initially evaluated and cared for by prehospital providers, however the effect of emergency medical services (EMS) systems, EMS clinical care, and EMS interventions on trauma patient outcomes is largely unknown. Outcome-based information to guide future EMS care has been hampered by the lack of comprehensive, standardized, multi-center prehospital data resources that include meaningful patient outcomes. In this paper, we describe the background, design, development, implementation, content, and potential uses of the first North American comprehensive epidemiologic prehospital data registry for injured persons. This data registry samples patients from 264 EMS agencies transporting to 287 acute care hospitals in both the United States and Canada.

International comparison of prehospital trauma care systems

OBJECTIVE

Given the recent emphasis on developing prehospital trauma care globally, we embarked upon a multicentre study to compare trauma patients' outcome within and between countries with technician-operated advanced life support (ALS) and physician-operated (Doc-ALS) emergency medical service (EMS) systems. These environments represent the continuum of prehospital care in high income countries with more advanced prehospital trauma care systems.

METHODS

Five countries with ALS-EMS system and four countries with Doc-ALS EMS system provided us with de-identified patient-level data from their national or local trauma registries. Generalised linear latent and mixed models was used in order to compare emergency department (ED) shock rate (systolic blood pressure (SBP) <90mmHg) and early trauma fatality rate (i.e. death during the first 24h after hospital arrival) between ALS and Doc-ALS EMS systems. Logistic regression was used to compare outcomes of interest among different countries, accounting for within-system correlation in patient outcomes.

RESULTS

After adjustment for patient age, sex, type and mechanism of injury, injury severity score and SBP at scene, the ED shock rate did not vary significantly between Doc-ALS and ALS systems (OR: 1.16, 95% CI: 0.73-1.91). However, the early trauma fatality rate was significantly lower in Doc-ALS EMS systems compared with ALS EMS systems (OR: 0.70, 95% CI: 0.54-0.91). Furthermore, we found a considerable heterogeneity in patient outcomes among countries even with similar type of EMS systems.

CONCLUSION

These findings suggest that prehospital trauma care systems that dispatch a physician to the scene may be associated with lower early trauma fatality rates, but not necessarily with significantly better outcomes on other clinical measures. The reasons for these findings deserve further studies.

A Comprehensive Framework for Determining the Cost of an Emergency Medical Services System

To determine the cost of an emergency medical services (EMS) system, researchers, policymakers, and EMS providers need a framework with which to identify the components of the system that must be included in any cost calculations. Such a framework will allow for cost comparisons across studies, communities, and interventions. The objective of this article is to present an EMS cost framework. This framework was developed by a consensus panel after analysis of existing peer-reviewed and non-peer-reviewed resources, as well as independent expert input. The components of the framework include administrative overhead, bystander response, communications, equipment, human resources, information systems, medical oversight, physical plant, training, and vehicles. There is no hierarchical rank to these components; they are all necessary. Within each component, there are subcomponents that must be considered. This framework can be used to standardize the calculation of EMS system costs to a community. Standardizing the calculation of EMS cost will allow for comparisons of costs between studies, communities, and interventions.

Design and implementation of resuscitation research: special challenges and potential solutions

Evaluation of the effectiveness of resuscitation interventions is challenging. We describe these challenges, which include design, enrolment and analysis issues. Randomized trials establish if interventions work in predefined populations. "Efficacy" trials determine whether interventions work under ideal conditions. "Effectiveness" trials determine whether interventions work under usual practice conditions. These trials represent a trade-off between internal validity versus external validity. Randomized trials use random allocation of participants to interventions to produce study groups that are similar with respect to known and unknown risk factors, reduce bias in the allocation of participants, and assure that statistical tests have valid significance levels. In the emergency setting, there is a risk that treatment offered to control patients will be contaminated by providers' experiences of applying the intervention to patients receiving the experimental intervention. Frequently there is not time to obtain consent from a patient in an emergency setting. Exception from consent can be applied if certain conditions are met. Enrolment in a research study must be initiated quickly in an emergency setting or the patient will die or become disabled. In any trial, data can be used to explore different aspects of response to treatment: multiple treatments, subgroups, events; and interim analyses. We propose solutions to these challenges to help potential investigators through the myriad of difficulties in initiating trials in a complex environment. Design of simple trials that have adequate power enhances their external validity. Allocating groups of episodes to interventions by randomizing by clusters, rather than by individual patients reduces provider noncompliance. Waiver from consent for emergency research and use of novel technologies could facilitate enrolment despite time constraints. Rigorous statistical methods can be used to analyze multiple data without an excessive increase in the chance of a false-positive result.

Out-of-hospital endotracheal intubation: where are we?

While remaining prominent in paramedic care and beneficial to some patients, out-of-hospital endotracheal intubation has not clearly improved survival or reduced morbidity from critical illness or injury when studied more broadly. Recent studies identify equivocal or unfavorable clinical effects, adverse events and errors, interaction with other important resuscitation interventions, and challenges in providing and maintaining procedural skill. We provide an overview of current data evaluating the overall effectiveness, safety, and feasibility of paramedic out-of-hospital endotracheal intubation. These studies highlight our limited understanding of out-of-hospital endotracheal intubation and the need for new strategies to improve airway support in the out-of-hospital setting.

The National EMS Research strategic plan

One of the eight major recommendations put forth by the National EMS Research Agenda Implementation Project in 2002 was the development of an emergency medical services (EMS) research strategic plan. Using a modified Delphi technique along with a consensus conference approach, a strategic plan for EMS research was created. The plan includes recommendations for concentrating efforts by EMS researchers, policy makers, and funding resources with the ultimate goal of improving clinical outcomes. Clinical issues targeted for additional research efforts include evaluation and treatment of patients with asthma, acute cardiac ischemia, circulatory shock, major injury, pain, acute stroke, and traumatic brain injury. The plan calls for developing, evaluating, and validating improved measurement tools and techniques. Additional research to improve the education of EMS personnel as well as system design and operation is also suggested. Implementation of the EMS research strategic plan will improve both the delivery of services and the care of individuals who access the emergency medical system.

Prehospital pain management in children suffering traumatic injury

Prehospital pain management has become an important emergency medical services (EMS) patient care issue.

OBJECTIVES

To describe the frequency of EMS and emergency department (ED) analgesic administration to injured children; to describe factors associated with the administration of analgesia by EMS; and to assess whether children with lower-extremity fractures receive analgesia as frequently as do adults with similar injuries.

METHODS

This was a retrospective study of children (age < 21 years) who were transported by EMS between January 2000 and June 2002 and had a final hospital diagnosis of extremity fractures or burns. Secondarily, children with lower-extremity fractures were compared with a cohort of EMS-transported adults with similar injuries and transported during the same study period. Receipt of and time of parenteral analgesia were recorded.

RESULTS

Seventy-three children met the inclusion criteria. The mean (range) age of this sample was 12.4 (0.9-21) years, with only four patients aged < 5 years. A majority of the patients were male (49/73, 67.1%) and sustained femur (20/73, 27.4%) or tibia/fibula (26/73, 35.6%) fractures. Few pediatric patients received prehospital analgesia (16/73, 21.9%), while a majority received analgesia in the ED (58/73, 79.4%). Prehospital analgesia was associated with earlier patient treatment than that administered in the ED (22.3 +/- 5.9 min vs. 88.3 +/- 38.2 min). Comparing children (n = 33) with adults (n = 76) with similar lower-extremity fractures, a small insignificant difference was found in the rate of prehospital analgesia between children and adults (7/33, 21.2%, vs. 20/56, 26.3%).

CONCLUSION

Few pediatric patients receive prehospital analgesia, although most ultimately received ED analgesia. Few factors were identified that could be associated with EMS oligoanalgesia. No difference was found between children and adults in the rates of EMS analgesia.

The Pediatric Emergency Care Applied Research Network (PECARN): rationale, development, and first steps

Since its formal recognition as a medical specialty, the field of pediatric emergency medicine has made substantial advances with respect to its scope and sophistication. These advances have occurred in clinical practice as well as in the research base to improve clinical practice. There remain, however, many areas in emergency medical services for children (EMSC) in the out-of-hospital, emergency department (ED), and hospital settings that suffer from a lack of data to guide practice. In an effort to expand the quality and quantity of research in pediatric emergency care, the Pediatric Emergency Care Applied Research Network (PECARN) was created in October of 2001. PECARN is the first federally funded national network for research in EMSC and is the result of cooperative agreement grants funded through the Health Resources and Services Administration with the purpose of developing an infrastructure capable of overcoming inherent barriers to EMSC research. Among these recognized barriers are low incidence rates of serious pediatric emergency events, the need for large numbers of children from varied backgrounds to achieve broadly representative study samples, lack of an infrastructure to test the efficacy of pediatric emergency care, and the need for a mechanism to translate study results into clinical practice. PECARN will serve as a national platform for collaborative research involving the continuum of care within the EMSC system, including out-of-hospital care, patient transport, ED and in-hospital care, and rehabilitation. This article describes the history of EMSC, the need for a national collaborative research network in EMSC, the organization and development of PECARN, and the work plan for the network.

Emergency system prospective performance evaluation for cardiac arrest in Lombardia, an Italian region

BACKGROUND

The aim of this research is to evaluate quality of out-of-hospital medical services in our country, using performance indicators and a new computerised database.

METHODS

(a)

EXPERIMENTAL DESIGN

Data were collected prospectively in three emergency dispatch centres for 90 days. Follow-up was evaluated at 1 day and 1 month after the event. This paper presents data on the cardiac arrest cohort only. (b)

SETTING

Three emergency dispatch centres in Lombardia. (c)

PATIENTS

One hundred and seventy-eight patients in non-traumatic cardiac arrest were enrolled. (d)

INTERVENTIONS

None. The study was observational only.

RESULTS

Mean interval between phone call and arrival on scene was 8.5+/-3.5 min. BLS manoeuvres were carried out from bystanders only in 15% of the cohort; this was associated with significant mortality reduction (85.7 versus 95.8%, chi(2) P<0.05). One hundred and thirty-three patients (75%) received assistance from BLS crews while only 45 patients (25%) were assisted by ALS medical personel, with a significant mortality reduction (ALS deaths 86.7%, BLS deaths 97%). Total 24 h survival was 9% and survival at 1 month declined to 6.17%.

CONCLUSIONS

Quality monitoring produces objective information on interventions and outcomes. Only with this information, is it possible to implement improvement programmes that are planned according to the data presented.