Barriers to EMS System Evaluation: Problems Associated with Field Data Collection

EMS Treatment Guidelines in Major Traumatic Brain Injury With Positive Pressure Ventilation

Importance

The Excellence in Prehospital Injury Care (EPIC) study demonstrated improved survival in patients with severe traumatic brain injury (TBI) following implementation of the prehospital treatment guidelines. The impact of implementing these guidelines in the subgroup of patients who received positive pressure ventilation (PPV) is unknown.

Objective

To evaluate the association of implementation of prehospital TBI evidence-based guidelines with survival among patients with prehospital PPV.

Design, Setting, and Participants

The EPIC study was a multisystem, intention-to-treat study using a before/after controlled design. Evidence-based guidelines were implemented by emergency medical service agencies across Arizona. This subanalysis was planned a priori and included participants who received prehospital PPV. Outcomes were compared between the preimplementation and postimplementation cohorts using logistic regression, stratified by predetermined TBI severity categories (moderate, severe, or critical). Data were collected from January 2007 to June 2017, and data were analyzed from January to February 2023.

Exposure

Implementation of the evidence-based guidelines for the prehospital care of patient with TBI.

Main Outcomes and Measures

The primary outcome was survival to hospital discharge, and the secondary outcome was survival to admission.

Results

Among the 21 852 participants in the main study, 5022 received prehospital PPV (preimplementation, 3531 participants; postimplementation, 1491 participants). Of 5022 included participants, 3720 (74.1%) were male, and the median (IQR) age was 36 (22-54) years. Across all severities combined, survival to admission improved (adjusted odds ratio [aOR], 1.59; 95% CI, 1.28-1.97), while survival to discharge did not (aOR, 0.94; 95% CI, 0.78-1.13). Within the cohort with severe TBI but not in the moderate or critical subgroups, survival to hospital admission increased (aOR, 6.44; 95% CI, 2.39-22.00), as did survival to discharge (aOR, 3.52; 95% CI, 1.96-6.34).

Conclusions and Relevance

Among patients with severe TBI who received active airway interventions in the field, guideline implementation was independently associated with improved survival to hospital admission and discharge. This was true whether they received basic airway interventions or advanced airways. These findings support the current guideline recommendations for aggressive prevention/correction of hypoxia and hyperventilation in patients with severe TBI, regardless of which airway type is used.

Correlation between prehospital and in-hospital hypotension and outcomes after traumatic brain injury

BACKGROUND AND OBJECTIVE

Hypotension has a powerful effect on patient outcome after traumatic brain injury (TBI). The relative impact of hypotension occurring in the field versus during early hospital resuscitation is unknown. We evaluated the association between hypotension and mortality and non-mortality outcomes in four cohorts defined by where the hypotension occurred [neither prehospital nor hospital, prehospital only, hospital only, both prehospital and hospital].

METHODS

Subjects ≥10 years with major TBI were included. Standard statistics were used for unadjusted analyses. We used logistic regression, controlling for significant confounders, to determine the adjusted odds (aOR) for outcomes in each of the three cohorts.

RESULTS

Included were 12,582 subjects (69.8% male; median age 44 (IQR 26-61). Mortality by hypotension status: No hypotension: 9.2% (95%CI: 8.7-9.8%); EMS hypotension only: 27.8% (24.6-31.2%); hospital hypotension only: 45.6% (39.1-52.1%); combined EMS/hospital hypotension 57.6% (50.0-65.0%); (p < 0.0001). The aOR for death reflected the same progression: 1.0 (reference-no hypotension), 1.8 (1.39-2.33), 2.61 (1.73-3.94), and 4.36 (2.78-6.84), respectively. The proportion of subjects having hospital hypotension was 19.0% (16.5-21.7%) in those with EMS hypotension compared to 2.0% (1.8-2.3%) for those without (p < 0.0001). Additionally, the proportion of patients with TC hypotension was increased even with EMS "near hypotension" up to an SBP of 120 mmHg [(aOR 3.78 (2.97, 4.82)].

CONCLUSION

While patients with hypotension in the field or on arrival at the trauma center had markedly increased risk of death compared to those with no hypotension, those with prehospital hypotension that was not resolved before hospital arrival had, by far, the highest odds of death. Furthermore, TBI patients who had prehospital hypotension were five times more likely to arrive hypotensive at the trauma center than those who did not. Finally, even "near-hypotension" in the field was strongly and independently associated the risk of a hypotensive hospital arrival (<90 mmHg). These findings are supportive of the prehospital guidelines that recommend aggressive prevention and treatment of hypotension in major TBI.

Optimal Out-of-Hospital Blood Pressure in Major Traumatic Brain Injury: A Challenge to the Current Understanding of Hypotension

STUDY OBJECTIVE

Little is known about the out-of-hospital blood pressure ranges associated with optimal outcomes in traumatic brain injuries (TBI). Our objective was to evaluate the associations between out-of-hospital systolic blood pressure (SBP) and multiple hospital outcomes without assuming any predefined thresholds for hypotension, normotension, or hypertension.

METHODS

This was a preplanned secondary analysis from the Excellence in Prehospital Injury Care (EPIC) TBI study. Among patients (age ≥10 years) with major TBIs (Barell Matrix type 1 and/or Abbreviated Injury Scale-head severity ≥3) and lowest out-of-hospital SBPs of 40 to 299 mmHg, we utilized generalized additive models to summarize the distributions of various outcomes as smoothed functions of SBP, adjusting for important and significant confounders. The subjects who were enrolled in the study phase after the out-of-hospital TBI guideline implementation were used to validate the models developed from the preimplementation cohort.

RESULTS

Among 12,169 included cases, the mortality model revealed 3 distinct ranges: (1) a monotonically decreasing relationship between SBP and the adjusted probability of death from 40 to 130 mmHg, (2) lowest adjusted mortality from 130 to 180 mmHg, and (3) rapidly increasing mortality above 180 mmHg. A subanalysis of the cohorts with isolated TBIs and multisystem injuries with TBIs revealed SBP mortality patterns that were similar to each other and to that of the main analysis. While the specific SBP ranges varied somewhat for the nonmortality outcomes (hospital length of stay, ICU length of stay, discharge to skilled nursing/inpatient rehabilitation, and hospital charges), the patterns were very similar to that of mortality. In each model, validation was confirmed utilizing the postimplementation cohort.

CONCLUSION

Optimal adjusted mortality was associated with a surprisingly high SBP range (130 to 180 mmHg). Below this level, there was no point or range of inflection that would indicate a physiologically meaningful threshold for defining hypotension. Nonmortality outcomes showed very similar patterns. These findings highlight how sensitive the injured brain is to compromised perfusion at SBP levels that, heretofore, have been considered adequate or even normal. While the study design does did not allow us to conclude that the currently recommended treatment threshold (<90 mmHg) should be increased, the findings imply that the definition of hypotension in the setting of TBI is too low. Randomized trials evaluating treatment levels significantly higher than 90 mmHg are needed.

Effect of Implementing the Out-of-Hospital Traumatic Brain Injury Treatment Guidelines: The Excellence in Prehospital Injury Care for Children Study (EPIC4Kids)

STUDY OBJECTIVE

We evaluate the effect of implementing the out-of-hospital pediatric traumatic brain injury guidelines on outcomes in children with major traumatic brain injury.

METHODS

The Excellence in Prehospital Injury Care for Children study is the preplanned secondary analysis of the Excellence in Prehospital Injury Care study, a multisystem, intention-to-treat study using a before-after controlled design. This subanalysis included children younger than 18 years who were transported to Level I trauma centers by participating out-of-hospital agencies between January 1, 2007, and June 30, 2015, throughout Arizona. The primary and secondary outcomes were survival to hospital discharge or admission for children with major traumatic brain injury and in 3 subgroups, defined a priori as those with moderate, severe, and critical traumatic brain injury. Outcomes in the preimplementation and postimplementation cohorts were compared with logistic regression, adjusting for risk factors and confounders.

RESULTS

There were 2,801 subjects, 2,041 in preimplementation and 760 in postimplementation. The primary analysis (postimplementation versus preimplementation) yielded an adjusted odds ratio of 1.16 (95% confidence interval 0.70 to 1.92) for survival to hospital discharge and 2.41 (95% confidence interval 1.17 to 5.21) for survival to hospital admission. In the severe traumatic brain injury cohort (Regional Severity Score-Head 3 or 4), but not the moderate or critical subgroups, survival to discharge significantly improved after guideline implementation (adjusted odds ratio = 8.42; 95% confidence interval 1.01 to 100+). The improvement in survival to discharge among patients with severe traumatic brain injury who received positive-pressure ventilation did not reach significance (adjusted odds ratio = 9.13; 95% confidence interval 0.79 to 100+).

CONCLUSION

Implementation of the pediatric out-of-hospital traumatic brain injury guidelines was not associated with improved survival when the entire spectrum of severity was analyzed as a whole (moderate, severe, and critical). However, both adjusted survival to hospital admission and discharge improved in children with severe traumatic brain injury, indicating a potential severity-based interventional opportunity for guideline effectiveness. These findings support the widespread implementation of the out-of-hospital pediatric traumatic brain injury guidelines.

Association of Statewide Implementation of the Prehospital Traumatic Brain Injury Treatment Guidelines With Patient Survival Following Traumatic Brain Injury: The Excellence in Prehospital Injury Care (EPIC) Study

Importance

Traumatic brain injury (TBI) is a massive public health problem. While evidence-based guidelines directing the prehospital treatment of TBI have been promulgated, to our knowledge, no studies have assessed their association with survival.

Objective

To evaluate the association of implementing the nationally vetted, evidence-based, prehospital treatment guidelines with outcomes in moderate, severe, and critical TBI.

Design, Setting, and Participants

The Excellence in Prehospital Injury Care (EPIC) Study included more than 130 emergency medical services systems/agencies throughout Arizona. This was a statewide, multisystem, intention-to-treat study using a before/after controlled design with patients with moderate to critically severe TBI (US Centers for Disease Control and Prevention Barell Matrix-Type 1 and/or Abbreviated Injury Scale Head region severity ≥3) transported to trauma centers between January 1, 2007, and June 30, 2015. Data were analyzed between October 25, 2017, and February 22, 2019.

Interventions

Implementation of the prehospital TBI guidelines emphasizing avoidance/treatment of hypoxia, prevention/correction of hyperventilation, and avoidance/treatment of hypotension.

Main Outcomes and Measures

Primary: survival to hospital discharge; secondary: survival to hospital admission.

Results

Of the included patients, the median age was 45 years, 14 666 (67.1%) were men, 7181 (32.9%) were women; 16 408 (75.1% ) were white, 1400 (6.4%) were Native American, 743 (3.4% ) were Black, 237 (1.1%) were Asian, and 2791 (12.8%) were other race/ethnicity. Of the included patients, 21 852 met inclusion criteria for analysis (preimplementation phase [P1]: 15 228; postimplementation [P3]: 6624). The primary analysis (P3 vs P1) revealed an adjusted odds ratio (aOR) of 1.06 (95% CI, 0.93-1.21; P = .40) for survival to hospital discharge. The aOR was 1.70 (95% CI, 1.38-2.09; P < .001) for survival to hospital admission. Among the severe injury cohorts (but not moderate or critical), guideline implementation was significantly associated with survival to discharge (Regional Severity Score-Head 3-4: aOR, 2.03; 95% CI, 1.52-2.72; P < .001; Injury Severity Score 16-24: aOR, 1.61; 95% CI, 1.07-2.48; P = .02). This was also true for survival to discharge among the severe, intubated subgroups (Regional Severity Score-Head 3-4: aOR, 3.14; 95% CI, 1.65-5.98; P < .001; Injury Severity Score 16-24: aOR, 3.28; 95% CI, 1.19-11.34; P = .02).

Conclusions and Relevance

Statewide implementation of the prehospital TBI guidelines was not associated with significant improvement in overall survival to hospital discharge (across the entire, combined moderate to critical injury spectrum). However, adjusted survival doubled among patients with severe TBI and tripled in the severe, intubated cohort. Furthermore, guideline implementation was significantly associated with survival to hospital admission. These findings support the widespread implementation of the prehospital TBI treatment guidelines.

Trial Registration

ClinicalTrials.gov identifier: NCT01339702.

Association of Out-of-Hospital Hypotension Depth and Duration With Traumatic Brain Injury Mortality

STUDY OBJECTIVE

Out-of-hospital hypotension has been associated with increased mortality in traumatic brain injury. The association of traumatic brain injury mortality with the depth or duration of out-of-hospital hypotension is unknown. We evaluated the relationship between the depth and duration of out-of-hospital hypotension and mortality in major traumatic brain injury.

METHODS

We evaluated adults and older children with moderate or severe traumatic brain injury in the preimplementation cohort of Arizona's statewide Excellence in Prehospital Injury Care study. We used logistic regression to determine the association between the depth-duration dose of hypotension (depth of systolic blood pressure <90 mm Hg integrated over duration [minutes] of hypotension) and odds of inhospital death, controlling for significant confounders.

RESULTS

There were 7,521 traumatic brain injury cases included (70.6% male patients; median age 40 years [interquartile range 24 to 58]). Mortality was 7.8% (95% confidence interval [CI] 7.2% to 8.5%) among the 6,982 patients without hypotension (systolic blood pressure ≥90 mm Hg) and 33.4% (95% CI 29.4% to 37.6%) among the 539 hypotensive patients (systolic blood pressure <90 mm Hg). Mortality was higher with increased hypotension dose: 0.01 to 14.99 mm Hg-minutes 16.3%; 15 to 49.99 mm Hg-minutes 28.1%; 50 to 141.99 mm Hg-minutes 38.8%; and greater than or equal to 142 mm Hg-minutes 50.4%. Log2 (the logarithm in base 2) of hypotension dose was associated with traumatic brain injury mortality (adjusted odds ratio 1.19 [95% CI 1.14 to 1.25] per 2-fold increase of dose).

CONCLUSION

In this study, the depth and duration of out-of-hospital hypotension were associated with increased traumatic brain injury mortality. Assessments linking out-of-hospital blood pressure with traumatic brain injury outcomes should consider both depth and duration of hypotension.

The Effect of Combined Out-of-Hospital Hypotension and Hypoxia on Mortality in Major Traumatic Brain Injury

STUDY OBJECTIVE

Survival is significantly reduced by either hypotension or hypoxia during the out-of-hospital management of major traumatic brain injury. However, only a handful of small studies have investigated the influence of the combination of both hypotension and hypoxia occurring together. In patients with major traumatic brain injury, we evaluate the associations between mortality and out-of-hospital hypotension and hypoxia separately and in combination.

METHODS

All moderate or severe traumatic brain injury cases in the preimplementation cohort of the Excellence in Prehospital Injury Care study (a statewide, before/after, controlled study of the effect of implementing the out-of-hospital traumatic brain injury treatment guidelines) from January 1, 2007, to March 31, 2014, were evaluated (exclusions: <10 years, out-of-hospital oxygen saturation ≤10%, and out-of-hospital systolic blood pressure <40 or >200 mm Hg). The relationship between mortality and hypotension (systolic blood pressure <90 mm Hg) or hypoxia (saturation <90%) was assessed with multivariable logistic regression, controlling for Injury Severity Score, head region severity, injury type (blunt versus penetrating), age, sex, race, ethnicity, payer, interhospital transfer, and trauma center.

RESULTS

Among the 13,151 patients who met inclusion criteria (median age 45 years; 68.6% men), 11,545 (87.8%) had neither hypotension nor hypoxia, 604 (4.6%) had hypotension only, 790 (6.0%) had hypoxia only, and 212 (1.6%) had both hypotension and hypoxia. Mortality for the 4 study cohorts was 5.6%, 20.7%, 28.1%, and 43.9%, respectively. The crude and adjusted odds ratios for death within the cohorts, using the patients with neither hypotension nor hypoxia as the reference, were 4.4 and 2.5, 6.6 and 3.0, and 13.2 and 6.1, respectively. Evaluation for an interaction between hypotension and hypoxia revealed that the effects were additive on the log odds of death.

CONCLUSION

In this statewide analysis of major traumatic brain injury, combined out-of-hospital hypotension and hypoxia were associated with significantly increased mortality. This effect on survival persisted even after controlling for multiple potential confounders. In fact, the adjusted odds of death for patients with both hypotension and hypoxia were more than 2 times greater than for those with either hypotension or hypoxia alone. These findings seem supportive of the emphasis on aggressive prevention and treatment of hypotension and hypoxia reflected in the current emergency medical services traumatic brain injury treatment guidelines but clearly reveal the need for further study to determine their influence on outcome.

EMS ... agenda for the future

In 1996, the National Highway Traffic Safety Administration and the Health Resources and Services Administration, Maternal and Child Health Bureau published the EMS Agenda for the Future. To date, thousands of copies have been distributed to EMS-knowledgeable people, and those who aspire to be, throughout the United States. This article reviews the findings discussed within the EMS Agenda for the Future. This discussion also assesses the effects of these findings on EMS development.

Emergency medical service agency definitions of response intervals

STUDY OBJECTIVE

There is a time continuum from emergency medical services (EMS) dispatch, response, scene, transport, and arrival at the hospital. Previous research has documented favorable patient outcome with short response intervals; however, these studies revealed the documentation of EMS time intervals is not always consistent. This study evaluates how agencies estimate these times and factors that may affect the length of response intervals.

METHODS

The study used a mail questionnaire to assess factors related to response intervals and to determine how agencies define and record response intervals. All ground-based EMS agencies in a southwestern state were invited to participate in the survey. Univariate and stratified data analyses compared definitions of response intervals.

RESULTS

Agencies varied as to how they defined the start and end of the response. Fifty-six percent stated that their response started when the responding unit was notified of the call. However, almost 23% defined response interval as starting when dispatch received the call, and 11% defined it as starting with the initial 911 call. A factor that affected response intervals was routing of the 911 call. Less than 6% of agencies had only 1-call routing.

CONCLUSION

Agencies use different time points as the start and end of their response interval, which makes comparison of results directly related to response intervals across agencies or regions difficult. To maintain an appropriate standard of prehospital emergency medical care throughout the state, the use of consistent standard terminology defining response intervals will help reach that goal.

Hawthorne effect: implications for prehospital research

STUDY OBJECTIVE

The phenomenon of altered behavior or performance resulting from awareness of being a part of an experimental study has been termed the "Hawthorne effect." Prehospital studies generally involve paramedics or are designed to use data collected by paramedics. Our objective was to determine whether paramedic performance, as measured by frequency of documentation, can be modified by (1) written notification of the importance of documentation, (2) written notification of a research project involving paramedic documentation, or (3) written notification of a quality-improvement audit of paramedic documentation.

DESIGN

Prospective, sequential intervention study with five study phases.

SETTING

Urban, all-advanced life support public utility model emergency medical services system with 55,000 emergency calls per year.

PARTICIPANTS

One hundred forty-five paramedics who completed all ambulance run reports from August 1992 to May 1993.

RESULTS

A total of 30,828 run reports was entered into the study. Baseline undocumented parameters ranged from 3.7% to 6.5%. Compared with baseline, a memo to heighten awareness (phase 2) did not alter documentation (P > or = .08). A medication study memo (phase 3) improved medication documentation (P = .0005) and allergies documentation (P = .037). A quality-improvement audit memo (phase 4) improved documentation of all parameters (P < or = .001).

CONCLUSION

The Hawthorne effect occurs in prehospital research. It does not require direct observation, nor does it require direct feedback. However, it may require a perceived demand for performance. The Hawthorne effect must be considered in the design of prehospital studies and interpretation of data collected by paramedics.

Uniform prehospital data elements and definitions: a report from the uniform prehospital emergency medical services data conference

One of the district and universal aspects of emergency medical service (EMS) is the belief that before its implementation many people were dying or being killed by ill-equipped, poorly trained "hearse drivers" and that this tragic state of affairs has been rectified by the advances in the prehospital phase of care. Except for cases of nontraumatic, out-of-hospital cardiac arrest there is almost no convincing scientific evidence to prove that prehospital care has had an impact on morbidity or mortality. At the very foundation of this problem is the lack of a set of broad-based, well-conceived, accurate, reliable, uniform EMS data. Many attempts have been made to develop a uniform EMS data set, but without a national consensus these have not achieved wide distribution. In 1992, with the assistance of the National Highway Traffic Safety Administration, the national consensus process began with a series of meetings involving many EMS agencies and organizations. This culminated in August 1994 with the development of an 81-item uniform EMS data set. We detail the prior attempts at data set development and outline the process leading to the this uniform, national EMS data set.

Near-death-experiences in out-of-hospital cardiac arrest survivors. Meaningful phenomena or just fantasy of death?

Frequent criticism concerning the investigation of near-death-experiences (NDEs) has been the lack of uniform nomenclature and the failure to control the studied population with an elimination of interfering factors such as administration of sedatives and nonspecific stress responses. Greyson's NDE Scale is a 16-item questionnaire developed to standardize further research into mechanisms and effects of NDEs. Using this scale, we interviewed good out-of-hospital cardiac arrest survivors, with documented time-intervals between call for help and restoration of spontaneous circulation, yet without obvious brain damage or known, psychiatric history. The incidence of such experiences appeared to be extremely low among survivors of genuine cardiac arrest events. Alteration of information processing under the influence of hypoxia and hypercarbia only occurs after several minutes of brain ischaemia. International multicentric data collection within the framework for standardized reporting of cardiac arrest events will be the only satisfying method to address this fascinating and intriguing issue.