A national model for developing, implementing, and evaluating evidence-based guidelines for prehospital care

Prehospital Stroke Care Part 2: On-Scene Evaluation and Management by Emergency Medical Services Practitioners

The prehospital phase is a critical component of delivering high-quality acute stroke care. This topical review discusses the current state of prehospital acute stroke screening and transport, as well as new and emerging advances in prehospital diagnosis and treatment of acute stroke. Topics include prehospital stroke screening, stroke severity screening, emerging technologies to aid in the identification and diagnosis of acute stroke in the prehospital setting, prenotification of receiving emergency departments, decision support for destination determination, and the capabilities and opportunities for prehospital stroke treatment in mobile stroke units. Further evidence-based guideline development and implementation of new technologies are critical for ongoing improvements in prehospital stroke care.

Evidence-Based Guidelines for Prehospital Pain Management: Literature and Methods

INTRODUCTION

Emergency Medical Services (EMS) clinicians commonly encounter patients with acute pain. A new set of evidence-based guidelines (EBG) was developed to assist in the prehospital management of pain. Our objective was to describe the methods used to develop these evidence-based guidelines for prehospital pain management.

METHODS

The EBG development process was supported by a previous systematic review conducted by the Agency for Healthcare Research and Quality (AHRQ) covering nine different population, intervention, comparison, and outcome (PICO) questions. A technical expert panel (TEP) was formed and added an additional pediatric-specific PICO question. Identified evidence was evaluated using the Grading of Recommendations, Assessment, Development, and Evaluation (GRADE) framework and tabulated into Summary of Findings tables. The TEP then utilized a rigorous systematic method, including the PanelVoice function, for recommendation development which was applied to generate Evidence to Decision Tables (EtD). This process involved review of the Summary of Findings tables, asynchronous member judging, and facilitated panel discussion to generate final consensus-based recommendations.

RESULTS

The work product described above was completed by the TEP panel from September 2020 to April 2021. For these recommendations, the overall certainty of evidence was very low or low, data for decisions on cost effectiveness and equity were lacking, and feasibility was rated well across all categories. Based on the evidence, one strong and seven conditional recommendations were made, with two PICO questions lacking sufficient evidence to generate a recommendation.

CONCLUSION

We describe a protocol that leveraged established EBG development techniques, the GRADE framework in conjunction with a previous AHRQ systematic review to develop treatment recommendations for prehospital pain management. This process allowed for mitigation of many confounders due to the use of virtual and electronic communication. Our approach may inform future guideline development and increase transparency in the prehospital recommendations development processes.

Recommendations for Improving the Quality of Prehospital Evidence-Based Guidelines

Evidence-based guidelines that provide recommendations for clinical care or operations are increasingly being published to inform the EMS community. The quality of evidence evaluation and methodological rigor undertaken to develop and publish these recommendations vary. This can negatively affect dissemination, education, and implementation efforts. Guideline developers and end users could be better informed by efforts across medical specialties to improve the quality of guidelines, including the use of specific criteria that have been identified within the highest quality guidelines. In this special contribution, we aim to describe the current state of published guidelines available to the EMS community informed by two recent systematic reviews of existing prehospital evidenced based guidelines (EBGs). We further aim to provide a description of key elements of EBGs, methods that can be used to assess their quality, and concrete recommendations for guideline developers to improve the quality of evidence evaluation, guideline development, and reporting. Finally, we outline six key recommendations for improving prehospital EBGs, informed by systematic reviews of prehospital guidelines performed by the Prehospital Guidelines Consortium.

Emergency Medical Services Leadership Perspectives on Implementation of Evidence-Based Guidelines: A Qualitative Study

Introduction: Prehospital evidence-based guidelines (EBGs) are developed to optimize clinical outcomes for emergency medical services (EMS) patients. However, widespread implementation of EBGs is often inconsistent. Therefore, this study aimed to assess the baseline knowledge and practices of EMS leaders related to EBG implementation.Methods: This was a qualitative study using focus groups to assess prehospital implementation awareness and knowledge. Participants were EMS EBG authors, EMS medical directors, and EMS professional organization leaders. Focus groups were held via video conference, audio recorded, and transcribed. Thematic coding used domains and constructs of the Consolidated Framework for Implementation Research (CFIR).Results: Six focus groups were conducted with a total of 18 participants. A total of 1,044 codes were analyzed. "Process" was the CFIR domain with the most codes (n = 350, 33.5%), followed by the "inner setting" (the EMS agency; n = 250, 23.9%), "characteristics of the intervention" (n = 203, 19.4%), "outer setting" (the health care system and community the EMS agency serves, and the broader national EMS professional context; n = 141, 13.5%), and "characteristics of individuals" (n = 100, 9.6%). The ten most frequent constructs across all domains were: reflecting and evaluating, executing, cosmopolitanism, planning, external policy and incentives, design quality and packaging, learning climate, culture, complexity, and other personal attributes.Conclusion: EMS leadership and stakeholder views on EBG implementation identified dominant themes related to the process of implementation and the culture and learning/implementation climate of EMS agencies. Opinions were mixed on the utility of the CFIR as a potential guide for EMS implementation. Further work is required to gain the frontline EMS clinician perspective on implementation and tie key themes to quantitative prehospital implementation outcomes.

Creating a Pediatric Prehospital Destination Decision Tool Using a Modified Delphi Method

Decisions for patient transport by emergency medical services (EMS) are individualized; while established guidelines help direct adult patients to specialty hospitals, no such pediatric equivalents are in wide use. When children are transported to a hospital that cannot provide definitive care, care is delayed and may cause adverse events. Therefore, we created a novel evidence-based decision tool to support EMS destination choice. A multidisciplinary expert panel (EP) of stakeholders reviewed published literature. Four facility capability levels for pediatric care were defined. Using a modified Delphi method, the EP matched specific conditions to a facility pediatric-capability level in a draft tool. The literature review and EP recommendations identified seventeen pediatric medical conditions at risk for secondary transport. In the first voting round, two were rejected, nine met consensus for a specific facility capability level, and six did not reach consensus on the destination facility level. A second round reached consensus on a facility level for the six conditions as well as revision of one previously rejected condition. In the third round, the panel selected a visual display format. Finally, the panel unanimously approved the PDTree. Using a modified Delphi technique, we developed the PDTree EMS destination decision tool by incorporating existing evidence and the expertise of a multidisciplinary panel.

Early administration of steroids in the ambulance setting: Protocol for a type I hybrid effectiveness-implementation trial with a stepped wedge design

BACKGROUND

Pediatric asthma exacerbations are a frequent reason for emergency care. Early administration of oral systemic corticosteroids (OCS) in the emergency department (ED) decreases hospitalization rates and ED length-of-stay (LOS). However, it is unknown whether even earlier OCS administration by emergency medical services (EMS) in the prehospital setting further improves outcomes.

PURPOSE

To describe the background and methods of a type 1 hybrid effectiveness-implementation trial of EMS-administered OCS for pediatric asthma patients incorporating a stepped wedge design and the RE-AIM framework.

METHODS

The study employs a non-randomized stepped wedge design where multiple EMS agencies adopt OCS as a treatment for pediatric asthma exacerbations at varying times. This design accommodates ethical considerations of studying pediatric subjects in the prehospital setting where informed consent is not feasible. We will compare hospitalization rates, ED LOS, and short-term healthcare costs between pediatric asthma patients who do and do not receive OCS from EMS. Using geographic information systems (GIS), we will measure how differences in outcomes scale with increasing EMS transport time. We will use the RE-AIM framework to guide a mixed methods analysis of barriers and enablers to EMS administration of OCS for pediatric asthma patients, including quantitative measures of adoption and uptake and qualitative EMS provider focus group data.

CONCLUSION

This trial will determine if earlier EMS administration of OCS to pediatric asthma patients decreases hospitalizations, ED LOS, and short-term healthcare costs, and if those outcomes scale with longer EMS transport times. We will identify barriers and enablers to implementing EMS-administered OCS for pediatric asthma patients.

Multicenter Evaluation of Prehospital Seizure Management in Children

BACKGROUND

Seizures are a common reason why emergency medical services (EMS) transports children by ambulance. Timely seizure cessation prevents neurologic morbidity, respiratory compromise, and mortality. Implementing recommendations from an evidence-based pediatric prehospital guideline may enhance timeliness of seizure cessation and optimize medication dosing.

OBJECTIVE

We compared management of pediatric prehospital seizures across several EMS systems after protocol revision consistent with an evidence-based guideline.

METHODS

Using a retrospective, cross-sectional approach, we evaluated actively seizing patients (0-17 years old) EMS transported to a hospital before and after modifying local protocols to include evidence-based recommendations for seizure management in three EMS agencies. We electronically queried and manually abstracted both EMS and hospital data at each site to obtain information about patient demographics, medications given, seizure cessation and recurrence, airway interventions, access obtained, and timeliness of care. The primary outcome of the study was the appropriate administration of midazolam based on route and dose. We analyzed these secondary outcomes: frequency of seizure activity upon emergency department (ED) arrival, frequency of respiratory failure, and timeliness of care.

RESULTS

We analyzed data for 533 actively seizing patients. Paramedics were more likely to administer at least one dose of midazolam after the protocol updates [127/208 (61%) vs. 232/325 (71%), p = 0.01, OR = 1.60 (95% CI: 1.10-2.30)]. Paramedics were also more likely to administer the first midazolam dose via the preferred intranasal (IN) or intramuscular (IM) routes after the protocol change [(63/208 (49%) vs. 179/325 (77%), p < 0.001, OR = 3.24 (2.01-5.21)]. Overall, paramedics administered midazolam approximately 14 min after their arrival, gave an incorrect weight-based dose to 130/359 (36%) patients, and gave a lower than recommended dose to 94/130 (72%) patients. Upon ED arrival, 152/533 (29%) patients had a recurrent or persistent seizure. Respiratory failure during EMS care or subsequently in the ED occurred in 90/533 (17%) patients.

CONCLUSIONS

Implementation of an evidence-based seizure protocol for EMS increased midazolam administration. Patients frequently received an incorrect weight-based dose. Future research should focus on optimizing administration of the correct dose of midazolam to improve seizure cessation.

Systematic Review of Evidence-Based Guidelines for Prehospital Care

Introduction: Multiple national organizations have identified a need to incorporate more evidence-based medicine in emergency medical services (EMS) through the creation of evidence-based guidelines (EBGs). Tools like the Appraisal of Guidelines for Research and Evaluation (AGREE) II and criteria outlined by the National Academy of Medicine (NAM) have established concrete recommendations for the development of high-quality guidelines. While many guidelines have been created that address topics within EMS medicine, neither the quantity nor quality of prehospital EBGs have been previously reported. Objectives: To perform a systematic review to identify existing EBGs related to prehospital care and evaluate the quality of these guidelines using the AGREE II tool and criteria for clinical guidelines described by the NAM. Methods: We performed a systematic search of the literature in MEDLINE, EMBASE, PubMED, Trip, and guidelines.gov, through September 2018. Guideline topics were categorized based on the 2019 Core Content of EMS Medicine. Two independent reviewers screened titles for relevance and then abstracts for essential guideline features. Included guidelines were appraised with the AGREE II tool across 6 domains by 3 independent reviewers and scores averaged. Two additional reviewers determined if each guideline reported the key elements of clinical practice guidelines recommended by the NAM via consensus. Results: We identified 71 guidelines, of which 89% addressed clinical aspects of EMS medicine. Only 9 guidelines scored >75% across AGREE II domains and most (63%) scored between 50 and 75%. Domain 4 (Clarity of Presentation) had the highest (79.7%) and domain 5 (Applicability) had the lowest average score across EMS guidelines. Only 38% of EMS guidelines included a reporting of all criteria identified by the NAM for clinical practice guidelines, with elements of a systematic review of the literature most commonly missing. Conclusions: EBGs exist addressing a variety of topics in EMS medicine. This systematic review and appraisal of EMS guidelines identified a wide range in the quality of these guidelines and variable reporting of key elements of clinical guidelines. Future guideline developers should consider established methodological and reporting recommendations to improve the quality of EMS guidelines.

Implementation of new guidelines in the prehospital services: a nationwide survey of Norway

Background

A debate regarding the potential harmful effects of rigid neck collar and backboard usage among prehospital and hospital care providers in Norway provoked the development of an evidence-based guideline. “The Norwegian guideline for the prehospital management of adult trauma patients with potential spinal injury” was developed with rigorous scientific methods and published in 2016. An e-learning course was developed in parallel. The aim of this study is to explore whether emergency medical services personnel in Norway have implemented the guideline, and to what extent the e-learning course was applied during the implementation process.

Method

An electronic survey was distributed individually to registered prehospital personnel in Norway 18 months after publication of the guideline.

Results

In all, 938 of 5500 (17%) EMS personnel responded to the survey. More than one-half confirmed knowledge of the guideline; among these, 56% claimed that the guideline was implemented in the service they work. Not having responded to trauma cases in real life was the main reason for not having executed the guideline. The e-learning course had been completed by 18% of respondents.

Conclusion

Although the guideline has not been authorized or made compulsory by national authorities, one-half of respondents with knowledge of the guideline reported it as implemented. E-learning did not seem to have affected the implementation. The guideline was developed based on perceived needs among care providers, and this probably facilitated implementation of the guideline.

Electronic supplementary material

The online version of this article (10.1186/s13049-019-0660-0) contains supplementary material, which is available to authorized users.

How reliable is perioperative anticoagulant management? Determining guideline compliance and practice variation by a retrospective patient record review

OBJECTIVES

Surgery in patients on anticoagulants requires careful monitoring and risk assessment to prevent harm. Required interruptions of anticoagulants and deciding whether to use bridging anticoagulation add further complexity. This process, known as perioperative anticoagulant management (PAM), is optimised by using guidelines. Optimal PAM prevents thromboembolic and bleeding complications. The purpose of this study was to assess the reliability of PAM practice in Dutch hospitals. Additionally, the variations between hospitals and different bridging dosages were studied.

DESIGN

A multicentre retrospective patient record review.

SETTING AND PARTICIPANTS

Records from 268 patients using vitamin-K antagonist (VKA) anticoagulants who underwent surgery in a representative random sample of 13 Dutch hospitals were reviewed, 259 were analysed.

PRIMARY AND SECONDARY OUTCOME MEASURES

Our primary outcome measure was the reliability of PAM expressed as the percentage of patients receiving guideline compliant care. Seven PAM steps were included. Secondary outcome measures included different bridging dosages used and an analysis of practice variation on the hospital level.

RESULTS

Preoperative compliance was lowest for timely VKA interruptions: 58.8% (95% CI 50.0% to 67.7%) and highest for timely preoperative assessments: 81% (95% CI 75.0% to 86.5%). Postoperative compliance was lowest for timely VKA restarts: 39.9% (95% CI 33.1% to 46.7%) and highest for the decision to apply bridging: 68.5% (95% CI 62.3% to 74.8%). Variation in compliance between hospitals was present for the timely preoperative assessment (range 41%-100%), international normalised ratio testing (range 21%-94%) and postoperative bridging (range 20%-88%). Subtherapeutic bridging was used in 50.5% of patients and increased with patients' weight.

CONCLUSIONS

Unsatisfying compliance for most PAM steps, reflect suboptimal reliability of PAM. Furthermore, the hospital performance varied. This increases the risk for adverse events, warranting quality improvement. The development of process measures can help but will be complicated by the availability of a strong supporting evidence base and integrated care delivery regarding PAM.

Establishing the Key Outcomes for Pediatric Emergency Medical Services Research

The evidence supporting best practices when treating children in the prehospital setting or even the effect emergency medical services (EMS) has on patient outcomes is limited. Standardizing the critical outcomes for EMS research will allow for focused and comparable effort among the small but growing group of pediatric EMS investigators on specific topics. Standardized outcomes will also provide the opportunity to collectively advance the science of EMS for children and demonstrate the effect of EMS on patient outcomes. This article describes a consensus process among stakeholders in the pediatric emergency medicine and EMS community that identified the critical outcomes for EMS care in five clinical areas (traumatic brain injury, general injury, respiratory disease/failure, sepsis, and seizures). These areas were selected based on both their known public health importance and their commonality in EMS encounters. Key research outcomes identified by participating stakeholders using a modified nominal group technique for consensus building, which included small group brainstorming and independent voting for ranking outcomes that were feasible and/or important for the field.

Challenges in Statewide Implementation of a Prehospital Evidence-Based Guideline: An Assessment of Barriers and Enablers in Five States

BACKGROUND

Individual states, regions, and local emergency medical service (EMS) agencies are responsible for the development and implementation of prehospital patient care protocols. Many states lack model prehospital guidelines for managing common conditions. Recently developed national evidence-based guidelines (EBGs) may address this gap. Barriers to statewide dissemination and implementation of model guidelines have not been studied. The objective of this study was to examine barriers and enablers to dissemination and implementation of an evidence-based guideline for traumatic pain management across 5 states.

METHODS

This study used mixed methods to evaluate the statewide dissemination and implementation of a prehospital EBG. The guideline provided pain assessment tools, recommended opiate medication dosing, and indications and contraindications for analgesia. Participating states were provided an implementation toolkit, standardized training materials, and a state-specific implementation plan. Outcomes were assessed via an electronic self-assessment tool in which states reported barriers and enablers to dissemination and implementation and information about changes in pain management practices in their states after implementation of the EBG.

RESULTS

Of the 5 participating states, 3 reported dissemination of the guideline, one through a state model guideline process and 2 through regional EMS systems. Two states did not disseminate or implement the guideline. Of these, one state chose to utilize a locally developed guideline, and the other state did not perform guideline dissemination at the state level. Barriers to state implementation were the lack of authority at the state level to mandate protocols, technical challenges with learning management systems, and inability to track and monitor training and implementation at the agency level. Enablers included having a state/regional EMS office champion and the availability of an implementation toolkit. No participating states demonstrated an increase in opioid delivery to patients during the study period.

CONCLUSION

Statewide dissemination and implementation of an EBG is complex with many challenges. Future efforts should consider the advantages of having statewide model or mandatory guidelines and the value of local champions and be aware of the challenges of a statewide learning management system and of tracking the success of implementation efforts.

Improving Prehospital Protocol Adherence Using Bundled Educational Interventions

BACKGROUND

Seizures and anaphylaxis are life-threatening conditions that require immediate treatment in the prehospital setting. There is variation in treatment of pediatric prehospital patients for both anaphylaxis and seizures. This educational study was done to improve compliance with pediatric prehospital protocols, educate prehospital providers and decrease variation in care.

OBJECTIVE

To improve the quality of care for children with seizures and anaphylaxis in the prehospital setting using a bundled, multifaceted educational intervention.

METHODS

Evidence-based pediatric prehospital guidelines for seizures and anaphylaxis were used to create a curriculum for the paramedics in the EMS system. The curriculum included in-person training, videos, distribution of decision support tools, and a targeted social media campaign to reinforce the evidence-based guidelines. Prehospital charts were reviewed for pediatric patients with a chief complaint of anaphylaxis or seizures who were transported by paramedics to one of ten hospitals, including three children's hospitals, for 8 months prior to the intervention and eight months following the intervention. The primary outcome for seizures was whether midazolam was given via the preferred intranasal (IN) or intramuscular (IM) routes. The primary outcome for anaphylaxis was whether IM epinephrine was given.

RESULTS

A total of 1,402 pediatric patients were transported for seizures by paramedics to during the study period. A total of 88 patients were actively seizing pre-intervention and 93 post-intervention. Of the actively seizing patients, 52 were given midazolam pre-intervention and 62 were given midazolam post-intervention. Pre-intervention, 29% (15/52) of the seizing patients received midazolam via the preferred IM or IN routes, compared to 74% (46/62) of the seizing patients post-intervention. A total of 45 patients with anaphylaxis were transported by paramedics, 30 pre-intervention and 15 post-intervention. Paramedics administered epinephrine to 17% (5/30) patients pre-intervention and 67% (10/15) patients post-intervention.

CONCLUSION

The use of a bundled, multifaceted educational intervention including in-person training, decision support tools, and social media improved adherence to updated evidence-based pediatric prehospital protocols.

Implementing Prehospital Evidence-Based Guidelines: A Systematic Literature Review

OBJECTIVE

As prehospital research advances, more evidence-based guidelines (EBGs) are implemented into emergency medical services (EMS) practice. However, incomplete or suboptimal prehospital EBG implementation may hinder improvement in patient outcomes. To inform future efforts, this study's objective was to review existing evidence pertaining to prehospital EBG implementation methods.

METHODS

This study was a systematic literature review and evaluation following the Grading of Recommendations, Assessment, Development, and Evaluation (GRADE) methodology. PubMed, EMBASE, Scopus, and Google Advanced Search were searched without language or publication date filters for articles addressing prehospital EBG implementation. Conference proceedings, textbooks, and non-English articles were excluded. GRADE was applied to the remaining articles independently by three of five study investigators. Study characteristics and salient findings from the included articles are reported.

RESULTS

The systematic literature review identified 1,367 articles, with 41 meeting inclusion criteria. Most articles described prehospital EBG implementation (n = 24, 59%), or implementation barriers (n = 13, 32%). Common study designs were statement documents (n = 12, 29%), retrospective cohort studies (n = 12, 29%), and cross-sectional studies (n = 9, 22%). Using GRADE, evidence quality was rated low (n = 18, 44%), or very low (n = 23, 56%). Salient findings from the articles included: (i) EBG adherence and patient outcomes depend upon successful implementation, (ii) published studies generally lack detailed implementation methods, (iii) EBG implementation takes longer than planned (mostly for EMS education), (iv) EMS systems' heterogeneity affects EBG implementation, and (v) multiple barriers limit successful implementation (e.g., financial constraints, equipment purchasing, coordination with hospitals, and regulatory agencies). This review found no direct evidence for best prehospital EBG implementation practices. There were no studies comparing implementation methods or implementation in different prehospital settings (e.g., urban vs. rural, advanced vs. basic life support).

CONCLUSIONS

While prehospital EBG implementation barriers are well described, there is a paucity of evidence for optimal implementation methods. For scientific advances to reach prehospital patients, EBG development efforts must translate into EMS practice. Future research should consider comparing implementation methodologies in different prehospital settings, with a goal of defining detailed, reproducible best practices.

Systematic Review Methodology for the Fatigue in Emergency Medical Services Project

BACKGROUND

Guidance for managing fatigue in the Emergency Medical Services (EMS) setting is limited. The Fatigue in EMS Project sought to complete multiple systematic reviews guided by seven explicit research questions, assemble the best available evidence, and rate the quality of that evidence for purposes of producing an Evidence Based Guideline (EBG) for fatigue risk management in EMS operations.

METHODS

We completed seven systematic reviews that involved searches of six databases for literature relevant to seven research questions. These questions were developed a priori by an expert panel and framed in the Population, Intervention, Comparison, and Outcome (PICO) format and pre-registered with PROSPERO. Our target population was defined as persons 18 years of age and older classified as EMS personnel or similar shift worker groups. A panel of experts selected outcomes for each PICO question as prescribed by the Grading of Recommendations, Assessment, Development, and Evaluation (GRADE) methodology. We pooled findings, stratified by study design (experimental vs. observational) and presented results of each systematic review in narrative and quantitative form. We used meta-analyses of select outcomes to generate pooled effects. We used the GRADE methodology and the GRADEpro software to designate a quality of evidence rating for each outcome.

RESULTS

We present the results for each systematic review in accordance with the Preferred Reporting Items for Systematic reviews and Meta-Analyses (PRISMA). More than 38,000 records were screened across seven systematic reviews. The median, minimum, and maximum inter-rater agreements (Kappa) between screeners for our seven systematic reviews were 0.66, 0.49, and 0.88, respectively. The median, minimum, and maximum number of records retained for the seven systematic reviews was 13, 1, and 100, respectively. We present key findings in GRADE Evidence Profile Tables in separate publications for each systematic review.

CONCLUSIONS

We describe a protocol for conducting multiple, simultaneous systematic reviews connected to fatigue with the goal of creating an EBG for fatigue risk management in the EMS setting. Our approach may be informative to others challenged with the creation of EBGs that address multiple, inter-related systematic reviews with overlapping outcomes.

Evidence-Based Guidelines for Fatigue Risk Management in EMS: Formulating Research Questions and Selecting Outcomes

BACKGROUND

Greater than half of Emergency Medical Services (EMS) personnel report work-related fatigue, yet there are no guidelines for the management of fatigue in EMS. A novel process has been established for evidence-based guideline (EBG) development germane to clinical EMS questions. This process has not yet been applied to operational EMS questions like fatigue risk management. The objective of this study was to develop content valid research questions in the Population, Intervention, Comparison, and Outcome (PICO) framework, and select outcomes to guide systematic reviews and development of EBGs for EMS fatigue risk management.

METHODS

We adopted the National Prehospital EBG Model Process and Grading of Recommendations Assessment, Development, and Evaluation (GRADE) framework for developing, implementing, and evaluating EBGs in the prehospital care setting. In accordance with steps one and two of the Model Process, we searched for existing EBGs, developed a multi-disciplinary expert panel and received external input. Panelists completed an iterative process to formulate research questions. We used the Content Validity Index (CVI) to score relevance and clarity of candidate PICO questions. The panel completed multiple rounds of question editing and used a CVI benchmark of ≥0.78 to indicate acceptable levels of clarity and relevance. Outcomes for each PICO question were rated from 1 = less important to 9 = critical.

RESULTS

Panelists formulated 13 candidate PICO questions, of which 6 were eliminated or merged with other questions. Panelists reached consensus on seven PICO questions (n = 1 diagnosis and n = 6 intervention). Final CVI scores of relevance ranged from 0.81 to 1.00. Final CVI scores of clarity ranged from 0.88 to 1.00. The mean number of outcomes rated as critical, important, and less important by PICO question was 0.7 (SD 0.7), 5.4 (SD 1.4), and 3.6 (SD 1.9), respectively. Patient and personnel safety were rated as critical for most PICO questions. PICO questions and outcomes were registered with PROSPERO, an international database of prospectively registered systematic reviews.

CONCLUSIONS

We describe formulating and refining research questions and selection of outcomes to guide systematic reviews germane to EMS fatigue risk management. We outline a protocol for applying the Model Process and GRADE framework to create evidence-based guidelines.

Contemporary evidence-based practice in Canadian emergency medical services: a vision for integrating evidence into clinical and policy decision-making

Nationally, emphasis on the importance of evidence-based practice (EBP) in emergency medicine and emergency medical services (EMS) has continuously increased. However, meaningful incorporation of effective and sustainable EBP into clinical and administrative decision-making remains a challenge. We propose a vision for EBP in EMS: Canadian EMS clinicians and leaders will understand and use the best available evidence for clinical and administrative decision-making, to improve patient health outcomes, the capability and quality of EMS systems of care, and safety of patients and EMS professionals. This vision can be implemented with the use of a structure, process, system, and outcome taxonomy to identify current barriers to true EBP, to recognize the opportunities that exist, and propose corresponding recommended strategies for local EMS agencies and at the national level. Framing local and national discussions with this approach will be useful for developing a cohesive and collaborative Canadian EBP strategy.

Impact of High-Fidelity Pediatric Simulation on Paramedic Seizure Management

BACKGROUND

A simulation-based course, Pediatric Simulation Training for Emergency Prehospital Providers (PediSTEPPs), was developed to optimize pediatric prehospital care. Seizures are common in Emergency Medical Services (EMS), and no studies have evaluated pediatric outcomes after EMS simulation training.

OBJECTIVES

The primary objective was to determine if PediSTEPPs enhances seizure protocol adherence in blood glucose measurement and midazolam administration for seizing children. The secondary objective was to describe management of seizing patients by EMS and Emergency Departments (EDs).

METHODS

This is a two-year retrospective cohort study of paramedics who transported 0-18 year old seizing patients to ten urban EDs. Management was compared between EMS crews with at least one paramedic who attended PediSTEPPs and crews that had none. Blood glucose measurement, medications administered, intravenous (IV) access, seizure recurrence, and respiratory failure data were collected from databases and run reports. Data were compared using Pearson's χ(2) test and odds ratios with 95% confidence intervals (categorical) and the Mann-Whitney test (continuous).

RESULTS

Of 2200 pediatric transports with a complaint of seizure, 250 (11%) were actively seizing at the time of transport. Of these, 65 (26%) were treated by a PediSTEPPs-trained paramedic. Blood glucose was slightly more likely to be checked by trained than untrained paramedics (OR = 1.35, 95% CI 0.72-2.51). Overall, 58% received an indicated dose of midazolam, and this was slightly more likely in the trained than untrained paramedics (OR = 1.39, 95% CI 0.77-2.49). There were no differences in secondary outcomes between groups. The prevalence of hypoglycemia was low (2%). Peripheral IVs were attempted in 80%, and midazolam was predominantly given by IV (68%) and rectal (12%) routes, with 51% receiving a correct dose. Seizures recurred in 22%, with 34% seizing on ED arrival. Respiratory failure occurred in the prehospital setting in 25 (10%) patients in the study.

CONCLUSION

Simulation-based training on pediatric seizure management may have utility. Data support the need to optimize the route and dose of midazolam for seizing children. Blood glucose measurement in seizure protocols may warrant reprioritization due to low hypoglycemia prevalence.

KEY WORDS

seizure; emergency medical services; simulation; pediatrics.

Defining the paramedic process

The use of a ‘process of care’ is well established in several health professions, most evidently within the field of nursing. Now ingrained within methods of care delivery, it offers a logical approach to problem solving and ensures an appropriate delivery of interventions that are specifically suited to the individual patient. Paramedicine is a rapidly advancing profession despite a wide acknowledgement of limited research provisions. This frequently results in the borrowing of evidence from other disciplines. While this has often been useful, there are many concerns relating to the acceptable limit of evidence transcription between professions. To date, there is no formally recognised ‘process of care’-defining activity within the pre-hospital arena. With much current focus on the professional classification of paramedic work, it is considered timely to formally define a formula that underpins other professional roles such as nursing. It is hypothesised that defined processes of care, particularly the nursing process, may have features that would readily translate to pre-hospital practice. The literature analysed was obtained through systematic searches of a range of databases, including Ovid MEDLINE, Cumulative Index to Nursing and Allied Health. The results demonstrated that the defined process of care provides nursing with more than just a structure for practice, but also has implications for education, clinical governance and professional standing. The current nursing process does not directly articulate to the complex and often unstructured role of the paramedic; however, it has many principles that offer value to the paramedic in their practice. Expanding the nursing process model to include the stages of Dispatch Considerations, Scene Assessment, First Impressions, Patient History, Physical Examination, Clinical Decision-Making, Interventions, Re-evaluation, Transport Decisions, Handover and Reflection would provide an appropriate model for pre-hospital practices.

Compliance with guidelines for the perioperative management of vitamin K antagonists

INTRODUCTION

Perioperative vitamin K antagonist management is an issue of concern in many countries. The availability of best practice guidelines meets health professionals' needs, but compliance is uncertain and should be assessed.

MATERIALS AND METHODS

Our aim was to assess practitioner compliance with the guidelines on perioperative VKA management issued by the French National Authority for Health through a national register set up in partnership with the French College of Anaesthetists and Intensivists. Seven sections of data entry were focused on perioperative management of VKAs for elective or emergency procedures. High-risk patients were identified. Compliance with guidelines was calculated per item

RESULTS

932 charts were completed between October 2009 and December 2010. VKA therapy was interrupted in 74% (622/837) of elective procedures and bridged in 69% cases (428/622) mainly with LMWH. According to guidelines, bridging was strongly recommended in 39% high-risk patients (175/394) but 13% of these (23/175) received no bridging. Bridging was overused in 60% of low risk patients (242/406). Other compliance rates were as follows: (i) administration of therapeutic enoxaparin doses (=200IU/kg/day): only 18% of high-risk patients (18/98), (ii) INR measurement on evening prior to the procedure 65% (525/803), (iii) concomitant prothrombin complex concentrate and vitamin K administration in emergency surgery 24% (21/87), (iv) postoperative therapeutic enoxaparin doses: only 20% despite widespread prescription. The incidence rate of bleeding and thrombotic events was 7.1% and 0.96% respectively.

CONCLUSIONS

These poor compliance rates with guidelines suggest that the knowledge-to-action transfer plan was inadequate and that further interventions are required.

An Evidence-based Guideline for prehospital analgesia in trauma

BACKGROUND

The management of acute traumatic pain is a crucial component of prehospital care and yet the assessment and administration of analgesia is highly variable, frequently suboptimal, and often determined by consensus-based regional protocols.

OBJECTIVE

To develop an evidence-based guideline (EBG) for the clinical management of acute traumatic pain in adults and children by advanced life support (ALS) providers in the prehospital setting. Methods. We recruited a multi-stakeholder panel with expertise in acute pain management, guideline development, health informatics, and emergency medical services (EMS) outcomes research. Representatives of the National Highway Traffic Safety Administration (sponsoring agency) and a major children's research center (investigative team) also contributed to the process. The panel used the Grading of Recommendations Assessment, Development and Evaluation (GRADE) methodology to guide the process of question formulation, evidence retrieval, appraisal/synthesis, and formulation of recommendations. The process also adhered to the National Prehospital Evidence-Based Guideline (EBG) model process approved by the Federal Interagency Council for EMS and the National EMS Advisory Council.

RESULTS

Four strong and three weak recommendations emerged from the process; two of the strong recommendations were linked to high- and moderate-quality evidence, respectively. The panel recommended that all patients be considered candidates for analgesia, regardless of transport interval, and that opioid medications should be considered for patients in moderate to severe pain. The panel also recommended that all patients should be reassessed at frequent intervals using a standardized pain scale and that patients should be re-dosed if pain persists. The panel suggested the use of specific age-appropriate pain scales.

CONCLUSION

GRADE methodology was used to develop an evidence-based guideline for prehospital analgesia in trauma. The panel issued four strong recommendations regarding patient assessment and narcotic medication dosing. Future research should define optimal approaches for implementation of the guideline as well as the impact of the protocol on safety and effectiveness metrics.

Quality improvement in pediatric emergency medicine

Pediatric patients, who accounted for 17.4% of US emergency department (ED) visits in 2010, present unique challenges that can impede an ED's ability to provide optimal care. To meet the growing demand for comprehensive, high-quality care, health care systems are incorporating quality improvement (QI) methods to reduce costs and variations in care and to improve access, safety, and ultimately the outcomes of medical care. This overview of QI initiatives within the field of pediatric emergency medicine explores how proven QI strategies are being integrated into efforts that target the care of children within the broader emergency care community. These initiatives are categorized within the domains of education, infrastructures supporting QI efforts, research, and community/government collaborations. Professional societies supporting education, such as the American Academy of Pediatrics, have made several strides to cultivate new health leaders that will use QI methodology to improve outcomes in pediatric emergency care. In addition to educational pursuits, professional societies and QI organizations (eg, Children's Hospital Association) offer stable infrastructures from which QI initiatives, either disease specific or broadly targeted, can be implemented as large-scale QI initiatives (eg, quality collaboratives). This overview also provides examples of how QI methodology has been integrated into research strategies and describes how the pediatric emergency medicine community can spread innovation and best practices into the larger emergency care community.

The implementation and evaluation of an evidence-based statewide prehospital pain management protocol developed using the national prehospital evidence-based guideline model process for emergency medical services

BACKGROUND

In 2008, the National Highway Traffic Safety Administration funded the development of a model process for the development and implementation of evidence-based guidelines (EBGs) for emergency medical services (EMS). We report on the implementation and evaluation of an evidence-based prehospital pain management protocol developed using this model process.

METHODS

An evidence-based protocol for prehospital management of pain resulting from injuries and burns was reviewed by the Protocol Review Committee (PRC) of the Maryland Institute for Emergency Medical Services Systems (MIEMSS). The PRC recommended revisions to the Maryland protocol that reflected recommendations in the EBG: weight-based dosing and repeat dosing of morphine. A training curriculum was developed and implemented using Maryland's online Learning Management System and successfully accessed by 3,941 paramedics and 15,969 BLS providers. Field providers submitted electronic patient care reports to the MIEMSS statewide prehospital database. Inclusion criteria were injured or burned patients transported by Maryland ambulances to Maryland hospitals whose electronic patient care records included data for level of EMS provider training during a 12-month preimplementation period and a 12-month postimplementation period from September 2010 through March 2012. We compared the percentage of patients receiving pain scale assessments and morphine, as well as the dose of morphine administered and the use of naloxone as a rescue medication for opiate use, before and after the protocol change.

RESULTS

No differences were seen in the percentage of patients who had a pain score documented or the percent of patients receiving morphine before and after the protocol change, but there was a significant increase in the total dose and dose in mg/kg administered per patient. During the postintervention phase, patients received an 18% higher total morphine dose and a 14.9% greater mg/kg dose.

CONCLUSIONS

We demonstrated that the implementation of a revised statewide prehospital pain management protocol based on an EBG developed using the National Prehospital Evidence-based Guideline Model Process was associated with an increase in dosing of narcotic pain medication consistent with that recommended by the EBG. No differences were seen in the percentage of patients receiving opiate analgesia or in the documentation of pain scores.

Exclusion of context knowledge in the development of prehospital guidelines: results produced by realistic evaluation

Background

Prehospital work is accomplished using guidelines and protocols, but there is evidence suggesting that compliance with guidelines is sometimes low in the prehospital setting. The reason for the poor compliance is not known. The objective of this study was to describe how guidelines and protocols are used in the prehospital context.

Methods

This was a single-case study with realistic evaluation as a methodological framework. The study took place in an ambulance organization in Sweden. The data collection was divided into four phases, where phase one consisted of a literature screening and selection of a theoretical framework. In phase two, semi-structured interviews with the ambulance organization's stakeholders, responsible for the development and implementation of guidelines, were performed. The third phase, observations, comprised 30 participants from both a rural and an urban ambulance station. In the last phase, two focus group interviews were performed. A template analysis style of documents, interviews and observation protocols was used.

Results

The development of guidelines took place using an informal consensus approach, where no party from the end users was represented. The development process resulted in guidelines with an insufficiently adapted format for the prehospital context. At local level, there was a conscious implementation strategy with lectures and manikin simulation. The physical format of the guidelines was the main obstacle to explicit use. Due to the format, the ambulance personnel feel they have to learn the content of the guidelines by heart. Explicit use of the guidelines in the assessment of patients was uncommon. Many ambulance personnel developed homemade guidelines in both electronic and paper format. The ambulance personnel in the study generally took a positive view of working with guidelines and protocols and they regarded them as indispensable in prehospital care, but an improved format was requested by both representatives of the organization and the ambulance personnel.

Conclusions

The personnel take a positive view of the use of guidelines and protocols in prehospital work. The main obstacle to the use of guidelines and protocols in this organization is the format, due to the exclusion of context knowledge in the development process.