Decrease in medical command errors with use of a "standing orders" protocol system

Pediatric Residency Training amid the COVID-19 Pandemic: Exploring the Impact of Supervision and Clinical Practice Guidelines on Clinical and Financial Outcomes

Objective

This study is aimed at calculating the magnitude of the effect of clinical practice guidelines (CPG) and supervision in inhibiting the negative impact of the COVID-19 pandemic on clinical and financial outcomes of non-COVID-19 inpatient care by pediatric residents in academic medical center (AMC) hospitals during the COVID-19 pandemic.

Methods

The cohort retrospective study was conducted. This study collected patient data from pediatric residency programs. A research cohort consisted of non-COVID-19 pediatric patients at Dr. Soetomo General Academic Hospital. This study compared the subgroup of patients treated during the pandemic with those treated before the pandemic. The results were analyzed using SPSS 26.0 and Smart-PLS.

Results

There was a 41.4% decrease in pediatric inpatients during the pandemic with an increased severity level and complexity level, a reduction of 7.46% availability of supervisors, an increase of 0.4% in readmission < 30 days, an increase of 0.31% in-hospital mortality, an increase the total costs of care, and a decrease of insurance claim profit. CPG did not moderate the effect of the COVID-19 pandemic on the clinical outcomes (β = −0.006, P = 0.083) but moderated the financial outcomes (β = −0.022, P = 0.000), by reducing the total cost of care and increasing insurance claim profit. Supervision moderated the effect of the COVID-19 pandemic on the clinical outcomes (β = 0.040, P = 0.000) by increasing aLOS and on the financial outcomes (β = −0.031, P = 0.000) by reducing the total cost of care and increasing insurance claim profit. This study model had a 24.0% variance of explanatory power for clinical outcomes and 49.0% for financial outcomes. This study's structural model effectively predicted clinical outcomes (Q² = 0.238) and financial outcomes (Q² = 0.413).

Conclusion

Direct supervision inhibited the negative impact of the COVID-19 pandemic on both clinical and financial outcomes of non-COVID-19 inpatient care by pediatric residents, while CPG only inhibited the negative impact on financial outcomes. Implication of This Study. In a disaster, the availability of CPG and direct supervision makes AMC hospitals able to inhibit the negative impact of disasters on clinical and financial outcomes.

Retrospective Analysis of Emergency Medical Services (EMS) Physician Medical Control Calls

INTRODUCTION

Although emergency medical services (EMS) standing-order protocols provide more efficient and accurate on-scene management by paramedics, online medical direction (OLMD) has not been eliminated from practice. In this modern era of OLMD, no studies exist to describe the prevalence of reasons for contacting OLMD.

OBJECTIVES

The primary goal of this study was to describe the quantity of and reasons for calls for medical direction. We also sought to determine time diverted from emergency physicians due to OLMD. Finally, we hoped to identify any areas for potential improvement or additional training opportunities for EMS providers.

METHODS

This was a descriptive study with retrospective data analysis of recorded OLMD calls from January 1, 2016, to December 31, 2016. Data were extracted by research personnel listening to audio recordings and were entered into a database for descriptive analysis. We abstracted the date and length of call, patient demographic information (age and gender), category of call (trauma, medical, cardiac, or obstetrics), reason for call, and origin of call (prehospital, interhospital, nursing home, or discharge).

RESULTS

The total number of recordings analyzed was 519. Calls were divided into four categories pertaining to their nature: 353 (68.5%) medical; 70 (13.6%) trauma; 83 (16.1%) cardiac; and 9 (8%) were obstetrics related. Repeat calls regarding the same patient encounter comprised 48 (9.4%) of the calls. Patient refusal of transport was the most common reason for a call medical direction (32.3% of calls). The total time for medical direction calls for the year was 26.6 hours. The maximum number of calls in a single day was seven, with a mean of 2.04 calls per day (standard deviation [SD] ± 1.18). The mean call length was 3.06 minutes (SD ± 2.51).

CONCLUSION

Our analysis shows that the use of OLMD frequently involves complex decision-making such as determination of the medical decision-making capacity of patients to refuse treatment and transport, and evaluation of the appropriate level of care for interfacility transfers. Further investigation into the effect of EMS physician-driven medical direction on both the quality and time required for OLMD could allow for better identification of areas of potential improvement and training.

Patient safety in ambulance services: a scoping review

Background

The role of ambulance services has changed dramatically over the last few decades with the introduction of paramedics able to provide life-saving interventions, thanks to sophisticated equipment and treatments available. The number of 999 calls continues to increase, with adverse events theoretically possible with each one. Most patient safety research is based on hospital data, but little is known concerning patient safety when using ambulance services, when things can be very different. There is an urgent need to characterise the evidence base for patient safety in NHS ambulance services.

Objective

To identify and map available evidence relating to patient safety when using ambulance services.

Design

Mixed-methods design including systematic review and review of ambulance service documentation, with areas for future research prioritised using a Delphi process.

Setting and participants

Ambulance services, their staff and service users in UK.

Data sources

A wide range of data sources were explored. Multiple databases, reference lists from key papers and citations, Google and the NHS Confederation website were searched, and experts contacted to ensure that new data were included in the review. The databases MEDLINE, EMBASE, Cumulative Index to Nursing and Allied Health Literature (CINAHL), Web of Science, Science Direct, Emerald, Education Resources Information Center (ERIC), Applied Social Sciences Index and Abstracts, Social Services Abstracts, Sociological Abstracts, International Bibliography of the Social Sciences (IBSS), PsycINFO, PsycARTICLES, Health Management Information Consortium (HMIC), NHS Evidence, Cochrane Database of Systematic Reviews, Database of Abstracts of Reviews of Effects (DARE), NHS Economic Evaluation Database (NHS EED),Health Technology Assessment, the FADE library, Current Awareness Service for Health (CASH), OpenDOAR (Directory of Open Access Repositories) and Open System for Information on Grey Literature in Europe (OpenSIGLE) and Zetoc (The British Library's Electronic Table of Contents) were searched from 1 January 1980 to 12 October 2011. Publicly available documents and issues identified by National Patient Safety Agency (NPSA), NHS Litigation Authority (NHSLA) and coroners’ reports were considered. Opinions and perceptions of senior managers, ambulance staff and service users were solicited.

Review methods

Data were extracted from annual reports using two-stage thematic analysis, data from quality accounts were collated with safety priorities tabulated and considered using thematic analysis, NPSA incident report data were collated and displayed comparatively using descriptive statistics, claims reported to NHSLA were analysed to identify number and cost of claims from mistakes and/or poor service, and summaries of coroners’ reports were assessed using thematic analysis to identify underlying safety issues. The depth of analysis is limited by the remit of a scoping exercise and availability of data.

Results

We identified studies exploring different aspects of safety, which were of variable quality and with little evidence to support activities currently undertaken by ambulance services. Adequately powered studies are required to address issues of patient safety in this service, and it appeared that national priorities were what determined safety activities, rather than patient need. There was inconsistency of information on attitudes and approaches to patient safety, exacerbated by a lack of common terminology.

Conclusion

Patient safety needs to become a more prominent consideration for ambulance services, rather than operational pressures, including targets and driving the service. Development of new models of working must include adequate training and monitoring of clinical risks. Providers and commissioners need a full understanding of the safety implications of introducing new models of care, particularly to a mobile workforce often isolated from colleagues, which requires a body of supportive evidence and an inherent critical evaluation culture. It is difficult to extrapolate findings of clinical studies undertaken in secondary care to ambulance service practice and current national guidelines often rely on consensus opinion regarding applicability to the pre-hospital environment. Areas requiring further work include the safety surrounding discharging patients, patient accidents, equipment and treatment, delays in transfer/admission to hospital, and treatment and diagnosis, with a clear need for increased reliability and training for improving handover to hospital.

Funding

The National Institute for Health Research Health Services and Delivery Research programme.

Evolution of the Literature Identifying Physicians' Roles in Leadership, Clinical Development, and Practice of the Subspecialty of Emergency Medical Services

Purpose: The 2007 Institute of Medicine report entitled Emergency Medical Services at the Crossroads identified a need for the establishment of physician subspecialty certification in emergency medical services (EMS). The purpose of this study was to identify and explore the evolution of publications that define the role of the physician in EMS systems in the United States.

Methods: Three comprehensive searches were undertaken to identify articles that define the physician's role in the leadership, clinical development, and practice of EMS. Independent reviewers then evaluated these articles to further determine whether the articles identified the physician's role in EMS. Then, identified articles were classified by the type of publication in order to evaluate the transition from a non-peer reviewed to peer-reviewed literature base and an analysis was performed on the differences in the growth between these two groups. In addition, for the peer-reviewed articles, an analysis was performed to identify the proportion of articles that were quantitative versus qualitative in nature.

Results: The comprehensive review identified 1,504 articles. Ninety articles were excluded due to lack of relevance to the US. The remaining 1,414 articles were reviewed, and 194 papers that address the physician's role within EMS systems were identified; 72 additional articles were identified by hand search of references for a total of 266 articles. The percentage of peer-reviewed articles has increased steadily over the past three decades. In addition, the percentage of quantitative articles increased from the first decade to the second and third decades.

Conclusions: This comprehensive review demonstrates that over the past 30 years an evidence base addressing the role of the physician in EMS has developed. This evidence base has steadily evolved to include a greater proportion of peer-reviewed, quantitative literature.

ED overcrowding is associated with an increased frequency of medication errors

OBJECTIVES

Despite the growing problems of emergency department (ED) crowding, the potential impact on the frequency of medication errors occurring in the ED is uncertain. Using a metric to measure ED crowding in real time (the Emergency Department Work Index, or EDWIN, score), we sought to prospectively measure the correlation between the degree of crowding and the frequency of medication errors occurring in our ED as detected by our ED pharmacists.

METHODS

We performed a prospective, observational study in a large, community hospital ED of all patients whose medication orders were evaluated by our ED pharmacists for a 3-month period. Our ED pharmacists review the orders of all patients in the ED critical care section and the Chest Pain unit, and all admitted patients boarding in the ED. We measured the Spearman correlation between average daily EDWIN score and number of medication errors detected and determined the score's predictive performance with receiver operating characteristic (ROC) curves.

RESULTS

A total of 283 medication errors were identified by the ED pharmacists over the study period. Errors included giving medications at incorrect doses, frequencies, durations, or routes and giving contraindicated medications. Error frequency showed a positive correlation with daily average EDWIN score (Spearman's rho = 0.33; P = .001). The area under the ROC curve was 0.67 (95% confidence interval, 0.56-0.78) with failure defined as greater than 1 medication error per day.

CONCLUSIONS

We identified an increased frequency of medication errors in our ED with increased crowding as measured with a real-time modified EDWIN score.

Paramedic Self-Reported Medication Errors

BACKGROUND

Continuing quality improvement (CQI) reviews reflect that medication administration errors occur in the prehospital setting. These include errors involving dose, medication, route, concentration, and treatment.

METHODS

A survey was given to paramedics in San Diego County. The survey tool was established based on previous literature reviews and questions developed based on previous CQI data.

RESULTS

A total of 352 surveys were returned, with the paramedics reporting a mean of 8.5 years of field experience. They work an average of 11.0 shifts/month with an average shift length of 25.4 hours and 6.7 calls/shift. Thirty-two responding paramedics (9.1%) reported committing a medication error in the past 12 months. Types of errors included dose-related errors (63%), protocol errors (33%), wrong route errors (21%), and wrong medication errors (4%). Issues identified in contributing to the errors include failure to triple check, infrequent use of the medication, dosage calculation error, and incorrect dosage given. Fatigue, training, and equipment setup of the drug box were not listed as any of the contributing factors. The majority of these errors were self-reported to their CQI representative (79.1%), with 8.3% reported by the base hospital radio nurse, 8.3% found on chart review, and 4.2% noted by the paramedic during the call but never reported.

CONCLUSIONS

Nine percent of paramedics responding to an anonymous survey reported medication errors in the past 12 months, with 4% of these errors never having been reported in the CQI process. Additional safeguards must continue to be implemented to decrease the incidence of medication errors.

Paramedic self-reported medication errors

BACKGROUND

Continuing quality improvement (CQI) reviews reflect that medication administration errors occur in the prehospital setting. These include errors involving dose, medication, route, concentration, and treatment.

METHODS

A survey was given to paramedics in San Diego County. The survey tool was established on the basis of previous literature reviews and questions developed with previous CQI data.

RESULTS

A total of 352 surveys were returned, with the paramedics reporting a mean of 8.5 years of field experience. They work an average of 11.0 shifts/month with an average of 25.4 hours and 6.7 calls/shift. Thirty-two (9.1%) responding paramedics reported committing a medication error in the last 12 months. Types of errors included dose-related errors (63%), protocol errors (33%), wrong route errors (21%), and wrong medication errors (4%). Issues identified in contributing to the errors include failure to triple check, infrequent use of the medication, dosage calculation error, and incorrect dosage given. Fatigue, training, and equipment setup of the drug box were not listed as any of the contributing factors. The majority of these errors were self-reported to their CQI representative (79.1%), with 8.3% being reported by the base hospital radio nurse, 8.3% found upon chart review, and 4.2% noted by paramedic during call but never reported.

CONCLUSIONS

Nine percent of paramedics responding to an anonymous survey report medication errors in the last 12 months, with 4% of these errors never having been reported in the CQI process. Additional safeguards must continue to be implemented to decrease the incidence of medication errors.

Ability of paramedics to treat patients with congestive heart failure via standing field treatment protocols

The objective of the study was to determine if paramedics can accurately select the appropriate standing field treatment protocol (SFTP) in lieu of on-line medical direction (OLMD) for patients with congestive heart failure. A prospective case series over 18 months determined the sensitivity and positive predictive value (PPV) of paramedics' treatment of CHF patients using SFTPs. All patients who were treated under the "rales" protocol and transported to our base hospital were evaluated for appropriateness of field treatment with correlation to discharge diagnosis. During this same time interval all patients ultimately diagnosed with CHF and treated by paramedics under any SFTP were studied. A total of 104 patients met the inclusion criteria with 102 available for analysis. Of the 58 patients treated under the rales protocol 50 (86%) had an ED diagnosis of CHF and 8 (13%) had a primary respiratory diagnosis. The remaining 44 (43%) of the 102 patients studied were treated under an SFTP other than rales but had a discharge diagnosis of CHF. Overall sensitivity for paramedics' correctly identifying CHF was 53%. Their PPV was 86%. In this study paramedics correctly identified only about half of the dyspneic patients who proved to have CHF, but their assessment of CHF did have a higher positive predictive value when this diagnosis was made. Further training and quality improvement efforts need to be directed towards improving paramedic performance with this challenging group of patients, with consideration given to requiring OLMD for patients presenting with rales.

Implementation of standing field treatment protocols in an urban EMS system

The objective was to describe our experience with implementation of standing field treatment protocols (SFTP) in a large, urban EMS system. A prospective, consecutive observational study examining the first 21 days of implementation of SFTPs in the City of Los Angeles, California. SFTPs were developed for 7 medical chief complaints and all major trauma patients. There were 13,586 EMS incidents, of which 4,037 (30%) received ALS treatment. SFTPs were used on 2,177 of these incidents, representing 54% of all ALS runs and 16% of all EMS incidents. The most frequently used SFTPs were for altered level of consciousness (29%), and chest pain (25%). The most common errors found were failure to document reassessment of the patient after each medication administration (45% fallout rate), and failure to document and attach a copy of the ECG to the EMS report (40%). The mean fallout rate for failure to establish or attempt IV access, administer oxygen, or provide cardiac monitoring was 7%. Out of 1,450 incidents with outcome data provided by the receiving hospitals, only 3 cases (2%) involved incorrect treatment, with an additional 2 involving the unnecessary use of lidocaine. None of these instances resulted in adverse effects or complications. SFTPs were integrated into a large EMS system with few procedural errors or adverse outcomes.

Physician satisfaction and emergency department laboratory test turnaround time

OBJECTIVES

To determine the length of time for the components of the emergency department (ED) turnaround time (TAT) study in 1998 and to ascertain physician satisfaction concerning laboratory services to the ED.

METHODS

Using forms supplied by the College of American Pathologists Q-Probes program, participants conducted a self-directed study of ED TAT over a 4-week period. Data requested included various times of day associated with the ordering, specimen collection, laboratory receipt, and result-reporting stages of stat ED TATs for potassium and hemoglobin. Additionally, practice-related questions associated with the laboratory were asked. Participating laboratories also provided a physician satisfaction survey for up to 4 physicians who were users of ED services. Results of both the TAT study and the physician satisfaction survey were returned by mail. Participants were drawn from the 952 hospital laboratories enrolled in the 1998 College of American Pathologists Q-Probes study on ED TAT. The main outcome measures included the components of the ED TAT process, factors associated with decreases in ED TAT, and the results of the physician satisfaction survey.

RESULTS

Six hundred ninety hospital laboratories (72.4% response rate) returned data on up to 18 230 hemoglobin and 18 259 potassium specimens. Half of these laboratories responded that 90% of potassium tests were ordered and reported in 69 minutes or less, whereas the TAT for 90% of hemoglobin results was 55 minutes or less. Comparison of the components of TAT for both potassium and hemoglobin with similar studies done in 1990 and 1993 showed no change. Factors found to statistically contribute to faster TATs for both tests were laboratory control of specimen handling and rapid transport time. When whole blood specimens were used for potassium determination, TAT improved. Emergency department physicians chose the study-defined lower satisfaction categories of Often, Sometimes, Rarely, and Never for the questions concerning the laboratory being sensitive to stat testing needs (39.1%) and meeting physician needs (47.6%). Many of the physicians surveyed believed that laboratory TAT caused delayed ED treatment more than 50% of the time (42.9%) and increased ED length of stay more than 50% of the time (61.4%) when compared with other specialty users of the ED.

CONCLUSIONS

Laboratory ED TATs have remained unchanged for almost a decade. Emergency department physicians are not satisfied with laboratory services. Although it appears that one issue may relate to the other, the interaction between the laboratory and the ED is quite complex and has been evolving for at least 30 years. Improvement in interoperability between the departments is essential for operational efficiency and patient care. Effective communication channels need to be established to achieve these goals.

On-line medical control versus protocol-based prehospital care

STUDY OBJECTIVE

To compare on-scene time, appropriateness of therapy, and accuracy of paramedic clinical assessments when prehospital care was provided with the use of on-line medical control (OLMC) by EMS-certified nurses from a single base station or by paramedics using chief complaint-based protocols.

METHODS

We assembled a prospective before-and-after series to compare OLMC (phase 1) and protocol (phase 2) care rendered by all paramedics in a single urban municipality using a single base station. The subjects were consecutively enrolled patients who met protocol inclusion criteria and presented with altered level of consciousness, nontraumatic chest pain, or shortness of breath. For both phases, EMS and corresponding ED records were compiled; all references identifying phase were removed. After establishing interrater reliability, we randomly assigned charts to one of two reviewers for scoring. Complaint-specific scoring elements included on-scene time, assessments performed, presence or absence of indications for common treatments, treatments given, paramedic diagnosis, and emergency physician diagnosis. The percentages of inappropriate treatment decisions and paramedic diagnostic accuracy (versus that of the receiving emergency physician) were calculated.

RESULTS

Phase 1 comprised 287 patients, phase 2 294. Interrater reliability between the two scorers was high. Of 2,190 elements scored jointly, the raters agreed in 97%, with kappa-values ranging from .6 to 1.0. On-scene time was 1 minute shorter during phase 2 (95% confidence interval [CI] for difference in median time, 0 to 2 minutes; P < .03). From phase 1 to phase 2 (relative risk [RR], 1.5; 95% CI, 1.0 to 2.1), inappropriate treatment decisions decreased from 7.4% to 5.1%. The percentage of cases in which paramedics and physicians were in complete diagnostic agreement was high (77% to 78%) and did not change across phases.

CONCLUSION

The use of protocols resulted in small improvements in both on-scene time and the appropriateness of therapeutic decisions, without a change in agreement between paramedic and physician. Protocol care for these three chief complaints is clinically safe and, by reducing training and staffing considerations, may offer a cost-effective alternative to OLMC.

Safe out-of-hospital treatment of chest pain without direct medical control

INTRODUCTION

The use of direct medical control (DMC) in the out-of-hospital setting often is beneficial, but has the disadvantage of consuming emergency medical services (EMS) resources.

HYPOTHESIS

Uncomplicated, nontrauma, adult patients with chest pain can be treated safely and transported by paramedics without DMC.

METHODS

Retrospective chart review of all nontrauma, adult patients with chest pain treated in a combined rural and suburban EMS system during a 2-year period (December 1990 through November 1992) was conducted. Before November 1991, DMC was mandatory for all patients with chest pain. Beginning 01 November 1991, if a patient had resolution of a pain either spontaneously, with administration of oxygen, or after a single dose of nitroglycerin, DMC was at the discretion of the paramedic. Using the above criteria for inclusion, three study groups were defined: Group 1, before protocol change; Group 2, after protocol change without DMC; and Group 3, after protocol change when physician contact was obtained, but not required. These groups were compared for the following parameters: 1) scene time; 2) time to administration of first dose of nitroglycerin; 3) time interval between measurement of vital signs; 4) oxygen use; 5) intravenous access; and 6) electrocardiographic monitoring. Continuous and categorical variables were analyzed by multivariate and univariate analysis of variance and chi-square tests, respectively.

RESULTS

Of 308 nontrauma, adult patients with chest pain, 71 met inclusion criteria in Group 1, 40 in Group 2, and 34 in Group 3. No statistically significant differences were identified in any of the study parameters.

CONCLUSION

Adult patients with chest pain who have no other symptoms or complicating conditions can be treated appropriately be paramedics without DMC.

On-line medical direction: a prospective study

OBJECTIVES

To determine the frequency with which physician, on-line medical direction (OLMD) [direct medical control] of prehospital care results in orders, to describe the nature of these orders, and to measure OLMD time intervals.

METHODS

Blinded, prospective study.

SETTING

A university hospital base-station resource center.

PARTICIPANTS

Ten emergency physicians, 50 advanced life support providers.

INTERVENTIONS

Prehospital treatment was directed by both standing orders and OLMD physician orders. Independent observers recorded event times and the characteristics of OLMD.

RESULTS

Physician orders were given in 47 (19%) of the 245 study cases, and covered a variety of interventions, including many already authorized by standing orders. Mean OLMD radio time was four minutes (245 +/- 216 seconds [sec]), and time from beginning of OLMD to hospital arrival averaged 12 minutes (718 +/- 439 sec). Mean transport time in this system was 13 minutes.

CONCLUSION

Despite detailed standing orders, OLMD results in orders for clinical interventions in 19% of cases. On-line medical direction requires about four minutes of physician time per call. This constituted about one-third of the potential field treatment time interval in this system. Thus, OLMD appears to play an important role in providing quality prehospital care.

Comparison of interventions in prehospital care by standing orders versus interventions ordered by direct [on-line] medical command

OBJECTIVE

The aim of this study was to compare the patient care measures provided by paramedics according to standing orders versus measures ordered by direct [on-line] medical command in order to determine the types and frequency of medical command orders.

DESIGN

Prospective identification of patient care measures done as part of a prehospital quality assurance program.

SETTING

An urban paramedic service in the northeast United States with direct medical command from three local hospitals.

PARTICIPANTS

One thousand eight paramedic reports from October 1992 through March 1993.

INTERVENTIONS

All patient care interventions recorded as done by standing orders or by direct medical command orders. Errors in patient care were determined by the same criteria as in the prior two studies of the same system.

RESULTS

Direct medical command gave orders in 143/1,008 (14.2%) cases. Paramedics performed 2,453/2,624 (93.5%) of the total patient care interventions using standing orders. In 61 cases (6.1%), medical command ordered a potentially beneficial intervention not specified by standing orders or not done by the paramedic. 21/171 (12.3%) command orders were for additional doses of epinephrine or atropine in cardiac arrest cases (where the initial doses had been given under standing orders), and 59/171 (34.5%) were for interventions already mandated or permitted by standing orders. The paramedic error rate was 0.6%, and the medical command error rate was 1.8% (unchanged form the prior study of the same standing-orders system).

CONCLUSION

Direct medical command gave orders in 14% of cases in this standing-orders system, but 35% of command orders only reiterated the standing orders. More selective and reduced uses of on-line command could be done in this system with no change in the types or numbers of patient care interventions performed.