Decision support system in prehospital care: a randomized controlled simulation study

Bracing for the next wave: A critical incident study of frontline decision-making, adaptation and learning in ambulance care during COVID-19

AIM

To explore frontline decision-making, adaptation, and learning in ambulance care during the evolving COVID-19 pandemic.

DESIGN

Descriptive and interpretative qualitative study.

METHODS

Twenty-eight registered nurses from the Swedish ambulance services described 56 critical incidents during the COVID-19 pandemic through free-text questionnaires. The material was analysed using the Critical Incident Technique and Interpretive Description through the lens of potential for resilient performance.

RESULTS

The findings were synthesized into four themes: 'Navigating uncharted waters under never-ending pressure', 'Balancing on the brink of an abyss', 'Sacrificing the few to save the many' and 'Bracing for the next wave'. Frontline decision-making during a pandemic contribute to ethical dilemmas while necessitating difficult prioritizations to adapt and respond to limited resources. Learning was manifested through effective information sharing and the identification of successful adaptations as compared to maladaptations.

CONCLUSIONS

During pandemics or under other extreme conditions, decisions must be made promptly, even amidst emerging chaos, potentially necessitating the use of untested methods and ad-hoc solutions due to initial lack of knowledge and guidelines. Within ambulance care, dynamic leadership becomes imperative, combining autonomous frontline decision-making with support from management. Strengthening ethical competence and fostering ethical discourse may enhance confidence in decision-making, particularly under ethically challenging circumstances.

IMPACT

Performance under extreme conditions can elevate the risk of suboptimal decision-making and adverse outcomes, with older adults being especially vulnerable. Thus, requiring targeted decision support and interventions. Enhancing patient safety in ambulance care during such conditions demands active participation and governance from management, along with decision support and guidelines. Vertical communication and collaboration between management and frontline professionals are essential to ensure that critical information, guidelines, and resources are effectively disseminated and implemented. Further research is needed into management and leadership in ambulance care, alongside the ethical challenges in frontline decision-making under extreme conditions.

REPORTING METHOD

Findings are reported per consolidated criteria for reporting qualitative research (COREQ).

PATIENT OR PUBLIC CONTRIBUTION

No Patient or Public Contribution.

Nurses' use of an advisory decision support system in ambulance services: A qualitative study

AIM

To illuminate from the perspective of nurses in ambulance services the experiences of using a web-based advisory decision support system to assess care needs and refer patients.

DESIGN

Inductive and descriptive approaches.

METHOD

Thirteen semi-structured interviews were conducted in the spring of 2020. The data were analysed through the reflexive thematic analysis.

RESULTS

The Swedish web-based advisory decision support system (ADSS) was found to strengthen nurses' feelings of security when they assess patients' care needs, promote their competence and professional pride, and help them manage stress. However, the system also generated difficulties for nurses to adjust to the dynamic ambulance team and revealed a discrepancy between their professional roles and responsibilities to refer patients and provide self-care advice. The nurses thought that the support system facilitated their increased participation and helped them understand patients and significant others by offering transparency in assessment and decision making. Thus, the support system provides nurses with an opportunity to strengthen patients' independence through information and education. However, in the care relationship, nurses worked to overcome patients' expectations.

CONCLUSION

Nurses using the ADSS increased their security while performing assessments and referrals and found new opportunities to provide information and promote understanding of their decisions. However, nursing care values can be threatened when new support systems are introduced, especially as ambulance services become increasingly protocol-driven.

IMPLICATIONS FOR PROFESSION AND/OR PATIENT CARE

These findings have implications for nurses' work environments and help them maintain consistency in making medical assessments and in providing equivalent self-care advice when referring patients to the different levels of care. The findings will also impact researchers and policymakers who formulate decision support systems.

REPORTING METHOD

Consolidated criteria for reporting qualitative research (COREQ).

PATIENT OR PUBLIC CONTRIBUTION

None.

Electronic field protocols for prehospital care quality improvement in Lithuania: a randomized simulation-based study

BACKGROUND

Prehospital emergency care is complex and influenced by various factors, leading to the need for decision-support tools. Studies suggest that cognitive aids improve provider performance and patient outcomes in clinical emergencies. Electronic cognitive aids have rarely been investigated in prehospital care. Therefore, this study aimed to evaluate the effects of the electronic field protocol (eFP) module on performance, adherence to the standard of care, and satisfaction of prehospital care providers in a simulated environment.

METHODS

This randomised simulation-based study was conducted at the Lithuanian University of Health Sciences in Kaunas, Lithuania. The simulation scenarios were developed to test 12 eFPs: adult resuscitation, pediatric resuscitation, delivery and postpartum care, seizures in pregnancy, stroke, anaphylaxis, acute chest pain, acute abdominal pain, respiratory distress in children, severe trauma, severe infection and sepsis, and initial neonatal evaluation and resuscitation. Sixteen prehospital practitioners with at least 3 years of clinical experience were randomly assigned to either use the eFP module or perform without it in each of the 12 simulated scenarios. Participant scores and adherence to standardised checklists were compared between the two performance modes. Participant satisfaction was measured through a post-simulation survey.

RESULTS

A total of 190 simulation sessions were conducted. Compared to the use of memory alone, the use of the eFP module significantly improved participants' performance in 10 out of the 12 simulation scenarios. Adherence to the standardised checklist increased from 60 to 85% (p < 0.001). Post-simulation survey results indicate that participants found the eFP module easy to use and relevant to prehospital clinical practice.

CONCLUSIONS

The study findings suggest that the eFP module as a cognitive aid can enhance prehospital practitioners' performance and adherence to the standard of care in simulated scenarios. These results highlight the potential of standardised eFPs as a quality improvement step in prehospital care in Lithuania.

A Literature Study of Medical Simulations for Non-Technical Skills Training in Emergency Medicine: Twenty Years of Progress, an Integrated Research Framework, and Future Research Avenues

Medical simulations have led to extensive developments in emergency medicine. Apart from the growing number of applications and research efforts in patient safety, few studies have focused on modalities, research methods, and professions via a synthesis of simulation studies with a focus on non-technical skills training. Intersections between medical simulation, non-technical skills training, and emergency medicine merit a synthesis of progress over the first two decades of the 21st century. Drawing on research from the Web of Science Core Collection's Science Citation Index Expanded and Social Science Citation Index editions, results showed that medical simulations were found to be effective, practical, and highly motivating. More importantly, simulation-based education should be a teaching approach, and many simulations are utilised to substitute high-risk, rare, and complex circumstances in technical or situational simulations. (1) Publications were grouped by specific categories of non-technical skills, teamwork, communication, diagnosis, resuscitation, airway management, anaesthesia, simulation, and medical education. (2) Although mixed-method and quantitative approaches were prominent during the time period, further exploration of qualitative data would greatly contribute to the interpretation of experience. (3) High-fidelity dummy was the most suitable instrument, but the tendency of simulators without explicitly stating the vendor selection calls for a standardised training process. The literature study concludes with a ring model as the integrated framework of presently known best practices and a broad range of underexplored research areas to be investigated in detail.

Cognitive aids in the management of clinical emergencies: a systematic review

Clinical emergencies can be defined as unpredictable events that necessitate immediate intervention. Safety critical industries have acknowledged the difficulties of responding to such crises. Strategies to improve human performance and mitigate its limitations include the provision and use of cognitive aids, a family of tools that includes algorithms, checklists and decision aids. This systematic review evaluates the usefulness of cognitive aids in clinical emergencies. Following a systematic search of the electronic databases, we included 13 randomised controlled trials, reported in 16 publications. Each compared cognitive aids with usual care in the context of an anaesthetic, medical, surgical or trauma emergency involving adults. Most trials used only clinicians in the development and testing of the cognitive aids, and only some trials provided familiarisation with the cognitive aids before they were deployed. The primary outcome was the completeness of care delivered to the patient. Cognitive aids were associated with a reduction in the incidence of missed care steps from 43.3% to 11% (RR (95%CI) 0.29 (0.15-0.16); p < 0.001), and the quality of evidence was rated as moderate. The use of cognitive aids was related to decreases in the incidence of errors, increases in the rate of correctly performed steps and improvement in the clinical teamwork skills scores, non-technical skills scores, subjective conflict resolution scores and the global assessment of team performance. Cognitive aids had an inconsistent influence on the time to first intervention and time to complete care of the patient's condition. It is possible that this was a reflection of how common or rare the crisis in question was as well as the experience and expertise of the clinicians and team. Sufficient thought should be applied to the development of the content and design of cognitive aids, with consideration of the pre-existing guideline ecosystem. Cognitive aids should be tested before their deployment with adequate clinician and team training.

Perceived human factors from the perspective of paramedics – a qualitative interview study

Background

The work environment in prehospital emergency medical care setting is dynamic and complex and includes many stressors. However, little is known about the perceived human factors from the perspective of paramedics. In this study, we investigated, from the perspective of paramedics, what are the human factors, and how are they linked to prehospital emergency medical care?

Methods

Data were collected through semi-structured interviews (n = 15) with Finnish paramedics. The material was analyzed using inductive content analysis.

Results

Three main categories of human factors were identified. The first main category consisted of factors related to work which were divided into two generic categories: “Challenging organizational work environment” and “Changing external work environment.” The second main category comprised factors related to paramedics themselves and were divided into three generic categories: “Issues linked to personality,” “Personal experiences”, and “Factors resulting from personal features.” The third main category described that paramedics have difficulties in understanding and describing human factors.

Conclusion

This study revealed numerous factors that can affect paramedics’ work in the EMS setting. Increased knowledge about human factors in the EMS setting provides organizations with the opportunity to develop procedures that can support paramedics’ cognitive and physical work. Human factors in different situations can be addressed to improve occupational and patient safety.

The Reliability of Anamnestic Data in the Management of Clostridium Tetani Infection in Elderly

Background: Tetanus infection remains a significant complication of wounds. Because most tetanus treatment guidelines rely on anamnestic data collected directly from patients, the congruence between anamnesis and laboratory evidence must be verified, especially in the elderly population.

Aim: Assess, in both the geriatric population (>65) and the non-geriatric one, the reliability of anamnestic data for managing patients with tetanus-risk wounds, identified categories of populations most exposed to non-vaccination coverage, and assessed the agreement of the Tetanos Quick Stick (TQS) results with the therapy performed (administration of tetanus vaccine or immunoglobulin).

Methods: In this retrospective single-center observational study, patients were asked their immunization status against tetanus vaccination. The decision to administer a vaccine or immunoglobulin was therefore clinical and based on anamnestic criteria. The TQS test was then given to patients who were unaware of their immunity status. Patients who thought they knew it but were not sure were given the TQS test to determine whether the anamnestic collection was supported by the test. The TQS test results were compared with the anamnestic data.

Results: Most patients, geriatric and not geriatric, did not know their immune status. Among those who reported knowing their immune status, there was no agreement between the vaccine coverage declared by patients and the TQS test results (p < 0.001), mainly in geriatric patients but also in the control group. Elderly and women had significantly lower positive TQS test results (p < 0.001). There was a statistically significant discrepancy (p < 0.001) between the therapy based on anamnestic data and the TQS test results.

Conclusion: The reliability of anamnestic data for the management of patients with tetanus-risk wounds is low and decreases with age, becoming minimal in geriatric patients. Elderly and women are less likely to have an effective vaccination status against tetanus.

Guideline adherence among prehospital emergency nurses when caring for patients with chest pain: a prospective cohort study

Background

The emergency medical services (EMS) use guidelines to describe optimal patient care for a wide range of clinical conditions and symptoms. The intent is to guide personnel to provide patient care in line with best practice. The aim of this study is to describe adherence to such guidelines among prehospital emergency nurses (PENs) when caring for patients with chest pain.

Objective

To describe guideline adherence among PENs when caring for patients with chest pain. To investigate whether guideline adherence is associated with patient age, sex or final diagnosis of acute myocardial infarction on hospital discharge.

Methods

Guideline adherence in terms of patient examination and pharmaceutical treatment was analysed in a cohort of 2092 EMS missions carried out in 2018 in Region Halland, Sweden. Multivariate regression was used to describe how guideline adherence is associated with patient age, sex and diagnosis on hospital discharge.

Results

Guideline adherence was high regarding examination of vital signs (93%) and electrocardiogram (ECG) registration (96%) but lower in terms of pharmaceutical treatment (ranging from 28 to 90%). Adherence was increased in cases in which the patient ended up with acute myocardial infarction (AMI) as diagnosis on discharge. Patients with AMI were given acetylsalicylic acid by PENs in 50% of cases. Women were less likely than men to receive treatment with acetylsalicylic acid and oxycodone.

Conclusions

Guideline adherence among PENs when caring for patients with chest pain is satisfactory in terms vital signs and ECG registration. Regarding pharmaceutical treatment guideline adherence is defective. Improved adherence is mainly associated with male sex in patients and a diagnosis of AMI on hospital discharge. Defective adherence excludes measures known to improve patients’ prognoses such as treatment with acetylsalicylic acid.

Monitoring sound levels in the intensive care unit: A mixed-methods system development project to optimize design features for a new electronic interface in the healthcare environment

•

Understanding the user experience is key to effective design.

•

Agile design practices foster efficient systems development.

•

Implementing technological change requires socio-cultural understanding of teams.

•

User-testing data from multiple sources allows for better systems evaluation.

•

A well-designed system requires little training or explanation to use.

Background

Intensive care units (ICU) are busy round the clock and it is difficult to maintain low sound levels that support patient rest. To help ICU staff manage activities we developed a visual display that monitors and reports sound levels in real-time. This facilitates immediate feedback, encouraging proactive behavior change to limit disturbances.

Methods

Following the principles of user-centered design practices we created our ‘user persona’ to understand the needs and goals of potential users of the system. We then conducted iterative user testing with current members of the ICU team, primarily using the ‘think aloud’ method to refine the design and functionality of our novel system. Ethnography evaluated team use of the display.

Results

The final design was simple, clear, and efficient, and both functional and aesthetically pleasing for the key user demographic. We identified challenges in the implementation and adoption process that were separate from the ‘usability’ of the system itself.

Conclusions

Embedding the design process within the core user demographic ensured the final product delivered relevant information for key users, and that this information was intuitive to interpret. Initiating sustainable change is not straightforward. It requires recognition of cultural practices within teams, departments, professions, organizations, and strategies to maximize engagement.

Systematic Review of Clinical Decision Support Systems for Prehospital Acute Coronary Syndrome Identification

OBJECTIVES

Timely prehospital diagnosis and treatment of acute coronary syndrome (ACS) are required to achieve optimal outcomes. Clinical decision support systems (CDSS) are platforms designed to integrate multiple data and can aid with management decisions in the prehospital environment. The review aim was to describe the accuracy of CDSS and individual components in the prehospital ACS management.

METHODS

This systematic review examined the current literature regarding the accuracy of CDSS for ACS in the prehospital setting, the influence of computer-aided decision-making and of 4 components: electrocardiogram, biomarkers, patient history, and examination findings. The impact of these components on sensitivity, specificity, and positive and negative predictive values was assessed.

RESULTS

A total of 11,439 articles were identified from a search of databases, of which 199 were screened against the eligibility criteria. Eight studies were found to meet the eligibility and quality criteria. There was marked heterogeneity between studies which precluded formal meta-analysis. However, individual components analysis found that patient history led to significant improvement in the sensitivity and negative predictive values. CDSS which incorporated all 4 components tended to show higher sensitivities and negative predictive values. CDSS incorporating computer-aided electrocardiogram diagnosis showed higher specificities and positive predictive values.

CONCLUSIONS

Although heterogeneity precluded meta-analysis, this review emphasizes the potential of ACS CDSS in prehospital environments that incorporate patient history in addition to integration of multiple components. The higher sensitivity of certain components, along with higher specificity of computer-aided decision-making, highlights the opportunity for developing an integrated algorithm with computer-aided decision support.

The Effects of Integrated IT Support on the Prehospital Stroke Process: Results from a Realistic Experiment

Stroke is a serious condition and the stroke chain of care is a complex. The present study aims to explore the impact of a computerised decision support system (CDSS) for the prehospital stroke process, with focus on work processes and performance. The study used an exploratory approach with a randomised controlled crossover design in a realistic contextualised simulation experiment. The study compared clinical performance among 11 emergency medical services (EMS) teams of 22 EMS clinicians using (1) a computerised decision support system (CDSS) and (2) their usual paper-based process support. Data collection consisted of video recordings, postquestionnaires and post-interviews, and data were analysed using a combination of qualitative and quantitative approaches. In this experiment, using a CDSS improved patient assessment, decision making and compliance to process recommendations. Minimal impact of the CDSS was found on EMS clinicians’ self-efficacy, suggesting that even though the system was found to be cumbersome to use it did not have any negative effects on self-efficacy. Negative effects of the CDSS include increased on-scene time and a cognitive burden of using the system, affecting patient interaction and collaboration with team members. The CDSS’s overall process advantage to the prehospital stroke process is assumed to lead to a prehospital care that is both safer and of higher quality. The key to user acceptance of a system such as this CDSS is the relative advantages of improved documentation process and the resulting patient journal. This could improve the overall prehospital stroke process.

Research challenges in prehospital care: the need for a simulation-based prehospital research laboratory

There is a need for improved research in the field of prehospital care. At the same time, there are many barriers in prehospital research due to the complex context, posing unique challenges for research, development, and evaluation. The present paper argues for the potential of simulation for prehospital research, e.g., through the development of an advanced simulation-based prehospital research laboratory. However, the prehospital context is different from other healthcare areas, which implies special requirements for the design of this type of laboratory, in terms of simulation width (including the entire prehospital work process) and depth (level of scenario detail). A set of features pertaining to simulation width, scenario depth, equipment, and personnel and competence are proposed. Close tailoring between these features and the prehospital research problems and context presents great potential to improve and further prehospital research.

Adverse events in prehospital emergency care: a trigger tool study

Background

Prehospital emergency care has developed rapidly during the past decades. The care is given in a complex context which makes prehospital care a potential high-risk activity when it comes to patient safety. Patient safety in the prehospital setting has been only sparsely investigated. The aims of the present study were 1) To investigate the incidence of adverse events (AEs) in prehospital care and 2) To investigate the factors contributing to AEs in prehospital care.

Methods

We used a retrospective study design where 30 randomly selected prehospital medical records were screened for AEs each month in three prehospital organizations in Sweden during a period of one year. A total of 1080 prehospital medical records were included. The record review was based on the use of 11 screening criteria.

Results

The reviewers identified 46 AEs in 46 of 1080 (4.3%) prehospital medical records. Of the 46 AEs, 43 were classified as potential for harm (AE1) (4.0, 95% CI = 2.9–5.4) and three as harm identified (AE2) (0.3, 95% CI = 0.1–0.9). However, among patients with a life-threatening condition (priority 1), the risk of AE was higher (16.5%). The most common factors contributing to AEs were deviations from standard of care and missing, incomplete, or unclear documentation. The most common cause of AEs was the result of action(s) or inaction(s) by the emergency medical service (EMS) crew.

Conclusions

There were 4.3 AEs per 100 ambulance missions in Swedish prehospital care. The majority of AEs originated from deviations from standard of care and incomplete documentation. There was an increase in the risk of AE among patients who the EMS team assessed as having a life-threatening condition. Most AEs were possible to avoid.

Electronic supplementary material

The online version of this article (10.1186/s12873-019-0228-3) contains supplementary material, which is available to authorized users.

The final assessment and its association with field assessment in patients who were transported by the emergency medical service

Background

In patients who call for the emergency medical service (EMS), there is a knowledge gap with regard to the final assessment after arriving at hospital and its association with field assessment.

Aim

In a representative population of patients who call for the EMS, to describe a) the final assessment at hospital discharge and b) the association between the assessment in the field and the assessment at hospital discharge.

Methods

Thirty randomly selected patients reached by a dispatched ambulance each month between 1 Jan and 31 Dec 2016 in one urban, one rural and one mixed ambulance organisation in Sweden took part in the study. The exclusion criteria were age < 18 years, dead on arrival, transport between health-care facilities and secondary missions. Each patient received a unique code based on the ICD code at hospital discharge and field assessment.

Results

In all, 1080 patients took part in the study, of which 1076 (99.6%) had a field assessment code. A total of 894 patients (83%) were brought to a hospital and an ICD code (ICD-10-SE) was available in 814 patients (91% of these cases and 76% of all cases included in the study). According to these ICD codes, the most frequent conditions were infection (15%), trauma (15%) and vascular disease (9%). The most frequent body localisation of the condition was the thorax (24%), head (16%) and abdomen (13%). In 118 patients (14% of all ICD codes), the condition according to the ICD code was judged as time critical. Among these cases, field assessment was assessed as potentially appropriate in 75% and potentially inappropriate in 12%.

Conclusion

Among patients reached by ambulance in Sweden, 83% were transported to hospital and, among them, 14% had a time-critical condition. In these cases, the majority were assessed in the field as potentially appropriate, but 12% had a potentially inappropriate field assessment. The consequences of these findings need to be further explored.

Electronic supplementary material

The online version of this article (10.1186/s13049-018-0579-x) contains supplementary material, which is available to authorized users.

Initial assessment, level of care and outcome among children who were seen by emergency medical services: a prospective observational study

Background

The assessment of children in the Emergency Medical Service (EMS) is infrequent representing 5.4% of the patients in an urban area in the western part of Sweden. In Sweden, patients are assessed on scene by an EMS nurse whom independently decides on interventions and level of care. To aid the EMS nurse in the assessment a triage instrument, Rapid Emergency Triage and Treatment System-paediatrics (RETTS-p) developed for Emergency Department (ED) purpose has been in use the last 5 years. The aim of this study was to evaluate the EMS nurse assessment, management, the utilisation of RETTS-p and patient outcome.

Methods

A prospective, observational study was performed on 651 children aged < 16 years from January to December 2016. Statistical tests used in the study were Mann-Whitney U test, Fisher’s exact test and Spearman’s rank statistics.

Results

The dispatch centre indexed life-threatening priority in 69% of the missions but, of all children, only 6.1% were given a life threatening RETTS-p red colour by the EMS nurse. A total of 69.7% of the children were transported to the ED and, of these, 31.7% were discharged without any interventions. Among the non-conveyed patients, 16 of 197 (8.1%) visited the ED within 72 h but only two were hospitalised. Full triage, including five out of five vital signs measurements and an emergency severity index, was conducted in 37.6% of all children. A triage colour was not present in 146 children (22.4%), of which the majority were non-conveyed. The overall 30-day mortality rate was 0.8% (n = 5) in children 0–15 years.

Conclusions

Despite the incomplete use of all vital signs according to the RETTS-p, the EMS nurse assessment of children appears to be adapted to the clinical situation in most cases and the patients appear to be assessed to the appropriate level of care but indicating an over triage. It seems that the RETTS-p with full triage is used selectively in the pre-hospital assessment of children with a risk of death during the first 30 days of less than 1%.

Striving for balance - A qualitative study to explore the experiences of nurses new to the ambulance service in Sweden

New nurses and nurses new to a professional practice go through a transition where they adopt a new professional identity. This has been described as a challenging time where peer support and limited responsibility are considered necessary. Little is known about the experience of nurses being new to the ambulance service where support is limited and the nurse holds full responsibility of patient care. The aim of this study has therefore been to explore nurses' experiences during their first year of employment in the Swedish ambulance service. Data was generated from semi-structured interviews with 13 nurses having less than 12 months of experience of work in the ambulance service. The nurses represented nine different districts in Sweden. Analysis was a latent inductive qualitative content analysis. The analysis resulted in the main category, "Striving for balance during the transition process in the ambulance context". Transition in the ambulance service was experienced as a balance act between emotions, expectations and a strive for professional development. The balance was negatively affected by harsh, condescending attitudes among colleagues and the lack of structured support and feedback. In striving for balance in their new professional practice, the nurses described personal, unsupervised strategies for professional development.

Measuring participants' immersion in healthcare simulation: the development of an instrument

Background

Immersion is important for simulation-based education; however, questionnaire-based instruments to measure immersion have some limitations. The aim of the present work is to develop a new instrument to measure immersion among participants in healthcare simulation scenarios.

Methods

The instrument was developed in four phases: trigger identification, content validity scores, inter-rater reliability analysis and comparison with an existing immersion measure instrument. A modified Delphi process was used to develop the instrument and to establish validity and reliability. The expert panel consisted of 10 researchers. All the researchers in the team had previous experience of simulation in the health and/or fire and rescue services as researchers and/or educators and simulation designers. To identify triggers, the panel members independently screened video recordings from simulation scenarios. Here, a trigger is an event in a simulation that is considered a sign of reduced or enhanced immersion among simulation participants.

Results

The result consists of the Immersion Score Rating Instrument (ISRI). It contains 10 triggers, of which seven indicate reduced and three enhanced immersion. When using ISRI, a rater identifies trigger occurrences and assigns them strength between 1 and 3. The content validity analysis shows that all the 10 triggers meet an acceptable content validity index for items (I-CVI) standard. The inter-rater reliability (IRR) among raters was assessed using a two-way mixed, consistency, average-measures intra-class correlation (ICC). The ICC for the difference between weighted positive and negative triggers was 0.92, which indicates that the raters are in agreement. Comparison with results from an immersion questionnaire mirrors the ISRI results.

Conclusions

In conclusion, we present a novel and non-intrusive instrument for identifying and rating the level of immersion among participants in healthcare simulation scenarios.

Electronic supplementary material

The online version of this article (doi:10.1186/s41077-016-0018-x) contains supplementary material, which is available to authorized users.

Effects of computer reminders on complications of peripheral venous catheters and nurses' adherence to a guideline in paediatric care--a cluster randomised study

BACKGROUND

Reminder systems in electronic patient records (EPR) have proven to affect both health care professionals' behaviour and patient outcomes. The aim of this cluster randomised trial was to investigate the effects of implementing a clinical practice guideline (CPG) for peripheral venous catheters (PVCs) in paediatric care in the format of reminders integrated in the EPRs, on PVC-related complications, and on registered nurses' (RNs') self-reported adherence to the guideline. An additional aim was to study the relationship between contextual factors and the outcomes of the intervention.

METHODS

The study involved 12 inpatient units at a paediatric university hospital. The reminders included choice of PVC, hygiene, maintenance, and daily inspection of PVC site. Primary outcome was documented signs and symptoms of PVC-related complications at removal, retrieved from the EPR. Secondary outcome was RNs' adherence to a PVC guideline, collected through a questionnaire that also included RNs' perceived work context, as measured by the Alberta Context Tool. Units were allocated into two strata, based on occurrence of PVCs. A blinded simple draw of lots from each stratum randomised six units to the control and intervention groups, respectively. Units were not blinded. The intervention group included 626 PVCs at baseline and 618 post-intervention and the control group 724 PVCs at baseline and 674 post-intervention. RNs included at baseline were 212 (65.4 %) and 208 (71.5 %) post-intervention.

RESULTS

No significant effect was found for the computer reminders on PVC-related complications nor on RNs' adherence to the guideline recommendations. The complication rate at baseline and post-intervention was 40.6 % (95 % confidence interval (CI) 36.7-44.5) and 41.9 % (95 % CI 38.0-45.8), for the intervention group and 40.3 % (95 % CI 36.8-44.0) and 46.9 % (95 % CI 43.1-50.7) for the control. In general, RNs' self-rated work context varied from moderately low to moderately high, indicating that conditions for a successful implementation to occur were less optimal.

CONCLUSIONS

The reminders might have benefitted from being accompanied by a tailored intervention that targeted specific barriers, such as the low frequency of recorded reasons for removal, the low adherence to daily inspection of PVC sites, and the lack of regular feedback to the RNs.

TRIAL REGISTRATION

Current Controlled Trials ISRCTN44819426.

The effect of a Computerised Decision Support System (CDSS) on compliance with the prehospital assessment process: results of an interrupted time-series study

Background

Errors in the decision-making process are probably the main threat to patient safety in the prehospital setting. The reason can be the change of focus in prehospital care from the traditional “scoop and run” practice to a more complex assessment and this new focus imposes real demands on clinical judgment. The use of Clinical Guidelines (CG) is a common strategy for cognitively supporting the prehospital providers. However, there are studies that suggest that the compliance with CG in some cases is low in the prehospital setting. One possible way to increase compliance with guidelines could be to introduce guidelines in a Computerized Decision Support System (CDSS). There is limited evidence relating to the effect of CDSS in a prehospital setting. The present study aimed to evaluate the effect of CDSS on compliance with the basic assessment process described in the prehospital CG and the effect of On Scene Time (OST).

Methods

In this time-series study, data from prehospital medical records were collected on a weekly basis during the study period. Medical records were rated with the guidance of a rating protocol and data on OST were collected. The difference between baseline and the intervention period was assessed by a segmented regression.

Results

In this study, 371 patients were included. Compliance with the assessment process described in the prehospital CG was stable during the baseline period. Following the introduction of the CDSS, compliance rose significantly. The post-intervention slope was stable. The CDSS had no significant effect on OST.

Conclusions

The use of CDSS in prehospital care has the ability to increase compliance with the assessment process of patients with a medical emergency. This study was unable to demonstrate any effects of OST.

Simulation as a methodology for assessing the performance of healthcare professionals working in the delivery room

Formal evaluation of healthcare professionals has been accomplished primarily through assessment of the ability to recall content knowledge despite the fact that cognitive, technical and behavioral skills are all important aspects of human performance in this domain. In addition human performance is also influenced by elements that are extrinsic to the human being including the systems and subsystems with which they must interact. Rigorous assessment of human and system performance in the actual healthcare environment is extremely challenging for a number of reasons. Simulation provides a methodology by which this performance can be objectively assessed, thereby facilitating the delivery of effective, safe and efficient patient care.

Exclusion of context knowledge in the development of prehospital guidelines: results produced by realistic evaluation

Background

Prehospital work is accomplished using guidelines and protocols, but there is evidence suggesting that compliance with guidelines is sometimes low in the prehospital setting. The reason for the poor compliance is not known. The objective of this study was to describe how guidelines and protocols are used in the prehospital context.

Methods

This was a single-case study with realistic evaluation as a methodological framework. The study took place in an ambulance organization in Sweden. The data collection was divided into four phases, where phase one consisted of a literature screening and selection of a theoretical framework. In phase two, semi-structured interviews with the ambulance organization's stakeholders, responsible for the development and implementation of guidelines, were performed. The third phase, observations, comprised 30 participants from both a rural and an urban ambulance station. In the last phase, two focus group interviews were performed. A template analysis style of documents, interviews and observation protocols was used.

Results

The development of guidelines took place using an informal consensus approach, where no party from the end users was represented. The development process resulted in guidelines with an insufficiently adapted format for the prehospital context. At local level, there was a conscious implementation strategy with lectures and manikin simulation. The physical format of the guidelines was the main obstacle to explicit use. Due to the format, the ambulance personnel feel they have to learn the content of the guidelines by heart. Explicit use of the guidelines in the assessment of patients was uncommon. Many ambulance personnel developed homemade guidelines in both electronic and paper format. The ambulance personnel in the study generally took a positive view of working with guidelines and protocols and they regarded them as indispensable in prehospital care, but an improved format was requested by both representatives of the organization and the ambulance personnel.

Conclusions

The personnel take a positive view of the use of guidelines and protocols in prehospital work. The main obstacle to the use of guidelines and protocols in this organization is the format, due to the exclusion of context knowledge in the development process.

The effects of on-screen, point of care computer reminders on processes and outcomes of care

BACKGROUND

The opportunity to improve care by delivering decision support to clinicians at the point of care represents one of the main incentives for implementing sophisticated clinical information systems. Previous reviews of computer reminder and decision support systems have reported mixed effects, possibly because they did not distinguish point of care computer reminders from e-mail alerts, computer-generated paper reminders, and other modes of delivering 'computer reminders'.

OBJECTIVES

To evaluate the effects on processes and outcomes of care attributable to on-screen computer reminders delivered to clinicians at the point of care.

SEARCH STRATEGY

We searched the Cochrane EPOC Group Trials register, MEDLINE, EMBASE and CINAHL and CENTRAL to July 2008, and scanned bibliographies from key articles.

SELECTION CRITERIA

Studies of a reminder delivered via a computer system routinely used by clinicians, with a randomised or quasi-randomised design and reporting at least one outcome involving a clinical endpoint or adherence to a recommended process of care.

DATA COLLECTION AND ANALYSIS

Two authors independently screened studies for eligibility and abstracted data. For each study, we calculated the median improvement in adherence to target processes of care and also identified the outcome with the largest such improvement. We then calculated the median absolute improvement in process adherence across all studies using both the median outcome from each study and the best outcome.

MAIN RESULTS

Twenty-eight studies (reporting a total of thirty-two comparisons) were included. Computer reminders achieved a median improvement in process adherence of 4.2% (interquartile range (IQR): 0.8% to 18.8%) across all reported process outcomes, 3.3% (IQR: 0.5% to 10.6%) for medication ordering, 3.8% (IQR: 0.5% to 6.6%) for vaccinations, and 3.8% (IQR: 0.4% to 16.3%) for test ordering. In a sensitivity analysis using the best outcome from each study, the median improvement was 5.6% (IQR: 2.0% to 19.2%) across all process measures and 6.2% (IQR: 3.0% to 28.0%) across measures of medication ordering. In the eight comparisons that reported dichotomous clinical endpoints, intervention patients experienced a median absolute improvement of 2.5% (IQR: 1.3% to 4.2%). Blood pressure was the most commonly reported clinical endpoint, with intervention patients experiencing a median reduction in their systolic blood pressure of 1.0 mmHg (IQR: 2.3 mmHg reduction to 2.0 mmHg increase).

AUTHORS' CONCLUSIONS

Point of care computer reminders generally achieve small to modest improvements in provider behaviour. A minority of interventions showed larger effects, but no specific reminder or contextual features were significantly associated with effect magnitude. Further research must identify design features and contextual factors consistently associated with larger improvements in provider behaviour if computer reminders are to succeed on more than a trial and error basis.