Assessing advanced life support (ALS) competence: Victorian practices

Development of an instrument for the evaluation of advanced life support performance

BACKGROUND

Assessing advanced life support (ALS) competence requires validated instruments. Existing instruments include aspects of technical skills (TS), non-technical skills (NTS) or both, but one instrument for detailed assessment that suits all resuscitation situations is lacking. This study aimed to develop an instrument for the evaluation of the overall ALS performance of the whole team.

METHODS

This instrument development study had four phases. First, we reviewed literature and resuscitation guidelines to explore items to include in the instrument. Thereafter, we interviewed resuscitation team professionals (n = 66), using the critical incident technique, to determine possible additional aspects associated with the performance of ALS. Second, we developed an instrument based on the findings. Third, we used an expert panel (n = 20) to assess the validity of the developed instrument. Finally, we revised the instrument based on the experts' comments and tested it with six experts who evaluated 22 video recorded resuscitations.

RESULTS

The final version of the developed instrument had 69 items divided into adherence to guidelines (28 items), clinical decision-making (5 items), workload management (12 items), team behaviour (8 items), information management (6 items), patient integrity and consideration of laymen (4 items) and work routines (6 items). The Cronbach's α values were good, and strong correlations between the overall performance and the instrument were observed.

CONCLUSION

The instrument may be useful for detailed assessment of the team's overall performance, but the numerous items make the use demanding. The instrument is still under development, and more research is needed to determine its psychometric properties.

Preparing Residents Effectively in Emergency Skills Training With a Serious Game

Supplemental digital content is available in the text.

Introduction

Training emergency care skills is critical for patient safety but cost intensive. Serious games have been proposed as an engaging self-directed learning tool for complex skills. The objective of this study was to compare the cognitive skills and motivation of medical residents who only used a course manual as preparation for classroom training on emergency care with residents who used an additional serious game.

Methods

This was a quasi-experimental study with residents preparing for a rotation in the emergency department. The “reading” group received a course manual before classroom training; the “reading and game” group received this manual plus the game as preparation for the same training. Emergency skills were assessed before training (with residents who agreed to participate in an extra pretraining assessment), using validated competency scales and a global performance scale. We also measured motivation.

Results

All groups had comparable important characteristics (eg, experience with acute care). Before training, the reading and game group felt motivated to play the game and spent more self-study time (+2.5 hours) than the reading group. Game-playing residents showed higher scores on objectively measured and self-assessed clinical competencies but equal scores on the global performance scale and were equally motivated for training, compared with the reading group. After the 2-week training, no differences between groups existed.

Conclusions

After preparing training with an additional serious game, residents showed improved clinical competencies, compared with residents who only studied course material. After a 2-week training, this advantage disappeared. Future research should study the retention of game effects in blended designs.

Advanced Practice Nursing Simulation for Neonatal Skill Competency: A Pilot Study for Successful Continuing Education

BACKGROUND

Skill readiness remains a challenge for all health care professionals who are involved in direct patient care. Researchers suggest that skill retention may decrease within 6 months of an educational session. The purpose of this study was to explore competency retention for high-risk, low-frequency procedures, specifically, managing a difficult airway and placing a laryngeal mask airway, using a web-based content refresher.

METHOD

The pilot study was conducted in two sessions. Session one established clinical skill competency. Six months later, the advanced practice RNs were randomized into two groups. Group 1 reviewed didactic content and participated in a complex airway management simulation. Group 2 participated only in a complex airway management simulation.

RESULTS

This study showed a positive trend in maintaining competency for a low-frequency procedure for which complex airway management was given, using web-based content review. It is feasible to maintain competency for low-frequency procedures using web-based content refreshers.

CONCLUSION

This pilot study benefited advanced practice nurses by providing them with the potential to maintain competency in this high-risk, low-frequency procedure. Continuing education is an important consideration for health care organizations.

Advanced life support (ALS) instructors experience of ALS education in Western Australia: a qualitative exploratory research study

BACKGROUND

When cardiac arrest occurs, timely competent advanced life support (ALS) interventions by nursing staff can influence patient outcomes. Ongoing ALS education influences maintenance of competency and avoids skill decay.

OBJECTIVES

To explore the methods of ALS education delivery for nurses in the workplace; describe the issues relating to maintaining ALS competency; explore ALS competency decay for nurses and develop recommendations for the provision of continuing ALS education.

DESIGN

A qualitative exploratory design was used to study ALS education provision in the workplace.

PARTICIPANTS

Data were collected from ALS nurse experts in Western Australia by face-to-face and phone interviews.

METHODS

Semi-structured interviews were conducted and organised around a set of predetermined questions.

RESULTS

Two major themes were identified; the first theme Demand and Supply describes the increasing demand for ALS education for nurses and the challenges with providing timely cost effective traditional face-to-face ALS education. The second theme, Choosing The Best Education Options describes new ways to provide ALS education using emerging technologies.

CONCLUSIONS

The study suggested that using e-learning methods would assist with educating the maximum amount of nurses in a timely manner and e-learning and teleconferencing offer opportunities to reach nurses in distant locations. Delivering ALS education more frequently than annually would increase skills maintenance and lessen skill decay. Further research is required to explore which blended e-learning model is best suited to ALS education.

Assessing the assessment in emergency care training

Objective

Each year over 1.5 million health care professionals attend emergency care courses. Despite high stakes for patients and extensive resources involved, little evidence exists on the quality of assessment. The aim of this study was to evaluate the validity and reliability of commonly used formats in assessing emergency care skills.

Methods

Residents were assessed at the end of a 2-week emergency course; a subgroup was videotaped. Psychometric analyses were conducted to assess the validity and inter-rater reliability of the assessment instrument, which included a checklist, a 9-item competency scale and a global performance scale.

Results

A group of 144 residents and 12 raters participated in the study; 22 residents were videotaped and re-assessed by 8 raters. The checklists showed limited validity and poor inter-rater reliability for the dimensions “correct” and “timely” (ICC = .30 and.39 resp.). The competency scale had good construct validity, consisting of a clinical and a communication subscale. The internal consistency of the (sub)scales was high (α = .93/.91/.86). The inter-rater reliability was moderate for the clinical competency subscale (.49) and the global performance scale (.50), but poor for the communication subscale (.27). A generalizability study showed that for a reliable assessment 5–13 raters are needed when using checklists, and four when using the clinical competency scale or the global performance scale.

Conclusions

This study shows poor validity and reliability for assessing emergency skills with checklists but good validity and moderate reliability with clinical competency or global performance scales. Involving more raters can improve the reliability substantially. Recommendations are made to improve this high stakes skill assessment.

Annual resuscitation competency assessments: a review of the evidence

BACKGROUND

Australian critical care nurses generally undertake assessment of resuscitation competencies on an annual or biannual basis. International resuscitation evidence and guidelines released in 2010 do not support this practice, instead advocating more frequent retraining.

AIM

To review the evidence for annual assessment of resuscitation knowledge and skills, and for the efficacy of resuscitation training practices.

METHODS

A search of the Medline and CINAHL databases was conducted using the key search words/terms 'resuscitation' 'advanced life support' 'advanced cardiac life support' 'assessment' 'cardiac arrest', 'in-hospital cardiac arrest', 'competence', 'training', 'ALS', 'ACLS' 'course' and 'competency'. The search was limited to English language publications produced during the last 10 years. The International Liaison Committee On Resuscitation worksheets were reviewed for key references, as were the reference lists of articles from the initial search.

RESULTS

There is little evidence to support the current practice of annual resuscitation competency assessments. Theoretical knowledge has no correlation with resuscitation performance, and current practical assessment methods are problematic. Both knowledge and skills decline well before the 12-month mark. There is emerging support in the literature for frequent practice sessions using simulation technology.

CONCLUSION

The current practice of annual assessments is not supported by evidence. Emerging evidence for regular resuscitation practice is not conclusive, but it is likely to produce better outcomes. Changing practice in Australia also represents an opportunity to generate data to inform practice further.

Guideline adherence to chemotherapy administration safety standards: a survey on nurses in a single institute

Objective

Little is known about the guideline adherence of nurses to chemotherapy administration guidelines. We determined the guideline adherence of nurses to the Chemotherapy Administration Safety Standards and the relationship between demographic characteristics and guideline adherence.

Methods

Survey sheets containing two questions on demographic characteristics and 16 questions on the guideline adherence of nurses regarding chemotherapy administration were distributed to all in-patient departments in our hospital in which chemotherapy was performed. All clinical nurses in the department were recommended to respond.

Results

Of 202 nurses, 123 responses were collected (61% response rate). The guideline adherence rate was >70% for 15 of 16 questions, but 55% of respondents indicated that there was no competency monitoring for nurses. Nurses with >7 years of clinical nursing experience felt more competent in performing cardiopulmonary resuscitation (CPR) than nurses with <7 years of clinical nursing experience (p=0.032).

Conclusion

The guideline adherence rate of nurses with respect to chemotherapy administration was high, with the exception of the absence of a competency monitoring for nurses. A significant number of nurses with <7 years of clinical nursing experience felt incompetent in performing CPR.