Comparative-Effectiveness of Simulation-Based Deliberate Practice Versus Self-Guided Practice on Resident Anesthesiologists’ Acquisition of Ultrasound-Guided Regional Anesthesia Skills:

Educational outcomes of simulation-based training in regional anaesthesia: a scoping review

BACKGROUND

Structured training in regional anaesthesia includes pretraining on simulation-based educational platforms to establish a safe and controlled learning environment before learners are provided clinical exposure in an apprenticeship model. This scoping review was designed to appraise the educational outcomes of current simulation-based educational modalities in regional anaesthesia.

METHODS

This review conformed to PRISMA-ScR guidelines. Relevant articles were searched in PubMed, Scopus, Google Scholar, Web of Science, and EMBASE with no date restrictions, until November 2023. Studies included randomised controlled trials, pre-post intervention, time series, case control, case series, and longitudinal studies, with no restrictions to settings, language or ethnic groups. The Kirkpatrick framework was applied for extraction of educational outcomes.

RESULTS

We included 28 studies, ranging from 2009 to 2023, of which 46.4% were randomised controlled trials. The majority of the target population was identified as trainees or residents (46.4%). Higher order educational outcomes that appraised translation to real clinical contexts (Kirkpatrick 3 and above) were reported in 12 studies (42.9%). Two studies demonstrated translational patient outcomes (Level 4) with reduced incidence of paraesthesia and clinical complications. The majority of studies appraised Level 3 outcomes of performance improvements in either laboratory simulation contexts (42.9%) or demonstration of clinical performance improvements in regional anaesthesia (39.3%).

CONCLUSIONS

There was significant heterogeneity in the types of simulation modalities used, teaching interventions applied, study methodologies, assessment tools, and outcome measures studied. When improvisations were made to regional anaesthesia simulation platforms (hybrid simulation), there were sustained educational improvements beyond 6 months. Newer technology-enhanced innovations such as virtual, augmented, and mixed reality simulations are evolving, with early reports of educational effectiveness.

[State of the art: Simulation in US]

Technical simulation of diagnostic and therapeutic procedures is of growing relevance for student education and advanced medical training and has already been introduced in the field of ultrasound. This review gives a broad overview on different levels of simulation for ultrasound diagnostics and highlights the technical background of the methodology. A critical review of the literature reveals recommendations for implementing simulation techniques in medical studies and professional ultrasound training. An analysis of strengths and weaknesses shows the advantages of simulation especially in the context of individual learning situations and COVID-19-related restrictions for personal interaction. However, simulation techniques cannot replace the experiences of complex clinical examinations with direct interaction to real patients. Therefore, future applications may focus on repetition and assessment of achieved competencies by using standardized feedback mechanisms in order to preserve the limited resources for practical medical training.

Are we talking about practice? A randomized study comparing simulation-based deliberate practice and mastery learning to self-guided practice

OBJECTIVES

Simulation-based technical skills training is now ubiquitous in medicine, particularly for high acuity, low occurrence (HALO) procedures. Mastery learning and deliberate practice (ML + DP) are potentially valuable educational methods, however, they are resource intensive. We sought to compare the effect of deliberate practice and mastery learning versus self-guided practice on skill performance of the rare, life-saving procedure, a bougie-assisted cricothyroidotomy (BAC).

METHODS

We conducted a multi-center, randomized study at five North American emergency medicine (EM) residency programs. We randomly assigned 176 EM residents to either the ML + DP or self-guided practice groups. Three blinded airway experts independently evaluated BAC skill performance by video review before (pre-test), after (post-test) and 6-12 months (retention) after the training session. The primary outcome was post-test skill performance using a global rating score (GRS). Secondary outcomes included performance time and skill performance at the retention test.

RESULTS

Immediately following training, GRS scores were significantly higher as mean performance improved from pre-test, (22, 95% CI = 21-23) to post-test (27, 95% CI = 26-28), (p < 0.001) for all participants. However, there was no difference between the groups on GRS scores (p = 0.2) at the post-test or at the retention test (p = 0.2). At the retention test, participants in the ML + DP group had faster performance times (66 s, 95% CI = 57-74) compared to the self-guided group (77 s, 95% CI = 67-86), (p < 0.01).

CONCLUSIONS

There was no significant difference in skill performance between groups. Residents who received deliberate practice and mastery learning demonstrated an improvement in skill performance time.

The ultrasound use of simulators, current view, and perspectives: Requirements and technical aspects (WFUMB state of the art paper)

Simulation has been shown to improve clinical learning outcomes, speed up the learning process and improve learner confidence, whilst initially taking pressure off busy clinical lists. The World Federation for Ultrasound in Medicine and Biology (WFUMB) state of the art paper on the use of simulators in ultrasound education introduces ultrasound simulation, its advantages and challenges. It describes different simulator types, including low and high-fidelity simulators, the requirements and technical aspects of simulators, followed by the clinical applications of ultrasound simulation. The paper discusses the role of ultrasound simulation in ultrasound clinical training, referencing established literature. Requirements for successful ultrasound simulation acceptance into educational structures are explored. Despite being in its infancy, ultrasound simulation already offers a wide range of training opportunities and likely holds the key to a broader point of care ultrasound education for medical students, practicing doctors, and other health care professionals. Despite the drawbacks of simulation, there are also many advantages, which are expanding rapidly as the technology evolves.

Use of an ultrasound-guided intravenous catheter insertion simulation-based mastery learning curriculum to improve paediatric anaesthesia care

Background

We previously showed that an ultrasound-guided i.v. catheter insertion (USGIV) simulation-based mastery learning (SBML) curriculum improves the simulated USGIV skills of paediatric anaesthesiologists. It remains unclear if improvements in simulated USGIV skills translate to improved patient care.

Methods

A cohort study was conducted from August 2018 to August 2020 to evaluate paediatric anaesthesiologists' USGIV performance in the operating theatre before and after they participated in the USGIV SBML curriculum. Paediatric anaesthesiologists' use of ultrasound for successful i.v. insertion and first-attempt i.v. insertion success rate with ultrasound were compared before and after training.

Results

Twenty-nine paediatric anaesthesiologists completed training. Unadjusted analysis showed a significant increase in the percentage of i.v. catheters inserted with ultrasound for successful i.v. catheter insertion (9.5-14.5%; P<0.001) and first i.v. catheter insertion attempt success with ultrasound (5.5-8.9%; P<0.001) from before to after training. Multivariable regression analysis showed higher odds of ultrasound use for a successful i.v. catheter attempt (1.79; 95% confidence interval [CI]: 1.11-2.90; P=0.018) and first-attempt success with ultrasound (4.11; 95% CI: 2.02-8.37; P<0.001) after training.

Conclusions

After completing the USGIV SBML curriculum, paediatric anaesthesiologists increased their ultrasound use for successful i.v. catheter insertion and first-attempt success rate with ultrasound for patients in the operating theatre.

Piloting a New Curriculum: Guided At-Home Pediatric Regional Anesthesia Education Using a Portable Ultrasound

Ultrasound-guided regional anesthesia is the standard of care for most regional blocks in pediatric anesthesiology.Training programs must educate physicians to perform regional blocks safely and efficiently. Hands-on learning with simulation and live models is the gold standard. The coronavirus disease 2019 (COVID-19) pandemic has greatly hampered our ability to safely hold in-person workshops. We describe an at-home, guided virtual workshop using portable ultrasound to safely continue experiential trainee education.

The primary objective of this pilot virtual workshop was to develop an effective experiential learning program without the need for live child models. The main goal was to give trainees hands-on experience obtaining anatomical ultrasound images necessary for regional anesthesia blocks in a guided-virtual setting and to evaluate the effectiveness of skills acquisition. This workshop included two pediatric anesthesiology fellows and a pediatric anesthesiologist.

Trainees were instructed on ultrasound-guided regional block acquisition. For two weeks, trainees acquired images/movies of regional block anatomy at home using their own children. Virtual video assistance was available. Trainees then used acquired images/movies to discuss needle and local anesthetic placement with a pediatric regional anesthesiologist. Trainees completed pre- and post-workshop surveys assessing attitudes, perceived educational efficacy, and procedural skill acquisition. The faculty member also assessed trainees’ skills.

The virtual workshop was successful. Trainees expressed successful active learning and increased comfort in performing regional blocks on live patients. They correctly identified relevant anatomy of acquired images/movies, as well as needle and local anesthetic placement at the time of debriefing. Faculty were pleased with trainees’ initial performance of regional blocks.

Adapting an in-person workshop to an at-home guided experience is a safe, feasible, and well-received method for anesthesiology trainees to obtain experiential learning of ultrasound-guided regional anesthesia. This facilitated at-home learning experience allows for hands-on skill practice while preventing exposure of child models to the hospital setting during a pandemic.

Novel cricothyrotomy assessment tool for attending physicians: A multicenter study of an error avoidance checklist

BACKGROUND

This study used existing literature and expert feedback to develop and pilot a novel error-avoidance checklist tool for cricothyrotomy in attending physicians. Prior literature has not focused on expert cricothyrotomy performance. While published checklists teach a specific procedural method, ideal for novice learners, this may hinder expert learners.

OBJECTIVES

We endeavored to create a succinct error-avoidance checklist for cricothyrotomy. We hypothesized that such a checklist would prove feasible and acceptable to attending physicians.

METHODS

This is a multicenter prospective checklist creation, evaluation, and feasibility study. Multiple experts pursued an iterative process to reach consensus on a 7-item error-avoidance checklist. The checklist was trialed for feasibility in pilot sessions at two sites by 45 attending emergency physicians who used the checklist for peer performance assessment and provided feedback.

RESULTS

During the pilot implementation, 94% of respondents completed the procedure within the allotted 120 s. Greater than 85% of respondents agreed that four of the five procedural errors on the checklist were very or somewhat critical to avoid, including cutting >2 cm from midline, creating a false passage, failing to continuously maintain an object in the trachea, and injuring oneself during the procedure. Only 66% of participants felt severing the cricoid cartilage was critical. Successful breath administration and time under 120 s were critical for 100% and 95% of participants, respectively. The checklist was rated "easy" or "very easy" to use by 93% of participants, and 95% found this checklist reasonable for evaluating attending physicians.

CONCLUSIONS

We present the multicenter development and implementation of a novel error-avoidance checklist tool for use in expert cricothyrotomy performance. Attending emergency medicine (EM) physicians rated our tool easy to use and agreed that most of the proposed errors were critical. Participants overwhelmingly agreed this tool would be reasonable for evaluation of cricothyrotomy performance among attending EM physicians.

Using psychometric ability to improve education in ultrasound-guided regional anaesthesia: a multicentre randomised controlled trial

The learning curve for novices developing regional anaesthesia skills, such as real-time ultrasound-guided needle manipulation, may be affected by innate visuospatial ability, as this influences spatial cognition and motor co-ordination. We conducted a multinational randomised controlled trial to test if novices with low visuospatial ability would perform better at an ultrasound-guided needling task with deliberate practice training than with discovery learning. Visuospatial ability was evaluated using the mental rotations test-A. We recruited 140 medical students and randomly allocated them into low-ability control (discovery learning), low-ability intervention (received deliberate practice), high-ability control, and high-ability intervention groups. Primary outcome was the time taken to complete the needling task, and there was no significant difference between groups: median (IQR [range]) low-ability control 125 s (69-237 [43-600 s]); low-ability intervention 163 s (116-276 [44-600 s]); high-ability control 130 s (80-210 [41-384 s]); and high-ability intervention 177 s (113-285 [43-547 s]), p = 0.06. No difference was found using the global rating scale: mean (95%CI) low-ability control 53% (95%CI 46-60%); low-ability intervention 61% (95%CI 53-68%); high-ability control 63% (95%CI 56-70%); and high-ability intervention 66% (95%CI 60-72%), p = 0.05. For overall procedure pass/fail, the low-ability control group pass rate of 42% (14/33) was significantly less than the other three groups: low-ability intervention 69% (25/36); high-ability control 68% (25/37); and high-ability intervention 85% (29/34) p = 0.003. Further research is required to determine the role of visuospatial ability screening in training for ultrasound-guided needle skills.

Contemporary training methods in regional anaesthesia: fundamentals and innovations

Over the past two decades, regional anaesthesia and medical education as a whole have undergone a renaissance. Significant changes in our teaching methods and clinical practice have been influenced by improvements in our theoretical understanding as well as by technological innovations. More recently, there has been a focus on using foundational education principles to teach regional anaesthesia, and the evidence on how to best teach and assess trainees is growing. This narrative review will discuss fundamentals and innovations in regional anaesthesia training. We present the fundamentals in regional anaesthesia training, specifically the current state of simulation-based education, deliberate practice and curriculum design based on competency-based progression. Moving into the future, we present the latest innovations in web-based learning, emerging technologies for teaching and assessment and new developments in alternate reality learning systems.

Use of a simulation-based mastery learning curriculum to improve ultrasound-guided vascular access skills of pediatric anesthesiologists

BACKGROUND

Pediatric vascular access is inherently challenging due to the small caliber of children's vessels. Ultrasound-guided intravenous catheter insertion has been shown to increase success rates and decrease time to cannulation in patients with difficult intravenous access. Although proficiency in ultrasound-guided intravenous catheter insertion is a critical skill in pediatric anesthesia, there are no published competency-based training curricula.

AIMS

The objective of this study was to evaluate the performance of pediatric anesthesiologists who participated in a novel ultrasound-guided intravenous catheter insertion simulation-based mastery learning curriculum.

METHODS

Pediatric anesthesia attendings, fellows, and rotating residents participated in the ultrasound-guided intravenous catheter insertion simulation-based mastery learning curriculum from August 2019 to February 2020. The 2-hour curriculum consisted of participants first undergoing a simulated skills pretest followed by watching a video on ultrasound-guided intravenous catheter insertion and deliberate practice on a simulator. Subsequently, all participants took a post-test and were required to meet or exceed a minimum passing standard. Those who were unable to meet the minimum passing standard participated in further practice until they could be retested and met this standard. We compared pre to post-test ultrasound-guided intravenous catheter insertion skills and self-confidence before and after participation in the curriculum.

RESULTS

Twenty-six pediatric anesthesia attendings, 12 fellows, and 38 residents participated in the curriculum. At pretest, 16/76 (21%) participants were able to meet or exceed the minimum passing standard. The median score on the pretest was 21/25 skills checklist items correct and improved to 24/25 at post-test (95% CI 3.0-4.0, P < .01). Self-confidence significantly improved after the course from an average of 3.2 before the course to a postcourse score of 3.9 (95% CI 0.5-0.9, P < .01; 1 = Not all confident, 5 = Very confident).

CONCLUSIONS

Simulation-based mastery learning significantly improved anesthesiologists' ultrasound-guided intravenous catheter insertion performance in a simulated setting.

Perfecting practice: a protocol for assessing simulation-based mastery learning and deliberate practice versus self-guided practice for bougie-assisted cricothyroidotomy performance

BACKGROUND

Simulation-based medical education (SBME) is a cornerstone for procedural skill training in residency education. Multiple studies have concluded that SBME is highly effective, superior to traditional clinical education, and translates to improved patient outcomes. Additionally it is widely accepted that mastery learning, which comprises deliberate practice, is essential for expert level performance for routine skills; however, given that highly structured practice is more time and resource-intensive, it is important to assess its value for the acquisition of rarely performed technical skills. The bougie-assisted cricothyroidotomy (BAC), a rarely performed, lifesaving procedure, is an ideal skill for evaluating the utility of highly structured practice as it is relevant across many acute care specialties and rare - making it unlikely for learners to have had significant previous training or clinical experience. The purpose of this study is to compare a modified mastery learning approach with deliberate practice versus self-guided practice on technical skill performance using a bougie-assisted cricothyroidotomy model.

METHODS

A multi-centre, randomized study will be conducted at four Canadian and one American residency programs with 160 residents assigned to either mastery learning and deliberate practice (ML + DP), or self-guided practice for BAC. Skill performance, using a global rating scale, will be assessed before, immediately after practice, and 6 months later. The two groups will be compared to assess whether the type of practice impacts performance and skill retention.

DISCUSSION

Mastery learning coupled with deliberate practice provides systematic and focused feedback during skill acquisition. However, it is resource-intensive and its efficacy is not fully defined. This multi-centre study will provide generalizable data about the utility of highly structured practice for technical skill acquisition of a rare, lifesaving procedure within postgraduate medical education. Study findings will guide educators in the selection of an optimal training strategy, addressing both short and long term performance.

Simulation-based ultrasound-guided regional anesthesia curriculum for anesthesiology residents

Proficiency in ultrasound-guided regional anesthesia (UGRA) requires the practitioner to acquire cognitive and technical skills. For anesthesiology residents, an assortment of challenges has been identified in learning UGRA skills. Currently, a validated UGRA curriculum for residents does not exist, and the level of UGRA proficiency achieved during residency training can vary considerably. Simulated practice has been shown to enhance proficiency in UGRA, and a competency-based education with simulation training has been endorsed for anesthesiology residents. The objective of this review is to outline simulation-based training that can be implemented in a UGRA curriculum and to explore educational tools like gamification to facilitate competency in regional anesthesiology.

Establishing an Acute Pain Service in Private Practice and Updates on Regional Anesthesia Billing

Acute pain management is an expanding perioperative specialty and there is a renewed focus on implementing and developing an acute pain service (APS) in nonacademic hospitals (ie, "private practice"). An anesthesiologist-led APS can improve patient care by decreasing perioperative morbidity and potentially reducing the risk of chronic postsurgical pain syndromes. Elements of a successful APS include multidisciplinary collaboration to develop perioperative pain protocols, education of health care providers and patients, and regular evaluation of patient safety and quality of care metrics. Standardization of regional anesthesia procedures and billing practices can promote consistent outcomes and efficiency.

Improved Retention of Chest Compression Psychomotor Skills With Brief "Rolling Refresher" Training

INTRODUCTION

High-quality cardiopulmonary resuscitation (CPR) is critical to improve survival from cardiac arrest. However, cardiopulmonary resuscitation knowledge and psychomotor skill proficiency are transient. We hypothesized that brief, in situ refresher training will improve chest compression (CC) psychomotor skill retention for bedside providers.

METHODS

Nurses completed a baseline skill evaluation of CC quality 6 months after traditional basic life support recertification. Data collected using ResusciAnne with SkillReporter included the following: CC depth, rate, complete release, and correct hand position. Total compliance was defined as 100% CC with depth of 50 mm or greater, rate of 100/min or greater, and more than 90% complete release. After the baseline evaluation, the subjects completed "Rolling Refresher" (RR) CC psychomotor training using audiovisual feedback every 2 to 3 months for 12 months until 30 seconds of CCs fulfilling total compliance criteria was achieved. Chest compression quality evaluations were repeated twice ("RR 6 month" and "RR 12 month" evaluation) after implementation of RR program.

RESULTS

Thirty-seven providers enrolled and completed the baseline evaluation. Mean depth was 36.3 (9.7) mm, and 8% met criteria for depth, 35% for rate, and 5% for total compliance. After RRs were implemented, CC quality improved significantly at RR 6-month evaluation: odds ratio for meeting criteria were the following: depth of 35.1 (95% confidence interval = 2.5496, P = 0.009) and total compliance of 22.3 (95% confidence interval = 2.1239, P = 0.010). There was no difference in CC quality at RR 12-month versus RR 6-month evaluation.

CONCLUSIONS

Retention of CC psychomotor skill quality is limited to 6 months after traditional basic life support recertification. Rolling Refresher CC training can significantly improve retention of CC psychomotor skills. Whether CC skills are improved, maintained, or deteriorate after 12 months of Refresher training and optimal frequency of Refreshers is unknown.

Teaching concepts in ultrasound-guided regional anesthesia

PURPOSE OF REVIEW

Ultrasound-guided regional anesthesia is a challenging, complex skill and requires competence in teaching. The aim of this study was to review current literature on identification of education and learning of ultrasound-guided regional anesthesia and to summarize recent findings on teaching concepts.

RECENT FINDINGS

Several teaching programs have been described and implemented into daily routine. Factors relevant to current practice are the knowledge of sonoanatomy, the acquisition of manual skills, the teaching ability, and the feedback given to the trainee. Simulation is a rapidly growing field and is supported by the development of phantoms. Needle visualization is one of the core competencies that is necessary for successful ultrasound-guided procedures and could be supported by technical developments in the future to improve teaching concepts.

SUMMARY

Although a lot of key questions cannot be answered by the latest study results, some interesting findings were able to improve existing education programs. These results should be tailored to the individual need of a trainee, and the effects of improved training programs on patient safety and quality of care have to be investigated. The see one, do one, teach one approach is obsolete and should be abandoned.

Preliminary Experience Using Eye-Tracking Technology to Differentiate Novice and Expert Image Interpretation for Ultrasound-Guided Regional Anesthesia

OBJECTIVES

Objective measures are needed to guide the novice's pathway to expertise. Within and outside medicine, eye tracking has been used for both training and assessment. We designed this study to test the hypothesis that eye tracking may differentiate novices from experts in static image interpretation for ultrasound (US)-guided regional anesthesia.

METHODS

We recruited novice anesthesiology residents and regional anesthesiology experts. Participants wore eye-tracking glasses, were shown 5 sonograms of US-guided regional anesthesia, and were asked a series of anatomy-based questions related to each image while their eye movements were recorded. The answer to each question was a location on the sonogram, defined as the area of interest (AOI). The primary outcome was the total gaze time in the AOI (seconds). Secondary outcomes were the total gaze time outside the AOI (seconds), total time to answer (seconds), and time to first fixation on the AOI (seconds).

RESULTS

Five novices and 5 experts completed the study. Although the gaze time (mean ± SD) in the AOI was not different between groups (7 ± 4 seconds for novices and 7 ± 3 seconds for experts; P = .150), the gaze time outside the AOI was greater for novices (75 ± 18 versus 44 ± 4 seconds for experts; P = .005). The total time to answer and total time to first fixation in the AOI were both shorter for experts.

CONCLUSIONS

Experts in US-guided regional anesthesia take less time to identify sonoanatomy and spend less unfocused time away from a target compared to novices. Eye tracking is a potentially useful tool to differentiate novices from experts in the domain of US image interpretation.

Educational system based on the TAPP checklist improves the performance of novices: a multicenter randomized trial

BACKGROUND

Despite recent developments in surgical education, obstacles including inadequate budget, limited human resources, and a scarcity of time have limited its widespread adoption. To provide systematic training for laparoscopic inguinal hernia repair, we had previously developed and validated a checklist to evaluate the recorded performance of transabdominal preperitoneal (TAPP) repair. We had also developed an educational system that included didactic materials based on the TAPP checklist and incorporated remote evaluation and feedback system. The aim of this study was to evaluate the educational impact of the TAPP education system on novice surgeons.

METHODS

Residents and surgeons from participating hospitals, who had performed 0 or 1 TAPP procedure, were randomly assigned to the intervention group (IG), who trained using this new educational tool, and the control group (CG), who trained using the conventional system. Their surgical videos were rated by blinded raters. All participants performed their first case prior to randomization. The primary outcome was improvement of TAPP checklist score from the first to the third case.

RESULTS

Eighteen participants from 9 institutes were recruited for this study. Seven participants in the IG and 5 participants in the CG were included in the final analysis. The participants in the IG demonstrated significant improvement in their TAPP performance (p = 0.044) from their first case to their third case, whereas their counterparts in the CG failed to make any significant progress during the same period (p = 0.581).

CONCLUSION

The new TAPP educational system was effective in improving the TAPP performance of novice surgeons.