The Effect of High-Frequency, Structured Expert Feedback on the Learning Curves of Basic Interventional Ultrasound Skills Applied to Regional Anesthesia

Feasibility study of cumulative sum (CUSUM) analysis as a competency assessment tool for ultrasound-guided venous access procedures

PURPOSE

Typically, physician training programs use a self-reported case-log competency assessment that does not measure procedure success or objectively assess competency. Cumulative sum (CUSUM) analysis could provide objective assessments of competency and progress over the training period. Our study objective was to determine the feasibility of CUSUM analysis to assess competency of ultrasound-guided peripheral intravenous (USG-PIV) line placement in pediatric anesthesiology fellows.

METHODS

We applied a CUSUM analysis to assess competency in USG-PIV placement in three consecutive pediatric anesthesia fellowship classes. After a didactic and hands-on training session, fellows placed a USG-PIV line and self-reported the outcomes via a web-based application. Fellows were deemed competent if the CUSUM curve crossed two consecutive boundary lines from above.

RESULTS

Twenty-nine fellows reported 1,388 USG-PIV attempts, with 74% success. Most fellows (26/29; 90%) achieved competency by the end of the fellowship. Two fellows identified in the mid-year CUSUM as not progressing towards competency achieved competency after targeted interventions. Fellows achieving competency (11/29 vs 25/29; odds ratio, 15; 95% confidence interval [CI], 1.98 to 113.56; P = 0.01) and attempts needed to achieve competency (19 vs 11; mean difference, 8.5; 95% CI, 3.3 to 13.7; P = 0.002) were significantly lower in younger patients and significantly higher in older patients.

CONCLUSION

Our study showed that CUSUM can be used to assess competence in USG-PIV procedures performed by pediatric anesthesia fellows and to identify learners not progressing toward competency in procedural skills. Ultrasound-guided venous access required more attempts to achieve competency in younger patients.

Contemporary training methods in regional anaesthesia: fundamentals and innovations

Over the past two decades, regional anaesthesia and medical education as a whole have undergone a renaissance. Significant changes in our teaching methods and clinical practice have been influenced by improvements in our theoretical understanding as well as by technological innovations. More recently, there has been a focus on using foundational education principles to teach regional anaesthesia, and the evidence on how to best teach and assess trainees is growing. This narrative review will discuss fundamentals and innovations in regional anaesthesia training. We present the fundamentals in regional anaesthesia training, specifically the current state of simulation-based education, deliberate practice and curriculum design based on competency-based progression. Moving into the future, we present the latest innovations in web-based learning, emerging technologies for teaching and assessment and new developments in alternate reality learning systems.

Education and training in ultrasound-guided regional anaesthesia and pain medicine

PURPOSE OF REVIEW

Effective and safe regional anaesthesia and pain medicine procedures require clinicians to learn and master complex theoretical knowledge and motor skills. This review aims to summarize articles relevant to education and training in these skill sets in the previous 2 years.

RECENT FINDINGS

Twenty-two articles were identified, investigating nine out of the 13 top-ranked research topics in education and training in regional anaesthesia. Research topics addressed by these articles included prerotation simulation, deliberate practice combined with formative assessment tools, validation of assessment tools, three-dimensional-printed models, and knowledge translation from simulation to clinical practice. Emerging concepts investigated for their applications in regional anaesthesia included eye-tracking as a surrogate metric when evaluating proficiency, and elastography aiding visual salience to distinguish appropriate perineural and inappropriate intraneural injections.

SUMMARY

Research into education and training in regional anaesthesia covered multiple and diverse topics. Methodological limitations were noted in several articles, reflecting the difficulties in designing and conducting medical education studies. Nonetheless, the evidence-base continues to mature and innovations provide exciting future possibilities.

Development of Learning Curves for Bronchoscopy: Results of a Multicenter Study of Pulmonary Trainees

BACKGROUND

There are currently no reference standards for the development of competence in bronchoscopy.

RESEARCH QUESTION

The aims of this study were to (1) develop learning curves for bronchoscopy skill development and (2) estimate the number of bronchoscopies required to achieve competence.

STUDY DESIGN AND METHODS

Trainees from seven North American academic centers were enrolled at the beginning of their pulmonology training. Performance during clinical bronchoscopies was assessed by supervising physicians using the Ontario Bronchoscopy Assessment Tool (OBAT). Group-level learning curves were modeled using a quantile regression growth model, where the dependent variable was the mean OBAT score and the independent variable was the number of bronchoscopies performed at the time the OBAT was completed.

RESULTS

A total of 591 OBAT assessments were collected from 31 trainees. The estimated regression quantiles illustrate significantly different learning curves based on trainees' performance percentiles. When competence was defined as the mean OBAT score for all bronchoscopies rated as being completed without need for supervision, the mean OBAT score associated with competence was 4.54 (95% CI, 4.47-4.58). Using this metric, the number of bronchoscopies required to achieve this score varied from seven to 10 for the 90th percentile of trainees and from 109 to 126 for the lowest 10th percentile of trainees. When competence was defined as the mean OBAT score for the first independent bronchoscopy, the mean was 4.40 (95% CI, 4.20-4.60). On the basis of this metric, the number of bronchoscopies required varied from one to 11 for the 90th percentile of trainees and from 83 to 129 for the lowest 10th percentile of trainees.

INTERPRETATION

We were able to generate learning curves for bronchoscopy across a range of trainees and centers. Furthermore, we established the average number of bronchoscopies required for the attainment of competence. This information can be used for purposes of curriculum planning and allows a trainee's progress to be compared with an established norm.

Recommendations and resources for regional anaesthesia Fellowships in Australia and New Zealand

Regional anaesthesia is a fundamental aspect of anaesthesia practice. Structured Fellowships in regional anaesthesia facilitate the development of expert clinicians, scholars and future leaders. The Australian and New Zealand College of Anaesthetists accredits training sites for the final year of Fellowship training but does not outline specific guidance for subspecialty training. Based on evidence from a systematic literature review and best-practice medical education principles, the ideal structure for a regional anaesthesia Fellowship programme in Australia and New Zealand is outlined in four categories: (a) structure and duration of training; (b) educational aspects; (c) institutional organization; (d) evaluation and improvement. Departments may use this resource to help design, implement and improve their Fellowship programmes while trainees may employ it as a reference to achieve their learning goals at any training stage. Continuing professional education plays a central role in achieving and maintaining mastery of regional anaesthesia competencies.

The Principles and Procedures of Ultrasound-guided Anesthesia Techniques

For inexperienced users, training with phantoms is an important part of training. Inexperienced users can teach themselves to gain significant procedural skills. Participating in training courses or practising with experts can enhance the outcomes. Inexperienced users need to understand the indications, clinical pearls, and pitfalls of each procedure to avoid potential complications. Inexperienced users can also train and teach themselves to become proficient in ultrasound techniques.