Learning Curves and Competences of Vascular Trainees Performing Open Aortic Repair in a Simulation-Based Environment

Certification of Basic Skills in Endovascular Aortic Repair Through a Modular Simulation Course With Real Time Performance Assessment

OBJECTIVE

Endovascular aortic repair (EVAR) is being used increasingly for the treatment of infrarenal abdominal aortic aneurysms. Improvement in educational strategies is required to teach future vascular surgeons EVAR skills, but a comprehensive, pre-defined e-learning and simulation curriculum remains to be developed and tested. EndoVascular Aortic Repair Assessment of Technical Expertise (EVARATE), an assessment tool for simulation based education (SBE) in EVAR, has previously been designed to assess EVAR skills, and a pass limit defining mastery level has been set. However, EVARATE was developed for anonymous video ratings in a research setting, and its feasibility for real time ratings in a standardised SBE programme in EVAR is unproven. This study aimed to test the effect of a newly developed simulation based modular course in EVAR. In addition, the applicability of EVARATE for real time performance assessments was investigated.

METHODS

The European Society of Vascular Surgery (ESVS) and Copenhagen Certification Programme in EVAR (ENHANCE-EVAR) was tested in a prospective cohort study. ENHANCE-EVAR is a modular SBE programme in EVAR consisting of e-learning and hands-on SBE. Participants were rated with the EVARATE tool by experienced EVAR surgeons.

RESULTS

Twenty-four physicians completed the study. The mean improvement in EVARATE score during the course was +11.8 (95% confidence interval 9.8 - 13.7) points (p < .001). Twenty-two participants (92%) passed with a mean number of 2.8 ± 0.7 test attempts to reach the pass limit. Cronbach's alpha coefficient was 0.91, corresponding to excellent reliability of the EVARATE scale. Differences between instructors' EVARATE ratings were insignificant (p = .16), with a maximum variation between instructors of ± 1.3 points.

CONCLUSION

ENHANCE-EVAR, a comprehensive certifying EVAR course, was proven to be effective. EndoVascular Aortic Repair Assessment of Technical Expertise (EVARATE) is a trustworthy tool for assessing performance within an authentic educational setting, enabling real time feedback.

A view from the top: A qualitative exploration of top-level health care leaders' perceptions on the implementation of simulation-based education in postgraduate medical education

INTRODUCTION

Although there is substantial evidence supporting the benefits of simulation-based education (SBE), its widespread and effective implementation remains challenging. The aim of this study was to explore the perceptions of top-level health care leaders regarding SBE and the barriers and facilitators that influence its wide implementation as part of the postgraduate surgical curricula in Denmark.

METHODS

We conducted semi-structured interviews with top-level health care leaders who were chosen based on their roles in ensuring high-quality patient care delivery and developing strategies to achieve the goals of the entire health care system. The interview transcripts were translated into English, and a thematic approach was used to code and inductively analyse the data. We used the Consolidated Framework for Implementation Research to identify and understand the determinants to a successful implementation of SBE.

RESULTS

We interviewed 13 participants from different political and administrative levels. We found that the participants had limited knowledge about SBE, which highlighted a disconnection between these leaders and the educational environment. This was further compounded by a lack of effective communication and inadequate information dissemination between simulation centres and higher-level organisations. While participants recognised the benefits of SBE for doctors in training, they expressed concerns about the implementation given the already strained health care system and limited resources. The need for evidence, particularly in the context of patient safety, was emphasised to facilitate SBE implementation. Although participants supported the implementation of SBE, it was unclear who should initiate action.

DISCUSSION

This study highlighted the perspectives of top-level health care leaders regarding SBE and identified the determinant factors for a successful implementation. Effective communication channels are crucial to enhance collaborations and reduce the disconnection between the different health care organisational levels. Strategic implementation processes, including the roles and responsibilities, should be defined and established. These will inform decisions regarding the implementation strategies to effectively integrate SBE into the residency training curricula.

Learning curve of ultrasound-guided surgeon-administered transversus abdominis plane (UGSA-TAP) block on a porcine model

Background

Surgeons commonly perform ultrasound-guided Transversus Abdominis Plane blocks to manage acute pain following abdominal surgeries. There is no consensus on whether surgeons should undergo basic hands-on training to perform TAP blocks or if video-based learning is sufficient. We theorized that simulation-based learning is superior to video-based learning. In the present study, we present the analysis of technical skills of UGSA-TAP block performance on a live porcine model by general surgery trainees after undergoing video or simulation-based learning.

Methods

We performed a prospective, double-blinded, randomized study. Ten surgery residents and two surgery critical-care fellows (n = 12) without prior experience in performing the TAP block were recruited. The participants were randomized either into a video-based or simulation-based training group. After that, all participants performed a TAP block on a live anesthetized pig, which was recorded and scored by three blinded anesthesiologists. All participants completed a post-performance survey to assess their confidence in gaining competency in the UGSA-TAP block. Statistical analyses were performed to assess the differences between the two groups. P < 0.05 was considered statistically significant.

Results

All simulation-based learning participants successfully performed a survey scan, identified the three muscular layers of the abdominal wall, and identified the transversus abdominis plane compared to 50 %, 50 %, and 33 % video-based learning group participants for the respective parameters (p < 0.05). While some performance metrics showed no statistically significant differences between the groups, substantial effect sizes (Cohen's ℎ up to 1.07) highlighted notable differences in participants' performance. Both groups exhibited confidence in core competencies, with varied rates of satisfactory skill execution. Performance assessed using a global rating scale revealed a higher passing rate for the simulation group (83 % vs. 33 %). Participant feedback via the Likert scale reflected confidence post-training. Inter-rater reliability (0.83-1) confirmed the robustness of study evaluations.

Conclusion

The UGSA-TAP block curriculum should be introduced into the surgical residency programs with an emphasis on simulation-based learning to enhance the procedural skills of the trainees before transitioning to surgical patients.

Facilitators and Barriers to Implementation of Simulation Based Education in Vascular Surgery in Europe

OBJECTIVE

This study explored the status and availability of simulation based education (SBE) for learning vascular surgical procedures identified in the 2019 General Needs Assessment in vascular surgery in Europe (GNA-2019) and identified facilitators and barriers to SBE implementation in vascular surgery.

METHODS

A three round iterative survey was distributed via the European Society for Vascular Surgery and the Union Européenne des Médecins Spécialistes. Members from leading committees and organisations within the European vascular surgical community were invited to participate as key opinion leaders (KOLs). Three online survey rounds explored demographics, SBE availability, and facilitators and barriers to SBE implementation.

RESULTS

Overall, 147 KOLs (target population 338) accepted invitation to round 1, representing 30 European countries. The dropout rates for rounds 2 and 3 were 29% and 40%, respectively. Most respondents (88%) were senior, consultant level or higher. No mandatory SBE training was required in their department before training on patients, according to 84% of the KOLs. There was high consensus on the need for structured SBE (87%) and mandatory SBE (81%). SBE is available for the top three prioritised procedures in GNA-2019 (basic open skills, basic endovascular skills, and vascular imaging interpretation) in 24, 23, and 20 of the 30 represented European countries, respectively. The highest ranking facilitators were structured SBE programmes, availability of simulation equipment locally and regionally, good quality simulators, and having a dedicated person running the SBE. The highest ranked barriers were lack of structured SBE curriculum, equipment costs, lack of SBE culture, no or limited dedicated time for faculty to teach in SBE, and clinical work overload.

CONCLUSION

Based largely on the opinions of KOLs in vascular surgery in Europe, this study revealed that SBE is needed in vascular surgery training and that systematic and structured programmes are required to ensure successful implementation.

Simulation-Based Education of Endovascular Scrub Nurses Reduces Stress and Improves Team Performance

INTRODUCTION

Endovascular procedures have become commonplace in vascular surgery. This development calls for new training strategies for future specialists. Most simulation-based education (SBE) programs have a monodisciplinary focus on physicians, although successful surgery is a multidisciplinary team effort. Mental stress impairs the learning process and surgical performance and heart rate variability (HRV) can be measured as a proxy for both mental and physical stress. This study aims to assess how SBE of endovascular scrub nurses affects team performance and HRV during endovascular aneurysm repair (EVAR).

MATERIALS AND METHODS

Prospective interventional study in which EVAR-inexperienced scrub nurses followed a focused SBE EVAR program. During real-life EVAR procedures, HRV was continuously recorded with a wireless electrocardiogram patch and multidisciplinary team performance was assessed with the Imperial College Error CAPture (ICECAP) tool, before and after the SBE program, allowing each scrub nurse to serve as their own control. Eight scrub nurses with experience in lower limb endovascular procedures, but not EVAR, were invited to participate.

RESULTS

Seven participants completed the study. In five of seven scrub nurses, HRV-derived stress levels during real-time EVAR procedures were lower after SBE compared to before SBE. Mean HRV increased from 24 msec to 35 msec (P < 0.001), indicating stress level reduction. Before SBE, the mean number of errors/hour was 7.3 (standard deviation ± 1.8) compared to 3.6 (standard deviation ± 2.7) after SBE. Most errors were categorized as technical (58 %) and communicative (23 %).

CONCLUSIONS

SBE of scrub nurses may improve team performance and may lower mental stress during EVAR procedures. In this small study, we suggest using mental stress, as evaluated with HRV, and multidisciplinary team performance, as evaluated with ICECAP, to assess SBE effectiveness in real-case EVAR procedures. This SBE program and live ICECAP observations and electrocardiogram patches was well-accepted by scrub nurses and the entire team.

A Systematic Review of Simulation-Based Training in Vascular Surgery

Introduction

Recent advancements in surgical technology, reduced working hours, and training opportunities exacerbated by the COVID-19 pandemic have led to an increase in simulation-based training. Furthermore, a rise in endovascular procedures has led to a requirement for high-fidelity simulators that offer comprehensive feedback. This review aims to identify vascular surgery simulation models and assess their validity and levels of effectiveness (LoE) for each model in order to successfully implement them into current training curricula.

Methods

PubMed and EMBASE were searched on January 1, 2021, for full-text English studies on vascular surgery simulators. Eligible articles were given validity ratings based on Messick’s modern concept of validity alongside an LoE score according to McGaghie’s translational outcomes.

Results

Overall 76 eligible articles validated 34 vascular surgery simulators and training courses for open and endovascular procedures. High validity ratings were achieved across studies for: content (35), response processes (12), the internal structure (5), relations to other variables (57), and consequences (2). Only seven studies achieved an LoE greater than 3/5. Overall, ANGIO Mentor was the most highly validated and effective simulator and was the only simulator to achieve an LoE of 5/5.

Conclusions

Simulation-based training in vascular surgery is a continuously developing field with exciting future prospects, demonstrated by the vast number of models and training courses. To effectively integrate simulation models into current vascular surgery curricula and assessments, there is a need for studies to look at trainee skill retention over a longer period of time. A more detailed discussion on cost-effectiveness is also needed.

Identifying technical skills and clinical procedures in surgery for a simulation-based curriculum: a national general needs assessment

BACKGROUND

The efficacy of simulation-based training in surgical education is well known. However, the development of training programs should start with problem identification and a general needs assessment to ensure that the content is aligned with current surgical trainee needs. The objective of the present study is to identify the technical skills and clinical procedures that should be included in a simulation-based curriculum in general surgery.

METHODS

A national, three-round Delphi process was conducted to achieve consensus on which technical skills and clinical procedures should be included in a simulation-based curriculum in general surgery. In total, 87 key opinion leaders were identified and invited to the study.

RESULTS

Round 1 of the Delphi process had a response rate of 64% (56/87) and a total of 245 suggestions. Based on these suggestions, a consolidated list of 51 technical skills or clinical procedures was made. The response rate in Delphi round 2 was 62% (54/87) resulting in a pre-prioritized order of procedures for round 3. The response rate in Delphi round 3 was 65% (35/54). The final list included 13 technical skills and clinical procedures. Training was predominantly requested within general open surgical skills, laparoscopic skills, and endoscopic skills, and a few specific procedures such as appendectomy and cholecystectomy were included in the final prioritized list.

CONCLUSION

Based on the Delphi process 13 technical skills and clinical procedures were included in the final prioritized list, which can serve as a point of departure when developing simulation-based training in surgery.