Simulation Based Training and Assessment in Open Vascular Surgery: A Systematic Review

Simulation training in vascular and endovascular surgery: A nationwide survey among surgeon educators and trainees in France

OBJECTIVES

Vascular surgical training is evolving towards simulation-based methods to enhance skill development, ensure patient safety, and adapt to changing regulations. This study aims to investigate the utilization of simulation training among vascular surgeons in France, amidst ongoing shifts in teaching approaches and educational reforms.

METHODS

A national survey assessed the experiences and perceptions of vascular surgery professionals regarding simulation training. Participation was open to self-reported health professionals specialized (or specializing) in vascular surgery, including interns or fellows. Participants were recruited through various channels, and data were collected via a questionnaire covering participant characteristics, simulation experiences, and perceptions.

RESULTS

Seventy-six participants, predominantly male (74%) took part in the survey. While 58% reported access to simulation laboratories, only 17% had organized simulation sessions 1 to 3 times a year, and 5% had sessions more than 10 times annually. High fidelity simulators were available in 57% of institutions, while low fidelity simulators were available in 50%. Regarding funding, 20% received financial assistance for training, predominantly from industry (18%). One third of the participants experienced 9 or more sessions (34%), lasting between 1 to 2 hours (34%), 30% expressed satisfaction with access to simulation, while 33% were dissatisfied with communication of simulation training opportunities.

CONCLUSION

Despite recognizing the benefits of simulation training, its integration into vascular surgery education in France remains incomplete. Challenges such as limited access and communication barriers hinder widespread adoption. Collaborative efforts are needed to ensure uniformity and enhance the effectiveness of simulation training in vascular surgery education.

Remote feedback in endovascular simulation training: a mixed-methods study

BACKGROUND

There is an increasing need to increase simulation-based learning opportunities for vascular surgery residents in endovascular skills training. This study aims to explore the effectiveness of remote expert instructional feedback of endovascular simulation-based education, as a means of increasing training opportunities in this area for vascular surgery residents.

METHODS

A mixed-methods study design was adopted. Twelve vascular surgery residents from Ireland were tasked with completing two endovascular renal artery procedures: one with in-person expert feedback and the other with remote instruction. Participants ranged in experience levels from second year to final year of residency. Following the training activities, interviews and a questionnaire were employed to gather information on the usefulness of remote feedback.

RESULTS

There was no significant difference reported by participants using a post-event validated questionnaire between remote and in-person feedback. During the interviews, participants expressed mixed feelings about the presence of the educator while practicing, but they eventually saw no limiting factors to their practice when the trainer provided remote feedback. When receiving performance feedback remotely, clear communication and a shared knowledge of the task development are critical to success.

CONCLUSIONS

We believe these findings can inform the design and development of remote learning and assessment of endovascular skills training and ultimately provide increased opportunities for more skills practice for vascular surgical residents.

Surgical Medical Education via 3D Bioprinting: Modular System for Endovascular Training

There is currently a shift in surgical training from traditional methods to simulation-based approaches, recognizing the necessity of more effective and controlled learning environments. This study introduces a completely new 3D-printed modular system for endovascular surgery training (M-SET), developed to allow various difficulty levels. Its design was based on computed tomography angiographies from real patient data with femoro-popliteal lesions. The study aimed to explore the integration of simulation training via a 3D model into the surgical training curriculum and its effect on their performance. Our preliminary study included 12 volunteer trainees randomized 1:1 into the standard simulation (SS) group (3 stepwise difficulty training sessions) and the random simulation (RS) group (random difficulty of the M-SET). A senior surgeon evaluated and timed the final training session. Feedback reports were assessed through the Student Satisfaction and Self-Confidence in Learning Scale. The SS group completed the training sessions in about half time (23.13 ± 9.2 min vs. 44.6 ± 12.8 min). Trainees expressed high satisfaction with the training program supported by the M-SET. Our 3D-printed modular training model meets the current need for new endovascular training approaches, offering a customizable, accessible, and effective simulation-based educational program with the aim of reducing the time required to reach a high level of practical skills.

Editor's Choice -- European Society for Vascular Surgery (ESVS) 2024 Clinical Practice Guidelines on the Management of Abdominal Aorto-Iliac Artery Aneurysms

OBJECTIVE

The European Society for Vascular Surgery (ESVS) has developed clinical practice guidelines for the care of patients with aneurysms of the abdominal aorta and iliac arteries in succession to the 2011 and 2019 versions, with the aim of assisting physicians and patients in selecting the best management strategy.

METHODS

The guideline is based on scientific evidence completed with expert opinion on the matter. By summarising and evaluating the best available evidence, recommendations for the evaluation and treatment of patients have been formulated. The recommendations are graded according to a modified European Society of Cardiology grading system, where the strength (class) of each recommendation is graded from I to III and the letters A to C mark the level of evidence.

RESULTS

A total of 160 recommendations have been issued on the following topics: Service standards, including surgical volume and training; Epidemiology, diagnosis, and screening; Management of patients with small abdominal aortic aneurysm (AAA), including surveillance, cardiovascular risk reduction, and indication for repair; Elective AAA repair, including operative risk assessment, open and endovascular repair, and early complications; Ruptured and symptomatic AAA, including peri-operative management, such as permissive hypotension and use of aortic occlusion balloon, open and endovascular repair, and early complications, such as abdominal compartment syndrome and colonic ischaemia; Long term outcome and follow up after AAA repair, including graft infection, endoleaks and follow up routines; Management of complex AAA, including open and endovascular repair; Management of iliac artery aneurysm, including indication for repair and open and endovascular repair; and Miscellaneous aortic problems, including mycotic, inflammatory, and saccular aortic aneurysm. In addition, Shared decision making is being addressed, with supporting information for patients, and Unresolved issues are discussed.

CONCLUSION

The ESVS Clinical Practice Guidelines provide the most comprehensive, up to date, and unbiased advice to clinicians and patients on the management of abdominal aorto-iliac artery aneurysms.

The changing face of surgical education: transfer of surgical and endovascular knowledge to young surgeons

The goal of vascular surgery education is to provide the best possible training to vascular residents and fellows and to assure the highest standards of care for patients with vascular disease. In the USA, the currently used Vascular Surgery Milestones Program includes milestones as set targets at five levels, from novice to expertise, to assess the trainees' performance in knowledge, skills, attitudes, and other attributes of competencies. Competencies are broad and foundational domains of ability, the most important being the care of the patient. The soon to be introduced Entrustable Professional Activities (EPA) Project, a competency-based assessment, appears to be the best way to evaluate that trainees are ready to practice independently. Transferring surgical and endovascular skills to trainees has been, however, a challenge, because of the decreased number of open surgical procedures, the increasing number of the endovascular interventions, the decreased work hours for residents and that learning on patients in the operating room is no longer acceptable. Simulation laboratories, using 3D reconstructions of real patient's aneurysms has been most helpful to teach even complex endovascular procedures. In open or endovascular simulation laboratories, deliberate practice with focused attention and specific goals of improving performance should be combined with expert feedback. Greatness is not coded into our DNA but comes from deliberate practice, dedication and perseverance.

Facilitators and Barriers to Implementation of Simulation Based Education in Vascular Surgery in Europe

OBJECTIVE

This study explored the status and availability of simulation based education (SBE) for learning vascular surgical procedures identified in the 2019 General Needs Assessment in vascular surgery in Europe (GNA-2019) and identified facilitators and barriers to SBE implementation in vascular surgery.

METHODS

A three round iterative survey was distributed via the European Society for Vascular Surgery and the Union Européenne des Médecins Spécialistes. Members from leading committees and organisations within the European vascular surgical community were invited to participate as key opinion leaders (KOLs). Three online survey rounds explored demographics, SBE availability, and facilitators and barriers to SBE implementation.

RESULTS

Overall, 147 KOLs (target population 338) accepted invitation to round 1, representing 30 European countries. The dropout rates for rounds 2 and 3 were 29% and 40%, respectively. Most respondents (88%) were senior, consultant level or higher. No mandatory SBE training was required in their department before training on patients, according to 84% of the KOLs. There was high consensus on the need for structured SBE (87%) and mandatory SBE (81%). SBE is available for the top three prioritised procedures in GNA-2019 (basic open skills, basic endovascular skills, and vascular imaging interpretation) in 24, 23, and 20 of the 30 represented European countries, respectively. The highest ranking facilitators were structured SBE programmes, availability of simulation equipment locally and regionally, good quality simulators, and having a dedicated person running the SBE. The highest ranked barriers were lack of structured SBE curriculum, equipment costs, lack of SBE culture, no or limited dedicated time for faculty to teach in SBE, and clinical work overload.

CONCLUSION

Based largely on the opinions of KOLs in vascular surgery in Europe, this study revealed that SBE is needed in vascular surgery training and that systematic and structured programmes are required to ensure successful implementation.

A National Needs Assessment in Simulation Based Training in Vascular Surgery

OBJECTIVES

The aim of this research was to ascertain the highest need areas for vascular simulation, in order to tailor training for the highest impact.

DESIGN, PARTICIPANTS AND SETTING

A needs assessment was conducted according to best practices using the Delphi method. All consultant vascular surgeons/trainers in the training jurisdiction (n=33) were approached through an independent intermediary to contribute and generate a prioritized list of procedures for training. The research team were blinded to participant identities. Three rounds were conducted according to the Delphi process and scored according to the Copenhagen Needs Assessment Formula (CAMES-NAF).

RESULTS

A final list of 34 vascular procedures was selected and prioritized by surgical trainers. Principles of arterial repair and endarterectomy/patching were considered the highest priority. Complex major interventions such as open abdominal aortic aneurysm (AAA) repair, carotid endarterectomy, and endovascular aortic repair (EVAR) consistently ranked higher than rarer, such as first rib resection and more basic procedures, such as foam injection for varicose veins. Major lower limb amputations typically ranked lower overall compared to arterial interventions. Surgical trainers generally agreed with the ranking according to the CAMES-NAF. There was some disagreement for a select few procedures such as iliac stenting (which rose 13 places) and open radial artery exposure (which fell 6 places) on subsequent iterations.

CONCLUSIONS

Core operative principles and common major operative cases should remain the priority for vascular technical skills training. Other procedures which may be less invasive, but have the potential for major complications should also not be overlooked. In designing simulators the main focus should center on specific skill acquisition for commonly performed major procedures and management of the recognized potential complications. Lower limb amputations are considered adequately taught in clinical practice, or are too challenging to simulate in simulator models apart from cadaveric models.

Simulation-Based Education in the Artificial Intelligence Era

Simulation-based medical education (SBME) has been widely implemented in skill training in various clinical specialties. SBME has contributed not only to patient and medical safety but also to undergraduate and specialist education in the healthcare field. In this review, we discuss the challenges and future directions of SBME in the artificial intelligence (AI) era. While SBME fidelity or methods may become highly complicated in the AI era, the fact is that learners play a central role. As SBME and clinical education are complementary, mutual feedback and improvement are essential, especially in non-technical skill development. For the development of sustainable SBME in the clinical field in the AI era, continuous improvement is needed by academia, educators, and learners.

Role of Simulated Training for Carotid Endarterectomy: A Systematic Review

Vascular surgery trainees often do not get to perform carotid endarterectomy (CEA) directly on the patients as it requires meticulous surgical technique and has a high risk of procedure-related complications. Hence, the role of simulation in training future vascular surgeons becomes essential. This review aims to assess the types and utility of simulators available for CEA. In this systematic review, all the studies performed on CEA simulation were included. The purpose of this review was to assess different types of simulators and their usefulness for CEA. We identified 122 articles, of which 10 were eligible for review. A variety of simulators, ranging from animal models, virtual reality simulators and commercially designed models with high fidelity options were used. Technical competence was the major domain assessed in the majority of the studies (n=8), whereas four studies evaluated anatomical and procedural knowledge. Blinding was done in five studies for assessment purposes. The majority of studies (n=9) found the simulation to be an effective tool for achieving technical competence. This review shows the potential usefulness of simulation in acquiring technical skills and procedural acumen for CEA. The available literature is unfortunately too diverse to have a common recommendation.

A three-dimensional (3D) printed simulator as a feasible assessment tool for evaluating hip arthroscopy skills

PURPOSE

The aims of this study were (1) to develop a three-dimensional (3D) printed simulator that facilitates the simulation of surgical skills for portal placement, intra-articular identification of anatomical structures and arthroscope navigation for hip arthroscopy and (2) to concurrently examine the feasibility of using this simulator as an assessment tool to evaluate trainees' surgical competencies.

METHODS

A simulator was developed using a combination of medical imaging, computer-aided design, and 3D printing. A cross-sectional study was conducted with 29 participants divided into 3 subgroups (novice, intermediate and experienced). All participants performed related skills on the simulator, and their performance was evaluated using different assessment parameters. The participants' qualitative feedback regarding the simulator was also collected. The data collated from each group of participants were subsequently compared.

RESULTS

Significant differences were observed between the three subgroups of participants with regard to the total checklist score (F_2,26 = 11.3), total Arthroscopic Surgical Skill Evaluation score (F_2,26 = 92.1), overall final global rating scale score (F_2,26 = 49), number of times the participants used fluoroscopy (F_2,26 = 7.4), and task completion times (F_2,26 = 23.5). The participants' performance in the simulated operation was correlated with their prior clinical experience. There was mainly positive feedback with regard to the fidelity and utility of the simulator in relation to the surgeons' prior clinical experience.

CONCLUSIONS

This study demonstrated that a reliable hip arthroscopic simulator can be developed for use by orthopedic surgeons to evaluate their hip arthroscopic skills before performing actual surgical operations.

LEVEL OF EVIDENCE

Level III.

A Systematic Review of Simulation-Based Training in Vascular Surgery

Introduction

Recent advancements in surgical technology, reduced working hours, and training opportunities exacerbated by the COVID-19 pandemic have led to an increase in simulation-based training. Furthermore, a rise in endovascular procedures has led to a requirement for high-fidelity simulators that offer comprehensive feedback. This review aims to identify vascular surgery simulation models and assess their validity and levels of effectiveness (LoE) for each model in order to successfully implement them into current training curricula.

Methods

PubMed and EMBASE were searched on January 1, 2021, for full-text English studies on vascular surgery simulators. Eligible articles were given validity ratings based on Messick’s modern concept of validity alongside an LoE score according to McGaghie’s translational outcomes.

Results

Overall 76 eligible articles validated 34 vascular surgery simulators and training courses for open and endovascular procedures. High validity ratings were achieved across studies for: content (35), response processes (12), the internal structure (5), relations to other variables (57), and consequences (2). Only seven studies achieved an LoE greater than 3/5. Overall, ANGIO Mentor was the most highly validated and effective simulator and was the only simulator to achieve an LoE of 5/5.

Conclusions

Simulation-based training in vascular surgery is a continuously developing field with exciting future prospects, demonstrated by the vast number of models and training courses. To effectively integrate simulation models into current vascular surgery curricula and assessments, there is a need for studies to look at trainee skill retention over a longer period of time. A more detailed discussion on cost-effectiveness is also needed.

Simulation-based procedure training (SBPT) in rarely performed procedures: a blueprint for theory-informed design considerations

Simulation-based procedure training is now integrated within health professions education with literature demonstrating increased performance and translational patient-level outcomes. The focus of published work has been centered around description of such procedural training and the creation of realistic part-task models. There has been little attention with regards to design consideration, specifically around how simulation and educational theory should directly inform programme creation. Using a case-based approach in cardiology as an example, we present a blueprint for theory-informed simulation-based procedure training linking learning needs analysis and defining suitable objectives to matched fidelity. We press the importance of understanding how to implement and utilise task competence benchmarking in practice, and the role of feedback and debriefing in cycles of repeated practice. We conclude with evaluation and argue why this should be considered part of the initial design process rather than an after-thought following education delivery.

Simulation-based training as a continuous means of vascular surgical education—a roadmap

Background

Simulation-based training has become an important part of the educational approach in many professions. Over the past decades it has slowly found recognition in the medical field and in surgery in particular. Research has clearly shown the advantages of learning and honing skills on simulators in safe environments, especially for junior doctors. For this purpose, a number of models and methods have been developed to enable open vascular surgery training.

Methods

Extensive research was performed for the development of simulation-based training for vascular surgery. Different types of models and techniques were investigated. Aspects of specific theoretical and practical means of education and training were considered. This initiated the development of a simulation center for open vascular surgery.

Results

Perfused simulators and necessary surgical instruments were acquired for open vascular surgery training at the Simulation Center of the Styrian state hospitals, located at the University Hospital, Graz Medical University, in Graz. A fully equipped mock operating room is available for simulation. In-house junior and senior doctors from the Department of Vascular Surgery have the monthly opportunity to perform simulation-based training. Courses for all state hospitals are planned twice per year.

Conclusion

Simulation-based training is a safe, efficient, and well-manageable possibility for improving the education of future experts in open vascular surgery. It can help hone simple skills such as suture techniques as well as prepare for complex surgical procedures. In time we hope to further integrate simulation-based training in the existing curriculum.

Validity Evidence for Vascular Skills Assessment: The Feasibility of Fundamentals of Vascular Surgery in General Surgery Residency

OBJECTIVE

As the Fundamentals of Laparoscopic Surgery (FLS) and Fundamentals of Endoscopic Surgery (FES) have been used for general surgery assessment, the Fundamentals of Vascular Surgery (FVS) has recently been developed to evaluate core operative skills for vascular trainees. This study examines the 3 year implementation of FVS for general surgery residents and it gathers validity evidence using Messick's framework. We hypothesized that the curriculum and assessment tool enhance general surgery resident training and assessment.

DESIGN

This is a retrospective review of FVS assessments of residents using descriptive and multivariate analyses.

SETTING

This study was conducted at an academic institution, where simulation-based teaching sessions occur in coordination between the general surgery and the integrated vascular surgery residency programs.

PARTICIPANTS

Seventeen general surgery residents were assessed in FVS skills by an expert rater from 2018 to 2020.

RESULTS

Overall, 86 assessments were completed.

CONTENT

Assessment focuses on 3 open vascular skills (End-to-Side Anastomosis, Patch Angioplasty and Clockface Suturing). Response Process: 7 items comprise a graded rating for a skills score. Additionally, a global summary score is designated. Internal Structure: The assessment tool has a Cronbach's alpha of 0.87, demonstrating good internal consistency. Addition of the second rater correlated with Cohen's kappa -0.69 (p < 0.001), indicating poor interrater reliability. Relationships to other variables: The most significant improvement occurred in total scores between PGY2s (17.4 ± 2.37) and PGY4s (23.2 ± 3.00), p < 0.001, indicating adequate level discernment.

CONCLUSIONS

The validity evidence of FVS assessment in this study supports its use in general surgery residency at a time when opportunities for open vascular skills assessment may be decreasing due to case availability and shifting paradigms. Further study into quality rater training is needed to optimize national implementation of FVS and ensure consistency in grading.