Achieving Consensus to Define Curricular Content for Simulation Based Education in Vascular Surgery: A Europe Wide Needs Assessment Initiative

The Impact of Simulator Training of Vascular Anastomosis and Video Assessment for Surgical Residents

BACKGROUND

The rapid increase of minimally invasive surgery and the shortened training period for surgical residents has resulted in limited opportunities to acquire proficiency in open surgical techniques, such as vascular anastomosis. However, vascular anastomosis remains an essential skill in every surgery for bleeding control. This study aimed to validate the effectiveness of surgical education model for vascular anastomosis and assess the impact on the comprehension, skill, and confidence of surgical residents in performing vascular anastomosis.

METHODS

A total of 21 surgical residents with first to third years of experience at Seoul National University Hospital participated in a 4-week vascular anastomosis training program. The program included an educational lecture and the performance of an end-to-side anastomosis on a procedural model, with evaluations being conducted using the Objective Structured Assessment of Technical Skills (OSATS) and the End-Product Rating Score (EPRS) in pretraining and posttraining surveys.

RESULTS

Significant improvement was observed in the OSATS score (from 9.22 ± 2.4 in week 1 to 12.87 ± 3.1 in week 4; P < 0.001) and the EPRS score (from 12.47 ± 4.1 in week 1 to 17.57 ± 2.2 in week 4; P < 0.001). Additionally, the surgical performance time significantly decreased from 20.99 ± 4.6 min to 16.33 ± 4.2 min (P = 0.019) CONCLUSIONS: Simulator training of in vitro vascular anastomosis, when accompanied by expert-led instruction, can effectively enhance the surgical proficiency, confidence, and overall surgical outcomes of residents, as inferred from the observed improvements in OSATS and EPRS scores. The results suggest that integration of this training model into surgical curricula could be a promising strategy for enhancing vascular surgical training.

Simulation Training in Vascular and Endovascular Surgery: A Nationwide Survey Among Surgeon Educators and Trainees in France

BACKGROUND

Vascular surgical training is evolving towards simulation-based methods to enhance skill development, ensure patient safety, and adapt to changing regulations. This study aims to investigate the utilization of simulation training among vascular surgeons in France, amidst ongoing shifts in teaching approaches and educational reforms.

METHODS

A national survey assessed the experiences and perceptions of vascular surgery professionals regarding simulation training. Participation was open to self-reported health professionals specialized (or specializing) in vascular surgery, including interns or fellows. Participants were recruited through various channels, and data were collected via a questionnaire covering participant characteristics, simulation experiences, and perceptions.

RESULTS

Seventy-six participants, predominantly male (74%) took part in the survey. While 58% reported access to simulation laboratories, only 17% had organized simulation sessions 1-3 times a year, and 5% had sessions more than 10 times annually. High fidelity simulators were available in 57% of institutions, while low fidelity simulators were available in 50%. Regarding funding, 20% received financial assistance for training, predominantly from industry (18%). One-third of the participants experienced 9 or more sessions (34%), lasting between 1 and 2 hours (34%), 30% expressed satisfaction with access to simulation, while 33% were dissatisfied with communication of simulation training opportunities.

CONCLUSIONS

Despite recognizing the benefits of simulation training, its integration into vascular surgery education in France remains incomplete. Challenges such as limited access and communication barriers hinder widespread adoption. Collaborative efforts are needed to ensure uniformity and enhance the effectiveness of simulation training in vascular surgery education.

From Emergency Room to Operating Room: Multidisciplinary Simulation Training in Emergency Laparotomy for Ruptured Abdominal Aortic Aneurysm - Learning Outcomes and Costs

BACKGROUND

Opportunities to practice emergency laparotomy (EL) and open surgical repair (OSR) for a ruptured abdominal aortic aneurysm (rAAA) are limited. While simulation-based training (SBT) is effective in educating healthcare professionals in medical emergencies, SBT specifically in EL and OSR for rAAA is scarce. It takes a team to diagnose a patient with massive abdominal bleeding, such as in rAAA, to organize primary care, and to provide definite treatment without unnecessary delays. This study investigated the effects of multidisciplinary EL simulation training in OSR for rAAA, from the emergency room (ER) to the operating room (OR), on trainees' learning outcomes and the costs of the training.

METHODS

A total of 162 healthcare professionals in 21 simulated emergency laparotomy teams participated in a structured 2-hour course consisting of an introductory lecture and a simulation scenario followed by debriefing. Data were collected using a pre-post self-assessment questionnaire and the T-NOTECHS scale. Implementation costs and the cost of education were calculated.

RESULTS

Simulation training improved knowledge, skills, and attitudes of both physicians and nurses. Most of the non-technical skills studied were significantly enhanced in both professional groups. The total cost of the simulation training was €29 415, cost per team €1,400 and cost per participant €182.

CONCLUSIONS

Multidisciplinary EL simulation training in OSR for rAAA from the ER to the OR is effective in improving knowledge, skills, and attitudes, as well as non-technical skills among both physicians and nurses. The overall costs of training seem reasonable given the significant learning outcomes.

REPAIRS Delphi: A UK and Ireland Consensus Statement on the Management of Infected Arterial Pseudoaneurysms Secondary to Groin Injecting Drug Use

OBJECTIVE

Consensus guidelines on the optimal management of infected arterial pseudoaneurysms secondary to groin injecting drug use are lacking. This pathology is a problem in the UK and globally, yet operative management options remain contentious. This study was designed to establish consensus to promote better management of these patients, drawing on the expert experience of those in a location with a high prevalence of illicit drug use.

METHODS

A three round modified Delphi was undertaken, systematically surveying consultant vascular surgeons in the UK and Ireland using an online platform. Seventy five vascular surgery units were invited to participate, with one consultant providing the unit consensus practice. Round one responses were thematically analysed to generate statements for round two. These statements were evaluated by participants using a five point Likert scale. Consensus was achieved at a threshold of 70% or more agreement or disagreement. Those statements not reaching consensus were assessed and modified for round three. The results of the Delphi process constituted the consensus statement.

RESULTS

Round one received 64 (86%) responses, round two 59 (79%) responses, and round three 62 (83%) responses; 73 (97%) of 75 units contributed. Round two comprised 150 statements and round three 24 statements. Ninety one statements achieved consensus agreement and 15 consensus disagreement. The Delphi statements covered sequential management of these patients from diagnosis and imaging, antibiotics and microbiology, surgical approach, wound management, follow up, and additional considerations. Pre-operative imaging achieved consensus agreement (97%), with computed tomography angiography being the modality of choice (97%). Ligation and debridement without arterial reconstruction was the preferred approach at initial surgical intervention (89%). Multidisciplinary management, ensuring holistic care and access to substance use services, also gained consensus agreement.

CONCLUSION

This comprehensive consensus statement provides a strong insight into the standard of care for these patients.

Certification of Basic Skills in Endovascular Aortic Repair Through a Modular Simulation Course With Real Time Performance Assessment

OBJECTIVE

Endovascular aortic repair (EVAR) is being used increasingly for the treatment of infrarenal abdominal aortic aneurysms. Improvement in educational strategies is required to teach future vascular surgeons EVAR skills, but a comprehensive, pre-defined e-learning and simulation curriculum remains to be developed and tested. EndoVascular Aortic Repair Assessment of Technical Expertise (EVARATE), an assessment tool for simulation based education (SBE) in EVAR, has previously been designed to assess EVAR skills, and a pass limit defining mastery level has been set. However, EVARATE was developed for anonymous video ratings in a research setting, and its feasibility for real time ratings in a standardised SBE programme in EVAR is unproven. This study aimed to test the effect of a newly developed simulation based modular course in EVAR. In addition, the applicability of EVARATE for real time performance assessments was investigated.

METHODS

The European Society of Vascular Surgery (ESVS) and Copenhagen Certification Programme in EVAR (ENHANCE-EVAR) was tested in a prospective cohort study. ENHANCE-EVAR is a modular SBE programme in EVAR consisting of e-learning and hands-on SBE. Participants were rated with the EVARATE tool by experienced EVAR surgeons.

RESULTS

Twenty-four physicians completed the study. The mean improvement in EVARATE score during the course was +11.8 (95% confidence interval 9.8 - 13.7) points (p < .001). Twenty-two participants (92%) passed with a mean number of 2.8 ± 0.7 test attempts to reach the pass limit. Cronbach's alpha coefficient was 0.91, corresponding to excellent reliability of the EVARATE scale. Differences between instructors' EVARATE ratings were insignificant (p = .16), with a maximum variation between instructors of ± 1.3 points.

CONCLUSION

ENHANCE-EVAR, a comprehensive certifying EVAR course, was proven to be effective. EndoVascular Aortic Repair Assessment of Technical Expertise (EVARATE) is a trustworthy tool for assessing performance within an authentic educational setting, enabling real time feedback.

Technical Skills Curriculum in Neonatology: A Modified European Delphi Study

INTRODUCTION

Simulation-based training (SBT) aids healthcare providers in acquiring the technical skills necessary to improve patient outcomes and safety. However, since SBT may require significant resources, training all skills to a comparable extent is impractical. Hence, a strategic prioritization of technical skills is necessary. While the European Training Requirements in Neonatology provide guidance on necessary skills, they lack prioritization. We aimed to identify and prioritize technical skills for a SBT curriculum in neonatology.

METHODS

A three-round modified Delphi process of expert neonatologists and neonatal trainees was performed. In round one, the participants listed all the technical skills newly trained neonatologists should master. The content analysis excluded duplicates and non-technical skills. In round two, the Copenhagen Academy for Medical Education and Simulation Needs Assessment Formula (CAMES-NAF) was used to preliminarily prioritize the technical skills according to frequency, importance of competency, SBT impact on patient safety, and feasibility for SBT. In round three, the participants further refined and reprioritized the technical skills. Items achieving consensus (agreement of ≥75%) were included.

RESULTS

We included 168 participants from 10 European countries. The response rates in rounds two and three were 80% (135/168) and 87% (117/135), respectively. In round one, the participants suggested 1964 different items. Content analysis revealed 81 unique technical skills prioritized in round two. In round three, 39 technical skills achieved consensus and were included.

CONCLUSION

We reached a European consensus on a prioritized list of 39 technical skills to be included in a SBT curriculum in neonatology.

Editor's Choice -- European Society for Vascular Surgery (ESVS) 2024 Clinical Practice Guidelines on the Management of Abdominal Aorto-Iliac Artery Aneurysms

OBJECTIVE

The European Society for Vascular Surgery (ESVS) has developed clinical practice guidelines for the care of patients with aneurysms of the abdominal aorta and iliac arteries in succession to the 2011 and 2019 versions, with the aim of assisting physicians and patients in selecting the best management strategy.

METHODS

The guideline is based on scientific evidence completed with expert opinion on the matter. By summarising and evaluating the best available evidence, recommendations for the evaluation and treatment of patients have been formulated. The recommendations are graded according to a modified European Society of Cardiology grading system, where the strength (class) of each recommendation is graded from I to III and the letters A to C mark the level of evidence.

RESULTS

A total of 160 recommendations have been issued on the following topics: Service standards, including surgical volume and training; Epidemiology, diagnosis, and screening; Management of patients with small abdominal aortic aneurysm (AAA), including surveillance, cardiovascular risk reduction, and indication for repair; Elective AAA repair, including operative risk assessment, open and endovascular repair, and early complications; Ruptured and symptomatic AAA, including peri-operative management, such as permissive hypotension and use of aortic occlusion balloon, open and endovascular repair, and early complications, such as abdominal compartment syndrome and colonic ischaemia; Long term outcome and follow up after AAA repair, including graft infection, endoleaks and follow up routines; Management of complex AAA, including open and endovascular repair; Management of iliac artery aneurysm, including indication for repair and open and endovascular repair; and Miscellaneous aortic problems, including mycotic, inflammatory, and saccular aortic aneurysm. In addition, Shared decision making is being addressed, with supporting information for patients, and Unresolved issues are discussed.

CONCLUSION

The ESVS Clinical Practice Guidelines provide the most comprehensive, up to date, and unbiased advice to clinicians and patients on the management of abdominal aorto-iliac artery aneurysms.

Massed Training is Logistically Superior to Distributed Training in Acquiring Basic Endovascular Skills

OBJECTIVE

A "PROficiency based StePwise Endovascular Curricular Training" (PROSPECT) has proven its superiority over traditional training in a randomised controlled trial to acquire basic endovascular skills outside theatre, but real life adherence is low. This study aimed to compare the original distributed training format, where trainees learn at their own pace, with a massed training format offering the same content within a limited time span while exempt from clinical duties. Secondly, long term skills retention was evaluated.

METHODS

A multicentre, prospective study allocated participants to the distributed D-PROSPECT or to a massed, compact version (C-PROSPECT) based on logistics such as travel time, participant and instructor availability. A multiple choice question (MCQ) test (max. score 20) tested cognitive skills. Technical skills were assessed using a global rating scale (GRS) (max. score 55), examiner's checklist (max. score 85), and validated simulator metrics. Data were collected pre- and post-programme and at three, six, and 12 months after programme completion.

RESULTS

Over four years and in two countries, D-PROSPECT was implemented in two centres and C-PROSPECT in three. A total of 22 participants completed D-PROSPECT with a 41% dropout rate, and 21 completed C-PROSPECT with 0% dropout rate. All participants showed significant improvement for all performance parameters after programme completion: MCQ test (median 14.5 vs. 18; p < .001), GRS (median 20 vs. 41; p < .001), examiner's checklist (median 49 vs. 78.5; p < .001), and simulation metrics (p < .001). Scores of C- or D-PROSPECT participants were not significantly different. No significant differences were seen between groups during the retention period.

CONCLUSION

PROSPECT significantly improves the quality of simulated endovascular performances using a massed or distributed training format. A massed training format of PROSPECT may be preferred to decrease dropout during standardised training to obtain basic endovascular skills in existing surgical curricula.

Facilitators and Barriers to Implementation of Simulation Based Education in Vascular Surgery in Europe

OBJECTIVE

This study explored the status and availability of simulation based education (SBE) for learning vascular surgical procedures identified in the 2019 General Needs Assessment in vascular surgery in Europe (GNA-2019) and identified facilitators and barriers to SBE implementation in vascular surgery.

METHODS

A three round iterative survey was distributed via the European Society for Vascular Surgery and the Union Européenne des Médecins Spécialistes. Members from leading committees and organisations within the European vascular surgical community were invited to participate as key opinion leaders (KOLs). Three online survey rounds explored demographics, SBE availability, and facilitators and barriers to SBE implementation.

RESULTS

Overall, 147 KOLs (target population 338) accepted invitation to round 1, representing 30 European countries. The dropout rates for rounds 2 and 3 were 29% and 40%, respectively. Most respondents (88%) were senior, consultant level or higher. No mandatory SBE training was required in their department before training on patients, according to 84% of the KOLs. There was high consensus on the need for structured SBE (87%) and mandatory SBE (81%). SBE is available for the top three prioritised procedures in GNA-2019 (basic open skills, basic endovascular skills, and vascular imaging interpretation) in 24, 23, and 20 of the 30 represented European countries, respectively. The highest ranking facilitators were structured SBE programmes, availability of simulation equipment locally and regionally, good quality simulators, and having a dedicated person running the SBE. The highest ranked barriers were lack of structured SBE curriculum, equipment costs, lack of SBE culture, no or limited dedicated time for faculty to teach in SBE, and clinical work overload.

CONCLUSION

Based largely on the opinions of KOLs in vascular surgery in Europe, this study revealed that SBE is needed in vascular surgery training and that systematic and structured programmes are required to ensure successful implementation.

A National Needs Assessment in Simulation Based Training in Vascular Surgery

OBJECTIVES

The aim of this research was to ascertain the highest need areas for vascular simulation, in order to tailor training for the highest impact.

DESIGN, PARTICIPANTS AND SETTING

A needs assessment was conducted according to best practices using the Delphi method. All consultant vascular surgeons/trainers in the training jurisdiction (n=33) were approached through an independent intermediary to contribute and generate a prioritized list of procedures for training. The research team were blinded to participant identities. Three rounds were conducted according to the Delphi process and scored according to the Copenhagen Needs Assessment Formula (CAMES-NAF).

RESULTS

A final list of 34 vascular procedures was selected and prioritized by surgical trainers. Principles of arterial repair and endarterectomy/patching were considered the highest priority. Complex major interventions such as open abdominal aortic aneurysm (AAA) repair, carotid endarterectomy, and endovascular aortic repair (EVAR) consistently ranked higher than rarer, such as first rib resection and more basic procedures, such as foam injection for varicose veins. Major lower limb amputations typically ranked lower overall compared to arterial interventions. Surgical trainers generally agreed with the ranking according to the CAMES-NAF. There was some disagreement for a select few procedures such as iliac stenting (which rose 13 places) and open radial artery exposure (which fell 6 places) on subsequent iterations.

CONCLUSIONS

Core operative principles and common major operative cases should remain the priority for vascular technical skills training. Other procedures which may be less invasive, but have the potential for major complications should also not be overlooked. In designing simulators the main focus should center on specific skill acquisition for commonly performed major procedures and management of the recognized potential complications. Lower limb amputations are considered adequately taught in clinical practice, or are too challenging to simulate in simulator models apart from cadaveric models.

Exploring training needs of newly graduated medical doctors to inform the undergraduate simulation-based curriculum: a national Delphi consensus study

PURPOSE

Mastering technical procedures is a key component in succeeding as a newly graduated medical doctor and is of critical importance to ensure patient safety. The efficacy of simulation-based education has been demonstrated but medical schools have different requirements for undergraduate curricula. We aimed to identify and prioritize the technical procedures needed by newly graduated medical doctors.

METHODS

We conducted a national needs assessment survey using the Delphi technique to gather consensus from key opinion leaders in the field. In the first round, a brainstorm was conducted to identify all potential technical procedures. In the second round, respondents rated the need for simulation-based training of each procedure using the Copenhagen Academy for Medical Education and Simulation Needs Assessment Formula (CAMES-NAF). The third round was a final elimination and prioritization of the procedures.

RESULTS

In total, 107 experts from 21 specialties answered the first round: 123 unique technical procedures were suggested. Response rates were 58% and 64% in the second and the third round, respectively. In the third round, 104 procedures were eliminated based on the consensus criterion, and the remaining 19 procedures were included and prioritized. The top five procedures were: (i) insert peripheral intravenous catheter, (ii) put on personal protection equipment, (iii) perform basic airway maneuvers, (iv) perform basic life support, and (v) perform radial artery puncture.

CONCLUSION

Based on the Delphi process a final list of 19 technical procedures reached expert consensus to be included in the undergraduate curriculum for simulation-based education.

A Bi-national needs assessment to identify and prioritise procedures in paediatric surgery for simulation-based training

BACKGROUND

Simulation-based education (SBE) has led to significant changes in healthcare education. However, SBE has often been based on available resources and local expertise rather than a systematic approach to curriculum development. The aim of this study was to perform a bi-national needs assessment to identify and prioritise procedures in a paediatric surgery curriculum that can be supported using SBE.

METHOD

A modified 3-round Delphi technique was used to gather consensus from education leaders and trainees in paediatric surgery in Australia and Aotearoa New Zealand (ANZ). Round 1 identified all procedures a newly specialised paediatric surgeon should be able to perform. In Round 2, each procedure was explored for the need for SBE using the Copenhagen Academy for Medical Education and Simulation (CAMES) Needs-Assessment Formula (NAF). This pre-prioritised list from Round 2 was sent back to participants for final exclusion and ranking in Round 3. Results 88 participants were identified and invited. From 174 procedures identified in Round 1, 71 procedures were grouped and categorised for Round 2 using the CAMES NAF. In Round 3, 17 procedures were eliminated resulting in 54 procedures. Appendicectomy, inguinal herniotomy, and central venous access were the highest rank procedures after prioritisation in Round 3. There was a strong correlation (r = 0.99) between the NAF score and the prioritised ranking, as well as between consultants and trainees (r = 0.92 in Round 2 and 0.98 in Round 3).

CONCLUSION

The prioritised list represents a consensus document decided upon by education leaders and stakeholders in paediatric surgery. These procedures should be an integral part of the SBE of paediatric surgeons in the region.

LEVEL OF EVIDENCE

Level V.

A Systematic Review of Simulation-Based Training in Vascular Surgery

Introduction

Recent advancements in surgical technology, reduced working hours, and training opportunities exacerbated by the COVID-19 pandemic have led to an increase in simulation-based training. Furthermore, a rise in endovascular procedures has led to a requirement for high-fidelity simulators that offer comprehensive feedback. This review aims to identify vascular surgery simulation models and assess their validity and levels of effectiveness (LoE) for each model in order to successfully implement them into current training curricula.

Methods

PubMed and EMBASE were searched on January 1, 2021, for full-text English studies on vascular surgery simulators. Eligible articles were given validity ratings based on Messick’s modern concept of validity alongside an LoE score according to McGaghie’s translational outcomes.

Results

Overall 76 eligible articles validated 34 vascular surgery simulators and training courses for open and endovascular procedures. High validity ratings were achieved across studies for: content (35), response processes (12), the internal structure (5), relations to other variables (57), and consequences (2). Only seven studies achieved an LoE greater than 3/5. Overall, ANGIO Mentor was the most highly validated and effective simulator and was the only simulator to achieve an LoE of 5/5.

Conclusions

Simulation-based training in vascular surgery is a continuously developing field with exciting future prospects, demonstrated by the vast number of models and training courses. To effectively integrate simulation models into current vascular surgery curricula and assessments, there is a need for studies to look at trainee skill retention over a longer period of time. A more detailed discussion on cost-effectiveness is also needed.

Quality improvement: understanding the adoption and diffusion of digital technologies related to surgical performance

Purpose

Quantifying the performance level of surgeons with digital virtual reality (VR) simulators can help ensure that quality requirements in healthcare are met. In order to better understand integration amongst quality principles, practices and technologies in the adoption and diffusion of VR simulators, the authors applied a technological innovation system (TIS) framework. The purpose of this study is to understand how the adoption and diffusion of VR surgical simulators in a Swedish healthcare context is influenced by various system factors.

Design/methodology/approach

In this study, single-case holistic design based on innovation system theory was used to analyse the adoption of digital quality technologies related to surgical performance in Swedish hospitals. The case employs a mixed methods approach triangulating data longitudinally from published documents and expert interviews.

Findings

Adoption of digital technologies regarding surgical performance is restricted by system factors relating to inconsistent normative and regulatory requirements for quantified performance criteria to judge surgical expertise. Addressing these systems' weaknesses with evidence-based training programmes can have a significant impact on the further development of the innovation system and can ultimately affect healthcare reliability and quality.

Originality/value

This paper explores quality management (QM) challenges in the context of digital transformation in healthcare. The paper attempts to fill the gap for TIS studies in a healthcare context and highlight the role of innovation function strength along the value chain and in relation to technology cycles to increase the understanding of adoption of digital technologies relating to surgical performance.

A core curriculum for basic EUS skills: An international consensus using the Delphi methodology

Background and Objectives:

Materials and Methods:

Results:

Conclusions:

International Implementation of a PROficiency based StePwise Endovascular Curricular Training (PROSPECT) in Daily Practice

OBJECTIVE

A randomised controlled trial (RCT) showed superior real life endovascular performance of trainees after PROficiency based StePwise Endovascular Curricular Training (PROSPECT) compared with traditional training. This study aimed to determine whether PROSPECT can be implemented routinely in surgical training (registry) and to identify the associated effects, facilitators, and barriers to implementation.

METHODS

This was a multicentre prospective registry to evaluate real life PROSPECT implementation effects. Cognitive ability was tested with a Multiple Choice Question test (MCQ) (max. score 20 points), while technical skills were assessed with a Global Rating Scale (GRS) (max. score 55 points), Examiner's Checklist (max, score 85 points), and simulator metrics. A cross sectional anonymous survey for both trainees and faculty evaluated the programme's implementation.

RESULTS

The PROSPECT registry was implemented in five centres in four countries over a period of three years. Only 17 of 48 starting trainees completed PROSPECT, resulting in a dropout rate of 65%. Participants who completed the programme showed significant improvement in the GRS (median 26 vs. 44, p = .018) and Examiner's Checklist (median 53.5 vs. 80, p = .028) after the programme. The survey was completed by 13/17 faculty members (76%) and 38/57 trainees who participated either in the initial PROSPECT RCT or the registry (67%). PROSPECT was perceived to provide more endovascular training opportunities, but non-availability of logistical/technical support, lack of training time within the working schedule, and little trainee motivation hindered broad implementation.

CONCLUSION

PROSPECT has a significant effect on performance, and trainees and faculty agree that PROSPECT is a valuable addition to surgical training. However, external and internal factors pose significant barriers to integration of this simulation based programme into daily practice leading to a high dropout rate. To integrate PROSPECT into contemporary surgical training, it should be a prerequisite to treating real patients and protected training time should be provided, combined with accessible support.

Identifying curriculum content for a cross-specialty robotic-assisted surgery training program: a Delphi study

BACKGROUND

Robotic-assisted surgery is increasing and there is a need for a structured and evidence-based curriculum to learn basic robotic competencies. Relevant training tasks, eligible trainees, realistic learning goals, and suitable training methods must be identified. We sought to develop a common curriculum that can ensure basic competencies across specialties.

METHODS

Two robotic surgeons from all departments in Denmark conducting robotic-assisted surgery within gynecology, urology, and gastrointestinal surgery, were invited to participate in a three-round Delphi study to identify learning goals and rank them according to relevance for a basic curriculum. An additional survey was conducted after the Delphi rounds on what training methods were considered best for each learning goal and who (console surgeon/patient-side assistant) should master each learning goal.

RESULTS

Fifty-six robotic surgeons participated and the response rates were 86%, 89%, and 77%, for rounds 1, 2 and 3, respectively. The Delphi study identified 40 potential learning goals, of which 29 were ranked as essential, e.g., Understand the link between arm placement and freedom of movement or Be able to perform emergency un-docking. In the additional survey, the response rate was 70%. Twenty-two (55%) of the identified learning goals were found relevant for the patient-side assistant and twenty-four (60%) were linked to a specific suitable learning method with > 75% agreement.

CONCLUSIONS

Our findings can help training centers plan their training programs concerning educational content and methods for training/learning. Furthermore, patient-side assistants should also receive basic skills training in robotic surgery.

Adequate emergency department resource usage: Applying simulation-based workshop to improve teaching competence among elementary and junior high school teachers in Taiwan

INTRODUCTION

More than 80% of patients who visited Emergency Department (ED) was not urgent in Taiwan in 2019. It causes insufficient medical services and a latent fiscal threat to the Nation Health Insurance (NHI). This study adopted simulation-based educating modules to explore the effect in teaching competence among primary and middle school teachers for efficient AEDRU (adequate emergency department resource usage) education in the future.

METHOD

The subjects were 414 elementary and junior high school teachers in Taiwan. 214 participants attended the simulation-based workshop as the simulation-based group, whereas 200 participants took an online self-learning module as the self-learning group. The workshop was created by an expert panel for decreasing the unnecessary usage amount of ED medial resources. The materials are lecture, board games, miniature ED modules, and simulation-based scenarios. A teaching competence questionnaire including ED knowledge, teaching attitude, teaching skills, and teaching self-efficacy was conducted among participants before and after the intervention. Data were analyzed via McNemar, paired t test and the generalized estimating equations (GEE).

RESULTS

The study showed that teachers who participated in the simulation-based workshop had improved more in teaching competence than those who received the online self-learning module. In addition, there were significant differences between the pre-test and post-test among the two groups in teaching competence.

CONCLUSION

The simulation-based workshop is effective and it should be spread out. When students know how to use ED medical resources properly, they could affect their families. It can help the ED service to be used properly and benefits the finance of the NHI. The health care cost will be managed while also improving health.

Identifying technical skills and clinical procedures in surgery for a simulation-based curriculum: a national general needs assessment

BACKGROUND

The efficacy of simulation-based training in surgical education is well known. However, the development of training programs should start with problem identification and a general needs assessment to ensure that the content is aligned with current surgical trainee needs. The objective of the present study is to identify the technical skills and clinical procedures that should be included in a simulation-based curriculum in general surgery.

METHODS

A national, three-round Delphi process was conducted to achieve consensus on which technical skills and clinical procedures should be included in a simulation-based curriculum in general surgery. In total, 87 key opinion leaders were identified and invited to the study.

RESULTS

Round 1 of the Delphi process had a response rate of 64% (56/87) and a total of 245 suggestions. Based on these suggestions, a consolidated list of 51 technical skills or clinical procedures was made. The response rate in Delphi round 2 was 62% (54/87) resulting in a pre-prioritized order of procedures for round 3. The response rate in Delphi round 3 was 65% (35/54). The final list included 13 technical skills and clinical procedures. Training was predominantly requested within general open surgical skills, laparoscopic skills, and endoscopic skills, and a few specific procedures such as appendectomy and cholecystectomy were included in the final prioritized list.

CONCLUSION

Based on the Delphi process 13 technical skills and clinical procedures were included in the final prioritized list, which can serve as a point of departure when developing simulation-based training in surgery.

Simulation Based Training and Assessment in Open Vascular Surgery: A Systematic Review

OBJECTIVE

The aim of this study was to systematically review the literature and give evidence based recommendations for future initiatives for simulation based training (SBT) and assessment in open vascular surgery.

DATA SOURCES

PubMed, Embase, and the Cochrane Library.

REVIEW METHODS

A systematic review of PubMed, Embase, and the Cochrane Library was performed, with the last search on 31 March 2020, to identify studies describing SBT and assessment in open vascular surgery. Kirkpatrick's levels for efficacy of training were evaluated. Validity evidence for assessment tools was evaluated according to the recommended contemporary framework by Messick.

RESULTS

Of 2 844 studies, 51 were included for data extraction. A high degree of heterogeneity in reporting standards and varying types of simulation was found. Vascular anastomosis was the most frequently simulated technical skill (43%). Assessment was mostly carried out using the Objective Structured Assessment of Technical Skills (55%). Validity evidence for assessment tools was found using outdated frameworks, and only one study used Messick's framework. Self directed training is valuable, the low trainer to trainee ratio is important to maximise efficiency, and experienced vascular surgeons are the most effective trainers.

CONCLUSION

Carefully designed and structured SBT is effective and can improve technical skills, especially in less experienced trainees. However, the supporting evidence lacks homogeneity in the reporting standards and types of simulations. Pass/fail standards that support proficiency based learning and studies investigating skills transfer should be the focus in future studies. Validity evidence of assessment tools needs to be addressed using contemporary frameworks.

Definition of Proficiency Level by a Virtual Simulator as a First Step Toward a Curriculum on Fundamental Skills for Endovascular Aneurysm Repair (EVAR)

OBJECTIVE

At present, there is no proficiency-based curriculum for endovascular treatment of aortic aneurysm repair (EVAR) using virtual reality (VR) surgical simulators, whereas such curricula are available for the treatment of iliac and/or superficial femoral artery disease. The purpose of this work was to compute proficiency, defined by a benchmark level determined by the performance of experts, using a commercial VR simulator as a first step of a curriculum on EVAR.

MATERIALS AND METHODS

Expert endovascular surgeons (with more than 150 EVAR cases as first operators) from 12 major Italian centers completed three cases of EVAR of increasing difficulty level 3 times each, using the Angio Mentor simulator (by Simbionix) and Gore devices. Proficiency level was based on performance of expert surgeons, as assessed by metrics from a VR simulator.

RESULTS

The participating surgeons had a median of 20 years of experience and executed a median of 440 EVAR. For the 3 simulated cases, the following proficiency values were respectively obtained: total procedure time: 22 minutes 32 seconds, 23 minutes 05 seconds, and 20 minutes 32 seconds; total amount of contrast injected: 85.16 mL, 89.97 mL, and 98.01 mL total fluoroscopy time: 10 minutes 39 seconds, 12 minutes 22 seconds, and 10 minutes 17 seconds; time to contralateral gate cannulation: 5 minutes 51 seconds, 7 minutes 09 seconds, and 3 minutes 32 seconds.

CONCLUSIONS

We computed proficiency levels for 3 simulated cases of EVAR using a VR simulator. Our next step is to determine whether surgical residents can reach this level. Translational research will then be required to assess the impact of such training on real patients.

Learning Curves and Competences of Vascular Trainees Performing Open Aortic Repair in a Simulation-Based Environment

BACKGROUND

The aim of this study was to analyze learning curves and competency gains of novice vascular trainees when performing open aortic repair in a simulation-based environment.

METHODS

This was a prospective study of 16 vascular trainees performing infrarenal open aortic repair on an inanimate abdominal aortic aneurysm simulator with pulsatile pressure and flow. Each participant performed 4 procedures as a primary surgeon while getting structured feedback by a supervising experienced vascular surgeon. All sessions were video recorded and were anonymously and independently assessed by 3 rater-trained experts on an online platform using the newly validated open abdominal aortic aneurysm repair of technical expertise assessment tool. All supervisor interferences and procedure time was noted.

RESULTS

Reliability between raters was excellent (intraclass correlation coefficient = 0.92). Participants' mean scores almost doubled during the course between the first (13.4, 95% confidence interval [CI], 6.8-20) and fourth session (29.8, 95% CI, 26.3-33.3) with a mean difference of 14.6 (P < 0.001). Supervisor interference also decreased significantly from mean 3.0 (95% CI, 1.5-3.6) in the first to 0.7 (95% CI, 0.4-1.0) in the fourth session (P = 0.004). Procedure time decreased with a mean of 24 minutes: from 81 min (95% CI, 71.8-90.3) to 57 min (95% CI, 51.1-63.2, P < 0.001). There was a significant negative correlation between procedure time and the Open Abdominal Aortic Aneurysm Repair of Technical Expertise score (Pearson's r = -0.72, P < 0.01). Only half of the participants passed the pass/fail score of 27.7 points during the course.

CONCLUSIONS

Novice vascular trainees achieve skills and competencies in open aortic repair in a simulated setting with dedicated supervision and feedback and can become ready for supervised surgery on real patients. Learning rates are individual, and it is important to construct training programs with emphasis on proficiency and not merely attending a course.

European Society for Vascular Surgery (ESVS) Certification of Theoretical and Practical Competences in Basic Vascular Ultrasound: Validity Investigation of the Assessment Tools

OBJECTIVE

The aim of this study was to gather validity evidence for the Assessment of basic Vascular Ultrasound Expertise (AVAUSE) tool, and to establish a pass/fail score for each component, to support decisions for certification.

METHODS

A cross sectional validation study performed during the European Society for Vascular Surgery's annual meeting. Validity evidence was sought for the theoretical test and two practical tests based on Messick's framework. The participants were vascular surgeons, vascular surgical trainees, sonographers, and nurses with varying experience levels. Five vascular ultrasound experts developed the theoretical and two practical test components of the AVAUSE tool for each test component. Two stations were set up for carotid examinations and two for superficial venous incompetence (SVI) examinations. Eight raters were assigned in pairs to each station. Three methods were used to set pass/fail scores: contrasting groups' method; rater consensus; and extended Angoff.

RESULTS

Nineteen participants were enrolled. Acceptable internal consistency reliability (Cronbach's alpha) for the AVAUSE theoretical (0.93), carotid (0.84), and SVI (0.65) practical test were shown. In the carotid examination, inter-rater reliability (IRR) for the two rater pairs was good: 0.68 and 0.78, respectively. The carotid scores correlated significantly with years of experience (Pearson's r = 0.56, p = .013) but not with number of examinations in the last five years. For SVI, IRR was excellent at 0.81 and 0.87. SVI performance scores did not correlate with years of experience and number of examinations. The pass/fail score set by the contrasting groups' method was 29 points out of 50. The rater set pass/fail scores were 3.0 points for both carotid and SVI examinations and were used to determine successful participants. Ten of 19 participants passed the tests and were certified.

CONCLUSION

Validity evidence was sought and established for the AVAUSE comprehensive tool, including pass/fail standards. AVAUSE can be used to assess competences in basic vascular ultrasound, allowing operators to progress towards independent practice.

Learn EVAR sizing from scratch: The results of a one-day intensive course in EVAR sizing and stent graft selection for vascular trainees

Background and aim

Recognition of structured training in endovascular aortic repair (EVAR) for vascular trainees is increasing. Nevertheless, how trainees can achieve sufficient skills in EVAR sizing and graft selection is sparsely described. The aim of this study was to investigate the effect of systematic training in basic EVAR sizing and graft selection on vascular surgery trainees using a validated assessment tool.

Methods

Sixteen vascular surgery trainees were included in an intensive 6-h hands-on workshop in aortic sizing and stent graft selection for EVAR with a trainer-to-trainee ratio of 1:2. After 1-h lecture, participants did 5 h of supervised training on increasingly complex cases. Finally, the participants were tested using a validated assessment tool.

Results

All participants were able to size the test-case and select a stent graft combination in 24:35 (13:30–48:20) min (median and range). The participants’ overall test scores (lower is better) were in median 17.9 (11.9–28.4). This did not differ from the scores of experienced EVAR operators 14.7 (11.7–25.2) (<200 EVAR’s) ( p = .32) but was inferior to the score of EVAR experts 11.2 (9.8 –18.7) (≥200 EVAR’s) ( p = .01). The sub-score for anatomical measurements was 10.6 (3.9–18.8) and comparable with the experienced group 9.7 (8.1–12.8) ( p = .83) but inferior to the expert operators 6.5 (5.2–10.2) ( p = .04). The sub-score for stent graft selection was 7.5 (4.9–14.1) and comparable with experienced operators scoring 4.5 (3.6–12.3) ( p = .09) but inferior to the expert operators score of 5.0 (3.6–8.4) ( p = .01).

Conclusion

This study presents the results of a standardised one-day basic EVAR sizing and graft selection workshop. Vascular surgery trainees with no prior EVAR experience learned to size and select stent grafts for a simple infra-renal AAA on par with experienced EVAR operators.

Ensuring Competency in Open Aortic Aneurysm Repair - Development and Validation of a New Assessment Tool

OBJECTIVE

The aims of this study were to develop a procedure specific assessment tool for open abdominal aortic aneurysm (AAA) repair, gather validity evidence for the tool and establish a pass/fail standard.

METHODS

Validity was studied based on the contemporary framework by Messick. Three vascular surgeons experienced in open AAA repair and an expert in assessment and validation within medical education developed the OPEn aortic aneurysm Repair Assessment of Technical Expertise (OPERATE) tool. Vascular surgeons with varying experiences performed open AAA repair in a standardised simulation based setting. All procedures were video recorded with the faces anonymised and scored independently by three experts in a mutual blinded setup. The Angoff standard setting method was used to establish a credible pass/fail score.

RESULTS

Sixteen novices and nine experienced open vascular surgeons were enrolled. The OPERATE tool achieved high internal consistency (Cronbach's alpha .92) and inter-rater reliability (Cronbach's alpha .95) and was able to differentiate novices and experienced surgeons with mean scores (higher score is better) of 13.4 ± 12 and 25.6 ± 6, respectively (p = .01). The pass/fail score was set high (27.7). One novice passed the test while six experienced surgeons failed.

CONCLUSION

Validity evidence was established for the newly developed OPERATE tool and was able to differentiate between novices and experienced surgeons providing a good argument that this tool can be used for both formative and summative assessment in a simulation based environment. The high pass/fail score emphasises the need for novices to train in a simulation based environment up to a certain level of competency before apprenticeship training in the clinical environment under the tutelage of a supervisor. Familiarisation with the simulation equipment must be ensured before performance is assessed as reflected by the low scores in the experienced group's first attempt.