A National Needs Assessment to Identify Technical Procedures in Vascular Surgery for Simulation Based Training

Pilot Study to Improve Resident Experience on Vascular Surgery by Standardizing Dissemination of Operative Steps

OBJECTIVE

Many surgical residencies have passed along attendings preferences and procedural knowledge as a highly utilized but informal resource. The objective was to assess the effect of providing operative steps and attending preferences on surgical resident performance.

DESIGN

This was a prospective observational study with a survey-based design.

SETTING

We created and shared vascular surgery operative steps including institutional and attending preferences with junior residents at the Massachusetts General Hospital.

PARTICIPANTS

There were a total of 31 residents who completed a survey to assess self-perception of performance in operative knowledge and Accreditation Council for Graduate Medical Education (ACGME) Milestone criteria.

RESULTS

Advice from colleagues was the most utilized resource, followed by web-based materials. Of the web-based materials, almost all residents utilized Google searches over other web-based resources designed to specifically help surgical trainees. The vascular surgery resource was used by 90% of residents more than 3 times per week to prepare for operative cases. There was significant improvement in patient positioning, instrument selection, operative field exposure, anatomy, sequence of procedure, procedure choices, and peri-operative care knowledge.

CONCLUSIONS

Development of institutional resources that specifically capture attending surgeon procedural variations can improve resident performance, encourage resident autonomy, and provide a catalog of approaches to challenging operative situations.

Surgical simulation of hypospadias repair - High-fidelity, reproducible and affordable animal tissue model

INTRODUCTION

Teaching methods in hypospadias repair are still traditional. Available simulators often lack authenticity in terms of haptic feedback and realistic tissue handling.

OBJECTIVE

Our aim was to develop a high-fidelity, easily reproducible, and affordable animal tissue model for the advanced surgical simulation of hypospadias repair with realistic haptic feedback and tissue handling.

MATERIAL AND METHODS

A regular-sized chicken leg and a lamb tenderloin are used to assess the feasibility of simulating hypospadias correction by using the example of a Snodgrass Tubularized Incised Plate-Repair. The model preparation is incorporated into the training process.

RESULTS

A detailed description of the high-fidelity model is provided. All steps of a hypospadias repair can be trained while providing realistic anatomy, adequate size, and multilayer tissue properties. Haptic conditions highly resemble human tissue properties. Fine tissue handling corresponds to intraoperative conditions. Limitations to this surgical model apply as in other animal tissue models.

CONCLUSION

We developed a high-fidelity, easily reproducible, and affordable hypospadias animal tissue model. Due to the multilayer animal tissue properties, this model provides realistic haptic feedback and thus an inexpensive and reproducible model for hypospadias simulation. External validation is mandatory prior to implementation into urological training.

Systematic Review on the Use of 3D-Printed Models for Planning, Training and Simulation in Vascular Surgery

The use of 3D-printed models in simulation-based training and planning for vascular surgery is gaining interest. This study aims to provide an overview of the current applications of 3D-printing technologies in vascular surgery. We performed a systematic review by searching four databases: PubMed, Web of Science, Scopus, and Cochrane Library (last search: 1 March 2024). We included studies considering the treatment of vascular stenotic/occlusive or aneurysmal diseases. We included papers that reported the outcome of applications of 3D-printed models, excluding case reports or very limited case series (≤5 printed models or tests/simulations). Finally, 22 studies were included and analyzed. Computed tomography angiography (CTA) was the primary diagnostic method used to obtain the images serving as the basis for generating the 3D-printed models. Processing the CTA data involved the use of medical imaging software; 3DSlicer (Brigham and Women's Hospital, Harvard University, Boston, MA), ITK-Snap, and Mimics (Materialise NV, Leuven, Belgium) were the most frequently used. Autodesk Meshmixer (San Francisco, CA, USA) and 3-matic (Materialise NV, Leuven, Belgium) were the most frequently employed mesh-editing software during the post-processing phase. PolyJet™, fused deposition modeling (FDM), and stereolithography (SLA) were the most frequently employed 3D-printing technologies. Planning and training with 3D-printed models seem to enhance physicians' confidence and performance levels by up to 40% and lead to a reduction in the procedure time and contrast volume usage to varying extents.

Objective and Automated Quantification of Instrument Handling for Open Surgical Suturing Skill Assessment: A Simulation-Based Study

Goal: Vascular surgical procedures are challenging and require proficient suturing skills. To develop these skills, medical training simulators with objective feedback for formative assessment are gaining popularity. As hardware advancements offer more complex, unique sensors, determining effective task performance measures becomes imperative for efficient suturing training. Methods: 97 subjects of varying clinical expertise completed four trials on a suturing skills measurement and feedback platform (SutureCoach). Instrument handling metrics were calculated from electromagnetic motion trackers affixed to the needle driver. Results: The results of the study showed that all metrics significantly differentiated between novices (no medical experience) from both experts (attending surgeons/fellows) and intermediates (residents). Rotational motion metrics were more consistent in differentiating experts and intermediates over traditionally used tooltip motion metrics. Conclusions: Our work emphasizes the importance of tool motion metrics for open suturing skills assessment and establishes groundwork to explore rotational motion for quantifying a critical facet of surgical performance.

Generating a Prioritized List of Operative Procedures for Simulation-based Assessment of General Surgery Trainees Through Consensus

OBJECTIVE

To develop appropriate content for high-stakes simulation-based assessments of operative competence in general surgery training through consensus.

BACKGROUND

Valid methods of summative operative competence assessment are required by competency-based training programs in surgery.

METHOD

An online Delphi consensus study was conducted. Procedures were derived from the competency expectations outlined by the Joint Committee on Surgical Training Curriculum 2021, and subsequent brainstorming. Procedures were rated according to their perceived importance, perceived procedural risk, how frequently they are performed, and simualtion feasibility by a purposive sample of 30 surgical trainers and a 5-person steering group. A modified Copenhagen Academy for Medical Education and Simulation Needs Assessment Formula was applied to the generated data to produce ranked procedural lists, which were returned to participants for re-prioritization.

RESULTS

Prioritized lists were generated for simulation-based operative competence assessments at 2 key stages of training; the end of 'phase 2' prior to the development of a sub-specialty interest, and the end of 'phase 3', that is, end-of-training certification. A total of 21 and 16 procedures were deemed suitable for assessments at each of these stages, respectively.

CONCLUSIONS

This study describes a national needs assessment approach to content generation for simulation-based assessments of operative competence in general surgery using Delphi consensus methodology. The prioritized procedural lists generated by this study can be used to further develop operative skill assessments for use in high-stakes scenarios, such as trainee progression, entrustment, and end-of-training certification, before subsequent validity testing.

A view from the top: A qualitative exploration of top-level health care leaders' perceptions on the implementation of simulation-based education in postgraduate medical education

INTRODUCTION

Although there is substantial evidence supporting the benefits of simulation-based education (SBE), its widespread and effective implementation remains challenging. The aim of this study was to explore the perceptions of top-level health care leaders regarding SBE and the barriers and facilitators that influence its wide implementation as part of the postgraduate surgical curricula in Denmark.

METHODS

We conducted semi-structured interviews with top-level health care leaders who were chosen based on their roles in ensuring high-quality patient care delivery and developing strategies to achieve the goals of the entire health care system. The interview transcripts were translated into English, and a thematic approach was used to code and inductively analyse the data. We used the Consolidated Framework for Implementation Research to identify and understand the determinants to a successful implementation of SBE.

RESULTS

We interviewed 13 participants from different political and administrative levels. We found that the participants had limited knowledge about SBE, which highlighted a disconnection between these leaders and the educational environment. This was further compounded by a lack of effective communication and inadequate information dissemination between simulation centres and higher-level organisations. While participants recognised the benefits of SBE for doctors in training, they expressed concerns about the implementation given the already strained health care system and limited resources. The need for evidence, particularly in the context of patient safety, was emphasised to facilitate SBE implementation. Although participants supported the implementation of SBE, it was unclear who should initiate action.

DISCUSSION

This study highlighted the perspectives of top-level health care leaders regarding SBE and identified the determinant factors for a successful implementation. Effective communication channels are crucial to enhance collaborations and reduce the disconnection between the different health care organisational levels. Strategic implementation processes, including the roles and responsibilities, should be defined and established. These will inform decisions regarding the implementation strategies to effectively integrate SBE into the residency training curricula.

Surgical Medical Education via 3D Bioprinting: Modular System for Endovascular Training

There is currently a shift in surgical training from traditional methods to simulation-based approaches, recognizing the necessity of more effective and controlled learning environments. This study introduces a completely new 3D-printed modular system for endovascular surgery training (M-SET), developed to allow various difficulty levels. Its design was based on computed tomography angiographies from real patient data with femoro-popliteal lesions. The study aimed to explore the integration of simulation training via a 3D model into the surgical training curriculum and its effect on their performance. Our preliminary study included 12 volunteer trainees randomized 1:1 into the standard simulation (SS) group (3 stepwise difficulty training sessions) and the random simulation (RS) group (random difficulty of the M-SET). A senior surgeon evaluated and timed the final training session. Feedback reports were assessed through the Student Satisfaction and Self-Confidence in Learning Scale. The SS group completed the training sessions in about half time (23.13 ± 9.2 min vs. 44.6 ± 12.8 min). Trainees expressed high satisfaction with the training program supported by the M-SET. Our 3D-printed modular training model meets the current need for new endovascular training approaches, offering a customizable, accessible, and effective simulation-based educational program with the aim of reducing the time required to reach a high level of practical skills.

A National Needs Assessment in Simulation Based Training in Vascular Surgery

OBJECTIVES

The aim of this research was to ascertain the highest need areas for vascular simulation, in order to tailor training for the highest impact.

DESIGN, PARTICIPANTS AND SETTING

A needs assessment was conducted according to best practices using the Delphi method. All consultant vascular surgeons/trainers in the training jurisdiction (n=33) were approached through an independent intermediary to contribute and generate a prioritized list of procedures for training. The research team were blinded to participant identities. Three rounds were conducted according to the Delphi process and scored according to the Copenhagen Needs Assessment Formula (CAMES-NAF).

RESULTS

A final list of 34 vascular procedures was selected and prioritized by surgical trainers. Principles of arterial repair and endarterectomy/patching were considered the highest priority. Complex major interventions such as open abdominal aortic aneurysm (AAA) repair, carotid endarterectomy, and endovascular aortic repair (EVAR) consistently ranked higher than rarer, such as first rib resection and more basic procedures, such as foam injection for varicose veins. Major lower limb amputations typically ranked lower overall compared to arterial interventions. Surgical trainers generally agreed with the ranking according to the CAMES-NAF. There was some disagreement for a select few procedures such as iliac stenting (which rose 13 places) and open radial artery exposure (which fell 6 places) on subsequent iterations.

CONCLUSIONS

Core operative principles and common major operative cases should remain the priority for vascular technical skills training. Other procedures which may be less invasive, but have the potential for major complications should also not be overlooked. In designing simulators the main focus should center on specific skill acquisition for commonly performed major procedures and management of the recognized potential complications. Lower limb amputations are considered adequately taught in clinical practice, or are too challenging to simulate in simulator models apart from cadaveric models.

A Multi-Institutional Needs Assessment in the Development of a Robotic Surgery Curriculum: Perceptions From Resident and Faculty Surgeons

BACKGROUND

The growing adoption of robotic-assisted surgery mandates residents must acquire robotic skills. No standardized curriculum for robotic surgery exists. Therefore, programs have developed their own curricula, which are often unstructured and based on resource availability. With this strategy programs may not adhere to scholarly approaches in curriculum development. We aimed to obtain a multi-institutional needs assessment to address training needs and identify integral components of a formalized robotic surgery curriculum.

METHODS

A 10-question survey was distributed to general surgery residents. A separate 7-question survey was sent to robotic faculty surgeons at 3 institutions. Survey questions queried demographics, opinions regarding robotic training, proficiency definitions, and identification of procedures and instructional strategies for a curriculum. Mann- Whitney U test and Fisher's exact test were performed to compare responses amongst residents and faculty. Spearman's correlation was used to identify relationships between experience or post-graduate year (PGY) with response selection.

RESULTS

Both residents and faculty believed robotic training should start in the PGY1 (55.1% vs 52%; p = 0.58). Faculty recognized robotic training to be more important compared to residents (84% vs 58.1%; p < 0.05). Both groups considered a minimum of 21 to 40 robotic cases to be sufficient exposure during training (p = 0.30). Cholecystectomy (82.4% vs 72%; p = 0.261), ventral hernia repair (89.2% vs 88%; p = 1.0), inguinal hernia repair (91.9% vs 92%; p = 1.0), and right colectomy (83.8% vs 80%; p = 0.7) were considered to be the most appropriate robotic procedures during training. Both groups concurred that bedside (91.9% vs 100%; p = 0.33) and console skills training (97.3% vs 100%; p = 1.0), small group simulation (94.6% vs 72% p = 0.005), and independent practice (87.8% vs 92% p = 0.73), were instructional strategies vital to a curriculum. Faculty considered online didactic modules (96% vs 59.5%; p < 0.05) to be more important, whereas residents favored small group experiences for fundamental skills (94.6% vs. 72%; p < 0.05) and procedure-based simulation (96% vs 64%; p < 0.05).

CONCLUSIONS

Our targeted needs assessment identified requisite components of a robotics curriculum, which are feasible and accepted by both residents and faculty. Medical educators can use this as a resource to develop a formal robotics training curriculum.

Consensus on communication curriculum content in Danish undergraduate medical education: A Delphi study

BACKGROUND

The acquisition of skills in patient-centered communication is a critical aspect of medical education which demands both resource-intensive instruction and longitudinal opportunities for learning. Significant variation currently exists in the content and timing of communication education. The aim of this study was to establish consensus regarding communication curriculum content for undergraduate medical education (UME) within the country of Denmark.

METHODS

This study employed a Delphi process which is a widely accepted method for establishing consensus among experts and can be utilized to guide planning and decision-making in education. For this study, consensus was based on greater than 60% agreement between participants. Diverse stakeholders, representing all four universities with medical schools in Denmark, participated in an iterative three-round Delphi process which involved: (1) identifying key curricular elements for medical student education, (2) rating the importance of each item, and (3) prioritizing items relative to one another and rating each item based on the level of mastery that was expected for each skill (i.e. knowledge, performance with supervision, or performance independently).

RESULTS

A national sample of 149 stakeholders participated with a 70% response rate for round 1, 81% for round 2, and 86% for round 3. The completed Delphi process yielded 56 content items which were prioritized in rank order lists within five categories: (1) establishing rapport, engaging patient perspectives and responding to needs; (2) basic communication skills and techniques; (3) phases and structure of the encounter; (4) personal characteristics and skills of the student; (5) specific challenging patient groups and context-dependent situations.

DISCUSSION

Using a Delphi process, it was possible to achieve consensus regarding communication curriculum content for UME. These findings provide an important foundation for ensuring greater uniformity in UME, as well as supporting the important longitudinal goals of communication skill development across medical training.

Systematic Review of Vascular Surgery Recruitment Strategies for Medical Students and General Surgery Residents

OBJECTIVE

Recruitment into the vascular surgery specialty is an imperative as the specialty faces significant demographic changes. Due to the changing dynamics in vascular surgery training pathways, we sought to review current literature on recruitment strategies and their effectiveness with medical students and general surgery residents.

METHODS

A systematic search, following PRISMA guidelines, was performed by searching MEDLINE, EMBASE, Scopus, CINAHL, and ERIC databases for studies on vascular surgery recruitment methods for medical students and general surgery residents from inception of databases to 12/31/2021. Reports in English discussing recruitment strategies were included. Reports lacking recruitment method data and those with insufficient data were excluded.

RESULTS

Ten reports met inclusion criteria and studied a total of 688 participants. Seven reports (70%) employed simulation, didactic, or online courses. The remaining 30% of studies included data on mentorship, research, or other interventions. Most of the studies (50%) reported data for medical students (MS1-MS4). Interventions specific to residents or both students and residents comprised the other 50% of studies. Simulation and didactic courses increased interest in vascular surgery by a median of 50% (IQR 38) for both medical students and residents. Importantly, without reinforcement, interest was seen to decrease over time.

CONCLUSIONS

Recruitment interventions are useful in increasing student interest in vascular surgery. Early exposure to simulated vascular surgery procedures and mentorship are cited as common reasons for entering the field. Further studies on recruitment strategies focused on long-term outcomes are required.

Identifying technical skills and clinical procedures in surgery for a simulation-based curriculum: a national general needs assessment

BACKGROUND

The efficacy of simulation-based training in surgical education is well known. However, the development of training programs should start with problem identification and a general needs assessment to ensure that the content is aligned with current surgical trainee needs. The objective of the present study is to identify the technical skills and clinical procedures that should be included in a simulation-based curriculum in general surgery.

METHODS

A national, three-round Delphi process was conducted to achieve consensus on which technical skills and clinical procedures should be included in a simulation-based curriculum in general surgery. In total, 87 key opinion leaders were identified and invited to the study.

RESULTS

Round 1 of the Delphi process had a response rate of 64% (56/87) and a total of 245 suggestions. Based on these suggestions, a consolidated list of 51 technical skills or clinical procedures was made. The response rate in Delphi round 2 was 62% (54/87) resulting in a pre-prioritized order of procedures for round 3. The response rate in Delphi round 3 was 65% (35/54). The final list included 13 technical skills and clinical procedures. Training was predominantly requested within general open surgical skills, laparoscopic skills, and endoscopic skills, and a few specific procedures such as appendectomy and cholecystectomy were included in the final prioritized list.

CONCLUSION

Based on the Delphi process 13 technical skills and clinical procedures were included in the final prioritized list, which can serve as a point of departure when developing simulation-based training in surgery.

Trainee Experience in Simulation-Based Education of Open Vascular Surgery

BACKGROUND

Simulation continues to be an important adjunct to vascular surgery training, yet the optimal implementation of simulation to complement conventional surgical training continues to evolve. This study aims to find areas for improvement in current simulation-based training of open vascular skills by characterizing the experience of vascular trainees attending a national simulation-based course.

METHOD

This was a survey study conducted at the simulation course of the Annual UCLA/SVS Symposium: A Comprehensive Review and Update of What's New in Vascular and Endovascular Surgery, a national vascular surgery meeting. The survey consisted of 17 questions and was administered on paper or electronically via the Audience Response System, before the start of the course. The survey assessed the participants' experience in formal training, simulation training, and comfort with open surgical procedures.

RESULTS

Between 2013 and 2018, the survey was completed by 150 participants of which 65% were vascular fellows. Only 48% of the participants had formal training in suturing and surgical instruments. Most participants had formal training in basic vascular techniques and advanced vascular operations. In 71%, simulation was incorporated into basic technique training and 60% in open surgical training. Simulation training was most commonly utilized in learning anastomotic techniques and open abdominal aortic aneurysm repair. Simulation skills were deemed translatable to the operating room by 59% of participants. Most participants were comfortable performing open vascular procedures. However, 68% of participants were uncomfortable performing an abdominal aortic aneurysm repair.

CONCLUSIONS

There continues to be a significant portion of trainees who do not undergo a simulation-based education. Current simulation training is being targeted to meet trainee needs in open vascular surgery, specifically open aneurysm repair. Nonetheless, trainees continue to have doubts regarding applicability of simulation-based skills to the operating theater. Further studies investigating access to simulation education as well as its translatability are needed.

Simulation for technical skill acquisition in open vascular surgery

BACKGROUND

Simulation has an increasingly prominent role in modern vascular surgery training. However, it is important to understand how simulation is most effectively delivered to best use the time and resources available. The aim of this narrative review is therefore to critically appraise open technical skill acquisition in the operating room environment and provide recommendations for the future development of evidence-based simulation for open vascular surgery.

METHODS

A systematic search strategy was used to retrieve relevant studies from PubMed, Medline, Web of Science, EMBASE, and the Cochrane databases in July 2019. Included papers were independently screened by two reviewers. Data were subsequently extracted using a standardized proforma and thematically analyzed.

RESULTS

Thirteen studies were included. All demonstrated that simulation is effective in improving confidence and/or competence in performing open technical skills when assessed by previously validated metrics. However, not all participants or course schedules achieved equal benefit, with distributed practice for junior trainees over several weeks achieving a greater improvement in technical skill compared with senior trainees or longer course schedules for some tasks.

CONCLUSIONS

Simulation can be an effective adjunct to traditional operative experience for technical skill acquisition in open vascular surgery. Future work should focus on developing models to address a wider range of training needs, as well as further defining the optimum schedule for the style, content, and timing of simulation for specific learner groups.

European Society for Vascular Surgery (ESVS) Certification of Theoretical and Practical Competences in Basic Vascular Ultrasound: Validity Investigation of the Assessment Tools

OBJECTIVE

The aim of this study was to gather validity evidence for the Assessment of basic Vascular Ultrasound Expertise (AVAUSE) tool, and to establish a pass/fail score for each component, to support decisions for certification.

METHODS

A cross sectional validation study performed during the European Society for Vascular Surgery's annual meeting. Validity evidence was sought for the theoretical test and two practical tests based on Messick's framework. The participants were vascular surgeons, vascular surgical trainees, sonographers, and nurses with varying experience levels. Five vascular ultrasound experts developed the theoretical and two practical test components of the AVAUSE tool for each test component. Two stations were set up for carotid examinations and two for superficial venous incompetence (SVI) examinations. Eight raters were assigned in pairs to each station. Three methods were used to set pass/fail scores: contrasting groups' method; rater consensus; and extended Angoff.

RESULTS

Nineteen participants were enrolled. Acceptable internal consistency reliability (Cronbach's alpha) for the AVAUSE theoretical (0.93), carotid (0.84), and SVI (0.65) practical test were shown. In the carotid examination, inter-rater reliability (IRR) for the two rater pairs was good: 0.68 and 0.78, respectively. The carotid scores correlated significantly with years of experience (Pearson's r = 0.56, p = .013) but not with number of examinations in the last five years. For SVI, IRR was excellent at 0.81 and 0.87. SVI performance scores did not correlate with years of experience and number of examinations. The pass/fail score set by the contrasting groups' method was 29 points out of 50. The rater set pass/fail scores were 3.0 points for both carotid and SVI examinations and were used to determine successful participants. Ten of 19 participants passed the tests and were certified.

CONCLUSION

Validity evidence was sought and established for the AVAUSE comprehensive tool, including pass/fail standards. AVAUSE can be used to assess competences in basic vascular ultrasound, allowing operators to progress towards independent practice.

Operators believe patient-specific rehearsal improve individual and team performance

INTRODUCTION

Rehearsing endovascular aortic aneurysm repair on patient-specific data is recent within virtual reality simulation and opens up new possibilities for operators to prepare for complex procedures. This study evaluated the feasibility of patient-specific rehearsal (PsR) and assessed operators' appraisal of the VIST-LAB simulator from Mentice.

MATERIAL AND METHODS

CT-data was segmented and uploaded to the simulator, and simulated for 30 elective EVAR patients. Operators were asked how they perceived the PsR on a Likert scale after the PsR (once) and after the following procedure (each time).

RESULTS

Patients were simulated and operated by 14 operators, always in pairs of one vascular surgeon and one interventional radiologist. The operators estimated that PsR improved individual and team performance (median 4), and recommended the use of PsR in general (median 4) and for difficult cases (median 5). The simulator realism got moderate scores (median 2-3). Inexperienced operators seemed to appreciate the PsR the most.

CONCLUSIONS

PsR was feasible and was evaluated by operators to improve individual and team performance. Inexperienced users were more positive towards PsR than experienced users. PsR realism and the ease of importing patient-specific data can still be improved, and further studies to quantify and precisely identify benefits are needed.

Ensuring Competency in Open Aortic Aneurysm Repair - Development and Validation of a New Assessment Tool

OBJECTIVE

The aims of this study were to develop a procedure specific assessment tool for open abdominal aortic aneurysm (AAA) repair, gather validity evidence for the tool and establish a pass/fail standard.

METHODS

Validity was studied based on the contemporary framework by Messick. Three vascular surgeons experienced in open AAA repair and an expert in assessment and validation within medical education developed the OPEn aortic aneurysm Repair Assessment of Technical Expertise (OPERATE) tool. Vascular surgeons with varying experiences performed open AAA repair in a standardised simulation based setting. All procedures were video recorded with the faces anonymised and scored independently by three experts in a mutual blinded setup. The Angoff standard setting method was used to establish a credible pass/fail score.

RESULTS

Sixteen novices and nine experienced open vascular surgeons were enrolled. The OPERATE tool achieved high internal consistency (Cronbach's alpha .92) and inter-rater reliability (Cronbach's alpha .95) and was able to differentiate novices and experienced surgeons with mean scores (higher score is better) of 13.4 ± 12 and 25.6 ± 6, respectively (p = .01). The pass/fail score was set high (27.7). One novice passed the test while six experienced surgeons failed.

CONCLUSION

Validity evidence was established for the newly developed OPERATE tool and was able to differentiate between novices and experienced surgeons providing a good argument that this tool can be used for both formative and summative assessment in a simulation based environment. The high pass/fail score emphasises the need for novices to train in a simulation based environment up to a certain level of competency before apprenticeship training in the clinical environment under the tutelage of a supervisor. Familiarisation with the simulation equipment must be ensured before performance is assessed as reflected by the low scores in the experienced group's first attempt.

Influence of patient-specific rehearsal on operative metrics and technical success for endovascular aneurysm repair

INTRODUCTION

Patient-specific rehearsal (PsR) is a recent technology within virtual reality (VR) simulation that lets the operators train on patient-specific data in a simulated environment prior to the procedure. Endovascular aneurysm repair (EVAR) is a complex procedure where operative metrics and technical success might improve after PsR.

MATERIAL AND METHODS

We compared technical success and operative metrics (endovascular procedure time, contralateral gate cannulation time, fluoroscopy time, total radiation dose, number of angiograms and contrast medium use) between 30 patients, where the operators performed PsR (the PsR group), and 30 patients without PsR (the control group).

RESULTS

The endovascular procedure time was significantly shorter in the PsR group than in the control group (median 44 versus 55 min, p = .017). The other operative metrics were similar. Technical success rates were higher in the PsR group, 96.7% primary and assisted primary outcome versus 90.0% in the control group. The differences were not significant (p = .076).

CONCLUSIONS

PsR before EVAR reduced endovascular procedure time, and our results indicate that it might improve technical success, but further studies are needed to confirm those results.

Identifying and prioritising technical procedures for simulation-based curriculum in paediatrics: a Delphi-based general needs assessment

OBJECTIVES

To identify and prioritise technical procedures that should be integrated in a curriculum of simulation-based procedural training in paediatrics using the Delphi method.

STUDY DESIGN

National general needs assessment using a Delphi process was completed among 93 key opinion leaders in paediatrics in Denmark. Delphi round 1 identified technical procedures. Round 2 explored frequency of procedures, number of paediatricians performing the procedures, risks and/or discomfort for patients and feasibility for simulation-based training. Round 3 included final elimination and reprioritisation.

RESULTS

Response rates in the Delphi rounds were 73%, 71% and 72%. We identified 37 procedures in Delphi round 1, preprioritised in round 2, resulting in a final list of 19 procedures in round 3. Strong correlation between the prioritisation from the second and third Delphi rounds was identified, Spearman's r of 0.94 (p<0.0001). Top five on the final list were acute neonatal airway management, acute non-neonatal airway management, non-neonatal peripheral intravenous and intraosseous access, neonatal vascular access and advanced heart lung resuscitation.

CONCLUSION

We identified and prioritised 19 technical procedures in paediatrics that are suitable for simulation and may be used as a guide for the development of simulation-based curriculum in paediatrics.

Identifying Technical Procedures in Orthopaedic Surgery and Traumatology That Should Be Integrated in a Simulation-Based Curriculum: A National General Needs Assessment in Denmark

BACKGROUND

Simulation-based training is emerging within the orthopaedic field to alleviate the challenges that trainees face such as work-hour restrictions, limited exposure to procedures, and increasing pressures to reduce risk to patients. This training modality has grown increasingly popular over the last 2 decades. However, integration into the curriculum often fails to follow a structured educational plan. The development of simulation-based curricula should follow a structured and stepwise approach that starts with a general needs assessment. This study aimed to identify and prioritize procedures within orthopaedic surgery to be included in a simulation-based curriculum on a national basis.

METHODS

A national needs assessment was conducted using the Delphi method. Ninety-five experts who are involved in the training of orthopaedic surgeons from all orthopaedic departments in Denmark were selected to participate in the assessment. Round 1 was a brainstorming phase to identify technical procedures that are relevant for orthopaedic surgeons in training. Round 2 was performed on a departmental basis; it explored the frequency of procedures, the number of surgeons performing each procedure, the risk and/or discomfort to patients, and the feasibility for simulation-based training to prioritize and eliminate some of the procedures that were determined in round 1. During round 3, the experts eliminated and reprioritized procedures from round 2 to produce a final prioritized list.

RESULTS

During the first round, 194 procedures were identified. These were reduced to 62 in round 2, and the final list after round 3 consisted of 33 prioritized procedures that are relevant for simulation-based training in orthopaedic surgery. The response rates were 63 of 95 physicians for round 1, 26 of 26 departments for round 2, and 64 of 97 physicians for round 3. The highest prioritized procedures were basic surgical techniques and principles for osteosynthesis, osteosynthesis of proximal femoral fracture, and surgical exposure of the upper and lower extremities.

CONCLUSIONS

The prioritized list of technical procedures in orthopaedic surgery that are suitable for simulation-based training can aid in the development of a simulation-based curriculum.

CLINICAL RELEVANCE

This article offers insights into needs assessment and curriculum development of simulation-based training in orthopaedic surgery and traumatology.

A Binational Need Assessment to Define the Level of Endovascular Expertise Required by Vascular Surgical Trainees

BACKGROUND

There has been a shift toward competency-based surgical education programs to improve trainee performance and achieve better patient outcomes. Endovascular procedures comprise a significant volume of vascular surgery, but the current methods for assessing the endovascular competence of vascular trainees in Australia and New Zealand are suboptimal. The objective of this study was to perform a need assessment to define the scope of endovascular expertise required by vascular surgical trainees to later aid in the development of novel surgical training assessment tools.

METHODS

A modified Delphi method was used to achieve expert consensus. Fifty-three key stakeholders in vascular surgical education and training (SET) in Australia and New Zealand were invited to take part in the 2-stage survey. Experts were asked which procedures they considered to be requisite for vascular surgery trainees and at which SET level competence should be achieved. The results were reiterated to the expert panel in the second stage, and consensus considered achieved if over 75% of experts were in agreement.

RESULTS

In the first stage 25 experts reached consensus that competence in 18 of the 26 procedures should be requisite for SET trainees. Twenty-two experts responded to the second stage and consensus was achieved for 12 out of 14 of the procedural items with mean percentage of experts in agreement being 90%.

CONCLUSIONS

A need assessment using a modified Delphi method has achieved consensus among experts in vascular surgery regarding the endovascular procedures considered to be requisite for vascular surgery trainees in Australia and New Zealand.

The relevance of low-fidelity virtual reality simulators compared with other learning methods in basic endovascular skills training

OBJECTIVE

The use of simulators has shown a profound impact on the development of both training and assessment of endovascular skills. Furthermore, there is evidence that simulator training is of great benefit for novice trainees. However, there are only a few simulators available geared specifically toward novice learners. Whereas research suggests that low-fidelity simulators could fill this gap, there are insufficient data available to determine the role of low-fidelity simulators in the training of endovascular skills.

METHODS

Medical students in their fifth year (N = 50) with no previous endovascular experience were randomized into three groups: conventional learning through a video podcast (group V; n = 12), low-fidelity simulation training with tablet-paired touch-gesture navigation (group A; n = 12), and low-fidelity simulation training with tablet-paired physical endovascular tool navigation (group S; n = 26). Within their respective groups, all students attended a 1-day class on basic endovascular skills. Questionnaire items for self-assessment before and after the class and assessment after the class of the participant's practical skills on a high-fidelity simulator were analyzed across all three groups as well as for each group separately using nonparametric tests.

RESULTS

All 50 participants completed the training. Participants in group S showed a significantly increased interest in working in interventional cardiology (P = .02) and vascular surgery (P = .03) after the class. Evaluation of the questionnaire items after the class showed that participants in group S rated their practical skills significantly higher after the class compared with those in group V and group A (P < .001 for pairwise comparison of all three groups, respectively), creating a significant trend across the three groups. However, analysis of the practical skills assessment for all three groups showed a significant difference between the groups only for choosing a guidewire (P = .045) and a significant trend in performance across the groups for choosing a guidewire and for positioning the guidewire in the vessel (P = .02 and P = .05, respectively). All other steps of the skills assessment showed no significant differences or a trend across the groups.

CONCLUSIONS

Low-fidelity simulation training, particularly with physical endovascular tool navigation, led to increased motivation in novice trainees. Whereas simulator training was associated with increased confidence of trainees in their skills, assessment of their practical skills showed no actual improvement in this study. Overall, low-fidelity simulation has the potential to benefit novice trainees, but possible risks of simulation training should be further evaluated.

Endovascular Training Using a Simulation Based Curriculum is Less Expensive than Training in the Hybrid Angiosuite

OBJECTIVE/BACKGROUND

This study aimed to determine the cost-effectiveness of a PROficiency based StePwise Endovascular Curricular Training (PROSPECT) program, including e-learning and hands on virtual reality simulation.

METHODS

A prospective, single blinded, randomised controlled trial (RCT) was carried out to evaluate the impact of a PROSPECT training program on real life operative performance. Under supervision, all subjects performed two endovascular interventions on patients with symptomatic iliac and/or superficial femoral artery stenosis. Primary outcomes were technical performance (Global Rating Scale, Examiner Checklist), operative metrics, and patient outcomes, adjusted for case difficulty and the trainee's experience. Additionally, an analysis of costs and savings related to implementation of this endovascular training program was performed. Thirty-two general surgery trainees were randomised into three groups: group 1 (n = 11) received e-learning and simulation training (PROSPECT program); group 2 (n = 10) only had access to e-learning; group 3 (n = 11) did not receive supplementary education besides clinical training. Developmental cost, implementation cost, training time cost, and the operational cost of PROSPECT were determined. Time spent studying and practicing was converted to indirect saving of operating time. The costs of logistics, faculty time supervising simulation sessions, and 30 day complication rates were registered. Sensitivity analysis was performed to assess the robustness of the results.

RESULTS

Fifty-eight peripheral endovascular interventions, performed by 29 surgical trainees (three dropouts) were included in this RCT from October 2014 to February 2016. Annual costs from the perspective of the hospital were €6589 for curriculum design, €31,484 for implementation, and €1143 in operational costs. Per trainee, simulation based training until proficiency cost €3806. In comparison, if endovascular proficiency levels were obtained with conventional training only, this may have cost €5001 per trainee.

CONCLUSION

Simulation based training in endovascular procedures may be cost saving, because training occurs outside the angiosuite. It is possible that cost savings are underestimated as, in contrast to the literature, prevented costs related to complications could not be defined.

Consensus on procedures to include in a simulation-based curriculum in ophthalmology: a national Delphi study

PURPOSE

The number of available simulation-based models for technical skills training in ophthalmology is rapidly increasing, and development of training programmes around these procedures should follow a structured approach. The aim of this study was to identify all technical procedures that should be integrated in a simulation-based curriculum in ophthalmology.

METHODS

Key opinion leaders involved in the education of ophthalmologists in Denmark including heads of departments, heads of clinical education, professors and board members of the society were invited to participate in a three-round Delphi process. Round 1 aimed at identifying technical procedures that physicians should be able to perform competently when completing specialty training; round 2 involved characterization of each procedure including frequency, number of operators, risk and/or discomfort for patients associated with an inexperienced physician, and feasibility of simulation-based training; round 3 included a priority ranking of procedures.

RESULTS

The response rate for each round was 71%, 64% and 64%, respectively. Sixty-five procedures were reduced to 25 prioritized procedures during the three rounds. Two-thirds of the procedures that were identified and highly prioritized were therapeutic procedures such as intravitreal injection therapy, yttrium-aluminium-garnet laser iridotomy/capsulotomy, minor ocular surface procedures and retinal argon laser therapy. The diagnostic procedures that were prioritized were ocular ultrasound, superficial keratectomy and optical coherence tomography (OCT).

CONCLUSION

The Delphi process identified and prioritized 25 procedures that should be practised in a simulation-based environment to achieve competency before working with patients. The list may be used to guide the development of future training programmes for ophthalmologists.

Surgical simulation: Current practices and future perspectives for technical skills training

Simulation-based training (SBT) has become a standard component of modern surgical education, yet successful implementation of evidence-based training programs remains challenging. In this narrative review, we use Kern's framework for curriculum development to describe where we are now and what lies ahead for SBT within surgery with a focus on technical skills in operative procedures. Despite principles for optimal SBT (proficiency-based, distributed, and deliberate practice) having been identified, massed training with fixed time intervals or a fixed number of repetitions is still being extensively used, and simulators are generally underutilized. SBT should be part of surgical training curricula, including theoretical, technical, and non-technical skills, and be based on relevant needs assessments. Furthermore, training should follow evidence-based theoretical principles for optimal training, and the effect of training needs to be evaluated using relevant outcomes. There is a larger, still unrealized potential of surgical SBT, which may be realized in the near future as simulator technologies evolve, more evidence-based training programs are implemented, and cost-effectiveness and impact on patient safety is clearly demonstrated.

How to identify and prioritize procedures suitable for simulation-based training: Experiences from general needs assessments using a modified Delphi method and a needs assessment formula

Simulation-based training (SBT) is a revolutionary addition to the education of residents in different specialties. However, the selection of training programs is often reliant on commercially available equipment or on experiential notions, local interests or coincidence. The first step to developing training programs should be problem identification and general needs assessment to ensure that these are aligned with current trainee needs. We describe a stepwise approach to performing a needs assessment following the Delphi process and using a needs assessment formula (NAF) to prioritize technical procedures for simulation training. This technique relies on a panel of experts to gather information and achieve a convergence of opinion. We used three rounds of survey iterations. Round 1: A brainstorming phase to gather all procedures that a newly qualified resident should be able to perform. Round 2: Rating and preliminary prioritization with a NAF including frequency of the procedure, number of doctors, impact, and feasibility. Round 3: Elimination and final prioritization of procedures. The needs assessment identifies and prioritizes procedures for simulation training. It can guide medical educators in the planning of SBT programs to address current trainee needs with the aim of improving the education and training of future doctors.

Process of medical simulator development: An approach based on personal experience

With increasing demand for simulators from the healthcare community and increasingly sophisticated technology being used in the manufacture of medical simulators, the manufacture of healthcare simulators has become a multifaceted undertaking. Based on our experience in the field and our diverse backgrounds, we explore the processes and issues related to the development of these simulators and suggest ways for the developing teams to collaborate and coordinate with each other to achieve a successful outcome.

Determining procedures for simulation-based training in radiology: a nationwide needs assessment

OBJECTIVES

New training modalities such as simulation are widely accepted in radiology; however, development of effective simulation-based training programs is challenging. They are often unstructured and based on convenience or coincidence. The study objective was to perform a nationwide needs assessment to identify and prioritize technical procedures that should be included in a simulation-based curriculum.

METHODS

A needs assessment using the Delphi method was completed among 91 key leaders in radiology. Round 1 identified technical procedures that radiologists should learn. Round 2 explored frequency of procedure, number of radiologists performing the procedure, risk and/or discomfort for patients, and feasibility for simulation. Round 3 was elimination and prioritization of procedures.

RESULTS

Response rates were 67 %, 70 % and 66 %, respectively. In Round 1, 22 technical procedures were included. Round 2 resulted in pre-prioritization of procedures. In round 3, 13 procedures were included in the final prioritized list. The three highly prioritized procedures were ultrasound-guided (US) histological biopsy and fine-needle aspiration, US-guided needle puncture and catheter drainage, and basic abdominal ultrasound.

CONCLUSION

A needs assessment identified and prioritized 13 technical procedures to include in a simulation-based curriculum. The list may be used as guide for development of training programs.

KEY POINTS

• Simulation-based training can supplement training on patients in radiology. • Development of simulation-based training should follow a structured approach. • The CAMES Needs Assessment Formula explores needs for simulation training. • A national Delphi study identified and prioritized procedures suitable for simulation training. • The prioritized list serves as guide for development of courses in radiology.