Training, assessment and accreditation in surgery

HoloMentor: A Novel Mixed Reality Surgical Anatomy Curriculum for Robot-Assisted Radical Prostatectomy

OBJECTIVES

The disruption to surgical training and medical education caused by the global COVID-19 pandemic highlighted the need for realistic, reliable, and engaging educational opportunities available outside of the operating theatre and accessible for trainees of all levels. This article presents the design and development of a virtual reality curriculum which simulates the surgical mentorship experience outside of the operating theatre, with a focus on surgical anatomy and surgical decision-making.

METHOD

This was a multi-institutional study between London's King's College and Imperial College. The index procedure selected for the module was robotic radical prostatectomy. For each stage of the surgical procedure, subject-matter experts (N = 3) at King's College London, identified (1) the critical surgical-decision making points, (2) critical anatomical landmarks, and (3) tips and techniques for overcoming intraoperative challenges. Content validity was determined by an independent panel of subject-matter experts (N = 8) at Imperial College, London, using Fleiss' kappa statistic. The experts' teaching points were combined with operative footage and illustrative animations, and projected onto a virtual reality headset. The module was piloted to surgical science students (N = 15). Quantitative analysis compared participants' confidence regarding their anatomical knowledge before and after taking the module. Qualitative data were gathered from students regarding their views on using the virtual reality model.

RESULTS

Multi-rater agreement between experts was above the 70.0% threshold for all steps of the procedure. Seventy-three percentage of pilot study participants "agreed" or "strongly agreed" that they achieved a better understanding of surgical anatomy and the rationale behind each procedural step. This was reflected in an increase in the median knowledge score after trialing the curriculum (p < 0.001). 100% of subject-matter experts and 93.3% of participants "agreed" or "strongly agreed" that virtual mentorship would be useful for future surgical training.

CONCLUSIONS

This study demonstrated that virtual surgical mentorship could be a feasible and cost-effective alternative to traditional training methods with the potential to improve technical skills, such as operative proficiency and nontechnical skills such as decision-making and situational judgement.

Deciphering the inflection points to achieve proficiency for each procedure step during training in laparoscopic appendicectomy

Background

Laparoscopic appendicectomy is a common procedure early in surgical training. A minimum number is usually required for certification in general surgery. However, data on proficiency are scarce. This study aimed to investigate steps towards proficiency in laparoscopic appendicectomy.

Methods

This was a prospective observational cohort study of laparoscopic appendicectomies performed by junior trainees under supervision scored on a six-point performance scale. Structured assessment was done within a defined programme. Procedures performed for uncomplicated appendicitis in adults were included. The procedures were evaluated with LOWESS graphs generated to investigate inflection points. Factors associated with proficiency rates were reported with odds ratios and 95 per cent confidence intervals.

Results

In total 142 laparoscopic procedures were included for 19 trainees (58 per cent female). The cumulative number of procedures during the study was a median of 20 (i.q.r. 8–33). For overall proficiency, an inflection point occurred at 30 procedures. Proficiency rate increased from 51 per cent for 30 or fewer procedures to 93 per cent for more than 30 procedures (odds ratio 11.9 (95 per cent c.i. 3.4 to 40.9); P < 0.001). Inflection points for proficiency for each procedure step varied considerably, with lowest numbers (fewer than 15 procedures) for removing the specimen, and highest for dividing the mesoappendix (more than 55 procedures). Operating time was significantly reduced by a median of 7 minutes after 30 procedures, from median 62 (i.q.r. 25–120) minutes to median 55 (i.q.r. 30–110) minutes for more than 30 procedures.

Conclusion

For junior trainees, variation in proficiency is related to specific procedure steps. Targeted training on specific procedure skills may reduce numbers needed to achieve proficiency in laparoscopic appendicectomy during training.

Editorial Commentary: Simulation-Based Training in Orthopaedic Surgery: Current Evidence and Limitations

Simulation-based training has been widely adopted by surgical educators and is now an essential component of the modern resident's skills acquisition pathway and career progression. The challenges faced by residents because of lack of exposure as a result of working-time directives-and now the COVID-19 (coronavirus disease 2019) pandemic limiting nonurgent and elective operating-reinforce the need for evidence-based simulation training. Although a wide range of training platforms have been developed, very few have shown transfer of skills. Simulation is thought to enhance the initial phase of the procedural learning curve; however, this hypothesis is yet to be tested in a high-quality study. Nevertheless, in light of the current evidence, simulation-based procedural curricula should be developed using the strengths of multiple different training platforms while incorporating the essential concept of nontechnical skills.

Surgical training 2.0: A systematic approach reviewing the literature focusing on oral maxillofacial surgery - Part I

PURPOSE

Many technologies are emerging in the medical field. Having an overview of the technological arsenal available to train new surgeons seems very interesting to guide subsequent surgical training protocols.

METHODS

This article is a systematic approach reviewing new technologies in surgical training, in particular in oral and maxillofacial surgery. This review explores what new technologies can do compared to traditional methods in the field of surgical education. A structured literature search of PubMed was performed in adherence to PRISMA guidelines. The articles were selected when they fell within predefined inclusion criteria while respecting the key objectives of this systematic review. We looked at medical students and more specifically in surgery and analysed whether exposure to new technologies improved their surgical skills compared to traditional methods. Each technology is reviewed by highlighting its advantages and disadvantages and studying the feasibility of integration into current practice.

RESULTS

The results are encouraging. Indeed, all of these technologies make it possible to reduce the learning time, the operating times, the operating complications and increase the enthusiasm of the students compared to more conventional methods. The start-up cost, the complexity to develop new models, and the openness of mind necessary for the integration of these technologies are all obstacles to immediate development. The main limitations of this review are that many of the studies have been carried out on small numbers, they are not interested in acquiring knowledge or skills over the long term and obviously there is a publication bias.

CONCLUSION

Surgical education methods will probably change in the years to come, integrating these new technologies into the curriculum seems essential so as not to remain on the side. This first part therefore reviews, open field camera, telemedicine and 3D printing. This systematic review is registered on PROSPERO.

Process-Oriented Instrument and Taxonomy for Teaching Surgical Procedures in Medical Training: The Ultrasound-Guided Insertion of Central Venous Catheter

Procedural training is relevant for physicians who perform surgical procedures. In the medical education field, instructors who teach surgical procedures need to understand how their students are learning to give them feedback and assess them objectively. The sequence of steps of surgical procedures is an aspect rarely considered in medical education, and state-of-the-art tools for giving feedback and assessing students do not focus on this perspective. Process Mining can help to include this perspective in this field since it has recently been used successfully in some applications. However, these previous developments are more centred on students than on instructors. This paper presents the use of Process Mining to fill this gap, generating a taxonomy of activities and a process-oriented instrument. We evaluated both tools with instructors who teach central venous catheter insertion. The results show that the instructors found both tools useful to provide objective feedback and objective assessment. We concluded that the instructors understood the information provided by the instrument since it provides helpful information to understand students’ performance regarding the sequence of steps followed.