Implementation and validation of a competency assessment tool for laparoscopic cholecystectomy

There is a need for a paradigm shift in laparoscopic surgical training: results of a nationwide survey among teaching hospitals in Switzerland

BACKGROUND

Surgical training curricula have changed little over the past decades. Current advances in surgical techniques, especially in minimally invasive surgery, as well as the rapidly changing socioeconomic environment pose a major challenge for the training of young surgeons. The aim of this survey was to provide a representative overview of the surgical training landscape in Switzerland focusing on laparoscopic surgical training: How do department chairs of teaching hospitals deal with the above challenges, and what should a future training curriculum look like?

METHODS

This is a prospective, questionnaire-based, cross-sectional study among the heads of departments of all certified surgical teaching hospitals in Switzerland.

RESULTS

The overall response rate was 56% (48/86) and 86% (19/22) for tertiary centers. Two-thirds of the centers (32) organize themselves in training networks. Laparoscopic training courses are offered in 25 (52%) hospitals, mainly in tertiary centers. Self-training opportunities exist in 40 (83%) hospitals. In addition to commercial (27) and self-built (7) box trainers, high-fidelity trainers are available in 16 (33%) hospitals. A mandatory training curriculum exists in 7 (15%) facilities, and a training assessment is performed in 15 (31%) institutions. Thirty-two (65%) heads of departments indicated that residents have sufficient practical exposure in the operating room, but the ability to work independently with obtaining the specialist title is seen critically (71%). They state that the surgical catalog does not adequately reflect the manual skills of the resident (64%). The desire is for training to be restructured from a numbers-based to a performance-based curriculum (53%) and for tools to assess residents' manual skills (56%) to be introduced.

CONCLUSIONS

Department chairs stated that the existing curriculum in Switzerland does not meet the requirements of a modern training curriculum. This study highlights the need to create an improved, competency-based curriculum that ensures the training of a new generation of surgeons, taking into account the growing evidence of the effectiveness of state-of-the-art training modalities such as simulation or proficiency-based training.

Laparoscopic cholecystectomy critical view of safety (LC-CVS): a multi-national validation study of an objective, procedure-specific assessment using video-based assessment (VBA)

BACKGROUND

A novel 6-item objective, procedure-specific assessment for laparoscopic cholecystectomy incorporating the critical view of safety (LC-CVS OPSA) was developed to support trainee formative and summative assessments. The LC-CVS OPSA included two retraction items (fundus and infundibulum retraction) and four CVS items (hepatocystic triangle visualization, gallbladder-liver separation, cystic artery identification, and cystic duct identification). The scoring rubric for retraction consisted of poor (frequently outside of defined range), adequate (minimally outside of defined range) and excellent (consistently inside defined range) and for CVS items were "poor-unsafe", "adequate-safe", or "excellent-safe".

METHODS

A multi-national consortium of 12 expert LC surgeons applied the OPSA-LC CVS to 35 unique LC videos and one duplicate video. Primary outcome measure was inter-rater reliability as measured by Gwet's AC2, a weighted measure that adjusts for scales with high probability of random agreement. Analysis of the inter-rater reliability was conducted on a collapsed dichotomous scoring rubric of "poor-unsafe" vs. "adequate/excellent-safe".

RESULTS

Inter-rater reliability was high for all six items ranging from 0.76 (hepatocystic triangle visualization) to 0.86 (cystic duct identification). Intra-rater reliability for the single duplicate video was substantially higher across the six items ranging from 0.91 to 1.00.

CONCLUSIONS

The novel 6-item OPSA LC CVS demonstrated high inter-rater reliability when tested with a multi-national consortium of LC expert surgeons. This brief instrument focused on safe surgical practice was designed to support the implementation of entrustable professional activities into busy surgical training programs. Instrument use coupled with video-based assessments creates novel datasets with the potential for artificial intelligence development including computer vision to drive assessment automation.

Low-fidelity simulation models in urology resident's microsurgery training

PURPOSE

To evaluate the gain of microsurgical skills and competencies by urology residents, using low-fidelity experimental models.

METHODS

The study involved the use of training boards, together with a low-fidelity microsurgery simulator, developed using a 3D printer. The model consists in two silicone tubes, coated with a resin, measuring 10 cm in length and with internal and external diameters of 0.5 and 1.5 mm. The support for the ducts is composed by a small box, developed with polylactic acid. The evaluation of the gain of skills and competencies in microsurgery occurred throughout a training course consisting of five training sessions. The first sessions (S1-S4) took place at weekly intervals and the last session (S5) was performed three months after S4. During sessions, were analyzed: the speed of performing microsurgical sutures in the pre and post-training and the performance of each resident through the Objective Structure Assessment of Technical Skill (OSATS) and Student Satisfaction Self-Confidence tools in Learning (SSSCL).

RESULTS

There was a decrease in the time needed to perform the anastomosis (p=0.0019), as well as a progressive increase in the score in the OSATS over during sessions S1 to S4. At S5, there was a slightly decrease in performance (p<0.0001), however, remaining within the expected plateau for the gain of skills and competences. The SSSCL satisfaction scale showed an overall approval rating of 96.9%, with a Cronback alpha coefficient of 83%.

CONCLUSIONS

The low-fidelity simulation was able to guarantee urology residents a solid gain in skills and competencies in microsurgery.

Video-based tools for surgical quality assessment of technical skills in laparoscopic procedures: a systematic review

BACKGROUND

Quality of surgery has substantial impact on both short- and long-term clinical outcomes. This stresses the need for objective surgical quality assessment (SQA) for education, clinical practice and research purposes. The aim of this systematic review was to provide a comprehensive overview of all video-based objective SQA tools in laparoscopic procedures and their validity to objectively assess surgical performance.

METHODS

PubMed, Embase.com and Web of Science were systematically searched by two reviewers to identify all studies focusing on video-based SQA tools of technical skills in laparoscopic surgery performed in a clinical setting. Evidence on validity was evaluated using a modified validation scoring system.

RESULTS

Fifty-five studies with a total of 41 video-based SQA tools were identified. These tools were used in 9 different fields of laparoscopic surgery and were divided into 4 categories: the global assessment scale (GAS), the error-based assessment scale (EBAS), the procedure-specific assessment tool (PSAT) and artificial intelligence (AI). The number of studies focusing on these four categories were 21, 6, 31 and 3, respectively. Twelve studies validated the SQA tool with clinical outcomes. In 11 of those studies, a positive association between surgical quality and clinical outcomes was found.

CONCLUSION

This systematic review included a total of 41 unique video-based SQA tools to assess surgical technical skills in various domains of laparoscopic surgery. This study suggests that validated SQA tools enable objective assessment of surgical performance with relevance for clinical outcomes, which can be used for training, research and quality improvement programs.

Training curriculum in minimally invasive emergency digestive surgery: 2022 WSES position paper

BACKGROUND

Minimally invasive surgery (MIS), including laparoscopic and robotic approaches, is widely adopted in elective digestive surgery, but selectively used for surgical emergencies. The present position paper summarizes the available evidence concerning the learning curve to achieve proficiency in emergency MIS and provides five expert opinion statements, which may form the basis for developing standardized curricula and training programs in emergency MIS.

METHODS

This position paper was conducted according to the World Society of Emergency Surgery methodology. A steering committee and an international expert panel were involved in the critical appraisal of the literature and the development of the consensus statements.

RESULTS

Thirteen studies regarding the learning curve in emergency MIS were selected. All but one study considered laparoscopic appendectomy. Only one study reported on emergency robotic surgery. In most of the studies, proficiency was achieved after an average of 30 procedures (range: 20-107) depending on the initial surgeon's experience. High heterogeneity was noted in the way the learning curve was assessed. The experts claim that further studies investigating learning curve processes in emergency MIS are needed. The emergency surgeon curriculum should include a progressive and adequate training based on simulation, supervised clinical practice (proctoring), and surgical fellowships. The results should be evaluated by adopting a credentialing system to ensure quality standards. Surgical proficiency should be maintained with a minimum caseload and constantly evaluated. Moreover, the training process should involve the entire surgical team to facilitate the surgeon's proficiency.

CONCLUSIONS

Limited evidence exists concerning the learning process in laparoscopic and robotic emergency surgery. The proposed statements should be seen as a preliminary guide for the surgical community while stressing the need for further research.