Structured training and competence assessment in colorectal robotic surgery. Results of a consensus experts round table

Preceptorship in robotic colorectal surgery: experience from the Australian private sector

This article describes a post-fellowship preceptorship training program to train sub-specialty colorectal surgeons in gaining proficiency in robotic colorectal surgery using a dual-surgeon model in the Australian private sector. The Australian colorectal surgeon faces challenges in gaining robotic colorectal surgery proficiency with limited exposure and experience in the public setting where the majority of general and colorectal surgery training is currently conducted. This training model uses graded exposure with a range of simulation training, wet lab training, and clinical operative cases to progress through both competency and proficiency in robotic colorectal surgery which is mutually beneficial to surgeons and patients alike. Ongoing audit of practice has shown no adverse impacts.

Training and assessment for colorectal surgery and appendicectomy- a systematic review

AIM

There is currently an increased focus on competency-based training, in which training and assessment play a crucial role. The aim of this systematic review is to create an overview of hands-on training methods and assessment tools for appendicectomy and colon and rectal surgery procedures using either an open, laparoscopic or robot-assisted approach.

METHOD

A systematic review of Medline, Embase, Cochrane and Scopus databases was conducted following the PRISMA guidelines. We conducted the last search on 9 March 2023. All published papers describing hands-on training, evaluation of performance data and development of assessment tools were eligible. The quality of studies and the validity evidence of assessment tools are reported.

RESULTS

Fifty-one studies were identified. Laparoscopic assessment tools are abundant, but the literature still lacks good-quality assessment tools for open appendicectomy, robotic colectomy and open rectal surgery. Overall, there is a lack of discussion regarding the establishment of pass/fail standards and the consequences of assessment. Virtual reality simulation is used more for appendicectomy than colorectal procedures. Only a few of the studies investigating training were of acceptable quality. There is a need for high-quality studies in open and robotic-assisted colon surgery and all approaches to rectal surgery.

CONCLUSION

This review provides an overview of current training methods and assessment tools and identifies where more research is needed based on the quality of the studies and the current validity evidence.

The deconstructed procedural description in robotic colorectal surgery

Increasing robotic surgical utilisation in colorectal surgery internationally has strengthened the need for standardised training. Deconstructed procedural descriptions identify components of an operation that can be integrated into proficiency-based progression training. This approach allows both access to skill level appropriate training opportunities and objective and comparable assessment. Robotic colorectal surgery has graded difficulty of operative procedures lending itself ideally to component training. Developing deconstructed procedural descriptions may assist in the structure and progression components in robotic colorectal surgical training. There is no currently published guide to procedural descriptions in robotic colorectal surgical or assessment of their training utility. This scoping review was conducted in June 2022 following the PRISMA-ScR guidelines to identify which robotic colorectal surgical procedures have available component-based procedural descriptions. Secondary aims were identifying the method of development of these descriptions and how they have been adapted in a training context. 20 published procedural descriptions were identified covering 8 robotic colorectal surgical procedures with anterior resection the most frequently described procedure. Five publications included descriptions of how the procedural description has been utilised for education and training. From these publications terminology relating to using deconstructed procedural descriptions in robotic colorectal surgical training is proposed. Development of deconstructed robotic colorectal procedural descriptions (DPDs) in an international context may assist in the development of a global curriculum of component operating competencies supported by objective metrics. This will allow for standardisation of robotic colorectal surgical training and supports a proficiency-based training approach.

Evaluation of objective tools and artificial intelligence in robotic surgery technical skills assessment: a systematic review

BACKGROUND

There is a need to standardize training in robotic surgery, including objective assessment for accreditation. This systematic review aimed to identify objective tools for technical skills assessment, providing evaluation statuses to guide research and inform implementation into training curricula.

METHODS

A systematic literature search was conducted in accordance with the PRISMA guidelines. Ovid Embase/Medline, PubMed and Web of Science were searched. Inclusion criterion: robotic surgery technical skills tools. Exclusion criteria: non-technical, laparoscopy or open skills only. Manual tools and automated performance metrics (APMs) were analysed using Messick's concept of validity and the Oxford Centre of Evidence-Based Medicine (OCEBM) Levels of Evidence and Recommendation (LoR). A bespoke tool analysed artificial intelligence (AI) studies. The Modified Downs-Black checklist was used to assess risk of bias.

RESULTS

Two hundred and forty-seven studies were analysed, identifying: 8 global rating scales, 26 procedure-/task-specific tools, 3 main error-based methods, 10 simulators, 28 studies analysing APMs and 53 AI studies. Global Evaluative Assessment of Robotic Skills and the da Vinci Skills Simulator were the most evaluated tools at LoR 1 (OCEBM). Three procedure-specific tools, 3 error-based methods and 1 non-simulator APMs reached LoR 2. AI models estimated outcomes (skill or clinical), demonstrating superior accuracy rates in the laboratory with 60 per cent of methods reporting accuracies over 90 per cent, compared to real surgery ranging from 67 to 100 per cent.

CONCLUSIONS

Manual and automated assessment tools for robotic surgery are not well validated and require further evaluation before use in accreditation processes.PROSPERO: registration ID CRD42022304901.

Utilising an accelerated Delphi process to develop consensus on the requirement and components of a pre-procedural core robotic surgery curriculum

Robot-assisted surgery (RAS) continues to grow globally. Despite this, in the UK and Ireland, it is estimated that over 70% of surgical trainees across all specialities have no access to robot-assisted surgical training (RAST). This study aimed to provide educational stakeholders guidance on a pre-procedural core robotic surgery curriculum (PPCRC) from the perspective of the end user; the surgical trainee. The study was conducted in four Phases: P1: a steering group was formed to review current literature and summarise the evidence, P2: Pan-Specialty Trainee Panel Virtual Classroom Discussion, P3: Accelerated Delphi Process and P4: Formulation of Recommendations. Forty-three surgeons in training representing all surgical specialties and training levels contributed to the three round Delphi process. Additions to the second- and third-round surveys were formulated based on the answers and comments from previous rounds. Consensus opinion was defined as ≥ 80% agreement. There was 100% response from all three rounds. The resulting formulated guidance showed good internal consistency, with a Cronbach alpha of > 0.8. There was 97.7% agreement that a standardised PPCRC would be advantageous to training and that, independent of speciality, there should be a common approach (95.5% agreement). Consensus was reached in multiple areas: 1. Experience and Exposure, 2. Access and context, 3. Curriculum Components, 4 Target Groups and Delivery, 5. Objective Metrics, Benchmarking and Assessment. Using the Delphi methodology, we achieved multispecialty consensus among trainees to develop and reach content validation for the requirements and components of a PPCRC. This guidance will benefit from further validation following implementation.

The current status of robotic colorectal surgery training programmes

Robotic-assisted colorectal surgery (RACS) is steadily increasing in popularity with an annual growth in the number of colorectal procedures undertaken robotically. Further upscaling of RACS requires structured and standardised robotic training to safeguard high-quality clinical outcomes. The aims of this systematic review were to assess the structure and assessment metrics of currently established RACS training programmes. A systematic review following Preferred Reporting Items for Systematic Reviews and Meta-analysis guidelines was performed. Searches were performed of the Ovid Medline, Embase and Web of Science databases between 2000 and 27th November 2021 to identify studies reporting on training curricula in RACS. Core components of training programmes and their relevant outcome assessment metrics were extracted. Thirteen studies were identified, with all training programmes designed for the da Vinci platform (Intuitive Surgical, Inc., Sunnyvale, CA, USA). Common elements of multimodal programmes included theoretical knowledge (76.9%), case observation (53.8%), simulation (100%) and proctored training (76.9%). Robotic skills acquisition was assessed primarily during the simulation phase (n = 4, 30.1%) and proctoring phase (n = 10, 76.9%). Performance metrics, consisting of time or assessment scores for VR simulation were only mandated in four (30.1%) studies. Objective assessment following proctored training was variably reported and employed a range of assessment metrics, including direct feedback (n = 3, 23.1%) or video feedback (n = 8, 61.5%). Five (38.4%) training programmes used the Global Assessment Score (GAS) forms. There is a broad consensus on the core multimodal components across current RACS training programmes; however, validated objective assessment is limited and needs to be appropriately standardised to ensure reproducible progression criteria and competency-based metrics are produced to robustly assess progression and competence.

Training curriculum in minimally invasive emergency digestive surgery: 2022 WSES position paper

BACKGROUND

Minimally invasive surgery (MIS), including laparoscopic and robotic approaches, is widely adopted in elective digestive surgery, but selectively used for surgical emergencies. The present position paper summarizes the available evidence concerning the learning curve to achieve proficiency in emergency MIS and provides five expert opinion statements, which may form the basis for developing standardized curricula and training programs in emergency MIS.

METHODS

This position paper was conducted according to the World Society of Emergency Surgery methodology. A steering committee and an international expert panel were involved in the critical appraisal of the literature and the development of the consensus statements.

RESULTS

Thirteen studies regarding the learning curve in emergency MIS were selected. All but one study considered laparoscopic appendectomy. Only one study reported on emergency robotic surgery. In most of the studies, proficiency was achieved after an average of 30 procedures (range: 20-107) depending on the initial surgeon's experience. High heterogeneity was noted in the way the learning curve was assessed. The experts claim that further studies investigating learning curve processes in emergency MIS are needed. The emergency surgeon curriculum should include a progressive and adequate training based on simulation, supervised clinical practice (proctoring), and surgical fellowships. The results should be evaluated by adopting a credentialing system to ensure quality standards. Surgical proficiency should be maintained with a minimum caseload and constantly evaluated. Moreover, the training process should involve the entire surgical team to facilitate the surgeon's proficiency.

CONCLUSIONS

Limited evidence exists concerning the learning process in laparoscopic and robotic emergency surgery. The proposed statements should be seen as a preliminary guide for the surgical community while stressing the need for further research.

A systematic review of robotic surgery curricula using a contemporary educational framework

BACKGROUND

There has been a rising trend in robotic surgery. Thus, there is demand for a robotic surgery curriculum (RSC) for training surgical trainees and practicing surgeons. There are limited data available about current curricular designs and the extent to which they have incorporated educational frameworks. Our aim was to study the existing robotic surgery curricula using Kern's 6-step approach in curriculum development.

METHODS

A systematic review was conducted using PubMed, PubMed Central, Cochrane, Embase, and Scopus (we searched studies from 2001 to 2021). PRISMA Guidelines was used to guide the search. Curriculum designed for general surgery and its subspecialties were included. Urology and gynecology were excluded. The articles were reviewed by five reviewers.

RESULTS

Our review yielded 71 articles, including 39 curricula at 9 different settings. Using Kern's framework, we demonstrated that the majority of robotic surgery curricula contained all the elements of Kern's curricular design. However, there were significant deficiencies in important aspects of these curricula i.e., implementation, the quality of assessment tools for measurement of performance and evaluation of the educational value of these interventions. Most institutions used commercial virtual reality simulators (VRS) as the main component of their RSC and 23% of curricula only used VRS.

CONCLUSIONS

Although majority of these studies contained all the elements of Kern's framework, there are critical deficiencies in the components of existing curricula. Future curricula should be designed using established educational frameworks to improve the quality of robotic surgery training.

Robotic gastrointestinal surgery: learning curve, educational programs and outcomes

The use of the robotic platform for gastrointestinal surgery was introduced nearly 20 years ago. However, significant growth and advancement has occurred primarily in the last decade. This is due to several advantages over traditional laparoscopic surgery allowing for more complex dissections and reconstructions. Several randomized controlled trials and retrospective reviews have demonstrated equivalent oncologic outcomes compared to open surgery with improved short-term outcomes. Unfortunately, there are currently no universally accepted or implemented training programs for robotic surgery and robotic surgery experience varies greatly. Additionally, several limitations to the robotic platform exist resulting in a distinct learning curve associated with various procedures. Therefore, implementation of robotic surgery requires a multidisciplinary team approach with commitment and investment from clinical faculty, operating room staff and hospital administrators. Additionally, there is a need for wider distribution of educational modules to train more surgeons and reduce the associated learning curve. This article will focus on the implementation of the robotic platform for surgery of the pancreas, stomach, liver, colon and rectum with an emphasis on the associated learning curve, educational platforms to develop proficiency and perioperative outcomes.

Applying the Delphi process for development of a hepatopancreaticobiliary robotic surgery training curriculum

BACKGROUND

Robotic hepatopancreaticobiliary (HPB) procedures are performed worldwide and establishing processes for safe adoption of this technology is essential for patient benefit. We report results of the Delphi process to define and optimize robotic training procedures for HPB surgeons.

METHODS

In 2019, a robotic HPB surgery panel with an interest in surgical training from the Americas and Europe was created and met. An e-consensus-finding exercise using the Delphi process was applied and consensus was defined as 80% agreement on each question. Iterations of anonymous voting continued over three rounds.

RESULTS

Members agreed on several points: there was need for a standardized robotic training curriculum for HPB surgery that considers experience of surgeons and based on a robotic hepatectomy includes a common approach for "basic robotic skills" training (e-learning module, including hardware description, patient selection, port placement, docking, troubleshooting, fundamentals of robotic surgery, team training and efficiency, and emergencies) and an "advanced technical skills curriculum" (e-learning, including patient selection information, cognitive skills, and recommended operative equipment lists). A modular approach to index procedures should be used with video demonstrations, port placement for index procedure, troubleshooting, and emergency scenario management information. Inexperienced surgeons should undergo training in basic robotic skills and console proficiency, transitioning to full procedure training of e-learning (video demonstration, simulation training, case observation, and final evaluation). Experienced surgeons should undergo basic training when using a new system (e-learning, dry lab, and operating room (OR) team training, virtual reality modules, and wet lab; case observations were unnecessary for basic training) and should complete the advanced index procedural robotic curriculum with assessment by wet lab, case observation, and OR team training.

CONCLUSIONS

Optimization and standardization of training and education of HPB surgeons in robotic procedures was agreed upon. Results are being incorporated into future curriculum for education in robotic surgery.

Educational note: teaching and training in robotic surgery. An opinion of the Minimally Invasive and Robotic Surgery Committee of the Brazilian College of Surgeons

ABSTRACT With the expansion of robotic surgical procedures, the acquisition of specific knowledge and skills for surgeons to reach proficiency seems essential before performing surgical procedures on humans. In this sense, the authors present a proposal to establish a certification based on objective and validated criteria for carrying out robotic procedures. A study was carried out by the Committee on Minimally Invasive and Robotic Surgery of the Brazilian College of Surgeons based on a reviewing strategy of the scientific literature. The study serves as a reference for the creation of a standard for the qualification and certification in robotic surgery according to a statement of the Brazilian Medical Association (AMB) announced on December 17, 2019. The standard proposes a minimum curriculum, integrating training and performance evaluation. The initial (pre-clinical) stage aims at knowledge and adaptation to a specific robotic platform and the development of psychomotor skills based on surgical simulation. Afterwards, the surgeon must accompany in person at least five surgeries in the specialty, participate as a bedside assistant in at least 10 cases and perform 10 surgeries under the supervision of a preceptor surgeon. The surgeon who completes all the steps will be considered qualified in robotic surgery in his specialty. The final certification must be issued by the specialty societies affiliated to AMB. The authors conclude that the creation of a norm for habilitation in robotic surgery should encourage Brazilian hospitals to apply objective qualification criteria for this type of procedure to qualify assistance.

Outcomes from the Delphi process of the Thoracic Robotic Curriculum Development Committee

OBJECTIVES

As the adoption of robotic procedures becomes more widespread, additional risk related to the learning curve can be expected. This article reports the results of a Delphi process to define procedures to optimize robotic training of thoracic surgeons and to promote safe performance of established robotic interventions as, for example, lung cancer and thymoma surgery.

METHODS

In June 2016, a working panel was spontaneously created by members of the European Society of Thoracic Surgeons (ESTS) and European Association for Cardio-Thoracic Surgery (EACTS) with a specialist interest in robotic thoracic surgery and/or surgical training. An e-consensus-finding exercise using the Delphi methodology was applied requiring 80% agreement to reach consensus on each question. Repeated iterations of anonymous voting continued over 3 rounds.

RESULTS

Agreement was reached on many points: a standardized robotic training curriculum for robotic thoracic surgery should be divided into clearly defined sections as a staged learning pathway; the basic robotic curriculum should include a baseline evaluation, an e-learning module, a simulation-based training (including virtual reality simulation, Dry lab and Wet lab) and a robotic theatre (bedside) observation. Advanced robotic training should include e-learning on index procedures (right upper lobe) with video demonstration, access to video library of robotic procedures, simulation training, modular console training to index procedure, transition to full-procedure training with a proctor and final evaluation of the submitted video to certified independent examiners.

CONCLUSIONS

Agreement was reached on a large number of questions to optimize and standardize training and education of thoracic surgeons in robotic activity. The production of the content of the learning material is ongoing.

Structured training program in colorectal surgery: the robotic surgeon as a new paradigm

BACKGROUND

One major issue in general surgery is how to provide novice surgeons with a structured training program (STP). The aim of our study was to assess the efficacy of a STP in robotic colorectal surgery for young surgeons without prior experience in both open and laparoscopic colorectal surgery, who were autonomous in basic minimally-invasive surgical procedures. Right colectomy with intracorporeal anastomosis has been chosen as a model.

METHODS

Between May 2015 and December 2017 two junior attending surgeons were trained through a STP. Right colectomy was divided into three main learning modules (colonic mobilization, vascular control, intracorporeal anastomosis) and each one was carried out by the trainees for at least two times under direct supervision of the senior surgeon. After the initial robotic cases completely performed under formal proctoring, they were privileged to perform robotic right colectomy independently without a mentor (20 procedures). Operative time, conversion rate, intra- and postoperative complications, length of stay and pathological outcomes were the variables analyzed to assess the effectiveness of the STP.

RESULTS

The mean operative time was 200 minutes and no conversion was required. Neither intraoperative nor major postoperative complications were recorded and the mean length of hospital stay was 6 days. Mean nodal yield was 21.

CONCLUSIONS

A STP in robotic colorectal surgery is feasible and effective. Right colectomy represents a good model as first step of the program in order to develop multiple technical skills. Previous experience in open or laparoscopic colorectal surgery may not be necessary.

The Effect of Formal Robotic Residency Training on the Adoption of Minimally Invasive Surgery by Young Colorectal Surgeons

OBJECTIVE

The minimally invasive approach to colorectal surgery is still underused. Only 50% to 60% of colectomies and 10% to 20% of rectal resections for cancer are performed laparoscopically. The increasing adoption of the robotic platform for colorectal surgery warrants re-evaluation of minimally invasive surgery (MIS) training techniques. Although considering lessons learned from past laparoscopic training, a standardized national robotic training program for colon and rectal surgery residents was developed and implemented in 2011. The objective of this study was to assess the effect of this program on the usage of MIS in practice following residency training.

DESIGN

An internet-based 18 question survey was sent to all colon and rectal surgeons who graduated from ACGME-approved colon and rectal surgery residencies from 2013 to 2016. The survey questions were designed to determine MIS practice patterns for young colon and rectal surgeons after residency training for those who participated in the standardized national robotics training course when compared to those who did not participate. Grouped bar charts with error bars are presented along with summary statistics to offer a descriptive overview of training experiences by cohort.

SETTING/PARTICIPANTS

This study is a survey of colon and rectal surgeons who completed colon and rectal surgery residencies to include all 52 programs across the United States.

RESULTS

The overall survey response rate was 37.2% (109 of 293). Most (79.8%) of the colon and rectal surgery resident respondents participated in the formal robotic training course. The average respondent reported that 84% of colectomy cases and 74.8% of rectal resections done after residency training by all respondents were by the MIS approach. The laparoscopic approach was most prevalent for colectomies for both course participants (laparoscopic 55.1%, hand assisted lap 14.5%, and robotic 15.7%) and nonparticipants (laparoscopic 53.8%, hand assisted lap 12.3%, and robotic 15.9%). For rectal resections, the robotic approach was the preferred option for course participants (laparoscopic 24.5%, hand assist lap 14.0%, and robotic 39.2%) whereas laparoscopic and open approaches were used more often by nonparticipants (laparoscopic 36.8%, hand assist lap 8.0%, robotic 26.8%, and open 28.4%). Barriers to robotic implementation included lack of robotic mentors, inadequate robotic assistance, and the preference for the laparoscopic approach.

CONCLUSION

The usage of MIS by young recently fellowship-trained colorectal surgeons is higher than previously reported. The proportion of rectal cases done robotically is higher compared to colon cases and with an apparent decrease in open rather than laparoscopic surgery, suggesting selective usage of robotic surgery for more challenging cases in the pelvis. Methods to more effectively increase the usage of minimally invasive approaches in colorectal surgery warrant further evaluation.

Robotic colorectal surgery: previous laparoscopic colorectal experience is not essential

A background in minimally invasive colorectal surgery (MICS) has been thought to be essential prior to robotic-assisted colorectal surgery (RACS). Our aim was to determine whether MICS is essential prior to starting RACS training based on results from our initial experience with RACS. Two surgeons from our centre received robotic training through the European Academy of Robotic Colorectal Surgery (EARCS). One surgeon had no prior formal MICS training. We reviewed the first 30 consecutive robotic colorectal procedures from a prospectively maintained database between November 2014 and January 2016 at our institution. Fourteen patients were male. Median age was 64.5 years (range 36-82) and BMI was 27.5 (range 20-32.5). Twelve procedures (40%) were performed by the non-MICS-trained surgeon: ten high anterior resections (one conversion), one low anterior resection and one abdomino-perineal resection of rectum (APER). The MICS-trained surgeon performed nine high and four low anterior resections, one APER and in addition three right hemicolectomies and one abdominal suture rectopexy. There were no intra-operative complications and two patients required re-operation. Median post-operative stay was five days (range 1-26). There were two 30-day re-admissions. All oncological resections had clear margins and median node harvest was 18 (range 9-39). Our case series demonstrates that a background in MICS is not essential prior to starting RACS training. Not having prior MICS training should not discourage surgeons from considering applying for a robotic training programme. Safe and successful robotic colorectal services can be established after completing a formal structured robotic training programme.