Orsi Consensus Meeting on European Robotic Training (OCERT): Results from the First Multispecialty Consensus Meeting on Training in Robot-assisted Surgery

Clinical and in vitro application of robotic computer-assisted implant surgery: a scoping review

In recent years, the emergence and application of robotic computer-assisted implant surgery (r-CAIS) has resulted in a revolutionary shift in conventional implant diagnosis and treatment. This scoping review was performed to verify the null hypothesis that r-CAIS has a relatively high accuracy of within 1 mm, with relatively few complications and a short operative time. This review was conducted in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses Extension for Scoping Reviews (PRISMA-ScR). From the 3355 publications identified in the PubMed, Scopus, Web of Science, and Google Scholar databases, 28 were finally included after a comprehensive review and analysis. The null hypothesis is partly accepted, as r-CAIS has a relatively high accuracy (coronal and apical deviation within 1 mm), and no significant adverse events or complications have been reported to date, although additional confirmatory studies are needed. However, there is insufficient evidence for a shorter surgical time, and further clinical research on this topic is required.

IMRA/SRS Delphi consensus on international standards for common core components of robotic surgical training design

Robotic surgery has expanded internationally at pace. There are multiple local robotic training pathways but there is inconsistency in standardisation of core common components for curricula internationally. A framework is required to define key objectives that can be implemented across robotic training ecosystems. This Delphi consensus aimed to provide recommendations for core considerations in robotic training design across diverse training environments internationally. A literature search was performed and an international steering committee (AG, KL, JW, HM, TC) proposed key components for contemporary robotic training design and a modified Delphi approach was used to gather stakeholder opinion. The outcomes were then discussed at a face-to-face international expert consensus at the IMRA educational session at the Society of Robotic Surgery (SRS) meeting and final voting was conducted on outstanding items. Stakeholders included robotic surgeons, proctors, trainees and robotic surgical training providers. There was consensus achieved in 139 statements organised into 15 themes. There was 100% agreement that standardised themes in robotic curricula may improve patient safety. Key take-home messages include-training curricula should be multiplatform, non-technical skills are an important component of a robotic curriculum as well as console and bedside skills, clinically relevant performance metrics should be used for assessment where available, the reliance on cadaveric and live animal models should be reduced as high-fidelity synthetic models emerge, and stepwise component training is useful for advanced procedural training. These consensus recommendations are intended to guide design of fit for purpose contemporary robotic surgical curricula. Integration of these components into robotic training pathways internationally is recommended.

Simulation-based training in robotic surgery education: bibliometric analysis and visualization

Simulation-based robotic surgery training may help surgeons gain operative skills and experience in the simulation environment. This bibliometric analysis examined the development of simulation-based training for robotic surgical education. Articles pertaining to robotic surgical simulation training that were included in the Web of Science Core Collection up to April 25, 2024, were included. The temporal patterns in published paper numbers were evaluated using Microsoft Excel software, and the data regarding co-authorship and keyword co-occurrence were analyzed and visualized using the VOSviewer and SCImago Graphica tools. A total of 594 papers on simulation-based training for robotic surgical education were evaluated in this study. The United States and United Kingdom were the leading contributors in this field. The most published authors were Professor Ahmed Kamran (23 publications) and Prokar Dasgupta (22 publications). The highest number of papers was published in the journal titled "Surgical Endoscopy and Other Interventional Techniques." The most common keywords were "virtual reality," "curriculum," "robotic surgery simulator," "assessment," and "learning curve." Our study offers a detailed overview of international research on simulation-based training for robotic surgical education, including the publishing countries, institutions, authors, journals, and research hotspots. It also methodically summarizes the state of knowledge in the area, and provides definite directions and concepts for further in-depth analysis.

The training pathway for residents: 'Robotic Curriculum for young Surgeons' (RoCS) does not impair patient outcome during implementation into clinical routine

The "Robotic Curriculum for young Surgeons" (RoCS) was launched 03/2020 to address the increasing importance of robotics in surgical training. It aims to provide residents with foundational robotic skills by involving them early in their training. This study evaluated the impact of RoCS' integration into clinical routine on patient outcomes. Two cohorts were compared regarding the implementation of RoCS: Cohort 1 (before RoCS) included all robot-assisted procedures between 2017 and 03/2020 (n = 174 adults) retrospectively; Cohort 2 (after RoCS) included all adults (n = 177) who underwent robotic procedures between 03/2020 and 2021 prospectively. Statistical analysis covered demographics, perioperative parameters, and follow-up data, including mortality and morbidity. Subgroup analysis for both cohorts was organ-related (upper gastrointestinal tract (UGI), colorectal (CR), hepatopancreaticobiliary system (HPB)). Sixteen procedures were excluded due to heterogeneity. In-hospital, 30-, 90-day morbidity and mortality showed no significant differences between both cohorts, including organ-related subgroups. For UGI, no significant intraoperative parameter changes were observed. Surgery duration decreased significantly in CR and HPB procedures (p = 0.018 and p < 0.001). Estimated blood loss significantly decreased for CR operations (p = 0.001). The conversion rate decreased for HPB operations (p = 0.005). Length of hospitalization decreased for CR (p = 0.015) and HPB (p = 0.006) procedures. Oncologic quality, measured by histopathologic R0-resections, showed no significant changes. RoCS can be safely integrated into clinical practice without compromising patient safety or oncologic quality. It serves as an effective training pathway to guide robotic novices through their first steps in robotic surgery, offering promising potential for skill acquisition and career advancement.

Development and evaluation of a societal core robotic surgery accreditation curriculum for the UK

Standardised proficiency-based progression is the cornerstone of safe robotic skills acquisition, however, is currently lacking within surgical training curricula. Expert consensuses have defined a modular pathway to accredit surgeons. This study aimed to address the lack of a formal, pre-clinical core robotic skills, proficiency-based accreditation curriculum in the UK. Novice robotic participants underwent a four-day pre-clinical core robotic skills curriculum incorporating multimodal assessment. Modifiable-Global Evaluative Assessment of Robotic Skills (M-GEARS), VR-automated performance metrics (APMs) and Objective Clinical Human Reliability Analysis (OCHRA) error methodology assessed performance at the beginning and end of training. Messick's validity concept and a curriculum evaluation model were utilised. Feedback was collated. Proficiency-based progression, benchmarking, tool validity and reliability was assessed through comparative and correlational statistical methods. Forty-seven participants were recruited. Objective assessment of VR and dry models across M-GEARS, APMs and OCHRA demonstrated significant improvements in technical skill (p < 0.001). Concurrent validity between assessment tools demonstrated strong correlation in dry and VR tasks (r = 0.64-0.92, p < 0.001). OCHRA Inter-rater reliability was excellent (r = 0.93, p < 0.001 and 81% matched error events). A benchmark was established with M-GEARS and for the curriculum at 80%. Thirty (63.82%) participants passed. Feedback was 5/5 stars on average, with 100% recommendation. Curriculum evaluation fulfilled all five domains of Messick's validity. Core robotic surgical skills training can be objectively evaluated and benchmarked to provide accreditation in basic robotic skills. A strategy is necessary to enrol standardised curricula into national surgical training at an early stage to ensure patient safety.

Current Standards for Training in Robot-assisted Surgery and Endourology: A Systematic Review

BACKGROUND AND OBJECTIVE

Different training programs have been developed to improve trainee outcomes in urology. However, evidence on the optimal training methodology is sparse. Our aim was to provide a comprehensive description of the training programs available for urological robotic surgery and endourology, assess their validity, and highlight the fundamental elements of future training pathways.

METHODS

We systematically reviewed the literature using PubMed/Medline, Embase, and Web of Science databases. The validity of each training model was assessed. The methodological quality of studies on metrics and curricula was graded using the MERSQI scale. The level of evidence (LoE) and level of recommendation for surgical curricula were awarded using the educational Oxford Centre for Evidence-Based Medicine classification.

KEY FINDINGS AND LIMITATIONS

A total of 75 studies were identified. Many simulators have been developed to aid trainees in mastering skills required for both robotic and endourology procedures, but only four demonstrated predictive validity. For assessment of trainee proficiency, we identified 18 in robotics training and six in endourology training; however, the majority are Likert-type scales. Although proficiency-based progression (PBP) curricula demonstrated superior outcomes to traditional training in preclinical settings, only four of six (67%) in robotics and three of nine (33%) in endourology are PBP-based. Among these, the Fundamentals of Robotic Surgery and the SIMULATE curricula have the highest LoE (level 1b). The lack of a quantitative synthesis is the main limitation of our study.

CONCLUSIONS AND CLINICAL IMPLICATIONS

Training curricula that integrate simulators and PBP methodology have been introduced to standardize trainee outcomes in robotics and endourology. However, evidence regarding their educational impact remains restricted to preclinical studies. Efforts should be made to expand these training programs to different surgical procedures and assess their clinical impact.

Delphi consensus project on prostate-specific membrane antigen (PSMA)-targeted surgery-outcomes from an international multidisciplinary panel

PURPOSE

Prostate-specific membrane antigen (PSMA) is increasingly considered as a molecular target to achieve precision surgery for prostate cancer. A Delphi consensus was conducted to explore expert views in this emerging field and to identify knowledge and evidence gaps as well as unmet research needs that may help change practice and improve oncological outcomes for patients.

METHODS

One hundred and five statements (scored by a 9-point Likert scale) were distributed through SurveyMonkey®. Following evaluation, a consecutive second round was performed to evaluate consensus (16 statements; 89% response rate). Consensus was defined using the disagreement index, assessed by the research and development project/University of California, Los Angeles appropriateness method.

RESULTS

Eighty-six panel participants (72.1% clinician, 8.1% industry, 15.1% scientists, and 4.7% other) participated, most with a urological background (57.0%), followed by nuclear medicine (22.1%). Consensus was obtained on the following: (1) The diagnostic PSMA-ligand PET/CT should ideally be taken < 1 month before surgery, 1-3 months is acceptable; (2) a 16-20-h interval between injection of the tracer and surgery seems to be preferred; (3) PSMA targeting is most valuable for identification of nodal metastases; (4) gamma, fluorescence, and hybrid imaging are the preferred guidance technologies; and (5) randomized controlled clinical trials are required to define oncological value. Regarding surgical margin assessment, the view on the value of PSMA-targeted surgery was neutral or inconclusive. A high rate of "cannot answer" responses indicates further study is necessary to address knowledge gaps (e.g., Cerenkov or beta-emissions).

CONCLUSIONS

This Delphi consensus provides guidance for clinicians and researchers that implement or develop PSMA-targeted surgery technologies. Ultimately, however, the consensus should be backed by randomized clinical trial data before it may be implemented within the guidelines.

The transition of surgical simulation training and its learning curve: a bibliometric analysis from 2000 to 2023

BACKGROUND

Proficient surgical skills are essential for surgeons, making surgical training an important part of surgical education. The development of technology promotes the diversification of surgical training types. This study analyzes the changes in surgical training patterns from the perspective of bibliometrics, and applies the learning curves as a measure to demonstrate their teaching ability.

METHOD

Related papers were searched in the Web of Science database using the following formula: TS=[(training OR simulation) AND (learning curve) AND (surgical)]. Two researchers browsed the papers to ensure that the topics of articles were focused on the impact of surgical simulation training on the learning curve. CiteSpace, VOSviewer, and R packages were applied to analyze the publication trends, countries, authors, keywords, and references of selected articles.

RESULT

Ultimately, 2461 documents were screened and analyzed. The USA is the most productive and influential country in this field. Surgical endoscopy and other interventional techniques publish the most articles, while surgical endoscopy and other interventional techniques is the most cited journal. Aggarwal Rajesh is the most productive and influential author. Keyword and reference analyses reveal that laparoscopic surgery, robotic surgery, virtue reality, and artificial intelligence were the hotspots in the field.

CONCLUSION

This study provided a global overview of the current state and future trend in the surgical education field. The study surmised the applicability of different surgical simulation types by comparing and analyzing the learning curves, which is helpful for the development of this field.

European Robotic Surgery Consensus (ERSC): Protocol for the development of a consensus in robotic training for gastrointestinal surgery trainees

BACKGROUND

The rapid adoption of robotic surgical systems across Europe has led to a critical gap in training and credentialing for gastrointestinal (GI) surgeons. Currently, there is no existing standardised curriculum to guide robotic training, assessment and certification for GI trainees. This manuscript describes the protocol to achieve a pan-European consensus on the essential components of a comprehensive training programme for GI robotic surgery through a five-stage process.

METHODS AND ANALYSIS

In Stage 1, a Steering Committee, consisting of international experts, trainees and educationalists, has been established to lead and coordinate the consensus development process. In Stage 2, a systematic review of existing multi-specialty robotic training curricula will be performed to inform the formulation of key position statements. In Stage 3, a comprehensive survey will be disseminated across Europe to capture the current state of robotic training and identify potential challenges and opportunities for improvement. In Stage 4, an international panel of GI surgeons, trainees, and robotic theatre staff will participate in a three-round Delphi process, seeking ≥ 70% agreement on crucial aspects of the training curriculum. Industry and patient representatives will be involved as external advisors throughout this process. In Stage 5, the robotic training curriculum for GI trainees will be finalised in a dedicated consensus meeting, culminating in the production of an Explanation and Elaboration (E&E) document.

REGISTRATION DETAILS

The study protocol has been registered on the Open Science Framework (https://osf.io/br87d/).

A review of minimal access surgery provision and training within the United Kingdom

When combined with healthcare pressures, the exponential growth of robotic-assisted surgery (RAS) has impacted UK-based training outcomes, including the learning curve to competency. Aim: To ascertain the current provision of RAS and investigate differences in access to minimal access surgical (MAS) facilities and training across the UK. A two-armed electronic survey was conducted. The first arm questioned clinical leads regarding robotic practice and future training provisions. The second investigated trainee and trainers' perceptions of MAS training and facilities. 64% (52/81) of responding trusts utilise a robotic system. The majority (68% [55/81]) have plans to expand or acquire a system within 3 years. 171 responses from 112 UK and Republic of Ireland hospitals were collected for Arm 2. Laparoscopic categories queried whether trainees had access to a formal curriculum, training days and sim-boxes. Most consultants (51.9%) and trainees (51.6%) reported that there was no formal local training curriculum for robotic surgery. Combined responses demonstrated 42.1% (n = 195/463) said "yes", 39.5% (n = 183) "no" and 18.4% (n = 85) "don't know". For combined robotic categories (simulation, training days and operative lists) 28.3% (n = 134/473) responded "yes", 51.6% (n = 244) said "no" and 20.1% (n = 95) said "don't know". This study provides insight into the current provision of robotic-assisted surgery at UK trusts and highlights the need to facilitate regular clinical training and equitable access to MAS simulation within a formal curriculum. This may aid regulation of training in parallel with the expansion of robotic practice and avoid a significant skill acquisition gap and risks to patient safety.

The deconstructed procedural description in robotic colorectal surgery

Increasing robotic surgical utilisation in colorectal surgery internationally has strengthened the need for standardised training. Deconstructed procedural descriptions identify components of an operation that can be integrated into proficiency-based progression training. This approach allows both access to skill level appropriate training opportunities and objective and comparable assessment. Robotic colorectal surgery has graded difficulty of operative procedures lending itself ideally to component training. Developing deconstructed procedural descriptions may assist in the structure and progression components in robotic colorectal surgical training. There is no currently published guide to procedural descriptions in robotic colorectal surgical or assessment of their training utility. This scoping review was conducted in June 2022 following the PRISMA-ScR guidelines to identify which robotic colorectal surgical procedures have available component-based procedural descriptions. Secondary aims were identifying the method of development of these descriptions and how they have been adapted in a training context. 20 published procedural descriptions were identified covering 8 robotic colorectal surgical procedures with anterior resection the most frequently described procedure. Five publications included descriptions of how the procedural description has been utilised for education and training. From these publications terminology relating to using deconstructed procedural descriptions in robotic colorectal surgical training is proposed. Development of deconstructed robotic colorectal procedural descriptions (DPDs) in an international context may assist in the development of a global curriculum of component operating competencies supported by objective metrics. This will allow for standardisation of robotic colorectal surgical training and supports a proficiency-based training approach.

Evaluation status of current and emerging minimally invasive robotic surgical platforms

BACKGROUND

The rapid adoption of robotics within minimally invasive surgical specialties has also seen an explosion of new technology including multi- and single port, natural orifice transluminal endoscopic surgery (NOTES), endoluminal and "on-demand" platforms. This review aims to evaluate the validation status of current and emerging MIS robotic platforms, using the IDEAL Framework.

METHODS

A scoping review exploring robotic minimally invasive surgical devices, technology and systems in use or being developed was performed, including general surgery, gynaecology, urology and cardiothoracics. Systems operating purely outside the abdomen or thorax and endoluminal or natural orifice platforms were excluded. PubMed, Google Scholar, journal reports and information from the public domain were collected. Each company was approached via email for a virtual interview to discover more about the systems and to quality check data. The IDEAL Framework is an internationally accepted tool to evaluate novel surgical technology, consisting of four stages: idea, development/exploration, assessment, and surveillance. An IDEAL stage, synonymous with validation status in this review, was assigned by reviewing the published literature.

RESULTS

21 companies with 23 different robotic platforms were identified for data collection, 13 with national and/or international regulatory approval. Of the 17 multiport systems, 1 is fully evaluated at stage 4, 2 are stage 3, 6 stage 2b, 2 at stage 2a, 2 stage 1, and 4 at the pre-IDEAL stage 0. Of the 6 single-port systems none have been fully evaluated with 1 at stage 3, 3 at stage 1 and 2 at stage 0.

CONCLUSIONS

The majority of existing robotic platforms are currently at the preclinical to developmental and exploratory stage of evaluation. Using the IDEAL framework will ensure that emerging robotic platforms are fully evaluated with long-term data, to inform the surgical workforce and ensure patient safety.

Evaluation of objective tools and artificial intelligence in robotic surgery technical skills assessment: a systematic review

BACKGROUND

There is a need to standardize training in robotic surgery, including objective assessment for accreditation. This systematic review aimed to identify objective tools for technical skills assessment, providing evaluation statuses to guide research and inform implementation into training curricula.

METHODS

A systematic literature search was conducted in accordance with the PRISMA guidelines. Ovid Embase/Medline, PubMed and Web of Science were searched. Inclusion criterion: robotic surgery technical skills tools. Exclusion criteria: non-technical, laparoscopy or open skills only. Manual tools and automated performance metrics (APMs) were analysed using Messick's concept of validity and the Oxford Centre of Evidence-Based Medicine (OCEBM) Levels of Evidence and Recommendation (LoR). A bespoke tool analysed artificial intelligence (AI) studies. The Modified Downs-Black checklist was used to assess risk of bias.

RESULTS

Two hundred and forty-seven studies were analysed, identifying: 8 global rating scales, 26 procedure-/task-specific tools, 3 main error-based methods, 10 simulators, 28 studies analysing APMs and 53 AI studies. Global Evaluative Assessment of Robotic Skills and the da Vinci Skills Simulator were the most evaluated tools at LoR 1 (OCEBM). Three procedure-specific tools, 3 error-based methods and 1 non-simulator APMs reached LoR 2. AI models estimated outcomes (skill or clinical), demonstrating superior accuracy rates in the laboratory with 60 per cent of methods reporting accuracies over 90 per cent, compared to real surgery ranging from 67 to 100 per cent.

CONCLUSIONS

Manual and automated assessment tools for robotic surgery are not well validated and require further evaluation before use in accreditation processes.PROSPERO: registration ID CRD42022304901.

The application of objective clinical human reliability analysis (OCHRA) in the assessment of basic robotic surgical skills

BACKGROUND

Using a validated, objective, and standardised assessment tool to assess progression and competency is essential for basic robotic surgical training programmes. Objective clinical human reliability analysis (OCHRA) is an error-based assessment tool that provides in-depth analysis of individual technical errors. We conducted a feasibility study to assess the concurrent validity and reliability of OCHRA when applied to basic, generic robotic technical skills assessment.

METHODS

Selected basic robotic surgical skill tasks, in virtual reality (VR) and dry lab equivalent, were performed by novice robotic surgeons during an intensive 5-day robotic surgical skills course on da Vinci® X and Xi surgical systems. For each task, we described a hierarchical task analysis. Our developed robotic surgical-specific OCHRA methodology was applied to error events in recorded videos with a standardised definition. Statistical analysis to assess concurrent validity with existing tools and inter-rater reliability were performed.

RESULTS

OCHRA methodology was applied to 272 basic robotic surgical skills tasks performed by 20 novice robotic surgeons. Performance scores improved from the start of the course to the end using all three assessment tools; Global Evaluative Assessment of Robotic Skills (GEARS) [VR: t(19) = - 9.33, p < 0.001] [dry lab: t(19) = - 10.17, p < 0.001], OCHRA [VR: t(19) = 6.33, p < 0.001] [dry lab: t(19) = 10.69, p < 0.001] and automated VR [VR: t(19) = - 8.26, p < 0.001]. Correlation analysis, for OCHRA compared to GEARS and automated VR scores, shows a significant and strong inverse correlation in every VR and dry lab task; OCHRA vs GEARS [VR: mean r = - 0.78, p < 0.001] [dry lab: mean r = - 0.82, p < 0.001] and OCHRA vs automated VR [VR: mean r = - 0.77, p < 0.001]. There is very strong and significant inter-rater reliability between two independent reviewers (r = 0.926, p < 0.001).

CONCLUSION

OCHRA methodology provides a detailed error analysis tool in basic robotic surgical skills with high reliability and concurrent validity with existing tools. OCHRA requires further evaluation in more advanced robotic surgical procedures.

Simulation-based assessment of robotic cardiac surgery skills: An international multicenter, cross-specialty trial

Objective

This study aimed to investigate the validity of simulation-based assessment of robotic-assisted cardiac surgery skills using a wet lab model, focusing on the use of a time-based score (TBS) and modified Global Evaluative Assessment of Robotic Skills (mGEARS) score.

Methods

We tested 3 wet lab tasks (atrial closure, mitral annular stitches, and internal thoracic artery [ITA] dissection) with both experienced robotic cardiac surgeons and novices from multiple European centers. The tasks were assessed using 2 tools: TBS and mGEARS score. Reliability, internal consistency, and the ability to discriminate between different levels of competence were evaluated.

Results

The results demonstrated a high internal consistency for all 3 tasks using mGEARS assessment tool. The mGEARS score and TBS could reliably discriminate between different levels of competence for the atrial closure and mitral stitches tasks but not for the ITA harvesting task. A generalizability study also revealed that it was feasible to assess competency of the atrial closure and mitral stitches tasks using mGEARS but not the ITA dissection task. Pass/fail scores were established for each task using both TBS and mGEARS assessment tools.

Conclusions

The study provides sufficient evidence for using TBS and mGEARS scores in evaluating robotic-assisted cardiac surgery skills in wet lab settings for intracardiac tasks. Combining both assessment tools enhances the evaluation of proficiency in robotic cardiac surgery, paving the way for standardized, evidence-based preclinical training and credentialing.

Clinical trial registry number

NCT05043064.

Robotic-assisted surgery for mid and low rectal cancer: a long but safe learning curve

The number of robotic-assisted procedures for rectal cancer is rising. The risk of this procedure when performed by surgeon with limited robotic experience is unknown and the precise duration of the learning curve debated. We, therefore, aimed to analyze the learning curve and its related safety in a single center before the development of mentoring programs. We prospectively recorded all robotic procedures performed for colorectal cancer between 2015 and 2020 by a single surgeon. Operative times for partial and total proctectomy were analyzed. The learning curve was defined by comparison with the standard duration of the laparoscopic procedure performed in expert centers (published in GRECCAR 5 and GRECCAR 6 trials) and calculated using a cumulative summation for learning curve test (LC-CUSUM). Among the 174 patients operated for colorectal cancer, we analyzed the outcomes of the 89 patients operated by partial and total robotic proctectomy. To reach repeatedly the same surgical duration as laparoscopic procedure for partial or complete proctectomy, the LC-CUSUM identified a learning curve of 57 patients. A severe morbidity in this population, defined by Clavien-Dindo classification ≥ 3, was observed in 15 cases (16.8%) with an anastomotic leak rate of 13.5%. The rate of completeness of mesorectal excision was 90% and the mean number of harvested lymph nodes was 15 (± 9). Using operative time as end-point, the learning curve of rectal cancer robotic surgery identified a cut-off of 57 patients. The technic remained safe with acceptable morbidity and oncological outcomes.

The First Entirely 3D-Printed Training Model for Robot-assisted Kidney Transplantation: The RAKT Box

Background

Robot-assisted kidney transplantation (RAKT) is increasingly performed at selected referral institutions worldwide. However, simulation and proficiency-based progression training frameworks for RAKT are still lacking, making acquisition of the RAKT-specific skill set a critical unmet need for future RAKT surgeons.

Objective

To develop and test the RAKT Box, the first entirely 3D-printed, perfused, hyperaccuracy simulator for vascular anastomoses during RAKT.

Design setting and participants

The project was developed in a stepwise fashion by a multidisciplinary team including urologists and bioengineers via an iterative process over a 3-yr period (November 2019-November 2022) using an established methodology. The essential and time-sensitive steps of RAKT were selected by a team of RAKT experts and simulated using the RAKT Box according to the principles of the Vattituki-Medanta technique. The RAKT Box was tested in the operating theatre by an expert RAKT surgeon and independently by four trainees with heterogeneous expertise in robotic surgery and kidney transplantation.

Surgical procedure

Simulation of RAKT.

Measurements

Video recordings of the trainees' performance of vascular anastomoses using the RAKT Box were evaluated blind by a senior surgeon according to the Global Evaluative Assessment of Robotic Skills (GEARS) and Assessment of Robotic Console Skills (ARCS) tools.

Results and limitations

All participants successfully completed the training session, confirming the technical reliability of the RAKT Box simulator. Tangible differences were observed among the trainees in both anastomosis time and performance metrics. Key limitations of the RAKT Box include lack of simulation of the ureterovesical anastomosis and the need for a robotic platform, specific training instruments, and disposable 3D-printed vessels.

Conclusions

The RAKT Box is a reliable educational tool to train novice surgeons in the key steps of RAKT and may represent the first step toward the definition of a structured surgical curriculum in RAKT.

Patient summary

We describe the first entirely 3D-printed simulator that allows surgeons to test the key steps of robot-assisted kidney transplantation (RAKT) in a training environment before performing the procedure in patients. The simulator, called the RAKT Box, has been successfully tested by an expert surgeon and four trainees. The results confirm its reliability and potential as an educational tool for training of future RAKT surgeons.

Transferability of robotic console skills by early robotic surgeons: a multi-platform crossover trial of simulation training

Robotic surgical training is undergoing a period of transition now that new robotic operating platforms are entering clinical practice. As this occurs, training will need to be adapted to include strategies to train across various consoles. These new consoles differ in multiple ways, with some new vendors using flat screen open source 3D enhanced vision with glasses and differences in design will require surgeons to learn new skills. This process has parallels with aviation credentialling across different aircraft described as type rating. This study was designed to test the hypothesis that technical robotic console operating skills are transferrable across different robotic operating platforms. Ten participants sequentially completed four Mimic®(Surgical Science) simulation exercises on two different robotic operating platforms (DaVinci®, Intuitive Surgical and HUGO™ RAS, Medtronic). Ethical approval and informed consent were obtained for this study. Groups were balanced for key demographics including previous robotic simulator experience. Data for simulation metrics and time to proficiency were collected for each attempt at the simulated exercise and analysed. Qualitative feedback on multi-platform learning was sought via unstructured interviews and a questionnaire. Participants were divided into two groups of 5. Group 1 completed the simulation exercises on console A first then repeated these exercises on console B. Group 2 completed the simulated exercises on console B first then repeated these exercises on console A. Group 1 candidates adapted quicker to the second console and Group 2 candidates reached proficiency faster on the first console. Participants were slower on the second attempt of the final exercise regardless of their allocated group. Quality and efficiency metrics and risk and safety metrics were equivalent across consoles. The data from this investigation suggests that console operating skills are transferrable across different platforms. Overall risk and safety metrics are within acceptable limits regardless of the order of progression of console indicating that training can safely occur across multiple consoles contemporaneously. This data has implications for the design of training and certification as new platforms progress to market and supports a proficiency-based approach.

Proficiency-based progression training for robotic surgery skills training: a randomized clinical trial

OBJECTIVE

To determine whether proficiency-based progression (PBP) training leads to better robotic surgical performance compared to traditional training (TT), given that the value of PBP training for learning robotic surgical skills is unclear.

MATERIALS AND METHODS

The PROVESA trial is a multicentric, prospective, randomized and blinded clinical study comparing PBP training with TT for robotic suturing and knot-tying anastomosis skills. A total of 36 robotic surgery-naïve junior residents were recruited from 16 training sites and 12 residency training programmes. Participants were randomly allocated to metric-based PBP training or the current standard of care TT, and compared at the end of training. The primary outcome was percentage of participants reaching the predefined proficiency benchmark. Secondary outcomes were the numbers of procedure steps and errors made.

RESULTS

Of the group that received TT, 3/18 reached the proficiency benchmark versus 12/18 of the PBP group (i.e. the PBP group were ~10 times as likely to demonstrate proficiency [P = 0.006]). The PBP group demonstrated a 51% reduction in number of performance errors from baseline to the final assessment (18.3 vs 8.9). The TT group demonstrated a marginal improvement (15.94 vs 15.44) in errors made.

CONCLUSIONS

The PROVESA trial is the first prospective randomized controlled trial on basic skills training in robotic surgery. Implementation of a PBP training methodology resulted in superior surgical performance for robotic suturing and knot-tying anastomosis performance. Compared to TT, better surgical quality could be obtained by implementing PBP training for basic skills in robotic surgery.

Assessing the efficacy of dissection gestures in robotic surgery

Our group previously defined a dissection gesture classification system that deconstructs robotic tissue dissection into its most elemental yet meaningful movements. The purpose of this study was to expand upon this framework by adding an assessment of gesture efficacy (ineffective, effective, or erroneous) and analyze dissection patterns between groups of surgeons of varying experience. We defined three possible gesture efficacies as ineffective (no meaningful effect on the tissue), effective (intended effect on the tissue), and erroneous (unintended disruption of the tissue). Novices (0 prior robotic cases), intermediates (1-99 cases), and experts (≥ 100 cases) completed a robotic dissection task in a dry-lab training environment. Video recordings were reviewed to classify each gesture and determine its efficacy, then dissection patterns between groups were analyzed. 23 participants completed the task, with 9 novices, 8 intermediates with median caseload 60 (IQR 41-80), and 6 experts with median caseload 525 (IQR 413-900). For gesture selection, we found increasing experience associated with increasing proportion of overall dissection gestures (p = 0.009) and decreasing proportion of retraction gestures (p = 0.009). For gesture efficacy, novices performed the greatest proportion of ineffective gestures (9.8%, p < 0.001), intermediates commit the greatest proportion of erroneous gestures (26.8%, p < 0.001), and the three groups performed similar proportions of overall effective gestures, though experts performed the greatest proportion of effective retraction gestures (85.6%, p < 0.001). Between groups of experience, we found significant differences in gesture selection and gesture efficacy. These relationships may provide insight into further improving surgical training.

Value-assessment of computer-assisted navigation strategies during percutaneous needle placement

Purpose

Navigational strategies create a scenario whereby percutaneous needle-based interventions of the liver can be guided using both pre-interventional 3D imaging datasets and dynamic interventional ultrasound (US). To score how such technologies impact the needle placement process, we performed kinematic analysis on different user groups.

Methods

Using a custom biopsy phantom, three consecutive exercises were performed by both novices and experts (n = 26). The exercise came in three options: (1) US-guidance, (2) US-guidance with pre-interventional image-registration (US + Reg) and (3) US-guidance with pre-interventional image-registration and needle-navigation (US + Reg + Nav). The traveled paths of the needle were digitized in 3D. Using custom software algorithms, kinematic metrics were extracted and related to dexterity, decision making indices to obtain overall performance scores (PS).

Results

Kinematic analysis helped quantifying the visual assessment of the needle trajectories. Compared to US-guidance, novices yielded most improvements using Reg (PSavg(US) = 0.43 vs. PSavg(US+Reg) = 0.57 vs. PSavg(US+Reg+Nav) = 0.51). Interestingly, the expert group yielded a reversed trend (PSavg(US) = 0.71 vs PSavg(US+Reg) = 0.58 vs PSavg(US+Reg+Nav) = 0.59).

Conclusion

Digitizing the movement trajectory allowed us to objectively assess the impact of needle-navigation strategies on percutaneous procedures. In particular, our findings suggest that these advanced technologies have a positive impact on the kinematics derived performance of novices.

Does quality assured eLearning provide adequate preparation for robotic surgical skills; a prospective, randomized and multi-center study

Purpose

In particular after the onset of the COVID-19 pandemic, there was a precipitous rush to implement virtual and online learning strategies in surgery and medicine. It is essential to understand whether this approach is sufficient and adequate to allow the development of robotic basic surgical skills. The main aim of the authors was to verify if the quality assured eLearning is sufficient to prepare individuals to perform a basic surgical robotic task.

Methods

A prospective, randomized and multi-center study was conducted in September 2020 in the ORSI Academy, International surgical robotic training center. Forty-seven participants, with no experience but a special interest in robotic surgery, were matched and randomized into four groups who underwent a didactic preparation with different formats before carrying out a robotic suturing and anastomosis task. Didactic preparation methods ranged from a complete eLearning path to peer-reviewed published manuscripts describing the suturing, knot tying and task assessment metrics.

Results

The primary outcome was the percentage of trainees who demonstrated the quantitatively defined proficiency benchmark after learning to complete an assisted but unaided robotic vesico-urethral anastomosis task. The quantitatively defined benchmark was based on the objectively assessed performance (i.e., procedure steps completed, errors and critical errors) of experienced robotic surgeons for a proficiency-based progression (PBP) training course. None of the trainees in this study demonstrated the proficiency benchmarks in completing the robotic surgery task.

Conclusions

PBP-based e-learning methodology is an effective training method avoiding critical errors in the suturing and knotting task. Quality assured online learning is insufficient preparation for robotic suturing and knot tying anastomosis skills.

Trial registration

ClinicalTrials.gov Identifier: NCT04541615.

Opportunities and Problems of the Consensus Conferences in the Care Robotics

Care robots represent an opportunity for the health domain. The use of these devices has important implications. They can be used in surgical operating rooms in important and delicate clinical interventions, in motion, in training-and-simulation, and cognitive and rehabilitation processes. They are involved in continuous processes of evolution in technology and clinical practice. Therefore, the introduction into routine clinical practice is difficult because this needs the stability and the standardization of processes. The agreement tools, in this case, are of primary importance for the clinical acceptance and introduction. The opinion focuses on the Consensus Conference tool and: (a) highlights its potential in the field; (b) explores the state of use; (c) detects the peculiarities and problems (d) expresses ideas on how improve its diffusion.

Review of automated performance metrics to assess surgical technical skills in robot-assisted laparoscopy

INTRODUCTION

Robot-assisted laparoscopy is a safe surgical approach with several studies suggesting correlations between complication rates and the surgeon's technical skills. Surgical skills are usually assessed by questionnaires completed by an expert observer. With the advent of surgical robots, automated surgical performance metrics (APMs)-objective measures related to instrument movements-can be computed. The aim of this systematic review was thus to assess APMs use in robot-assisted laparoscopic procedures. The primary outcome was the assessment of surgical skills by APMs and the secondary outcomes were the association between APM and surgeon parameters and the prediction of clinical outcomes.

METHODS

A systematic review following the PRISMA guidelines was conducted. PubMed and Scopus electronic databases were screened with the query "robot-assisted surgery OR robotic surgery AND performance metrics" between January 2010 and January 2021. The quality of the studies was assessed by the medical education research study quality instrument. The study settings, metrics, and applications were analysed.

RESULTS

The initial search yielded 341 citations of which 16 studies were finally included. The study settings were either simulated virtual reality (VR) (4 studies) or real clinical environment (12 studies). Data to compute APMs were kinematics (motion tracking), and system and specific events data (actions from the robot console). APMs were used to differentiate expertise levels, and thus validate VR modules, predict outcomes, and integrate datasets for automatic recognition models. APMs were correlated with clinical outcomes for some studies.

CONCLUSIONS

APMs constitute an objective approach for assessing technical skills. Evidence of associations between APMs and clinical outcomes remain to be confirmed by further studies, particularly, for non-urological procedures. Concurrent validation is also required.

Potential Contenders for the Leadership in Robotic Surgery

Purpose: To summarize the scientific published literature on new robotic surgical platforms with potential use in the urological field, reviewing their evolution from presentation until the present day. Our goal is to describe the current characteristics and possible prospects for these platforms. Materials and Methods: A nonsystematic search of the PubMed, Cochrane library's Central, EMBASE, MEDLINE, and Scopus databases was conducted to identify scientific literature about new robotic platforms other than the Da Vinci^® system, reviewing their evolution from inception until December 2020. Only English language publications were included. The following keywords were used: "new robotic platforms," "Revo-I robot," "Versius robot," and "Senhance robot." All relevant English-language original studies were analyzed by one author (R.F.) and summarized after discussion with an independent third party (E.M., S.Y., S.P., and M.A.). Results: Since 1995, Intuitive Surgical, Inc., with the Da Vinci surgical system, is the leading company in the robotic surgical market. However, Revo-I^®, Versius^®, and Senhance^® are the other three platforms that recently appeared on the market with available articles published in peer-reviewed journals. Among these three new surgical systems, the Senhance robot has the most substantial scientific proof of its capacity to perform minimally invasive urological surgery and as such, it might become a contender of the Da Vinci robot. Conclusions: The Da Vinci surgical platform has allowed the diffusion of robotic surgery worldwide and showed the different advantages of this type of technique. However, its use has some drawbacks, especially its price. New robotic platforms characterized by unique features are under development. Of note, they might be less expensive compared with the Da Vinci robotic system. We found that these new platforms are still at the beginning of their technical and scientific validation. However, the Senhance robot is in a more advanced stage, with clinical studies supporting its full implementation.

Development and validation of the metric-based assessment of a robotic vessel dissection, vessel loop positioning, clip applying and bipolar coagulation task on an avian model

The evolution of robotic technology and its diffusion does not seem to have been adequately accompanied by the development and implementation of surgeon training programs that ensure skilled and safe device use at the start of the learning curve. The objective of the study is to develop and validate performance metrics for vessel dissection, vessel loop positioning, clip applying and bipolar coagulation using an avian model. Three robotic surgeons and a behavioral scientist characterized the performance metrics of the task according to the proficiency-based progression methodology. Fourteen experienced robotic surgeons from different European countries participated in a modified online Delphi consensus. Eight experienced surgeons and eight novices performed the robotic task twice. In the Delphi meeting, 100% consensus was reached on the performance metrics. Novice surgeons took 26 min to complete the entire task on trial 1 and 20 min on trial 2. Experts took 10.1 min and 9.5 min. On average the Expert Group completed the task 137% faster than the Novice Group. The amount of time to reach the vessel part of the task was also calculated. Novice surgeons took 26 min on trial 1 and 20 min on trial 2. Experts took 5.5 min and 4.8 min. On average the experts reached the vessel 200% faster than the novices. The Expert Group made 155% fewer performance errors than the Novice Group. The mean IRR of video-recorded performance assessments for all metrics was 0.96 (95% confidence intervals (CI) lower = 0.94-upper = 0.98). We report the development and validation for a standard and replicable basic robotic vessel dissection, vessel loop positioning, clip applying and bipolar coagulation task on an avian model. The development of objective performance metrics, based on a transparent and fair methodology (i.e., PBP), is the first fundamental step toward quality assured training. This task developed on the avian model proved to have good results in the validation study.

Evolving robotic surgery training and improving patient safety, with the integration of novel technologies

INTRODUCTION

Robot-assisted surgery is becoming increasingly adopted by multiple surgical specialties. There is evidence of inherent risks of utilising new technologies that are unfamiliar early in the learning curve. The development of standardised and validated training programmes is crucial to deliver safe introduction. In this review, we aim to evaluate the current evidence and opportunities to integrate novel technologies into modern digitalised robotic training curricula.

METHODS

A systematic literature review of the current evidence for novel technologies in surgical training was conducted online and relevant publications and information were identified. Evaluation was made on how these technologies could further enable digitalisation of training.

RESULTS

Overall, the quality of available studies was found to be low with current available evidence consisting largely of expert opinion, consensus statements and small qualitative studies. The review identified that there are several novel technologies already being utilised in robotic surgery training. There is also a trend towards standardised validated robotic training curricula. Currently, the majority of the validated curricula do not incorporate novel technologies and training is delivered with more traditional methods that includes centralisation of training services with wet laboratories that have access to cadavers and dedicated training robots.

CONCLUSIONS

Improvements to training standards and understanding performance data have good potential to significantly lower complications in patients. Digitalisation automates data collection and brings data together for analysis. Machine learning has potential to develop automated performance feedback for trainees. Digitalised training aims to build on the current gold standards and to further improve the 'continuum of training' by integrating PBP training, 3D-printed models, telementoring, telemetry and machine learning.

Utilising an Accelerated Delphi Process to Develop Guidance and Protocols for Telepresence Applications in Remote Robotic Surgery Training

CONTEXT

The role of robot-assisted surgery continues to expand at a time when trainers and proctors have travel restrictions during the coronavirus disease 2019 (COVID-19) pandemic.

OBJECTIVE

To provide guidance on setting up and running an optimised telementoring service that can be integrated into current validated curricula. We define a standardised approach to training candidates in skill acquisition via telepresence technologies. We aim to describe an approach based on the current evidence and available technologies, and define the key elements within optimised telepresence services, by seeking consensus from an expert committee comprising key opinion leaders in training.

EVIDENCE ACQUISITION

This project was carried out in phases: a systematic review of the current literature, a teleconference meeting, and then an initial survey were conducted based on the current evidence and expert opinion, and sent to the committee. Twenty-four experts in training, including clinicians, academics, and industry, contributed to the Delphi process. An accelerated Delphi process underwent three rounds and was completed within 72 h. Additions to the second- and third-round surveys were formulated based on the answers and comments from the previous rounds. Consensus opinion was defined as ≥80% agreement.

EVIDENCE SYNTHESIS

There was 100% consensus regarding an urgent need for international agreement on guidance for optimised telepresence. Consensus was reached in multiple areas, including (1) infrastructure and functionality; (2) definitions and terminology; (3) protocols for training, communication, and safety issues; and (4) accountability including ethical and legal issues. The resulting formulated guidance showed good internal consistency among experts, with a Cronbach alpha of 0.90.

CONCLUSIONS

Using the Delphi methodology, we achieved international consensus among experts for development and content validation of optimised telepresence services for robotic surgery training. This guidance lays the foundation for launching telepresence services in robotic surgery. This guidance will require further validation.

PATIENT SUMMARY

Owing to travel restrictions during the coronavirus disease 2019 (COVID-19) pandemic, development of remote training and support via telemedicine is becoming increasingly important. We report a key opinion leader consensus view on a standardised approach to telepresence.

Development and validation of the objective assessment of robotic suturing and knot tying skills for chicken anastomotic model

BACKGROUND

To improve patient safety, there is an imperative to develop objective performance metrics for basic surgical skills training in robotic surgery.

OBJECTIVE

To develop and validate (face, content, and construct) the performance metrics for robotic suturing and knot tying, using a chicken anastomotic model.

DESIGN, SETTING AND PARTICIPANTS

Study 1: In a procedure characterization, we developed the performance metrics (i.e., procedure steps, errors, and critical errors) for robotic suturing and knot tying, using a chicken anastomotic model. In a modified Delphi panel of 13 experts from four EU countries, we achieved 100% consensus on the five steps, 18 errors and four critical errors (CE) of the task. Study 2: Ten experienced surgeons and nine novice urology surgeons performed the robotic suturing and knot tying chicken anastomotic task. The mean inter-rater reliability for the assessments by two experienced robotic surgeons was 0.92 (95% CI, 0.9-0.95). Novices took 18.5 min to complete the task and experts took 8.2 min. (p = 0.00001) and made 74% more objectively assessed performance errors than the experts (p = 0.000343).

CONCLUSIONS

We demonstrated face, content, and construct validity for a standard and replicable basic anastomotic robotic suturing and knot tying task on a chicken model. Validated, objective, and transparent performance metrics of a robotic surgical suturing and knot tying tasks are imperative for effective and quality assured surgical training.