Expectations versus reality: trainee participation on the robotic console in academic surgery

Behind the pattern: General surgery residsent autonomy in robotic surgery

Objective

Robotic surgery is increasingly utilized and common in general surgery training programs. This study sought to better understand the factors that influence resident operative autonomy in robotic surgery. We hypothesized that resident seniority, surgeon work experience, surgeon robotic-assisted surgery (RAS) case volume, and procedure type influence general surgery residents' opportunities for autonomy in RAS as measured by percentage of resident individual console time (ICT).

Methods

General surgery resident ICT data for robotic cholecystectomy (RC), inguinal hernia (RIH), and ventral hernia (RVH) operations performed on the dual-console Da Vinci surgical robotic system between July 2019 and June 2021 were extracted. Cases with postgraduate year (PGY) 2-5 residents participating as a console surgeon were included. A sequential explanatory mixed-methods approach was undertaken to explore the ICT results and we conducted secondary qualitative interviews with surgeons. Descriptive statistics and thematic analysis were applied.

Results

Resident ICT data from 420 robotic cases (IH 200, RC 121, and VH 99) performed by 20 junior residents (PGY2-3), 18 senior residents (PGY4-5), and 9 attending surgeons were extracted. The average ICT per case was 26.8 % for junior residents and 42.4 % for senior residents. Compared to early-career surgeons, surgeons with over 10 years' work experience gave less ICT to junior (18.2 % vs. 32.0 %) and senior residents (33.9 % vs. 56.6 %) respectively. Surgeons' RAS case volume had no correlation with resident ICT (r = 0.003, p = 0.0003). On average, residents had the most ICT in RC (45.8 %), followed by RIH (36.7 %) and RVH (28.6 %). Interviews with surgeons revealed two potential reasons for these resident ICT patterns: 1) Surgeon assessment of resident training year/experience influenced decisions to grant ICT; 2) Surgeons' perceived operative time pressure inversely affected resident ICT.

Conclusions

This study suggests resident ICT/autonomy in RC, RIH, and RVH are influenced by resident seniority level, surgeon work experience, and procedure type, but not related to surgeon RAS case volume. Design and implementation of an effective robotic training program must consider the external pressures at conflict with increased resident operative autonomy and seek to mitigate them.

Residents underestimate their robotic performance: evaluating resident robotic console participation time

Lack of formal national robotic curriculum results in a void of knowledge regarding appropriate progression of autonomy in robotic general surgery training. One midwestern academic surgical training program has demonstrated that residents expect to independently operate more on the robotic console than they perceive themselves to do. As such, our study sought to evaluate expectations of residents and faculty regarding resident participation versus actual console participation time (CPT) at a community general surgery training program. We surveyed residents and faculty in two phases. Initially, participants were asked to reflect on their perceptions and expectations from the previous six months. The second phase included surveys (collected over six months) after individual cases with subjective estimation of participation versus CPT calculated by the Intuitive Surgical, Inc. MyIntuitive application. Using Mann-Whitney U-Test, we compared resident perceptions of CPT to actual CPT by case complexity and post-graduate year (PGY). Faculty (n = 7) estimated they allowed residents to complete a median of 26-50% of simple and 0-25% of complex cases in the six months prior to the study. They expected senior residents (PGY-4 and PGY-5) to complete more: 51-75% of simple and 26-50% of complex cases. Residents (n = 13), PGY-2-PGY-5, estimated they completed less than faculty perceived (0-25% of simple and 0-25% of complex cases). Sixty-six post-case (after partial colectomy, abdominoperoneal resection, low anterior resection, cholecystectomy, inguinal/ventral hernia repair, and others) surveys were completed. Residents estimated after any case that they had completed 26-50% of the case. However, once examining their MyIntuitive report, they actually completed 51-75% of the case (median). Residents, especially PGY-4 and 5, completed a higher percentage than estimated of robotic cases. Our study confirms that residents can and should complete more of (and increasingly complex) robotic cases throughout training, like the transition of autonomy in open and laparoscopic surgery.

Is Robotic Console Time a Surrogate for Resident Operative Autonomy?

OBJECTIVE

Robotic-assisted surgery is an increasing part of general surgery training, but resident autonomy on the robotic platform can be hard to quantify. Robotic console time (RCT), the percentage of time the resident controls the console, may be an appropriate measure of resident operative autonomy. This study aims to characterize the correlation between objective resident RCT and subjectively scored operative autonomy.

METHODS

Using a validated resident performance evaluation instrument, we collected resident operative autonomy ratings from residents and attendings performing robotic cholecystectomy (RC) and robotic inguinal hernia repair (IH) at a university-based general surgery program between 9/2020-6/2021. We then extracted RCT data from the Intuitive surgical system. Descriptive statistics, t-tests and ANOVA were performed.

RESULTS

A total of 31 robotic operations (13 RC, 18 IH) performed by 4 attending surgeons and 8 residents (4 junior, 4 senior) were matched and included. 83.9% of cases were scored by both attending and resident. The average RCT per case was 35.6%(95% CI 13.0%,58.3%) for junior residents (PGY 2-3) and 59.7%(CI 51.1%,68.3%) for senior residents (PGY 4-5). The mean autonomy evaluated by residents was 3.29(CI 2.85,3.73) out of a maximum score of 5, while the mean autonomy evaluated by attendings was 4.12(CI 3.68,4.55). RCT significantly correlated with subjective evaluations of resident autonomy (r=0.61, p=0.0003). RCT also moderately correlated with resident training level (r=0.5306, p<0.0001). Neither attending robotic experience nor operation type significantly correlated with RCT or autonomy evaluation scores.

CONCLUSIONS

Our study suggests that resident console time is a valid surrogate for resident operative autonomy in robotic cholecystectomy and inguinal hernia repair. RCT may be a valuable measure in objective assessment of residents' operative autonomy and training efficiency. Future investigation into how RCT correlates with subjective and objective autonomy metrics such as verbal guidance or distinguishing critical operative steps is needed to validate the study findings further.

Common Components of General Surgery Robotic Educational Programs

OBJECTIVE

Robotically assisted surgery has become more common in general surgery, but there is limited guidance from the Accreditation Council for Graduate Medical Education (ACGME) regarding this type of training. We sought to determine common elements and differences in the robotic educational curricula developed by general surgery residency programs.

DESIGN

Robotic educational curricula were obtained from the 7 individuals who presented at the workshop, "Robotic Education in General Surgery" at the 2023 Association of Program Directors in Surgery annual meeting.

RESULTS

All 7 general surgery programs had training beginning intern year, required online robotic modules, had at least 1 dedicated simulation training console not used for clinical purposes, and ran dry and wet (tissue) robotic labs at least annually. All programs had bedside and console surgeon case minimums and had administrative support to run the educational programs. Differences existed regarding how training intern year was executed, the simulations required, clinical practice minimum requirements, how progress was monitored over time, and how case numbers were tracked. Some programs had salary support for a director of robotic education.

CONCLUSIONS

There are several common elements to robotic educational curricula in general surgery, however significant variation does exist between programs. Given the frequency of robotic use in general surgery and current lack of standardization, formal guidance from the ACGME specifically regarding robotic education in general surgery residency is warranted.

The robot doesn't lie: real-life validation of robotic performance metrics

BACKGROUND

Degree of resident participation in a case is often used as a surrogate marker for operative autonomy, an essential element of surgical resident training. Previous studies have demonstrated a considerable disagreement between the perceptions of attending surgeons and trainees when it comes to estimating operative participation. The Da Vinci Surgical System dual console interface allows machine generated measurements of trainee's active participation, which has the potential to obviate the need for labor intensive direct observation of surgical procedures. However, the robotic metrics require validation. We present a comparison of operative participation as perceived by the resident, faculty, trained research staff observer (gold standard), and robotic machine generated data.

METHODS

A total of 28 consecutive robotic inguinal hernia repair procedures were observed by research staff. Operative time, percent active time for the resident, and number of handoffs between the resident and attending were recorded by trained research staff in the operating room and the Da Vinci Surgical System. Attending and resident evaluations of operative performance and perceptions of percent active time for the resident were collected using standardized forms and compared with the research staff observed values and the robot-generated console data. Wilcoxon two-sample tests and Pearson Correlation coefficients statistical analysis were performed.

RESULTS

Robotic inguinal hernia repair cases had a mean operative time of 91.3 (30) minutes and an attending-rated mean difficulty of 3.1 (1.26) out of 5. Residents were recorded to be the active surgeon 71.8% (17.7) of the total case time by research staff. There was a strong correlation (r = 0.77) in number of handoffs between faculty and trainee as recorded by the research staff and robot (4.28 (2.01) vs. 5.8 (3.04) respectively). The robotic machine generated data demonstrated the highest degree of association when compared to the gold standard (research staff observed data), with r = 0.98, p < 0.0001. Lower levels of association were seen with resident reported (r = 0.66) perceptions and faculty-reported (r = 0.55) perceptions of resident active operative time.

CONCLUSIONS

Our findings suggest that robot-generated performance metrics are an extremely accurate and reliable measure of intraoperative resident participation indicated by a very strong correlation with the data recorded by research staff's direct observation of the case. Residents demonstrated a more accurate awareness of their degree of participation compared with faculty surgeons. With high accuracy and ease of use, robotic surgical system performance metrics have the potential to be a valuable tool in surgical training and skill assessment.