Urology milestones

Changing the Status Quo: Developing a Virtual Sub-Internship in the Era of COVID-19

PROBLEM

Subinternships are integral to medical education as tools for teaching and assessing fourth-year medical students. Social distancing due to COVID-19 has precluded the ability to offer in-person subinternships - negatively impacting medical education and creating uncertainty surrounding the residency match. With no precedent for the development and implementation of virtual subinternships, the Society of Academic Urologists (SAU) developed an innovative and standardized curriculum for the Virtual Subinternship in Urology (vSIU).

METHODS

The vSIU committee's mandate was to create a standardized curriculum for teaching foundational urology and assessing student performance. Thirty-three members from 23 institutions were divided into working groups and given 3 weeks to develop 10 modules based on urologic subspecialties, Accreditation Council for Graduate Medical Education core competencies, technical skills training and student assessment. Working groups were encouraged to develop innovative learning approaches. The final curriculum was assembled into the "vSIU Guidebook."

RESULTS

The vSIU Guidebook contains 212 pages - 64 pages core content and 2 appendices (patient cases and evaluations). It outlines a detailed 4-week curriculum with a sufficient volume of resources to offer a completely adaptable virtual course with the same rigor as a traditional subinternship. Modules contain curated teaching resources including journal articles, lectures, surgical videos and simulated clinical scenarios. Innovative learning tools include reflective writing, mentorship guidelines, videoconference-based didactics, surgical simulcasting and virtual technical skills training. The guidebook was disseminated to program directors nationally.

NEXT STEPS

The vSIU is the first virtual subinternship in any specialty to be standardized and offered nationally, and it was implemented by at least 19 urology programs. This curriculum serves as a template for other specialties looking to develop virtual programs and feedback from educators and students will allow the curriculum to evolve. As the pandemic continues to challenge our paradigm, this rapid and innovative response exemplifies that the medical community will continue to meet the needs of an ever-changing educational landscape.

Crowdsourced Assessment of Ureteroscopy with Laser Lithotripsy Video Feed Does Not Correlate with Trainee Experience

OBJECTIVES

We sought to validate the use of crowdsourced surgical video assessment in the evaluation of urology residents performing flexible ureteroscopic laser lithotripsy.

METHODS

We collected video feeds from 30 intrarenal ureteroscopic laser lithotripsy cases where residents, postgraduate year (PGY) two through six, handled the ureteroscope. The video feeds were annotated to represent overall performance and to contain parts of the procedure being scored. Videos were submitted to a commercially available surgical video evaluation platform (Crowd-Sourced Assessment of Technical Skills). We used a validated ureteroscopic laser lithotripsy global assessment tool that was modified to include only those domains that could be evaluated on the captured video. Videos were evaluated by crowd workers recruited using Amazon's Mechanical Turk platform as well as five endourology-trained experts. Mean scores were calculated and intraclass correlation coefficients (ICCs) were computed for the expert domain and total scores. ICCs were estimated using a linear mixed-effects model. Spearman rank correlation coefficients were calculated as a measure of the strength of the relationships between the crowd mean and expert average scores.

RESULTS

A total of 30 videos were reviewed 2488 times by 487 crowd workers and five expert endourologists. ICCs between expert raters were all below accepted levels of correlation (0.30), with the overall score having an ICC of <0.001. For individual domains, the crowd scores did not correlate with expert scores, except for the stone retrieval domain (0.60 p = 0.015). In addition, crowdsourced scores had a negative correlation with the PGY level (0.44, p = 0.019).

CONCLUSIONS

There is poor agreement between experts and poor correlation between expert and crowd scores when evaluating video feeds of ureteroscopic laser lithotripsy. The use of an intraoperative video of ureteroscopy with laser lithotripsy for assessment of resident trainee skills does not appear reliable. This is further supported by the lack of correlation between crowd scores and advancing PGY level.

Electroencephalographic Monitoring of Brain Wave Activity During Laparoscopic Surgical Simulation to Measure Surgeon Concentration and Stress: Can the Student Become the Master?

PURPOSE

To measure gamma and alpha brain wave activity as a measurement of concentration and stress levels during surgical simulator performance of laparoscopic tasks to determine if expert surgeons have different brain activity patterns compared with intermediate and novice surgeons.

MATERIALS AND METHODS

After obtaining Institutional Review Board approval, 1st and 2nd year medical students, urology residents (PGY2-PGY5), and attending urologists from one institution were recruited. Participants were stratified by level of experience and performed laparoscopic tasks on the EDGE laparoscopic simulator. Subjects were evaluated for concentration and stress levels using the electroencephalography (EEG) data extracted from the MUSE(™) headband. The MUSE software developer kit (SDK) allowed quantification of gamma and alpha waves during each task. An analysis of variance was used to compare concentration and stress levels between groups.

RESULTS

A total of 19 participants were recruited for the study and stratified by surgical experience into novice, intermediate, and expert laparoscopy groups: 6 medical students, 9 urology residents, and 4 attending urologists, respectively. Concentration and stress were quantified by calculating the area under the curve of the gamma and alpha EEG wave tracings. Stress was significantly lower in the attending urologists compared with the residents and medical students during the laparoscopic suturing and trended toward significance in the peg transfer task (P = 0.0003, P = 0.069). Concentration was significantly higher in the expert group compared with the less experienced groups during both the peg and suture tasks (P = 0.036, P = 0.0039).

CONCLUSIONS

EEG brain activity in more experienced surgeons reveals a significant increase in concentration levels with a decrease in stress during simulated laparoscopic tasks compared with novices. This information may correlate with increased proficiency as well as provide objective feedback of progress along the learning curve with the MUSE SDK.

Genetic Counseling Milestones: A Framework for Student Competency Evaluation

Graduate medical education has recently increased focus on the development of medical specialty competency milestones to provide a targeted tool for medical resident evaluation. Milestones provide developmental assessment of the attainment of competencies over the course of an educational program. An educational framework is described to explore the development of Genetic Counseling Milestones for the evaluation of the development of genetic counseling competencies by genetic counseling students. The development of Genetic Counseling Milestones may provide a valuable tool to assess genetic counseling students across all program activities. Historical educational context, current practices, and potential benefits and challenges in the development of Genetic Counseling Milestones are discussed.

The Effect of Resident Involvement on Perioperative Outcomes in Transurethral Urologic Surgeries

OBJECTIVE

To conduct the first study of intra- and postoperative outcomes related to intraoperative resident involvement in transurethral resection procedures for benign prostatic hyperplasia and bladder cancer in a large, multi-institutional database.

DESIGN

Relying on the American College of Surgeons National Surgical Quality Improvement Program Participant User Files (2005-2012), we abstracted all cases of endoscopic prostate surgery (EPS) for benign prostatic hyperplasia and transurethral resection of bladder tumors (TURBTs). Multivariable logistic regression models were constructed to assess the effect of trainee involvement (postgraduate year [PGY] 1-2: junior, PGY 3-4: senior, PGY ≥ 5: chief or fellow) vs attending only on operative time and length of hospital stay, as well as 30-day complication, reoperation, and readmission rates.

RESULTS

In all, 5093 EPS and 3059 TURBTs for a total of 8152 transurethral resection procedures were performed during the study period for which data on resident involvement were available. In multivariable analyses, resident involvement in EPS or TURBT was associated with increased odds of prolonged operative times and hospital readmissions in 30 days independent of resident level of training. Resident involvement was not associated with overall complications or reoperation rates.

CONCLUSIONS

Resident involvement in lower urinary tract surgeries is associated with increased readmissions. Strategies to optimize resident teaching of these common urologic procedures in order to minimize possible risks to patients should be explored.

The impact of resident involvement in minimally-invasive urologic oncology procedures

INTRODUCTION

Robotic and laparoscopic surgical training is an integral part of resident education in urology, yet the effect of resident involvement on outcomes of minimally-invasive urologic procedures remains largely unknown. We assess the impact of resident participation on surgical outcomes using a large multi-institutional prospective database.

METHODS

Relying on the American College of Surgeons National Surgical Quality Improvement Program (ACS-NSQIP) Participant User Files (2005-2011), we abstracted the 3 most frequently performed minimally-invasive urologic oncology procedures. These included radical prostatectomy, radical nephrectomy and partial nephrectomy. Multivariable logistic regression models were constructed to assess the impact of trainee involvement (PGY 1-2: junior, PGY 3-4: senior, PGY ≥5: chief) versus attending-only on operative time, length-of-stay, 30-day complication, reoperation and readmission rates.

RESULTS

A total of 5459 minimally-invasive radical prostatectomies, 1740 minimally-invasive radical nephrectomies and 786 minimally-invasive partial nephrectomies were performed during the study period, for which data on resident surgeon involvement was available. In multivariable analyses, resident involvement was not associated with increased odds of overall complications, reoperation, or readmission rates for minimally-invasive prostatectomy, radical and partial nephrectomy. However, operative time was prolonged when residents were involved irrespective of the type of procedure. Length-of-stay was decreased with senior resident involvement in minimally-invasive partial nephrectomies (odds ratio [OR] 0.49, p = 0.04) and prostatectomies (OR 0.68, p = 0.01). The major limitations of this study include its retrospective observational design, inability to adjust for the case complexity and surgeon/hospital characteristics, and the lack of information regarding the minimally-invasive approach utilized (whether robotic or laparoscopic).

CONCLUSIONS

Resident involvement is associated with increased operative time in minimally-invasive urologic oncology procedures. However, it does not adversely affect the complication, reoperation or readmission rates, as well as length-of-stay.