Entrustable Professional Activities, a tool for addressing gender bias and the Imposter Syndrome?

Resident perspectives on the role of gender in operative experience during general surgery residency training: A mixed-methods study

BACKGROUND

It remains unclear why female general surgery residents perform fewer cases than male peers. This exploratory study investigated possible contributors to gender-based disparities and solutions for improving equity in operative experience.

METHODS

Surveys, including Likert scale and free-text questions, were distributed to 21 accredited general surgery residency programs.

RESULTS

There were 96 respondents, of whom 69% were female. 22% of females personally experienced barriers to operative experience versus 13% of males (p ​= ​0.41), while 52% of female residents believed operative training was affected by gender (p ​= ​0.004). Inductive analysis revealed the most common barrier to operating room participation was floor work/clinical tasks. The most common barrier for female residents was perceived sexism/gender bias, with subthemes of "misidentification," "feeling unwelcome," and "poor trust/autonomy." To improve parity, residents proposed structured program-level review, feedback, and transparent expectations about case assignments.

CONCLUSION

Female general surgery residents believe gender bias impacts training. Further mixed-methods research is crucial to determine the cause of gender-based disparities in operative experience.

Framing our Expectations: Variability in Entrustable Professional Activity Assessments

OBJECTIVE

To determine the ability of surgical trainees and faculty to correctly interpret entrustability of a resident learner in a modeled patient care scenario.

DESIGN

Prospective study utilizing a web-based survey including 4 previously-recorded short videos of resident learners targeted to specific levels of the American Board of Surgery's (ABS) Entrustment Scale. Respondents were asked to choose the entrustment level that best corresponded to their observations of the learner in the video. Responses were subcategorized by low and high entrustment.

SETTING

Online, utilizing the Qualtrics survey platform.

PARTICIPANTS

Survey targeting US surgical trainees and surgical faculty via email and social media. We received 31 complete responses and 2 responses which completed > 1 video assessment question without demographic information (n = 33). Respondents included 10 trainees (32%) and 21 attending surgeons (68%).

RESULTS

Neither faculty nor trainees readily identified the targeted entrustment level for Question 1 (preoperative care of a patient with acute appendicitis with high entrustment, 36% correct), though evaluations of the remaining questions (2 through 4) demonstrated more accuracy (70, 84, and 75% correct, respectively). Faculty were more readily able than trainees to identify low entrustment (level Limited Participation) in intraoperative inguinal hernia repair (95% vs 60%, p = 0.03). After subcategorization to high and low entrustment, both residents and faculty were able to accurately identify entrustment 95% overall.

CONCLUSIONS

Both trainees and attending surgeons were able to identify high- and low-performing residents on short video demonstrations using the ABS EPA entrustment scale. This provides additional evidence in support of the need for frequent observations of EPAs to account for the variability in raters' perceptions in addition to complexity of clinical scenarios. Frame-of-reference training via a video-based platform may also be beneficial for both residents and faculty as an ongoing EPA implementation strategy.

Multi-institutional study examining intraoperative entrustment and resident sex

INTRODUCTION

Single-site studies have found variable associations between gender and entrustment-based interactions during surgical residency. We sought to assess the relationship between resident sex and intraoperative entrustment at multiple institutions.

METHODS

Surgical cases were observed at four university-based training programs. Faculty entrustment and resident entrustability were rated using OpTrust. OpTrust is a validated intraoperative entrustment measurement tool which enables trained third-party raters to objectively score resident and faculty behaviors in the operating room. Independent sample t-tests and regression analysis with cluster adjusted standard errors were used.

RESULTS

337 cases were observed which included 149 residents (54 ​% female) and 97 faculty members (30 ​% female). There was no difference in resident entrustability based on resident sex (p ​= ​0.30). Female residents were more likely to be involved in cases rated as more difficult (p ​= ​0.04). At a single site, male residents scored higher on resident entrustability (p ​= ​0.007) and faculty entrustment (p ​= ​0.022).

CONCLUSION

Entrustment did not differ based on resident sex on a multi-institutional scale; however, at a single site, there was a difference; suggesting there are multi-factorial issues contributing to differences in training.

Gender differences in autonomy and performance assessments in a national cohort of vascular surgery trainees

OBJECTIVE

Gender disparities in surgical training and assessment are described in the general surgery literature. Assessment disparities have not been explored in vascular surgery. We sought to investigate gender disparities in operative assessment in a national cohort of vascular surgery integrated residents (VIRs) and fellows (VSFs).

METHODS

Operative performance and autonomy ratings from the Society for Improving Medical Professional Learning (SIMPL) application database were collected for all vascular surgery participating institutions from 2018 to 2023. Logistic generalized linear mixed models were conducted to examine the association of faculty and trainee gender on faculty and self-assessment of autonomy and performance. Data were adjusted for post-graduate year and case complexity. Random effects were included to account for clustering effects due to participant, program, and procedure.

RESULTS

One hundred three trainees (n = 63 VIRs; n = 40 VSFs; 63.1% men) and 99 faculty (73.7% men) from 17 institutions (n = 12 VIR and n = 13 VSF programs) contributed 4951 total assessments (44.4% by faculty, 55.6% by trainees) across 235 unique procedures. Faculty and trainee gender were not associated with faculty ratings of performance (faculty gender: odds ratio [OR], 0.78; 95% confidence interval [CI], 0.27-2.29; trainee gender: OR, 1.80; 95% CI, 0.76-0.43) or autonomy (faculty gender: OR, 0.99; 95% CI, 0.41-2.39; trainee gender: OR, 1.23; 95% CI, 0.62-2.45) of trainees. All trainees self-assessed at lower performance and autonomy ratings as compared with faculty assessments. However, women trainees rated themselves significantly lower than men for both autonomy (OR, 0.57; 95% CI, 0.43-0.74) and performance (OR, 0.40; 95% CI, 0.30-0.54).

CONCLUSIONS

Although gender was not associated with differences in faculty assessment of performance or autonomy among vascular surgery trainees, women trainees perceive themselves as performing with lower competency and less autonomy than their male colleagues. These findings suggest utility for exploring gender differences in real-time feedback delivered to and received by trainees and targeted interventions to align trainee self-perception with actual operative performance and autonomy to optimize surgical skill acquisition.

A Scoping Review of the Literature on Entrustable Professional Activities in Surgery Residency Programs

OBJECTIVE

Entrustable professional activities (EPAs) are a crucial component of contemporary postgraduate medical education with many surgery residency programs having implemented EPAs as a competency assessment framework to assess and provide feedback on the performance of their residents. Despite broad implementation of EPAs, there is a paucity of evidence regarding the impact of EPAs on the learners and learning environments. A first step in improving understanding of the use and impact of EPAs is by mapping the rising number of EPA-related publications from the field of surgery. The primary objective of this scoping review is to examine the nature, extent, and range of articles on the development, implementation, and assessment of EPAs. The second objective is to identify the experiences and factors that influence EPA implementation and use in practice in surgical specialties.

DESIGN

Scoping review. Four electronic databases (Medline, Embase, Education Source, and ERIC) were searched on January 20, 2022, and then again on July 19, 2023. A quasi-statistical content analysis was employed to quantify and draw meaning from the information related to the development, implementation, assessment, validity, reliability, and experiences with EPAs in the workplace.

PARTICIPANTS

A total of 42 empirical and nonempirical articles were included.

RESULTS

Four thematic categories describe the topic areas in included articles related to: 1) the development and refinement of EPAs, including the multiple steps taken to develop and refine unique EPAs for surgery residency programs; 2) the methods for implementing EPAs; 3) outcomes of EPA use in practice; 4) barriers, facilitators, and areas for improvement for the implementation and use of EPAs in surgical education.

CONCLUSIONS

This scoping review highlights the key trends and gaps from the rapidly increasing number of publications on EPAs in surgery residency, from development to their use in the workplace. Existing EPA studies lack a theoretical and/or conceptual basis; future development and implementation studies should adopt implementation science frameworks to better structure and operationalize EPAs within surgery residency programs.

The Growing Years: Promoting Yourself in the First 5 Years

There are several transitions that must be made to define your new role as an attending surgeon. Establishing these transitions can be difficult but trying to promote yourself while undergoing these awkward transitions can be taxing but nevertheless crucial. Whether you are in private practice trying to obtain referrals to build your practice or in an academic setting where you are trying to find your niche, promoting yourself along the way is imperative for your future growth. There are 3 core transitions in the first 5 years: (1) clinical, (2) professional, and (3) personal.

The influence of resident and faculty gender on assessments in anesthesia competency-based medical education

PURPOSE

Competency-based medical education (CBME) relies on frequent workplace-based assessments of trainees, providing opportunities for conscious and implicit biases to reflect in these assessments. We aimed to examine the influence of resident and faculty gender on performance ratings of residents within a CBME system.

METHODS

This retrospective cohort study took place from August 2017 to January 2021 using resident assessment data from two workplace-based assessments: the Anesthesia Clinical Encounter Assessment (ACEA) and Entrustable Professional Activities (EPAs). Self-reported gender data were also extracted. The primary outcome-gender-based differences in entrustment ratings of residents on the ACEA and EPAs-was evaluated using mixed-effects logistic regression, with differences reported through odds ratios and confidence intervals (α = 0.01). Gender-based differences in the receipt of free-text comments on the ACEA and EPAs were also explored.

RESULTS

In total, 14,376 ACEA and 4,467 EPA assessments were analyzed. There were no significant differences in entrustment ratings on either assessment tool between men and women residents. Regardless of whether assessments were completed by men or women faculty, entrustment rates between men and women residents were not significantly different for any postgraduate year level. Additionally, men and women residents received strengths-related and actions-related comments on both assessments at comparable frequencies, irrespective of faculty gender.

CONCLUSION

We found no gender-based differences in entrustment ratings for both the ACEA and EPAs, which suggests an absence of resident gender bias within this CBME system. Given considerable heterogeneity in rater leniency, future work would be strengthened by using rater leniency-adjusted scores rather than raw scores.

Advancing Urology Resident Surgical Autonomy

PURPOSE OF REVIEW

This paper aims to survey current literature on urologic graduate medical education focusing on surgical autonomy.

RECENT FINDINGS

Affording appropriate levels of surgical autonomy has a key role in the education of urologic trainees and perceived preparedness for independent practice. Recent studies in surgical resident autonomy have demonstrated a reduction in autonomy for trainees in recent years. Efforts to advance the state of modern surgical training include creation of targeted curricula, enhanced with use of surgical simulation, and structured feedback. Decline in surgical autonomy for urology residents may influence confidence after completion of their residency. Further study is needed into the declining levels of urology resident autonomy, how it affects urologists entering independent practice, and what interventions can advance autonomy in modern urologic training.

Resident Operative Autonomy and Attending Verbal Feedback Differ by Resident and Attending Gender

Objectives

This study tests the null hypotheses that overall sentiment and gendered words in verbal feedback and resident operative autonomy relative to performance are similar for female and male residents.

Background

Female and male surgical residents may experience training differently, affecting the quality of learning and graduated autonomy.

Methods

A longitudinal, observational study using a Society for Improving Medical Professional Learning collaborative dataset describing resident and attending evaluations of resident operative performance and autonomy and recordings of verbal feedback from attendings from surgical procedures performed at 54 US general surgery residency training programs from 2016 to 2021. Overall sentiment, adjectives, and gendered words in verbal feedback were quantified by natural language processing. Resident operative autonomy and performance, as evaluated by attendings, were reported on 5-point ordinal scales. Performance-adjusted autonomy was calculated as autonomy minus performance.

Results

The final dataset included objective assessments and dictated feedback for 2683 surgical procedures. Sentiment scores were higher for female residents (95 [interquartile range (IQR), 4-100] vs 86 [IQR 2-100]; P < 0.001). Gendered words were present in a greater proportion of dictations for female residents (29% vs 25%; P = 0.04) due to male attendings disproportionately using male-associated words in feedback for female residents (28% vs 23%; P = 0.01). Overall, attendings reported that male residents received greater performance-adjusted autonomy compared with female residents (P < 0.001).

Conclusions

Sentiment and gendered words in verbal feedback and performance-adjusted operative autonomy differed for female and male general surgery residents. These findings suggest a need to ensure that trainees are given appropriate and equitable operative autonomy and feedback.