Resident and Attending Perceptions of Resident Involvement: An Analysis of ACGME Reporting Guidelines

How Do Resident Surgeons Identify Operative Case Complexity? An Analysis of Resident versus Attending Perceptions

OBJECTIVE

Accurate recognition of patient-related complexity of an operation is critical for appropriate surgical decision making. It is not yet understood whether general surgery residents are able to accurately assess the relative complexity of a given operative case. This study investigates the agreement of case complexity ratings between residents and attending surgeons and explores whether resident-related factors correlate with any discordance in perception of patient-related operative complexity.

DESIGN

Residents and attending surgeons rated the relative complexity of completed cases on a 3 point scale via the SIMPL (Society for Improving Medical Professional Learning) operative assessment smartphone app. Additional trainee demographic data, autonomy ratings, and performance ratings were also obtained from the SIMPL registry for each rated case. Complexity agreement was defined as an equal rating between the resident and attending and assigned a value of zero. Over-estimate ratings were assigned a positive value and under-estimate ratings were assigned a negative value. Trends in complexity agreement were analyzed using descriptive statistics and mixed-effects models.

RESULTS

A total of 43,179 general surgery cases were rated by 1946 categorical general surgery residents and 1520 attending surgeons between 2015 and 2020. Residents and attendings agreed on case complexity in 63.23% of cases, while the residents overestimated complexity in 13.37% of cases and underestimated complexity in 23.40% of cases. Every level of resident except post-graduate year 2 had similar rates of agreement about the complexity of a procedure, while residents who received a higher autonomy rating were more likely to be in agreement with the faculty raters (OR 1.12, 95% CI 1.06-1.19).

CONCLUSIONS

The results of this study suggest that general surgery residents inaccurately perceive the patient-related complexity of a given case approximately one third of the time. Greater experience and operative autonomy appear to be associated with higher complexity agreement. Future research into factors influencing perceived case complexity may provide insight into how to best implement new teaching for surgical residents regarding the concept of case complexity.

Resident Involvement in Hip Arthroscopy Procedures Does Not Affect Short-Term Surgical Outcomes

Purpose

To evaluate whether the presence of residents in hip arthroscopy (HA) procedures affects short-term surgical outcomes.

Methods

The American College of Surgeons National Surgical Quality Improvement Program Database was used to identify patients who underwent HA from 2006 to 2012. Demographic and 30-day outcome variables were compared between cohorts of patients with and without residents. Multivariate logistic regression was used to identify whether resident involvement was an independent risk factor for adverse outcomes. Propensity score matching was performed to control for all demographic and intraoperative variables.

Results

A total of 869 patients (59.7% female) were included in this study, 626 of which reported data on resident involvement. Patients were mostly White (73.4% of cases without a resident, 51.8% with a resident, P < .05). Those with residents were younger (P = .016), had lower modified 5-item frailty index (mFI-5) scores (P = .028), and had fewer cardiac comorbidities (P = .008). There was no difference in diabetic status, dyspnea symptoms, history of chronic obstructive pulmonary disease, renal comorbidity, neurologic comorbidity, cumulative comorbidities, history of bleeding disorders, inpatient vs. outpatient treatment, preoperative functional status, smoking history, and steroid use for chronic conditions. There was no difference in all complications, operative time, length of stay, reoperation, readmission, wound complication, venous thromboembolism, blood transfusions, or sepsis. Propensity score match for demographic and intraoperative differences found no association between resident involvement and increased complications. Resident involvement was not an independent risk factor for all complications studied.

Conclusion

Resident involvement in HA procedures was not a risk factor for 30-day complications between 2006 and 2012. Resident involvement did not increase the risk of adverse outcomes, readmission, reoperation, or length of stay, nor did it significantly increase operative times.

Public Perceptions of General Surgery Residency Training

OBJECTIVE

Patients are integral to surgical training. Understanding our patients' perceptions of surgical training, resident involvement and autonomy is crucial to optimizing surgical education and thus patient care. In the modern, connected world many factors extrinsic to a patient's experience of healthcare may influence their opinion of our training systems (i.e., social media, television shows, and internet searches). The purpose of this article is to contextualize the literature investigating public perceptions of general surgery training to allow us to effect patient education initiatives to optimize both surgical training and patient safety.

DESIGN

This is a perspective including a literature review summarizing the current knowledge of public perceptions of general surgery training.

CONCLUSIONS

Little is published regarding patient and public perceptions of general surgery residency training and the role of residents within this. Current literature demonstrates that the majority of patients are willing to have residents participate in their care. Patients' attitude toward resident involvement in their operation is improved by utilizing educational materials and by ensuring a supervising attending is present within the operating room. These observations, coupled with future work to delve deeper into factors affecting public perceptions of surgical training and resident involvement within this, can guide strategies to improve surgical education.

See None, Do Some, Teach None: An Analysis of the Contemporary Operative Experience as Nonprimary Surgeon

OBJECTIVE

The operative experience of today's general surgery resident has changed, but little is known about the modern experience as nonprimary surgeon. We set out to explore changes in the operative experience of general surgery residents as first assistant (FA) and teaching assistant (TA).

DESIGN, SETTING, AND PARTICIPANTS

This is a review of ACGME national operative log reports from 1990 to 2018. TA and FA cases were analyzed. Statistical analysis was performed using polynomial regression analysis and Kruskal-Wallis test. Statistical significance was set at p < 0.05.

RESULTS

30,260 individuals completed general surgery residency during the study period with medians of 951 (interquartile range: 929-974) total major, 63 (31-184) FA, and 32 (25-48) TA cases. As a proportion of total cases completed, FA cases decreased from 21.8% of the total operative experience in 1990 to 2.5% in 2018, and TA cases declined from 7.4% of the total operative experience in 1990 to 3.5% in 2018. Regression modeling demonstrated that both operative roles decreased over time, but at a progressively decreasing rate, with FA cases reaching a "floor" around 2010 and TA cases reaching a "breakpoint" in 2008 at which time operative volume rebounded and began to increase. Among the core general surgery domains of abdomen and alimentary tract, compositional analysis revealed a decrease across each of the 11 operative subcategories (all p < 0.05) for FA, and for TA, a decrease in 6 of the 11 operative subcategories (stomach, small intestine, large intestine, anorectal, hernia, and biliary, all p < 0.05).

CONCLUSIONS

Over the past 3 decades, the resident operative experience as nonprimary surgeon has decreased dramatically, with today's residents graduating with fewer FA and TA cases. As surgical training has traditionally relied heavily on an apprenticeship model for learning technical skills, it is essential that surgical educators recognize and rectify these trends.

Quantitative Analysis of Surgical Residency Reform: Using Case-Logs to Evaluate Resident Experience

BACKGROUND

Curricular changes at a mid-sized surgical training program were developed to rebalance clinical rotations, optimize education over service, decrease the size of service teams, and integrate apprenticeship-type experiences. This study quantifies the operative experience before and after implementation as part of a mixed-methods program evaluation.

STUDY DESIGN

Retrospective review of case-log data and data from the Accreditation Council for Graduate Medical Education (ACGME) and the American College of Surgeons National Surgical Quality Improvement Program: quality in-training initiative to evaluate case volume pre- and postintervention.

RESULTS

11,365 cases, excluding "first-assistant" and "endoscopic" cases, were logged for an average of 291 and 263 cases/resident pre- and postintervention, respectively. Average case volume increased significantly for postgraduate year (PGY) 3 residents and decreased significantly for PGY 4 residents between the two time periods. Variability was observed among residents at the same PGY level both pre- and postintervention, with coefficients of variation of 6.0% to 34.1% in 2014 to 2015 and 11.2% to 66.8% in 2015 to 2016. Inter-resident variability persisted when comparing a specific procedure between ACGME case-log and quality in-training initiative data sets.

CONCLUSION

The data suggest that inter-resident variability in case load is not an artifact of case logging behavior alone, but may reflect personal preferences and choices in case selection that are not impacted by curriculum change. Logging behavior and accuracy of case-logs may contribute to variability. The shift in case load from PGY 4 to PGY 3 after curriculum implementation requires validation by ongoing analysis of ACGME case-log data.

Crowdsourcing in Surgical Skills Acquisition: A Developing Technology in Surgical Education

BACKGROUND

The application of crowdsourcing to surgical education is a recent phenomenon and adds to increasing demands on surgical residency training. The efficacy, range, and scope of this technology for surgical education remains incompletely defined.

OBJECTIVE

A systematic review was performed using the PubMed database of English-language literature on crowdsourced evaluation of surgical technical tasks up to April 2017.

METHODS

Articles were reviewed, abstracted, and analyzed, and were assessed for quality using the Medical Education Research Study Quality Instrument (MERSQI). Articles were evaluated with eligibility criteria for inclusion. Study information, performance task, subjects, evaluative standards, crowdworker compensation, time to response, and correlation between crowd and expert or standard evaluations were abstracted and analyzed.

RESULTS

Of 63 unique publications initially identified, 13 with MERSQI scores ranging from 10 to 13 (mean = 11.85) were included in the review. Overall, crowd and expert evaluations demonstrated good to excellent correlation across a wide range of tasks (Pearson's coefficient 0.59-0.95, Cronbach's alpha 0.32-0.92), with 1 exception being a study involving medical students. There was a wide range of reported interrater variability among experts. Nonexpert evaluation was consistently quicker than expert evaluation (ranging from 4.8 to 150.9 times faster), and was more cost effective.

CONCLUSIONS

Crowdsourced feedback appears to be comparable to expert feedback and is cost effective and efficient. Further work is needed to increase consistency in expert evaluations, to explore sources of discrepant assessments between surgeons and crowds, and to identify optimal populations and novel applications for this technology.