Leadership-Specific Feedback Practices in Surgical Residency: A Qualitative Study

Evaluation of Educational Feedback in Urology Training: A Survey-Based Assessment of Trainees and Program Directors

OBJECTIVE

Our objective was to evaluate current satisfaction with the feedback provided during post-graduate urological training, including the quality and frequency of feedback, with participants consisting of both trainees and program directors. Additionally, we aimed to identify areas for future improvement in resident and fellow-level urological training.

METHODS

Graduating residents, fellows, and program directors from accredited residency/fellowship programs in the United States were surveyed. A total of 575 surveys were sent out. Information on feedback frequency, quality, form, and satisfaction was collected using applicable multiple-choice responses and a five-point Likert scale. An open-ended question gathered suggestions for improving current feedback processes. A chi-square test of independence was used to compare the responses to individual questions.

RESULTS

Ninety-two respondents answered our survey: 22 residents, 18 fellows, 25 residency program directors (PDs), and 27 fellowship PDs. The distribution of age, race, and gender categories was not significantly different between PDs and trainees. However, there was a significant difference in their subspecialties and American Urological Association (AUA) sections. The majority of fellowship PDs, residency PDs, fellows, and residents (88 total) reported verbal feedback as the predominant method within their practice. This was followed by written (68 total), electronic (54 total), and app-based feedback (19 total).

CONCLUSION

Our study suggests that there may be a need for ongoing improvement or standardization of feedback mechanisms in the field of urological training and highlights the perceived discrepancies between learners and educators.

Leadership Training Curriculum for Otolaryngology-Head and Neck Surgery Residents: A Scoping Review

OBJECTIVE

Otolaryngologists take on various leadership roles throughout their daily practice, but specific training focused on leadership development during otolaryngology-head and neck surgery (OHNS) residency is not well-defined. This project explores the current state of leadership curricula for OHNS residents.

DATA SOURCES

Google Scholar, Embase, PubMed, and MedEdPORTAL.

REVIEW METHODS

A scoping review was performed on English-language, full-text, peer-reviewed articles that describe leadership curricula for OHNS residents. Investigators reviewed curriculum settings, content, delivery methods, and assessment; curriculum effectiveness was evaluated using Kirkpatrick effectiveness scores and article quality was assessed using the Best Evidence in Medical Education (BEME) index.

CONCLUSION

Three thousand four hundred sixteen articles met search criteria, 198 articles were included for full-text review, and 4 articles met inclusion criteria. Curriculum content and delivery methods were diverse. Curriculum cadence ranged from 2-day immersion trainings to year-long longitudinal programs. Only one of the included studies utilized a needs assessment to inform curriculum development. Two articles achieved Kirkpatrick effectiveness scores of 2, indicating changes in the attitudes or perceptions among participants and a quality measure of 3, indicating clear conclusions drawn from the results.

IMPLICATIONS FOR PRACTICE

The current state of leadership training in OHNS residency is limited and nonuniform. These data align with descriptions of leadership training in other surgical residencies which are reported as heterogenous and lacking in effectiveness. This review highlights the need for standardized leadership training for OHNS residents. The high-quality leadership development initiatives within graduate medical education are reviewed to inform future directions for effective curriculum development and assessment.

Becoming a neurosurgeon in France: A qualitative study from the trainees' perspective

Introduction

The training of neurosurgeons is evolving in a world of socio-professional changes, including the technological revolution, administrative pressure on stakeholders, reduced working hours, geographical heterogeneity, generational changes, to name but a few.

Research question

This qualitative study aimed to explore experiences and feedback of French neurosurgical trainees concerning their training.

Material and methods

The grounded theory approach was used with 23 neurosurgical trainees' interviews. Inclusion was continued until data saturation. Six researchers (an anthropologist, a psychiatrist, and four neurosurgeons) thematically and independently analyzed data collected through anonymized interviews.

Results

Data analysis identified three superordinate themes: (1) The Trainee-Senior Dyad, where the respondents describe a similar bipolarity between trainees and faculty (trainees oscillating between those who fit into the system and those who are more reluctant to accept hierarchy, faculty using an ideal pedagogy while others refuse to help or invest in training); (2) The difficulty to learn (describing pressure exercised on trainees that can alter their motivation and degrade their training, including the impact of administrative tasks); (3) A pedagogy of empowerment (trainee' feelings about the pertinent pedagogy in the OR, ideal sequence to progress, progressive empowerment especially during the shifts, and stress of envisioning themselves as a senior neurosurgeon).

Discussion and conclusion

Respondents emphasize the heterogeneity of their training both intra- and inter-university-hospital. Their critical analysis, as well as the formalization of their stress to become autonomous seniors, can be an important link with the reforms and optimizations currently being carried out to improve and standardize the training of young French neurosurgeons.

The Impact on Urology Residents' Learning of Social Media and Web Technologies after the Pandemic: A Step Forward through the Sharing of Knowledge

The COVID-19 pandemic has impacted urology residents and their training. However, several new technologies or knowledge platforms as social media (SoMe) and web-based learning solutions have filled this gap. Therefore, we aimed to analyze resident's learning curves of new learning modalities, identify the evidence that is provided in the literature, and evaluate the possible impact of such solutions in the future. We conducted a non-systematic literature search using Medline, PubMed, and Embase. In addition, online resources of national and international urology resident societies were queried. The identified paper described SoMe, webinars, podcasts, pre-recorded surgical videos, educational platforms, and mobile apps in the field of urology that are used to gain access to information, teach and provide feedback to residents, and were used under the conditions of the pandemic. The application of those technologies harbors the risk of mis- and disinformation, but have the potential to provide access to education and validated knowledge, training, and feedback and thereby might democratize training of residents in urology globally.

Advancing leadership in surgery: a realist review of interventions and strategies to promote evidence-based leadership in healthcare

BACKGROUND

Healthcare systems invest in leadership development of surgeons, surgical trainees, and teams. However, there is no agreement on how interventions should be designed, or what components they must contain to be successful. The objective of this realist review was to generate a programme theory explaining in which context and for whom surgical leadership interventions work and why.

METHODS

Five databases were systematically searched, and articles screened against inclusion considering their relevance. Context-mechanism-outcome configurations (CMOCs) and fragments of CMOCs were identified. Gaps in the CMOCs were filled through deliberation with the research team and stakeholder feedback. We identified patterns between CMOCs and causal relationships to create a programme theory.

RESULTS

Thirty-three studies were included and 19 CMOCs were developed. Findings suggests that interventions for surgeons and surgical teams improve leadership if timely feedback is delivered on multiple occasions and by trusted and respected people. Negative feedback is best provided privately. Feedback from senior-to-junior or peer-to-peer should be delivered directly, whereas feedback from junior-to-senior is preferred when delivered anonymously. Leadership interventions were shown to be most effective for those with awareness of the importance of leadership, those with confidence in their technical surgical skills, and those with identified leadership deficits. For interventions to improve leadership in surgery, they need to be delivered in an intimate learning environment, consider implementing a speak-up culture, provide a variety of interactive learning activities, show a genuine investment in the intervention, and be customised to the needs of surgeons. Leadership of surgical teams can be best developed by enabling surgical teams to train together.

CONCLUSIONS

The programme theory provides evidence-based guidance for those who are designing, developing and implementing leadership interventions in surgery. Adopting the recommendations will help to ensure interventions are acceptable to the surgical community and successful in improving surgical leadership.

TRIAL REGISTRATION

The review protocol is registered with PROSPERO (CRD42021230709).

The Effect of Anonymity on Quality of Resident Feedback

OBJECTIVE

Quality feedback is critical to facilitate better performance and quicker learning. However, faculty may be hesitant to provide quality constructive feedback, especially in written form, due to fear of retaliation. We evaluated the impact of faculty anonymity on the quality of faculty-to-resident feedback.

DESIGN

A retrospective review was undertaken of faculty evaluation of resident performance from 2017 to 2018, when evaluations were identifiable, compared to 2018-2019, when evaluations were anonymous. Evaluations included 27 individual items with Likert type scoring and 2 open-ended questions. Open-ended responses and overall performance were de-identified and scored by 2 reviewers independently using the task, performance gap, action scoring model. Comparisons between groups were performed with the Wilcoxon-Mann-Whitney test.

SETTING

Tertiary Care Institution, University of Michigan, Ann Arbor, MI PARTICIPANTS: 415 resident performance evaluations were available for analysis with 251 in the identifiable group and 164 in the anonymous group.

RESULTS

The average composite score for the identifiable group was 105.2 and 103.4 in the anonymous group (p = 0.22). The effect size of the impact on composite score was small (Cohen's d 0.084, 95% CI -0.11-0.28). There was excellent inter-rater reliability. There were no differences between feedback groups for any of the 3 components of task, performance gap, and action model. While average scores for all 3 components were low, action scores were lowest.

CONCLUSIONS

Anonymity did not significantly impact faculty evaluations of resident performance. The quality of open-ended feedback on written evaluations was generally poor, especially in identifying actions for continued performance improvement. Additional mechanisms to improve feedback quality should be sought.

Lived Experiences of Surgical Residents During the COVID-19 Pandemic: A Qualitative Assessment

OBJECTIVE

As the COVID-19 pandemic dynamically changes our society, it is important to consider how the pandemic has affected the training and wellness of surgical residents. Using a qualitative study of national focus groups with general surgery residents, we aim to identify common themes surrounding their personal, clinical, and educational experiences that could be used to inform practice and policy for future pandemics and disasters.

DESIGN

Six 90-minute focus groups were conducted by a trained qualitative researcher who elicited responses on six predetermined topics. De-identified transcripts and audio recordings were later analyzed by two independent researchers who organized responses to each topic into themes.

SETTING

Focus groups were conducted virtually and anonymously.

PARTICIPANTS

General surgery residents were recruited from across the country. Demographic information of potential participants was coded, and subjects were randomly selected to ensure a diverse group of participants.

RESULTS

The impact of the COVID-19 pandemic on residents' clinical, educational, and personal experiences varied depending on the institutional response of the program and the burden of COVID-19 cases geographically. Many successes were identified: the use of telehealth and virtual didactics, an increased sense of camaraderie amongst residents, and flexibility in scheduling. Many challenges were also identified: uncertainty at work regarding personal protective equipment and scheduling, decreased case volume and educational opportunities, and emotional trauma and burnout associated with the pandemic.

CONCLUSIONS

These data gathered from our qualitative study highlight a clear, urgent need for thoughtful institutional planning and policies for the remainder of this and future pandemics. Residency programs must ensure a balanced training program for surgical residents as they attempt to master the skills of their craft while also serving as employed health care providers in a pandemic. Furthermore, a focus on wellness, in addition to clinical competency and education, is vital to resident resilience and success in a pandemic setting.

How Feedback Is Given Matters: A Cross-Sectional Survey of Patient Satisfaction Feedback Delivery and Physician Well-being

OBJECTIVE

To evaluate how variation in the way patient satisfaction feedback is delivered relates to physician well-being and perceptions of its impact on patient care, job satisfaction, and clinical decision making.

PARTICIPANTS AND METHODS

A cross-sectional electronic survey was sent to faculty physicians from a large academic medical center in March 29, 2019. Physicians reported their exposure to feedback (timing, performance relative to peers, or channel) and related perceptions. The Professional Fulfillment Index captured burnout and professional fulfillment. Associations between feedback characteristics and well-being or perceived impact were tested using analysis of variance or logistic regression adjusted for covariates.

RESULTS

Of 1016 survey respondents, 569 (56.0%) reported receiving patient satisfaction feedback. Among those receiving feedback, 303 (53.2%) did not believe that this feedback improved patient care. Compared with physicians who never received feedback, those who received any type of feedback had higher professional fulfillment scores (mean, 6.6±2.1 vs 6.3±2.0; P=.03) but also reported an unfavorable impact on clinical decision making (odds ratio [OR], 2.9; 95% CI, 1.8 to 4.7; P<.001). Physicians who received feedback that included one-on-one discussions (as opposed to feedback without this channel) held more positive perceptions of the feedback's impact on patient care (OR, 2.0; 95% CI, 1.3 to 3.0; P=.003), whereas perceptions were less positive in physicians whose feedback included comparisons to named colleagues (OR, 0.5; 95% CI, 0.3 to 0.8; P=.003).

CONCLUSION

Providing patient satisfaction feedback to physicians was associated with mixed results, and physician perceptions of the impact of feedback depended on the characteristics of feedback delivery. Our findings suggest that feedback is viewed most constructively by physicians when delivered through one-on-one discussions and without comparison to peers.

Evaluation of leadership curricula in general surgery residency programs

The rapid and dynamic surgical environment requires leaders that can help guide their teams to desired outcomes while delivering patient-centered care. The need for early implementation of leadership curricula has been identified; however, most available leadership curricula are tailored for faculty and not embedded within surgery training. The ideal intervention(s) to close this gap while addressing the unique challenges of the demanding surgical training are yet to be identified. This manuscript reviews the current status of residency leadership programs and the relationship of leadership to other essential aspects for optimal training of future surgeon leaders. The use of best practice medical education frameworks is key to help guide effective and sustainable evidence-based leadership curricula. The collaboration, standardization, and publication of leadership curricula for surgery residents can serve as prototypes to address specific needs at different training institutions with the aim of equipping surgeons with the necessary leadership tools for their success.

Leadership and surgical training part 2: training toolkit for leadership development during surgical training

The Royal Australasian College of Surgeons identifies leadership as an everyday surgical skill and one of the 10 key competences expected of surgeons. However, there is limited opportunity for formal leadership training and development prior to becoming a consultant, with surgical leadership curricula within worldwide training programmes often poorly defined. As a consequence of a focus on general professional skill development, rather than specific training and assessment in leadership, observed trainee leadership skills show scope for improvement. Many studies indicate trainees report leadership skills training as beneficial and are receptive to interventions. However, most surgical leadership development courses prepare pre-identified leaders for formal leadership positions rather than developing all surgical trainees leadership skills. Although the recently established Royal Australasian College of Surgeons 'Surgeons as Leaders in Everyday Practice' course helps to fill this gap, it is aimed at consultant surgeons. Most successful leadership development programmes are also longitudinal throughout surgical training and multi-faceted.

The Hidden Curriculum: Strategies for Preparing Residents for Practice

PURPOSE OF REVIEW

The goal of this paper was to identify areas of importance in modern urology education that are not currently emphasized in current urological curricula.

RECENT FINDINGS

We identified curricular deficits in robotic surgical simulation, transgender health, leadership, business management, and social media training. Few practicing urologists feel comfortable managing transgender-specific needs, and most training programs do not adequately address transgender health. Urology programs also do not sufficiently emphasize topics in leadership, business management, or appropriate social media usage. With respect to simulation, while it is currently included in the Accreditation Council for Graduate Medical Education (ACGME) program requirements, it is currently under-utilized for training in robotic surgery. It is important for urologists to receive adequate training for the modern practice landscape. Where knowledge gaps among early practicing urologists arise, programs should adapt their curricula to address them.

Leadership proficiency in surgery: lessons from the COVID-19 pandemic

Summary

The coronavirus disease 2019 (COVID-19) pandemic has accentuated the importance of leadership training for health care professionals, particularly surgeons. Surgeons are expected to lead and thrive in multidisciplinary teams. There is, however, a critical gap in teaching residents about fundamental leadership principles, such as developing productive and vision-driven teams, conflict resolution and emotional intelligence. We discuss the merits of leadership training for surgical residents and future directions for implementing a leadership curriculum for Canadian residency programs in the competency by design era.