Analysis of Self- and 360-Evaluation Scores of the Professionalism Intelligence Model Within an Academic Otolaryngology-Head and Neck Surgery Department

Leadership Training Curriculum for Otolaryngology-Head and Neck Surgery Residents: A Scoping Review

OBJECTIVE

Otolaryngologists take on various leadership roles throughout their daily practice, but specific training focused on leadership development during otolaryngology-head and neck surgery (OHNS) residency is not well-defined. This project explores the current state of leadership curricula for OHNS residents.

DATA SOURCES

Google Scholar, Embase, PubMed, and MedEdPORTAL.

REVIEW METHODS

A scoping review was performed on English-language, full-text, peer-reviewed articles that describe leadership curricula for OHNS residents. Investigators reviewed curriculum settings, content, delivery methods, and assessment; curriculum effectiveness was evaluated using Kirkpatrick effectiveness scores and article quality was assessed using the Best Evidence in Medical Education (BEME) index.

CONCLUSION

Three thousand four hundred sixteen articles met search criteria, 198 articles were included for full-text review, and 4 articles met inclusion criteria. Curriculum content and delivery methods were diverse. Curriculum cadence ranged from 2-day immersion trainings to year-long longitudinal programs. Only one of the included studies utilized a needs assessment to inform curriculum development. Two articles achieved Kirkpatrick effectiveness scores of 2, indicating changes in the attitudes or perceptions among participants and a quality measure of 3, indicating clear conclusions drawn from the results.

IMPLICATIONS FOR PRACTICE

The current state of leadership training in OHNS residency is limited and nonuniform. These data align with descriptions of leadership training in other surgical residencies which are reported as heterogenous and lacking in effectiveness. This review highlights the need for standardized leadership training for OHNS residents. The high-quality leadership development initiatives within graduate medical education are reviewed to inform future directions for effective curriculum development and assessment.

Bias in Surgical Residency Evaluations: A Scoping Review

OBJECTIVE

Given widespread disparities in the surgical workforce and the advent of competency-based training models that rely on objective evaluations of resident performance, this review aims to describe the landscape of bias in the evaluation methods of residents in surgical training programs in the United States.

DESIGN

A scoping review was conducted within PubMed, Embase, Web of Science, and ERIC in May 2022, without a date restriction. Studies were screened and reviewed in duplicate by 3 reviewers. Data were described descriptively.

SETTING/PARTICIPANTS

English-language studies conducted in the United States that assessed bias in the evaluation of surgical residents were included.

RESULTS

The search yielded 1641 studies, of which 53 met inclusion criteria. Of the included studies, 26 (49.1%) were retrospective cohort studies, 25 (47.2%) were cross-sectional studies, and 2 (3.8%) were prospective cohort studies. The majority included general surgery residents (n = 30, 56.6%) and nonstandardized examination modalities (n = 38, 71.7%), such as video-based skills evaluations (n = 5, 13.2%). The most common performance metric evaluated was operative skill (n = 22, 41.5%). Overall, the majority of studies demonstrated bias (n = 38, 73.6%) and most investigated gender bias (n = 46, 86.8%). Most studies reported disadvantages for female trainees regarding standardized examinations (80.0%), self-evaluations (73.7%), and program-level evaluations (71.4%). Four studies (7.6%) assessed racial bias, of which all reported disadvantages for trainees underrepresented in surgery.

CONCLUSIONS

Evaluation methods for surgery residents may be prone to bias, particularly with regard to female trainees. Research is warranted regarding other implicit and explicit biases, such as racial bias, as well as for nongeneral surgery subspecialties.