Advising Medical Students During COVID-19: The Case for a Single Emergency Medicine Rotation for All

An Evaluation of Non-Uniform Grade Distribution with the Emergency Medicine Off-Service Standardized Letters of Evaluation

INTRODUCTION

Standardized Letters of Evaluation (SLOEs) are designed to objectively compare medical students to their peers for completed emergency medicine (EM) rotations to be used in the EM residency match. In an attempt to adapt quickly to the lack of availability of in-person EM rotations due to COVID restrictions, "off-service" SLOEs (OSLOEs) were allowed in place of traditional SLOEs. The purpose of this study was to assess the utility of OSLOEs for candidate selection during the 2020-21 application cycle at a single EM residency.

METHODS

A retrospective cohort review of all OSLOEs submitted during the 2020-21 academic year to an EM residency program was performed. A total of 270 OSLOES were eligible for review. Summary statistics were calculated for the study variables recorded, including global rank, grade, categorical details, and rank.

RESULTS

Of the 270 OSLOEs reviewed, 61.9% ranked candidates in the top 10% of their class, with 95% being ranked in the top two categories. Over 90% of students were graded as honors or high pass and over 75% of students were ranked in the top 1/3 for each specific OSLOE category.

CONCLUSION

Our findings reveal questionable utility of the objective measures in the OSLOE as there are signs it may suffer from non-uniform grade distribution, leading to low utility for candidate selection. Our data shows marked over-ranking within the highest 2 categories. EM program directors and faculty should use caution as the OSLOE may not carry the same weight as a traditional SLOE when objectively evaluating prospective students for a match into EM.

Website usability analysis of United States emergency medicine residencies

OBJECTIVES

The Council of Residency Directors (CORD) in Emergency Medicine (EM) has recommended that all residency programs should conduct virtual interviews for the 2020 to 2021 application cycle due to the COVID-19 pandemic. While factors such as geographical region, city, program size, or hospital affiliation are not modifiable, EM residencies can bridge the information gap created by a lack of face-to-face interaction by representing themselves digitally. Measuring usability provides an objective method for EM residencies to improve their Web presence and effectively represent themselves to applicants.

METHODS

Our sample set included 55 U.S. EM residency program websites. Using methodology replicated from previous literature on health care website usability, we divided usability into four categories for quantifiable analysis: accessibility, marketing, content quality, and technology. Analysis was performed on each website and scored in all four categories. A "general usability" score was calculated for each website using a composite of the key factors within the four categories. Using a weighted percentage across all of the factors, an overall score was calculated.

RESULTS

Content quality was the overall highest scoring category (mean ± SD = 5.4, SE = 0.33). The overall lowest performing category was technology (mean ± SD = 0.8 ± 0.09, SE = 0.01).

CONCLUSIONS

Measuring usability can help EM residency programs identify ways to improve their Web presence. To effectively promote their programs, residencies need quality content that communicates their key features. Our recommendation is for all residency programs to periodically perform website audits and apply the usability measures outlined to improve their digital presence, especially during times when face-to-face interactions will be limited.

Medical student experiences of applying into emergency medicine during the COVID-19 pandemic: A multi-institutional survey of emergency medicine-bound medical students

BACKGROUND

The COVID-19 pandemic added new and great uncertainty to the typical approach to applying into emergency medicine (EM) for medical students. There are little data on students' lived experience of applying during this time period. We performed a multi-institutional survey of EM-bound students' experiences with preparing to apply into EM during the pandemic.

METHODS

This was a cross-sectional survey design study of fourth-year students preparing to apply into EM during the 2020-2021 academic year. All self-identified EM-bound students at four participating institutions were recruited by email in June 2020 to participate in a 13-item, 5-point Likert-scale survey. Univariate descriptive statistics, response rate, and nonresponse bias were calculated.

RESULTS

Sixty-seven of 125 eligible students responded for an overall response rate of 53.6%. Nonresponse bias for specific survey items ranged from 0.01 to 0.12. Students rated the importance of securing an EM rotation at their home institution the highest of any item (mean ± SD = 4.81 ± 0.68). Students indicated higher satisfaction with advice from their department of EM (mean ± SD = 4.28 ± 0.75) than from their school of medicine (mean ± SD = 3.52 ± 0.89). Students indicated higher confidence in their home EM rotations' ability to assure adequate personal protective equipment (PPE; mean ± SD = 3.91 ± 0.83) than an away rotation (mean ± SD = 2.82, 1.09). Students reported feeling between moderately and quite stressed about applying into EM this year (mean ± SD = 3.49 ± 1.01), but reported the financial stress the lowest of any item (mean ± SD = 1.46 ± 0.84). Students rated it highly important that away rotations prioritize students from institutions without an EM residency (mean ± SD = 4.51 ± 0.93).

CONCLUSION

Medical students applying into EM during the COVID-19 pandemic felt confident in their EM advisors' recommendations and their home institution's PPE provision. Students with EM residency programs at their schools recognized the importance of away rotations being prioritized for students from schools without EM residency programs. Strong EM advising is important to students.

COVID-19: A Driver for Disruptive Innovation of the Emergency Medicine Residency Application Process

The coronavirus disease (COVID-19) pandemic has had a significant impact on undergraduate medical education with limitation of patient care activities and disruption to medical licensing examinations. In an effort to promote both safety and equity, the emergency medicine (EM) community has recommended no away rotations for EM applicants and entirely virtual interviews during this year's residency application cycle. These changes affect the components of the EM residency application most highly regarded by program directors - Standardized Letters of Evaluation from EM rotations, board scores, and interactions during the interview. The Council of Residency Directors in Emergency Medicine Application Process Improvement Committee suggests solutions not only for the upcoming year but also to address longstanding difficulties within the process, encouraging residency programs to leverage these challenges as an opportunity for disruptive innovation.