How Did Coronavirus-19 Impact the Expenses for Medical Students Applying to an Orthopaedic Surgery Residency in 2020 to 2021?

Geographic and demographic trends with the initiation of virtual interviews in general surgery: A 7-program evaluation

BACKGROUND

Although most general surgery residency interviews remain virtual, the effect of this format remains understudied. Single-institution data have shown an increase in the number of applications received and interviews conducted with virtual interviewing but no change in the geographic backgrounds of interviewed or matched applicants. This study sought to compare national trends in geographic characteristics of general surgery applicants, interviewed applicants, and matched applicants between in-person and virtual application cycles.

STUDY DESIGN

A retrospective review of 7 general surgery residency programs from application years 2016-2019 (in-person) and 2020-2021 (virtual) was conducted. Data collected included birth year, sex, race, medical school state, and contact location at the time of application. Data were analyzed using generalized mixed effects linear models.

RESULTS

A total of 52,742 applicants, 4,550 interviewed applicants, and 329 matched applicants were included. During virtual application cycles, there were no increases in the average number of applicants (P = .25), interviewed applicants (P = .36), or matched (P = .84) applicants per year. Virtual cycles were associated with a larger proportion of interviews conducted with applicants from out-of-state medical schools (P < .01) and listing out-of-state contact locations (P < .01) compared with in-person application cycles. There were no significant geographic differences in matched applicants between virtual and in-person application cycles.

CONCLUSION

Virtual application cycles had greater geographic diversity among interviewed applicants. However, similar differences were not seen in the geographic diversity of matched applicants. Additional efforts should focus on why no changes in the geographic diversity of matched applicants were identified.

Identification of Factors Associated with Orthopaedic Surgery Residency Programs That Preferentially Match Students Who Performed an Elective Rotation Before the Interview Process

Introduction

The role of elective rotations in the orthopaedic residency selection process varies between programs. Our study aims to identify factors associated with residency programs that interview and match a greater proportion of applicants who have completed an elective rotation with their program.

Methods

Data were collected through the American Orthopaedic Association's Orthopaedic Residency Information Network database. Bivariate correlations and multivariate regression models were used to identify independent predictors of programs with a greater proportion of interviewees or residents who completed an elective rotation at the respective program.

Results

One hundred seventy-eight of the 218 existing residency programs were included in this study. Programs that offered fewer interviews and more away rotation positions per year were associated with a greater odds of its interviewees (OR = 0.36, p = 0.01; OR = 4.55, p < 0.001, respectively) and residents (OR = 0.44, p = 0.04; OR = 4.23, p < 0.001, respectively) having completed an elective rotation with the program. In addition, programs with fewer attendings (OR = 0.39, p = 0.03) and in-person interviews (OR = 3.04, p = 0.04) matched a greater proportion of their rotators. However, programs that interviewed applicants during the elective rotation were less likely to match their rotators (OR = 0.35, p = 0.04).

Conclusion

Certain program characteristics independently predict the likelihood of a program interviewing and matching their rotators. These findings may provide information for applicants and programs regarding the rotation process.

Level of Evidence

III.

Changes in Residency Applicant Cancellation Patterns with Virtual Interviews: A Single-site Analysis

Background

Residency programs transitioned to primarily virtual interviews due to the COVID-19 pandemic. This shift raised questions regarding expectations and patterns of applicant cancellation timeliness. The purpose of this study was to examine changes in applicant cancellations after transitioning to virtual interviews.

Methods

This was a retrospective cohort study of interview data from a three-year emergency medicine residency at a tertiary-care academic medical center. Using archived data from Interview Broker, we examined scheduling patterns between one in-person (2019-2020) and two virtual interview cohorts (2020-2021 and 2021-2022). Our outcomes were the overall cancellation rates relative to interview slots as well as the proportion of cancellations that occurred within 7 or 14 days of the interview date.

Results

There were 453 interview slots and 568 applicants invited. Overall, applicants canceled 17.1% of scheduled interviews. Compared with in-person interviews, applicants canceled significantly fewer virtual interviews (in person: 40/128 (31.3%), virtual year 1: 22/178 (12.4%), virtual year 2: 15/143 (10.5%), P = 0.001). Conversely, applicants canceled significantly more virtual interviews within both the 14-day threshold (in person: 8/40 (20%), virtual year 1: 12/22 (55.5%), virtual year 2: 12/15 (80%), P < 0.001) and the 7-day threshold (in person: 0/40 (0%), virtual year 1: 3/22 (13.6%), virtual year 2: 4/15 (26.7%), P = 0.004).

Conclusion

While limited, at our site, changing to a virtual interview format correlated with fewer cancellations overall. The proportion of cancellations within 14 days was much higher during virtual interview seasons, with most cancellations occurring during that time frame. Additional studies are needed to determine the effects of cancellation patterns on emergency medicine recruitment.

The Utility of the Standardized Letter of Recommendation for Orthopedic Surgery Residency Applicants: A Systematic Review

Despite widespread adoption for evaluating residency candidates, few studies have evaluated the orthopedic standardized letter of recommendation (SLOR). A systematic review using PubMed, Embase, and Web of Science was performed in June 2022. Study design and results from SLOR investigations were compiled. Common outcomes studied were summative rank statement scores and SLOR individual domains. Applicants were rated ranked to match or in the top one-third of rank lists in non-normally distributed frequencies. The association of summative rank statement score with match outcome was rarely studied. Applicants' ratings skew positively, the utility is reportedly limited, and influence on match outcome has been inadequately studied. [Orthopedics. 2024;47(1):e1-e5.].

Matching into competitive surgical residencies: predictors of success

Evidence-informed data may help students matching into competitive residency programs guide curricular activities, extracurricular activities, and residency career choices. We aimed to examine the characteristics of students applying to competitive surgical residencies and identify predictors of matching success. We identified the five lowest match rates for the surgical subspecialities listed in the 2020 National Resident Matching Program report to define a surgical residency as competitive. We analyzed a database from 115 United States medical schools regarding application data from 2017 to 2020. Multilevel logistic regression was used to determine predictors of matching. Statistical significance was set at p < 0.05.A total of 1,448 medical students submitted 25,549 applications. The five most competitive specialties included were plastic surgery (N = 172), otolaryngology (N = 342), neurological surgery (N = 163), vascular surgery (N = 52), orthopedic surgery (N = 679), and thoracic surgery (N = 40). We found that medical students with a geographical connection (adjusted OR, 1.65 [95% CI, 1.41 to 1.93]), and students who did an away rotation at the applied program (adjusted OR, 3.22 [95% CI, 2.75 to 3.78]) had statistically significantly increased odds of matching into a competitive surgical specialty. Furthermore, we found that students with a United States Medical Licensing Examination (USMLE) Step 1 score below 230 and Step 2 Clinical Knowledge (CK) score below 240 had increased odds of matching if they completed an away rotation at the applied program. Completing an away rotation and geographical connection to the institution may contribute more than academic criteria for selection into a competitive surgical residency after an interview. This finding may be due to less variation in academic criteria among this pool of high-performing medical students. Students with limited resources who apply to a competitive surgical specialty may be at a disadvantage given the financial burden of an away rotation.

Augmented Web-based applicant experiences for anesthesiology away audition rotations: A systematic review of the current literature

Objective

The objective of this paper is to evaluate Augmented Web-based Applicant Experiences in the field of Anesthesiology. We hope to advocate for Augmented Web-based Applicant Experiences rotations and address their limitations in case in-person rotations become restricted again.

Methods

A thorough search of articles from the years 1978 to 2023 was completed using the search phrases "Away Rotations Anesthesiology," "Away Rotations Anesthesia," "Audition Rotation Anesthesia" and "Audition Rotation Anesthesiology." These search phrases were used on both the PubMed (Medline) and Excerpta medica database (EMBASE) databases, and the number of total articles that appeared was 73. These articles were then filtered to gather relevant articles for our study.

Results

After the articles were filtered, there was one remaining article that was used for our study. To supplement this article, 29 additional sources were added using the worldwide web. However, these did not address rotations in Anesthesiology. Although these other sources did not involve Anesthesiology residencies, they still provide significant perspectives that can be applied to online rotations. A total of 30 sources were used for our manuscript.

Conclusion

Although in-person rotations are preferred, Augmented Web-based Applicant Experiences rotations are valuable as they give residency programs an opportunity to evaluate students. Augmented Web-based Applicant Experiences rotations also provide students with learning opportunities and also help familiarize them with the residency programs. There are limitations that come with Augmented Web-based Applicant Experiences rotations. However, addressing these shortcomings can help Augmented Web-based Applicant Experiences rotations become a proper substitution for in-person rotations if they become restricted again.

Where Do Orthopaedic Surgery Applicants Match on Their Rank Lists? A Survey of Incoming Residents

The National Resident Matching Program reports match results by rank list position for all specialties in aggregate, but these data have not been previously reported for orthopaedic surgery specifically. The purpose of this study was to determine where orthopaedic applicants match on their rank lists in comparison to the national average for all specialties and to evaluate which factors may influence match results.

Methods

This was a cross-sectional survey study distributed to all applicants to a single institution's orthopaedic surgery residency program. Metrics such as match result, USMLE scores, Alpha Omega Alpha (AOA) status, and research productivity, in addition to other applicant-specific traits were captured. Results were stratified by match status and rank list position, with subgroup analyses completed for applicants matching at highly ranked programs (1-3) vs. lower ranked programs (≥ 4).

Results

The survey was distributed to 698 applicants with a response rate of 32% (n = 224), with a match rate of 85% (n = 191). Thirty-four percent of respondents matched at their top choice program, 15.2% at their second choice, 9.9% at their third, and 40.8% at their fourth or lower. When comparing the matched to unmatched applicant cohorts, there was a significant difference in number of programs ranked, AOA status, and sex. When comparing applicants who matched at highly ranked (1-3) vs. lower ranked (≥ 4) programs, there was a significant difference in USMLE board scores.

Conclusions

Orthopaedic surgery residency applicants are significantly less likely to match at their first choice or within their top 3 choices when compared to the national average for all specialties. Number of contiguous ranks, AOA status, and female sex were found to be associated with successfully obtaining an orthopaedic residency position, whereas USMLE board scores were associated with matching higher on one's rank list, thus resulting in greater match satisfaction.

Level of Evidence

III.

AAMC Guidance on Interviewing for the 2022-2023 Residency Application Cycle: Orthopaedic Program Director Perspectives

In May 2022, the Association of American Medical Colleges (AAMC) published guidelines regarding interviews for the 2022-2023 residency application cycle. These guidelines recommended virtual interviews and discouraged "hybrid" interviewing. We conducted a survey of orthopaedic program directors (PDs) to understand their perspectives on these new guidelines and their plans for the upcoming cycle.

METHODS

A 19-question multicenter, cross-sectional research survey was emailed to 98 PDs (38.8% response rate) through Qualtrics XM. Contact information was obtained from a public national database.

RESULTS

Most orthopaedic residency programs (60.5%) were planning on conducting in-person interviews before any AAMC and hospital guidelines, and most (65.8%) will likely be conducting virtual interviews post-guidelines. PDs voiced mixed opinions about virtual interviews (39.4% in favor vs. 47.4% against). PDs were also split on whether forgoing the AAMC guidance would be irresponsible for residency programs (47.4% believe it would be irresponsible vs. 44.8% believe it would not); however, a plurality are in favor of the AAMC's guidance (42.1%). Furthermore, PDs agreed that virtual interviews have disadvantages including favoring top-tier applicants, students from home institutions, and in-person rotators, making ranking applicants and learning about a program's culture more difficult. Most PDs (84.2%) felt that hybrid interviews would disadvantage applicants who would choose the virtual option.

CONCLUSION

AAMC guidance seems to be influencing how most orthopaedic surgery programs will conduct residency interviews for the 2022-2023 cycle. Most PDs agreed with the AAMC guidelines but voiced concerns regarding several disadvantages for all 3 proposed interview options (virtual, in-person, and hybrid). Our results indicate that the recent AAMC guidelines may have contributed to a shift in opinions among PDs but are not sufficient to create a consensus on the best practices for residency interviews. Our findings should encourage solutions focused on the deeper systemic issues within the orthopaedic application process in the post-coronavirus 2019 pandemic era.

Deconstructing the roadmap to surgical residency: a national survey of residents illuminates factors associated with recruitment success as well as applicants' needs and beliefs

Purpose

As applications increase and residency becomes more competitive, applicants and programs will be challenged by increased demands on recruitment, metric assessment, and rank determination. Studies have investigated program opinions; however, this survey sought to illuminate the process from an applicant's perspective.

Methods

An anonymous survey was distributed to past or current surgery residents nationwide using social media and program director emails. Regression analyses were performed to assess factors correlating with percentage of programs which offered the applicant an interview.

Results

There were 223 respondents who applied to an average of 61 programs (± 40) with 16 (± 11) interviews offered. Applicants believed that programs were most interested in (1) personality, (2) letter of recommendation (LOR) writers, and (3) medical school reputation. Top factors considered by applicants in ranking were resident culture, location, program reputation, and autonomy. Bivariate analysis found factors that decreased percent of interview invites to be Asian race, whereas factors that increased interview invites included age, year of match, surgery clerkship grade, medicine clerkship grade, AOA status, honor surgery rotation, gold humanism (GHHS) status, phone call for interview made, and step scores (all p < 0.05). AOA status, step scores, honor surgery rotation, year of match, and Asian race remained significant after multivariate analysis.

Conclusions

National surveys illuminate how applicants approach the application process and what programs and applicants appear to value. This information provides insight and guidance to candidates and programs as the process of matching becomes more challenging with surging application numbers, changes in testing parameters and virtual interviews.

Supplementary Information

The online version contains supplementary material available at 10.1007/s44186-022-00070-9.

Assessing the Impact of COVID-19 on the 2021 Orthopaedic Surgery Match Outcomes

The purpose of this study was to assess the influence of the COVID-19 pandemic on the 2021 orthopaedic surgery residency match outcomes. Because in-person away rotations and interviews were canceled during the 2020 to 2021 application cycle, we hypothesized that applicants would match at their home program at a higher rate in 2021 than in previous years.

Methods

We queried allopathic orthopaedic surgery residency websites and social media accounts for names of residents and medical school information for cohorts matching from 2017 through 2021. To assess availability of and participation in virtual away rotations, we administered a survey to Accreditation Council for Graduate Medical Education-accredited allopathic orthopaedic surgery residency programs. The primary outcome was the annual proportion of applicants matching at the program affiliated with their medical school ("home program"). Subgroup analyses were stratified by Doximity reputation ranking and availability of a virtual away rotation.

Results

We identified 2,632 residents who matched between 2017 and 2020 and 698 residents who matched in 2021. Overall home program match rate and likelihood of home matching were higher in 2021 compared with 2017 to 2020 (28% vs. 20%; odds ratio [OR] = 1.51, 95% confidence interval [CI] 1.24-1.82, p < 0.001). The increase in the home match rate at programs ranked in the top 30 (27% vs. 20%, p = 0.034) was similar to the increase at programs ranked outside the top 30 (28% vs. 20%, p < 0.001). Of the 66 (48%) programs that responded to the survey, 16 (24%) offered a virtual away rotation. Programs with a higher Doximity ranking were more likely than lower-ranked programs to offer a virtual away rotation (OR = 6.75, 95% CI 1.95-23.4, p = 0.003). Home match rates did not differ significantly between programs that offered a virtual away rotation and those that did not (26% vs. 32%, p = 0.271).

Conclusions

A higher proportion of orthopaedic surgery residency applicants matched at their home program in 2021 compared with previous years. Limitations on in-person activities due to the COVID-19 pandemic may have contributed to this rise.

Level of Evidence

N/A.

Cost of the Otolaryngology Residency Application Process: Comparison With Other Specialties and Equity Implications

Objective

This study aims to assess trends in applicant-reported costs of the otolaryngology residency application process between 2019 and 2021 and evaluate the impact of application costs on number of interview offers.

Study Design

Cross-sectional study.

Setting

US allopathic and osteopathic medical schools.

Methods

Survey data from applicants were obtained from the Texas STAR database (Seeking Transparency in Application to Residency) for the years 2019 to 2021. Outcomes included total cost, interview cost, other costs, application fees, and number of interview offers. Simple and multivariable linear regression was used to identify novel predictors of cost and assess the correlation between cost and interview offers.

Results

Among 363 otolaryngology applicants, there was a 74% reduction in total costs and a 97% reduction in interview costs in the 2021 cycle vs the 2020 cycle. Significant predictors of total cost among otolaryngology applicants included the number of away rotations (P < .01), the number of research experiences (P = .04), and couples matching (P < .01). During the 2019 and 2020 application cycles, there was a significant association between applicant-reported total spending and number of otolaryngology interview offers (P < .01), which was not present during the 2021 cycle (P = .35).

Conclusion

Number of otolaryngology interview offers appears to be directly correlated with applicant-reported total costs regardless of number of applications or interviews attended, which may be a source of inequality in the application process. There was a drastic reduction in total costs, interview costs, and other costs during the COVID-19 pandemic, which was likely driven by virtual interviewing and the absence of away rotations.

Orthopaedic Surgery Residency Application, and Selection Criteria Adaptations, in Times of COVID-19

Amid the COVID-19 pandemic, medical education and residency application have faced unprecedented changes. This has forced residency directors to alter their selection criteria in the absence of away rotations and the implementation of nationwide virtual interviews.