Considerations for Program Directors in the 2020-2021 Remote Resident Recruitment

Video Interviews and Surgical Applicants' Ability to Assess Fit to Residency Programs

INTRODUCTION

Due to the COVID-19 pandemic, the recruitment cycle for the 2021 Match was performed virtually. This Association for Surgical Education (ASE)-sponsored survey set out to study applicants' ability to assess the factors contributing to fit through video interviews.

METHODS

An IRB-approved, online, anonymous survey was distributed to surgical applicants at a single academic institution and through the ASE clerkship director distribution list between the rank order list certification deadline and Match Day. Applicants used 5-point Likert-type scales to rate factors for importance to fit and their ease of assessment through video interviewing. A variety of recruitment activities were also rated by applicants for their perceived helpfulness in assessment of fit.

RESULTS

One hundred and eighty-three applicants responded to the survey. The three most important factors for applicant fit were how much the program cared, how satisfied residents seem with their program, and how well residents get along. Resident rapport, diversity of the patient population, and quality of the facilities were hardest to assess through video interviews. In general, diversity-related factors were more important to female and non-White applicants, but not more difficult to assess. Interview day and resident-only virtual panels were the most helpful recruitment activities, while virtual campus tours, faculty-only panels, and a program's social media were the least helpful.

CONCLUSIONS

This study provides valuable insight into the limitations of virtual recruitment for surgical applicants' perception of fit. These findings and the recommendations herein should be taken into consideration by residency program leadership to ensure successful recruitment of diverse residency classes.

An Assessment of Pediatric Residency Applicant Perceptions of "Fit" During the Virtual Interview Era

PURPOSE

Residency recruitment events and interviews are widely considered an integral component of the residency match experience. Due to the COVID-19 pandemic, residency recruitment and interviewing throughout the 2020-2021 academic year were performed virtually, which created challenges for applicants' ability to discern "fit" to a program. Given this change, it is reasonable to suspect that applicants would be less able to discern program fit. Therefore, this study evaluated how virtual interviews impacted pediatric residency applicants' ability to assess factors contributing to fit and subsequently how applicants assessed their self-perceived fit to their top-ranked programs.

METHODS

An online, anonymous survey was distributed to all residency applicants who applied to any specialty at our large academic institution. The survey utilized a 5-point Likert-type scale to evaluate qualities of fit as well as the applicants' self-perceived ability to assess these qualities through a virtual platform.

RESULTS

1,840 surveys were distributed, of which 473 residency applicants responded (25.7% response rate). Among these responses, 81 were pediatric applicants (27.6%). Factors deemed most important in determining fit included how well the residents get along with one another (98.8%), how much the program appeared to care about its trainees (97.5%), and how satisfied residents were with their program (97.5%). Qualities deemed most difficult for applicants to discern included the quality of facilities (18.6%), patient diversity (29.4%), and how well the residents got along with one another (30.2%). When compared to all other residency applicants, pediatric applicants placed more value on whether a program was family-friendly (p = 0.015), the quality of the facilities (p = 0.009), and the on-call system (p = 0.038).

CONCLUSION

This study highlights factors that influence pediatric applicants' perception of fit into a program. Unfortunately, many factors deemed most important for pediatric applicants were also among the most difficult to assess virtually. These include resident camaraderie, whether a program cares about its residents, and overall resident satisfaction. Taken together, these findings and the recommendations presented should be considered by all residency program leaders to ensure the successful recruitment of a pediatric residency class.

Impact of the Virtual Format on Plastic Surgery Residency and Fellowship Interviews: A National Cross-Sectional Study

BACKGROUND

The 2020-2021 residency and fellowship application cycles were profoundly affected by the introduction of virtual interviews (VIs). The authors investigate the impact that the virtual format (VF) had on plastic surgery residency and fellowship interviews from the perspectives of program directors (PDs).

METHODS

Surveys were sent to PDs of integrated plastic surgery residency (RPD) and fellowship (FPD) programs to ascertain their perspectives regarding the VF's impact on residency and fellowship interviews. PDs were stratified into residency and fellowship cohorts, and comparative analysis was performed.

RESULTS

A total of 92 PDs, 28 RPDs and 64 FPDs, completed our survey (35%). When compared to in-person interviews, VIs were reported to be more economical and time efficient by RPDs (100% and 46%, respectively) and FPDs (97% and 48%, respectively). Consequentially, 36% and 47% of residency and fellowship programs were able to interview more applicants, respectively. RPDs and FPDs reported that VIs hindered their ability to assess applicants' fit with the program (75% and 63%, respectively), personality and communication skills (75% and 64%, respectively), and commitment to the field along with their ability to function as a trainee (57% and 50%, respectively). Overall, 71% of RPDs and 58% of FPDs preferred in-person interviews. The majority of residency (71%) and fellowship (56%) programs intend to conduct both in-person and VIs in future application cycles (p=0.12).

CONCLUSIONS

Despite preferring in-person interviews, PDs intend on hosting both in-person and VIs in future application cycles. It remains to be seen how VIs will be employed moving forward.

The Effect of Virtual Interviews and Social Media on Applicant Decision-Making During The 2020-2021 Resident Match Cycle

RATIONALE AND OBJECTIVES

The COVID-19 pandemic significantly altered the residency application and interview process. Due to social distancing concerns, residency programs have had to virtually showcase their program to applicants, many utilizing social media. Similarly, applicants have had to devise novel ways of assessing "goodness of fit", one of the top factor's applicants use when ranking programs (1). Whether or not these attempts made an impact on an applicant's decision-making process has yet to be determined.

MATERIALS AND METHODS

Residency candidates interviewing for a diagnostic and/or interventional radiology residency position at our institution completed an online survey. The goal of the survey was to assess the potential influence of virtual interviews, social media, and virtual events on an applicant's decision to apply to, interview at, and rank residency programs.

RESULTS

78/156 (50%) candidates completed the survey. Thirty-five percent reported applying to more programs and 58% reported accepting more interviews than they would have if interviews were not virtual. Forty-two percent reported that social media played a vital role during the application season and 71% reported using social media to learn more about the program. Sixty-nine percent attended a virtual open house, 57% of whom reported that attending the open house influenced their decision to apply to a program. Sixty-three percent reported that attending a virtual reception influenced a program's ranking.

CONCLUSION

Social media has had a growing role in the medical community, and the COVID-19 pandemic likely accelerated an inevitable shift in residency program "branding" and how applicants perceive overall "goodness of fit".

Applicants' perception of fit to residency programmes in the video-interview era: A large multidisciplinary survey

INTRODUCTION

'Fit' refers to an applicants' perceived compatibility to a residency programme. A variety of structural, identity-related and relational factors contribute to self-assessments of fit. The 2021 residency recruitment cycle in the USA was performed virtually due to the COVID-19 pandemic. Little is known about how video-interviewing may affect residency applicants' ability to gauge fit.

METHODS

A multidisciplinary, anonymous survey was distributed to applicants at a large academic institution between rank order list (ROL) certification deadline and Match Day 2021. Using Likert-type scales, applicants rated factors for importance to 'fit' and their ease of assessment through video-interviewing. Applicants also self-assigned fit scores to the top-ranked programme in their ROL using Likert-type scales with pairs of anchoring statements.

RESULTS

Four hundred seventy-three applicants responded to the survey (25.7% response rate). The three most important factors to applicants for assessment of fit (how much the programme seemed to care, how satisfied residents seem with their programme and how well the residents get along) were also the factors with the greatest discrepancy between importance and ease of assessment through video-interviewing. Diversity-related factors were more important to female applicants compared with males and to non-White applicants compared with White applicants. Furthermore, White male applicants self-assigned higher fit scores compared with other demographic groups.

CONCLUSION

There is a marked discrepancy between the most important factors to applicants for fit and their ability to assess those factors virtually. Minoritised trainees self-assigned lower fit scores to their top-ranked programme, which should raise concern amongst medical educators and highlights the importance of expanding current diversity, equity and inclusion efforts in academic medicine.

Reducing Over-Interviewing in the Anesthesiology Residency Match

Background The U.S. residency recruitment process is expensive and time-consuming because of application inflation and over-invitation. Objective Using interview and match data, we quantify the predicted effects if anesthesiology residency programs excluded interviews for applicants who are very unlikely to match. Methods We previously published the validity and accuracy of the logistic regression model based on data from interview scheduling software used by 32 U.S. anesthesiology residency programs and 1300 applicants from 2015-18. Data used were program region, applicant address, numbers of interviews of the interviewee, medical school US News and World Report (USNWR) rank, the difference between United States Medical Licensing Exam (USMLE) Step 1 and 2 Clinical Knowledge (CK) scores, and the historical average of USMLE scores of program residents. In the current study completed in 2020, the predicted probabilities and their variances were summed among interviewees for 30 deidentified programs. Results For anesthesiology, the median residency program could reduce their interviews by 16.9% (97.5% confidence interval 8.5%-24.1%) supposing they would not invite applicants if the 99% upper prediction limit for the probability of matching was less than 10.0%. The corresponding median savings would be 0.80 interviews per matched spot (0.34-1.33). In doing so, the median program would sustain a risk of 5.3% (97.5% confidence interval 2.3%-7.9%) of having at least one interviewee removed from their final rank-to-match list. Conclusion Using novel interview data and analyses, we demonstrate that residency programs can substantively reduce interviews with less effect on rank-to-match lists. The data-driven approach to manage marginal interviews allows program leadership to better weigh costs and benefits when composing their annual list of interviewees.