1
|
Patel H, Wright DD, Hernandez N, Werling A, Watts E, Havron WS, Elkbuli A. Evaluating the Factors Influencing Residency Match for Surgical Specialty Applicants and Programs: Challenges and Future Directions. Am Surg 2024:31348241262427. [PMID: 38900926 DOI: 10.1177/00031348241262427] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/22/2024]
Abstract
INTRODUCTION We aim to evaluate the impact of recent changes in the residency matching process on surgical specialties' applicants and programs to offer recommendations on residency selection and matching processes. METHODS We utilized five databases while employing a Boolean query to search for studies from 2015 to March 2024. The search selection focused on factors and recent changes influencing residency match results across surgical specialties, including USMLE Step 1 pass/fail, research productivity, interview structure, and preference and geographic signaling. RESULTS The shift of the USMLE Step 1 to a pass/fail scoring system revealed a consensus among surgical program directors (PDs) and applicants not in favor of the change due to the emphasis on additional application elements. Research productivity was identified as a significant factor, especially in neurosurgery (with an average of 18.3 publications per applicant) and vascular surgery (8.3 publications), indicating a positive correlation between the number of publications and match outcomes. The adoption of virtual interviews has been well-received by both applicants and PDs, leading to an increase in the number of interviews offered and applicants. The implementation of preference and geographic signaling mechanisms has improved interview rates for applicants who utilize them. CONCLUSION The transition to a pass/fail USMLE Step 1 has raised concerns among surgical specialties, necessitating a greater focus on Step 2 scores and research productivity. Virtual interviews and signaling have improved the accessibility and reach of the residency application process, however, the full impact of these changes on the perception of applicant-program fit remains unclear.
Collapse
Affiliation(s)
- Heli Patel
- NOVA Southeastern University, Kiran Patel College of Allopathic Medicine, Fort Lauderdale, FL, USA
| | - D-Dre Wright
- University of Hawaii, John A. Burns School of Medicine, Honolulu, HI, USA
| | - Nickolas Hernandez
- William Carey University College of Osteopathic Medicine, Hattiesburg, MS, USA
| | - Alaina Werling
- NOVA Southeastern University, Kiran Patel College of Allopathic Medicine, Fort Lauderdale, FL, USA
| | - Emelia Watts
- NOVA Southeastern University, Kiran Patel College of Allopathic Medicine, Fort Lauderdale, FL, USA
| | - William S Havron
- Department of Surgery, Division of Trauma and Surgical Critical Care, Orlando Regional Medical Center, Orlando, FL, USA
- Department of Surgical Education, Orlando Regional Medical Center, Orlando, FL, USA
| | - Adel Elkbuli
- Department of Surgery, Division of Trauma and Surgical Critical Care, Orlando Regional Medical Center, Orlando, FL, USA
- Department of Surgical Education, Orlando Regional Medical Center, Orlando, FL, USA
| |
Collapse
|
2
|
Melvin J, Beesley H, Pernar LI, Richman A, Hess DT. Intern Experience Reflects Information Gathered During the Virtual Interview Process. JOURNAL OF SURGICAL EDUCATION 2023; 80:1544-1551. [PMID: 37563002 DOI: 10.1016/j.jsurg.2023.07.012] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/25/2023] [Revised: 06/15/2023] [Accepted: 07/10/2023] [Indexed: 08/12/2023]
Abstract
OBJECTIVE The onset of the coronavirus 2019 (COVID-19) pandemic brought many changes to the residency application process including transitioning to a virtual interview platform, which continues today. The transition brought many concerns from general surgery applicants about their ability to obtain adequate information about a program virtually. We sought to characterize how information presented by programs during the first ever virtual interview cycle matched the experience of general surgery interns after training at a program for 1 year. DESIGN, SETTING, AND PARTICIPANTS In May of 2022, a survey was distributed to 243 program directors who were asked to forward it to their general surgery categorical interns who matched during the 2021 virtual match cycle. Demographics, resources used to determine an impression of a program, and correlations between information presented virtually and what was subsequently experienced as an intern were collected. RESULTS Forty-six program directors confirmed forwarding the survey to their categorical interns. A total of 102 general surgery interns completed the survey. Most interns (88.2%) agreed that their experience matched expectations based on information received through the virtual interview process and 98% of interns were satisfied with their experience at their training program. Interviews with faculty (40.0%), residents (68.0%) and the program web site (29.0%) were the top 3 resources used to create the most accurate impression of a program. Interns felt they were well informed during the virtual interview experience about support from fellow residents (84.3%), culture (73.0%), surgical volume (72.5%), and intern operative experience (71.6%). In addition, 65.7% of participants thought they were able to obtain a good understanding of the program's culture from the virtual process. However, 16.7% thought that their program unintentionally misrepresented aspects of the training program. CONCLUSIONS The faculty and residency interviews were the most important factors in program ranking and most participants agreed that their virtual interview experience matched their expectations during their intern year. Most interns felt they were able to obtain a good understanding of the program's culture from the virtual process. In addition, a majority of interns felt well informed during the interview on aspects ranging from surgical volume, autonomy, and work hours to support from faculty and residents. If virtual interviews are to continue, residents can be satisfied that information gathered virtually will match the reality of their training. Programs should continue to make every effort to present their program realistically.
Collapse
Affiliation(s)
- Jeffrey Melvin
- Avedisian School of Medicine, Boston University Chobanian, Boston, Massachusetts; Department of Surgery, Boston Medical Center, Boston, Massachusetts
| | - Hassan Beesley
- Avedisian School of Medicine, Boston University Chobanian, Boston, Massachusetts
| | - Luise I Pernar
- Avedisian School of Medicine, Boston University Chobanian, Boston, Massachusetts; Department of Surgery, Boston Medical Center, Boston, Massachusetts
| | - Aaron Richman
- Avedisian School of Medicine, Boston University Chobanian, Boston, Massachusetts; Department of Surgery, Boston Medical Center, Boston, Massachusetts
| | - Donald T Hess
- Avedisian School of Medicine, Boston University Chobanian, Boston, Massachusetts; Department of Surgery, Boston Medical Center, Boston, Massachusetts.
| |
Collapse
|
3
|
Kumar B, Feng A, Gheriani G, Iftekhar A, Ni R, Dimachkie M, Gokalp G, Bazigh I, Moy L, Chao C, Lingamaneni A, Patel A, Cepero GS, Iqtidar T, Thoene PB, Knaack A, Swee ML, Suneja M, Davis B. Reimagining the Rheumatology Fellowship Interview: Using Participatory Design-Thinking Process to Create a More Applicant-Centered Experience. ACR Open Rheumatol 2023; 5:600-608. [PMID: 37724836 PMCID: PMC10642253 DOI: 10.1002/acr2.11606] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/09/2023] [Revised: 08/04/2023] [Accepted: 08/21/2023] [Indexed: 09/21/2023] Open
Abstract
OBJECTIVE Design thinking is a creative problem-solving process used to better understand users' needs and experiences so that a product or service can be improved. Its emphasis on empathy, iterative prototyping, and participatory collaboration make it an ideal methodology for innovation in medical education. We apply this framework to the virtual rheumatology fellowship interview process so that interviews can become more applicant centered. METHODS This educational quality improvement project uses a design-thinking framework to identify opportunities and challenges for rheumatology fellowship applicants. The investigators use the 5-step process (Empathize, Define, Ideate, Prototype, Test) and incorporate rapid qualitative analysis of semistructured interviews to innovate the interview experience. The iterative and collaborative nature of this process has empowered participants to codesign an applicant-centered interview experience. RESULTS Interviews with fellowship applicants (n = 9), fellow physicians (n = 4), and faculty members (n = 3) identified three major dynamics of the interview process: (1) Is it a safe environment to ask questions? (2) How do I exchange information effectively? and (3) How do I fit all these data into the bigger picture? Creative brainstorming techniques at a series of three workshops yielded four prototypes emphasizing customization, hybridization, facilitation, and preparation. A finalized applicant-centered interview template was devised in preparation for the 2023-2024 application season. CONCLUSION Design thinking has yielded insights into three important dynamics that drive applicant experiences. These insights allow for a redesign of processes so that virtual interviews can be more applicant centered. This framework allows for further iterations and modifications as the needs of applicants and programs evolve over time.
Collapse
Affiliation(s)
- Bharat Kumar
- University of Iowa Carver College of MedicineIowa City
| | - Alick Feng
- University of Iowa Carver College of MedicineIowa City
| | | | | | - Ruoning Ni
- University of Iowa Carver College of MedicineIowa City
| | | | - Gizem Gokalp
- University of Florida College of MedicineGainesville
| | - Izza Bazigh
- Mayo Clinic College of Medicine and ScienceArizonaScottsdale
| | - Lindsay Moy
- University of Iowa Carver College of MedicineIowa City
| | - Chen Chao
- Albert Einstein College of MedicineNew YorkBronx
| | | | - Axi Patel
- University of Illinois College of MedicineChicago
| | | | | | | | - Aaron Knaack
- University of Iowa Carver College of MedicineIowa City
| | | | - Manish Suneja
- University of Iowa Carver College of MedicineIowa City
| | | |
Collapse
|
4
|
Vaysburg DM, Delman AM, Ammann AM, Turner KM, Winer LK, Sussman JJ, Makley AT, Goodman MD, Quillin RC, Van Haren RM. General Surgery Residency Virtual Recruitment During the Pandemic: An Analysis of Applicant Surveys. J Surg Res 2023; 283:33-41. [PMID: 36368273 PMCID: PMC9642898 DOI: 10.1016/j.jss.2022.10.015] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/17/2022] [Revised: 09/07/2022] [Accepted: 10/15/2022] [Indexed: 11/09/2022]
Abstract
INTRODUCTION The COVID-19 pandemic forced a sudden change from in-person to virtual interviews for the general surgery residency match. General surgery programs and applicants adopted multiple strategies to best mimic in-person recruitment. The purpose of this study was to evaluate applicant opinions of the virtual recruitment format. MATERIALS AND METHODS Postinterview survey responses for applicants interviewing at a single general surgery residency program in the 2020-2021 and 2021-2022 cycles were evaluated. All interviewed applicants were sent an anonymous survey assessing the virtual interview structure, their impression of the program, and their opinions on recruitment in the future. RESULTS The response rate was 31.2% (n = 60). Most (88.4%) respondents reported a more favorable view of the program after a virtual interview. Factors that were most likely to create a favorable impression were residents (89.6%) and culture (81.0%). 50.8% of applicants favored virtual-only interviews. The majority of applicants (60.3%), however, preferred the virtual interview remain a component of the application process, 34.4% recommended that virtual interviews be used as an initial screen before in-person invites, while 19.0% suggested applicants should interview in-person or virtually without penalty. 62.1% favored capping the number of interviews offered by programs and accepted by applicants. CONCLUSIONS The virtual interview format for general surgery residency allows applicants to effectively evaluate a residency program. Applicants are in favor of a combination of virtual and in-person interviews in the future. Innovation in the recruitment process, including limiting the number of applications and incorporating virtual events, is supported by applicants.
Collapse
Affiliation(s)
- Dennis M. Vaysburg
- Cincinnati Research on Education in Surgical Training (CREST), Department of Surgery, University of Cincinnati, Cincinnati, Ohio
| | - Aaron M. Delman
- Cincinnati Research on Education in Surgical Training (CREST), Department of Surgery, University of Cincinnati, Cincinnati, Ohio
| | - Allison M. Ammann
- Cincinnati Research on Education in Surgical Training (CREST), Department of Surgery, University of Cincinnati, Cincinnati, Ohio
| | - Kevin M. Turner
- Cincinnati Research on Education in Surgical Training (CREST), Department of Surgery, University of Cincinnati, Cincinnati, Ohio
| | - Leah K. Winer
- Cincinnati Research on Education in Surgical Training (CREST), Department of Surgery, University of Cincinnati, Cincinnati, Ohio
| | - Jeffrey J. Sussman
- Cincinnati Research on Education in Surgical Training (CREST), Department of Surgery, University of Cincinnati, Cincinnati, Ohio
| | - Amy T. Makley
- Cincinnati Research on Education in Surgical Training (CREST), Department of Surgery, University of Cincinnati, Cincinnati, Ohio
| | - Michael D. Goodman
- Cincinnati Research on Education in Surgical Training (CREST), Department of Surgery, University of Cincinnati, Cincinnati, Ohio
| | - Ralph C. Quillin
- Cincinnati Research on Education in Surgical Training (CREST), Department of Surgery, University of Cincinnati, Cincinnati, Ohio
| | - Robert M. Van Haren
- Cincinnati Research on Education in Surgical Training (CREST), Department of Surgery, University of Cincinnati, Cincinnati, Ohio,Division of Thoracic Surgery, University of Cincinnati, Cincinnati, Ohio,Corresponding author. Department of Surgery, University of Cincinnati, 231 Albert Sabin Way ML—0558, Medical Sciences Building, Room 2472, Cincinnati, OH 45267-0558. Tel.: +1 513 584 4424
| |
Collapse
|
5
|
Brian R, Wang JJ, Park KM, Karimzada M, Sequeira N, O'Sullivan P, Alseidi A. Virtual Interviews: Assessing How Expectations Meet Reality. JOURNAL OF SURGICAL EDUCATION 2023; 80:200-207. [PMID: 36241482 DOI: 10.1016/j.jsurg.2022.09.019] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/18/2022] [Revised: 09/16/2022] [Accepted: 09/25/2022] [Indexed: 06/16/2023]
Abstract
OBJECTIVE This study aimed to determine the post-matriculation perceptions of interns and faculty who participated in the 2020-2021 virtual interview process and how their expectations of the program and the applicants, respectively, aligned with reality. DESIGN, SETTING, AND PARTICIPANTS Published surveys on virtual interviewing were reviewed and modified to design two surveys, for interns and for faculty who interviewed. Interns and faculty members from the Departments of Surgery and Medicine at one institution who participated in the 2020-2021 virtual interview process completed the surveys four to six months after the start of the academic year. Following survey completion, surgical interns from the same application cycle participated in one in-person focus group nine months after the start of the academic year to clarify points raised in the surveys. RESULTS Forty-six interns and faculty members responded to the survey (subgroup response rates ranging from 13-30%) and ten interns participated in the focus group (participation rate 100%). Most faculty and intern participants found that expectations formed during virtual interviews were accurate. However, our respondents noted limitations to virtual interviews that reduced their usefulness, including challenges with unnatural social interactions, understanding city fit, and getting a sense of resident and program culture. Participants provided possible solutions to address these challenges. CONCLUSIONS Overall, this mixed-methods study at a single institution found that perceptions from virtual interviews were generally accurate but with some limitations. We describe several opportunities to improve the virtual interview process and optimize the application experience.
Collapse
Affiliation(s)
- Riley Brian
- Department of Surgery, University of California San Francisco, San Francisco, California.
| | - Jaeyun Jane Wang
- Department of Surgery, University of California San Francisco, San Francisco, California
| | - Keon Min Park
- Division of Plastic Surgery, Department of Surgery, University of California San Francisco, San Francisco, California
| | - Mohammad Karimzada
- Department of Surgery, University of California San Francisco, San Francisco, California
| | - Nicola Sequeira
- Department of Surgery, University of California Davis, Davis, California
| | - Patricia O'Sullivan
- Department of Surgery, University of California San Francisco, San Francisco, California
| | - Adnan Alseidi
- Department of Surgery, University of California San Francisco, San Francisco, California
| |
Collapse
|
6
|
Atwood DT, Chiel LE, Nelson BA, Casey AM. Expectations versus reality: Understanding the accuracy of impressions made during virtual interviews of pediatric pulmonary fellowship programs. Pediatr Pulmonol 2023; 58:306-314. [PMID: 36222349 DOI: 10.1002/ppul.26201] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/23/2022] [Revised: 09/12/2022] [Accepted: 10/09/2022] [Indexed: 01/11/2023]
Abstract
RATIONALE As a result of the SARS-CoV-2 pandemic, all pediatric pulmonary fellowship programs conducted virtual interviews for the first time in the Fall of 2020. This study aimed to understand the accuracy of virtual-interview derived-impressions of fellowship programs, as well as applicant preference for future fellowship interview cycles. METHODS A group of pediatric pulmonary fellows and Program Directors designed a REDCap survey. The survey was distributed to all first-year pediatric pulmonary fellows who participated in the 2020-2021 virtual interview season. RESULTS 23/52 (44%) of first-year pediatric pulmonary fellows completed the survey. 96% were able to form general impressions about fellowship programs during their virtual interviews. 96% reported that generally their fellowship experience matched their virtual-interview derived-impressions. 17 of the 19 factors applicants use to rank programs had no statistically significant change (p > 0.05) in impression from virtual interview to fellowship experience. The two factors with a statistically significant (p < 0.05) change in impression were patient care related-volume of "bread and butter" pediatric pulmonary patients and volume of tertiary care pediatric pulmonary patients. 87% prefer some form of in-person interview option in future application cycles. A tiered interview format in which applicants are first invited to a virtual interview day followed by an optional in-person second look day was the most popular preference for future interview cycles (48%). CONCLUSIONS Virtual interviews may provide accurate representations of pediatric pulmonary fellowship programs and applicants prefer some type of in-person interview option in future application cycles.
Collapse
Affiliation(s)
- Daniel T Atwood
- Division of Pulmonary Medicine, Department of Pediatrics, Boston Children's Hospital, Harvard Medical School, Boston, Massachusetts, USA
| | - Laura E Chiel
- Division of Pulmonary Medicine, Department of Pediatrics, Boston Children's Hospital, Harvard Medical School, Boston, Massachusetts, USA
| | - Benjamin A Nelson
- Division of Pediatric Pulmonology, Massachusetts General Hospital for Children, Harvard Medical School, Boston, Massachusetts, USA
| | - Alicia M Casey
- Division of Pulmonary Medicine, Department of Pediatrics, Boston Children's Hospital, Harvard Medical School, Boston, Massachusetts, USA
| |
Collapse
|
7
|
Daniel M, Gottlieb M, Wooten D, Stojan J, Haas MRC, Bailey J, Evans S, Lee D, Goldberg C, Fernandez J, Jassal SK, Rudolf F, Guluma K, Lander L, Pott E, Goldhaber NH, Thammasitboon S, Uraiby H, Grafton-Clarke C, Gordon M, Pawlikowska T, Corral J, Partha I, Kolman KB, Westrick J, Dolmans D. Virtual interviewing for graduate medical education recruitment and selection: A BEME systematic review: BEME Guide No. 80. MEDICAL TEACHER 2022; 44:1313-1331. [PMID: 36369939 DOI: 10.1080/0142159x.2022.2130038] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/16/2023]
Abstract
BACKGROUND The COVID-19 pandemic caused graduate medical education (GME) programs to pivot to virtual interviews (VIs) for recruitment and selection. This systematic review synthesizes the rapidly expanding evidence base on VIs, providing insights into preferred formats, strengths, and weaknesses. METHODS PubMed/MEDLINE, Scopus, ERIC, PsycINFO, MedEdPublish, and Google Scholar were searched from 1 January 2012 to 21 February 2022. Two authors independently screened titles, abstracts, full texts, performed data extraction, and assessed risk of bias using the Medical Education Research Quality Instrument. Findings were reported according to Best Evidence in Medical Education guidance. RESULTS One hundred ten studies were included. The majority (97%) were from North America. Fourteen were conducted before COVID-19 and 96 during the pandemic. Studies involved both medical students applying to residencies (61%) and residents applying to fellowships (39%). Surgical specialties were more represented than other specialties. Applicants preferred VI days that lasted 4-6 h, with three to five individual interviews (15-20 min each), with virtual tours and opportunities to connect with current faculty and trainees. Satisfaction with VIs was high, though both applicants and programs found VIs inferior to in-person interviews for assessing 'fit.' Confidence in ranking applicants and programs was decreased. Stakeholders universally noted significant cost and time savings with VIs, as well as equity gains and reduced carbon footprint due to eliminating travel. CONCLUSIONS The use of VIs for GME recruitment and selection has accelerated rapidly. The findings of this review offer early insights that can guide future practice, policy, and research.
Collapse
Affiliation(s)
- Michelle Daniel
- School of Medicine, University of California, San Diego, San Diego, CA, USA
| | | | - Darcy Wooten
- School of Medicine, University of California, San Diego, San Diego, CA, USA
| | | | - Mary R C Haas
- University of Michigan Medical School, Ann Arbor, MI, USA
| | - Jacob Bailey
- School of Medicine, University of California, San Diego, San Diego, CA, USA
| | - Sean Evans
- School of Medicine, University of California, San Diego, San Diego, CA, USA
| | - Daniel Lee
- School of Medicine, University of California, San Diego, San Diego, CA, USA
| | - Charles Goldberg
- School of Medicine, University of California, San Diego, San Diego, CA, USA
- VA San Diego Healthcare, San Diego, CA, USA
| | - Jorge Fernandez
- School of Medicine, University of California, San Diego, San Diego, CA, USA
| | - Simerjot K Jassal
- School of Medicine, University of California, San Diego, San Diego, CA, USA
- VA San Diego Healthcare, San Diego, CA, USA
| | - Frances Rudolf
- School of Medicine, University of California, San Diego, San Diego, CA, USA
| | - Kama Guluma
- School of Medicine, University of California, San Diego, San Diego, CA, USA
| | - Lina Lander
- School of Medicine, University of California, San Diego, San Diego, CA, USA
| | - Emily Pott
- School of Medicine, University of California, San Diego, San Diego, CA, USA
| | - Nicole H Goldhaber
- School of Medicine, University of California, San Diego, San Diego, CA, USA
| | | | - Hussain Uraiby
- University Hospitals of Leicester NHS Trust, Leicester, UK
| | | | - Morris Gordon
- Biomedical Evidence Synthesis and Translation to Practice (BEST) Unit, School of Medicine, University of Central Lancashire, Preston, UK
| | - Teresa Pawlikowska
- Health Professions Education Centre (HPEC), RCSI University of Medicine and Health Sciences, Dublin, IE
| | - Janet Corral
- University of Nevada School of Medicine, Reno, NV, USA
| | - Indu Partha
- University of Arizona College of Medicine, Tuscon, AZ, USA
| | - Karyn B Kolman
- University of Arizona College of Medicine, Tuscon, AZ, USA
| | | | - Diana Dolmans
- Faculty of Health, Medicine and Life Sciences, Maastricht University, Maastricht, the Netherlands
| |
Collapse
|
8
|
|
9
|
Baloul MS, Lund S, D’Angelo J, Yeh VJH, Shaikh N, Rivera M. LEGO ®-based communication assessment in virtual general surgery residency interviews. GLOBAL SURGICAL EDUCATION : JOURNAL OF THE ASSOCIATION FOR SURGICAL EDUCATION 2022; 1:22. [PMID: 38013704 PMCID: PMC9171471 DOI: 10.1007/s44186-022-00021-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/15/2021] [Revised: 04/03/2022] [Accepted: 05/11/2022] [Indexed: 10/27/2022]
Abstract
Purpose Effective communication skills are a critical quality and skill that is highly sought after for surgeons which largely impacts patient outcomes. Residency programs design their interview processes to select the best candidates. LEGO®-based activities have been frequently used to enhance communication skills and team building. This study investigates the effectiveness and reliability of a novel LEGO®-based communication assessment in interviews for surgical residencies and the feasibility of implementing it in a virtual setting. Methods This study conducted a retrospective analysis of a LEGO®-based communication assessment at the program's 2020/2021 residency interviews. Each applicant was assessed on a different model. The total scores were analyzed for consistency among raters and correlated to faculty interviews. Furthermore, the impact of the assessment structure, scoring criteria, and range of models' difficulties on the total scores were explored. Results A total of 54 categorical and 55 preliminary applicants interviewed on 2 days. The assessment on different models and had no impact on applicants' total scores for either categorical and preliminary groups (p = 0.791 and 0.709, respectively). The communication components of the assessment showed high consistency between the raters. The two applicant groups displayed a statistically significant difference (p = 0.004) in the communication evaluation and model accuracy components. Total scores did not correlate with the faculty interviews of standardized questions in either group. Conclusion This novel LEGO®-based communication assessment showed high reliability and promising results as a tool to assess communication and problem solving for residency interviews that can be readily implemented in a virtual setting. Supplementary Information The online version contains supplementary material available at 10.1007/s44186-022-00021-4.
Collapse
Affiliation(s)
| | - Sarah Lund
- Department of Surgery, Mayo Clinic, Rochester, MN USA
- Mayo Clinic Multidisciplinary Simulation Center, Rochester, MN USA
| | - Jonathan D’Angelo
- Division of Colon and Rectal Surgery, Mayo Clinic, Rochester, MN USA
| | | | | | - Mariela Rivera
- Division of Trauma, Critical Care, and General Surgery, Department of Surgery, Mayo Clinic, 200 1st ST SW, Rochester, MN 55905 USA
| |
Collapse
|
10
|
Risbud A, Pang JC, Ito S, Tjoa T, Armstrong WB, Abouzari M. Otolaryngology residency programs' perspectives on virtual interviews during the COVID-19 pandemic. Laryngoscope Investig Otolaryngol 2022; 7:692-698. [PMID: 35734073 PMCID: PMC9195030 DOI: 10.1002/lio2.681] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/16/2021] [Revised: 09/27/2021] [Accepted: 10/05/2021] [Indexed: 11/08/2022] Open
Abstract
Objective To evaluate perceptions of otolaryngology residency program directors (PDs) and department chairs (DCs) on virtual interviews (VIs) at the conclusion of the 2021 residency match. Study design Cross-sectional survey study. Methods An anonymous and voluntary survey was administered to PDs and DCs of U.S. otolaryngology residency programs from March 1, 2021 to April 11, 2021. Utilizing Likert scale ratings, the survey measured overall satisfaction with the VI format, perceived ability to assess key candidate attributes, relative importance of traditional candidate metrics, and likelihood to implement VIs in future cycles. Results Ninety-four surveys were completed by PDs (48.9%) and DCs (51.1%). Sixty (63.8%) respondents found the VI experience to be satisfactory or strongly satisfactory. Sixty-six (70.2%) respondents felt confident in their ability to assess a candidate's professionalism and communication skills through VIs; however, confidence in gauging an applicant's clinical skills/knowledge (41.2%) and overall program fit (47.3%) was lower. Regarding candidate metrics, 64 (68.1%) respondents believed that personal prior knowledge of the applicant gained increased importance with VIs. Forty-four (46.8%) and 45 (47.9%) participants believed that letters of recommendation in the specialty and perceived commitment to their program similarly attained increased significance in evaluating applicants, respectively. Conclusion Most PDs and DCs were satisfied with their VI experiences and expect the quality of interns to be unaffected by virtual assessment modalities. Majority opinion on the relative importance of traditional applicant metrics remained largely unchanged, the exception being an increase in importance of prior knowledge of the applicant.Level of Evidence: N/A.
Collapse
Affiliation(s)
- Adwight Risbud
- Department of Otolaryngology–Head and Neck SurgeryUniversity of California, IrvineOrangeCaliforniaUSA
| | - Jonathan C. Pang
- Department of Otolaryngology–Head and Neck SurgeryUniversity of California, IrvineOrangeCaliforniaUSA
| | - Sun Ito
- Department of Otolaryngology–Head and Neck SurgeryUniversity of California, IrvineOrangeCaliforniaUSA
| | - Tjoson Tjoa
- Department of Otolaryngology–Head and Neck SurgeryUniversity of California, IrvineOrangeCaliforniaUSA
| | - William B. Armstrong
- Department of Otolaryngology–Head and Neck SurgeryUniversity of California, IrvineOrangeCaliforniaUSA
| | - Mehdi Abouzari
- Department of Otolaryngology–Head and Neck SurgeryUniversity of California, IrvineOrangeCaliforniaUSA
| |
Collapse
|
11
|
Leppard J, Nath A, Cheung WJ. Experiences, perspectives, and advice for using virtual interviews in post-graduate trainee selection: a national survey of CCFP (EM) program directors. CAN J EMERG MED 2022; 24:498-502. [PMID: 35637400 PMCID: PMC9150630 DOI: 10.1007/s43678-022-00312-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/15/2021] [Accepted: 03/30/2022] [Indexed: 11/17/2022]
Abstract
Objective Due to the COVID pandemic, restrictions were put in place mandating that all residency interviews be transitioned to a virtual format. Canadian CCFP(EM) programs were among the first to embark on this universal virtual interview process for resident selection. Although there have been several recent publications suggesting best practice guidelines for virtual interviews in trainee selection, pragmatic experiences and opinions from Program Directors (PDs) are lacking. This study aimed to elicit the experiences and perspectives of CCFP(EM) PDs after being amongst the first to conduct universal virtual interviews in Canada. Methods A 17-item online survey was created and distributed to all CCFP(EM) PDs (n = 17). It explored the virtual interview format employed, perceived advantages and disadvantages of a virtual configuration, confidence in determining a candidate’s rank order, and PD preference for employing a virtual interview format in the future. It also elicited practical advice to conduct a smooth and successful virtual interview day. Results The survey response rate was 76.5% (13/17). Nine respondents (69.2%) agreed that the virtual interview format enabled them to confidently determine a candidate’s rank order. With respect to preference for future use of virtual interviews, 23.1% agreed, 38.5% disagreed and 38.5% neither agreed nor disagreed. Inductive thematic analysis of free text responses revealed themes related to virtual interview advantages (time, financial, and resource costs), disadvantages (difficulty promoting smaller programs, getting a ‘feel’ for candidates and assessing their interpersonal skills), and practical tips to facilitate virtual interview processes. Conclusion Once restrictions are lifted, cost-saving advantages must be weighed against suggested disadvantages such as showcasing program strengths and assessing interpersonal skills in choosing between traditional and virtual formats. Should virtual interviews become a routine part of resident selection, the advice suggested in this study may be considered to help optimize a successful virtual interview process.
Supplementary Information The online version contains supplementary material available at 10.1007/s43678-022-00312-1.
Collapse
Affiliation(s)
- Jennifer Leppard
- Department of Emergency Medicine, University of Ottawa, The Ottawa Hospital, Ottawa, ON, Canada.
| | - Avik Nath
- Department of Emergency Medicine, University of Ottawa, The Ottawa Hospital, Ottawa, ON, Canada
| | - Warren J Cheung
- Department of Emergency Medicine, University of Ottawa, The Ottawa Hospital, Ottawa, ON, Canada.,Clinical Epidemiology Program, Ottawa Hospital Research Institute, Ottawa, ON, Canada
| |
Collapse
|
12
|
Simmons RP, Ortiz J, Kisielewski M, Zaas A, Finn KM. Virtual Recruitment: Experiences and Perspectives of Internal Medicine Program Directors. Am J Med 2022; 135:258-263.e1. [PMID: 34752749 PMCID: PMC8573855 DOI: 10.1016/j.amjmed.2021.10.017] [Citation(s) in RCA: 11] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/04/2021] [Accepted: 10/27/2021] [Indexed: 11/18/2022]
Affiliation(s)
- Rachel P Simmons
- Department of Medicine, Boston University School of Medicine, Boston, MA.
| | - Jordan Ortiz
- Alliance for Academic Internal Medicine, Alexandria, VA
| | | | - Aimee Zaas
- Department of Medicine, Duke University School of Medicine, Durham, NC
| | - Kathleen M Finn
- Department of Medicine, Massachusetts General Hospital, Harvard Medical School, Boston, MA
| |
Collapse
|
13
|
Aljamaan F, Alkhattabi F, Al-Eyadhy A, Alhaboob A, Alharbi NS, Alherbish A, Almosned B, Alobaylan M, Alabdulkarim H, Jamal A, Alhaider SA, Alsaywid B, Bashiri FA, Barry M, Al-Tawfiq JA, Alhasan K, Temsah MH. Faculty Members’ Perspective on Virtual Interviews for Medical Residency Matching during the COVID-19 Crisis: A National Survey. Healthcare (Basel) 2021; 10:healthcare10010016. [PMID: 35052180 PMCID: PMC8775573 DOI: 10.3390/healthcare10010016] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/18/2021] [Revised: 12/14/2021] [Accepted: 12/17/2021] [Indexed: 11/16/2022] Open
Abstract
During the COVID-19 pandemic, conducting face-to-face medical residency interviews was challenging due to infection prevention precautions, social distancing, and travel restrictions. Virtual interviews were implemented by the Saudi Commission for Health Specialties (SCFHS) as an alternative process for residency matching while striving to maintain the same quality standards. This national survey was conducted to assess the satisfaction and perceptions of faculty members’ virtual interview performance in the assessment for the medical training residency programs. Among the participating 173 faculty members, 34.1% did not have previous experience with video-conferencing. The Zoom application was the most commonly used platform (65.9%). Most (89.6%) of the faculty perceived virtual interviews as “adequate” platforms on which the candidates could express themselves, while almost half of the faculty (53.8%) agreed that virtual interviews allowed them to accurately reach an impression about the candidates. Overall, 73.4% of faculty felt comfortable ranking the virtually interviewed candidates. We conclude that the acceptance of participating faculty members in the first Saudi medical residency training matching cycle virtual interviewing event was well-perceived. This study provides evidence for future application and research of virtual interviews in residency candidates’ assessment, especially after the pandemic crisis resolves.
Collapse
Affiliation(s)
- Fadi Aljamaan
- College of Medicine, King Saud University, Riyadh 11362, Saudi Arabia; (F.A.); (A.A.-E.); (A.A.); (N.S.A.); (A.A.); (A.J.); (F.A.B.); (M.B.); (K.A.)
- Critical Care Department, King Saud University Medical City, Riyadh 11362, Saudi Arabia
| | - Fadiah Alkhattabi
- King Faisal Specialist Hospital and Research Center, Riyadh 11211, Saudi Arabia;
| | - Ayman Al-Eyadhy
- College of Medicine, King Saud University, Riyadh 11362, Saudi Arabia; (F.A.); (A.A.-E.); (A.A.); (N.S.A.); (A.A.); (A.J.); (F.A.B.); (M.B.); (K.A.)
- Pediatric Department, King Saud University Medical City, Riyadh 11362, Saudi Arabia; (B.A.); (M.A.); (H.A.)
| | - Ali Alhaboob
- College of Medicine, King Saud University, Riyadh 11362, Saudi Arabia; (F.A.); (A.A.-E.); (A.A.); (N.S.A.); (A.A.); (A.J.); (F.A.B.); (M.B.); (K.A.)
- Pediatric Department, King Saud University Medical City, Riyadh 11362, Saudi Arabia; (B.A.); (M.A.); (H.A.)
| | - Nasser S. Alharbi
- College of Medicine, King Saud University, Riyadh 11362, Saudi Arabia; (F.A.); (A.A.-E.); (A.A.); (N.S.A.); (A.A.); (A.J.); (F.A.B.); (M.B.); (K.A.)
- Pediatric Department, King Saud University Medical City, Riyadh 11362, Saudi Arabia; (B.A.); (M.A.); (H.A.)
| | - Adi Alherbish
- College of Medicine, King Saud University, Riyadh 11362, Saudi Arabia; (F.A.); (A.A.-E.); (A.A.); (N.S.A.); (A.A.); (A.J.); (F.A.B.); (M.B.); (K.A.)
- Pediatric Department, King Saud University Medical City, Riyadh 11362, Saudi Arabia; (B.A.); (M.A.); (H.A.)
| | - Badr Almosned
- Pediatric Department, King Saud University Medical City, Riyadh 11362, Saudi Arabia; (B.A.); (M.A.); (H.A.)
| | - Mohammed Alobaylan
- Pediatric Department, King Saud University Medical City, Riyadh 11362, Saudi Arabia; (B.A.); (M.A.); (H.A.)
| | - Hayfa Alabdulkarim
- Pediatric Department, King Saud University Medical City, Riyadh 11362, Saudi Arabia; (B.A.); (M.A.); (H.A.)
| | - Amr Jamal
- College of Medicine, King Saud University, Riyadh 11362, Saudi Arabia; (F.A.); (A.A.-E.); (A.A.); (N.S.A.); (A.A.); (A.J.); (F.A.B.); (M.B.); (K.A.)
- Department of Family and Community Medicine, King Saud University Medical City, Riyadh 11362, Saudi Arabia
- Evidence-Based Health Care & Knowledge Translation Research, King Saud University, Riyadh 11362, Saudi Arabia
| | - Sami A. Alhaider
- Saudi Commission for Health Specialties, Riyadh 11614, Saudi Arabia; (S.A.A.); (B.A.)
| | - Basim Alsaywid
- Saudi Commission for Health Specialties, Riyadh 11614, Saudi Arabia; (S.A.A.); (B.A.)
| | - Fahad A. Bashiri
- College of Medicine, King Saud University, Riyadh 11362, Saudi Arabia; (F.A.); (A.A.-E.); (A.A.); (N.S.A.); (A.A.); (A.J.); (F.A.B.); (M.B.); (K.A.)
- Pediatric Department, King Saud University Medical City, Riyadh 11362, Saudi Arabia; (B.A.); (M.A.); (H.A.)
| | - Mazin Barry
- College of Medicine, King Saud University, Riyadh 11362, Saudi Arabia; (F.A.); (A.A.-E.); (A.A.); (N.S.A.); (A.A.); (A.J.); (F.A.B.); (M.B.); (K.A.)
- Division of Infectious Diseases, Department of Internal Medicine, King Saud University Medical City, Riyadh 11362, Saudi Arabia
| | - Jaffar A. Al-Tawfiq
- Specialty Internal Medicine and Quality Department, Johns Hopkins Aramco Healthcare, Dhahran 34465, Saudi Arabia;
- Infectious Disease Division, Department of Medicine, School of Medicine, Indiana University, Indianapolis, IN 46202, USA
- Infectious Disease Division, Department of Medicine, School of Medicine, Johns Hopkins University, Baltimore, MD 21218, USA
| | - Khalid Alhasan
- College of Medicine, King Saud University, Riyadh 11362, Saudi Arabia; (F.A.); (A.A.-E.); (A.A.); (N.S.A.); (A.A.); (A.J.); (F.A.B.); (M.B.); (K.A.)
- Pediatric Department, King Saud University Medical City, Riyadh 11362, Saudi Arabia; (B.A.); (M.A.); (H.A.)
| | - Mohamad-Hani Temsah
- College of Medicine, King Saud University, Riyadh 11362, Saudi Arabia; (F.A.); (A.A.-E.); (A.A.); (N.S.A.); (A.A.); (A.J.); (F.A.B.); (M.B.); (K.A.)
- Pediatric Department, King Saud University Medical City, Riyadh 11362, Saudi Arabia; (B.A.); (M.A.); (H.A.)
- Prince Abdullah Ben Khaled Coeliac Disease, Faculty of Medicine, King Saud University, Riyadh 11362, Saudi Arabia
- Correspondence:
| |
Collapse
|