Does the multiple mini-interview address stakeholder needs? An applicant's perspective

Twelve tips for constructing a multiple mini-interview

Health professions the world over value various competencies in their practitioners that are not easily captured by academic measures of performance. As a result, many programs have begun using multiple mini-interviews (MMIs) to facilitate the selection of candidates who are most likely to demonstrate and further develop such qualities. In this twelve-tips article, the authors offer evidence- and experience-based advice regarding how to construct an MMI that is fit for purpose. The tips are provided chronologically, offering guidance regarding how one might conceptualize their goals for creating an MMI, how to establish a database of stations that are context appropriate, and how to prepare both candidates and examiners for their task. While MMIs have been shown to have utility in many instances, the authors urge caution against over-generalization by stressing the importance of post-MMI considerations including data monitoring and integration between one's admissions philosophy and one's curricular efforts.

Virtual Reality as an Interview Technique in Evaluation of Emergency Medicine Applicants

NEED FOR INNOVATION

Current interviewing strategies and the standardized letter of evaluation may not provide enough insight into preferred resident characteristics. Emergency medicine (EM) residency programs are challenged with identifying trainees who can problem solve, communicate, and work well with fellow health professionals.

BACKGROUND

Structured interviews have previously been used and can help predict success but candidates have reported a negative impression with their use.

OBJECTIVE OF INNOVATION

This structured virtual reality (VR) interviewing method was designed so that interviewers can observe the communication abilities, subtle personality traits, and teamwork skills of applicants interviewed at an EM residency program.

DEVELOPMENT PROCESS

A consumer VR headset became available and in combination with an interactive team game was incorporated into a standardized team-based interview session. This session was designed to allow observation of candidates' communication, problem solving, and teamwork skills.

IMPLEMENTATION PHASE

Surveys were collected to examine the satisfaction of EM residency applicants who participated in this novel standardized interviewing method using a VR headset. After the submission of rank lists, but prior to Match Day, those who interviewed were e-mailed a voluntary, anonymous, and confidential survey asking about their interview experience, specifically about the VR portion. The survey was sent to 102 applicants with 63 responses for a 62% response rate at the completion of the 2015 to 2016 interview season.

OUTCOMES

Overall study findings suggested that participants had a highly favorable impression of the VR portion of the interview. Specifically, participants reported that this interview technique was appropriate and worthwhile. Additionally, participants attested that the Oculus portion of the interview gave insight to their work ethic, personality, and communication skills and how they work with others.

REFLECTIVE DISCUSSION

The novel interviewing method used in this study allowed interviewers to gain insight beyond that of the paperwork and brief face-to-face interaction. Study findings suggest that interviewees accepted the use of this novel interview method. It has been incorporated into our interview process for three consecutive years.

How well will you FIT? Use of a modified MMI to assess applicants' compatibility with an emergency medicine residency program

PURPOSE

Emergency medicine residency programs have evaluated the use of Multiple Mini Interviews (MMIs) for applicants. The authors developed an MMI-style method called the Fast Interview Track (FIT) to predict an applicant's 'fit' within an individual residency program.

METHODS

Applicants meet with up to five residents and are asked one question by each. Residents score the applicant using a Likert scale from 1 to 5 on two questions: 'How well does the applicant think on his/her feet?' and 'How well do you think the applicant will fit in here?'. To assess how well these questions predicted a resident's 'fit', current residents scored fellow residents on these same questions. These scores were compared with the residents' interview FIT scores. A postmatch survey of applicants who did not match at this program solicited applicants' attitudes toward the FIT sessions.

RESULTS

Among the junior class, the correlation between interview and current scores was significant for question 1 (rho=0.5192 [p=0.03]) and question 2 (rho=0.5753 [p=0.01]). Among seniors, Spearman's rho was statistically significant for question 2, though not statistically significant for question 1. The chi-square measure of high scores (4-5) versus low scores (1-3) found a statistically significant association between interview and current scores for interns and juniors. Of the 29 responses to the postmatch survey, 16 (55%) felt FIT sessions provided a good sense of the program's personality and only 6 (21%) disagreed. Nine (31%) felt FIT sessions positively impacted our program's ranking and 11 (38%) were 'Neutral'. Only two (7%) reported that FIT sessions negatively impacted their ranking of our program.

CONCLUSIONS

FIT provided program leadership with a sense of an applicant's 'fit' within this program. Interview day scores correlated with scores received during residency. Most applicants report a positive experience with FIT sessions. FIT provides a useful tool to recruit applicants who fit with the residency program.

Social media responses to the Annals of Emergency Medicine residents' perspective article on multiple mini-interviews

In May 2014, Annals of Emergency Medicine continued a successful collaboration with an academic Web site, Academic Life in Emergency Medicine (ALiEM) to host an online discussion session featuring the 2014 Annals Residents' Perspective article "Does the Multiple Mini-Interview Address Stakeholder Needs? An Applicant's Perspective" by Phillips and Garmel. This dialogue included Twitter conversations, a live videocast with the authors and other experts, and detailed discussions on the ALiEM Web site's comment section. This summary article serves the dual purpose of reporting the qualitative thematic analysis from a global online discussion and the Web analytics for our novel multimodal approach. Social media technologies provide a unique opportunity to engage with a diverse audience to detect existing and new emerging themes. Such technologies allow rapid hypothesis generation for future research and enable more accelerated knowledge translation.