Emergency Medicine Education Research Since the 2012 Consensus Conference: How Far Have We Come and What's Next?

Evaluation of an Educational Scholarship Fellowship Program for Health Professions Educators

Introduction

Historically, the requirement to produce scholarship for advancement has challenged health professions educators heavily engaged in teaching. As biomedical scientists or healthcare practitioners, few are trained in educational scholarship, and related faculty development varies in scope and quality across institutions. Currently, there is a need for faculty development and mentoring programs to support the development of these skills.

Methods

The International Association of Medical Science Educators (IAMSE) established the Medical Educator Fellowship (MEF) Program to foster health professions educational scholarship. MEF addresses the following: curriculum design, teaching methods and strategies, assessment, educational scholarship, and leadership. Participants receive mentorship and faculty development, and complete an educational scholarship project. Using a logic model, we conducted a retrospective program evaluation with data from Program records, database searches, graduate surveys, and focus groups.

Results

Over 14 years, MEF graduated 61 participants with diverse terminal degrees from five continents and six academic program areas. Graduate survey responses indicated enhanced post-Program skills in all focus areas, that the majority would recommend MEF to a colleague, and that mentorship, networking, and professional development were strengths. Focus group outcomes indicated professional growth, increased confidence, and increased sense of community.

Conclusion

MEF addresses health professions educators' need for faculty development and mentorship in educational scholarship. Evaluation outcomes suggest that MEF effectively enhanced perceived skills across focus areas. Similar programs are essential to support faculty who dedicate significant time to teaching. Organizations like IAMSE can demonstrate the value of educational scholarship and positively impact health professions educator careers by supporting such programs.

The next generation of researchers: One-year outcome data from the SAEM Advanced Research Methodology Evaluation and Design in Medical Education (ARMED MedEd) program

Introduction

As the field of medical education evolves, there is a need to increase the quality of education scholarship and develop a cadre of research scholars; however, clinician educators (CEs) considering this career transition have limited formal training in education research methodology to heed this call. Therefore, a program that provides more advanced training in education scholarship for CEs without the financial and resource barriers of fellowships and masters programs is needed.

Methods

The SAEM Advanced Research Methodology Evaluation and Design in Medical Education (ARMED MedEd) program is a longitudinal program for the beyond-beginner CE, seeking advanced training in education research. The program was created using a comprehensive needs assessment and included longitudinal training; small-group projects; dedicated project mentors; and integrated diversity, equity, and inclusion initiatives. Program participants applied for a grant upon program completion.

Results

Twenty-one participants completed the course with 100% completing the baseline survey and 67% (14/21) completing the end-of-program survey. Participants reported improved perception of knowledge across all of the topics with a medium to large effect size, ranging from 0.40 to 0.62. When asked about impact on their network of potential collaborators, participants reported a median of 7 (interquartile range [IQR] 5-8) out of 9. When asked about the impact on their community of practice, participants reported a median of 7 (IQR 5-7) out of 9. When asked about the impact on their professional identity, participants reported a median of 7 (IQR 4-9) out of 9. Participants also reported an increase in both the quantity (mean of 2 ± 1 new mentors) and the quality (median score 7 [IQR 5-8] out of 9) of new research mentorship as a result of the program. Open-ended feedback was generally positive, with 100% reporting they would advise others to take this program.

Conclusions

The SAEM ARMED MedEd program represents a proof of concept for an advanced education research program seeking to fill the research training gap for the beyond-beginner Clinician educators.

Is it worth it? A qualitative analysis of the impact of medical education fellowships on careers

Objectives

Medical education fellowships provide training in teaching, assessment, educational program administration, and scholarship. The longitudinal impact of this training is unknown. The objective of this study was to explore the impact of medical education fellowships on the careers of graduates.

Methods

The authors performed a qualitative study with a constructivist-interpretivist paradigm using semistructured interviews in 2021. The authors used a purposeful randomized stratified sampling strategy of graduates to ensure diversity of representation (gender, region, fellowship duration, and career stage). Two researchers independently analyzed interview transcriptions using a modified grounded theory approach.

Results

The authors interviewed 10 graduates and identified three overarching concepts: motivations for pursuing fellowship, benefits of training, and drivers of career development. Graduates sought training because of their desire for growth and career preparation and at the advice of mentors. Fellowships provided knowledge and skills in a structured learning environment, supported by mentors and a collaborative community. Fellowship training shaped the careers of graduates by increasing their self-efficacy, enhancing their outcome expectations, refining their goals, and influencing their professional identity formation. They acquired expertise that prepared them for jobs, developed credibility, felt competitive in the job market, anticipated successful promotion, reached for greater goals, broadened their educational worldview, and evolved their professional identity as a result of fellowship training.

Conclusions

Fellowship training in medical education provides knowledge and skills, a structured learning environment, and important relationships that shape the careers of graduates by impacting their self-efficacy, outcome expectations, goal creation, and professional identity formation.

A workforce study of emergency medicine medical education fellowship directors: Describing roles, responsibilities, support, and priorities

Introduction

Despite emergency medicine (EM) medical education fellowships increasing in number, the position of the medical education fellowship director (FD) remains incompletely defined. The goal of this study was to characterize the roles, responsibilities, support, and priorities for medical education FDs.

Methods

We adapted and piloted an anonymous electronic survey consisting of 31 single-answer, multiple-answer, and free-response items. The survey was distributed to FDs via listserv and individual emails from a directory compiled from multiple online resources. We used descriptive statistics to analyze data from items with discrete answer choices. Using a constructivist paradigm, we performed a thematic analysis of free-response data.

Results

Thirty-four medical education FDs completed the survey, resulting in a response rate of 77%. Thirty-eight percent of respondents were female. Fifty-three percent earned master's degrees in education and 35% completed a medical education fellowship. Most respondents held other education leadership roles including program director (28%), associate/assistant program director (28%), and vice chair (25%). Sixty-three percent received support in their role, including clinical buy-down (90%), administrative assistants (55%), and salary (5%). There was no difference (χ2 [2, n = 32] = 1.77, p = 0.41) between availability of support and type of hospital (community, university, or public hospital). Medical education FDs dedicated a median of 12 h per month to fellowship responsibilities, include education (median 35% of time), program administration (25%), research mentorship (15%), and recruitment (10%). Medical education FDs describe priorities that can be categorized into three themes related to fellows, fellowship, and institution.

Conclusion

This study provides insight into the current position and experience of medical education FDs. The results can clarify the role and responsibilities of FDs as the demand for medical education FDs increases.

Beyond the CLAIM: A comprehensive needs assessment strategy for creating an Advanced Medical Education Research Training Program (ARMED-MedEd)

BACKGROUND

The health professions education (HPE) landscape has shifted substantively with increasing professionalization of research and scholarship. Clinician educators seeking to become competitive in this domain often pursue fellowships and master's degrees in HPE, but there are few resources for the continuing professional development (CPD) of those who seek to continue developing their scholarly practice within HPE. Acknowledging the multiple players in this landscape, the authors sought to design a new "beyond beginners" HPE research program using a novel needs assessment planning process.

METHODS

The authors developed and conducted a new three-phase, five-step process that sets forth a programmatic approach to conducting a needs assessment for a CPD course in HPE research. The five steps of the CLAIM method are: Competitive analysis, Literature review with thematic analysis, Ask stakeholders, Internal review by experts, and Mapping of a curriculum. These steps are organized into three phases (Discovery, Convergence, and Synthesis).

RESULTS

Over a 12-month period, the authors completed a comprehensive needs assessment. The CLAIM process revealed that longitudinal digital connection, diverse and in depth exposure to HPE research methods, skills around scholarly publishing, and leadership and management of research would be beneficial to our design.

CONCLUSIONS

The CLAIM method provided scaffolding to help the authors create a robust curriculum that adopts a scholarly approach for developing a HPE research course. This needs assessment methodology may be useful in other CPD contexts.

Outcome assessment of medical education fellowships in emergency medicine

OBJECTIVES

Medical education fellowships in emergency medicine (EM) provide training in teaching, assessment, educational program administration, and scholarship. The longitudinal impact of this training is unknown. Our objective was to characterize the career outcomes of medical education fellowship graduates.

METHODS

We solicited curriculum vitae (CV) from graduates of U.S. EM education fellowships by email. We abstracted data from CVs with a standard instrument that included program characteristics, employment history, leadership positions, awards, and scholarly productivity. We calculated and reported descriptive statistics.

RESULTS

A total of 71 of 91 (78%) graduates participated. Thirty-three completed a 1-year fellowship and 38 completed a 2-year fellowship. Nineteen (27%) completed an advanced degree during fellowship. Median (range) graduation year was 2016 (1997-2020). The majority, 63 of 71 (89%), work in an academic setting. Graduates held leadership positions in continuing medical education, graduate medical education, and undergraduate medical education. Forty-eight (68%) served on national medical education committees. The mean ± SD number of national medical education awards was 1.27 ± 2.03. The mean ± SD number of national medical education presentations was 7.63 ± 10.83. Graduates authored a mean ± SD of 3.63 ± 5.81 book chapters and a mean ± SD of 4.99 ± 6.17 peer-reviewed medical education research publications. Ten (14%) served on journal editorial boards, 34 (48%) were journal reviewers, and 31 (44%) had received a medical education grant.

CONCLUSION

EM medical education fellowship graduates are academically productive and hold education leadership positions.

Direct Observation Tools in Emergency Medicine: A Systematic Review of the Literature

OBJECTIVES

Direct observation is important for assessing the competency of medical learners. Multiple tools have been described in other fields, although the degree of emergency medicine-specific literature is unclear. This review sought to summarize the current literature on direct observation tools in the emergency department (ED) setting.

METHODS

We searched PubMed, Scopus, CINAHL, the Cochrane Central Register of Clinical Trials, the Cochrane Database of Systematic Reviews, ERIC, PsycINFO, and Google Scholar from 2012 to 2020 for publications on direct observation tools in the ED setting. Data were dual extracted into a predefined worksheet, and quality analysis was performed using the Medical Education Research Study Quality Instrument.

RESULTS

We identified 38 publications, comprising 2,977 learners. Fifteen different tools were described. The most commonly assessed tools included the Milestones (nine studies), Observed Structured Clinical Exercises (seven studies), the McMaster Modular Assessment Program (six studies), Queen's Simulation Assessment Test (five studies), and the mini-Clinical Evaluation Exercise (four studies). Most of the studies were performed in a single institution, and there were limited validity or reliability assessments reported.

CONCLUSIONS

The number of publications on direct observation tools for the ED setting has markedly increased. However, there remains a need for stronger internal and external validity data.

The Impact of a Medical Education Research Faculty Development Program on Career Development, Through the Lens of Social Cognitive Career Theory

OBJECTIVES

The Medical Education Research Certificate at the Council of Residency Directors in Emergency Medicine (MERC at CORD), a specialized adaptation of the Association of American Medical Colleges MERC program, provides faculty development in education research in emergency medicine. However, its long-term influence on career development remains unknown. Our study explored the impact of MERC at CORD on career development through the lens of social cognitive career (SCC) theory.

METHODS

This was a prospective qualitative study using a constructivist/interpretivist paradigm to assess long-term career development outcomes. A purposeful randomized stratified sampling strategy of MERC at CORD graduates (2011-2014) ensured diversity of representation (sex, region, number of research publications, and project group leadership). Subjects were invited by e-mail to participate in semistructured phone interviews. Thematic analysis by two independent reviewers followed an iterative process until saturation was reached.

RESULTS

Twelve graduates were interviewed. All engaged with MERC at CORD early in their careers with minimal previous education research experience. Currently, all hold medical education leadership positions. Graduates had a mean of 19.3 publications (range = 9-43). Themes explaining reasons for participating in MERC at CORD include: desire for education research skills, recommendation of mentors/colleagues, and accessibility. Themes citing the program's value to career development include networking/collaboration, mentorship, informational framework to build upon, and the application of theoretical knowledge through experiential learning. MERC at CORD impacted career development aligning with the core domains of SCC theory including self-efficacy, outcome expectations, and goals.

CONCLUSION

MERC at CORD enhanced the long-term career development of participants by providing a core knowledge framework in a mentored, experiential learning environment. Participants identified themes aligned with SCC theory as influential in their long-term career advancement in medical education including the development of education research skills, successful completion of education research, career acceleration, promotion, niche development, and formulation of professional goals.