Education scholarship in emergency medicine part 1: innovating and improving teaching and learning

Using the METRICS model for defining routes to scholarship in healthcare simulation

INTRODUCTION

In this paper, we explored the utility and value of the METRICS model for modeling scholarship in healthcare simulation by: (1) describing the distribution of articles in four healthcare simulation journals across the seven areas of METRICS scholarship; and (2) appraising patterns of scholarship expressed in three programs of simulation scholarship and reflecting on how these patterns potentially influence the pursuit of future scholarly activities.

METHODS

Two raters reviewed abstracts of papers published between January 2015 and August 2017 in four healthcare simulation journals and coded them using METRICS. Descriptive statistics were calculated for scholarship type and distribution across journals. Twenty-eight articles from three scholars were reviewed, with patterns of scholarship within articles mapped to METRICS. Descriptive synthesis was constructed through discussion between two reviewers.

RESULTS

A total of 432 articles from four journals were reviewed. The three most commonly published areas of scholarship were: 32.2% (139/432) evaluation, 18.8% (81/432) innovation, and 15.3% (66/432) conceptual. The METRICS model was able to represent different kinds of scholarship expressed in all of the papers reviewed and across programs of research. Reflecting on patterns of scholarship within their scholarly programs was helpful for research in planning future directions.

CONCLUSIONS

The METRICS model for scholarship can describe a wide range of patterns of simulation scholarship within individual articles, programs of research, or across journals.

CAEP 2016 Academic Symposium: How to have an impact as an emergency medicine educator and scholar

BACKGROUND

In a time of major medical education transformation, emergency medicine (EM) needs to nurture education scholars who will influence EM education practice. However, the essential ingredients to ensure a career with impact in EM education are not clear.

OBJECTIVE

To describe how to prepare EM educators for a high-impact career.

METHODS

The Canadian Association of Emergency Physicians (CAEP) Academic Section commissioned an "Education Impact" working group (IWG) to guide the creation of consensus recommendations from the EM community. EM educators from across Canada were initially recruited from the networks of the IWG members, and additional educators were recruited via snowball sampling. "High impact educators" were nominated by this network. The high impact educators were then interviewed using a structured question guide. These interviews were transcribed and coded for themes using qualitative methods. The process continued until no new themes were identified. Proposed themes and recommendations were presented to the EM community at the CAEP 2016 Academic Symposium. Feedback was then incorporated into a final set of recommendations.

RESULTS

Fifty-five (71%) of 77 of identified Canadian EM educators participated, and 170 names of high impact educators were submitted and ranked by frequency. The IWG achieved sufficiency of themes after nine interviews. Five recommendations were made: 1) EM educators can pursue a high impact career by leveraging either traditional or innovative career pathways; 2) EM educators starting their education careers should have multiple senior mentors; 3) Early-career EM educators should immerse themselves in their area of interest and cultivate a community of practice, not limited to EM; 4) Every academic EM department and EM teaching site should have access to an EM educator with protected time and recognition for their EM education scholarship; and 5) Educators at all stages should continuously compile an impact portfolio.

CONCLUSIONS

We describe a unique set of recommendations to develop educators who will influence EM, derived from a consensus from the EM community. EM leaders, educators, and aspiring educational scholars should consider how to implement this guide towards enhancing our specialty's educational mission.

An environmental scan of academic pediatric emergency medicine at Canadian medical schools: Identifying variability across Canada

OBJECTIVE

To complement our environmental scan of academic emergency medicine departments, we conducted a similar environmental scan of the academic pediatric emergency medicine programs offered by the Canadian medical schools.

METHODS

We developed an 88-question form, which was distributed to pediatric academic leaders at each medical school. The responses were validated via email to ensure that the questions were answered completely and consistently.

RESULTS

Fourteen of the 17 Canadian medical schools have some type of pediatric emergency medicine academic program. None of the pediatric emergency medicine units have full departmental status, while nine are divisions, two are sections, and three have no status. Canadian academic pediatric emergency medicine is practised at 13 major teaching hospitals and one specialized pediatric emergency department. There are 394 pediatric emergency medicine faculty members, including 13 full professors and 64 associate professors. Eight sites regularly take pediatric undergraduate clinical clerks, and all 14 provide resident education. Fellowship training is offered at 10 sites, with five offering advanced pediatric emergency medicine fellowship training. Half of the sites have at least one physician with a Master's degree in education, totalling 18 faculty members across Canada. There are 31 clinical researchers with salary support at nine universities. Eleven sites have published peer-reviewed papers (n=423) in the past five years, ranging from two to 102 per site. Annual academic budgets range from $10,000 to $2,607,515.

CONCLUSIONS

This comprehensive review of academic activities in pediatric emergency medicine across Canada identifies the variability across the country, including the recognition of sites above and below the national average, which may prompt change at individual sites. Sharing these academic practices may inspire sites to provide more support to teachers, educators, and researchers.

Developing and rewarding teachers as educators and scholars: remarkable progress and daunting challenges

CONTEXT

This article describes the scholarly work that has addressed the fifth recommendation of the 1988 World Conference on Medical Education: 'Train teachers as educators, not content experts alone, and reward excellence in this field as fully as excellence in biomedical research or clinical practice'.

PROGRESS

Over the past 30 years, scholars have defined the preparation needed for teaching and other educator roles, and created faculty development delivery systems to train teachers as educators. To reward the excellence of educators, scholars have expanded definitions of scholarship, defined educator roles and criteria for judging excellence, and developed educator portfolios to make achievements visible for peer review. Despite these efforts, the scholarship of discovery continues to be more highly prized and rewarded than the scholarship of teaching. These values are deeply embedded in university culture and policies.

CHALLENGES

To remedy the structural inequalities between researchers and educators, a holistic approach to rewarding the broad range of educational roles and educational scholarship is needed. This requires strong advocacy to create changes in academic rewards and support policies, provide a clear career trajectory for educators using learning analytics, expand programmes for faculty development, support health professions education scholarship units and academies of medical educators, and create mechanisms to ensure high standards for all educators.

The View From the Top: Academic Emergency Department Chairs' Perspectives on Education Scholarship

Education scholarship continues to grow within emergency medicine (EM) and in academic medicine in general. Despite a growing interest, would-be education scholars often struggle to find adequate mentorship, research training, funding, and protected time to produce rigorous scholarship. The ways in which individual academic EM departments can support this mission remains an area in need of description.

OBJECTIVES

We sought to describe academic EM department chairs' perceptions of education scholarship and facilitators and barriers to producing high-quality education scholarship.

METHODS

We conducted a qualitative study using a grounded theory-derived approach. Participants were solicited directly, and semistructured interviews were conducted via telephone. Interviews were transcribed verbatim and were analyzed by three study investigators using a coding matrix. Discrepancies in coding were resolved via in depth discussion.

RESULTS

We interviewed seven EM chairs from academic departments throughout North America (six in geographically diverse regions of the United States and one in western Canada). Chairs described education scholarship as lacking clearly defined and measurable outcomes, as well as methodologic rigor. They identified that education faculty within their departments need training and incentives to pursue scholarly work in a system that primarily expects teaching from educators. Chairs acknowledged a lack of access to education research expertise and mentorship within their own departments, but identified potential resources within their local medical schools and universities. They also voiced willingness to support career development opportunities and scholarly work among faculty seeking to perform education research.

CONCLUSIONS

Academic EM chairs endorse a need for methodologic training, mentorship, and access to expertise specific to education scholarship. While such resources are often rare within academic EM departments, they may exist within local universities and schools of medicine. Academic EM chairs described themselves as willing and able to support faculty who wish to pursue this type of work.

The writer's guide to education scholarship in emergency medicine: Systematic reviews and the scholarship of integration (part 4)

OBJECTIVE

Reviews help scholars consolidate evidence and guide their educational practice. However, few papers describe how to effectively publish review papers. We completed a scoping review to develop a set of quality indicators that will assist junior authors to publish reviews and integrative scholarship.

METHODS

MEDLINE, Embase, ERIC, and Google Scholar were searched for English language articles published between 2012 and January 2016 using the terms review, medical education, how to publish, and emergency medicine. Titles and abstracts were reviewed by two authors and included if they focused on how to publish a review or outlined reporting guidelines of reviews. The articles were reviewed in parallel for calibration, and disagreements were resolved through a consensus.

RESULTS

A full text review of the 25 articles was conducted, and 196 recommendations were extracted from 13 articles. A hand search of the included articles' reference lists and expert recommendation found an additional eight articles. These recommendations were thematically analysed into a list of seven themes and 32 items. Additionally, seven evaluation tools and reporting guidelines were found to guide researchers in optimizing their reviews for publication.

CONCLUSION

In emergency medicine education, review articles can help synthesize educational research so that educators can engage in evidence-based scholarly teaching. We hope that this work will act as an introduction to those interested in engaging in integrative scholarship by providing them with a guide to key quality markers and important checklists for improving their research.

A writer’s guide to education scholarship: Quantitative methodologies for medical education research (part 1)

Background

Quantitative research is one of the many research methods used to help educators advance their understanding of questions in medical education. However, little research has been done on how to succeed in publishing in this area.

Objective

We conducted a scoping review to identify key recommendations and reporting guidelines for quantitative educational research and scholarship.

Methods

Medline, ERIC, and Google Scholar were searched for English-language articles published between 2006 and January 2016 using the search terms, “research design,” “quantitative,” “quantitative methods,” and “medical education.” A hand search was completed for additional references during the full-text review. Titles/abstracts were reviewed by two authors (BT, PC) and included if they focused on quantitative research in medical education and outlined reporting guidelines, or provided recommendations on conducting quantitative research. One hundred articles were reviewed in parallel with the first 30 used for calibration and the subsequent 70 to calculate Cohen’s kappa coefficient. Two reviewers (BT, PC) conducted a full text review and extracted recommendations and reporting guidelines. A simple thematic analysis summarized the extracted recommendations.

Results

Sixty-one articles were reviewed in full, and 157 recommendations were extracted. The thematic analysis identified 86 items, 14 categories, and 3 themes. Fourteen quality evaluation tools and reporting guidelines were found.

Discussion

This paper provides guidance for junior researchers in the form of key quality markers and reporting guidelines. We hope that quantitative researchers in medical education will be informed by the results and that further work will be done to refine the list of recommendations.

CAEP 2014 Academic symposium: "How to make research succeed in your department: How to fund your research program"

OBJECTIVE

We sought to gather a comprehensive list of funding strategies and opportunities for emergency medicine (EM) centres across Canada, and make recommendations on how to successfully fund all levels of research activity, including research projects, staff salaries, infrastructure, and researcher stipends.

METHODS

We formed an expert panel consisting of volunteers recognized nationally for their scholarly work in EM. First, we conducted interviews with academic leaders and researchers to obtain a description of their local funding strategies using a standardized open-ended questionnaire. Panelists then identified emerging funding models. Second, we listed funding opportunities and initiatives at the provincial, national, and international levels. Finally, we used an iterative consensus-based approach to derive pragmatic recommendations after incorporating comments and suggestions from participants at an academic symposium.

RESULTS

Our review of funding strategies identified four funding models: 1) investigator dependent model, 2) practice plan, 3) generous benefactor, and 4) mixed funding. Recommendations in this document include approaches for research contributors and producers (seven recommendations), for local academic leaders (five recommendations), and for national organizations, such as the Canadian Association of Emergency Physicians (CAEP) (three recommendations).

CONCLUSIONS

Funding for research in EM varies across Canada and is largely insecure. We offer recommendations to help facilitate funding for large and small projects, for salary support, and for local and national leaders to advance EM research. We believe that these recommendations will increase funding for all levels of EM research activity, including research projects, staff salaries, infrastructure, and researcher stipends.

Academic Primer Series: Five Key Papers Fostering Educational Scholarship in Junior Academic Faculty

INTRODUCTION

Scholarship is an essential part of academic success. Junior faculty members are often unfamiliar with the grounding literature that defines educational scholarship. In this article, the authors aim to summarize five key papers which outline education scholarship in the setting of academic contributions for emerging clinician educators.

METHODS

The authors conducted a consensus-building process to generate a list of key papers that describe the importance and significance of academic scholarship, informed by social media sources. They then used a three-round voting methodology, akin to a Delphi study, to determine the most useful papers.

RESULTS

A summary of the five most important papers on the topic of academic scholarship, as determined by this mixed group of junior faculty members and faculty developers, is presented in this paper. These authors subsequently wrote a summary of these five papers and discussed their relevance to both junior faculty members and faculty developers.

CONCLUSION

Five papers on education scholarship, deemed essential by the authors' consensus process, are presented in this paper. These papers may help provide the foundational background to help junior faculty members gain a grasp of the academic scholarly environment. This list may also inform senior faculty and faculty developers on the needs of junior educators in the nascent stages of their careers.

An Environmental Scan of Academic Emergency Medicine at the 17 Canadian Medical Schools: Why Does this Matter to Emergency Physicians?

OBJECTIVE

We sought to conduct a major objective of the CAEP Academic Section, an environmental scan of the academic emergency medicine programs across the 17 Canadian medical schools.

METHODS

We developed an 84-question questionnaire, which was distributed to academic heads. The responses were validated by phone by the lead author to ensure that the questions were answered completely and consistently. Details of pediatric emergency medicine units were excluded from the scan.

RESULTS

At eight of 17 universities, emergency medicine has full departmental status and at two it has no official academic status. Canadian academic emergency medicine is practiced at 46 major teaching hospitals and 13 specialized pediatric hospitals. Another 69 Canadian hospital EDs regularly take clinical clerks and emergency medicine residents. There are 31 full professors of emergency medicine in Canada. Teaching programs are strong with clerkships offered at 16/17 universities, CCFP(EM) programs at 17/17, and RCPSC residency programs at 14/17. Fourteen sites have at least one physician with a Master's degree in education. There are 55 clinical researchers with salary support at 13 universities. Sixteen sites have published peer-reviewed papers in the past five years, ranging from four to 235 per site. Annual budgets range from $200,000 to $5,900,000.

CONCLUSION

This comprehensive review of academic activities in emergency medicine across Canada identifies areas of strengths as well as opportunities for improvement. CAEP and the Academic Section hope we can ultimately improve ED patient care by sharing best academic practices and becoming better teachers, educators, and researchers.

CAEP 2015 Academic Symposium: Recommendations for University Governance and Administration for Emergency Medicine

OBJECTIVE

1) To identify the strengths and challenges of governance structures in academic emergency medicine (EM), and 2) to make recommendations on principles and approaches that may guide improvements.

METHODS

Over the course of 9 months, eight established EM leaders met by teleconference, reviewed the literature, and discussed their findings and experiences to arrive at recommendations on governance in academic units of EM. The results and recommendations were presented at the annual Canadian Association of Emergency Physicians (CAEP) Academic Symposium, where attendees provided feedback. The updated recommendations were subsequently distributed to the CAEP Academic Section for further input, and the final recommendations were decided by consensus.

RESULTS

The panel identified four governance areas of interest: 1) the elements of governance; 2) the relationships between emergency physicians and academic units of EM, and between the academic units of EM and faculty of medicine; 3) current status of governance in Canadian academic units of EM; and 4) essential elements of good governance. Six recommendations were developed around three themes, including 1) the importance of good governance; 2) the purposes of an academic unit of EM; and 3) essential elements for better governance for academic units of EM. Recommendations included identifying the importance of good governance, recognizing the need to adapt to the different models depending on the local environment; seeking full departmental status, provided it is mutually beneficial to EM and the faculty of medicine (and health authority); using a consultation service to learn from the experience of other academic units of EM; and establishing an annual forum for EM leaders.

CONCLUSION

Although governance of academic EM is complex, there are ways to iteratively improve the mission of academic units of EM: providing exceptional patient care through research and education. Although there is no one-size-fits-all guide, there are practical recommended steps for academic units of EM to consider.

CAEP 2015 Academic Symposium: Current State and Recommendations to Achieve Adequate and Sustainable Funding for Emergency Medicine Academic Units

Objectives

To describe the current state of academic emergency medicine (EM) funding in Canada and develop recommendations to grow and establish sustainable funding.

Methods

A panel of eight leaders from different EM academic units was assembled. Using mixed methods (including a literature review, sharing of professional experiences, a survey of current EM academic heads, and data previously collected from an environmental scan), 10 recommendations were drafted and presented at an academic symposium. Attendee feedback was incorporated, and the second set of draft recommendations was further distributed to the Canadian Association Emergency Physicians (CAEP) Academic Section for additional comments before being finalized.

Results

Recommendations were developed around the funding challenges identified and solutions developed by academic EM university-based units across Canada. A strategic plan was seen as integral to achieving strong funding of an EM unit, especially when it aligned with departmental and institutional priorities. A business plan, although occasionally overlooked, was deemed an important component for planning and sustaining the academic mission. A number of recommendations surrounding philanthropy consisted of creating partnerships with existing foundations and engaging multiple stakeholders and communities. Synergy between academic and clinical EM departments was also viewed as an opportunity to ensure integration of common missions. Education and networking for current and future leaders were also viewed as invaluable to ensure that opportunities are optimized through strong leadership development and shared experiences to further the EM academic missions across the country.

Conclusions

These recommendations were designed to improve the financial circumstances for many Canadian EM units. There is a considerable wealth of resources that can contribute to financial stability for an academic unit, and an annual networking meeting and continuing education on these issues will facilitate more rapid implementation of these recommendations.

CAEP 2015 Academic Symposium: Leadership within the emergency medicine academic community and beyond

OBJECTIVES

A panel of emergency medicine (EM) leaders endeavoured to define the key elements of leadership and its models, as well as to formulate consensus recommendations to build and strengthen academic leadership in the Canadian EM community in the areas of mentorship, education, and resources.

METHODS

The expert panel comprised EM leaders from across Canada and met regularly by teleconference over the course of 9 months. From the breadth of backgrounds and experience, as well as a literature review and the development of a leadership video series, broad themes for recommendations around the building and strengthening of EM leadership were presented at the CAEP 2015 Academic Symposium held in Edmonton, Alberta. Feedback from the attendees (about 80 emergency physicians interested in leadership) was sought. Subsequently, draft recommendations were developed by the panel through attendee feedback, further review of the leadership video series, and expert opinion. The recommendations were distributed to the CAEP Academic Section for further feedback and updated by consensus of the expert panel.

RESULTS

The methods informed the panel who framed recommendations around four themes: 1) leadership preparation and training, 2) self-reflection/emotional intelligence, 3) academic leadership skills, and 4) gender balance in academic EM leadership. The recommendations aimed to support and nurture the next generation of academic EM leaders in Canada and included leadership mentors, availability of formal educational courses/programs in leadership, self-directed education of aspiring leaders, creation of a Canadian subgroup with the AACEM/SAEM Chair Development Program, and gender balance in leadership roles.

CONCLUSIONS

These recommendations serve as a roadmap for all EM leaders (and aspiring leaders) to build on their success, inspire their colleagues, and foster the next generation of Canadian EM academic leaders.

Education Scholarship and its Impact on Emergency Medicine Education

Emergency medicine (EM) education is becoming increasingly challenging as a result of changes to North American medical education and the growing complexity of EM practice. Education scholarship (ES) provides a process to develop solutions to these challenges. ES includes both research and innovation. ES is informed by theory, principles and best practices, is peer reviewed, and is disseminated and archived for others to use. Digital technologies have improved the discovery of work that informs ES, broadened the scope and timing of peer review, and provided new platforms for the dissemination and archiving of innovations. This editorial reviews key steps in raising an education innovation to the level of scholarship. It also discusses important areas for EM education scholars to address, which include the following: the delivery of competency-based medical education programs, the impact of social media on learning, and the redesign of continuing professional development.

Education scholarship in emergency medicine part 2: supporting and developing scholars

Emergency medicine (EM) is defined, in part, by clinical excellence across an immense breadth of content and the provision of exemplary bedside teaching to a wide variety of learners. The specialty is also well-suited to a number of emerging areas of education scholarship, particularly in relation to team-based learning, clinical reasoning, acute care response, and simulation-based teaching. The success of EM education scholarship will be predicated on systematic, collective attention to providing the infrastructure for this to occur. Specifically, as a new generation of emergency physicians prepares for education careers, academic organizations need to develop means not only to identify potential scholars but also to mentor, support, and encourage their careers. This paper summarizes the supporting literature and presents related recommendations from a 2013 consensus conference on EM education scholarship led by the Academic Section of the Canadian Association of Emergency Physicians.

Education scholarship in emergency medicine part 3: a “how-to” guide

Successful emergency medicine (EM) education scholarship requires a systematic approach that includes searching the (grey) literature, mobilizing resources, adopting frameworks to focus the innovation, integrating a component of program evaluation, and disseminating the innovation via traditional and emerging avenues. This paper provides direction for EM teachers and educators looking to transform their education innovation into scholarship. Recommendations on producing EM education scholarship from the 2013 consensus conference of the Academic Section of the Canadian Association of Emergency Physicians are presented.