Highlights in emergency medicine medical education research: 2008

Emergency Medicine Education Research Since the 2012 Consensus Conference: How Far Have We Come and What's Next?

In 2012, the Society for Academic Emergency Medicine convened a consensus conference on the state of medical education research with goals of defining and advancing a future research agenda. Since that time, emergency medicine (EM) education research has grown significantly. A task force of EM education experts was assembled and sought to understand the current state of EM education research and future directions. Among the advances are increases in medical education fellowships, advanced degree and certification programs, faculty development programs, publication venues, and funding. These findings are discussed in light of the prior objectives from the 2012 consensus conference, and recommendations for future directions are provided.

The Flipped Classroom: A Critical Appraisal

Introduction

The objective of this study was to review and critically appraise the medical education literature pertaining to a flipped-classroom (FC) education model, and to highlight influential papers that inform our current understanding of the role of the FC in medical education.

Methods

A search of the English-language literature querying Education Resources Information Center (ERIC), PsychINFO, PubMed, and Scopus identified 296 papers related to the FC using either quantitative, qualitative, or review methods. Two reviewers independently screened each category of publications using previously established exclusion criteria. Eight reviewers then independently scored the remaining 54 publications using either a qualitative, quantitative, or review-paper scoring system. Each scoring system consisted of nine criteria and used parallel metrics that have been previously used in critical appraisals of education research.

Results

A total of 54 papers (33 quantitative, four qualitative, and 17 review) on FC met a priori criteria for inclusion and were critically appraised and reviewed. The top 10 highest scoring articles (five quantitative studies, two qualitative studies, and three review papers) are summarized in this article.

Conclusion

This installment of the Council of Emergency Medicine Residency Directors (CORD) Academy Critical Appraisal series highlights 10 papers that describe the current state of literature on the flipped classroom, including an analysis of the benefits and drawbacks of an FC approach, practical implications for emergency medicine educators, and next steps for future research.

Critical Appraisal of Emergency Medicine Educational Research: The Best Publications of 2016

OBJECTIVES

The objectives were to critically appraise the emergency medicine (EM) medical education literature published in 2016 and review the highest-quality quantitative and qualitative studies.

METHODS

A search of the English language literature in 2016 querying MEDLINE, Scopus, Education Resources Information Center (ERIC), and PsychInfo identified 510 papers related to medical education in EM. Two reviewers independently screened all of the publications using previously established exclusion criteria. The 25 top-scoring quantitative studies based on methodology and all six qualitative studies were scored by all reviewers using selected scoring criteria that have been adapted from previous installments. The top-scoring articles were highlighted and trends in medical education research were described.

RESULTS

Seventy-five manuscripts met inclusion criteria and were scored. Eleven quantitative and one qualitative papers were the highest scoring and are summarized in this article.

CONCLUSION

This annual critical appraisal series highlights the best EM education research articles published in 2016.

The Uphill Battle of Performing Education Scholarship: Barriers Educators and Education Researchers Face

Introduction

Educators and education researchers report that their scholarship is limited by lack of time, funding, mentorship, expertise, and reward. This study aims to evaluate these groups’ perceptions regarding barriers to scholarship and potential strategies for success.

Methods

Core emergency medicine (EM) educators and education researchers completed an online survey consisting of multiple-choice, 10-point Likert scale, and free-response items in 2015. Descriptive statistics were reported. We used qualitative analysis applying a thematic approach to free-response items.

Results

A total of 204 educators and 42 education researchers participated. Education researchers were highly productive: 19/42 reported more than 20 peer-reviewed education scholarship publications on their curricula vitae. In contrast, 68/197 educators reported no education publications within five years. Only a minority, 61/197 had formal research training compared to 25/42 education researchers. Barriers to performing research for both groups were lack of time, competing demands, lack of support, lack of funding, and challenges achieving scientifically rigorous methods and publication. The most common motivators identified were dissemination of knowledge, support of evidence-based practices, and promotion. Respondents advised those who seek greater education research involvement to pursue mentorship, formal research training, collaboration, and rigorous methodological standards.

Conclusion

The most commonly cited barriers were lack of time and competing demands. Stakeholders were motivated by the desire to disseminate knowledge, support evidence-based practices, and achieve promotion. Suggested strategies for success included formal training, mentorship, and collaboration. This information may inform interventions to support educators in their scholarly pursuits and improve the overall quality of education research in EM.

Comparing Quick Sequential Organ Failure Assessment Scores to End-tidal Carbon Dioxide as Mortality Predictors in Prehospital Patients with Suspected Sepsis

Introduction

Early identification of sepsis significantly improves outcomes, suggesting a role for prehospital screening. An end-tidal carbon dioxide (ETCO₂) value ≤ 25 mmHg predicts mortality and severe sepsis when used as part of a prehospital screening tool. Recently, the Quick Sequential Organ Failure Assessment (qSOFA) score was also derived as a tool for predicting poor outcomes in potentially septic patients.

Methods

We conducted a retrospective cohort study among patients transported by emergency medical services to compare the use of ETCO₂ ≤ 25 mmHg with qSOFA score of ≥ 2 as a predictor of mortality or diagnosis of severe sepsis in prehospital patients with suspected sepsis.

Results

By comparison of receiver operator characteristic curves, ETCO₂ had a higher discriminatory power to predict mortality, sepsis, and severe sepsis than qSOFA.

Conclusion

Both non-invasive measures were easily obtainable by prehospital personnel, with ETCO₂ performing slightly better as an outcome predictor.

Critical Appraisal of Emergency Medicine Educational Research: The Best Publications of 2015

OBJECTIVE

The objectives were to critically appraise the medical education research literature of 2015 and review the highest-quality quantitative and qualitative examples.

METHODS

A total of 434 emergency medicine (EM)-related articles were discovered upon a search of ERIC, PsychINFO, PubMED, and SCOPUS. These were both quantitative and qualitative in nature. All were screened by two of the authors using previously published exclusion criteria, and the remaining were appraised by all authors using a previously published scoring system. The highest scoring articles were then reviewed.

RESULTS

Sixty-one manuscripts were scored, and 10 quantitative and two qualitative papers were the highest scoring and are reviewed and summarized in this article.

CONCLUSIONS

This installment in this critical appraisal series reviews 12 of the highest-quality EM-related medical education research manuscripts published in 2015.

Critical Appraisal of Emergency Medicine Educational Research: The Best Publications of 2015

OBJECTIVE

The objectives were to critically appraise the medical education research literature of 2015 and review the highest-quality quantitative and qualitative examples.

METHODS

A total of 434 emergency medicine (EM)-related articles were discovered upon a search of ERIC, PsychINFO, PubMED, and SCOPUS. These were both quantitative and qualitative in nature. All were screened by two of the authors using previously published exclusion criteria, and the remaining were appraised by all authors using a previously published scoring system. The highest scoring articles were then reviewed.

RESULTS

Sixty-one manuscripts were scored, and 10 quantitative and two qualitative papers were the highest scoring and are reviewed and summarized in this article.

CONCLUSIONS

This installment in this critical appraisal series reviews 12 of the highest-quality EM-related medical education research manuscripts published in 2015.

Feedback in Medical Education: A Critical Appraisal

OBJECTIVE

The objective was to review and critically appraise the medical education literature pertaining to feedback and highlight influential papers that inform our current understanding of the role of feedback in medical education.

METHODS

A search of the English language literature in querying Education Resources Information Center (ERIC), PsychINFO, PubMed, and Scopus identified 327 feedback-related papers using either quantitative (hypothesis-testing or observational investigations of educational interventions), qualitative methods (exploring important phenomena in emergency medicine [EM] education), or review methods.Two reviewers independently screened each category of publications using previously established exclusion criteria. Six reviewers then independently scored the remaining 54 publications using a qualitative, quantitative, or review paper scoring system. Each scoring system consisted of nine criteria and used parallel scoring metrics that have been previously used in critical appraisals of education research.

RESULTS

Fifty-four feedback papers (25 quantitative studies, 24 qualitative studies, five review papers) met the a priori criteria for inclusion and were reviewed. Eight quantitative studies, nine qualitative studies, and three review papers were ranked highly by the reviewers and are summarized in this article.

CONCLUSIONS

This inaugural Council of Emergency Medicine Residency Directors Academy critical appraisal highlights 20 feedback in medical education papers that describe the current state of the feedback literature. A summary of current factors that influence feedback effectiveness is discussed, along with practical implications for EM educators and the next steps for research.

Cognitive Load and Self-Determination Theories Applied to E-Learning: Impact on Students' Participation and Academic Performance

BACKGROUND

Emergency clerkships expose students to a stressful environment that require multiple tasks, which may have a direct impact on cognitive load and motivation for learning. To address this challenge, Cognitive Load Theory and Self Determination Theory provided the conceptual frameworks to the development of a Moodle-based online Emergency Medicine course, inspired by real clinical cases.

METHODS

Three consecutive classes (2013-2015) of sixth-year medical students (n = 304) participated in the course, during a curricular and essentially practical emergency rotation. "Virtual Rounds" provided weekly virtual patients in narrative format and meaningful schemata to chief complaints, in order to simulate real rounds at Emergency Unit. Additional activities such as Extreme Decisions, Emergency Quiz and Electrocardiographic challenge offered different views of emergency care. Authors assessed student´s participation and its correlation with their academic performance. A survey evaluated students´ opinions. Students graduating in 2015 answered an online questionnaire to investigate cognitive load and motivation.

RESULTS

Each student produced 1965 pageviews and spent 72 hours logged on. Although Clinical Emergency rotation has two months long, students accessed the online course during an average of 5.3 months. Virtual Rounds was the most accessed activity, and there was positive correlations between the number of hours logged on the platform and final grades on Emergency Medicine. Over 90% of students felt an improvement in their clinical reasoning and considered themselves better prepared for rendering Emergency care. Considering a Likert scale from 1 (minimum load) to 7 (maximum load), the scores for total cognitive load were 4.79±2.2 for Virtual Rounds and 5.56±1.96 for real medical rounds(p<0,01).

CONCLUSIONS

A real-world inspired online course, based on cognitive and motivational conceptual frameworks, seems to be a strong tool to engage students in learning. It may support them to manage the cognitive challenges involved in clinical care and increase their motivation for learning.

Critical Appraisal of Emergency Medicine Education Research: The Best Publications of 2014

OBJECTIVES

The objective was to critically appraise and highlight rigorous education research study articles published in 2014 whose outcomes advance the science of emergency medicine (EM) education.

METHODS

A search of the English language literature in 2014 querying Education Resources Information Center (ERIC), PsychINFO, PubMed, and Scopus identified 243 EM-related articles using either quantitative (hypothesis-testing or observational investigations of educational interventions) or qualitative (exploring important phenomena in EM education) methods. Two reviewers independently screened all of the publications using previously established exclusion criteria. Six reviewers then independently scored the 25 selected publications using either a qualitative or a quantitative scoring system. Each scoring system consisted of nine criteria. Selected criteria were based on accepted educational review literature and chosen a priori. Both scoring systems use parallel scoring metrics and have been used previously within this annual review.

RESULTS

Twenty-five medical education research papers (22 quantitative, three qualitative) met the criteria for inclusion and were reviewed. Five quantitative and two qualitative studies were ranked most highly by the reviewers as exemplary and are summarized in this article.

CONCLUSIONS

This annual critical appraisal series highlights seven excellent EM education research studies, meeting a priori criteria and published in 2014. Methodologic strengths in the 2014 papers are noted, and current trends in medical education research in EM are discussed.

Critical appraisal of emergency medicine education research: the best publications of 2013

OBJECTIVES

The objective was to critically appraise and highlight methodologically superior medical education research articles published in 2013 whose outcomes are pertinent to teaching and education in emergency medicine (EM).

METHODS

A search of the English-language literature in 2013 querying Education Resources Information Center (ERIC), PsychINFO, PubMed, and Scopus identified 251 EM-related studies using hypothesis-testing or observational investigations of educational interventions. Two reviewers independently screened all of the publications and removed articles using established exclusion criteria. Six reviewers then independently scored the remaining 43 publications using either a qualitative a or quantitative scoring system, based on the research methodology of each article. Each scoring system consisted of nine criteria. Selected criteria were based on accepted educational review literature and chosen a priori. Both scoring systems used parallel scoring metrics and have been used previously within this annual review.

RESULTS

Forty-three medical education research papers (37 quantitative and six qualitative studies) met the a priori criteria for inclusion and were reviewed. Six quantitative and one qualitative study were scored and ranked most highly by the reviewers as exemplary and are summarized in this article.

CONCLUSIONS

This annual critical appraisal article aims to promote superior research in EM-related education, by reviewing and highlighting seven of 43 major education research studies, meeting a priori criteria, and published in 2013. Common methodologic pitfalls in the 2013 papers are noted, and current trends in medical education research in EM are discussed.

Critical appraisal of emergency medicine education research: the best publications of 2012

OBJECTIVES

The objective was to critically appraise and highlight medical education research published in 2012 that was methodologically superior and whose outcomes were pertinent to teaching and education in emergency medicine (EM).

METHODS

A search of the English language literature in 2012 querying Education Resources Information Center (ERIC), PsychInfo, PubMed, and Scopus identified EM studies using hypothesis-testing or observational investigations of educational interventions. Two reviewers independently screened all of the publications and removed articles using established exclusion criteria. This year, publications limited to a single-site survey design that measured satisfaction or self-assessment on unvalidated instruments were not formally reviewed. Six reviewers then independently ranked all remaining publications using one of two scoring systems depending on whether the study methodology was primarily qualitative or quantitative. Each scoring system had nine criteria, including four related to methodology, that were chosen a priori, to standardize evaluation by reviewers. The quantitative study scoring system was used previously to appraise medical education published annually in 2008 through 2011, while a separate, new qualitative study scoring system was derived and implemented consisting of parallel metrics.

RESULTS

Forty-eight medical education research papers met the a priori criteria for inclusion, and 33 (30 quantitative and three qualitative studies) were reviewed. Seven quantitative and two qualitative studies met the criteria for inclusion as exemplary and are summarized in this article.

CONCLUSIONS

This critical appraisal series aims to promote superior education research by reviewing and highlighting nine of the 48 major education research studies with relevance to EM published in 2012. Current trends and common methodologic pitfalls in the 2012 papers are noted.

Critical appraisal of emergency medicine educational research: the best publications of 2011

OBJECTIVES

The objective was to critically appraise and highlight medical education research studies published in 2011 that were methodologically superior and whose outcomes were pertinent to teaching and education in emergency medicine (EM).

METHODS

A search of the English language literature in 2011 querying PubMed, Scopus, Education Resources Information Center (ERIC), and PsychInfo identified EM studies that used hypothesis-testing or observational investigations of educational interventions. Six reviewers independently ranked all publications based on 10 criteria, including four related to methodology, that were chosen a priori to standardize evaluation by reviewers. This method was used previously to appraise medical education published in 2008, 2009, and 2010.

RESULTS

Forty-eight educational research papers were identified. Comparing the literature of 2011 to that of 2008 through 2010, the number of published educational research papers meeting the criteria increased over time from 30, to 36, to 41, and now to 48. Five medical education research studies met the a priori criteria for inclusion as exemplary and are reviewed and summarized in this article. The number of funded studies remained fairly stable over the past 3 years, at 13 (2008), 16 (2009), 9 (2010), and 13 (2011). As in past years, research involving the use of technology accounted for almost half (n = 22) of the publications. Observational study designs accounted for 28 of the papers, while nine studies featured an experimental design.

CONCLUSIONS

Forty-eight EM educational studies published in 2011 and meeting the criteria were identified. This critical appraisal reviews and highlights five studies that met a priori quality indicators. Current trends and common methodologic pitfalls in the 2011 papers are noted.

Executive summary: Education research in emergency medicine-opportunities, challenges, and strategies for success

The 2012 Academic Emergency Medicine (AEM) consensus conference "Education Research In Emergency Medicine: Opportunities, Challenges, and Strategies for Success" convened a diverse group of stakeholders in medical education to target gaps in emergency medicine (EM) education research and identify priorities for future study. A total of 175 registrants collaborated in preparatory and conference-day activities to explore subtopics in educational interventions, learner assessment, faculty development, and research funding and infrastructure. The conference was punctuated by didactic sessions led by key international medical education experts and ended with consensus formation in many domains. This issue of AEM presents the exciting results of this process.

An agenda for increasing grant funding of emergency medicine education research

Funding is a perennial challenge for medical education researchers. Through a consensus process, the authors developed a multifaceted agenda for increasing funding of education research in emergency medicine (EM). Priority agenda items include developing resources to increase the competitiveness of medical education research faculty in grant applications, identifying means by which departments may bolster their faculty's grant writing success, taking long-term steps to increase the number of grants available to education researchers in the field, and encouraging a shift in cultural attitudes toward education research.

Overcoming barriers to addressing education problems with research design: a panel discussion

A plenary panel session at the 2012 Academic Emergency Medicine consensus conference "Education Research in Emergency Medicine: Opportunities, Challenges, and Strategies for Success" discussed barriers educators face in imagining, designing, and implementing studies to address educational challenges. This proceedings article presents a general approach to getting started in education research. Four examples of studies from the medical education literature that illustrate a distinct way to approach specific research questions are discussed. The study designs used are applicable to a variety of education research problems in emergency medicine (EM). Potential applications of studies are discussed, as well as effects and lessons learned.

Toward a new paradigm: goal-based residency training

OBJECTIVES

Many factors affect the clinical training experience of emergency medicine (EM) residents, and length of training currently serves as a proxy for clinical experience. Very few studies have been published that provide quantitative information about clinical experience. The goals of this study were to determine the numbers of clinical encounters for each resident in emergency department (ED) rotations during training in a 3-year program, to characterize these encounters by patient acuity and age, to determine the numbers of encounters for selected clinical disorders, and to assess the variation in clinical experience between residents.

METHODS

This was a retrospective analysis of the ED clinical and administrative databases at two hospitals that provide EM training for a southeastern U.S. EM residency program. Data were gathered for three complete cohorts of residents, with entering years of 2003, 2004, and 2005, so the total study period was 2003-2008. ED clinical encounter information included hospital training site (tertiary or community), postgraduate year (PGY) of the resident, patient triage acuity reflected by the Emergency Severity Index (ESI); patient International Classification of Diseases, Ninth Revision, Clinical Modification (ICD-9-CM) diagnostic code; and patient age group.

RESULTS

There were 25 residents with 120,240 total ED clinical encounters from 2003 to 2008. The median number of ED clinical encounters for a resident during his or her training was 4,836 (range = 3,831 to 5,780), based on a maximum of an 80-hour work week, and 24 or 25 four-week blocks of EM rotations. Overall, clinical encounters increased by 30% from PGY 1 to PGY 2, and another 14% from PGY 2 to PGY 3. There was 30% to 60% variation in clinical encounters between individual residents. Variability was most prominent in the care of children and in the care of time-sensitive critical illness. Resident encounters with lower-acuity problems during training were much less than the anticipated lower-acuity burden during practice. Additionally, residents did not encounter some high-risk conditions clinically during the study period.

CONCLUSIONS

Methods should be developed to decrease resident variance in both numbers and types of clinical encounters and to provide curriculum supplementation for individuals and for the entire residency cohort in areas that are important for the clinical practice of EM, but that are rare or not encountered during residency training.

Critical appraisal of emergency medicine educational research: the best publications of 2010

OBJECTIVES

The objective was to critically appraise and highlight medical education research studies published in 2010 that were methodologically superior and whose outcomes were pertinent to teaching and education in emergency medicine (EM).

METHODS

A search of the English language literature in 2010 querying PubMed, Scopus, Education Resources Information Center (ERIC), and PsychInfo identified 41 EM studies that used hypothesis-testing or observational investigations of educational interventions. Five reviewers independently ranked all publications based on 10 criteria, including four related to methodology, that were chosen a priori to standardize evaluation by reviewers. This method was used previously to appraise medical education published in 2008 and 2009.

RESULTS

Five medical education research studies met the a priori criteria for inclusion and are reviewed and summarized here. Comparing the literature of 2010 to 2008 and 2009, the number of published educational research papers increased from 30 to 36 and then to 41. The number of funded studies remained fairly stable over the past 3 years at 13 (2008), 16 (2009), and 9 (2010). As in past years, research involving the use of technology accounted for a significant number of publications (34%), including three of the five highlighted studies.

CONCLUSIONS

Forty-one EM educational studies published in 2010 were identified. This critical appraisal reviews and highlights five studies that met a priori quality indicators. Current trends and common methodologic pitfalls in the 2010 papers are noted.

Education research: a primer for educators in emergency medicine

As medical educators strive to adopt an evidence-based, outcomes-driven approach to teaching, education research in emergency medicine (EM) is burgeoning. Many educational challenges prompt specific research questions that are well suited to investigative study, but educators face numerous barriers to translating exciting ideas into research publications. This primer, intended for educators in EM, provides a brief overview of the current scope and essential elements of education research. We present an approach to identifying research problems and conceptual frameworks and defining specific research questions. A common approach to curricular development is reviewed, as well as a fundamental overview of qualitative and quantitative methods that can be applied to educational research questions. Finally, suggestions for disseminating results and overcoming common barriers to conducting research are discussed.

Best educational practices in pediatric emergency medicine during emergency medicine residency training: guiding principles and expert recommendations

The state of pediatric emergency medicine (PEM) education within emergency medicine (EM) residency programs is reviewed and discussed in the context of shifting practice environments and new demands for a greater focus on the availability and quality of PEM services. The rapid growth of PEM within pediatrics has altered the EM practice landscape with regard to PEM. The authors evaluate the composition, quantity, and quality of PEM training in EM residency programs, with close attention paid to the challenges facing programs. A set of best practices is presented as a framework for discussion of future PEM training that would increase the yield and relevance of knowledge and experiences within the constraints of 3- and 4-year residencies. Innovative educational modalities are discussed, as well as the role of simulation and pediatric-specific patient safety education. Finally, barriers to PEM fellowship training among EM residency graduates are discussed in light of the shortage of practitioners from this training pathway and in recognition of the ongoing importance of the EM voice in PEM.

Critical appraisal of emergency medicine educational research: the best publications of 2009

OBJECTIVES

The objective was to critically appraise and highlight methodologically superior medical education research specific to emergency medicine (EM) published in 2009.

METHODS

A search of the English language literature in 2009 querying Ovid MEDLINE In-Process & Other Non-Indexed Citations, Ovid MEDLINE 1950 to Present, Web of Science, Education Resources Information Center (ERIC), and PsychInfo identified 36 EM studies that used hypothesis-testing or observational investigations of educational interventions. Six reviewers independently ranked all publications based on 10 criteria, including four related to methodology, that were chosen a priori to standardize evaluation by reviewers. This was a refinement of the methods used to appraise medical education published in 2008.

RESULTS

Seven studies met the standards as determined by the averaged rankings and are highlighted and summarized here. This year, 16 of 36 (44%) identified studies had funding, compared to 11 of 30 (36%) identified last year; five of seven (71%) highlighted publications were funded in 2009 compared to three of five (60%) highlighted in 2008. Use of technology in medical education was reported in 14 identified and four highlighted publications, with simulation being the most common technology studied. Five of the seven (71%) featured publications used a quasi-experimental or experimental design, one was observational, and one was qualitative. Practice management topics, including patient safety, efficiency, and revenue generation, were examined in seven reviewed studies.

CONCLUSIONS

Thirty-six medical education publications published in 2009 focusing on EM were identified. This critical appraisal reviews and highlights seven studies that met a priori quality indicators. Current trends are noted.