Foundations of Emergency Medicine: Impact of a Standardized, Open-access, Core Content Curriculum on In-Training Exam Scores

Introduction

Learners frequently benefit from modalities such as small-group, case-based teaching and interactive didactic experiences rather than passive learning methods. These contemporary techniques are features of Foundations of Emergency Medicine (FoEM) curricula, and particularly the Foundations I (F1) course, which targets first-year resident (PGY-1) learners. The American Board of Emergency Medicine administers the in-training exam (ITE) that provides an annual assessment of EM-specific medical knowledge. We sought to assess the effect of F1 implementation on ITE scores.

Methods

We retrospectively analyzed data from interns at four EM residency programs accredited by the Accreditation Council for Graduate Medical Education. We collected data in 2021. Participating sites were geographically diverse and included three- and four-year training formats. We collected data from interns two years before (control group) and two years after (intervention group) implementation of F1 at each site. Year of F1 implementation ranged from 2015-2018 at participating sites. We abstracted data using a standard form including program, ITE raw score, year of ITE administration, US Medical Licensing Exam Step 1 score, Step 2 Clinical Knowledge (CK) score, and gender. We performed univariable and multivariable linear regression to explore differences between intervention and control groups.

Results

We collected data for 180 PGY-1s. Step 1 and Step 2 CK scores were significant predictors of ITE in univariable analyses (both with P < 0.001). After accounting for Step 1 and Step 2 CK scores, we did not find F1 implementation to be a significant predictor of ITE score, P = 0.83.

Conclusion

Implementation of F1 curricula did not show significant changes in performance on the ITE after controlling for important variables.

Telemedicine Physical Examination Utilizing a Consumer Device Demonstrates Poor Concordance with In-Person Physical Examination in Emergency Department Patients with Sore Throat: A Prospective Blinded Study

BACKGROUND

Telemedicine allows patients to connect with healthcare providers remotely. It has recently expanded to evaluate low-acuity illnesses such as pharyngitis by using patients' personal communication devices. The purpose of our study was to compare the telemedicine-facilitated physical examination with an in-person examination in emergency department (ED) patients with sore throat.

MATERIALS AND METHODS

This was a prospective, observational, blinded diagnostic concordance study of patients being seen for sore throat in a 60,000-visit Midwestern academic ED. A telemedicine and a face-to-face examination were performed independently by two advanced practice providers (APP), blinded to the results of the other evaluator. The primary outcome was agreement on pharyngeal redness between the evaluators, with secondary outcomes of agreement and inter-rater reliability on 14 other aspects of the pharyngeal physical examination. We also conducted a survey of patients and providers to evaluate perceptions and preferences for sore throat evaluation using telemedicine.

RESULTS

Sixty-two patients were enrolled, with a median tonsil size of 1.0. Inter-rater agreement (kappa) for tonsil size was 0.394, which was worse than our predetermined concordance threshold. Other kappa values ranged from 0 to 0.434, and telemedicine was best for detecting abnormal coloration of the palate and tender superficial cervical lymph nodes (anterior structures), but poor for detecting abnormal submandibular lymph nodes or asymmetry of the posterior pharynx (posterior structures). In survey responses, telemedicine was judged easier to use and more comfortable for providers than patients; however, neither patients nor providers preferred in-person to telemedicine evaluation.

CONCLUSION

Telemedicine exhibited poor agreement with the in-person physical examination on the primary outcome of tonsil size, but exhibited moderate agreement on coloration of the palate and cervical lymphadenopathy. Future work should better characterize the importance of the physical examination in treatment decisions for patients with sore throat and the use of telemedicine in avoiding in-person healthcare visits.