Using an alumni survey to target improvements in an emergency medicine training programme

Pediatric emergency medicine fellows' milestone evaluations: Do they all meet the targets for graduation?

BACKGROUND

The ACGME Milestone Project created a competency-based trainee assessment tool. Subcompetencies (SCs) are scored on a 5-point scale; level 4 is recommended for graduation. The 2018 Milestones Report found that across subspecialties, not all graduates attain level 4 for every SC.

OBJECTIVE

The objective was to describe the number of pediatric emergency medicine (PEM) fellows who achieve ≥ level 4 in all 23 SCs at graduation and identify SCs where level 4 is not achieved and factors predictive of not achieving a level 4.

METHODS

This is a multicenter, retrospective cohort study of PEM fellows from 2014 to 2018. Program directors provided milestone reports. Descriptive analysis of SC scores was performed. Subanalyses assessed differences in residency graduation scores, first-year fellowship scores, and the rate of milestone attainment between fellows who did and did not attain ≥ level 4 at graduation.

RESULTS

Data from 392 fellows were obtained. There were no SCs in which all fellows attained ≥ level 4 at graduation; the range of fellows scoring < level 4 per SC was 7% to 39%. A total of 67% of fellows did not attain ≥ level 4 on one or more SC. While some fellows failed to attain ≥ level 4 on up to all 23 SCs, 26% failed to meet level 4 on only one or two. In 19 SCs, residency graduation and/or first year fellow scores were lower for fellows who did not attain ≥ level 4 at graduation compared to those who did (mean difference = 0.74 points). Among 10 SCs, fellows who did not attain ≥ level 4 at graduation had a faster rate of improvement compared to those who did attain ≥ level 4.

CONCLUSION

In our sample, 67% of PEM fellows did not attain level 4 for one or more of the SCs at graduation. Low scores during residency or early in fellowship may predict difficulty in meeting level 4 by fellowship completion.

Alignment of Preventive Medicine Physicians' Residency Training With Professional Needs

Preventive medicine (PM) physicians promote population-based approaches to health care with training that emphasizes public health, epidemiology, and policy. PM physicians use these skills in varied, often nonclinical, practice settings. PM career diversity challenges educators when designing residency curricula. Input from PM physicians about workforce environments is needed to ensure that residency requirements match skills needed post-residency. Graduates of one PM residency were sent a cross-sectional survey in 2016. Questions included professional experience, importance of 18 Accreditation Council for Graduate Medical Education sub-competencies and 13 leadership/management skills to current position, and residency training adequacy in those sub-competencies/skills. Responses were rated on 3-point Likert scales. Analyses were completed in 2017. Pearson's chi-square tests examined relationships between position type (academic/government) and perception of competencies' importance and training adequacy. Eighty PM physicians responded (46%): 44% worked in academia and 25% in federal/state/local government. Half (53%) were PM board certified. A total of 88% completed clinical residency prior to PM. Thirteen of 18 competencies were important to work, and respondents felt well trained in 16 of 18 competencies. Respondents did not feel well trained in emergency preparedness and surveillance systems during residency and their opinions about the importance of these sub-competencies varied based on where they worked. Respondents rated all 13 leadership/management skills as important, but reported inadequate residency training. In conclusion, respondents rated most Accreditation Council for Graduate Medical Education sub-competencies as important to current work and felt well trained, indicating good alignment between residency training and professional needs. Respondents also reported leadership/management training deficiencies. PM residencies might consider incorporating formal leadership training into curricula.