The Use of Entrustable Professional Activities in Pediatric Postgraduate Medical Education: A Systematic Review

A novel experiential work-based learning model in paediatric secondary care using entrustable professional activities to develop clinical knowledge and communication skills

BACKGROUND

Initial education and training standards for pharmacists in Great Britain require early clinical exposure to patients using experiential work-based learning. However, there is poor evidence of this approach in some settings, such as paediatric care. The aim of this study was therefore to explore a novel model of experiential work-based learning for student pharmacists in a paediatric setting.

METHODS

Fourth-year student pharmacists enrolled on a Master of Pharmacy programme were allocated five three-hour placement sessions at a paediatric hospital. Sessions consisted of a briefing, ward activities, scaffolded consultations with children and their carers, followed by a debriefing session with a clinical supervisor. Data were collected relating to the ward, patient details, student reported activities, learning outcomes and if follow up was required by a member of the clinical team. Data were cleaned, quality checked, then descriptive statistical analysis and inductive content analysis were conducted.

MAIN FINDINGS

Seventy-four students took part in 28 individual sessions and 233 consultations were recorded. Consultations included a best-possible medical history (76%, n = 177), a satisfactory drug history (45%, n = 104), or discussed hospital discharge (11%, n = 26). Students were exposed to patients with diagnosed acute conditions (41%, n = 96) and chronic conditions (33%, n = 76), as well as children awaiting diagnosis (13%, n = 30). Students reported learning about the pathology, diagnosis and symptoms of paediatric conditions (48%, n = 81), medicines used in children (24%, n = 41), patient experiences of recieving care (15%, n = 25), carer experiences (2%, n = 3), the hospital environment (2%, n = 4), career progression (2%, n = 4), and experiences of social care (11%, n = 18). Findings were synthesised with existing entrustable professional activities from the literature to generate novel EPAs specific to paediatric settings.

CONCLUSIONS

A paediatric setting offers a suitable environment to host experiential work-based learning in pharmacy education. Standards of initial education and training which require pharmacists to prescribe in Great Britain must recognise the importance of exposure to the health needs and experiences of children, young people's and carers prior to graduation.

A Scoping Review of the Literature on Entrustable Professional Activities in Surgery Residency Programs

OBJECTIVE

Entrustable professional activities (EPAs) are a crucial component of contemporary postgraduate medical education with many surgery residency programs having implemented EPAs as a competency assessment framework to assess and provide feedback on the performance of their residents. Despite broad implementation of EPAs, there is a paucity of evidence regarding the impact of EPAs on the learners and learning environments. A first step in improving understanding of the use and impact of EPAs is by mapping the rising number of EPA-related publications from the field of surgery. The primary objective of this scoping review is to examine the nature, extent, and range of articles on the development, implementation, and assessment of EPAs. The second objective is to identify the experiences and factors that influence EPA implementation and use in practice in surgical specialties.

DESIGN

Scoping review. Four electronic databases (Medline, Embase, Education Source, and ERIC) were searched on January 20, 2022, and then again on July 19, 2023. A quasi-statistical content analysis was employed to quantify and draw meaning from the information related to the development, implementation, assessment, validity, reliability, and experiences with EPAs in the workplace.

PARTICIPANTS

A total of 42 empirical and nonempirical articles were included.

RESULTS

Four thematic categories describe the topic areas in included articles related to: 1) the development and refinement of EPAs, including the multiple steps taken to develop and refine unique EPAs for surgery residency programs; 2) the methods for implementing EPAs; 3) outcomes of EPA use in practice; 4) barriers, facilitators, and areas for improvement for the implementation and use of EPAs in surgical education.

CONCLUSIONS

This scoping review highlights the key trends and gaps from the rapidly increasing number of publications on EPAs in surgery residency, from development to their use in the workplace. Existing EPA studies lack a theoretical and/or conceptual basis; future development and implementation studies should adopt implementation science frameworks to better structure and operationalize EPAs within surgery residency programs.

Implementing Entrustable Professional Activities in Pediatric Fellowships: Facilitating the Process

BACKGROUND AND OBJECTIVES

Entrustable professional activities (EPAs) will be used for initial certification by the American Board of Pediatrics by 2028. Less than half of pediatric fellowships currently use EPAs for assessment, yet all will need to adopt them. Our objectives were to identify facilitators and barriers to the implementation of EPAs to assess pediatric fellows and to determine fellowship program directors' (FPD) perceptions of EPAs and Milestones.

METHODS

We conducted a survey of FPDs from 15 pediatric subspecialties. EPA users were asked about their implementation of EPAs, barriers encountered, and perceptions of EPAs. Nonusers were queried about deterrents to using EPAs. Both groups were asked about potential facilitators of implementation and their perceptions of Milestones.

RESULTS

The response rate was 65% (575/883). Of these, 344 (59.8%) were EPA users and 231 (40.2%) were nonusers. Both groups indicated work burden as a barrier to implementation. Nonusers reported more barriers than users (mean [SD]: 7 [3.8] vs 5.8 [3.4], P < .001). Both groups identified training materials and premade assessment forms as facilitators to implementation. Users felt that EPAs were easier to understand than Milestones (89%) and better reflected what it meant to be a practicing subspecialty physician (90%). In contrast, nonusers felt that Milestones were easy to understand (57%) and reflected what it meant to be a practicing subspecialist (58%).

CONCLUSIONS

Implementing EPA-based assessment will require a substantial investment by FPDs, facilitated by guidance and easily accessible resources provided by multiple organizations. Perceived barriers to be addressed include FPD time constraints, a need for additional assessment tools, and outcomes data.

The Chief Residency in U.S. and Canadian Graduate Medical Education: A Scoping Review

PHENOMENON

Despite the nearly universal presence of chief residents within U.S. and Canadian residency programs and their critical importance in graduate medical education, to our knowledge, a comprehensive synthesis of publications about chief residency does not exist. An understanding of the current state of the literature can be helpful to program leadership to make evidence-based improvements to the chief residency and for medical education researchers to recognize and fill gaps in the literature.

APPROACH

We performed a scoping review of the literature about chief residency. We searched OVID Medline, PsycINFO, ERIC, and Web of Science databases through January 2023 for publications about chief residency. We included publications addressing chief residency in ACGME specialties in the U.S. and Canada and only those using the term "chief resident" to refer to additional responsibilities beyond the typical residency training. We excluded publications using chief residents as a convenience sample. We performed a topic analysis to identify common topics among studies.

FINDINGS

We identified 2,064 publications. We performed title and abstract screening on 1,306 and full text review on 208, resulting in 146 included studies. Roughly half of the publications represented the specialties of Internal Medicine (n = 37, 25.3%) and Psychiatry (n = 30, 20.5%). Topic analysis revealed six major topics: (1) selection of chief residents (2) qualities of chief residents (3) training of chief residents (4) roles of chief residents (5) benefits/challenges of chief residency (6) outcomes after chief residency.

INSIGHTS

After reviewing our topic analysis, we identified three key areas warranting increased attention with opportunity for future study: (1) addressing equity and bias in chief resident selection (2) establishment of structured expectations, mentorship, and training of chief residents and (3) increased attention to chief resident experience and career development, including potential downsides of the role.

Exploration of validity evidence for core residency entrustable professional activities in Chinese pediatric residency

Introduction

This study seeks to explore validity and reliability evidence for core residency entrustable professional activities (CR-EPAs) that were developed by Peking University First Hospital (PKUFH) in 2020.

Methods

A prospective cohort study was conducted in PKUFH. Trainers (raters) assessed pediatric residents on CR-EPAs over 1 academic year, bi-annually. Critical components within a validity evidence framework were examined: response process (rater perceptions), the internal structure (reliability and contributions of different variance sources), and consequences (potential use of a cutoff score).

Results

In total, 37 residents were enrolled, and 111 and 99 trainers' ratings were collected in Fall 2020 and Spring 2021, respectively. For rater perceptions, all the raters considered CR-EPAs highly operational and convenient. In all ratings, individual EPAs correlate with total EPA moderately, with Spearman correlation coefficients spanning from 0.805 to 0.919. EPA 2 (select and interpret the auxiliary examinations), EPA 5 (prepare and complete medical documents), EPA 6 (provide an oral presentation of a case or a clinical encounter), and EPA 7 (identify and manage the general clinical conditions) were EPAs correlated with other EPAs significantly. The results of the generalizability theory indicated that the variability due to residents is the highest (nearly 78.5%), leading to a large size of the reliability estimates. The matching results indicate that the lowest error locates at 5.933.

Conclusion

The rating showed good validity and reliability. The ratings were reliable based on G-theory. CR-EPAs have a magnificent internal structure and have promising consequences. Our results indicate that CR-EPAs are a robust assessment tool in workplace-based training in a carefully designed setting.

Entrustable Professional Activities and Their Relevance to Pediatric Cardiology Training

Entrustable professional activities (EPAs) have become a popular framework for medical trainee assessment and a supplemental component for milestone and competency assessment. EPAs were developed to facilitate assessment of competencies and furthermore to facilitate translation into clinical practice. In this review, we explore the rationale for the introduction of EPAs, examine whether they fulfill the promise expected of them, and contemplate further developments in their application with specific reference to training in pediatric cardiology.

Entrustable professional activities for residency in general internal medicine: a systematic review

CONTEXT

Entrustable Professional Activities (EPAs) are observable tasks that are regular parts of a physician's daily clinical work. Before being permitted to accomplish these tasks independently, trainees must gain their supervisors' trust. Defining the list of EPAs that should be mastered by the end of a residency is critical to setting clear expectations about autonomous practice.

OBJECTIVE

To collect all the lists of EPAs defined for residencies in general internal medicine and synthesise them into a reference work useful for developing new lists of EPAs or improving existing ones.

METHOD

This systematic review searched five databases and relevant grey literature using keywords related to EPAs and postgraduate education, from 2005, when the first article on EPAs was published, to April 2022. Inclusion criteria were the availability of an EPAs list and a focus on general internal medicine. Two reviewers independently selected the studies, extracted data and performed a quality assessment using QATSDD and AACODS tools. Mean values and inter-rater reliability were calculated.

RESULTS

The review yielded 3292 records, with 16 articles meeting the inclusion criteria, mostly from North America. Synthesising their 16 lists generated 395 EPAs. The reviewers then inductively categoried those EPAs, 308 of which fell into 6 domains, 14 themes and 24 subthemes. The domains were: (1) care and management of the general adult population (n = 103 EPAs); (2) care and management of patients with specific needs (n = 67); (3) care coordination and communication (n = 52); (4) management and leadership (N = 21); (5) healthcare quality, education, and research (n = 41); and (6) miscellaneous (n = 24). The remaining 87 EPAs were disease-specific and did not fit into this categorisation.

CONCLUSIONS

Categorising EPAs created a unique synthesis of the existing lists of EPAs for educating residents in general internal medicine. This synthesis could be used as a reference for anyone tasked with developing new lists of EPAs or improving existing ones.

Developing an Entrustable Professional Activity to Improve the Care of LGBTQ+ Youth

Despite the multitude of health inequities often experienced by lesbian, gay, bisexual, transgender, and queer (LGBTQ)+ youth, few training programs consistently and comprehensively address these disparities through education and assessment of learners. Over the past decade, programs have begun to incrementally increase the number of hours dedicated to LGBTQ+ health training; however, the lack of standardization for curricula and assessment remains a significant barrier. As medical education shifts to a competency-based approach, focusing on patient outcomes and the competencies trainees must achieve to meet those outcomes, we must take this opportunity to develop curricula and assessment tools that emphasize inclusive, affirming, equitable, and culturally humble care for LGBTQ+ youth. Entrustable professional activities (EPA) are increasingly used to educate and assess trainees on their progression from full supervision to unsupervised practice. Given their multifaceted use to standardize curricula, assess learners, and highlight programmatic gaps in education, we believe an EPA is the ideal tool to systematically improve LGBTQ+ health training in graduate medical education. Our team of national experts in this field developed an LGBTQ+ health EPA. We describe our methods of development, the functions and curricular components of the EPA, and the many applications for widespread program use.

Entrustable Professional Activities for Chinese Standardized Residency Training in Pediatric Intensive Care Medicine

BACKGROUND

Entrustable professional activities (EPAs) were first introduced by Olle ten Cate in 2005. Since then, hundreds of applications in medical research have been reported worldwide. However, few studies discuss the use of EPAs for residency training in pediatric intensive care medicine. We conducted a pilot study of EPA for pediatric intensive care medicine to evaluate the use of EPAs in this subspecialty.

MATERIALS AND METHODS

A cross-sectional study was implemented in pediatric intensive care medicine standardized residency training at the Qilu Hospital of Shandong University. An electronic survey assessing EPA performance using eight scales composed of 15 categories were distributed among residents and directors.

RESULTS

A total of 217 director-assessment and 44 residents' self-assessment questionnaires were collected, both demonstrating a rising trend in scores across postgraduate years. There were significant differences in PGY1-vs.-PGY2 and PGY1-vs.-PGY3 director-assessment scores, while there were no differences in PGY2-vs.-PGY3 scores. PGY had a significant effect on the score of each EPA, while position significantly affected the scores of all EPAs except for EPA1 (Admit a patient) and EPA2 (Select and interpret auxiliary examinations). Gender only significantly affected the scores of EPA6 (Report a case), EPA12 (Perform health education), and EPA13 (Inform bad news).

CONCLUSION

This study indicates that EPA assessments have a certain discriminating capability among different PGYs in Chinese standardized residency training in pediatric intensive care medicine. Postgraduate year, gender, and resident position affected EPA scores to a certain extent. Given the inconsistency between resident-assessed and director-assessed scores, an improved feedback program is needed in the future.