Clarifying essential terminology in entrustment

A realist synthesis of prospective entrustment decision making by entrustment or clinical competency committees

INTRODUCTION

The real-world mechanisms underlying prospective entrustment decision making (PEDM) by entrustment or clinical competency committees (E/CCCs) are poorly understood. To advance understanding in this area, the authors conducted a realist synthesis of the published literature to address the following research question: In E/CCC efforts to make defensible prospective entrustment decisions (PEDs), what works, for whom, under what circumstances and why?

METHODS

Realist work seeks to understand the contexts (C), mechanisms (M) and outcomes (O) that explain how and why things work (or do not). In the authors' study, contexts included individual E/CCC members, E/CCC structures and processes, and training programmes. The outcome (i.e. desired outcome) was a PED. Mechanisms were a substantial focus of the analysis and informed the core findings. To define a final corpus of 52 included papers, the authors searched four databases, screened all results from those searches and performed a full-text review of a subset of screened papers. Data extraction focused on developing context-mechanism-outcome configurations from the papers, which were used to create a theory for how PEDM leads to PEDs.

RESULTS

PEDM is often driven by default (non-deliberate) decision making rather than a deliberate process of deciding whether a trainee should be entrusted or not. When defaulting, some E/CCCs find red flags that sometimes lead to being more deliberate with decision making. E/CCCs that seek to be deliberate describe PEDM that can be effortful (when data are insufficient or incongruent) or effortless (when data are robust and tell a congruent story about a trainee). Both information about trainee trustworthiness and the sufficiency of data about trainee performance influence PEDM. Several moderators influence what is considered to be sufficient data, how trustworthiness data are viewed and how PEDM is carried out. These include perceived consequences and associated risks, E/CCC member trust propensity, E/CCC member personal knowledge of and experience with trainees and E/CCC structures and processes.

DISCUSSION

PEDM is rarely deliberate but should be. Data about trainee trustworthiness are foundational to making PEDs. Bias, equity and fairness are nearly absent from the papers in this synthesis, and future efforts must seek to advance understanding and practice regarding the roles of bias, equity and fairness in PEDM.

American Dental Education Association Compendium Entrustable Professional Activities Workgroup report

PURPOSE

Entrustable professional activities (EPAs) are discrete clinical tasks that can be evaluated to help define readiness for independent practice in the health professions and are intended to increase trust in the dental graduate. EPAs provide a framework that bridges competencies to clinical practice. This report describes the work of the American Dental Education Association (ADEA) Compendium EPA Workgroup to develop a list of EPAs for dental education and supportive resources, including specifications and a glossary.

METHODS

Preliminary work including literature and resource review, mapping of existing competencies, and review of other health professions' EPAs informed the development of our EPAs list. Workgroup members achieved consensus using a modified Delphi process. A Qualtrics survey using a validated rubric for the assessment of EPAs as described in peer-reviewed literature was used. Dental educators, including academic deans, were surveyed for feedback on the content and format of the EPAs.

RESULTS

Based on findings in the literature analysis of existing EPAs and competencies in health professions, a list of EPAs was developed along with a description of specifications. The EPA workgroup (nine members from multiple institutions) used the Delphi process in receiving feedback from various experts. A list of 11 core EPAs was vetted by dental educators including academic deans (n = ∼23), and the process of development was reviewed by EPAs experts outside dental education. A glossary was developed to align language.

CONCLUSION

These EPAs define the scope of dental practice. This report represents Phase 1 of the EPA framework development and vetting process. Future directions will include a broader vetting of the EPA list, faculty development, and national standardized technology that support this work to optimize implementation.

Clinical supervision in medical education: A citation analysis

PURPOSE

Medical education relies on clinical supervision for critical functions, including trainee assessment and ensuring patient safety. Yet, there is substantial variance in supervision, which has led to calls for a shared definition of the concept and guidelines to inform practice. AMEE Guide No. 27 provided these desired elements and is highly cited, suggesting that translation and utilization of the Guide's knowledge is suboptimal. This study investigates utilization by systematically characterizing citations to the Guide and by describing translation of its recommendations in relation to supervision.

MATERIALS AND METHODS

Citations were identified using Web of Science, Scopus, and Google Scholar. The authors coded all citations and conducted a subanalysis of studies specific to supervision.

RESULTS

583 studies were identified; 268 met inclusion criteria for general analysis of which 167 studies were further analyzed. Most studies reiterated the Guide's characterization of effective supervision, but few demonstrate how these recommendations inform innovations in supervisory practice.

CONCLUSION

Translation of the Guide's recommendations regarding clinical supervision appears limited. Future research should consider the extent of knowledge translation occurring in clinical supervision literature as well as AMEE Guides. Increased attention to knowledge translation in medical education may benefit the distribution of similar knowledge products.

Scoping review: exploring residents' views of supervisor entrustment and its effect on learning and professional development

This scoping review aimed to systematically explore the complex and nuanced perceptions of residents entrusted with significant responsibilities by their supervisors in the clinical context. We conducted a comprehensive search strategy targeting six major electronic databases. Data were extracted using the PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews) checklist and a scoping review protocol. Resident perceptions regarding entrustment and its impact on learning and professional development were categorized. This review elucidated the role of supervisor entrustment in shaping residents' clinical performance, notably influencing autonomy, self-confidence, responsibility for patients, learning needs and goals, uncertainty management, and professional identity formation. Residents identified factors that promote and hinder performance and entrustment development resulting from supervisor entrustment and distinguished between appropriate supervision and over- or under-supervision. Our review suggests that residents' perceptions of supervisor entrustment, as bestowed by supervisors, serves as a catalyst for enhancing autonomy, thereby exerting a significant influence on clinical performance, and fostering the development of a professional identity. However, residents' views on appropriate supervision differ in some ways from supervisors' perspectives. Further research is needed to bridge the gap between residents' expectations of autonomy and what they are given, and to explore the intricate relationship between autonomy and entrustment.

Do summative entrustment decisions actually lead to entrustment?

BACKGROUND

Entrustable professional activities (EPAs) were introduced across Dutch postgraduate programmes between 2017 and 2019. We aimed to understand the extent to which residents actually were granted increased clinical responsibility upon receiving summative entrustment for an EPA, a critical feature of its use.

METHODS

A survey study was conducted among all Dutch residents who started dermatology training in 2018 and 2019 and all Dutch dermatology programme directors (PDs). We chose an EPA designed for early entrustment in residency (identification, treatment and care regarding a simple dermatological problem in the ambulatory setting). The survey contained two hypothetical clinical cases that aligned with this EPA. The questions were aimed to determine whether and when residents should request supervision. Similar questions were posed to PDs.

FINDINGS

Twenty four residents (56%) and 19 PDs (79%) completed the survey. The majority of the residents (65%) and PDs (63%) confirmed that competent dermatology residents (level 4) are generally allowed to perform EPA1 unsupervised, particularly when seeing patients from GPs. However, still a substantial proportion of the level 4 residents, working in University Medical Centers (36%) indicated that they had to request supervision in the assessment of these patients. For 2nd opinions, the results were typically the opposite.

DISCUSSION AND CONCLUSION

This study demonstrated that, at least in one specialty and one country, the introduction of EPAs and entrustment decision making procedure generally led to the intended autonomy of the resident.

The new Diploma of Rural Generalist Anaesthesia: Supporting Australian rural and remote communities

In 2023, a Diploma of Rural Generalist Anaesthesia (DipRGA) was implemented across Australia. Developed collaboratively by the Australian and New Zealand College of Anaesthetists (ANZCA), the Australian College of Rural and Remote Medicine (ACRRM) and the Royal Australian College of General Practitioners (RACGP), the 12-month qualification is completed during or following ACRRM or RACGP Rural Generalist Fellowship training. Focused on the needs of rural and remote communities for elective and emergency surgery, maternity care, resuscitative care for medical illness or injury, and stabilisation for retrieval, the DipRGA supports rural generalist anaesthetists working within collaborative teams in geographically isolated settings. The goal is a graduate who can anaesthetise American Society of Anesthesiologists physical status class 1, 2 and stable 3 patients for elective surgery, provide obstetric anaesthesia and analgesia, anaesthetise paediatric patients and undertake advanced crisis care within their scope of practice. Crucially, they also recognise both limitations of their skills and local resources available when considering whether to provide care, defer, refer or transfer patients. DipRGA curriculum design commenced by adapting the ANZCA specialist training curriculum with consideration of the training approach of both the ACRRM and the RACGP, particularly the rural and remote context. Curriculum content is addressed in seven entrustable professional activities supported by workplace-based assessments and multisource feedback. Trainees are supervised by rural generalist anaesthetists and specialist anaesthetists, and complete flexible learning activities to accommodate geographical dispersion. Standardised summative assessments include an early test of knowledge and an examination, adapted from the ACRRM structured assessment using multiple patient scenarios.

"Rater training" re-imagined for work-based assessment in medical education

In this perspective, the authors critically examine "rater training" as it has been conceptualized and used in medical education. By "rater training," they mean the educational events intended to improve rater performance and contributions during assessment events. Historically, rater training programs have focused on modifying faculty behaviours to achieve psychometric ideals (e.g., reliability, inter-rater reliability, accuracy). The authors argue these ideals may now be poorly aligned with contemporary research informing work-based assessment, introducing a compatibility threat, with no clear direction on how to proceed. To address this issue, the authors provide a brief historical review of "rater training" and provide an analysis of the literature examining the effectiveness of rater training programs. They focus mainly on what has served to define effectiveness or improvements. They then draw on philosophical and conceptual shifts in assessment to demonstrate why the function, effectiveness aims, and structure of rater training requires reimagining. These include shifting competencies for assessors, viewing assessment as a complex cognitive task enacted in a social context, evolving views on biases, and reprioritizing which validity evidence should be most sought in medical education. The authors aim to advance the discussion on rater training by challenging implicit incompatibility issues and stimulating ways to overcome them. They propose that "rater training" (a moniker they suggest be reserved for strong psychometric aims) be augmented with "assessor readiness" programs that link to contemporary assessment science and enact the principle of compatibility between that science and ways of engaging with advances in real-world faculty-learner contexts.

Faculty Decision Making in Ad Hoc Entrustment of Pediatric Critical Care Fellows: A National Case-Based Survey

Phenomenon: Ad hoc entrustment decisions reflect a clinical supervisor's estimation of the amount of supervision a trainee needs to successfully complete a task in the moment. These decisions have important consequences for patient safety, trainee learning, and preparation for independent practice. Determinants of these decisions have previously been described but have not been well described for acute care contexts such as critical care and emergency medicine. The ad hoc entrustment of trainees caring for vulnerable patient populations is a high-stakes decision that may differ from other contexts. Critically ill patients and children are vulnerable patient populations, making the ad hoc entrustment of a pediatric critical care medicine (PCCM) fellow a particularly high-stakes decision. This study sought to characterize how ad hoc entrustment decisions are made for PCCM fellows through faculty ratings of vignettes. The authors investigated how acuity, relationship, training level, and task interact to influence ad hoc entrustment decisions. Approach: A survey containing 16 vignettes that varied by four traits (acuity, relationship, training level, and task) was distributed to U.S. faculty of pediatric critical care fellowships in 2020. Respondents determined an entrustment level for each case and provided demographic data. Entrustment ratings were dichotomized by "high entrustment" versus "low entrustment" (direct supervision or observation only). The authors used logistic regression to evaluate the individual and interactive effects of the four traits on dichotomized entrustment ratings. Findings: One hundred seventy-eight respondents from 30 institutions completed the survey (44% institutional response rate). Acuity, relationship, and task all significantly influenced the entrustment level selected but did not interact. Faculty most frequently selected "direct supervision" as the entrustment level for vignettes, including for 24% of vignettes describing fellows in their final year of training. Faculty rated the majority of vignettes (61%) as "low entrustment." There was no relationship between faculty or institutional demographics and the entrustment level selected. Insights: As has been found in summative entrustment for pediatrics, internal medicine, and surgery trainees, PCCM fellows often rated at or below the "direct supervision" level of ad hoc entrustment. This may relate to declining opportunities to practice procedures, a culture of low trust propensity among the specialty, and/or variation in interpretation of entrustment scales.

Residents as supervisors: How senior residents make ad hoc entrustment decisions

BACKGROUND

As residency programmes transition to competency-based medical education, there has been substantial inquiry into understanding how ad hoc entrustment decisions are made by attending supervisors in the clinical context. However, although attendings are ultimately responsible for the decisions and actions of resident trainees, senior residents are often the ones directly supervising junior residents enrolled in competency-based training programmes. This clinical dynamic has been largely overlooked in the ad hoc entrustment literature. The purpose of this study was to explore the considerations senior residents entertain when making ad hoc entrustment decisions for their junior resident colleagues.

METHODS

In semi-structured interviews, 11 senior resident supervisors (third, fourth and fifth year) in obstetrics and gynaecology described how they entrust junior residents with clinical activities in the moment. Following constructivist grounded theory methodology, data were iteratively collected and coded with constant comparison until theoretical sufficiency was determined.

RESULTS

Senior residents described many similar considerations as attendings regarding ad hoc entrustment of junior residents, including patient safety, desire to optimise the learning environment, junior resident qualities (such as discernment and communication skills), learner handover from colleagues, and situational factors. Uniquely, senior residents discussed how their role as a middle manager and their desire to protect the junior resident (from burnout, becoming a second victim and from attendings) impacts their decisions.

CONCLUSIONS

Although senior residents make ad hoc entrustment decisions with some similar considerations to attendings, they also seem to think about additional factors. It may be that these different considerations need to be accommodated in documentation of ad hoc entrustment decisions if these documents are to be used for high-stakes summative entrustment decisions made by competency committees.

The influence of resident and faculty gender on assessments in anesthesia competency-based medical education

PURPOSE

Competency-based medical education (CBME) relies on frequent workplace-based assessments of trainees, providing opportunities for conscious and implicit biases to reflect in these assessments. We aimed to examine the influence of resident and faculty gender on performance ratings of residents within a CBME system.

METHODS

This retrospective cohort study took place from August 2017 to January 2021 using resident assessment data from two workplace-based assessments: the Anesthesia Clinical Encounter Assessment (ACEA) and Entrustable Professional Activities (EPAs). Self-reported gender data were also extracted. The primary outcome-gender-based differences in entrustment ratings of residents on the ACEA and EPAs-was evaluated using mixed-effects logistic regression, with differences reported through odds ratios and confidence intervals (α = 0.01). Gender-based differences in the receipt of free-text comments on the ACEA and EPAs were also explored.

RESULTS

In total, 14,376 ACEA and 4,467 EPA assessments were analyzed. There were no significant differences in entrustment ratings on either assessment tool between men and women residents. Regardless of whether assessments were completed by men or women faculty, entrustment rates between men and women residents were not significantly different for any postgraduate year level. Additionally, men and women residents received strengths-related and actions-related comments on both assessments at comparable frequencies, irrespective of faculty gender.

CONCLUSION

We found no gender-based differences in entrustment ratings for both the ACEA and EPAs, which suggests an absence of resident gender bias within this CBME system. Given considerable heterogeneity in rater leniency, future work would be strengthened by using rater leniency-adjusted scores rather than raw scores.

An Innovative Undergraduate Medical Curriculum Using Entrustable Professional Activities

The need to educate medical professionals in changing medical organizations has led to a revision of the Radboudumc's undergraduate medical curriculum. Entrustable professional activities (EPAs) were used as a learning tool to support participation and encourage feedback-seeking behavior, in order to offer students the best opportunities for growth. This paper describes the development of the Radboudumc's EPA-based Master's curriculum and how EPAs can facilitate continuity in learning in the clerkships. Four guiding principles were used to create a curriculum that offers possibilities for the students' development: (1) working with EPAs, (2) establishing entrustment, (3) providing continuity in learning, and (4) organizing smooth transitions. The new curriculum was designed with the implementation of EPAs and an e-portfolio, based on these 4 principles. The authors found that the revised curriculum corresponds to daily practice in clerkships. Students used their e-portfolios throughout all clerkships, which stimulates feedback-seeking behavior. Moreover, EPAs promote continuity in learning while rotating clerkships every 1 to 2 months. This might encourage curriculum developers to use EPAs when aiming for greater continuity in the development of students. Future research needs to focus on the effect of EPAs on transitions across clerkships in order to further improve the undergraduate medical curriculum.

Making prospective entrustment decisions: Knowing limits, seeking help and defaulting

INTRODUCTION

Many studies focused on entrustment have not considered prospective entrustment decisions, where clinical competency and entrustment committees determine how much supervision trainees will require in the future for tasks occurring in not completely known contexts. The authors sought to explore factors that influence and determine prospective entrustment decisions made by members of such committees in graduate medical education (GME) and undergraduate medical education (UME).

METHODS

The authors conducted a constructivist grounded theory study with 23 faculty participants from GME and UME clinical competency and entrustment committees in the United States between October 2020 and March 2021. Interviews sought to explore factors and considerations participants weigh in making prospective entrustment decisions about trainees. Data collection and analysis occurred in an iterative fashion, ensuring constant comparison. Theoretical sampling was used to confirm, disconfirm and elaborate on the evolving results.

RESULTS

Trainees' ability to know limits and seek help is the foundation of participants' prospective entrustment decision making. Most participants, however, describe a presumption of trainee readiness to progress and describe commonly making default prospective entrustment decisions unless 'red flags' in performance are present. Although participants desire sufficient and trusted data about trainee performance to inform decisions, they often lack it. Finally, the perceived permanence and consequences of prospective entrustment decisions influence how participants weigh other factors contributing to prospective entrustment decisions.

CONCLUSION

Trainees' ability to know limits and seek help appears to be the foundation of prospective entrustment decision making. Training programmes should strive to collect and employ robust data supporting and questioning the presence of these attributes.

Entrustable professional activities versus competencies and skills: Exploring why different concepts are often conflated

Despite explanations in the literature, a returning question in the use of entrustable professional activities (EPAs) is how to distinguish them from competencies and skills. In this article, we attempt to analyze the causes of the frequent confusion and conflation of EPAs with competencies and skills, and argue why the distinction is important for education, qualification and patient safety. 'Tracheotomy', 'lumbar puncture', 'interprofessional collaboration' for example are colloquially called 'skills', but its is a person's ability to perform these activities that is the actual skill; the EPA is simply the activity itself. We identify two possible causes for the confusion. One is a tendency to frame all educational objectives as EPAs. Many objectives of medical training can be conceptualized as EPAs, if 'the ability to do X' is the corresponding competency; but that does not work for all. We offer ways to deal with objectives of training that are not usefully conceptualized as EPAs. A more fundamental cause relates to entrustment decisions. The permission to contribute to health care reflects entrustment. Entrustment decisions are the links or pivots between a person's readiness for the task and the actual task execution. However, if entrustment decisions do not lead to increased autonomy in the practice of health care, but only serve to decide upon the advancement to a next stage of training, EPAs can become the tick boxes learners feel they need to collect to 'pass'. Gradually, then, EPAs can loose their original meaning of units of practice for which one becomes qualified.

Building the Generalist Physician to Support Adolescence and Emerging Adulthood: A Narrative Review

Undergraduate medical education serves as a foundation for the medical student to develop the skills of a generalist physician. Given the "blurring" of the demarcations between childhood and adulthood and the increased scope of pediatric practice, an extra layer has been added to medical education which seeks to address care across the lifespan. While approaches have been developed to teach this layer, clerkship reform has not focused on advancing the clinical science of adolescence. Furthermore, as we look towards the vanguard of entrustable professional activities (EPA), specific attention to transition care for the adolescent has seen minimal attention. Drawing on prior examples of curriculum integration between specialties as well as solutions to complex care management from clinical reasoning, we suggest that attention to the development of the generalist physician requires attention to the combined medicine-pediatrics specialty.