Transforming primary care training--patient-centered medical home entrustable professional activities for internal medicine residents

Exploring factors impacting patient decisions in hemorrhoid surgery: A questionnaire survey in Taiwan

Background

Minimally invasive hemorrhoid surgeries like Doppler-Guided Hemorrhoidal Artery Ligation (DGHAL) and Stapled Hemorrhoidopexy (PPH) offer benefits over traditional methods. This study investigated public perceptions and attitudes towards these surgeries, exploring awareness, preferences, and influencing factors.

Methods

A detailed questionnaire was disseminated to 2011 participants from various regions of Taiwan in December 2023, gathering data on demographics, understanding of minimally invasive surgery, and attitudes towards hemorrhoid surgery. Chi-square tests were used for analysis (p < 0.05).

Results

Hemorrhoid prevalence was similar across sexes and age groups. About 70 % preferred medical centers or district hospitals for surgery. Postoperative complications were a primary concern, with significant sex differences. Approximately 70 % preferred minimally invasive surgery if costs were below NT$50,000. Medical personnel showed higher awareness of minimally invasive surgery benefits. Most participants relied on personal networks and medical social media for information.

Conclusions

The study revealed generally positive perceptions of minimally invasive hemorrhoid surgery, with cost being a significant factor. Knowledge gaps exist, particularly among non-medical personnel. Future initiatives should aim to enhance public awareness of minimally invasive surgery benefits, and policy considerations should address financial aspects of healthcare decisions.

Only as Strong as the Weakest Link: Resident Perspectives on Entrustable Professional Activities and Their Impact on Learning

Background Core to competency-based medical education (CBME) is the use of frequent low-stakes workplace-based assessments. In the Canadian context, these observations of performance are framed around entrustable professional activities (EPAs). Objective We aimed to explore residents' real-world perspectives of EPAs and their perceived impact on learning, because assessments perceived to be "inauthentic," or not truly reflective of their lived experiences, may interfere with learning. Methods Using constructivist grounded theory, we conducted 18 semistructured interviews in 2021 with residents from all programs that had implemented CBME at one tertiary care academic center in Canada. Participants were recruited via email through respective program administrators. Data collection and analysis occurred iteratively, and categories were identified using constant comparative analysis. Results Residents were strikingly polarized, perceiving EPAs as either a valuable opportunity for professional growth or as an onerous requirement that interfered with learning. Regardless of what view participants held, all perspectives were informed by: (1) the program administration and the perceived messaging from program to residents; (2) faculty assessors and their perceived degree of engagement, or "buy-in" with the EPA system; and ultimately (3) learner behavior. We theorized from these findings that all 3 aspects must be working in tandem for the assessment system to function as intended. Conclusions From the learners' perspective, there exists a dynamic, interdependent relationship between the 3 CBME stakeholders. As such, the perceived value of the EPA assessment system can only be as strong as the weakest link in the chain.

Validity and Educational Impact of Clinical Entrustable Professional Activities Linked to the Nutrition Care Process for Work-Based Assessment of Entry-Level Dietetics Students: Evaluation of a 3-Year Implementation Study in Australia

BACKGROUND

Entrustable professional activities (EPAs) describe key workplace activities and are increasingly being used for student work-based assessment. An EPA-based work-based assessment tool offers potential to increase understanding of dietetics student skill development and opportunity for standardised work-based student assessment.

OBJECTIVE

To determine construct validity and educational impact of an EPA work-based assessment tool for dietetics placement students in clinical settings.

DESIGN

Using a time series design, supervisor and student self-assessment data collected from an EPA-based assessment tool from three cohorts of dietetics students and supervisors from 2017-2019 was analyzed.

PARTICIPANTS AND SETTING

Dietetics students (n = 145) from an accredited dietetic training program in Australia and affiliated metropolitan and rural hospitals.

MAIN OUTCOME MEASURES

Construct validity was determined through analysis of supervisor evaluation of student performance against EPAs over time. Educational impact was determined through comparing student performance across EPAs to predicted milestones to identify areas of least entrustment.

STATISTICAL ANALYSES PERFORMED

Student performance over time and differences between student self-assessment and supervisor assessment for each EPA were investigated using Wilcoxon signed-rank tests and linear mixed-model analysis. Descriptive statistics summarised student performance against each EPA.

RESULTS

Performance significantly increased over time in 35 out of 37 EPAs. Significant differences between supervisor and student self-assessment were evident in 9 out of 37 EPAs. Dietetics student performance varied across EPAs with 88.2% of students achieving entrustment for nutrition management EPAs compared with 100% for professionalism EPAs.

CONCLUSIONS

The tool's construct validity was established. EPAs identified areas of Nutrition Care Process skills development requiring additional support. Data collected by the tool can inform teaching.

Entrustable professional activities for residency in general internal medicine: a systematic review

CONTEXT

Entrustable Professional Activities (EPAs) are observable tasks that are regular parts of a physician's daily clinical work. Before being permitted to accomplish these tasks independently, trainees must gain their supervisors' trust. Defining the list of EPAs that should be mastered by the end of a residency is critical to setting clear expectations about autonomous practice.

OBJECTIVE

To collect all the lists of EPAs defined for residencies in general internal medicine and synthesise them into a reference work useful for developing new lists of EPAs or improving existing ones.

METHOD

This systematic review searched five databases and relevant grey literature using keywords related to EPAs and postgraduate education, from 2005, when the first article on EPAs was published, to April 2022. Inclusion criteria were the availability of an EPAs list and a focus on general internal medicine. Two reviewers independently selected the studies, extracted data and performed a quality assessment using QATSDD and AACODS tools. Mean values and inter-rater reliability were calculated.

RESULTS

The review yielded 3292 records, with 16 articles meeting the inclusion criteria, mostly from North America. Synthesising their 16 lists generated 395 EPAs. The reviewers then inductively categoried those EPAs, 308 of which fell into 6 domains, 14 themes and 24 subthemes. The domains were: (1) care and management of the general adult population (n = 103 EPAs); (2) care and management of patients with specific needs (n = 67); (3) care coordination and communication (n = 52); (4) management and leadership (N = 21); (5) healthcare quality, education, and research (n = 41); and (6) miscellaneous (n = 24). The remaining 87 EPAs were disease-specific and did not fit into this categorisation.

CONCLUSIONS

Categorising EPAs created a unique synthesis of the existing lists of EPAs for educating residents in general internal medicine. This synthesis could be used as a reference for anyone tasked with developing new lists of EPAs or improving existing ones.

Development and evaluation of Entrustable Professional Activities embedded in an e-portfolio for work-based assessment in community and public health dietetics

Entrustable professional activities (EPAs) is a recent concept that helps operationalise competency-based education. In this paper, we report on the development of EPAs and incorporation into an e-portfolio for work-based assessment of final year dietetics students in a community and public health professional placement. We aimed to determine the utility of the EPAs for work-based assessment in this context. We used action research methodology to conduct broad consultation with students and supervisors using anonymous surveys and focus groups to understand their beliefs and attitudes towards work-based assessment. Consequently, 40 EPAs with an accompanying four-point entrustment scale were developed and mapped to the National Competency Standards for Dietitians in Australia. The EPAs and assessment tool were piloted and evaluated via an anonymous online user survey across three cohorts of students (n = 133) and supervisors (n = 67). Following mediocre pilot year evaluation results, EPAs were revised and reduced in number. While students positively evaluated the e-portfolio, their appraisal of the EPAs and entrustment scale was less positive compared to supervisors. Supervisor evaluation of the EPA-based e-portfolio supported the validity, feasibility and acceptability of this novel assessment method in a community and public health setting. Assessment using EPAs, and the resulting educational data collected by the tool, offers potential for individual learners to identify areas needing development during placement, as well as potential to inform curriculum improvements and increase understanding of learning opportunities and outcomes for dietetic students in community and public health settings.

WBAs in UME-How Many Are Needed? A Reliability Analysis of 5 AAMC Core EPAs Implemented in the Internal Medicine Clerkship

BACKGROUND

Reliable assessments of clinical skills are important for undergraduate medical education, trustworthy handoffs to graduate medical programs, and safe, effective patient care. Entrustable professional activities (EPAs) for entering residency have been developed; research is needed to assess reliability of such assessments in authentic clinical workspaces.

DESIGN

A student-driven mobile assessment platform was developed and used for clinical supervisors to record ad hoc entrustment decisions using the modified Ottawa scale on 5 core EPAs in an 8-week internal medicine (IM) clerkship. After a 12-month period, generalizability (G) theory analysis was performed to estimate the reliability of entrustment scores and determine the proportion of variance attributable to the student and the other facets, including particular EPA, evaluator type (attending versus resident), or case complexity. Decision (D) theory analysis determined the expected reliability based on the number of hypothetical observations. A g-coefficient of 0.7 was used as a generally agreed upon minimum reliability threshold.

KEY RESULTS

A total of 1368 ratings over the 5 EPAs were completed on 94 students. Variance attributed to person (true variance) was high for all EPAs; EPA-5 had the lowest person variance (9.8% across cases and four blocks). Across cases, reliability ranged from 0.02 to 0.60. Applying this to the Decision study, the estimated number of observations needed to reach a reliability index of 0.7 ranged between 9 and 11 for all EPAs except EPA5 which was sensitive to case complexity.

CONCLUSIONS

Work place-based clinical skills in IM clerkship students were assessed and logged using a convenient mobile platform. Our analysis suggests that 9-11 observations are needed for these EPA workplace-based assessments (WBAs) to achieve a reliability index of 0.7. Note writing was very sensitive to case complexity. Further reliability analyses of core EPAs are needed before US medical schools consider wider adoption into summative entrustment processes and GME handoffs.

How preceptors develop trust in continuity clinic residents and how trust influences supervision: A qualitative study

INTRODUCTION

To advance in their clinical roles, residents must earn supervisors' trust. Research on supervisor trust in the inpatient setting has identified learner, supervisor, relationship, context, and task factors that influence trust. However, trust in the continuity clinic setting, where resident roles, relationships, and context differ, is not well understood. We aimed to explore how preceptors in the continuity clinic setting develop trust in internal medicine residents and how trust influences supervision.

METHODS

In this qualitative study, we conducted semi-structured interviews with faculty preceptors from two continuity clinic sites in an internal medicine residency program at an urban academic medical center in the United States from August 2018-June 2020. We analyzed transcripts using thematic analysis with sensitizing concepts related to the theoretical framework of the five factors of trust.

RESULTS

Sixteen preceptors participated. We identified four key drivers of trust and supervision in the continuity clinic setting: 1) longitudinal resident-preceptor-patient relationships, 2) direct observations of continuity clinic skills, 3) resident attitude towards their primary care physician role, and 4) challenging context and task factors influencing supervision. Preceptors shared challenges to determining trust stemming from incomplete knowledge about patients and limited opportunities to directly observe and supervise between-visit care.

DISCUSSION

The continuity clinic setting offers unique supports and challenges to trust development and trust-supervision alignment. Maximizing resident-preceptor-patient continuity, promoting direct observation, and improving preceptor supervision of residents' provision of between-visit care may improve resident continuity clinic learning and patient care.

How an EPA-based curriculum supports professional identity formation

BACKGROUND

Entrustable professional activities (EPAs) are widely used in medical education, and they might be an important incentive to stimulate professional identity formation (PIF) of medical students, by actively encouraging participation in the workplace. The goal of this study was to explore the effects of an EPA-based curriculum on the PIF of medical students in undergraduate curricula.

METHODS

In this study at the Radboud University Medical Center in Nijmegen, the Netherlands, the authors interviewed twenty-one medical students in three focus group interviews (November 2019), and conducted a thematic analysis based on both the synthesizing concepts PIF, communities of practice and EPAs, and newly defined themes.

RESULTS

Four central themes proved crucial for understanding the influence of EPAs on PIF: creating learning opportunities, managing feedback, dealing with supervision in context and developing confidence. EPAs helped students to create learning opportunities and to choose activities purposefully, and the use of EPAs stimulated their feedback-seeking behavior. The context and way of supervision had a great impact on their development, where some contexts offer better learning opportunities than others. EPAs helped them develop trust and self-confidence, but trust from supervisors hardly appears to result from using EPAs.

CONCLUSIONS

An EPA-based curriculum does stimulate PIF in the complex context of working and learning by supporting participation in the workplace and by encouraging feedback-seeking behavior. Striking the right balance between participation, feedback-seeking behavior and choosing learning activities is essential.

TRIAL REGISTRATION

This study was approved by the ethics committee of the Netherlands Association of Medical Education (NVMO, case number 2019.5.12).

Design, implementation and evaluation of novel work-based clinical assessment tool: An e-portfolio with embedded Entrustable Professional Activities

BACKGROUND

A new concept in work-based assessment, Entrustable Professional Activities (EPAs) describe key activities a work-ready practitioner can perform independently. EPAs are widely used in medicine to support competency-based education and are gaining acceptance in other professions such as nursing, pharmacy and dietetics. There is currently no widely accepted work-based assessment tool for student clinical placement assessment in dietetics and EPAs offer potential to address this gap.

OBJECTIVES

To design, implement and evaluate a work-based assessment tool using EPAs embedded in an e-portfolio for use in clinical dietetics.

SETTING

An accredited dietetic training program in Australian university and affiliated metropolitan and rural hospitals.

PARTICIPANTS

Three consecutive cohorts of final year dietetic students (n = 126) and their professional placement supervisors (n = 101).

METHODS

A working party consisting of dietetic academics with experience in clinical dietetics and education developed clinical dietetic EPAs and milestones that were mapped to the National Competency Standards for Dietitians in Australia. A design model incorporating multiple rounds of user feedback was used to create an e-portfolio with the EPAs embedded. Students and supervisors were invited to complete anonymous on-line surveys with Likert responses (1 = highly dissatisfied, 5 = highly satisfied) to evaluate the face validity, acceptability and feasibility of the tool.

RESULTS

A total of 37 EPAs were developed with an accompanying four-point entrustment scale to measure performance. Evaluation survey response rates were high and ranged from 35 to 45% for students and 57-83% for supervisors across the study period. Both students and supervisors evaluated the tool positively with a mean overall satisfaction of 4.12 ± 0.69 and 4.03 ± 0.68, respectively. Survey items evaluating face validity, feasibility and acceptability scored >3.75 for both groups of users.

CONCLUSIONS

The EPA based e-portfolio demonstrated face validity, feasibility and acceptability and offers potential for a widely accepted tool for work-based assessment of clinical dietetic students.

Benefits of EPAs at risk? The influence of the workplace environment on the uptake of EPAs in EPA-based curricula

INTRODUCTION

Entrustable Professional Activities (EPAs) have been applied differently in many postgraduate medical education (PGME) programmes, but the reasons for and the consequences of this variation are not well known. Our objective was to investigate how the uptake of EPAs is influenced by the workplace environment and to what extent the benefits of working with EPAs are at risk when the uptake of EPAs is influenced. This knowledge can be used by curriculum developers who intend to apply EPAs in their curricula.

METHOD

For this qualitative study, we selected four PGME programmes: General Practice, Clinical Geriatrics, Obstetrics & Gynaecology, and Radiology & Nuclear Medicine. A document analysis was performed on the national training plans, supported by the AMEE Guide for developing EPA-based curricula and relevant EPA-based literature. Interviews were undertaken with medical specialists who had specific involvement in the development of the curricula. Content analysis was employed and illuminated the possible reasons for variation in the uptake of EPAs.

RESULTS

An important part of the variation in the uptake of EPAs can be explained by environmental factors, such as patient population, the role of the physician in the health-care system, and the setup of local medical care institutions where the training programme takes place. The variation in uptake of EPAs is specifically reflected in the number and breadth of the EPAs, and in the way the entrustment decision is executed within the PGME programme.

DISCUSSION

Due to variation in uptake of EPAs, the opportunities for trainees to work independently during the training programme might be challenging. EPAs can be implemented in the curriculum of PGME programmes in a meaningful way, but only if the quality of an EPA is assessed, future users are involved in the development, and the key feature of EPAs (the entrustment decision) is retained.

Twice-Daily Huddles Improves Collaborative Problem Solving in the Respiratory Care Department

BACKGROUND

Lean Six Sigma processes are used in health care systems to increase safety and efficiency. Daily huddles, one tool of the Lean Six Sigma process, have been used to increase patient safety, facilitate efficiency in problem solving, promote optimal patient outcomes, and reduce poor communication. Huddle utilization by respiratory care departments has not been previously reported. We describe our process of implementing daily huddles and the impact on departmental problem solving.

METHOD

A descriptive study of a quality improvement intervention and a retrospective study of prospectively collected data were performed. The respiratory care department was trained in the utilization of a daily huddle process to resolve issues and identify process improvement opportunities. Huddles were performed at the beginning of each shift. Process improvement opportunities were raised by the respiratory therapy staff using the following categories: Safety/Service, Methods, Equipment, Supplies, and Associates. Opportunities were placed within 3 categories; quick hits (resolution in 1-3 d), complex problems (resolution in 3-7 d), and projects (resolution in > 7 d). All opportunities included a problem statement, an immediate countermeasure, a problem leader, and a due date. Items requiring interdisciplinary support were escalated to the organizational patient care services huddle. We evaluated the number and nature of process improvement opportunities raised in huddles from January 1 through December 31, 2018, to better understand the impact of daily huddles.

RESULTS

A total of 366 process improvement opportunities were raised during huddles. Of those, 245 (67%) were quick hits, 77 (21%) were complex, and 44 (12%) were projects. Resolution of 174 (47.5%) opportunities was completed using only the resources of the respiratory care department, and 157 (43%) were resolved with additional interdisciplinary involvement. A small portion 35 (9.5%) of opportunities required escalation to the organizational multidisciplinary huddle for resolution. All process improvement opportunities were resolved at the end of the study period (mean ± SD of 30.5 ± 7.7 per month).

CONCLUSIONS

Twice-daily huddles implemented by our respiratory care department allowed for identification and timely resolution of process improvement opportunities.

Entrustable Professional Activities in Orthopaedics

Background

An entrustable professional activity (EPA) is defined as a core task of a specialty that is entrusted to a trainee once sufficient competence has been reached. A group of EPAs reflects the activities that clinicians commonly do on a day-to-day basis. Lists of EPAs have been created for most medical subspecialties, but not orthopaedic surgery. The aim of this study was to create a peer-reviewed list of essential EPAs that a resident must perform independently before completing orthopaedic residency training.

Methods

A focus group of 7 orthopaedic surgeons from the University of Toronto developed a comprehensive list of 285 EPAs. For each subspecialty group, the opinions of at least 15 academic and nonacademic surgeons, as well as subspecialty-trained and non-subspecialty-trained surgeons, were used. The modified Delphi method was used to rank EPAs on a five-point scale from not important to mandatory for a resident to competent before exiting training. Two Delphi rounds were used, using a threshold of >50% of surgeons considering the EPA as mandatory before being considered for the next round. A final list of EPAs was ratified using the focus group of academic surgeons involved in the study.

Results

Seventy-five (75) of 107 (70%) surgeons invited responded to the survey. Nearly half (129) of the 285 EPAs were discarded after the first round of Delphi. A further 118 EPAs were discarded after the second Delphi round, leaving 49 final EPAs, across 9 subspecialties in orthopaedic surgery.

Conclusions

Expert consensus was used to create a list of EPAs considered mandatory for completion of resident training in orthopaedics in our province. The final 49 peer-reviewed EPAs will be a valuable benchmark in curriculum design and assessment in orthopaedic surgery in the competency-based era for other programs.

Entrustability levels of general internal medicine residents

BACKGROUND

Entrustable professional activities (EPAs) are those activities that a health professional can perform without direct supervision in a defined environment. Bridging the gap between competencies and learning objectives, EPAs have made assessing the performances of health professional more realistic. The main objective of the present study was developing and customizing EPAs for Iranian Internal Medicine Residency Programs.

RESULTS

After reviewing the publications, residency curricula and logbooks, and collecting experts' ideas, the initial list of EPAs was developed. Then, in a focus group, the list was refined, the entrustability level of each residency year was determined, and finally, the EPA-competency cross-tab was established, and in the next step, through a one- round Delphi, the results were validated. Twenty-eight EPAs were developed. Some of them were definitely suitable for the higher levels of residency, such that they had to be accomplished under direct supervision until the end of the program. On the other hand, some of EPAs were those that residents, even from the first year, are expected to perform independently or under indirect supervision. Most of the EPAs cover a wide range of competencies.

CONCLUSION

Determining the entrustability level of each residency year in each EPA as well as the competency- EPA matrix has crucial effect on the quality of the graduates. It seems that our findings are applicable in developing countries like Iran.

Experiences of patients with haemorrhoidal disease – a qualitative study

Purpose To obtain a better understanding of the patients’ experiences with haemorrhoidal disease’ impact on their daily life and results of treatment by performing a qualitative study.

Method Individually interviews were conducted among patients with haemorrhoidal disease between 2016 and 2017. Each interview was recorded using an audio recorder and transcribed verbatim. A semi-structured interview guide was used with pre-specified topics, based on a previous conducted literature review. Transcripts were coded and the analysis consisted highlighting passages in the text and assigning each passage a code representing the predefined themes from the interview guide. This resulted in a three-level theme hierarchy: overarching theme, mid-level sub-theme and issues.

Results Fifteen participants underwent individual interviews of whom thirteen were conducted by telephone. The mean age was 60.7 years (35–78); five of them were female (33.3%). Pain and blood loss were the most frequently reported symptoms. Participants indicated that these symptoms were directly associated with emotional burden, daily adjustments and social impact. Before diagnosis with haemorrhoidal disease blood loss resulted in feelings of fear and next in embarrassment during social activities. In daily life participants needed to get up early, used sanitary pads for blood loss and anal ice sticks to reduce pain. Participants were often not completely satisfied with the process and outcome of treatment.

Conclusion This first qualitative study provides detailed insight into the patients’ experiences with haemorrhoidal disease, impact on daily life and results of treatment. This information may be used in daily practice to create awareness among clinicians.

Access and Continuity: A Multidisciplinary Education Workshop to Teach Patient-Centered Medical Home (PCMH) Principles

INTRODUCTION

As more practices move to patient-centered medical home (PCMH) models, future health care professionals must train to work in collaborative settings. We implemented a 3-hour workshop for multidisciplinary trainees on the PCMH principles of access and continuity based on the EFECT framework (eliciting a patient-centered narrative, facilitating an interprofessional team discussion, evaluating the clinical evidence, creating a shared care plan, and tracking outcomes).

METHODS

Participants included internal medicine residents and medical, physician assistant (PA), and clinical psychology students. The workshop incorporated reflective activities identifying patient and provider health care delivery priorities, plus a PCMH presentation and group activities focusing on access and continuity. Evaluations were analyzed qualitatively and quantitatively.

RESULTS

The workshop had 39 participants (seven physicians, one PA, one educator, one psychologist, three staff, nine residents, one PA student, one psychology extern, and 15 medical students). On a 0-10 Likert scale (0 = don't agree at all, 10 = completely agree), learners reported higher knowledge of PCMH principles (M = 8.8), feeling better prepared for PCMH work (M = 8.6), and having obtained real-world skills (M = 8.3). Open-ended responses describing the workshop's take-home message included the role of patient-centeredness in clinical redesign, the value of the multidisciplinary team in optimizing access and continuity, and how to use a quality improvement approach for access and continuity.

DISCUSSION

This workshop increased PCMH-related knowledge and encouraged discussion of professional roles within the team. Learners recognized the benefits of team-based rather than provider-centric approaches to access and continuity.

The development of competency frameworks in healthcare professions: a scoping review

Competency frameworks serve various roles including outlining characteristics of a competent workforce, facilitating mobility, and analysing or assessing expertise. Given these roles and their relevance in the health professions, we sought to understand the methods and strategies used in the development of existing competency frameworks. We applied the Arksey and O'Malley framework to undertake this scoping review. We searched six electronic databases (MEDLINE, CINAHL, PsycINFO, EMBASE, Scopus, and ERIC) and three grey literature sources (greylit.org, Trove and Google Scholar) using keywords related to competency frameworks. We screened studies for inclusion by title and abstract, and we included studies of any type that described the development of a competency framework in a healthcare profession. Two reviewers independently extracted data including study characteristics. Data synthesis was both quantitative and qualitative. Among 5710 citations, we selected 190 for analysis. The majority of studies were conducted in medicine and nursing professions. Literature reviews and group techniques were conducted in 116 studies each (61%), and 85 (45%) outlined some form of stakeholder deliberation. We observed a significant degree of diversity in methodological strategies, inconsistent adherence to existing guidance on the selection of methods, who was involved, and based on the variation we observed in timeframes, combination, function, application and reporting of methods and strategies, there is no apparent gold standard or standardised approach to competency framework development. We observed significant variation within the conduct and reporting of the competency framework development process. While some variation can be expected given the differences across and within professions, our results suggest there is some difficulty in determining whether methods were fit-for-purpose, and therefore in making determinations regarding the appropriateness of the development process. This uncertainty may unwillingly create and legitimise uncertain or artificial outcomes. There is a need for improved guidance in the process for developing and reporting competency frameworks.

Entrustable professional activities in nursing: A concept analysis

OBJECTIVE

Entrustable professional activities (EPAs) is a newly emerging concept. This paper aims at analyzing the concept of "EPAs" to clarify the meaning and to identify its components for optimum understanding of the concept for use in nursing education and future research.

METHOD

Three databases - ProQuest, Ovid, and PubMed- were retrieved, and Walker and Avant's concept analysis approach was used to analyze the concept of EPAs.

RESULTS

Based on the analysis, three attributes of EPAs were defined, namely 1) EPAs should be restricted to a limited number of tasks; 2)reflect the experience curve; and 3) include acceptance of responsibility and accountability. The antecedent of EPAs is a holistic and integrated assessment approach. This will eventually lead to anticipated consequences such as a mastery of core competencies and an increase in the level of autonomy.

CONCLUSION

The study may contribute to a reduction in the ambiguity of this concept to better apply it in nursing practice.

Development of undergraduate nursing entrustable professional activities to enhance clinical care and practice

BACKGROUND

Nursing education adopts a time-based approach to assess the multifaceted competencies of student nurses. The competency-based approach is preferred historically as it is practical and ensures that individuals deliver effective healthcare practice. However, there remains a gap on how these competencies are actually applied in nursing practice. To facilitate the connection between competencies, competency-based education, and nursing practice, entrustable professional activities (EPAs) can be utilized to translate competencies into clinical practice. EPAs have shown promising results across multiple healthcare specialties and have become the current driving force to facilitate nursing care and practice. Given the limited information of EPAs in nursing education, it is an opportune time to develop EPAs specific to nursing care and practice.

OBJECTIVES

To provide a detailed breakdown on the development of EPAs in nursing education to inform clinical care and practice.

METHODS

The development stages of EPAs included: i) the formation of a team, ii) the development of the conceptual framework, and iii) the pooling, reviewing, and revising of core EPAs.

RESULTS

A total of ten core EPAs were developed, with sub-EPAs nested within these core EPAs. The EPAs include: 1) patient engagement, 2) patient care and practice, 3) care management, 4) common procedures, 5) safety, 6) urgent care, 7) transition care, 8) patient education, 9) interprofessional collaboration, and 10) palliative care.

CONCLUSION

The development of EPAs specific to nursing care and practice may offer nursing programs a guide to assist with curricula planning and a basis for developing entrustment assessment tools. The unfamiliarity of EPAs in nursing education may pose as implementation challenges to EPAs. Future research is warranted to evaluate and improve the developed EPAs.

Perspectives of specialists and family physicians in interprofessional teams in caring for patients with multimorbidity: a qualitative study

BACKGROUND

Patients with multimorbidity often require services across different health care settings, yet team processes among settings are rarely implemented. We explored perceptions of specialists and family physicians collaborating in a telemedicine interprofessional consultation for patients with multimorbidity to better understand the value of bringing physicians together across the boundaries of health care settings.

METHODS

This was a descriptive qualitative, interview-based study. Physicians who had previously participated in the Telemedicine Interprofessional Model of Practice for Aging and Complex Treatments (Telemedicine IMPACT Plus [TIP] Program) were invited to participate and asked to describe their experience of being a member of the program. Interviews were conducted from March to May 2016. We conducted an iterative and interpretive process using both individual and team analysis to identify themes.

RESULTS

There were 15 participants, 9 specialists and 6 family physicians. Three themes emerged in the analysis: creating new perspectives on care for patients with multimorbidity by sharing knowledge, skills and attitudes; the shift from a consultant model to an interprofessional team model (allowing a window into the community, extending discussions beyond the medical model and focusing on the patient's health in context); and opportunities for learners, including learning about interprofessional collaboration and gaining exposure to a real-world model for caring for people with multimorbidity in outpatient settings.

INTERPRETATION

Family physicians and specialists participating in a TIP Program believed the program improved their knowledge and skills, while also serving as an effective care delivery strategy. The findings also support that learners require more exposure to nontraditional consultant models in order to care for patients with multimorbidity effectively.

Simulation Fellowships: Survey of Current Summative Assessment Practices

INTRODUCTION

The simulation fellowship training community has commenced efforts toward the development of core curricular elements for healthcare simulation fellowships but has not deployed the same effort to create evaluation strategies to monitor fellows' progress. The authors present a current view of simulation fellowship assessment strategies, their relative validity evidence using Kane's theoretical framework, and consider new approaches for defining expertise after training.

METHODS

Fellowship directors in North America were surveyed to identify what competencies are being used by the simulation fellowship community to monitor fellows' progress. A follow-up survey was sent to further clarify which tools with published validity evidence were being applied by current programs.

RESULTS

Of the 61 programs contacted, 44 (72.1%) responded and completed the first survey. Of the 44 programs, 32 (72.7%) reported using some formal assessment of their fellows. The most commonly assessed skill was debriefing. Twenty-three (37.7%) of the 61 programs contacted responded to the secondary survey. These reported that the most common published tool used was the Debriefing Assessment for Simulation in Healthcare, with only a few other tools mentioned.

CONCLUSIONS

There is a paucity of tools with published validity evidence being used to monitor a fellow's progression. The authors agree that further research needs to focus on creating validated assessment tools to assist in refining fellowship training.

Design of an entrustable professional activity for adult extracorporeal membrane oxygenation

Background

Extracorporeal membrane oxygenation supports severe cardiac or pulmonary failure. There are currently no competency-based standards for extracorporeal membrane oxygenation training.

Methods

Extracorporeal membrane oxygenation experts were interviewed using a structured interview. Responses were audio recorded, transcribed, and validated by respondents. Interviews were coded using grounded theory with a constant comparison method. Themes were developed and used to construct the entrustable professional activity, which was reviewed by the extracorporeal membrane oxygenation experts.

Results

Nine experts were interviewed; all had experience with trainees. Interview themes identified include patient selection, circuit and medical management, multidisciplinary communication, problem-based learning and simulation, and entrustment decisions. Essential functions of the entrustable professional activity were patient selection, circuit management, cannula selection, responding to circuit emergencies/complications, anticoagulation management, weaning, and family/team communication.

Conclusions

Essential functions of an extracorporeal membrane oxygenation entrustable professional activity were defined using data from structured interviews. The resultant entrustable professional activity could be implemented by critical-care programs as a scaffolding for competency-based fellow training.

•

A structured interview is an effective method for an EPA creation.

•

Nine experts with a median 14 years of ECMO experience were interviewed.

•

The essential functions for ECMO care were defined.

•

The ECMO EPA could be used for competency-based critical care education.

Entrustable Professional Activities in Oral Health for Primary Care Providers Based on a Scoping Review

Despite advances in oral health care, inequalities in oral health outcomes persist due to problems in access. With proper training, primary care providers can mitigate this inequality by providing oral health education, screening, and referral to advanced dental treatment. Diverging sets of oral health competencies and guidelines have been released or endorsed by multiple primary care disciplines. The aim of this study was to transform multiple sets of competencies into Entrustable Professional Activities (EPAs) for oral health integration into primary care training. A scoping review of the literature between January 2000 and December 2016 was conducted according to PRISMA methodology to identify all existing sets of competencies. The following primary care disciplines were included in the search: allopathic/osteopathic medical schools and residency programs in family medicine, internal medicine, and pediatrics; physician assistant programs; and nurse practitioner programs. Competencies were compared using the Health Resources and Services Administration Integration of Oral Health and Primary Care Practice competencies as the foundational set and translated into EPAs. The resulting EPAs were tested with a reactor panel. The scoping review produced 1,466 references, of which 114 were selected for full text review. Fourteen competencies were identified as being central to the integration of oral health into primary care. These were converted to seven EPAs for oral health integration into primary care and were mapped onto Accreditation Council for Graduate Medical Education residency competency domains as well to the Association of American Medical Colleges EPAs for graduating medical students. The resulting EPAs delineate the essential, observable work required of primary care providers to ensure that oral health is treated as a critical determinant of overall health.

Entrustable professional activities in health care education: a scoping review

CONTEXT

The shift in medical education from time-based learning to outcome-based learning has drawn much attention to entrustable professional activities (EPAs) as an ideal assessment framework to translate competencies into clinical practice. Given the relative novelty of EPAs, this review aims to highlight research gaps and explore and consolidate available evidence pertaining to the development and implementation of EPAs in health care.

METHOD

Arksey and O'Malley's scoping review framework was used to present the findings. The authors performed a systematic search of PubMed, Embase, CINAHL, Scopus, MedNar, OpenGrey and ProQuest Dissertation and Theses for English articles published from the inception of each database to May 2018. A manual search of the reference lists of the included studies was conducted and an expert panel was consulted. Two reviewers screened the articles for eligibility using the inclusion criteria. All authors extracted key data and analysed the data descriptively. Thematic analysis was used to categorise the results into themes.

RESULTS

Eighty articles were included in the review. All articles were published between 2010 and 2018. Three major themes and eight sub-themes were generated: (i) development of EPAs (frameworks for EPA development and implementation, identifying core or specialty-specific EPAs, and EPAs for faculty development), (ii) evaluation of EPAs and EPA entrustment factors (revised curriculum, entrustment decisions for professional activities, and feedback on implemented EPAs and the development process), and (iii) future directions and recommendations for EPAs (implementation of EPAs in undergraduate medical education and specific disciplines, and other criticisms and recommendations for EPAs).

CONCLUSIONS

Entrustable professional activities are an essential means to translate competencies into observable and measurable clinical practice. However, high-level evidence-based research on the efficacy, development and implementation of EPAs for specific target groups (i.e. undergraduates and staff) and geographical regions (i.e. Asia and Africa) is still lacking, which suggests a direction for future research.

Core Functions and Forms of Complex Health Interventions: a Patient-Centered Medical Home Illustration

Despite policy and practice support to develop and test interventions designed to increase access to quality care among high-need patients, many of these interventions fail to meet expectations once deployed in real-life clinical settings. One example is the Patient-Centered Medical Home (PCMH) model, designed to deliver coordinated care. A meta-analysis of PCMH initiatives found mixed evidence of impacts on service access, quality, and costs. Conceptualizing PCMH as a complex health intervention can generate insights into the mechanisms by which this model achieves its effects. It can also address heterogeneity by distinguishing PCMH core functions (the intervention's basic purposes) from forms (the strategies used to meet each function). We conducted a scoping review to identify core functions and forms documented in published PCMH models from 2007 to 2017. We analyzed and summarized the data to develop a PCMH Function and Form Matrix. The matrix contributes to the development of an explicit theory-based depiction of how an intervention achieves its effects, and can guide decision-support tools in the field. This innovative approach can support transformations of clinical settings and implementation efforts by building on a clear understanding of the intervention's standard core functions and the forms adapted to local contexts' characteristics.

A systematic review of 7 years of research on entrustable professional activities in graduate medical education, 2011-2018

PURPOSE

This review aimed to synthesise some of the extant work on the use of entrustable professional activities (EPAs) for postgraduate physicians, to assess the quality of the work and provide direction for future research and practice.

METHOD

Systematic searches were conducted within five electronic databases (Medline, Scopus, Web of Science, PsycINFO and CINAHL) in September 2018. Reference lists, Google Scholar and Google were also searched. Methodological quality was assessed using the Quality Assessment Tool for Studies with Diverse Designs (QATSDD).

RESULTS

In total, 49 studies were included, classified as Development of EPAs (n = 37; 76% of total included), Implementation and/or assessment of EPAs (n = 10; 20%), or both (n = 2; 4%). EPAs were described for numerous specialties, including internal medicine (n = 14; 36%), paediatrics (n = 8; 21%) and psychiatry (n = 4; 10%). Of the development studies, 92% utilised more than one method to generate EPAs. The two most commonly used methods were developing initial EPAs in a working group, (n = 27; 69%) and revising through deliberation (n = 21; 54%). Development papers were of variable quality (mean QATSDD score = 20, range 6-41). Implementation and assessment studies utilised methods that included observing trainee performance (n = 6; 50%) and enrolling trainees in competency-based curricula, which included EPAs (n = 4; 33%). The methodological quality of these implementation studies varied (mean QATSDD score = 19.5, range = 6-32).

CONCLUSIONS

This review highlighted a need for: (i) consideration of best practice guidelines for EPA development; (ii) focus on the methodological quality of research on EPA development and of EPAs, and (iii) further work investigating the implementation of EPAs in the curriculum.

Patient-Centered Medical Home Graduate Internship, Benefits to a Practice Manager: Case Study

Graduate Health Information Management students can and should be involved in collaborations with the Patient-Centered Medical Home at primary care clinics. In this case, the student is not from a Health Services Management background as it was in the first internship article, but rather from a Health Information Management background. This case study is the second of 2 Patient-Centered Medical Home internship studies where the value of an intern to a practice manager is demonstrated.

Integration of Entrustable Professional Activities with the Milestones for Emergency Medicine Residents

INTRODUCTION

Medical education is moving toward a competency-based framework with a focus on assessment using the Accreditation Council for Graduate Medical Education Milestones. Assessment of individual competencies through milestones can be challenging. While competencies describe characteristics of the person, the entrustable professional activities (EPAs) concept refers to work-related activities. EPAs would not replace the milestones but would be linked to them, integrating these frameworks. Many core specialties have already defined EPAs for resident trainees, but EPAs have not yet been created for emergency medicine (EM). This paper describes the development of milestone-linked EPAs for EM.

METHODS

Ten EM educators from across North America formed a consensus working group to draft EM EPAs, using a modified Glaser state-of-the-art approach. A reactor panel with EPA experts from the United States, Canada and the Netherlands was created, and an iterative process with multiple revisions was performed based on reactor panel input. Following this, the EPAs were sent to the Council of Residency Directors for EM (CORD-EM) listserv for additional feedback.

RESULTS

The product was 11 core EPAs that every trainee from every EM program should be able to perform independently by the time of graduation. Each EPA has associated knowledge, skills, attitudes and behaviors (KSAB), which are either milestones themselves or KSABs linked to individual milestones. We recognize that individual programs may have additional focus areas or work-based activities they want their trainees to achieve by graduation; therefore, programs are also encouraged to create additional program-specific EPAs.

CONCLUSION

This set of 11 core, EM-resident EPAs can be used as an assessment tool by EM residency programs, allowing supervising physicians to document the multiple entrustment decisions they are already making during clinical shifts with trainees. The KSAB list within each EPA could assist supervisors in giving specific, actionable feedback to trainees and allow trainees to use this list as an assessment-for-learning tool. Linking each KSAB to individual EM milestones allows EPAs to directly inform milestone assessment for clinical competency committees. These EPAs serve as another option for workplace-based assessment, and are linked to the milestones to create an integrated framework.

Huddling for High-Performing Teams

In short team huddles, trainees and PACT teamlets meet to coordinate care and identify ways to improve team processes under the guidance of faculty members who reinforce collaborative practice and continuous improvement.

Developing End-of-Training Entrustable Professional Activities for Psychiatry: Results and Methodological Lessons

PURPOSE

To develop entrustable professional activities (EPAs) for psychiatry and to demonstrate an innovative, validity-enhancing methodology that may be relevant to other specialties.

METHOD

A national task force employed a three-stage process from May 2014 to February 2017 to develop EPAs for psychiatry. In stage 1, the task force used an iterative consensus-driven process to construct proposed EPAs. Each included a title, full description, and relevant competencies. In stage 2, the task force interviewed four nonpsychiatric experts in EPAs and further revised the EPAs. In stage 3, the task force performed a Delphi study of national experts in psychiatric education and assessment. All survey participants completed a brief training program on EPAs. Quantitative and qualitative analysis led to further modifications. Essentialness was measured on a five-point scale. EPAs were included if the content validity index was at least 0.8 and the lower end of the asymmetric confidence interval was not lower than 4.0.

RESULTS

Stages 1 and 2 yielded 24 and 14 EPAs, respectively. In stage 3, 31 of the 39 invited experts participated in both rounds of the Delphi study. Round 1 reduced the proposed EPAs to 13. Ten EPAs met the inclusion criteria in Round 2.

CONCLUSIONS

The final EPAs provide a strong foundation for competency-based assessment in psychiatry. Methodological features such as critique by nonpsychiatry experts, a national Delphi study with frame-of-reference training, and stringent inclusion criteria strengthen the content validity of the findings and may serve as a model for future efforts in other specialties.

Training Needs for Adaptive Coordination: Utilizing Task Analysis to Identify Coordination Requirements in Three Different Clinical Settings

A team’s ability to coordinate and adapt their performance to meet situational demands is critical to excellent patient care. The goal of this article is to identify common coordination characteristics that enable health care action teams to ensure effective patient care and to discuss specific examples of adaptive coordination within the health care setting. Task analyses were conducted to identify situational demands, in three different clinical settings: cardiac anesthesia, pediatric sepsis simulation, and trauma resuscitation. Each task analysis identified specific coordination requirements for pertinent tasks. The research team compared these task analyses, identified emerging themes, and agreed on core coordination characteristics common across all three environments by consensus through iterative abductive analysis. Findings across these diverse clinical settings showed that expert action teams (a) continually appraise their dynamic environment, (b) identify and define points of coordination, and (c) respond to the demands of nonroutine events by making coordination highly explicit. Specific examples of adaptive coordination within the health care setting are discussed, and implications for training are articulated. Findings are also pertinent outside of health care and may contribute to the understanding of coordination behaviors within action teams across multiple settings.

How well are Swiss French physicians prepared for future practice in primary care?

BACKGROUND

Moving from postgraduate training into independent practice represents a major transition in physicians' professional life. Little is known about how Swiss primary care graduates experience such a transition. The aim of this study was to explore the extent to which primary care physicians who recently set up private practice felt prepared to work as independent practitioners.

METHODS

We conducted 7 focus groups among recently established (≤ 5 years) primary care physicians in Switzerland. Questions focused on positive and negative aspects of setting up a practice, and degree of preparedness. Transcripts were analysed according to organisational socialisation and work role transition frameworks.

RESULTS

Participants felt relatively well prepared for most medical tasks except for some rheumatologic, minor traumatology, ENR, skin and psychiatric aspects. They felt unprepared for non clinical tasks such as office, insurance and medico-legal management issues and did not anticipate that the professional networking outside the hospital would be so important to their daily work. They faced dilemmas opposing professional values to the reality of practice which forced them to clarify their professional roles and expectations. Adjustment strategies were mainly informal.

CONCLUSION

Although the postgraduate primary care curriculum is longer in Switzerland than in most European countries, it remains insufficiently connected with the reality of transitioning into independent practice, especially regarding role development and management tasks. A greater proportion of postgraduate training, with special emphasis on these issues, should take place directly in primary care.

Implementation of a novel population panel management curriculum among interprofessional health care trainees

BACKGROUND

Gaps in chronic disease management have led to calls for novel methods of interprofessional, team-based care. Population panel management (PPM), the process of continuous quality improvement across groups of patients, is rarely included in health professions training for physicians, nurses, or pharmacists. The feasibility and acceptance of such training across different healthcare professions is unknown. We developed and implemented a novel, interprofessional PPM curriculum targeted to diverse health professions trainees.

METHODS

The curriculum was implemented annually among internal medicine residents, nurse practitioner students and residents, and pharmacy residents co-located in a large, academic primary care site. Small groups of interprofessional trainees participated in supervised quarterly seminars focusing on chronic disease management (e.g., diabetes mellitus, hypertension, or chronic obstructive pulmonary disease) or processes of care (e.g., emergency department utilization for nonacute conditions or chronic opioid management). Following brief didactic presentations, trainees self-assessed their clinic performance using patient-level chart review, presented individual cases to interprofessional staff and faculty, and implemented subsequent feedback with their clinic team. We report data from 2011 to 2015. Program evaluation included post-session participant surveys regarding attitudes, knowledge and confidence towards PPM, ability to identify patients for referral to interprofessional team members, and major learning points from the session. Directed content analysis was performed on an open-ended survey question.

RESULTS

Trainees (n = 168) completed 122 evaluation assessments. Trainees overwhelmingly reported increased confidence in using PPM and increased knowledge about managing their patient panel. Trainees reported improved ability to identify patients who would benefit from multidisciplinary care or referral to another team member. Directed content analysis revealed that trainees viewed team members as important system resources (n = 82).

CONCLUSIONS

Structured interprofessional training in PPM is both feasible and acceptable to trainees across multiple professions. Curriculum participants reported improved panel management skills, increased confidence in using PPM, and increased confidence in identifying candidates for interprofessional care. The curriculum could be readily exported to other programs and contexts.

Entrustable professional activities for quality and patient safety

BACKGROUND

Further efforts are warranted to identify innovative approaches to best implement competencies in nursing education. To bridge the gap between competency-based education, practice, and implementation of knowledge, skills, and attitudes, one emerging approach is entrustable professional activities (EPAs).

PURPOSE

The objective of this study was to introduce the concept of EPAs as a framework for curriculum and assessment in graduate nursing education and training.

METHODS

Seven steps are provided to develop EPAs for nurses through the example of a quality and safety EPA. The example incorporates the Quality and Safety Education for Nurses (QSEN) patient safety competencies and evidence-based literature.

FINDINGS

EPAs provide a practical approach to integrating competencies in nursing as quality and safety are the cornerstones of nursing practice, education, and research.

DISCUSSION

Introducing the EPA concept in nursing is timely as we look to identify opportunities to enhance nurse practitioner (NP) training models and implement nurse residency programs.

What Is a Rheumatologist and How Do We Make One?

OBJECTIVE

Graduate medical education is a critical time in the training of a rheumatologist, and purposeful evaluation of abilities during this time is essential for long-term success as an independent practitioner. The internal medicine subspecialties collectively developed a uniform set of reporting milestones by which trainees can be assessed and receive formative feedback, providing clarity of accomplishment as well as areas for improvement in training. Furthermore, the reporting milestones provide a schema for assessment and evaluation of fellows by supervisors. The internal medicine subspecialties were also tasked with considering entrustable professional activities (EPAs), which define the abilities of a subspecialty physician who has attained sufficient mastery of the field to be accountable to stakeholders and participate in independent practice. Although EPAs have been established for a few specialties, they had not yet been described for rheumatology. EPAs have value as descriptors of the comprehensive abilities, knowledge, and skills of a practicing rheumatologist. The rheumatology EPAs have a role in defining a specialist in rheumatology upon completion of training, and also represent the ways our specialty defines our abilities that are enduring throughout practice.

METHODS

We describe the collaborative process of the development of both the subspecialty reporting milestones and the rheumatology EPAs. The reporting milestones evolved through discussions and collaborations among representatives from the Association of Specialty Professors, the Alliance for Academic Internal Medicine, the American Board of Internal Medicine, and the Accreditation Council for Graduate Medical Education. The EPAs were a product of deliberations by the Next Accreditation System (NAS) working group of the American College of Rheumatology (ACR) Committee on Rheumatology Training and Workforce Issues.

RESULTS

Twenty-three subspecialty reporting milestones and 14 rheumatology EPAs were advanced and refined over the course of 3 subspecialty reporting milestone development summits and 3 ACR NAS working group meetings, respectively.

CONCLUSION

The subspecialty reporting milestones and rheumatology EPAs presented here stipulate reasonable and measurable expectations for rheumatologists-in-training. Together, these tools aim to promote enrichment and greater accountability in the training of fellows. Additionally, the EPAs define, for all stakeholders, the expertise of a rheumatologist in practice.

Developing a Comprehensive Perioperative Education Curriculum for Internal Medicine Residency Training

Background

Patients undergoing surgery are becoming increasingly complex and internists are becoming more involved in their perioperative care. Therefore, new requirements from the ACGME/ABIM necessitate education in this area. We aim to discuss how our institution adapted a perioperative curriculum to fill this need.

Methods

Perioperative education is primarily given to the residents during their one month rotation through the General Internal Medicine Consult Service rotation. This is an inpatient rotation that provides perioperative expertise to surgical teams, medicine consultation to medical subspecialty teams, and outpatient preoperative evaluations.

Results

Our implementation complies with ACGME/ABIM requirements and ensures that the educational and clinical needs of our institution are met.

Conclusions

Developing a new curriculum can be daunting. We hope that this explanation of our approach will aid others who are working to develop an effective perioperative curriculum at their institutions.

Faculty and resident perspectives on ambulatory care education: A collective case study of family medicine, psychiatry, and surgery

BACKGROUND

Ambulatory care (AC) experiences within medical education are garnering increasing attention. We sought to understand how faculty and residents' describe their experiences of AC and ambulatory care education (ACEduc) within, between, and across disciplinary contexts.

METHODS

We designed a Stakian collective case study, applying constructivist grounded theory analytic methods. Using purposive and snowball sampling, we interviewed 17 faculty and residents across three instrumental cases: family medicine, psychiatry, surgery. Through constant comparative analysis, we identified patterns within, between, and across cases.

RESULTS

Family medicine and psychiatry saw AC as an inherent part of continuous, longitudinal care; surgery equated AC with episodic experiences in clinic, differentiating it from operating. Across cases, faculty and residents cautiously valued ACEduc, and in particular, considered it important to develop non-medical expert competencies (e.g., communication). However, surgery residents described AC and ACEduc as less interesting and a lower priority than operating. Educational structures mediated these views.

CONCLUSION

Differences between cases highlight a need for further study, as universal assumptions about ACEduc's purposes and approaches may need to be tempered by situated, contextually-rich perspectives. How disciplinary culture, program structure, and systemic structure influence ACEduc warrant further consideration as does the educational potential for explicitly framing learners' perspectives.

Applying occupational and organizational psychology theory to entrustment decision-making about trainees in health care: a conceptual model

In medical contexts around the world, supervising physicians continuously decide what degree of supervision to apply as trainees carry out professional activities. Although the implications for patients can be far-reaching, little is known about how these entrustment decisions are formed. The concept of 'Entrustable Professional Activities' has initiated interest and valuable research on factors that may influence the entrustment decision process.The aim of the current article is to link models of entrustment developed in the fields of occupational and organizational psychology and military psychology to medical education studies that have explored the factors influencing physicians' entrustment decisions. We provide a conceptual framework of the entrustment decision-making process, which we suggest will contribute to the understanding of how supervising physicians arrive at the decision to entrust a medical trainee with a professional activity.

Do medical residents perform patient-centered medical home tasks? A mixed-methods study

BACKGROUND

Increasingly, residents are being trained in Patient-centered Medical Home (PCMH) settings. A set of PCMH entrustable professional activities (EPAs) for residents has been defined but not evaluated in practice.

OBJECTIVE

To understand whether residents trained at PCMH sites reported higher likelihood of engaging in PCMH tasks than those training in non-PCMH sites.

DESIGN

Survey and nominal group data from post-graduate trainees at three residency programs.

RESULTS

A total of 179 residents responded (80% response). Over half (52%) cared for patients at PCMH sites. Residents at PCMH sites were more likely to report engaging in tasks in the NCQA domains of enhancing access and continuity (p < 0.01 for 4/11 tasks), planning and managing care (p < 0.01 for 3/4 tasks), providing self-care and community support (p < 0.01 for 3/5 tasks), and identifying and managing patient populations (p < 0.01 for 1/6 tasks), but were not more likely to report tracking and coordinating care or measuring and improving performance. Residents at PCMH sites were more likely to report working with medical assistants (p < 0.01), but not other healthcare professionals. Qualitative data showed staff teamwork and continuity of care as facilitators of patient-centered care, and technological problems and office inefficiencies as barriers to care.

CONCLUSIONS

Residents trained at PCMH sites were more likely to engage in tasks in several NCQA domains, but not care coordination and quality assessment. Similar facilitators and barriers to trainee provision of patient-centered care were cited regardless of PCMH status. Curricula on PCMH principles and workflows that foster continuity and communication may help to inform residents on PCMH tenets and incorporate residents into team-based care.

ABBREVIATIONS

EPA: Entrustable professional activity; GIM: General Internal Medicine; NCQA: National Center for Quality Assurance; PCMH: Patient-centered medical home.

Why Aren't More Primary Care Residents Going into Primary Care? A Qualitative Study

BACKGROUND

Workforce projections indicate a potential shortage of up to 31,000 adult primary care providers by the year 2025. Approximately 80 % of internal medicine residents and nearly two-thirds of primary care internal medicine residents do not plan to have a career in primary care or general internal medicine.

OBJECTIVE

We aimed to explore contextual and programmatic factors within primary care residency training environments that may influence career choices.

DESIGN

This was a qualitative study based on semi-structured, in-person interviews.

PARTICIPANTS

Three primary care internal medicine residency programs were purposefully selected to represent a diversity of training environments. Second and third year residents were interviewed.

APPROACH

We used a survey guide developed from pilot interviews and existing literature. Three members of the research team independently coded the transcripts and developed the code structure based on the constant comparative method. The research team identified emerging themes and refined codes. ATLAS.ti was used for the analysis.

KEY RESULTS

We completed 24 interviews (12 second-year residents, and 12 third-year residents). The age range was 27-39 years. Four recurrent themes characterized contextual and programmatic factors contributing to residents' decision-making: resident expectations of a career in primary care, navigation of the boundary between social needs and medical needs, mentorship and perceptions of primary care, and structural features of the training program.

CONCLUSIONS

Addressing aspects of training that may discourage residents from careers in primary care such as lack of diversity in outpatient experiences and resident frustration with their inability to address social needs of patients, and strengthening aspects of training that may encourage interests in careers in primary care such as mentorship and protected time away from inpatient responsibilities during primary care rotations, may increase the proportion of residents enrolled in primary care training programs who pursue a career in primary care.

Assessment formats in dental medicine: An overview

AIM

At the annual meeting of German dentists in Frankfurt am Main in 2013, the Working Group for the Advancement of Dental Education (AKWLZ) initiated an interdisciplinary working group to address assessments in dental education. This paper presents an overview of the current work being done by this working group, some of whose members are also actively involved in the German Association for Medical Education's (GMA) working group for dental education. The aim is to present a summary of the current state of research on this topic for all those who participate in the design, administration and evaluation of university-specific assessments in dentistry.

METHOD

Based on systematic literature research, the testing scenarios listed in the National Competency-based Catalogue of Learning Objectives (NKLZ) have been compiled and presented in tables according to assessment value.

RESULTS

Different assessment scenarios are described briefly in table form addressing validity (V), reliability (R), acceptance (A), cost (C), feasibility (F), and the influence on teaching and learning (EI) as presented in the current literature. Infoboxes were deliberately chosen to allow readers quick access to the information and to facilitate comparisons between the various assessment formats. Following each description is a list summarizing the uses in dental and medical education.

CONCLUSION

This overview provides a summary of competency-based testing formats. It is meant to have a formative effect on dental and medical schools and provide support for developing workplace-based strategies in dental education for learning, teaching and testing in the future.

Effects of adding a new PCMH block rotation and resident team to existing longitudinal training within a certified PCMH: primary care residents' attitudes, knowledge, and experience

BACKGROUND

Although the patient-centered medical home (PCMH) model is considered important for the future of primary care in the USA, it remains unclear how best to prepare trainees for PCMH practice and leadership. Following a baseline study, the authors added a new required PCMH block rotation and resident team to an existing longitudinal PCMH immersion and didactic curriculum within a Level 3-certified PCMH, aiming for "enhanced situated learning". All 39 residents enrolled in a USA family medicine residency program during the first year of curricular implementation completed this new 4-week rotation. This study examines the effects of this rotation after 1 year.

METHODS

A total of 39 intervention and 13 comparison residents were eligible participants. This multimethod study included: 1) individual interviews of postgraduate year (PGY) 3 intervention vs PGY3 comparison residents, assessing residents' PCMH attitudes, knowledge, and clinical experience, and 2) routine rotation evaluations. Interviews were audiorecorded, transcribed, and analyzed using immersion/crystallization. Rotation evaluations were analyzed using descriptive statistics and qualitative analysis of free text responses.

RESULTS

Authors analyzed 23 interviews (88%) and 26 rotation evaluations (67%). Intervention PGY3s' interviews revealed more nuanced understanding of PCMH concepts and more experience with system-level PCMH tasks than those of comparison PGY3s. More intervention PGY3s rated themselves "extremely prepared" to implement PCMH than comparison PGY3s; however, most self-rated "somewhat prepared". Their reflections demonstrated deeper understanding of PCMH implementation and challenges than comparison PGY3s but inadequate experience to directly see the results of successful solutions. Rotation evaluations from PGY1, PGY2, and PGY3s revealed strengths and several areas for improvement.

CONCLUSION

Adding one 4-week block rotation to existing longitudinal training appears to improve residents' PCMH knowledge, skills, and experience from "basic" to "intermediate". However, this training level appears inadequate for PCMH leadership or for teaching junior learners. Further study is needed to determine the optimum training for different settings.

Transforming the learning outcomes of anaesthesiology training into entrustable professional activities: A Delphi study

BACKGROUND

True competency-based medical education should produce graduates meeting fixed standards of competence. Current postgraduate programmes are usually based on a pre-determined length of time in training making them poorly suited for an individual approach. The concept of entrustable professional activities (EPAs) enables a more flexible, personalised and less time-dependent approach to training programmes. An EPA is a unit of professional practice, to be entrusted to a trainee to execute without supervision once they demonstrate sufficient competence. As EPAs relate competencies to clinical practice, they structure training and assessment more logically according to the way clinicians actually work. A first step in building an EPA-based curriculum is to identify the core EPAs of the profession.

OBJECTIVES

The aim of this study was to identify EPAs for postgraduate training in anaesthesiology and to provide an example of how an existing curriculum can be transformed into an EPA-based curriculum.

DESIGN

A modified Delphi method was used as a consensus approach applying three Delphi rounds.

SETTING

Postgraduate specialty training in anaesthesiology in the Netherlands.

PARTICIPANTS

All programme directors in anaesthesiology in the Netherlands except for a single programme director who was involved as a researcher in this study and could not participate.

MAIN OUTCOME MEASURES

Agreement among participants on a list of EPAs. Agreement was specified as a consensus rate of more than 80%.

RESULTS

In this study, 27 programme directors (69% overall response rate) reached consensus on a set of 45 EPAs that describe a curriculum in anaesthesiology for the Netherlands.

CONCLUSION

This study is a first step toward a more contemporary curriculum in competency-based postgraduate anaesthesiology training.