Counternarratives that illuminate faculty agency: A five-year longitudinal qualitative study of physician educators in academic medicine

PURPOSE

Physician educators are often expected to direct educational programs and assume roles that conform to field norms for career advancement but that may not afford meaningful work for educators. The purpose of this study was to describe and analyse the perspectives and actions taken by physician educators in response to tension between feeling compelled to direct an educational program and doing educationally meaningful work.

METHODS AND MATERIALS

We used data from a longitudinal study and focused on three participants who, over the course of the five-year study, offered significant insights into how physician educators act in ways that run counter to expectations for career advancement. Our narrative analysis entailed organizing data from interview transcripts into time-ordered displays, weaving data into counternarratives that were edited by participants, and using the theory of faculty agency (and its key constructs, strategic perspectives and strategic action) to thread the stories together.

RESULTS

In each counternarrative, the participant deliberated their sense of being a physician educator (strategic perspectives) and when expectations became untenable, they did what they needed to do to engage in meaningful work (strategic action) rather than comply with expectations for career advancement in academic medicine. For one participant, faculty agency meant leaving academic medicine; for another, it meant reducing clinical time so that unpaid time could be devoted to education; and for another, it meant opting not do direct a reputable education program.

CONCLUSIONS

Faculty agency is a useful theoretical lens for conceptualizing how physician educators navigate their careers in academic medicine. Counternarratives that illuminate faculty agency offer stories that describe alternate career paths and portend a different future for physician educators.

Inequity is woven into the fabric: a discourse analysis of assessment in pediatric residency training

Intrinsic inequity in assessment refers to sources of harmful discrimination inherent in the design of assessment tools and systems. This study seeks to understand intrinsic inequity in assessment systems by studying assessment policies and associated procedures in residency training, using general pediatrics as a discourse case study. Foucauldian discourse analysis (FDA) was conducted on assessment policy and procedure documents. Two authors independently prepared structured analytic notes using guiding questions. Documents and respective analytic notes were subsequently reviewed independently by all authors. Each author prepared further unstructured analytic notes on the documents' discourse. The authors then compared notes and constructed truth statements (i.e., interpretations of what the discourse establishes as true about the construct under study) and sub-strands (i.e., themes) that were repeated and legitimized across the documents via iterative discussion. Based on analysis, the authors constructed two truth statements. These truth statements, "good assessment is equitable assessment," and "everyone is responsible for inequity," conceptualized inequity in assessment as an isolated or individual-level aberration in an otherwise effective or neutral system. Closer examination of the truth statements and sub-strands in the discourse presented an alternative view, suggesting that inequity may in fact not be an aberration but rather an inherent feature of assessment systems.

Program Evaluation in Health Professions Education: An Innovative Approach Guided by Principles

PROBLEM

Program evaluation approaches that center the achievement of specific, measurable, achievable, realistic, and time-bound goals are common in health professions education (HPE) but can be challenging to articulate when evaluating emergent programs. Principles-focused evaluation is an alternative approach to program evaluation that centers on adherence to guiding principles, not achievement of goals. The authors describe their innovative application of principles-focused evaluation to an emergent HPE program.

APPROACH

The authors applied principles-focused evaluation to the Children's Hospital of Philadelphia Medical Education Collaboratory, a works-in-progress program for HPE scholarship. In September 2019, the authors drafted 3 guiding principles. In May 2021, they used feedback from Collaboratory attendees to revise the guiding principles: Advance Excellence , Build Bridges , and Cultivate Learning .

OUTCOMES

In July 2021, the authors queried participants about the extent to which their experience with the Collaboratory adhered to the revised guiding principles. Twenty of the 38 Collaboratory participants (53%) responded to the survey. Regarding the guiding principle Advance Excellence , 9 respondents (45%) reported that the Collaboratory facilitated engagement in scholarly conversation only by a small extent, and 8 (40%) reported it facilitated professional growth only by a small extent. Although some respondents expressed positive regard for the high degree of rigor promoted by the Collaboratory, others felt discouraged because this degree of rigor seemed unachievable. Regarding the guiding principle Build Bridges , 19 (95%) reported the Collaboratory welcomed perspectives within the group. Regarding the guiding principle Cultivate Learning , 19 (95%) indicated the Collaboratory welcomed perspectives within the group and across disciplines, and garnered collaboration.

NEXT STEPS

Next steps include improving adherence to the principle of Advancing Excellence , fostering a shared mental model of the Collaboratory's guiding principles, and applying a principles-focused approach to the evaluation of multi-site HPE programs.

EKG Acquisition Curriculum for Pediatric Trainees

OBJECTIVES

Pediatric residency trainees interface with electrocardiograms (EKG) as part of routine clinical care. Depending on workflow and availability of support staff, trainees may be required to obtain EKGs on patients, though training on this skill varies. Our intervention seeks to train incoming pediatric residents on obtaining EKGs from pediatric patients and identifying common problems that may result in acquisition of low-fidelity EKGs.

METHODS

A team of physicians, EKG technicians, and simulation educators designed a 30-min didactic and experiential learning opportunity for incoming pediatric trainees held prior to their start of clinical responsibilities. During the session, trainees were introduced to the basics of EKG acquisition and common quality issues that arise. Afterwards, they practiced placing EKG leads on a mannequin and a live model. A pre- and post-session survey was utilized to assess the session's utility and participant's learning.

RESULTS

The intervention was perceived as a valuable experience by participants over the course of 2 years. We found increased participant comfort with performing and troubleshooting EKGs (P<.001). There was a 33% improvement in quality assessment of EKG rhythm strips after the session (P<.001).

CONCLUSION

Given the importance of EKGs to the care of pediatric patients, it is essential that pediatricians receive adequate training in acquiring and assessing EKG quality. This intervention was deemed to be highly useful with a demonstrated improvement in EKG troubleshooting skills among first year pediatric residents. This session improves learner comfort with essential clinical responsibilities and identification of low-quality EKGs that often warrant repeat testing.

Can I Ask a Question About URiM Awards That I Don't Know the Answer to? Designing an Award for Underrepresented Medical Education Researchers

Meaningful Equity, Diversity, and Inclusion (EDI) efforts may be stymied by concerns about whether proposed initiatives are performative or tokenistic. The purpose of this project was to analyze discussions by the Research in Medical Education (RIME) Program Planning committee about how best to recognize and support underrepresented in medicine (URiM) researchers in medical education to generate lessons learned that might inform local, national, and international actions to implement meaningful EDI initiatives. Ten RIME Program Planning Committee members and administrative staff participated in a focus group held virtually in August 2021. Focus group questions elicited opinions about "if and how" to establish a URiM research award. The focus group was recorded, transcribed, and thematically analyzed. Recognition of privilege, including who has it and who doesn't, underpinned the focus group discussion, which revolved around 2 themes: (1) tensions between optics and semantics, and (2) potential unintended consequences of trying to level the medical education playing field. The overarching storyline threaded throughout the focus group discussion was intentionality. Focus group participants sought to avoid performativity by creating an award that would be meaningful to recipients and to career gatekeepers such as department chairs and promotion and tenure committees. Ultimately, participants decided to create an award that focused on exemplary Equity, Diversity, and Inclusion (EDI) scholarship, which was eventually named the "RIME URiM Research Award." Difficult but productive conversations about EDI initiatives are necessary to advance underrepresented in medicine (URiM) scholarship. This transparent commentary may trigger further critical conversations.

Diagnostic Reasoning of Resident Physicians in the Age of Clinical Pathways

BACKGROUND

Development of skills in diagnostic reasoning is paramount to the transition from novice to expert clinicians. Efforts to standardize approaches to diagnosis and treatment using clinical pathways are increasingly common. The effects of implementing pathways into systems of care during diagnostic education and practice among pediatric residents are not well described.

OBJECTIVE

To characterize pediatric residents' perceptions of the tradeoffs between clinical pathway use and diagnostic reasoning.

METHODS

We conducted a qualitative study from May to December 2019. Senior pediatric residents from a high-volume general pediatric inpatient service at an academic hospital participated in semi-structured interviews. We utilized a basic interpretive qualitative approach informed by a dual process diagnostic reasoning framework.

RESULTS

Nine residents recruited via email were interviewed. Residents reported using pathways when admitting patients and during teaching rounds. All residents described using pathways primarily as management tools for patients with a predetermined diagnosis, rather than as aids in formulating a diagnosis. As such, pathways primed residents to circumvent crucial steps of deliberate diagnostic reasoning. However, residents relied on bedside assessment to identify when patients are "not quite fitting the mold" of the current pathway diagnosis, facilitating recalibration of the diagnostic process.

CONCLUSIONS

This study identifies important educational implications at the intersection of residents' cognitive diagnostic processes and use of clinical pathways. We highlight potential challenges clinical pathways pose for skill development in diagnostic reasoning by pediatric residents. We suggest opportunities for educators to leverage clinical pathways as a framework for development of these skills.

Conducting qualitative research through time: how might theory be useful in longitudinal qualitative research?

This paper explores the use of theory in longitudinal qualitative research, an approach to research which explores lived experiences as they unfold. The authors illustrate how the complexity of conducting qualitative research through time drives an understanding and use of theory that differs from other research approaches. Longitudinal qualitative research considers time as fluid, subjective, and unbounded-in contrast to the more common taken-for-granted understanding of time as fixed, objective, and linear. Furthermore, longitudinal qualitative research is predicated on a premise of trust in the context of enduring research relationships. Therefore, while subject-matter theories used to investigate topics of interest to health professions educators may be useful frameworks for other types of research, longitudinal qualitative research needs theories that accommodate the myriad of changes in lived experiences through time. The authors share their decade-long, longitudinal qualitative research story, highlighting their decision points and insights. In doing so, they foreground issues such as time as fluid as an important contribution to health professions education literature.

Replace, amplify, transform: a qualitative study of how postgraduate trainees and supervisors experience and use telehealth for instruction in ambulatory patient care

BACKGROUND

Little is known about using telehealth patient visits as an educational mode. Therefore, rapid implementation of telehealth during the COVID-19 pandemic had to be done without understanding how to optimize telehealth for education. With the likely sustained/post-pandemic use of telehealth in ambulatory patient care, filling gaps in our understanding of how telehealth can be used for instruction in this context is critical. This study sought to understand perceptions of pediatric postgraduate trainees and supervisors on the use of telehealth for instruction in ambulatory settings with the goal of identifying effective ways to enhance learning during telehealth visits.

METHODS

In May-June of 2020, the authors purposefully sampled first- and third-year postgraduate trainees and supervising attendings from pediatric fellowship programs at one institution that implemented telehealth for instructional activities. They conducted semi-structured interviews; interviews lasted a median of 51 min (trainees) and 41 min (supervisors). They conducted interviews and data analysis iteratively until reaching saturation. Using thematic analysis, they created codes and constructed themes from coded data. They organized themes using the Replace-Amplify-Transform (RAT) model, which proposes that technology can replace in-person learning and/or amplify and transform learning.

RESULTS

First-year trainees (n = 6), third-year trainees (n = 5) and supervisors (n = 6) initially used telehealth to replace in-person learning. However, skills that could be practiced in telehealth visits differed from in-person visits and instructional activities felt rushed or awkward. Trainees and supervisors adapted and used telehealth to amplify learning by enhancing observation and autonomy. They also transformed learning, using telehealth to develop novel skills.

CONCLUSIONS

To harness telehealth for instructional activities, our findings indicated that trainees and supervisors should shift from using it as a direct replacement for in-person education to taking advantage of novel opportunities to amplify and transform education in PGME. The authors provide data-driven recommendations to help PGME trainees, supervisors and educators capitalize on the educational advantages of telehealth.

RIME 60 Years: Celebration and Future Horizons

This year marks the 60th anniversary (1961-2021) of Research in Medical Education (RIME). Over the past 6 decades, RIME has selected medical education research to be presented each year at the Association of American Medical Colleges Annual Meeting: Learn Serve Lead and published in a supplement of Academic Medicine. In this article, the authors surveyed RIME chairs from the past 20 years to identify ways that RIME has advanced medical education research and to generate ideas for future directions. RIME chairs described advancements in the rigor and impact of RIME research and the timeliness of the topics, often serving as a driver for cutting-edge research. They highlighted RIME's role in promoting qualitative research, introducing new epistemologies, and encouraging networking as a means of career advancement. Going forward, RIME chairs suggested (1) strengthening collaborations with formal advanced MEd and PhD degree programs, (2) creating formal mentorship channels for junior and minority faculty, and (3) promoting research related to knowledge translation.

Longitudinal qualitative research in medical education: Time to conceptualise time

CONTEXT

Longitudinal qualitative research is an approach to research that entails generating qualitative data with the same participants over extended periods of time to understand their lived experiences as those experiences unfold. Knowing about dynamic lived experiences in medical education, that is, learning journeys with stops and starts, detours, transitions and reversals, enriches understanding of events and accomplishments along the way. The purpose of this paper is to create access points to longitudinal qualitative research in support of increasing its use in medical education.

METHODS

The authors explore and argue for different conceptualisations of time: analysing lived experiences through time versus analysing lived experiences cross-sectional or via 2-point follow-up studies and considering time as subjective and fluid as well as objective and fixed. They introduce applications of longitudinal qualitative research from several academic domains: investigating development and formal education; building longitudinal research relationship; and exploring interconnections between individual journeys and social structures. They provide an illustrative overview of longitudinal qualitative research in medical education, and end with practical advice, or pearls, for medical education investigators interested in using this research approach: collecting data recursively; analysing longitudinal data in three strands; addressing mutual reflexivity; using theory to illuminate time; and making a long-term commitment to longitudinal qualitative research.

CONCLUSIONS

Longitudinal qualitative research stretches investigators to think differently about time and undertake more complex analyses to understand dynamic lived experiences. Research in medical education will likely be impoverished if the focus remains on time as fixed. Seeing things qualitatively through time, where time is fluid and the past, present and future interpenetrate, produces a rich understanding that can move the field forward.

Navigating landscapes of practice: A longitudinal qualitative study of physicians in medical education

INTRODUCTION

Despite its widespread application in medical education, belonging to a single community of practice does not reflect the overall experience of physician-educators. Knowing how physician-educators find their way among different communities of practice (ie their landscape of practice) has implications for professional development but the limited description in the literature. In this longitudinal qualitative research, we explored how physicians who pursue graduate degrees in medical education navigate their landscape of practice.

METHODS

11/29 physicians in one cohort of a masters in medical education programme were interviewed annually from 2016 (programme start) to 2020 (2 years post-graduation). We iteratively collected and analysed data, creating inductive codes and categorising coded data by mode of identification (engagement, imagination, alignment) and time. We organised narratives into time-ordered data matrices so that final analysis wove together mode, time and participant.

RESULTS

All participants consistently spoke of navigating their landscape of practice, which included the community created in the graduate programme; but that single community 'doesn't define the journey itself'. They shifted engagement from teaching individual learners to translating what they learned in the graduate programme to develop educational projects and produce scholarship. They shifted the imagination from relying on internal and external assessments to experience-inspired versions of their future self. And they shifted alignment from belonging to the graduate programme's community of practice, then belonging to different communities in their landscape of practice and ultimately focussing on communities that mattered most to them.

DISCUSSION

Physicians in a graduate programme in medical education navigated their dynamic landscape of practice by shifting how they engaged in medical education, as well as what they imagined and who they aligned with as physician-educators. Our work offers novel insights into how knowledgeability emerges through time as overlapping modes of identification.

Mutual Rewards: Engaging the Field and Creating a Path Toward Academic Journal Editorship

In this commentary, the inaugural cohort of Academic Medicine assistant editors shares their experiences in this role and the value of creating a path toward academic journal editorship for early- and mid-career scholars. They are a group with diverse backgrounds and a common commitment to advance scholarship in medical education. They collectively describe how they have contributed to the journal in multiple ways, reflect on how they navigated onboarding challenges in the midst of a pandemic, and, most important, share why this role matters for the medical education scholarship community. They express how the assistant editor role has been mutually rewarding, allowing the assistant editors to gain entry to academic journal editorship while also serving the journal and its community.

Longitudinal Qualitative Study of Career Decision-making of First-Year Medical Students: Why Neurology (or Not)?

Objective

The growing shortage of neurologists is in part due to suboptimal recruitment. Little is known about students' decision making regarding a career in neurology, particularly early in training. Using a longitudinal qualitative approach, we aimed to understand factors that influence first-year medical students' decisions about neurology.

Methods

We conducted 1-on-1 semistructured interviews with 15 first-year medical students at 1 institution before and after the preclinical neurology course (2018-2019). In the first interview, we asked about career intentions, factors likely to influence specialty choice, and perceptions of neurology. In the second interview, we asked about changes in students' views over the year. Using thematic analysis, we generated codes and clustered coded data into themes.

Results

The 2 most prominent factors influencing career choice in general were lifestyle and personal interest. No students expressed concerns about lifestyle in neurology. Most students were neutral about neurology or had a positive personal interest, which typically increased after the neurology course. Students frequently worried about content difficulty and the curative potential of neurology.

Conclusions

Interventions should include early education about the factors important to students in determining specialty choice, including lifestyle, and address potentially negative perceptions of neurology. Increasing time allotment to the preclinical neurology course may combat perception of the content as difficult.

Reading the Self: Medical Students' Experience of Reflecting on Their Writing Over Time

PURPOSE

To investigate students' experience (over time) with meta-reflection writing exercises, called Signature Reflections. These exercises were used to strengthen reflective capacity, as part of a 4-year reflective writing portfolio curriculum that builds on a recognized strategy for reflection (narrative medicine) and employs longitudinal faculty-mentors.

METHOD

In 2018, the authors conducted 5 focus groups with 18 third-year students from the Columbia University Vagelos College of Physicians and Surgeons class of 2019 to examine students' experience with Signature Reflections. Using an iterative, thematic approach, they developed codes to reflect common patterns in the transcripts, distilled conceptually similar codes, and assembled the code categories into themes.

RESULTS

Three core themes (safe space, narrative experience, mirror of self) and 1 overarching theme (moving through time) were identified. Students frequently experienced relief at having a safe reflective space that promoted grappling with their fears or vulnerabilities and highlighted contextual factors (e.g., trusted faculty-mentors, protected time) that fostered a safe space for reflection and exploration. They often emphasized the value of tangible documentation of their medical school journey (narrative experience) and reported using Signature Reflections to examine their emerging identity (mirror of self). Overlapping with the core themes was a deep appreciation for the temporal perspective facilitated by the Signature Reflections (moving through time).

CONCLUSIONS

A longitudinal narrative medicine-based portfolio curriculum with pauses for meta-reflection allowed students, with faculty support, to observe their trajectory through medical school, explore fears and vulnerabilities, and narrate their own growth. Findings suggest that narrative medicine curricula should be required and sufficiently longitudinal to facilitate opportunities to practice the skill of writing for insight, foster relationships with faculty, and strengthen students' temporal perspectives of their development.

Medical Students' Perspectives on Entrustment Decision Making in an Entrustable Professional Activity Assessment Framework: A Secondary Data Analysis

PURPOSE

Research on how entrustment decisions are made identifies 5 influential factors (supervisor, trainee, supervisor-trainee relationship, context, task). However, this literature primarily represents the perspective of supervisors in graduate medical education and is conducted outside of an assessment framework where entrustment decisions have consequences for trainees and for patients. To complement the literature, the authors explored how medical students in a pilot program that used an entrustable professional activity (EPA) assessment framework perceived factors influencing entrustment decisions.

METHOD

The authors conducted a secondary analysis of qualitative data from program evaluation of a pilot project using an EPA assessment framework to advance students through their curriculum and into residency. Data were derived from 8 focus groups conducted over 4 years (2015-2018) with 27 students who shared their experience of learning and supervision in the project. Sensitized by the entrustment literature, the authors coded and analyzed focus group transcripts according to principles of thematic analysis.

RESULTS

Components of the trainee and supervisor-trainee relationship factors predominated students' perceptions of entrustment decisions. Students directed their own learning by asking for feedback, seeking opportunities to engage in learning, sharing limitations of their knowledge with supervisors, and pushing supervisors to recalibrate assessments when appropriate. Students' agentic actions were facilitated by longitudinal supervisor-trainee relationships wherein they felt comfortable asking for help and built confidence in patient care. Students mentioned components of other factors that influenced entrustment decisions (supervisor, clinical task, clinical context), but did so less frequently and from a nonagentic vantage point.

CONCLUSIONS

Students' perspectives on entrustment decisions can be derived from their views on learning and supervision in an EPA assessment framework. Their perspectives complement the literature by highlighting students' agentic actions to influence entrustment decisions and promotion of agentic action through practices incorporating longitudinal supervisor-trainee relationships.

Entrustable Professional Activities and Entrustment Decision Making: A Development and Research Agenda for the Next Decade

To establish a research and development agenda for Entrustable Professional Activities (EPAs) for the coming decade, the authors, all active in this area of investigation, reviewed recent research papers, seeking recommendations for future research. They pooled their knowledge and experience to identify 3 levels of potential research and development: the micro level of learning and teaching; the meso level of institutions, programs, and specialty domains; and the macro level of regional, national, and international dynamics. Within these levels, the authors categorized their recommendations for research and development. The authors identified 14 discrete themes, each including multiple questions or issues for potential exploration, that range from foundational and conceptual to practical. Much research to date has focused on a variety of issues regarding development and early implementation of EPAs. Future research should focus on large-scale implementation of EPAs to support competency-based medical education (CBME) and on its consequences at the 3 levels. In addition, emerging from the implementation phase, the authors call for rigorous studies focusing on conceptual issues. These issues include the nature of entrustment decisions and their relationship with education and learner progress and the use of EPAs across boundaries of training phases, disciplines and professions, including continuing professional development. International studies evaluating the value of EPAs across countries are another important consideration. Future studies should also remain alert for unintended consequences of the use of EPAs. EPAs were conceptualized to support CBME in its endeavor to improve outcomes of education and patient care, prompting creation of this agenda.

Stability and Change in the Journeys of Medical Trainees: A 9-Year, Longitudinal Qualitative Study

PURPOSE

It takes many years for trainees to become physicians-so long that their individual journeys through medical school and residency are seldom systematically studied and thus not well understood. Lack of understanding hinders effective support of future physicians' development across traditional time-bound phases of medical education. The authors initiated a longitudinal qualitative study, tracing a cohort of 6 trainees through the same medical school and 6 different residencies. They asked, how do stability and change characterize the lived experience of trainees through time?

METHOD

From 2010 to 2019, the authors conducted in-depth interviews every 6 to 12 months with 6 trainees, using reflective prompts about formative events and prior interviews. Data were inductively coded and analyzed in an iterative fashion. By scrutinizing data via time-ordered displays of codes, the authors identified 3 patterns of stability and change, particularly related to constructing careers in medicine. The study originated at a private medical school in New York, New York.

RESULTS

Patterns in the balance between stability and change were shaped by trainees' career interests. Trainees motivated by stable clinical interests perceived their journey as a "series of stepping-stones." Trainees motivated by evolving clinical interests described disruptive change or "upsets"; however, they were still accommodated by medical education. In contrast, trainees motivated by stable nonclinical (i.e., social science) interests perceived their journey as a "struggle" in residency because of the clinically heavy nature of that phase of training.

CONCLUSIONS

Based on this descriptive, 9-year study of a small number of trainees, medical education seems to accommodate trainees whose journeys are motivated by clinical interests, even if those clinical interests change through time. Medical education could consider alternatives to time-bound frames of reference and focus on the right time for trainees to integrate clinical and social sciences in medical training.

Facilitators and Inhibitors to Assessing Entrustable Professional Activities in Pediatric Residency

OBJECTIVE

Research on entrustable professional activities (EPAs) has focused on EPA development with little attention paid to implementation experiences. This constructivist grounded theory study sought to begin filling this gap by exploring the experiences of pediatric residency programs with implementing EPA-based assessment.

METHODS

Interviews with 19 program leader and clinical competency committee participants from 13 sites were held between January and July 2019. Participants were asked about their experiences with implementing EPA-based assessment. Data collection and analysis were iterative.

RESULTS

Participants described a range of facilitators and inhibitors that influenced their efforts to implement EPA-based assessment. These fell into 4 thematic areas: 1) alignment of EPA construct with local views of performance and assessment, 2) assessing EPAs illuminates holes in the residency curriculum, 3) clinical competency committee structure and process impacts EPA-based assessment, and 4) faculty engagement and development drives ability to assess EPAs. Areas described as facilitators by some participants were noted to be inhibitors for others. The sum of a program's facilitators and inhibitors led to more or less ability to assess EPAs on the whole. Finally, the first area functions differently from the others; it can shift the entire balance toward or away from the ability to assess EPAs overall.

CONCLUSION

This study helps fill a void in implementation evidence for EPA-based assessment through better understanding of facilitators and inhibitors to such efforts.

Creating a "Culture of Triage": A Dual-Perspective Study of Interruptions During ICU Rounds

OBJECTIVES

To explore interrupters' and interruptees' experiences of interruptions occurring during morning rounds in a PICU in an attempt to understand better how to limit interruptions that threaten patient safety.

DESIGN

Qualitative ethnographic study including observations, field interviews, and in-depth interviews.

SETTING

A 55-bed PICU in a free-standing, quaternary-care children's hospital.

SUBJECTS PARTICIPANTS

Attending physicians, fellow physicians, frontline clinicians (resident physicians and nurse practitioners), and nurses working in the PICU.

INTERVENTIONS

Data collection occurred in two parts: 1) field observations during morning rounds with brief field interviews conducted with participants involved in an observed interruption and 2) in-depth interviews conducted with selected participants from prior field observations.

MEASUREMENTS AND MAIN RESULTS

Data were coded using a constant comparative method with thematic analysis, clustering codes into groups, and subsequently into themes. We observed 11 rounding encounters (17 hr of observation and 48 patient encounters), conducting 25 field interviews and eight in-depth interviews. Themes included culture of interruption triage, interruption triage criteria, and barriers to interruption triage. Interruptees desired forming a culture of triage, whereby less-urgent interruptions were deferred until later or addressed through an asynchronous method; this desire was misaligned with interrupters who described ongoing interruption triage based on clinical changes, time-sensitivity, and interrupter comfort, despite not having a formal triage algorithm. Barriers to interruption triage included a lack of situational awareness and experience among interrupters and interruptees.

CONCLUSIONS

Interrupters and interruptees did not have a shared understanding of the culture of triage within the PICU. Although interrupters attempted to triage interruptions, no formal triage algorithm existed and interruptees did not perceive a triaging culture. Using data from this study, we created a triage algorithm that could inform future studies, potentially decrease unnecessary interruptions, and optimize information sharing for essential interruptions.

How Full Is Your Tank? A Qualitative Exploration of Faculty Volunteerism in a National Professional Development Program

OBJECTIVE

Professional development programs (PDPs) within academic professional organizations rely on faculty volunteers, but little is known about the volunteering process and experience. Our aim was to gain insights into the initial decision to volunteer, the experience of volunteering and the decision to re-volunteer or not (ie, remain or leave as a volunteer). The study setting was a PDP of the Academic Pediatric Association, the Educational Scholars Program.

METHODS

In 2014, 13 Educational Scholars Program faculty members participated in semistructured phone interviews. The authors performed a general inductive analysis of the data, inductively created codes, and analyzed coded data for emergent themes that led to the creation of a model for recruiting and sustaining volunteers.

RESULTS

Four themes related to the initial volunteer decision and the decision to re-volunteer or not (self-interest and altruism, reputation of the program, relevant skill set, and doability), and 4 themes related to the experience of volunteering (emotional impact, career advancement and professional recognition, professional growth, and doability) emerged. The relationship among the themes led to the creation of a model of volunteering, involving a metaphorical volunteerism "tank" that is full when faculty initially volunteer and subsequently fills or empties as a result of dynamic interplay between the themes for each individual.

CONCLUSIONS

Leaders of PDPs may find our model of volunteering beneficial for enhancing the emotional and tangible benefits and minimizing the logistical issues of volunteering. This information should contribute to success in recruiting and retaining the volunteers who are essential for developing and sustaining PDPs.

Scholarly Evaluation of Curricula and Educational Programs: Using a Systematic Approach to Produce Publishable Scholarship

The goal of designing innovative curricula and programs in medical education is to create interventions that will change the attitudes, knowledge, skills, and behaviors of learners in order to prepare them to contribute to the health of patients and communities they serve. Systematic evaluation allows curriculum/program developers to optimize their curriculum/program and ensure that the goals of the curriculum/program are met. While curriculum/program evaluation is distinct from educational research, when approached in a rigorous manner, curriculum/program evaluation can be published as educational scholarship. The goal of our paper is to equip readers with tools to apply a scholarly approach to curriculum/program evaluation to produce findings that will advance the field. We start by defining curricula, educational programs, learner assessment, and evaluation. We then briefly describe examples of best practice models for curriculum/program development that incorporate the critical step of planning for evaluation. Building on published work, we distinguish the use of best practice models and conceptual frameworks to inform curriculum/program development and evaluation. More specifically, we outline steps to plan an evaluation that demonstrates WHAT was effective, describes HOW the curriculum/program contributed to the outcomes achieved, and points to WHY the curriculum/program led to the outcomes observed. We conclude with key considerations for publishing findings of an evaluation, including what to include in each section of a manuscript.

Shared Mental Models Among Clinical Competency Committees in the Context of Time-Variable, Competency-Based Advancement to Residency

PURPOSE

To evaluate response process validity evidence for clinical competency committee (CCC) assessments of first-year residents on a subset of General Pediatrics Entrustable Professional Activities (EPAs) and milestones in the context of a national pilot of competency-based, time-variable (CBTV) advancement from undergraduate to graduate medical education.

METHOD

Assessments of 2 EPAs and 8 milestones made by the trainees' actual CCCs and 2 different blinded "virtual" CCCs for 48 first-year pediatrics residents at 4 residency programs between 2016 and 2018 were compared. Residents had 3 different training paths from medical school to residency: time-variable graduation at the same institution as their residency, time-fixed graduation at the same institution, or time-fixed graduation from a different institution. Assessments were compared using ordinal mixed-effects models.

RESULTS

Actual CCCs assigned residents higher scores than virtual CCCs on milestones and one EPA's supervision levels. Residents who graduated from a different institution than their residency received lower milestone ratings than either group from the same institution; CBTV residents received higher ratings on one milestone (ICS4) and similar ratings on all others compared with non-CBTV residents who completed medical school at the same institution.

CONCLUSIONS

First-year residents who graduated from CBTV medical school programs were assessed as having the same level of competence as residents who graduated from traditional medical school programs, but response process evidence suggests that members of CCCs may also draw on undocumented personal knowledge of the learner to draw conclusions about resident competence.

Applying the Theory of Gendered Organizations to the Lived Experience of Women with Established Careers in Academic Medicine

Phenomenon: The number of women who enter medical school has been on par with the number of men for almost 20 years, but parity in training has not translated to equity in professional life. To capitalize on the perspective of women faculty with established careers in academic medicine and to bring theory to the largely descriptive research on gender inequity in academic medicine, the authors used the Theory of Gendered Organizations to demonstrate how academic medical centers function as inherently gendered organizations. Approach: The authors recruited women faculty with established careers at one academic medical center based on purposeful and snowball sampling and interviewed 30 participants in Summer/Fall 2018. They coded and analyzed data inductively. In later stages of analysis they used sensitizing concepts from the Theory of Gendered Organizations to guide our focus on formal expectations of, and informal interactions in, the academic medical center. Findings: The disjuncture, i.e., "lip service", between formal expectations intended to be gender-neutral and informal interactions that advantaged men demonstrated how the academic medical center functioned as a gendered organization. Participants experienced these interactions as being treated differently than men and/or being stereotyped. As their careers progressed, participants recognized gender inequity as embedded in the organization, or as they said, "the way things were stacked". Subsequent to this recognition, they navigated this gendered organization by advocating for themselves and younger women faculty. Insights: Women with established careers in academic medicine experienced gender inequity as embedded in the organization but navigate gendered interactions by advocating for themselves and for younger women. Using the Theory of Gendered Organizations as an analytic lens demonstrates how academic medical centers function as gendered organizations; these findings can inform both theory-based research and pragmatic change strategies.

Focal Length Fluidity: Research Questions in Medical Education Research and Scholarship

Research and scholarship in health professions education has been shaped by intended audience (i.e., producers vs users) and the purpose of research questions (i.e., curiosity driven or service oriented), but these archetypal dichotomies do not represent the breadth of scholarship in the field. Akin to an array of lenses required by scientists to capture images of a black hole, the authors propose the analogy of lenses with different focal lengths to consider how different kinds of research questions can offer insight into health professions research-a microscope, a magnifying glass, binoculars, and telescopes allow us to ask and answer different kinds of research questions. They argue for the relevance of all of the different kinds of research questions (or focal lengths); each provides important insight into a particular phenomenon and contributes to understanding that phenomenon in a different way. The authors propose that research questions can move fluidly across focal lengths. For example, a theoretical question can be made more pragmatic through asking "how" questions ("How can we observe and measure a phenomenon?"), whereas a pragmatic question can be made more theoretic by asking a series of "why" questions ("Why are these findings relevant to larger issues?"). In summary, only through the combination of lenses with different focal lengths, brought to bear through interdisciplinary work, can we fully comprehend important phenomena in health professions education and scholarship-the same way scientists managed to image a black hole.

A Pediatric Preintern Boot Camp: Program Development and Evaluation Informed by a Conceptual Framework

OBJECTIVE

Boot camps are being developed and implemented by a growing number of medical schools to facilitate medical students' transition to internship. However, there is limited conceptual understanding of how this facilitation occurs.

METHODS

We developed and piloted a 1-week pediatric boot camp in 2015, then significantly revised and evaluated the program in 2016-2017 using a conceptual framework of self-efficacy. Consistent with this framework, the revised boot camp focuses on enhancing practical skills that can ease medical students' transition to internship. Observations and course evaluations informed process evaluation, whereas learner assessments immediately after and at 6 months after the boot camp informed outcomes evaluation in terms of both perceived self-efficacy and confidence.

RESULTS

Medical students valued sessions that were "hands on," and program improvements were made to include a variety of interactive curricular activities. Data from course evaluations provided evidence of increased perceived self-efficacy. Learner assessment showed a medium to large effect size for confidence in nearly all specific skills that were queried and a positive, albeit attenuated, effect on perceived self-efficacy at 6 months.

CONCLUSIONS

Program evaluation of a pediatric boot camp informed by a conceptual framework of self-efficacy shed light on how it might facilitate medical students' transition to internship. A similar conceptual framework may be useful for other trainee preparatory courses.

How Mentor Identity Evolves: Findings From a 10-Year Follow-up Study of a National Professional Development Program

PURPOSE

Despite academic medicine's endorsement of professional development and mentoring, little is known about what junior faculty learn about mentoring in implicit curricula of professional development programs, and how their mentor identity evolves in this context. The authors explored what faculty-participants in the Educational Scholars Program implicitly learned about mentoring and how the implicit curriculum affected mentor identity transformation.

METHOD

Semistructured interviews with 19 of 36 former faculty-participants were conducted in 2016. Consistent with constructivist grounded theory, data collection and analysis overlapped. The authors created initial codes informed by Ibarra's model for identity transformation, iteratively revised codes based on incoming data patterns, and created visual representations of relationships amongst codes to gain a holistic, shared understanding of the data.

RESULTS

In the implicit curriculum, faculty-participants learned the importance of having multiple mentors, the value of peer mentors, and the incremental process of becoming a mentor. The authors used Ibarra's model to understand how the implicit curriculum worked to transform mentor identity: Faculty-participants reported observing mentors, experimenting with different ways to mentor and to be a mentor, and evaluating themselves as mentors.

CONCLUSIONS

The Educational Scholars Program's implicit curriculum facilitated faculty-participants taking on mentor identity via opportunities it afforded to watch mentors, experiment with mentoring, and evaluate self as mentor, key ingredients for identity construction. Leaders of professional development programs can develop faculty as mentors by capitalizing on what faculty-participants learn in the implicit curriculum and deliberately structuring postgraduation mentoring opportunities.

Looking Back to Move Forward: First-Year Medical Students' Meta-Reflections on Their Narrative Portfolio Writings

The day-to-day rigors of medical education often preclude learners from gaining a longitudinal perspective on who they are becoming. Furthermore, the current focus on competencies, coupled with concerning rates of trainee burnout and a decline in empathy, have fueled the search for pedagogic tools to foster students' reflective capacity. In response, many scholars have looked to the tradition of narrative medicine to foster "reflective spaces" wherein holistic professional identity construction can be supported. This article focuses on the rationale, content, and early analysis of the reflective space created by the narrative medicine-centered portfolio at the Columbia University Vagelos College of Physicians and Surgeons. In January 2015, the authors investigated learning outcomes derived from students' "Signature Reflections," end-of-semester meta-reflections on their previous portfolio work. The authors analyzed the Signature Reflections of 97 (of 132) first-year medical students using a constant comparative process. This iterative approach allowed researchers to identify themes within students' writings and interpret the data. The authors identified two overarching interpretive themes-recognition and grappling-and six subthemes. Recognition included comments about self-awareness and empathy. Grappling encompassed the subthemes of internal change, dichotomies, wonder and questioning, and anxiety. Based on the authors' analyses, the Signature Reflection seems to provide a structured framework that encourages students' reflective capacity and the construction of holistic professional identity. Other medical educators may adopt meta-reflection, within the reflective space of a writing portfolio, to encourage students' acquisition of a longitudinal perspective on who they are becoming and how they are constructing their professional identity.

Positive Change in Feedback Perceptions and Behavior: A 10-Year Follow-up Study

BACKGROUND

Providing and learning from feedback are essential components of medical education, and typically described as resistant to change. But given a decade of change in the clinical context in which feedback occurs, the authors asked if, and how, perceptions of feedback and feedback behaviors might have changed in response to contextual affordances.

METHODS

In 2017, the authors conducted a follow-up, ethnographic study on 2 general pediatric floors at the same children's hospital where another ethnographic study on a general pediatric floor was conducted in 2007. Data sources included (1) 21 and 34 hours of observation in 2007 and 2017, respectively, (2) 35 and 25 interviews with general pediatric attending physicians and residents in 2007 and 2017, respectively, and (3) a review of 120 program documents spanning 2007 to 2017. Data were coded and organized around 3 recommendations for feedback that were derived from 2007 data and served as standards for assessing change in 2017.

RESULTS

Data revealed progress in achieving each recommendation. Compared with 2007, participants in 2017 more clearly distinguished between feedback and evaluation; residents were more aware of in-the-moment feedback, and they had shifted their orientation from evaluation and grades to feedback and learning. Explanations for progress in achieving recommendations, which were derived from the data, pointed to institutional and national influences, namely, the pediatric milestones.

CONCLUSIONS

On the basis of follow-up, ethnographic data, changes in the clinical context of pediatric education may afford positive change in perceptions of feedback and feedback behavior and point to influences within and beyond the institution.

Longitudinal qualitative research in medical education

None

Impact of Explicit, Implicit, and Extra Curricula on Students’ Learning of the History and Physical Examination

This article was migrated. The article was not marked as recommended. Purpose : History taking and physical examination (H&P) in a patient-centered manner is central to the practice of medicine. This qualitative case study explored the relative influences of explicit, implicit, and extra curricula on medical students' learning of the H&P. Methods : The authors conducted semi-structured interviews with 15 fourth-year medical students at Columbia University from September 2015 to January 2016. The authors coded interview transcripts in an iterative process, and clustered coded data into emerging themes to elucidate how curricula shaped students' learning of the H&P. Results : Students perceived misalignment between curricula, with two predominant patterns: lesser emphasis on patient-centered H&P and greater emphasis on hypothesis-driven H&P in implicit versus explicit curricula. Role models, patient interactions, and clinical context were important influences on students' learning of patient-centered H&P. Ward rounds, role models, and feedback were particularly impactful for students' learning of hypothesis-driven H&P. Students reported minimal learning from the extra curriculum. Conclusions : Medical students perceived a misalignment in learning the H&P between the explicit and implicit curricula, with the former being primarily where students developed patient-centeredness in conducting H&Ps and the latter being where students learned to conduct hypothesis-driven H&P. Efforts to align curricula could strengthen H&P training.

Understanding the relation between medical students' collective and individual trajectories: an application of habitus

INTRODUCTION

While medical educators typically attend to group trends, groups are made up of unique individuals. An exploration of Bourdieu's concept of habitus, defined as a system of dispositions, may help medical educators think relationally about the collective trajectory of the group and the individual trajectory of each student.

METHODS

We built on our 4‑year, longitudinal study which reported how field, capital, and habitus worked together to explain how medical students, as a group, navigated transitions in undergraduate medical education. In this secondary analysis, we reviewed serial collections of narratives about students' peak learning experiences in medical school (19 students, 5 narratives per student), concentrating on first-person representations of self. We then explored the relation between collective and individual trajectories in three illustrative cases.

RESULTS

The social space of undergraduate medical education harmonized students' experience and helped explain the collective trajectory, as evidenced by students' consistent reports of taking initiative and staying open-minded. But individuals were not totally harmonized. They had unique dispositions that influenced their ability to access valued resources and shaped their behaviour. For example, Emily consistently spoke of being driven by her own goals; Zach focused on meeting expectations of authorities; Hilary routinely oriented toward abstract medical knowledge.

DISCUSSION

Habitus provides a useful conceptual lens for thinking relationally about collective and individual trajectories of medical students. Our work may inform faculty as they seek to situate individualized learning within standardized curricula, and is a step toward researching transitions in medical training from a holistic perspective that includes, but is not limited to, individual trajectories.

Caring to Care: Applying Noddings' Philosophy to Medical Education

The authors argue that Nel Noddings' philosophy, "an ethic of caring," may illuminate how students learn to be caring physicians from their experience of being in a caring, reciprocal relationship with teaching faculty. In her philosophy, Noddings acknowledges two important contextual continuities: duration and space, which the authors speculate exist within longitudinal integrated clerkships. In this Perspective, the authors highlight core features of Noddings' philosophy and explore its applicability to medical education. They apply Noddings' philosophy to a subset of data from a previously published longitudinal case study to explore its "goodness of fit" with the experience of eight students in the 2012 cohort of the Columbia-Bassett longitudinal integrated clerkship. In line with Noddings' philosophy, the authors' supplementary analysis suggests that students (1) recognized caring when they talked about "being known" by teaching faculty who "cared for" and "trusted" them; (2) responded to caring by demonstrating enthusiasm, action, and responsibility toward patients; and (3) acknowledged that duration and space facilitated caring relations with teaching faculty. The authors discuss how Noddings' philosophy provides a useful conceptual framework to apply to medical education design and to future research on caring-oriented clinical training, such as longitudinal integrated clerkships.

Professional Formation in the Gross Anatomy Lab and Narrative Medicine: An Exploration

As an early and important experience in medical education, dissection in the gross anatomy lab is a locus of professional formation. Because students often think of their professional development in evolving, narrative terms, the authors propose that close attention to these narratives might add to understanding of professional formation in progress. They solicited written reflections from students, to explore ways that both the content and form of written reflections might illuminate themes relevant to professional formation, and to describe some elements of professional formation in the context of one institution (Baylor College of Medicine, Houston, Texas). Seventeen students participated in writing sessions and wrote in response to an oral interview transcript and to a poem. Using a reading approach that grew out of the narrative medicine movement, the authors collaboratively engaged the content and form of these written reflections.Students' collection of written reflections was a rich source of information about their experiences in the anatomy lab. Through both content (e.g., expressions of gratitude, transitions, self-awareness) and form (e.g., from less detailed writing to literary playfulness), their writings gave a glimpse into the tensions, disappointments, and satisfactions of the practice of gross anatomy.This project models one way that educators can read and respond to the reflective writing that students generate. The authors go on to propose ways that interactions around reflective writing can be part of a broader goal of forming narrative-minded physicians, who become increasingly self- and other-aware as they progress in their education and practice.