Educating for adaptive expertise: case examples along the medical education continuum

Error Management Training and Adaptive Expertise in Learning Computed Tomography Interpretation: A Randomized Clinical Trial

Importance

Adaptive expertise helps physicians apply their skills to novel clinical cases and reduce preventable errors. Error management training (EMT) has been shown to improve adaptive expertise with procedural skills; however, its application to cognitive skills in medical education is unclear.

Objective

To evaluate whether EMT improves adaptive expertise when learning the cognitive skill of head computed tomography (CT) interpretation.

Design, Setting, and Participants

This 3-arm randomized clinical trial was conducted from July 8, 2022, to March 30, 2023, in 7 geographically diverse emergency medicine residency programs. Participants were postgraduate year 1 through 4 emergency medicine residents masked to the hypothesis.

Interventions

Participants were randomized 1:1:1 to a difficult EMT, easy EMT, or error avoidance training (EAT) control learning strategy for completing an online head CT curriculum. Both EMT cohorts received no didactic instruction before scrolling through head CT cases, whereas the EAT group did. The difficult EMT cohort answered difficult questions about the teaching cases, leading to errors, whereas the easy EMT cohort answered easy questions, leading to fewer errors. All 3 cohorts used the same cases.

Main Outcomes and Measures

The primary outcome was a difference in adaptive expertise among the 3 cohorts, as measured using a head CT posttest. Secondary outcomes were (1) differences in routine expertise, (2) whether the quantity of errors during training mediated differences in adaptive expertise, and (3) the interaction between prior residency training and the learning strategies.

Results

Among 212 randomized participants (mean [SD] age, 28.8 [2.0] years; 107 men [50.5%]), 70 were allocated to the difficult EMT, 71 to the easy EMT, and 71 to the EAT control cohorts; 150 participants (70.8%) completed the posttest. The difficult EMT cohort outperformed both the easy EMT and EAT cohorts on adaptive expertise cases (60.6% [95% CI, 56.1%-65.1%] vs 45.2% [95% CI, 39.9%-50.6%], vs 40.9% [95% CI, 36.0%-45.7%], respectively; P < .001), with a large effect size (η2 = 0.19). There was no significant difference in routine expertise. The difficult EMT cohort made more errors during training than the easy EMT cohort. Mediation analysis showed that the number of errors during training explained 87.2% of the difficult EMT learning strategy's effect on improving adaptive expertise (P = .01). The difficult EMT learning strategy was more effective in improving adaptive expertise for residents earlier in training, with a large effect size (η2 = 0.25; P = .002).

Conclusions and Relevance

In this randomized clinical trial, the findings show that EMT is an effective method to develop physicians' adaptive expertise with cognitive skills.

Trial Registration

ClinicalTrials.gov Identifier: NCT05284838.

The case for metacognitive reflection: a theory integrative review with implications for medical education

The concepts of metacognitive reflection, reflection, and metacognition are distinct but have undergone shifts in meaning as they migrated into medical education. Conceptual clarity is essential to the construction of the knowledge base of medical education and its educational interventions. We conducted a theoretical integrative review across diverse bodies of literature with the goal of understanding what metacognitive reflection is. We searched PubMed, Embase, CINAHL, PsychInfo, and Web of Science databases, including all peer-reviewed research articles and theoretical papers as well as book chapters that addressed the topic, with no limitations for date, language, or location. A total of 733 articles were identified and 87 were chosen after careful review and application of exclusion criteria. The work of conceptually and empirically delineating metacognitive reflection has begun. Contributions have been made to root metacognitive reflection in the concept of metacognition and moving beyond it to engage in cycles of reflection. Other work has underscored its affective component, transformational nature, and contextual factors. Despite this merging of threads to develop a richer conceptualization, a theory of how metacognitive reflection works is elusive. Debates address whether metacognition drives reflection or vice versa. It has also been suggested that learners evolve along on a continuum from thinking, to task-related reflection, to self-reflection, and finally to metacognitive reflection. Based on prior theory and research, as well as the findings of this review, we propose the following conceptualization: Metacognitive reflection involves heightened internal observation, awareness, monitoring, and regulation of our own knowledge, experiences, and emotions by questioning and examining cognition and emotional processes to continually refine and enhance our perspectives and decisions while thoughtfully accounting for context. We argue that metacognitive reflection brings a shift in perspective and can support valuable reconceptualization for lifelong learning.

'It's more like checking in with an old friend': A qualitative study of medical students' experiences with longitudinal coaches throughout medical school

PURPOSE

Coaching in medical education facilitates learners' growth and development through feedback, goal-setting and support. This study explored how coaching relationships evolve throughout medical school and the impact of longitudinal coaching relationships on medical students' approach to feedback and goal setting in the clinical years.

METHOD

In this qualitative study using a constructivist paradigm, authors purposively sampled 15 senior medical students at University of California, San Francisco, to participate in individual semi-structured interviews (October-November 2021). The authors used an inductive approach to thematic analysis.

RESULTS

The authors identified four themes: First, the student-coach relationship deepened over the course of medical school. Second, students identified factors that sustained and strengthened the student-coach relationship over time: a strong foundation to the relationship, the non-evaluative nature of the relationship, coach supportiveness and responsiveness, and coach knowledge of the institutional landscape. Third, coaches provided individualized advice, assessed trajectory, and guided feedback interpretation. Lastly, students applied skills of soliciting and responding to feedback and creating learning goals, originally learned through coaching experience.

CONCLUSIONS

Coaching relationships, grounded in trust, evolve to meet students' changing needs as they grow into physicians. Students apply feedback and goal-setting skills learned with the coach in clinical settings with other supervisors.

Short-Term Training with Basic Science Research Literature Advances Medical Students' Skills for Adaptive Expertise

Physicians must adapt their learning and expertise to the rapid evolution of healthcare. To train for the innovation-efficient demands of adaptive expertise, medical students need to acquire the skill of adaptive self-regulated learning, which includes accessing, interpreting, and synthesizing emerging basic and translational research to support patient care. In response, we developed the course Medical Student Grand Rounds (MSGR). It engages all pre-clerkship students at our institution with self-regulated learning from translational basic research literature. In this report, we describe MSGR's methodology and important outcomes. Students found, interpreted, critically assessed, and presented basic research literature about self-selected clinically relevant topics. In less than one semester and mentored by basic science researchers, they completed eight milestones: (a) search research literature databases; (b) choose a clinical topic using searching skills; (c) outline the topic's background; (d) outline a presentation based on the topic's mechanistic research literature; (e) attend translational research-oriented grand rounds by faculty; (f) learn to prepare oral presentations; (g) write an abstract; and (h) present at Grand Rounds Day, emphasizing their topic's research literature. Graded milestones and end-of-course self-assessments indicated students became proficient in interpreting research articles, preparing and delivering presentations, understanding links among basic and translational research and clinical applications, and pursuing self-regulated learning. Qualitative analysis of self-assessment surveys found most students thought they progressed toward the learning objectives: find scientific information about a research topic (56% positive responses), interpret and critically assess scientific information (64%), and prepare and deliver a scientific presentation (50%). Milestones improve time management and provide a scaffolded method for presenting focused research topics. MSGR equips students with critical thinking skills for lifelong, adaptive, self-regulated learning-a foundation for adaptive expertise. The master adaptive learner cycle of planning, learning, assessing, and adjusting is a conceptual framework for understanding students' MSGR learning experiences.

Powerful medical education improves health care quality and return on investment

INTRODUCTION

Powerful medical education (PME) involves the use of new technologies informed by the science of expertise that are embedded in laboratories and organizations that value evidence-based education and support innovation. This contrasts with traditional medical education that relies on a dated apprenticeship model that yields uneven results. PME involves an amalgam of features, conditions and assumptions, and contextual variables that comprise an approach to developing clinical competence grounded in education impact metrics including efficiency and cost-effectiveness.

METHODS

This article is a narrative review based on SANRA criteria and informed by realist review principles. The review addresses the PME model with an emphasis on mastery learning and deliberate practice principles drawn from the new science of expertise. Pub Med, Scopus, and Web of Science search terms include medical education, the science of expertise, mastery learning, translational outcomes, cost effectiveness, and return on investment. Literature coverage is comprehensive with selective citations.

RESULTS

PME is described as an integrated set of twelve features embedded in a group of seven conditions and assumptions and four context variables. PME is illustrated via case examples that demonstrate improved ventilator patient management learning outcomes compared to traditional clinical education and mastery learning of breaking bad news communication skills. Evidence also shows that PME of physicians and other health care providers can have translational, downstream effects on patient care practices, patient outcomes, and return on investment. Several translational health care quality improvements that derive from PME include reduced infections; better communication among physicians, patients, and families; exceptional birth outcomes; more effective patient education; and return on investment.

CONCLUSIONS

The article concludes with challenges to hospitals, health systems, and medical education organizations that are responsible for producing physicians who are expected to deliver safe, effective, and cost-conscious health care.

Errors in clinical diagnosis: a narrative review

Diagnostic errors are often caused by cognitive biases and sometimes by other cognitive errors, which are driven by factors specific to clinicians, patients, diseases, and health care systems. An experienced clinician diagnoses routine cases intuitively, effortlessly, and automatically through non-analytic reasoning and uses deliberate, cognitively effortful analytic reasoning to diagnose atypical or complicated clinical cases. However, diagnostic errors can never be completely avoided. To minimize the frequency of diagnostic errors, it is advisable to rely on multiple sources of information including the clinician's personal experience, expert opinion, principals of statistics, evidence-based data, and well-designed algorithms and guidelines, if available. It is also important to frequently engage in thoughtful, reflective, and metacognitive practices that can serve to strengthen the clinician's diagnostic skills, with a consequent reduction in the risk of diagnostic error. The purpose of this narrative review was to highlight certain factors that influence the genesis of diagnostic errors. Understanding the dynamic, adaptive, and complex interactions among these factors may assist clinicians, managers of health care systems, and public health policy makers in formulating strategies and guidelines aimed at reducing the incidence and prevalence of the phenomenon of clinical diagnostic error, which poses a public health hazard.

Adaptive Expertise in Undergraduate Pharmacy Education

Pharmacy educators are grappling with concerns around curriculum overload and core pharmacist competencies in a rapidly changing and increasingly complex healthcare landscape. Adaptive expertise provides a conceptual framework to guide educators as they design instructional activities that can support students on their journey towards becoming pharmacists who can perform procedural tasks efficiently, as well as creatively handle new and difficult-to-anticipate problems that arise regularly in pharmacy practice. This article explores undergraduate pharmacy education through a cognitive psychology lens and foregrounds three instructional design strategies which support the development of adaptive expertise: (1) cognitive integration, (2) productive failure, and (3) inventing with contrasting cases. These three evidence-based strategies cultivate long-term learning and provide a practical mechanism to combat curriculum overload and backwards-facing assessments. Pharmacy education can encourage the development of procedural and conceptual knowledge and position pharmacy students to excel as they move into more complicated and ambiguous roles in our healthcare system.

The imperative for (and opportunities of) research on adaptive expertise in health professions education

In this editorial, three Advances in Health Sciences Education editors argue for the importance and impact of adaptive expertise on the future of health professions education and work. They present a sample of the broad range of theory-informed research currently contributing to understanding and applying adaptive expertise in health professions education. They reflect on the unique opportunities that interdisciplinarity offers this endeavour. Finally they offer potential ways forward for continued efforts to advance collective understanding of education, expert development and health professions practice.