Learning to balance efficiency and innovation for optimal adaptive expertise

Distributed cognition: Theoretical insights and practical applications to health professions education: AMEE Guide No. 159

Distributed cognition (DCog) is a member of the family of situativity theories that widens the lens of cognition from occurring solely inside the head to being socially, materially and temporally distributed within a dynamic system. The concept of extending the view of cognition to outside the head of a single health professional is relatively new in the healthcare system. DCog has been increasingly used by researchers to describe many ways in which health professionals perform in teams within structured clinical environments to deliver healthcare for patients. In this Guide, we expound ten central tenets of the macro (grand) theory of DCog (1. Cognition is decentralized in a system; 2. The unit of analysis is the system; 3. Cognitive processes are distributed; 4. Cognitive processes emerge from interactions; 5. Cognitive processes are interdependent; 6. Social organization is a cognitive architecture; 7. Division of labour; 8. Social organization is a system of communication; 9. Buffering and filtering; 10. Cognitive processes are encultured) to provide theoretical insights as well as practical applications to the field of health professions education.

Looking beyond the COVID-19 pandemic: the recalibration of student-teacher relationships in teaching and learning process

BACKGROUND

Given the various novel educational approaches and online interactions following the pandemic, it is timely to identify lessons learned for post-pandemic student and teacher relationships within the 'new normal' teaching learning processes. This study aims to explore the dynamics and to what extent the disruption influences student-teacher relationships in teaching and learning process following the COVID-19 pandemic.

MATERIALS AND METHODS

A qualitative descriptive approach was employed to explore individual reflections and perspectives from 28 medical teachers and 35 medical students from different institutions who participated in 10 focus groups. Data were analyzed thematically using steps for coding and theorization (SCAT) approach. The emerging themes were then further analyzed and regrouped into the relationship-centered leadership framework based on emotional intelligence.

RESULTS

The identified themes described three elements representing student-teacher relationships in the teaching learning processes. The self as the center of the diagram consists of the co-existing role of the self as teachers and as students, which to some extent, is related to their personal and professional development, motivation, and struggles to maintain work-life balance. The middle layer represents the dynamic of student-teacher relationship, which showed that despite the increased number of teaching opportunities, the trust among teachers and students was compromised. These changes in the self and the dynamic relationship occurred in a broader and more complex medical education system, pictured as the outer layer. Thorough curriculum improvements, contents, and new skills were emphasized.

CONCLUSIONS

Our findings emphasized the need to recalibrate student-teacher relationships, taking into account the intrapersonal, interpersonal, and the system factors. The pandemic has reemphasized the aim of teachers' roles, not only to nurture students' competencies, but also to nurture meaningful interpersonal reciprocal relationships through responding towards both teachers' and students' needs as well as supporting both personal and professional development.

Fostering Adaptive Expertise Through Simulation

Technology-enhanced simulation has been used to tackle myriad challenges within health professions education. Recently, work has typically adopted a mastery learning orientation that emphasizes trainees' sequential mastery of increasingly complex material. Doing so has privileged a focus on performance and task completion, as captured by trainees' observable behaviors and actions. Designing simulation in these ways has provided important advances to education, clinical care, and patient safety, yet also placed constraints around how simulation-based activities were enacted and learning outcomes were measured. In tracing the contemporary manifestations of simulation in health professions education, this article highlights several unintended consequences of this performance orientation and draws from principles of adaptive expertise to suggest new directions. Instructional approaches grounded in adaptive expertise in other contexts suggest that uncertainty, struggle, invention, and even failure help learners to develop deeper conceptual understanding and learn innovative approaches to novel problems. Adaptive expertise provides a new lens for simulation designers to think intentionally around how idiosyncrasy, individuality, and inventiveness could be enacted as central design principles, providing learners with opportunities to practice and receive feedback around the kinds of complex problems they are likely to encounter in practice. Fostering the growth of adaptive expertise through simulation will require a fundamental reimagining of the design of simulation scenarios, embracing the power of uncertainty and ill-defined problem spaces, and focusing on the structure and pedagogical stance of debriefing. Such an approach may reveal untapped potential within health care simulation.

Preparing future physicians for complexity: a post-graduate elective in HIV psychiatry

BACKGROUND

Patients with complex care needs have multiple concurrent conditions (medical, psychiatric, social vulnerability or functional impairment), interfering with achieving desired health outcomes. Their care often requires coordination and integration of services across hospital and community settings. Physicians feel ill-equipped and unsupported to navigate uncertainty and ambiguity caused by multiple problems. A HIV Psychiatry resident elective was designed to support acquisition of integrated competencies to navigate uncertainty and disjointed systems of care - necessary for complex patient care.

METHODS

Through qualitative thematic analysis of pre- and post-interviews with 12 participants - residents and clinic staff - from December 2019 to September 2022, we explored experiences of this elective.

RESULTS

This educational experience helped trainees expand their understanding of what makes patients complex. Teachers and trainees emphasize the importance of an approach to "not knowing" and utilizing integrative competencies for navigating uncertainty. Through perspective exchange and collaboration, trainees showed evidence of adaptive expertise: the ability to improvise while drawing on past knowledge.

CONCLUSIONS

Postgraduate training experiences should be designed to facilitate skills for caring for complex patients. These skills help residents fill in practice gaps, improvise when standardization fails, and develop adaptive expertise. Going forward, findings will be used to inform this ongoing elective.

Frameworks for Integrating Learning Analytics With the Electronic Health Record

The information systems designed to support clinical care have evolved separately from those that support health professions education. This has resulted in a considerable digital divide between patient care and education, one that poorly serves practitioners and organizations, even as learning becomes ever more important to both. In this perspective, we advocate for the enhancement of existing health information systems so that they intentionally facilitate learning. We describe three well-regarded frameworks for learning that can point toward how health care information systems can best evolve to support learning. The Master Adaptive Learner model suggests ways that the individual practitioner can best organize their activities to ensure continual self-improvement. The PDSA cycle similarly proposes actions for improvement but at a health care organization's workflow level. Senge's Five Disciplines of the Learning Organization, a more general framework from the business literature, serves to further inform how disparate information and knowledge flows can be managed for continual improvement. Our main thesis holds that these types of learning frameworks should inform the design and integration of information systems serving the health professions. An underutilized mediator of educational improvement is the ubiquitous electronic health record. The authors list learning analytic opportunities, including potential modifications of learning management systems and the electronic health record, that would enhance health professions education and support the shared goal of delivering high-quality evidence-based health care.

Educating for adaptive expertise: case examples along the medical education continuum

Adaptive expertise represents the combination of both efficient problem-solving for clinical encounters with known solutions, as well as the ability to learn and innovate when faced with a novel challenge. Fostering adaptive expertise requires careful approaches to instructional design to emphasize deeper, more effortful learning. These teaching strategies are time-intensive, effortful, and challenging to implement in health professions education curricula. The authors are educators whose missions encompass the medical education continuum, from undergraduate through to organizational learning. Each has grappled with how to promote adaptive expertise development in their context. They describe themes drawn from educational experiences at these various learner levels to illustrate strategies that may be used to cultivate adaptive expertise.At Vanderbilt University School of Medicine, a restructuring of the medical school curriculum provided multiple opportunities to use specific curricular strategies to foster adaptive expertise development. The advantage for students in terms of future learning had to be rationalized against assessments that are more short-term in nature. In a consortium of emergency medicine residency programs, a diversity of instructional approaches was deployed to foster adaptive expertise within complex clinical learning environments. Here the value of adaptive expertise approaches must be balanced with the efficiency imperative in clinical care. At Mayo Clinic, an existing continuous professional development program was used to orient the entire organization towards an adaptive expertise mindset, with each individual making a contribution to the shift.The different contexts illustrate both the flexibility of the adaptive expertise conceptualization and the need to customize the educational approach to the developmental stage of the learner. In particular, an important benefit of teaching to adaptive expertise is the opportunity to influence individual professional identity formation to ensure that clinicians of the future value deeper, more effortful learning strategies throughout their careers.

Making sense of adaptive expertise for frontline clinical educators: a scoping review of definitions and strategies

Adaptive expertise has been promoted as an emerging model of expertise in health professions education in response to the inherent complexities of patient care; however, as the concept increasingly influences the structure of professional training and practice, it creates the potential for misunderstandings of the definition and implications of adaptive expertise. To foster a common understanding of the concept, we conducted a scoping review to explore how adaptive expertise has been discussed within health professions education literature. Five databases-MedLine, PubMed, ERIC, CINAHL, and PsycINFO-were searched using the exact term "adaptive expertise", producing 212 unique articles. Fifty-eight articles met inclusion criteria. In the included articles, authors discussed the conceptual implications of adaptive expertise for health professions education, strategies for training for adaptive expertise, and research findings aimed at supporting the development of adaptive expertise or utilizing adaptive expertise as a theoretical framework. The goal of this scoping review is to establish a resource for frontline educators tasked with fostering the development of adaptive expertise in learners through education initiatives. A common understanding of adaptive expertise is essential to ensuring effective implementation in training programs.

Ecological interchangeability: supporting team adaptive expertise in moments of disruption

While undesirable, unexpected disruptions offer unique opportunities to enact adaptive expertise. For adaptive expertise to flourish, individuals and teams must embrace both efficiency and adaptation. While some industries do it readily, others continue to struggle with the tension between efficiency and adaptation, particularly when otherwise stable situations are unexpectedly disrupted. For instance, in healthcare settings, the efficiency mandate for strict compliance with scopes of practice can deter teams from using the adaptive strategy of making their members interchangeable. Yet, interchangeability has been hinted as a key capacity of today' teams that are required to navigate fluid team structures. Because interchangeability - as an adaptive strategy - can generate antagonistic reactions, it has not been well studied in fluid teams. Thus, in this exploratory qualitative study we sought to gain insights into how interchangeability manifests when fluid teams from five different contexts (healthcare, emergency services, orchestras, military, and business) deal with disruptive events. According to our participants, successful interchangeability was possible when people knew how to work within one's role while being aware of their teammates' roles. However, interchangeability included more than just role switching. Interchangeability took various forms and was most successful when teams capitalized on the procedural, emotional, and social dimensions of their work. To reflect this added complexity, we refer to interchangeability in fluid teams as Ecological Interchangeability. We suggest that ecological interchangeability may become a desired feature in the training of adaptive expertise in teams, if its underlying properties and enabling mechanisms are more fully understood.

Creating a better learning environment: a qualitative study uncovering the experiences of Master Adaptive Learners in residency

BACKGROUND

Adaptive expertise is an important physician skill, and the Master Adaptive Learner (MAL) conceptual model describes learner skills and behaviors integral to the acquisition of adaptive expertise. The learning environment is postulated to significantly impact how MALs learn, but it is unclear how these successful learners experience and interact with it. This study sought to understand the authentic experience of MALs within the learning environment and translate those experiences into practical recommendations to improve the learning environment for all trainees.

METHODS

Following a constructivist paradigm, we conducted a thematic analysis of transcripts from focus groups composed of MALs to identify commonalities in experiences and practices of successful postgraduate trainees in the learning environment. Saturation was achieved after seven focus groups, consisting of thirty-eight participants representing fourteen specialties from four institutions. Researchers coded transcripts using constant comparison analysis, which served as the foundation for our thematic analysis.

RESULTS

We identified eight themes and situated them within a 4-component model of the learning environment. Four themes were identified within the personal component: (1) patients drive learning; (2) learning has no endpoint; (3) management of emotions is crucial for learning; (4) successful learning requires a structured approach. Two themes were identified in the social component: (5) positive social relationships are leveraged to maximize learning; (6) teaching facilitates personal learning. Two themes were identified in the organizational component: (7) transitions challenge learners to adapt; (8) the learning environment dictates goal setting strategy. No major themes were identified in the physical/virtual component, although participants frequently used technology when learning.

CONCLUSIONS

Master Adaptive Learners experience similar facilitators of, and barriers to, success in the learning environment. Overall, our data show that acquisition of many successful strategies and skills that support learning are relegated to the hidden curriculum of residency training. Educators could support a more effective learning environment for all trainees by: (1) highlighting patients as the focal point of learning, (2) building a professional 'learner' identity, (3) teaching learning skills, and (4) creating opportunities for collaborative learning.

Social network analysis of publication collaboration of accelerating change in MedEd consortium

INTRODUCTION

The American Medical Association formed the Accelerating Change in Medical Education Consortium through grants to effect change in medical education. The dissemination of educational innovations through scholarship was a priority. The objective of this study was to explore the patterns of collaboration of educational innovation through the consortium's publications.

METHOD

Publications were identified from grantee schools' semi-annual reports. Each publication was coded for the number of citations, Altmetric score, domain of scholarship, and collaboration with other institutions. Social network analysis explored relationships at the midpoint and end of the grant.

RESULTS

Over five years, the 32 Consortium institutions produced 168 publications, ranging from 38 papers from one institution to no manuscripts from another. The two most common domains focused on health system science (92 papers) and competency-based medical education (30 papers). Articles were published in 54 different journals. Forty percent of publications involved more than one institution. Social network analysis demonstrated rich publishing relationships within the Consortium members as well as beyond the Consortium schools. In addition, there was growth of the network connections and density over time.

CONCLUSION

The Consortium fostered a scholarship network disseminating a broad range of educational innovations through publications of individual school projects and collaborations.

The Accelerating Change in Medical Education Consortium: Key Drivers of Transformative Change

The American Medical Association's (AMA's) Accelerating Change in Medical Education (ACE) initiative, launched in 2013 to foster advancements in undergraduate medical education, has led to the development and scaling of innovations influencing the full continuum of medical training. Initial grants of $1 million were awarded to 11 U.S. medical schools, with 21 schools joining the consortium in 2016 at a lower funding level. Almost one-fifth of all U.S. MD- and DO-granting medical schools are represented in the 32-member consortium. In the first 5 years, the consortium medical schools have delivered innovative educational experiences to approximately 19,000 medical students, who will provide a potential 33 million patient care visits annually. The core initiative objectives focus on competency-based approaches to medical education and individualized pathways for students, training in health systems science, and enhancing the learning environment. At the close of the initial 5-year grant period, AMA leadership sought to catalogue outputs and understand how the structure of the consortium may have influenced its outcomes. Themes from qualitative analysis of stakeholder interviews as well as other sources of evidence aligned with the 4 elements of the transformational leadership model (inspirational motivation, intellectual stimulation, individualized consideration, and idealized influence) and can be used to inform future innovation interventions. For example, the ACE initiative has been successful in stimulating change at the consortium schools and propagating those innovations broadly, with outputs involving medical students, faculty, medical schools, affiliated health systems, and the broader educational landscape. In summary, the ACE initiative has fostered a far-reaching community of innovation that will continue to drive change across the continuum of medical education.

A Descriptive Analysis of the Cumulative Experiences of Emergency Medicine Residents in the Pediatric Emergency Department

OBJECTIVES

Most children seeking emergency care are evaluated in general emergency departments (EDs). The cumulative pediatric clinical experiences of emergency medicine (EM) residents are largely unknown. This study examined EM resident pediatric clinical experience through the lens of the Accreditation Council for Graduate Medical Education requirements and the Model of the Clinical Practice of Emergency Medicine.

METHODS

Retrospective, observational study of the cumulative clinical experience of two classes of EM residents from a 4-year training program at two pediatric EDs of a quaternary care pediatric center. A database of resident patient encounters was generated from the electronic medical record. Experiences classified included: diagnosis categories per the Model of the Clinical Practice of Emergency Medicine, procedures, and resuscitations. Results were stratified by age, acuity, and disposition.

RESULTS

Twenty-five EM residents evaluated 17,642 patients (median = 723). Most patients (73.5%) were emergent acuity (Emergency Severity Index triage level 2 or 3 or non-intensive care admission); 2% were critical. Residents participated in 598 (median = 22) medical resuscitations and 483 (median = 19) trauma resuscitations. Minor procedures (e.g., laceration repair) were commonly performed; critical procedures (e.g., intubation) were rare. Exposure to neonates was infrequent and pediatric deaths were rare. Abdominal pain (5.7%), asthma exacerbation (4.6%), and fever (3.8%) were the most common diagnoses.

CONCLUSIONS

Emergency medicine residents encountered a wide array of pediatric diagnoses throughout training and performed a substantial number of common pediatric procedures. Exposure to critical acuity and procedures, neonatal pathology, and certain pediatric-specific diagnoses, such as congenital heart disease, was limited despite training in a large, quaternary care children's hospital. Curriculum development and collaboration should focus on these areas.

A scoping review of adaptive expertise in education

Adaptive expertise encompasses efficiency and innovation; however little is known about the state of research of adaptive expertise in medical education. Our scoping review summarizes existing evidence in the conceptual frameworks, development, and measurement for adaptive expertise. We searched Pubmed, MEDLINE, ERIC, CINAHL and PsycINFO for original research articles published from 1986 onwards in English. Given the heterogeneity of the studies, no quantitative syntheses were conducted and the articles were summarized qualitatively. Of the 48 articles that met inclusion criteria, 19 examined conceptual frameworks, 24 explored interventions supporting development and 5 examined measurement. Conceptual frameworks are consistent within and beyond health professions education. Factors influencing development include: predisposing factors such as knowledge (ability to integrate knowledge and innovate), beliefs and attitudes (high motivation and humility), enabling factors such as skills (people skills, implementing reflection and scholarly activities), resources such as curricular enablers (providing variability of cases, allowing flexibility to generate solutions, critical appraisal of textbooks) and reinforcing factors such as mentor-guided feedback and constant curricular review. Two validated measurement tools exist for adaptive expertise. Substantial research opportunities exist in studying interventions involving the development of adaptive expertise. Notable gaps exist in the development and validation of measurement tools.

The embodiment of practice thresholds: from standardization to stabilization in surgical education

Surgeons practice their own variations on a procedure. Residents experience shifting thresholds between variations that one surgeon holds firmly as principle and another takes more lightly as preference. Such variability has implications for surgical education, but the impact is not well understood. This is a critical problem to investigate as programs seek to define procedures for competency-based medical education (CBME) and improve learning through deliberate practice. Our study analyzes the emergence of procedural variation in an early-adopter CBME program through a situational analysis of tonsillectomy, a foundation level procedure in this otolaryngology, head and neck surgical program. An earlier phase of the study identified frequent variations (n = 12) on tonsillectomy among co-located surgeons who routinely perform this procedure (n = 6). In the phase reported here we interviewed these surgeons (n = 4) and residents at different stages of training (n = 3) about their experiences of these variations to map the relations of contributing social and material actors. Our results show that even a basic procedure resists standardization. This study contributes a sociomaterial grounded theory of surgical practice as an embodied response to conditions materialized by intra-relations of human and more-than-human actors. Shifting root metaphors about practice in surgical education from standardization to stabilization can help residents achieve stable-for-now embodiments of performance as their practice thresholds continue to emerge.

Entrustment Decision Making: Extending Miller's Pyramid

The iconic Miller's pyramid, proposed in 1989, characterizes 4 levels of assessment in medical education ("knows," "knows how," "shows how," "does"). The frame work has created a worldwide awareness of the need to have different assessment approaches for different expected outcomes of education and training. At the time, Miller stressed the innovative use of simulation techniques, geared at the third level ("shows how"); however, the "does" level, assessment in the workplace, remained a largely uncharted area. In the 30 years since Miller's conference address and seminal paper, much attention has been devoted to procedures and instrument development for workplace-based assessment. With the rise of competency-based medical education (CBME), the need for approaches to determine the competence of learners in the clinical workplace has intensified. The proposal to use entrustable professional activities as a framework of assessment and the related entrustment decision making for clinical responsibilities at designated levels of supervision of learners (e.g., direct, indirect, and no supervision) has become a recent critical innovation of CBME at the "does" level. Analysis of the entrustment concept reveals that trust in a learner to work without assistance or supervision encompasses more than the observation of "doing" in practice (the "does" level). It implies the readiness of educators to accept the inherent risks involved in health care tasks and the judgment that the learner has enough experience to act appropriately when facing unexpected challenges. Earning this qualification requires qualities beyond observed proficiency, which led the authors to propose adding the level "trusted" to the apex of Miller's pyramid.

Maintaining competence in airway management

BACKGROUND

Airway management is a defining skill for anaesthesiologists. Anaesthesiologists must maintain and update these crucial skills throughout their career, but how this is best achieved remains unclear. This study aimed to clarify anaesthesiologists' procedural volume, confidence in airway management and their current and preferred future educational strategies.

METHODS

A questionnaire was developed consisting of 28 items exploring essential skills in airway management. All anaesthesiologists in the Capital Region of Denmark were invited to participate.

RESULTS

The response rate was 84% (240/285). Most anaesthesiologists felt competent to a high or very high degree in basic airway management. Anaesthesiologists from anaesthesia felt confident to a significantly higher degree than those working in the intensive care unit (ICU) regarding the practical aspects of airway management in both the anticipated difficult airway (93% vs 73%, P < .001) and the unanticipated difficult airway (81% vs 61%, P = .002). Both groups performed most of the key advanced techniques ≤4 times yearly, whereas anaesthesiologists from the ICU had a lower and less diverse procedural volume than those working in anaesthesia. The anaesthesiologists preferred training through their daily clinical work, hands-on workshops, and scenario-based simulation training. However, a large discrepancy was identified between the current and the desired level of training.

CONCLUSION

The anaesthesiologists felt competent to a high or very high degree in basic airway management but the current procedural volume in advanced airway management causes concern for skill maintenance. Furthermore, we found a gap between the current and the desired level of supplemental training.

Speed and quality goals in procedural skills learning: A randomized experiment

Purpose: Compare time (speed) and product quality goals in a surgical procedural task.Methods: Secondary school students participating in a medical simulation-based training activity participated in a randomized experiment. Each participant completed eight repetitions of a blood vessel ligation. Once, between repetitions four and five, each participant received a randomly-assigned speed goal or quality goal. Outcomes included time and leak-free ligatures.Results: 80 students participated. The speed-goal group performed 18% faster on the final repetition than the quality-goal group, with adjusted fold change (FC) 0.82 (95% confidence interval [CI], 0.71, 0.94; p = 0.01). Conversely, the speed-goal group had fewer high-quality (leak-free) ligatures (odds ratio [OR] 0.36 [95% CI, 0.22, 0.58; p < 0.001]). For the quality-goal group, leaky ligatures took longer post-intervention than leak-free ligatures (FC 1.09 [95% CI, 1.02, 1.17; p = 0.01]), whereas average times for leaky and leak-free ligatures were similar for the speed-goal group (FC 0.97 [95% CI, 0.91, 1.04; p = 0.38]). For a given performance time, the speed-goal group had more leaks post-intervention than the quality-goal group (OR 3.35 [95% CI, 1.58, 7.10; p = 0.002]).Conclusions: Speed and quality goals promote different learning processes and outcomes among novices. Use of both speed and quality goals may facilitate more effective and efficient learning.

Learning to learn: A qualitative study to uncover strategies used by Master Adaptive Learners in the planning of learning

Background: The ability to adapt expertise to both routine and uncommon situations, termed adaptive expertise, has been suggested as a necessary skill for physicians. The Master Adaptive Learner (MAL) framework proposes four phases necessary to develop adaptive expertise. The first phase, "planning" for learning, includes three stages: identification of gaps, prioritization of gaps, and identification of learning resources. This study explored key strategies used by MALs in "planning" for learning. Methods: Focus groups were used to identify strategies that successful postgraduate trainees use to plan learning. Researchers analyzed transcripts using constant comparison analysis and grounded theory to guide the generation of themes. Results: 38 participants, representing 14 specialties, participated in 7 focus groups. Six key strategies used in the "planning" phase of learning were found. During gap identification, they used performance-driven gap identification and community-driven gap identification. To prioritize gaps, they used the schema of triage and adequacy. To identify resources they used intentional adaptation and weighted curation. Barriers such as lack of time and inexperience were noted. Conclusions: MALs use six strategies to plan learning, using patients, health-care team roles, and clinical questions to guide them. Understanding these strategies can help educators design learning opportunities and overcome barriers.