Priority Areas and Potential Solutions for Successful Integration and Sustainment of Health Systems Science in Undergraduate Medical Education

Systems-Based Practice: Expert Perspectives on the Origin and Evolution of an Ambiguous Competency

PURPOSE

Systems-based practice (SBP) has been a core competency in graduate medical education in the United States since 1999, but it has been difficult to operationalize in residency programs due to its conceptual ambiguity. The authors explored the historical origin and subsequent development of the SBP competency from the perspective of individuals who were influential across critical phases of its implementation and ensuing development. The goal of this study was to elicit the history of SBP from the perspective of individuals who have expertise in it and to use those findings to inform the current SBP construct.

METHOD

Between March and July 2021, 24 physicians, nurses, educators, and leaders in the field of SBP were individually interviewed about the origin and meaning of SBP as practiced in U.S. medical education using a semistructured guide. Individuals were selected based upon their influence on the origin or evolution of the SBP competency. Data were iteratively collected and analyzed using real-time analytic memos, regular adjudication sessions with the research team, and thematic analysis. Researchers identified themes from participants' perspectives and agreed upon the final results and quotations.

RESULTS

Five themes were identified: SBP has many different definitions, SBP was intentionally designed to be vague, systems thinking was identified as the foundation of the SBP competency, the 6 core competencies established in the United States by the Accreditation Council for Graduate Medical Education were developed to be interdependent, and the SBP and practice-based learning and improvement competencies are uniquely related and synergistic.

CONCLUSIONS

Interview data indicate that since its inception, SBP has been a nuanced and complex competency, resulting in a lack of mutually shared understanding among stakeholders. This deliberate historical examination of expert perspectives provides insight into specific areas for improving how SBP is taught and learned.

Non-physician and physician preceptors in Landscapes of Practice: a mixed-methods study exploring learning for 1st-year medical students in clinical experiences

Medical education has traditionally relied on physician educators. With expanding Health Systems Science competencies, non-physician healthcare providers are required. To investigate preceptor-role types, communication frequency, and importance of preceptors in value-added patient navigator roles (PN) and clinical preceptorships (CP). Using a mixed-methods approach, medical students participating in PN and CP during the first year of medical school (n=191) identified individuals with whom they communicated and communication frequency (1=never, 7=frequently), and importance of preceptors to work/education (1=not important, 7=extremely important; open-ended responses). Quantitative data were analyzed via repeated measures using a mixed-effects model and McNemar's test; effect size was calculated via Cohen's d or Cohen's h; qualitative data was analyzed using thematic analysis. Comparing ratings for non-physicians to physician healthcare professionals in PN, communication frequency (5.54 vs 3.65; p<0.001, d=1.18), importance to work (5.77 vs 4.28, p<0.001, d=0.89) and education (5.02 vs 4.12, p<0.001; d=0.49) were higher for non-physician educators. Comparing ratings for non-physicians to physician healthcare professionals in CP, communication frequency (4.93 vs. 6.48, p<0.001, d=1.33), importance to work (5.12 vs 6.61 vs, p<0.001, d=1.29) and education (4.32 vs 6.55, p<0.001, d=1.89) were higher for physician educators. Qualitative analysis indicated that non-physician healthcare providers in PN focused on Health Systems Science concepts, including social determinants of health and healthcare delivery. In PN, students observed collaboration from the perspective of multiple providers. In CP, healthcare providers, mainly physicians, focused on physician-centric clinical skills and interprofessional collaboration from the physician's perspective. Educational benefits of non-physician healthcare professionals related to Health Systems Science in work-based clinical settings - or Landscapes of Practice - can help students understand systems-based concepts such as social determinants of health, healthcare delivery systems, and interprofessional collaboration. Differences in the educational value of non-physician healthcare educators perceived by students should be further explored.

Strategies to improve hidden curriculum in nursing and medical education: a scoping review

BACKGROUND

The importance of hidden curriculum cannot be neglected in education. Despite much research in the field, there have been limited studies on HC improvement in nursing and medical education. This scoping review aimed to determine the scope of strategies to improve HC in nursing and medical education.

METHOD

PubMed, EBSCO/Cumulative Index to Nursing and Allied Health Literature (CINAHL), Cochrane Library, Scopus, Web of Science, Proquest and Persian-language databases of Magiran and SID were searched in January 2023 without a time filter. According to the PRISMA flow diagram, two independent reviewers selected the records that fit the inclusion and exclusion criteria via title and abstract screening. Next, the reviewers studied the full texts of the related articles. The data extracted from the selected articles were tabulated and ultimately synthesized.

FINDINGS

Out of the eight examined studies, published from 2017 to 2022, only one was in the field of nursing and seven were in medicine. The central strategies were implementing new curricula to replace the previous ones, utilizing team-based clinical clerkship, proposing a HC improvement model, implementation a case-based faculty development workshop, implementation longitudinal and comprehensive educational courses, and incorporating an educational activity into a small group program.

CONCLUSION

Students and faculty members familiarization on the topic of HC, implementing new curricula, utilizing team-based clerkship, and using comprehensive models were among the HC improvement strategies. Focusing on upgrading the learning environment, particularly the clinical settings, can also be helpful in HC improvement.

Neurology education in the era of artificial intelligence

PURPOSE OF REVIEW

The practice of neurology is undergoing a paradigm shift because of advances in the field of data science, artificial intelligence, and machine learning. To ensure a smooth transition, physicians must have the knowledge and competence to apply these technologies in clinical practice. In this review, we describe physician perception and preparedness, as well as current state for clinical applications of artificial intelligence and machine learning in neurology.

RECENT FINDINGS

Digital health including artificial intelligence-based/machine learning-based technology has made significant inroads into various aspects of healthcare including neurological care. Surveys of physicians and healthcare stakeholders suggests an overall positive perception about the benefits of artificial intelligence/machine learning in clinical practice. This positive perception is tempered by concerns for lack of knowledge and limited opportunities to build competence in artificial intelligence/machine learning technology. Literature about neurologist's perception and preparedness towards artificial intelligence/machine learning-based technology is scant. There are very few opportunities for physicians particularly neurologists to learn about artificial intelligence/machine learning-based technology.

SUMMARY

Neurologists have not been surveyed about their perception and preparedness to adopt artificial intelligence/machine learning-based technology in clinical practice. We propose development of a practical artificial intelligence/machine learning curriculum to enhance neurologists' competence in these newer technologies.

Informatics in Undergraduate Medical Education: Analysis of Competency Frameworks and Practices Across North America

BACKGROUND

With the advent of competency-based medical education, as well as Canadian efforts to include clinical informatics within undergraduate medical education, competency frameworks in the United States have not emphasized the skills associated with clinical informatics pertinent to the broader practice of medicine.

OBJECTIVE

By examining the competency frameworks with which undergraduate medical education in clinical informatics has been developed in Canada and the United States, we hypothesized that there is a gap: the lack of a unified competency set and frame for clinical informatics education across North America.

METHODS

We performed directional competency mapping between Canadian and American graduate clinical informatics competencies and general graduate medical education competencies. Directional competency mapping was performed between Canadian roles and American common program requirements using keyword matching at the subcompetency and enabling competency levels. In addition, for general graduate medical education competencies, the Physician Competency Reference Set developed for the Liaison Committee on Medical Education was used as a direct means of computing the ontological overlap between competency frameworks.

RESULTS

Upon mapping Canadian roles to American competencies via both undergraduate and graduate medical education competency frameworks, the difference in focus between the 2 countries can be thematically described as a difference between the concepts of clinical and management reasoning.

CONCLUSIONS

We suggest that the development or deployment of informatics competencies in undergraduate medical education should focus on 3 items: the teaching of diagnostic reasoning, such that the information tasks that comprise both clinical and management reasoning can be discussed; precision medical education, where informatics can provide for more fine-grained evaluation; and assessment methods to support traditional pedagogical efforts (both at the bedside and beyond). Assessment using cases or structured assessments (eg, Objective Structured Clinical Examinations) would help students draw parallels between clinical informatics and fundamental clinical subjects and would better emphasize the cognitive techniques taught through informatics.

Bridging medical education goals and health system outcomes: An instrumental case study of pre-clerkship students' improvement projects

INTRODUCTION

Many medical schools engage students in health system improvement (HSI) efforts. Evaluation of these efforts often focuses on students' learning outcomes and rarely considers the impact on health systems, despite the significant commitment health systems make to these efforts. Our study identified and evaluated system-level outcomes of pre-clerkship medical students' engagement in HSI efforts.

METHODS

We used an instrumental case study approach to examine the effects of pre-clerkship medical students' engagement in HSI projects as part of a 15-month experiential curriculum. We extracted data from 53 project summaries and posters completed during the 2017-18 academic year and follow-up survey data collected in May 2019 from physician coaches and health system professionals who mentored students, contributed to these projects, and worked in the clinical microsystems where the projects occurred.

RESULTS

We identified three categories and ten indicators of health system outcomes relevant to medical student engagement in HSI. Using these indicators, our evaluation found multiple benefits to the microsystems in which projects occurred. These included achievement of project aims, perceived immediate and sustained project impact on the health system, and development and implementation of projects with aims that aligned with national and health system priorities.

CONCLUSION

Evaluation of HSI curricula needs to include effects on health systems so that program design can optimize the experience for all involved. Our study offers a framework others can use to evaluate system-level effects of project-based HSI curricula and shows several ways in which students' engagement can add value to health systems.

Preparing Faculty to Incorporate Health Systems Science into the Clinical Learning Environment: Factors Associated with Sustained Outcomes

This study assesses participants' perceptions of long-term impacts of the Teachers of Quality Academy, a medical school faculty development program designed to prepare faculty to both practice and teach health system science. A previously published 1-year evaluation of the first cohort of 27 participants showed improved perceived skills, with positive career and health system impacts. In this 5-year evaluation, a mixed-methods design included a questionnaire followed by semistructured interviews to assess perceived long-term impacts on participants. Quantitative and qualitative analyses were completed. Questionnaire response rate was 88% (N = 22), and 14 interviews were analyzed. Results demonstrated that participants had incorporated quality improvement concepts into their clinical work and teaching, better understood interprofessionalism, and observed continued improvements in care delivery. They felt the longitudinal training, delivered in a shared setting, created a learning community with lasting positive effects in institutional culture, supported long-term professional development, and had broader institutional impact. Advancements in clinical care, medical education, and professional and academic advancements were noted.

Evolving the Systems-Based Practice Competency in Graduate Medical Education to Meet Patient Needs in the 21st-Century Health Care System

Medical education is increasingly recognizing the importance of the systems-based practice (SBP) competency in the emerging 21st-century U.S. health care landscape. In the wake of data documenting insufficiencies in care delivery, notably in patient safety and health care disparities, the Accreditation Council for Graduate Medical Education created the SBP competency to address gaps in health outcomes and facilitate the education of trainees to better meet the needs of patients. Despite the introduction of SBP over 20 years ago, efforts to realize its potential have been incomplete and fragmented. Several challenges exist, including difficulty in operationalizing and evaluating SBP in current clinical learning environments. This inconsistent evolution of SBP has compromised the professional development of physicians who are increasingly expected to advance systems of care and actively contribute to improving patient outcomes, patient and care team experience, and costs of care. The authors prioritize 5 areas of focus necessary to further evolve SBP: comprehensive systems-based learning content, a professional development continuum, teaching and assessment methods, clinical learning environments in which SBP is learned and practiced, and professional identity as systems citizens. Accelerating the evolution of SBP in these 5 focus areas will require health system leaders and educators to embrace complexity with a systems thinking mindset, use coproduction between sponsoring health systems and education programs, create new roles to drive alignment of system and educational goals, and use design thinking to propel improvement efforts. The evolution of SBP is essential to cultivate the next generation of collaboratively effective, systems-minded professionals and improve patient outcomes.

Social network analysis of publication collaboration of accelerating change in MedEd consortium

INTRODUCTION

The American Medical Association formed the Accelerating Change in Medical Education Consortium through grants to effect change in medical education. The dissemination of educational innovations through scholarship was a priority. The objective of this study was to explore the patterns of collaboration of educational innovation through the consortium's publications.

METHOD

Publications were identified from grantee schools' semi-annual reports. Each publication was coded for the number of citations, Altmetric score, domain of scholarship, and collaboration with other institutions. Social network analysis explored relationships at the midpoint and end of the grant.

RESULTS

Over five years, the 32 Consortium institutions produced 168 publications, ranging from 38 papers from one institution to no manuscripts from another. The two most common domains focused on health system science (92 papers) and competency-based medical education (30 papers). Articles were published in 54 different journals. Forty percent of publications involved more than one institution. Social network analysis demonstrated rich publishing relationships within the Consortium members as well as beyond the Consortium schools. In addition, there was growth of the network connections and density over time.

CONCLUSION

The Consortium fostered a scholarship network disseminating a broad range of educational innovations through publications of individual school projects and collaborations.

Lessons From Learners: Adapting Medical Student Education During and Post COVID-19

In response to the COVID-19 pandemic, many medical schools suspended clinical clerkships and implemented newly adapted curricula to facilitate continued educational progress. While the implementation of these new curricula has been described, an understanding of the impact on student learning outcomes is lacking. In 2020, the authors followed Kern's 6-step approach to curricular development to create and evaluate a novel COVID-19 curriculum for medical students at the University of California San Francisco School of Medicine and evaluate its learning outcomes. The primary goal of the curriculum was to provide third- and fourth-year medical students an opportunity for workplace learning in the absence of clinical clerkships, specifically for students to develop clerkship-level milestones in the competency domains of practice-based learning and improvement, professionalism, and systems-based practice. The curriculum was designed to match students with faculty-mentored projects occurring primarily in virtual formats. A total of 126 students enrolled in the curriculum and completed a survey about their learning outcomes (100% response rate). Of 35 possible clerkship-level milestones, there were 12 milestones for which over half of students reported development in competency domains including practice-based learning and improvement, professionalism, and interpersonal and communication skills. Thematic analysis of students' qualitative survey responses demonstrated 2 central motivations for participating in the curriculum: identity as physicians-in-training and patient engagement. Six central learning areas were developed during the curriculum: interprofessional teamwork, community resources, technology in medicine, skill-building, quality improvement, and specialty-specific learning. This analysis demonstrates that students can develop competencies and achieve rich workplace learning through project-based experiential learning, even in virtual clinical workplaces. Furthermore, knowledge of community resources, technology in medicine, and quality improvement was developed through the curriculum more readily than in traditional clerkships. These could be considered as integral learning objectives in future curricular design.

Defining Successful Practice Within Health Systems Science Among Entering Residents: A Single-Institution Qualitative Study of Graduate Medical Education Faculty Observations

PURPOSE

The American Medical Association's Accelerating Change in Medical Education consortium defined health systems science (HSS) as the study of how health care is delivered, how health care professionals work together to deliver that care, and how the health system can improve patient care and health care delivery. This framework is increasingly being incorporated into medical school curricula. Graduate medical education (GME) had previously elevated systems-based practice (SBP) as a core competency, but expectations are defined by specialty-specific milestones. The lack of a shared competency framework between undergraduate medical education (UME) and GME makes it challenging to ensure that entering residents are prepared to implement HSS/SBP concepts in the workplace. The authors explored GME faculty observations of residents exemplifying successful practice across HSS domains to inform targets for UME training and assessment.

METHOD

Authors performed a single-institution qualitative study using transcribed phone interviews with eligible Vanderbilt residency program directors, associate program directors, and core faculty. Participants described observations of successful residents within each HSS domain. Two researchers independently coded, discussed, and reconciled deidentified transcripts using inductive-deductive approaches to identify themes.

RESULTS

Seventeen faculty participated across specialties (17/39, 45%). Faculty responses emphasize precurricular experiences including professional degrees, work experience, extracurriculars, and medical school exposure. Importantly, successful residents exhibit foundational core workforce characteristics including growth mindset, curiosity, and a desire to learn about systems. GME faculty identified HSS domain-specific skills, noting distinctions among learning environments. Outcomes resulting from residents' application of HSS concepts include delivering high-quality, person-centered care and systems improvements.

CONCLUSIONS

Descriptions of successful practice within HSS domains highlight preparatory experiences and core workforce characteristics and outline entry-level HSS behaviors. Conceptualized in a logic model framework, these findings describe key inputs, learning activities, outputs, and outcomes for systems-prepared entering residents bridging the UME-GME transition.

Health systems science education: The new post-Flexner professionalism for the 21st century

The foundations of medical education have drawn from the Flexner Report to prepare students for practice for over a century. These recommendations relied, however, upon a limited set of competencies and a relatively narrow view of the physician's role. There have been increasing calls and recommendations to expand those competencies and the professional identity of the physician to better meet the current and future needs of patients, health systems, and society. We propose a framework for the twenty-first century physician that includes an expectation of new competency in health systems science (HSS), creating 'system citizens' who are effective stewards of the health care system. Experiential educational strategies, in addition to knowledge-centered learning, are critically important for students to develop their professional identity as system citizens working alongside interprofessional colleagues. Challenges to HSS adoption range from competing priorities for learners, to the need for faculty development, to the necessity for buy-in by medical schools and their associated health care systems. Ultimately, success will depend on our ability to articulate, encourage, support, and evaluate system citizenship and its impact on health care and health care systems.

The Accelerating Change in Medical Education Consortium: Key Drivers of Transformative Change

The American Medical Association's (AMA's) Accelerating Change in Medical Education (ACE) initiative, launched in 2013 to foster advancements in undergraduate medical education, has led to the development and scaling of innovations influencing the full continuum of medical training. Initial grants of $1 million were awarded to 11 U.S. medical schools, with 21 schools joining the consortium in 2016 at a lower funding level. Almost one-fifth of all U.S. MD- and DO-granting medical schools are represented in the 32-member consortium. In the first 5 years, the consortium medical schools have delivered innovative educational experiences to approximately 19,000 medical students, who will provide a potential 33 million patient care visits annually. The core initiative objectives focus on competency-based approaches to medical education and individualized pathways for students, training in health systems science, and enhancing the learning environment. At the close of the initial 5-year grant period, AMA leadership sought to catalogue outputs and understand how the structure of the consortium may have influenced its outcomes. Themes from qualitative analysis of stakeholder interviews as well as other sources of evidence aligned with the 4 elements of the transformational leadership model (inspirational motivation, intellectual stimulation, individualized consideration, and idealized influence) and can be used to inform future innovation interventions. For example, the ACE initiative has been successful in stimulating change at the consortium schools and propagating those innovations broadly, with outputs involving medical students, faculty, medical schools, affiliated health systems, and the broader educational landscape. In summary, the ACE initiative has fostered a far-reaching community of innovation that will continue to drive change across the continuum of medical education.

The Mystery Dinner RCA: Using Gamification and Simulation to Teach Root Cause Analysis

Introduction

Root cause analysis (RCA) is a widely utilized tool for investigating systems issues that lead to patient safety events and near misses, yet only 38% of learners participate in an interdisciplinary patient safety investigation during training. Common barriers to RCA education and participation include faculty time and materials, trainee time constraints, and learner engagement.

Methods

We developed a simulated RCA workshop to be taught to a mix of medical and surgical specialties from over 11 GME programs and to third-year medical students. The workshop was a single 90-minute session formatted as a gamified mystery dinner including characters and sequentially revealed clues to promote engagement. Participant satisfaction and subjective knowledge, skills, and attitudes were assessed with a pre/post survey.

Results

The workshop was completed by 134 learners between October 2018 and October 2019. The short workshop duration and premade simulation allowed a small number of faculty to train a wide variety of learners in various educational settings. Participants' presurvey (124 out of 134, 92%) versus postsurvey (113 out of 134, 84%) responses showed that attitudes about RCA were statistically improved across all domains queried, with an average effect size of 0.6 (moderate effect); 91% of participants would recommend this course to a colleague.

Discussion

A 90-minute, gamified, simulated RCA workshop was taught to medical students and multiple GME specialties with subjective improvements in patient safety attitudes and knowledge while alleviating faculty time constraints in case development.

Scholarship, teaching practice and educational responsibility: Issues in designing and implementing a quality improvement and evidence-based practice module in the undergraduate curriculum

As part of a review of the undergraduate medical curriculum at King's College London, a module preparing students to undertake a quality improvement project (QIP) was developed. Using an illuminative evaluation method, the successes and challenges of the module were identified. The student experience lay along a continuum. At one end, QIPs enabled some significant improvements within trusts and primary care. Projects were presented in their clinical settings and at national and international conferences, and were published. At the other end of the continuum, students struggled to find an actionable project or have early and regular communication with their supervisors. Poor implementation of the module created challenges. These included misunderstanding of module requirements by students and supervisors, lack of clarity about what a feasible undergraduate project comprised and logistical problems when students moved from their QIP site to their next rotation. Travel back to the QIP site to complete projects involved missing scheduled teaching in their current rotation. Supervisors were unsure how to assess group projects. Key successes included students feeling better prepared to undertake QIPs, students developing a better understanding of the dynamics of clinical settings and teams, and how to manage these to progress projects.

Assessing the Transition of Training in Health Systems Science From Undergraduate to Graduate Medical Education

BACKGROUND

The American Medical Association Accelerating Change in Medical Education (AMA-ACE) consortium proposes that medical schools include a new 3-pillar model incorporating health systems science (HSS) and basic and clinical sciences. One of the goals of AMA-ACE was to support HSS curricular innovation to improve residency preparation.

OBJECTIVE

This study evaluates the effectiveness of HSS curricula by using a large dataset to link medical school graduates to internship Milestones through collaboration with the Accreditation Council for Graduate Medical Education (ACGME).

METHODS

ACGME subcompetencies related to the schools' HSS curricula were identified for internal medicine, emergency medicine, family medicine, obstetrics and gynecology (OB/GYN), pediatrics, and surgery. Analysis compared Milestone ratings of ACE school graduates to non-ACE graduates at 6 and 12 months using generalized estimating equation models.

RESULTS

At 6 months both groups demonstrated similar HSS-related levels of Milestone performance on the selected ACGME competencies. At 1 year, ACE graduates in OB/GYN scored minimally higher on 2 systems-based practice (SBP) subcompetencies compared to non-ACE school graduates: SBP01 (1.96 vs 1.82, 95% CI 0.03-0.24) and SBP02 (1.87 vs 1.79, 95% CI 0.01-0.16). In internal medicine, ACE graduates scored minimally higher on 3 HSS-related subcompetencies: SBP01 (2.19 vs 2.05, 95% CI 0.04-0.26), PBLI01 (2.13 vs 2.01; 95% CI 0.01-0.24), and PBLI04 (2.05 vs 1.93; 95% CI 0.03-0.21). For the other specialties examined, there were no significant differences between groups.

CONCLUSIONS

Graduates from schools with training in HSS had similar Milestone ratings for most subcompetencies and very small differences in Milestone ratings for only 5 subcompetencies across 6 specialties at 1 year, compared to graduates from non-ACE schools. These differences are likely not educationally meaningful.

Accessible and Adaptable Faculty Development to Support Curriculum Reform in Medical Education

Contemporary curricular reform in medical education focuses on areas that current physician-educators were likely not exposed to during medical school, such as interprofessional teamwork; informatics; health care systems improvement; and diversity, equity, and inclusion. Thus, faculty may not be ready to support the planned curricular reform without adequate faculty development to acquire the necessary knowledge and skills. In an era with increasing demands on faculty, new approaches that are flexible and adaptable are needed. The University of California, San Francisco, School of Medicine implemented a new curriculum in 2016, which constituted a major curricular overhaul necessitating extensive faculty development. Based on this experience, the author proposes 8 guiding principles for faculty development around curricular reform: (1) create a blueprint to inform design and implementation of faculty development activities; (2) build on existing resources, networks, and communities; (3) target different needs and competency levels for different groups of faculty; (4) encourage cocreation in the workplace; (5) promote collaboration between content experts and faculty developers; (6) tap into faculty's intrinsic motivation for professional development; (7) develop curriculum leaders and faculty developers; and (8) evaluate for continuous improvement. Each of these principles is illustrated with examples, and when available, supported by references to relevant literature. Considering the current wave of curricular reform, both at the undergraduate and graduate levels, these principles can be useful for other institutions.

Learning New Skills in Innovation, Leadership, and Discovery During a 9-Month Scholarly Concentration: Results from the First Cohort at a New Medical School

Dell Medical School (DMS) has weaved health systems science (HSS) throughout its curriculum. During the third year, students complete a master's degree program or an immersive distinction in research or design during a 9-month Innovation, Leadership, and Discovery (ILD) block. Faculty assessments revealed all students met expectations, but dual-degree students were rated higher than distinction students in leading future innovative teams competencies. Student self-assessments revealed statistically significant improvements in HSS competencies during the block with little difference by ILD choice (dual degree or distinction). We will continue to examine the long-term impact of these experiences and skills in career trajectories.

A Proposed Shared Vision for Leadership Development for all Medical Students: A Call from a Coalition of Diverse Medical Schools

Issue: Despite clear relevance, need, descriptive literature, and student interest, few schools offer required curriculum to develop leadership skills. This paper outlines a proposed shared vision for leadership development drawn from a coalition of diverse medical schools. We advocate that leadership development is about self (looking inward), teams (not hierarchy), and change (looking outward). We propose that leadership development is for all medical students, not for a subset, and we believe that leadership curricula and programs must be experiential and applied. Evidence: This paper also draws on the current literature and the experience of medical schools participating in the American Medical Association's (AMA) Accelerating Change in Medical Education Consortium, confronts the common arguments against leadership training in medical education, and provides three cross-cutting principles that we believe must each be incorporated in all medical student-centered leadership development programs as they emerge and evolve at medical schools. Implications: By confronting common arguments against leadership training and providing a framework for such training, we give medical educators important tools and insights into developing leadership training for all students at their institutions.

Health Systems Science in Medical Education: Unifying the Components to Catalyze Transformation

Medical education exists in the service of patients and communities and must continually calibrate its focus to ensure the achievement of these goals. To close gaps in U.S. health outcomes, medical education is steadily evolving to better prepare providers with the knowledge and skills to lead patient- and systems-level improvements. Systems-related competencies, including high-value care, quality improvement, population health, informatics, and systems thinking, are needed to achieve this but are often curricular islands in medical education, dependent on local context, and have lacked a unifying framework. The third pillar of medical education-health systems science (HSS)-complements the basic and clinical sciences and integrates the full range of systems-related competencies. Despite the movement toward HSS, there remains uncertainty and significant inconsistency in the application of HSS concepts and nomenclature within health care and medical education. In this Article, the authors (1) explore the historical context of several key systems-related competency areas; (2) describe HSS and highlight a schema crosswalk between HSS and systems-related national competency recommendations, accreditation standards, national and local curricula, educator recommendations, and textbooks; and (3) articulate 6 rationales for the use and integration of a broad HSS framework within medical education. These rationales include: (1) ensuring core competencies are not marginalized, (2) accounting for related and integrated competencies in curricular design, (3) providing the foundation for comprehensive assessments and evaluations, (4) providing a clear learning pathway for the undergraduate-graduate-workforce continuum, (5) facilitating a shift toward a national standard, and (6) catalyzing a new professional identity as systems citizens. Continued movement toward a cohesive framework will better align the clinical and educational missions by cultivating the next generation of systems-minded health care professionals.

For a Healthy (and) Higher Education: Evidences from Learning Outcomes in Health Sciences

Increased recognition of outcomes, or competency-based education, has evolved across higher education on health sciences. However, there is significant diversity in the current study of Portuguese programmes. Considering learning outcomes (LO) as indicators of knowledge, skills, abilities, attitudes and the understanding that the student will gain as a result of an educational experience, this study aims to explore which LO are emphasised on the study programmes of health sciences in Portugal. Through a qualitative methodology, carried out through MAXQDA software, all LO of all Portuguese health sciences study programmes submitted to quality accreditation to the Portuguese Agency for Assessment and Accreditation of Higher Education (A3ES) since 2009 until 2016 were analysed. Although specific knowledge was the most referenced LO, transversal skills were also emphasized, such as critical and reflexive analysis/critical thinking, research, ability to organize and plan and professional ethics. Significant differences were found between LO selection when the analysis was made by comparing the diverse study programmes. This required assortment of knowledge and skills seems to reflect not only the specificities of each health science programme but also the challenging demands on professionals in the 21st century, along with the necessary changes imposed by society, fostering intercultural understanding, tolerance, mutual respect and an ethic of global citizenship and shared responsibility, crucial enablers of educational development for all in the scope of the 2030 Agenda for Sustainable Development.

General Internists as Change Agents: Opportunities and Barriers to Leadership in Health Systems and Medical Education Transformation

Health systems are increasingly engaging in mission development around the quadruple aim of patient experience of care, population health, cost of care, and work-life balance of clinicians. This integrated approach is closely aligned with the education principles and competencies of health systems science (HSS), which includes population health, high-value care, leadership, teamwork, collaboration, and systems thinking. Influenced by health outcomes research, the systems-based practice competency, and the Clinical Learning Environment Review, many medical schools and residency programs are taking on the challenge of comprehensively incorporating these HSS competencies into the education agenda. General internal medicine physicians, inclusive of hospitalists, geriatricians, and palliative and primary care physicians, are at the frontlines of this transformation and uniquely positioned to contribute to and lead health system transformation, role model HSS competencies for trainees, and facilitate the education of a new workforce equipped with HSS skills to accelerate change in healthcare. Although GIM faculty are positioned to be early adopters and leaders in evolving systems of care and education, professional development and changes with academic health systems are required. This Perspective article explores the conceptualization and opportunities to effectively link GIM with healthcare and medical education transformation.

Honoring Medicine's Social Contract: A Scoping Review of Critical Consciousness in Medical Education

PURPOSE

To explore how the construct of critical consciousness has been conceptualized within the medical education literature and identify the main elements of critical consciousness in medical education so as to inform educational strategies to foster socially conscious physicians.

METHOD

In March 2019, the authors conducted a literature search of 4 databases and Google Scholar, seeking articles discussing critical consciousness in medical education published any time after 1970. Three of the authors screened articles for eligibility. Two transcribed data using a data extraction form and identified preliminary emerging themes, which were then discussed by the whole research team to ensure agreement.

RESULTS

Of the initial 317 articles identified, 20 met study inclusion criteria. The publication of academic articles around critical consciousness in medical education has expanded substantially since 2017. Critical consciousness has been conceptualized in the medical education literature through 4 overlapping themes: (1) social awareness, (2) cultural awareness, (3) political awareness, and (4) awareness of educational dynamics.

CONCLUSIONS

Critical consciousness has been conceptualized in medical education as an intellectual construct to foster a reflexive awareness of professional power in health care, to unearth the values and biases legitimizing medicine as currently practiced, and to foster transformation and social accountability. Scholars highlighted its potential to improve sociocultural responsibility and to foster compassion in doctors. Adopting a critical pedagogy approach in medical education can help uphold its social accountability through an intrinsic orientation to action, but any enterprise working toward embedding critical pedagogy within curricula must acknowledge and challenge the current structure and culture of medical education itself.

Unpacking Medical Students' Mixed Engagement in Health Systems Science Education

Phenomenon: Medical education is better aligning with the needs of health systems. Health systems science competencies, such as high-value care, population health, and systems thinking, are increasingly being integrated into curricula, but not without challenges. One challenge is mixed receptivity by students, the underlying reasons of which have not been extensively explored. In this qualitative study, we explored the research question: "How do students perceive health systems science curricula across all four years, and how do such perceptions inform the reasons for mixed quality ratings?" Approach: Following large-scale health systems science curricular changes in their medical school, we used students' open-ended comments obtained from course evaluations related to 1^st-, 2^nd-, and 4^th-year courses and performed a qualitative thematic analysis to explore students' perceptions. We identified themes, synthesized findings into a conceptual figure, and agreed upon results and quotations. Findings: Five themes were identified: (1) perceived importance and relevance of health systems science education, (2) tension between traditional and evolving health systems science-related professional identity, (3) dissatisfaction with redundancy of topics, (4) competition with basic and clinical science curricula, and, (5) preference for discrete, usable, testable facts over complexity and uncertainty. The relationship between themes is described along a continuum of competing agendas between students' traditional mindset (which focuses on basic/clinical science) and an emerging medical education approach (which focuses on basic, clinical, and health systems science). Insights: Health systems science education can be viewed by learners as peripheral to their future practice and not aligned with a professional identity that places emphasis on basic and clinical science topics. For some students, this traditional identity limits engagement in health systems science curricula. If health systems science is to achieve its full potential in medical education, further work is required to explore the adoption of new perspectives by students and create activities to accelerate the process.

Teaching Systems Improvement to Early Medical Students: Strategies and Lessons Learned

PURPOSE

Despite increasing emphasis in medical school education on quality and systems improvement, many medical schools lack sufficient faculty with expertise to teach systems improvement. Using the pedagogical content knowledge framework, this study explores how faculty engage students in systems improvement work and faculty perceptions of the outcomes for the health system and students.

METHOD

In May-June 2017, the authors interviewed 12 of 13 invited faculty with experience in teaching and engaging first-year medical students in systems improvement work, the course of students' systems improvement work over time, the impact of students' projects on health systems, and students' learning and attitudes about systems improvement. The authors conducted qualitative analysis iteratively with data collection to sufficiency.

RESULTS

Six emergent themes characterized faculty's approach to guiding students in systems improvement work: faculty-student relationship, faculty role, student role, faculty-student shared responsibility for projects, faculty and student content knowledge, and project outcomes. The faculty-student relationship was foundational for successful systems improvement work. Faculty roles included project selection, project management, and health systems interactions. Students engaged in systems improvement as their faculty leveraged their knowledge and skills and created meaningful student roles. Faculty and students shared responsibility and colearned systems improvement content knowledge. Faculty defined successful outcomes as students' learning about the systems improvement process and interprofessional collaboration.

CONCLUSIONS

Findings highlight the critical importance of pedagogical content knowledge to engage early learners in systems improvement work, understand their learning interests and needs, and manage their projects longitudinally.

How to Teach Laboratory Stewardship in the Undergraduate Medical Curriculum?

OBJECTIVES

Promotion of high-quality care at a lower cost requires educational initiatives across the continuum of medical education. A needs assessment was performed to inform the design of an educational tool with the goal of teaching laboratory stewardship to medical students.

METHODS

The needs assessment consisted of semistructured interviews with core clerkship directors and residency program directors at our institution, a national survey to the Undergraduate Medical Educators Section (UMEDS) of the Association of Pathology Chairs, and a review of existing online resources that teach high-value care.

RESULTS

Two major themes emerged regarding opportunities to enhance laboratory stewardship education: appropriate ordering (knowledge of test indications, pretest/posttest probability, appropriateness criteria, recognition of unnecessary testing) and correct interpretation (understanding test specifications, factors that affect the test result, recognizing inaccurate results).

CONCLUSIONS

The online educational tool will focus on the curricular needs identified, using a multidisciplinary approach for development and implementation.

"Getting Out of That Siloed Mentality Early": Interprofessional Learning in a Longitudinal Placement for Early Medical Students

PURPOSE

Although descriptions of interprofessional education often focus on interactions among students from multiple professions, embedding students from 1 profession in clinical settings may also provide rich opportunities for interprofessional learning (IPL). This study examines affordances and barriers to medical students' interactions with and opportunities to learn from health care professionals while learning health systems science in clinical workplaces.

METHOD

In May 2017, 14 first-year medical students at the University of California, San Francisco participated in a semistructured interview about IPL experiences during a 17-month, weekly half-day clinical microsystem placement focused on systems improvement (SI) projects and clinical skills. Communities of practice and workplace learning frameworks informed the interview guide. The authors analyzed interview transcripts using conventional qualitative content analysis.

RESULTS

The authors found much variation among the 14 students' interprofessional interactions and experiences in 12 placement sites (7 outpatient, 4 inpatient, 1 emergency department). Factors influencing the depth of interprofessional interactions included the nature of the SI project, clinical workflow, student and staff schedules, workplace culture, and faculty coach facilitation of interprofessional interactions. Although all students endorsed the value of learning about and from diverse health care professionals, they were reluctant to engage with, or "burden," them.

CONCLUSIONS

There are significant IPL opportunities for early medical students in longitudinal placements focused on SI and clinical skills. Formal curricular activities, SI projects conducive to interprofessional interactions, and faculty development can enhance the quality of workplace-based IPL.

Health Systems Science: The "Broccoli" of Undergraduate Medical Education

Health system leaders are calling for reform of medical education programs to meet evolving needs of health systems. U.S. medical schools have initiated innovative curricula related to health systems science (HSS), which includes competencies in value-based care, population health, system improvement, interprofessional collaboration, and systems thinking. Successful implementation of HSS curricula is challenging because of the necessity for new curricular methods, assessments, and educators and for resource allocation. Perhaps most notable of these challenges, however, is students' mixed receptivity. Although many students are fully engaged, others are dissatisfied with curricular time dedicated to competencies not perceived as high yield. HSS learning can be viewed as "broccoli"-students may realize it is good for them in the long term, but it may not be palatable in the moment. Further analysis is necessary for accelerating change both locally and nationally.With over 11 years of experience in global HSS curricular reform in 2 medical schools and informed by the curricular implementation "performance gap," the authors explore student receptivity challenges, including marginalization of HSS coursework, infancy of the HSS field, relative nascence of curricula and educators, heterogeneity of pedagogies, tensions in students' perceptions of their professional role, and culture of HSS integration. The authors call for the reexamination of 5 issues influencing HSS receptivity: student recruitment processes, faculty development, building an HSS academic "home," evaluation metrics, and transparent collaboration between medical schools. To fulfill the social obligation of meeting patients' needs, educators must seek a shared understanding of underlying challenges of HSS innovations.

Imprinting on Clinical Rotations: Multisite Survey of High- and Low-Value Medical Student Behaviors and Relationship with Healthcare Intensity

BACKGROUND

Physician behaviors are important to high-value care, and the learning environment medical students encounter on clinical clerkships may imprint their developing practice patterns.

OBJECTIVES

To explore potential imprinting on clinical rotations by (a) describing high- and low-value behaviors among medical students and (b) examining relationships with regional healthcare intensity (HCI).

DESIGN

Multisite cross-sectional survey PARTICIPANTS: Third- and fourth-year students at nine US medical schools MAIN MEASURES: Survey items measured high-value (n = 10) and low-value (n = 9) student behaviors. Regional HCI was measured using Dartmouth Atlas End-of-Life Chronic Illness Care data (ratio of physician visits per decedent compared with the US average, hospital care intensity index, ratio of medical specialty to primary care physician visits per decedent). Associations between regional HCI and student behaviors were examined using unadjusted and adjusted (controlling for age, sex, and year in school) logistic regression analyses, using median item ratings to summarize reported engagement in high- and low-value behaviors.

KEY RESULTS

Of 2623 students invited, 1304 (50%) responded. Many reported trying to determine healthcare costs (1085/1234, 88%), but only 45% (571/1257) reported including cost details in case presentations. Students acknowledged suggesting tests solely to anticipate what their supervisor would want (1143/1220, 94%), show off their ability to generate a broad differential diagnosis (1072/1218, 88%), satisfy curiosity (958/1217, 79%), protect the team from liability (938/1215, 77%), and build clinical experience (533/1217, 44%). Students in higher intensity regions reported significantly more low-value behaviors: each one-unit increase in the ratio of physician visits per decedent increased the odds of reporting low-value behaviors by 20% (OR 1.20, 95% CI 1.04-1.38; P = 0.01).

CONCLUSIONS

Third- and fourth-year medical students report engaging in both high- and low-value behaviors, which are related to regional HCI. This underscores the importance of the clinical learning environment and suggests imprinting is already underway during medical school.

Validity of the Health Systems Science Examination: Relationship Between Examinee Performance and Time of Training

The health systems science (HSS) framework articulates systems-relevant topics that medical trainees must learn to be prepared for physician practice. As new HSS-related curricula are developed, measures demonstrating appropriate levels of reliability and validity are needed. The authors describe a collaborative effort between a consortium of medical schools and the National Board of Medical Examiners to create a multiple-choice HSS examination in the areas of evidence-based medicine/population health, patient safety, quality improvement, and teamwork. Fifteen schools administered the 100-question examination through 2 academic years a total of 1887 times to 1837 first-time takers. Total test score mean was 67% (SD 11%). Total test reliability as measured by coefficient α was .83. This examination differentiated between medical students who completed the examination before, during, and after relevant training/instruction. This new HSS examination can support and inform the efforts of institutions as they integrate HSS-related content into their curricula.

Leadership education for physicians-how it fits in their culture

None

Developing a Professional Identity as a Change Agent Early in Medical School: the Students' Voice

As health systems are adapting to increased accountability for quality outcomes, population health, and collaborative care, medical schools are adapting curricula to better prepare physicians to function in health systems. Two components of this educational transformation are (1) increasing physician competence in Health Systems Science, including quality, population health, social determinants of health, and interprofessional collaboration, and (2) providing roles for students to act as change agents while adding value to the health system. The authors, three medical students who served as patient navigators during their first year of medical school, provide perspectives regarding their clinical systems learning roles, which spanned the levels of individual patients, clinic operations, and the health system. Specifically, authors describe working with a struggling patient, developing an intake assessment tool to aid clinical operations, and creating a directory of community-based resources. Authors discuss educational benefits, including understanding social determinants of health, barriers to care, and inefficiencies within the healthcare system. Several challenges are explored, including the importance of student initiative and concerns about traditional curricular outcomes. Through early experiences, students describe developing a professional identity as a change agent, while also learning key competencies required for clinical practice.

New Educator Roles for Health Systems Science: Implications of New Physician Competencies for U.S. Medical School Faculty

To address gaps in U.S. health care outcomes, medical education is evolving to incorporate new competencies, as well as to align with care delivery transformation and prepare systems-ready providers. These new health systems science (HSS) competencies-including value-based care, quality improvement, social determinants of health, population health, informatics, and systems thinking-require formal education and role modeling in both classroom and clinical settings. This is challenging because few faculty had formal training in how to practice or teach these concepts. Thus, these new competencies require both expanding current educators' skills and a new cohort of educators, especially interprofessional clinicians. Additionally, because interprofessional teams are the foundation of many clinical learning environments, medical schools are developing innovative experiential activities that include interprofessional clinicians as teachers. This combination of a relative "expertise vacuum" within the current cohort of medical educators and expanding need for workplace learning opportunities requires a reimagining of medical school teachers. Based on experiences implementing HSS curricula at two U.S. medical schools (Penn State College of Medicine and University of California, San Francisco, School of Medicine, starting in 2013), this Perspective explores the need for new educator competencies and the implications for medical education, including the need to identify and integrate "new" educators into the education mission, develop faculty educators' knowledge and skills in HSS, and acknowledge and reward new and emerging educators. These efforts have the potential to better align the clinical and education missions of academic health centers and cultivate the next generation of physician leaders.

Developing Tomorrow's Leaders: A Medical Student Distinction Track in Health System Transformation and Leadership

PROBLEM

Calls for medical education reform focus on preparing physicians to meet the challenges of today's complex health care system. Despite implementing curricula focused on health systems science (HSS), including quality improvement (QI), patient safety, team-based care, and population health, a significant gap remains in training students to meet the system's evolving needs.

APPROACH

Brody School of Medicine redesigned its curriculum to prepare leaders to effect health system change. This included development of a distinction track in health system transformation and leadership, known as the Leaders in INnovative Care (LINC) Scholars Program. Selected LINC scholars spend eight weeks in a summer immersion experience designed to provide foundational knowledge and practical application.

OUTCOMES

Two cohorts (15 LINC scholars) completed the summer immersion in 2015 and 2016. Participants demonstrated significant improvement in knowledge and confidence and continue to be engaged in ongoing QI projects throughout the health system. All scholars have presented their work at local, regional, or national meetings. Students rated patient navigation experiences, health system leader interviews, QI project application, and interprofessional experiences as most valuable and recommended adoption in the curriculum for all students.

NEXT STEPS

A distinction track with an immersion component can be an effective method to pilot innovative HSS components for the entire curriculum while preparing a cadre of learners with advanced expertise. To longitudinally measure HSS knowledge change, behavioral impact, and organization-level outcomes, next steps must focus on development of workplace-based assessments, establishment of learner portfolios, and longitudinal tracking of student outcomes, including career trajectory.

High-Value, Cost-Conscious Communication Skills in Undergraduate Medical Education: Validity Evidence for Scores Derived from Two Standardized Patient Scenarios

INTRODUCTION

Training in high-value, cost-conscious care (HVCCC) is increasingly being incorporated into medical school curricula, but students may have limited opportunities to engage patients in HVCCC conversations. The aim of this study was to develop two standardized patient scenarios with associated checklists, hypothesizing that resulting scores would allow for valid formative assessments of HVCCC communication skills.

METHODS

Scenarios were designed to generate a less-is-more conversation (in response to a patient requesting an unnecessary test) and a shared decision-making conversation (in response to a patient choosing between multiple effective treatment options). Checklists were developed by experts and informed by the existing literature. Validity evidence was collected from content, response process, internal structure, relations to other variables, and consequences of testing.

RESULTS

Ninety-three third-year medical students participated during 2014-2015. Mean checklist scores were 79% (SD = 18, Cronbach α = 0.72) and 72% (SD = 13, Cronbach α = 0.62) for the less-is-more and shared decision-making scenarios, respectively. Checklist scores correlated with global ratings of performance (r = 0.65 and 0.54, respectively, both P < 0.001), and overall interrater reliability was good (r = 0.66). Checklist scores discriminated between higher and lower performers (discrimination indices of 0.84 and 0.65, respectively, both P < 0.001). Most students (83/90, 92%) agreed that the session improved their HVCCC communication skills.

CONCLUSIONS

This study provides validity evidence supporting the use of scores derived from two standardized patient scenarios for formative assessment of HVCCC communication skills among third-year medical students. These scenarios can help equip students with practical, patient-centered strategies for promoting value in clinical encounters.

Attitudes toward cost-conscious care among U.S. physicians and medical students: analysis of national cross-sectional survey data by age and stage of training

BACKGROUND

The success of initiatives intended to increase the value of health care depends, in part, on the degree to which cost-conscious care is endorsed by current and future physicians. This study aimed to first analyze attitudes of U.S. physicians by age and then compare the attitudes of physicians and medical students.

METHODS

A paper survey was mailed in mid-2012 to 3897 practicing physicians randomly selected from the American Medical Association Masterfile. An electronic survey was sent in early 2015 to all 5,992 students at 10 U.S. medical schools. Survey items measured attitudes toward cost-conscious care and perceived responsibility for reducing healthcare costs. Physician responses were first compared across age groups (30-40 years, 41-50 years, 51-60 years, and > 60 years) and then compared to student responses using Chi square tests and logistic regression analyses (controlling for sex).

RESULTS

A total of 2,556 physicians (65%) and 3395 students (57%) responded. Physician attitudes generally did not differ by age, but differed significantly from those of students. Specifically, students were more likely than physicians to agree that cost to society should be important in treatment decisions (p < 0.001) and that physicians should sometimes deny beneficial but costly services (p < 0.001). Students were less likely to agree that it is unfair to ask physicians to be cost-conscious while prioritizing patient welfare (p < 0.001). Compared to physicians, students assigned more responsibility for reducing healthcare costs to hospitals and health systems (p < 0.001) and less responsibility to lawyers (p < 0.001) and patients (p < 0.001). Nearly all significant differences persisted after controlling for sex and when only the youngest physicians were compared to students.

CONCLUSIONS

Physician attitudes toward cost-conscious care are similar across age groups. However, physician attitudes differ significantly from medical students, even among the youngest physicians most proximate to students in age. Medical student responses suggest they are more accepting of cost-conscious care than physicians and attribute more responsibility for reducing costs to organizations and systems rather than individuals. This may be due to the combined effects of generational differences, new medical school curricula, students' relative inexperience providing cost-conscious care within complex healthcare systems, and the rapidly evolving U.S. healthcare system.

The clarion call for a third wave in medical education to optimise healthcare in the twenty-first century

During the years preceding 1910, the education and training of physicians (doctors) -to-be was based mainly on a master-apprentice model; the primary focus then was on the teaching and development of clinical skills. In 1910, however, Abraham Flexner submitted a highly influential report to the American medical authorities: in it, he recommended that all medical schools should be university-based and that, importantly, medical practice should have a scientific basis strongly underpinned by the basic medical sciences. The recommendation provided the impetus for the design of medical education that begins with a pre-clinical phase to provide the strong scientific foundation for the clinical phase that follows. During the clinical phase, student learning will focus primarily on the clinical sciences relating to the diagnosis, treatment and management of patient care. Thus, two key 'pillars' (the basic sciences and the clinical sciences) of medical education were established; this two pillar model of medical education persisted for many decades thereafter and remained so till today. However, in order to optimise delivery of health care this must be viewed as an 'eco-system' taking into account the practice setting both present and future. The authors will attempt to provide a background to the changing trends in medical education and the changing practice environment, due primarily to the disruptive forces of change in this article.

Understanding Clerkship Student Roles in the Context of 21st-Century Healthcare Systems and Curricular Reform

Phenomenon: Preclerkship medical education has undergone extensive reform, and the clerkship years are growing targets for curricular innovation. As institutions implement new preclerkship curricula to better prepare medical students to practice medicine in the context of modern healthcare systems, the perspective of clerkship leaders regarding clerkship student roles and potential for change will facilitate redefining these roles so that preclerkship educational innovations can continue into clerkships. Approach: In this qualitative exploratory study, authors conducted semistructured interviews with clerkship and site directors for eight core clerkships from April to May 2016. Questions addressed how clerkship leaders perceive current student roles and the potential for change. Through iterative consensus building, authors identified themes describing current ideal clerkship student roles applicable to future roles. Findings: Twenty-three of 24 (96%) directors participated. Findings fell into four themes: factors influencing the clerkship role, clerkship student role archetypes, workplace authenticity and value, and potential for change. Student, supervisor, and context factors determine the clerkship student role. Three role archetypes emerged: the apprentice (an assistant completing concrete patient care tasks), the academic (a researcher bringing literature back to the team), and the communicator (an interdisciplinary and patient liaison). Each archetype was considered authentic and valuable. Positive attitudes toward preclerkship curricular changes were associated with openness to evolution of the clerkship students' role. These emerging roles mapped to the archetypes. Insights: Clerkship leaders perceive that student, supervisor, and context factors result in varying emphasis on role archetypes, which in turn lead to different types of learning. Medical educators can use the archetypes to articulate how expanded student roles align learning with clinical needs, particularly as they relate to health systems science and inquiry.

Concerns and Responses for Integrating Health Systems Science Into Medical Education

With the aim of improving the health of individuals and populations, medical schools are transforming curricula to ensure physician competence encompasses health systems science (HSS), which includes population health, health policy, high-value care, interprofessional teamwork, leadership, quality improvement, and patient safety. Large-scale, meaningful integration remains limited, however, and a major challenge in HSS curricular transformation efforts relates to the receptivity and engagement of students, educators, clinicians, scientists, and health system leaders. The authors identify several widely perceived challenges to integrating HSS into medical school curricula, respond to each concern, and provide potential strategies to address these concerns, based on their experiences designing and integrating HSS curricula. They identify two broad categories of concerns: the (1) relevance and importance of learning HSS-including the perception that there is inadequate urgency for change; HSS education is too complex and should occur in later years; early students would not be able to contribute, and the roles already exist; and the science is too nascent-and (2) logistics and practicality of teaching HSS-including limited curricular time, scarcity of faculty educators with expertise, lack of support from accreditation agencies and licensing boards, and unpreparedness of evolving health care systems to partner with schools with HSS curricula. The authors recommend the initiation and continuation of discussions between educators, clinicians, basic science faculty, health system leaders, and accrediting and regulatory bodies about the goals and priorities of medical education, as well as about the need to collaborate on new methods of education to reach these goals.

The Teachers of Quality Academy: Evaluation of the Effectiveness and Impact of a Health Systems Science Training Program

This project aimed to evaluate the effectiveness of a faculty development program in health systems science (HSS)-the Teachers of Quality Academy (TQA). Participants in TQA and a comparison group were evaluated before, during, and 1 year after the program using self-perception questionnaires, tests of HSS knowledge, and tracking of academic productivity and career advancement. Among program completers (n = 27), the mean self-assessed ratings of knowledge and skills of HSS topics immediately after the program, as compared to baseline, increased significantly compared to controls (n = 30). Participants demonstrated progressive improvement of self-perceived skills and attitudes, and retention of HSS knowledge, from baseline to completion of the program. Participants also demonstrated substantially higher HSS scholarly productivity, leadership, and career advancement compared to the comparison group. The TQA effectively created a faculty cadre able to role model, teach, and create a curriculum in HSS competencies for medical students, resident physicians, and other health professionals.

Aligning Education With Health Care Transformation: Identifying a Shared Mental Model of "New" Faculty Competencies for Academic Faculty

PURPOSE

To develop a potential competency framework for faculty development programs aligned with the needs of faculty in academic health centers (AHCs).

METHOD

In 2014 and 2015, the authors interviewed 23 health system leaders and analyzed transcripts using constant comparative analysis and thematic analysis. They coded competencies and curricular concepts into subcategories. Lead investigators reviewed drafts of the categorization themes and subthemes related to gaps in faculty knowledge and skills, collapsed and combined competency domains, and resolved disagreements via discussion.

RESULTS

Through analysis, the authors identified four themes. The first was core functional competencies and curricular domains for conceptual learning, including patient-centered care, health care processes, clinical informatics, population and public health, policy and payment, value-based care, and health system improvement. The second was the need for foundational competency domains, including systems thinking, change agency/management, teaming, and leadership. The third theme was paradigm shifts in how academic faculty should approach health care, categorized into four areas: delivery, transformation, provider characteristics and skills, and education. The fourth theme was the need for faculty to be aware of challenges in the culture of AHCs as an influential context for change.

CONCLUSIONS

This broad competency framework for faculty development programs expands existing curricula by including a comprehensive scope of health systems science content and skills. AHC leaders can use these results to better align faculty education with the real-time needs of their health systems. Future work should focus on optimal prioritization and methods for teaching.

A Constructive Reframing of Student Roles and Systems Learning in Medical Education Using a Communities of Practice Lens

Health systems are in the midst of a transformation that is being driven by a variety of forces. This has important implications for medical educators because clinical practice environments play a key role in learning and professional development, and evolving health systems are beginning to demand that providers have "systems-ready" knowledge, attitudes, and skills. Such implications provide a clear mandate for medical schools to modify their goals and prepare physicians to practice flexibly within teams and effectively contribute to the improvement of health care delivery. In this context, the concepts of value-added medical education, authentic student roles, and health systems science are emerging as increasingly important. In this Article, the authors use a lens informed by communities of practice theory to explore these three concepts, examining the implications that the communities of practice theory has in the constructive reframing of educational practices-particularly common student roles and experiences-and charting future directions for medical education that better align with the needs of the health care system. The authors apply several key features of the communities of practice theory to current experiential roles for students, then propose a new approach to students' clinical experiences-value-added clinical systems learning roles-that provides students with opportunities to make meaningful contributions to patient care while learning health systems science at the patient and population level. Finally, the authors discuss implications for professional role formation and anticipated challenges to the design and implementation of value-added clinical systems learning roles.

Science of Health Care Delivery: An Innovation in Undergraduate Medical Education to Meet Society's Needs

The purpose of this special article is to describe a new, 4-year Science of Health Care Delivery curriculum at Mayo Clinic School of Medicine, including curricular content and structure, methods for instruction, partnership with Arizona State University, and implementation challenges. This curriculum is intended to ensure that graduating medical students enter residency prepared to train and eventually practice within person-centered, community- and population-oriented, science-driven, collaborative care teams delivering high-value care. A Science of Health Care Delivery curriculum in undergraduate medical education is necessary to successfully prepare physicians so as to ensure the best clinical outcomes and patient experience of care, at the lowest cost.

How Can Medical Students Add Value? Identifying Roles, Barriers, and Strategies to Advance the Value of Undergraduate Medical Education to Patient Care and the Health System

PURPOSE

As health systems evolve, the education community is seeking to reimagine student roles that combine learning with meaningful contributions to patient care. The authors sought to identify potential stakeholders regarding the value of student work, and roles and tasks students could perform to add value to the health system, including key barriers and associated strategies to promote value-added roles in undergraduate medical education.

METHOD

In 2016, 32 U.S. medical schools in the American Medical Association's (AMA's) Accelerating Change in Education Consortium met for a two-day national meeting to explore value-added medical education; 121 educators, systems leaders, clinical mentors, AMA staff leadership and advisory board members, and medical students were included. A thematic qualitative analysis of workshop discussions and written responses was performed, which extracted key themes.

RESULTS

In current clinical roles, students can enhance value by performing detailed patient histories to identify social determinants of health and care barriers, providing evidence-based medicine contributions at the point-of-care, and undertaking health system research projects. Novel value-added roles include students serving as patient navigators/health coaches, care transition facilitators, population health managers, and quality improvement team extenders. Six priority areas for advancing value-added roles are student engagement, skills, and assessments; balance of service versus learning; resources, logistics, and supervision; productivity/billing pressures; current health systems design and culture; and faculty factors.

CONCLUSIONS

These findings provide a starting point for collaborative work to positively impact clinical care and medical education through the enhanced integration of value-added medical student roles into care delivery systems.

Science of health care delivery milestones for undergraduate medical education

BACKGROUND

The changing healthcare landscape requires physicians to develop new knowledge and skills such as high-value care, systems improvement, population health, and team-based care, which together may be referred to as the Science of Health Care Delivery (SHCD). To engender public trust and confidence, educators must be able to meaningfully assess physicians' abilities in SHCD. We aimed to develop a novel set of SHCD milestones based on published Accreditation Council for Graduate Medical Education (ACGME) milestones that can be used by medical schools to assess medical students' competence in SHCD.

METHODS

We reviewed all ACGME milestones for 25 specialties available in September 2013. We used an iterative, qualitative process to group the ACGME milestones into SHCD content domains, from which SHCD milestones were derived. The SHCD milestones were categorized within the current ACGME core competencies and were also mapped to Association of American Medical Colleges' Entrustable Professional Activities (AAMC EPAs).

RESULTS

Fifteen SHCD sub-competencies and corresponding milestones are provided, grouped within ACGME core competencies and mapped to multiple AAMC EPAs.

CONCLUSIONS

This novel set of milestones, grounded within the existing ACGME competencies, defines fundamental expectations within SHCD that can be used and adapted by medical schools in the assessment of medical students in this emerging curricular area. These milestones provide a blueprint for SHCD content and assessment as ongoing revisions to milestones and curricula occur.