Concerns and Responses for Integrating Health Systems Science Into Medical Education

Assembling the Pediatric Emergency Medicine Social Care Toolkit: A Modified Delphi Study

BACKGROUND

The pediatric emergency department is a high-value site for screening and resource referral for health-related social needs. However, best practices for this unique environment remain unclear. This study's objective was to introduce a consensus-based social care training toolkit for the pediatric emergency medicine (PEM) setting.

METHODS

We conducted a modified Delphi study to establish consensus on social care practice and develop a user-friendly toolkit. Initially, five priority areas (sections) were identified. Participants reviewed literature and shared their expertise to draft preliminary sections of the toolkit. Two rounds of the modified Delphi process were conducted, involving a ranking system, significant qualitative feedback, and a final approval stage, resulting in the finalized toolkit.

RESULTS

Seventeen participants were included in the Delphi process, including pediatric and general EM faculty and trainees, as well as a social worker and public health professor. Forty-two content items were ranked in the first Delphi round. Based on a combination of score cut-off and extensiveness of qualitative comments, items were either minorly edited and kept (29%) or sent back to their section for review (71%). The second Delphi round integrated further suggested edits, and all participants in this final round approved the publicly available version of the toolkit.

CONCLUSION

By utilizing diverse sources of information and a consensus-driven process of the modified Delphi, we generated best practice recommendations for the design, implementation, and training of social care programs in the PEM setting.

Needs Assessment for a Leadership Course in Saudi Medical Schools: The Student Perspective

Introduction

Leaders in healthcare no longer need to hold formal management positions; instead, leadership is perceived to be the responsibility of all healthcare professionals. Despite changes in curricula and teaching design, however, this review of the content taught in medical colleges in Saudi Arabia reveals a lack of leadership and a failure to equip young graduates to compete on the global stage. Medical students need leadership skills for patient care, cooperation, and navigating the complex healthcare system. Clinical management skills in hospitals require these talents also. The complexity of healthcare and the impact healthcare executives have on people's lives highlight the importance of these skills. Thus, healthcare practitioners must develop non-technical skills like proactivity, motivation, and change management to lead across professional boundaries and negotiate the increasingly complex healthcare landscape.

Methods

This cross-sectional study combines a quantitative approach with a self-administered questionnaire-based survey. The sampling procedure is a non-probability convenience technique, adapted for 700 male and female undergraduate medical students from four medical colleges.

Results

Of the students, 75.46% had minimal leadership experience and 22.69% had some leadership experience; 3.02% of 464 students considered themselves highly experienced in leadership.

Conclusion

As the needs assessment and other relevant factors show, leadership should be introduced as a skilled subject. There will always be a growing demand for competent medical graduates, who are capable of becoming future leaders. Although elementary leadership concepts remain fundamentally the same, curricular development must focus on the needs of society and stakeholders.

Systems-Based Practice: Expert Perspectives on the Origin and Evolution of an Ambiguous Competency

PURPOSE

Systems-based practice (SBP) has been a core competency in graduate medical education in the United States since 1999, but it has been difficult to operationalize in residency programs due to its conceptual ambiguity. The authors explored the historical origin and subsequent development of the SBP competency from the perspective of individuals who were influential across critical phases of its implementation and ensuing development. The goal of this study was to elicit the history of SBP from the perspective of individuals who have expertise in it and to use those findings to inform the current SBP construct.

METHOD

Between March and July 2021, 24 physicians, nurses, educators, and leaders in the field of SBP were individually interviewed about the origin and meaning of SBP as practiced in U.S. medical education using a semistructured guide. Individuals were selected based upon their influence on the origin or evolution of the SBP competency. Data were iteratively collected and analyzed using real-time analytic memos, regular adjudication sessions with the research team, and thematic analysis. Researchers identified themes from participants' perspectives and agreed upon the final results and quotations.

RESULTS

Five themes were identified: SBP has many different definitions, SBP was intentionally designed to be vague, systems thinking was identified as the foundation of the SBP competency, the 6 core competencies established in the United States by the Accreditation Council for Graduate Medical Education were developed to be interdependent, and the SBP and practice-based learning and improvement competencies are uniquely related and synergistic.

CONCLUSIONS

Interview data indicate that since its inception, SBP has been a nuanced and complex competency, resulting in a lack of mutually shared understanding among stakeholders. This deliberate historical examination of expert perspectives provides insight into specific areas for improving how SBP is taught and learned.

Systems-Based Practice in Graduate Medical Education: Evolving Toward an Ideal Future State

ABSTRACT

Systems-based practice (SBP) was first introduced as a core competency in graduate medical education (GME) in 2002 by the Accreditation Council for Graduate Medical Education as part of the Outcomes Project. While inclusion of SBP content in GME has become increasingly common, there have also been well-documented stumbling blocks, including perceptions that SBP has eroded the amount of curricular time available for more medically focused competencies, is not relevant for some practice contexts, and is not introduced early enough in training. As a result, SBP learning experiences often feel disconnected from medical trainees' practical reality. In this commentary, the authors provide guidance regarding potential changes that may facilitate the evolution of SBP toward an ideal future state where graduates bring a systems science mindset to all aspects of their work. Specific suggestions include the following: (1) expanding the SBP toolbox to reflect current-day health system needs, (2) evolve the teaching methodology, (3) broadening the scope of relevant SBP content areas, and (4) emphasizing SBP as an integrated responsibility for all health care team members. Levers to enact this transformation exist and must be used to influence change at the learner, faculty, program, and clinical learning environment levels.Physicians operate within an increasingly complex health care system that highlights the intersection of health care with complex social, environmental, and relational contexts. Consequently, the role of SBP in both physician work responsibilities and educational requirements continues to expand. To meet this growing demand, GME must adapt how it supports and trains the next generation of systems thinkers, ensuring they understand how levers in the health care system directly affect health outcomes for their patients, and integrate SBP into the foundation of GME curricula in an inclusive, holistic, and unrestrained way.

Twelve tips for creating a longitudinal quality improvement and safety education for early health professions students

Despite the numerous calls for integrating quality improvement and patient safety (QIPS) curricula into health professions education, there are limited examples of effective implementation for early learners. Typically, pre-clinical QIPS experiences involve lectures or lessons that are disconnected from the practice of medicine. Consequently, students often prioritize other content they consider more important. As a result, they may enter clinical settings without essential QIPS skills and struggle to incorporate these concepts into their early professional identity formation. In this paper, we present twelve tips aimed at assisting educators in developing QIPS education early in the curricula of health professions students. These tips address various key issues, including aligning incentives, providing longitudinal experiences, incorporating real-world care outcomes, optimizing learning environments, communicating successes, and continually enhancing education and care delivery processes.

Advancement, barriers and collaboration: the ABC's of addressing challenges and designing solutions between front-line physicians and business-oriented leaders

BACKGROUND

The complexity of US healthcare has been increasing for many years, requiring clinicians and learners to understand care delivery systems in addition to clinical sciences. Thus, there has been a major push to educate faculty and trainees on healthcare functionality. This comes as hospitals expand into health systems requiring the help of more sophisticated expertise of departments such as operations excellence when problem-solving. As a medical student with a background in operations excellence, medical education leader and clinical administration leader all currently facilitating this transition, we wanted to reflect on the barriers we have experienced in clinical implementation of quality improvement projects and educating learners on the impact of operations excellence principles in their clinical education.

METHODS

The ideas presented in this article were the result of a several collaborative discussion between the authors, on the key challenges to adopting operations excellence principles into health system science education. In an effort to add context to this reflection through the current body of research present, they supplemented a literature review on the topic which included 86 studies published between 2013 and 2021 regarding health systems science and healthcare leadership engagement in the USA. The themes that intersected between the literature review and the discussions were then expanded on in this paper.

RESULTS

Through this process, we identified four challenges: (1) the difference in thinking styles, which we term, 'mental model differences'; (2) the strategic nature of process improvement projects and how that collides with physician priorities, or 'the chess game of stakeholder engagement'; (3) the language and precise methodology, or 'consistency of language and need for administrative resilience' and (4) the issue of teaching these concepts or bridging the learning gap.'

CONCLUSION

In an increasingly complex healthcare landscape, physicians and trainee's need to bridge gaps between the mental models of administrative and clinical workflow.

Training the next generation of delivery science researchers: 10-year experience of a post-doctoral research fellowship program within an integrated care system

Introduction

Learning health systems require a workforce of researchers trained in the methods of identifying and overcoming barriers to effective, evidence-based care. Most existing postdoctoral training programs, such as NIH-funded postdoctoral T32 awards, support basic and epidemiological science with very limited focus on rigorous delivery science methods for improving care. In this report, we present the 10-year experience of developing and implementing a Delivery Science postdoctoral fellowship embedded within an integrated health care delivery system.

Methods

In 2012, the Kaiser Permanente Northern California Division of Research designed and implemented a 2-year postdoctoral Delivery Science Fellowship research training program to foster research expertise in identifying and addressing barriers to evidence-based care within health care delivery systems.

Results

Since 2014, 20 fellows have completed the program. Ten fellows had PhD-level scientific training, and 10 fellows had clinical doctorates (eg, MD, RN/PhD, PharmD). Fellowship alumni have graduated to faculty research positions at academic institutions (9), and research or clinical organizations (4). Seven alumni now hold positions in Kaiser Permanente's clinical operations or medical group (7).

Conclusions

This delivery science fellowship program has succeeded in training graduates to address delivery science problems from both research and operational perspectives. In the next 10 years, additional goals of the program will be to expand its reach (eg, by developing joint research training models in collaboration with clinical fellowships) and strengthen mechanisms to support transition from fellowship to the workforce, especially for researchers from underrepresented groups.

French-speaking Swiss physician's perceptions and perspectives regarding their competencies and training need in leadership and management: a mixed-methods study

INTRODUCTION

Effective leadership and management (L&M) are essential to the success of health care organizations. Young medical leaders often find themselves ill-prepared to take on these new responsibilities, but rarely attend training in L&M skills. The aims of this study were to evaluate physician's self-perceived competencies and training needs for L&M, to identify available regional L&M training, and to highlight opportunities, challenges and threats regarding physicians' training in medical L&M in the French-speaking part of Switzerland.

METHODS

We conducted a mixed methods study in three steps: (1) a survey on perceived L&M competencies and training needs (5 dimensions) to all physicians of a Swiss University Hospital (N = 2247); (2) a mapping of the Swiss French speaking L&M training programs through analysis of hospital websites and interviews; and (3) semi-structured interviews with L&M program coordinators about the programs' strengths and weaknesses as well as the opportunities and challenges to include physicians in such training. We used analysis of variance to compare differences in perceived competences between physicians of different hierarchical status and used Cramer's V to measure the association's degree between physicians' training needs and prior training in L&M and hierarchical status. We analysed semi-structured interviews using thematic analysis.

RESULTS

Five-hundred thirty-two physicians responded (24%). Physicians perceived themselves as rather competent in most leadership dimensions. More experienced physicians reported a higher sense of competence in all dimensions of leadership (e.g. Working with others: F = 15.55, p < .001; Managing services: F = 46.89, p < .001). Three competencies did not vary according to the hierarchical status: emotional intelligence (F = 1.56, p = .20), time management (F = 0.47, p = .70) and communicating (F = 1.97, p = .12). There was a weak to moderate association between the responders' self-perceived needs for training and their hierarchal status for all competencies (Cramer's V ∈ [0.16;0.35]). Physicians expressed a strong desire to seek out training for all competencies, especially for knowing one's leadership style (82%), managing teams (83%), and managing conflict (85%). Although existing local L&M training programs covered most relevant topics, only a forth of responders had attended any type of training. L&M program coordinators identified several facilitators and barriers to physician attendance on institutional (matching reality and training), relational (managing collective intelligence), and individual levels (beliefs and self-perceived identity).

CONCLUSIONS

French-speaking Swiss hospital physicians clearly express training needs for L&M skills although they only rarely attend such training programs. Reasons for non-attendance to such programs should be explored in order to understand physicians' low participation rates in these trainings.

Health Systems Science - A Primer for Radiologists

Health systems science (HSS) is an educational framework designed to promote improved care through enhanced citizenship and the training of systems-fluent individuals trained in the science of health care delivery.  HSS education in residency builds upon foundations established during medical school, emphasizing practical skills development, and fostering a growth mindset among trainees.  The HSS framework organizes elements of system-based practice for radiology trainees, promoting practice-readiness for providing safe, timely, effective, efficient, equitable and patient centered radiological care. This paper serves as a primer for radiologists to understand and apply the HSS framework. Additionally, we highlight radiology-specific curricular elements aligned with the HSS framework, and provide teaching resources both for classroom education and for resident self-study.

Learning by doing: A phenomenological study of medical student leaders

INTRODUCTION

Despite being recognised as a key physician competency, leadership development is an area of improvement especially in undergraduate medical education. We sought to explore the lived experience of leaders who served in elected, representative roles during their time in medical school.

METHODS

We used a hermeneutic phenomenological approach to uncover the essence of the medical student leader experience. From late 2020 to early 2021, we interviewed 12 medical residents who served in elected leadership roles from 2015 to 2019. Each participant graduated from a different Canadian medical school. We deliberately chose a limited and historic time period in order for participants to be able to reflect on their past experiences while accounting for differences in the medical student leadership experience over time. We then engaged in a reflexive thematic analysis to generate the final themes.

RESULTS

We identified the following five themes: (i) living with busyness, (ii) the role of faculty mentorship and support, (iii) competing demands of leadership, (iv) medical student leadership as enriching and (v) creating better physicians. Though demanding, medical student leadership was found to be rewarding and particularly key in the development of a more well-rounded physician. Furthermore, being well supported by faculty contributed to an overall positive leadership experience.

DISCUSSION

In addition to describing the hardships and rewards that make up their experience, this study suggests that medical student leadership can enhance core physician competencies. The findings also support the notion that faculties have an important role to play in supporting medical student leaders.

Examining the nexus between medical education and complexity: a systematic review to inform practice and research

BACKGROUND

Medical education is a multifarious endeavour integrating a range of pedagogies and philosophies. Complexity as a science or theory ('complexity') signals a move away from a reductionist paradigm to one which appreciates that interactions in multi-component systems, such as healthcare systems, can result in adaptive and emergent outcomes. This examination of the nexus between medical education and complexity theory aims to discover ways that complexity theory can inform medical education and medical education research.

METHODS

A structured literature review was conducted to examine the nexus between medical education and complexity; 5 databases were searched using relevant terms. Papers were included if they engaged fully with complexity as a science or theory and were significantly focused on medical education. All types of papers were included, including conceptual papers (e.g. opinion and theoretical discussions), case studies, program evaluations and empirical research. A narrative and thematic synthesis was undertaken to create a deep understanding of the use of complexity in medical education.

RESULTS

Eighty-three papers were included; the majority were conceptual papers. The context and theoretical underpinnings of complexity as a relevant theory for medical education were identified. Bibliographic and temporal observations were noted regarding the entry of complexity into medical education. Complexity was relied upon as a theoretical framework for empirical studies covering a variety of elements within medical education including: knowledge and learning theories; curricular, program and faculty development; program evaluation and medical education research; assessment and admissions; professionalism and leadership; and learning for systems, about systems and in systems.

DISCUSSION

There is a call for greater use of theory by medical educators. Complexity within medical education is established, although not widespread. Individualistic cultures of medicine and comfort with reductionist epistemologies challenges its introduction. However, complexity was found to be a useful theory across a range of areas by a limited number of authors and is increasingly used by medical educators and medical education researchers. This review has further conceptualized how complexity is being used to support medical education and medical education research.

CONCLUSION

This literature review can assist in understanding how complexity can be useful in medical educationalists' practice.

Extracurricular activities in medical education: an integrative literature review

BACKGROUND

The importance of extracurricular activities (EAs) has been emphasized in medical education. These activities could enhance medical students' emotional and physical health and afford them developmental opportunities. Despite the growing amount of research related to this theme, few studies review and synthesize the existing literature. This study aims to provide an understanding of the educational implications of EAs in medical colleges and constructs an integrated conceptual framework concerning their types and learning outcomes by literature review.

METHODS

An integrative literature review was conducted following Torraco's method, with the aim to generate a new framework for the given topic. The authors utilized Scopus and PubMed as databases, using search terms "extracurricular," "medical," and "students." Initially, titles and abstracts were screened to include relevant studies, and the researchers verified the eligibility of the articles by following the inclusion and exclusion criteria. Of the 263 articles identified, 64 empirical studies were selected for further review.

RESULTS

EAs in undergraduate medical education can be classified into direct extracurricular activities and indirect extracurricular activities, the latter of which is sorted into nine sub-categories. We identified seven main categories regarding the learning outcomes of EAs. In addition to general activities (e.g., pro-social activities, team sports), some distinctive activities such as research have been largely addressed in previous studies. The results of EAs were discussed in relation to academic growth, career development, and psychological experiences.

CONCLUSIONS

This review identified the types and learning outcomes of EAs in the context of medical education, thereby suggesting ways to improve the quality of EAs and maximize their educational effects.

Assessing the current and desired levels of training and applied experiences in chronic disease prevention of students during medical school

INTRODUCTION

Chronic diseases account for approximately 70% of deaths in the U.S. annually. Though physicians are uniquely positioned to provide behavior change counseling for chronic disease prevention, they often lack the necessary training and self-efficacy. This study examined medical student interest in receiving chronic disease prevention training as a formal part of their education as part of an effort to enhance their ability to provide guidance to patients in the future.

METHODS

A 23-question, online survey was sent to all undergraduate medical students enrolled in a large medical education program. The survey assessed medical student interest in receiving training related to chronic disease prevention. Survey topics included student awareness of primary prevention programs, perceived importance of receiving training and applied experience in chronic disease prevention, and preferences for how and when to receive this training.

RESULTS

Of 793 eligible medical students, 432 completed the survey (54.5%). Overall, 92.4% of students reported receiving formal training in physical activity, public health, nutrition, obesity, smoking cessation, and chronic diseases was of "very high" or "high" importance. Despite this level of importance, students most frequently reported receiving no or 1-5 h of formal training in a number of topics, including physical activity (35.4% and 47.0%, respectively) and nutrition (16.9% and 56.3%, respectively). The level of importance given to public health training was significantly greater across degree type (p = 0.0001) and future specialty (p = 0.03) for MD/MPH students and those interested in primary care, respectively.

CONCLUSIONS

While medical students perceive chronic disease prevention as an important topic, most reported receiving little to no formal training. To address the growing prevalence of chronic disease across our society, programs schools should place greater emphasis on integrating training in physical activity, nutrition, and obesity-related content into the medical education curriculum.

"Finding My Piece in That Puzzle": A Qualitative Study Exploring How Medical Students at Four U.S. Schools Envision Their Future Professional Identity in Relation to Health Systems

PURPOSE

Health systems science (HSS) curricula equip future physicians to improve patient, population, and health systems outcomes (i.e., to become "systems citizens"), but the degree to which medical students internalize this conception of the physician role remains unclear. This study aimed to explore how students envision their future professional identity in relation to the system and identify experiences relevant to this aspect of identity formation.

METHOD

Between December 2018 and September 2019, authors interviewed 48 students at 4 U.S. medical schools with HSS curricula. Semistructured interviews were audiorecorded, transcribed, and analyzed iteratively using inductive thematic analysis. Interview questions explored how students understood the health system, systems-related activities they envisioned as future physicians, and experiences and considerations shaping their perspectives.

RESULTS

Most students anticipated enacting one or more systems-related roles as a future physician, categorized as "bottom-up" efforts enacted at a patient or community level (humanist, connector, steward) or "top-down" efforts enacted at a system or policy level (system improver, system scholar, policy advocate). Corresponding activities included attending to social determinants of health or serving medically underserved populations, connecting patients with team members to address systems-related barriers, stewarding health care resources, conducting quality improvement projects, researching/teaching systems topics, and advocating for policy change. Students attributed systems-related aspirations to experiences beyond HSS curricula (e.g., low-income background; work or volunteer experience; undergraduate studies; exposure to systems challenges affecting patients; supportive classmates, faculty, and institutional culture). Students also described future-oriented considerations promoting or undermining identification with systems-related roles (responsibility, affinity, ability, efficacy, priority, reality, consequences).

CONCLUSIONS

This study illuminates systems-related roles medical students at 4 schools with HSS curricula envisioned as part of their future physician identity and highlights past/present experiences and future-oriented considerations shaping identification with such roles. These findings inform practical strategies to support professional identity formation inclusive of systems engagement.

Design and implementation of a health systems science curriculum at a large teaching hospital

BACKGROUND

Physicians must increasingly lead change for improvement in the value of health care for individuals and populations. Leadership, stewardship, and population health competencies are not explicitly part of the Accreditation Council for Graduate Medical Education (ACGME) requirements and are best appreciated in the context of Health Systems Science (HSS). HSS education is best approached at the institutional level, yet almost all graduate medical education (GME) curriculum is at the program level. We describe the process of designing and implementing an institutional HSS GME curriculum in a hospital-based sponsoring institution.

METHODS

A group of diverse stakeholders drafted a curriculum to build competencies in leadership, stewardship, and population health, which was further refined by our Graduate Medical Education Committee (GMEC) and Resident Forum in the academic years 2015-2017. The refined curriculum was implemented at the institutional level of a large urban teaching hospital with over 80 ACGME accredited programs in the 2017-2018 academic year, participation was tracked and impact surveys were conducted.

RESULTS

All programs participate in at least parts of the curriculum with sustained use. Annual surveys show a progression in assessment of our target competencies and/or opportunities to reflect and provide feedback. The annual program review meeting and GMEC meetings are used to troubleshoot and identify new curricular opportunities.

CONCLUSION

This innovative institutional curriculum has been sustained for over four years and we believe that other training institutions with similar goals will find our experience implementing an institutional curriculum translatable to their clinical learning environment.

Incorporating value-based healthcare projects in residency training: a mixed-methods study on the impact of participation on understanding and competency development

OBJECTIVES

Stimulating the active participation of residents in projects with societally relevant healthcare themes, such as value-based healthcare (VBHC), can be a strategy to enhance competency development. Canadian Medical Education Directions for Specialists (CanMEDS) competencies such as leader and scholar are important skills for all doctors. In this study, we hypothesise that when residents conduct a VBHC project, CanMEDS competencies are developed. There is the added value of gaining knowledge about VBHC.

DESIGN

An explorative mixed-methods study assessing residents' self-perceived learning effects of conducting VBHC projects according to three main components: (1) CanMEDS competency development, (2) recognition of VBHC dilemmas in clinical practice, and (3) potential facilitators for and barriers to implementing a VBHC project. We triangulated data resulting from qualitative analyses of: (a) text-based summaries of VBHC projects by residents and (b) semistructured interviews with residents who conducted these projects.

SETTING

Academic and non-academic hospitals in the Netherlands.

PARTICIPANTS

Out of 63 text-based summaries from residents, 56 were selected; and out of 19 eligible residents, 11 were selected for semistructured interviews and were included in the final analysis.

RESULTS

Regarding CanMEDS competency development, the competencies 'leader', 'communicator' and 'collaborator' scored the highest. Opportunities to recognise VBHC dilemmas in practice were mainly stimulated by analysing healthcare practices from different perspectives, and by learning how to define costs and relate them to outcomes. Finally, implementation of VBHC projects is facilitated by a thorough investigation of a VBHC dilemma combined with an in-depth stakeholder analysis.

CONCLUSION

In medical residency training programmes, competency development through active participation in projects with societally relevant healthcare themes-such as VBHC-was found to be a promising strategy. From a resident's perspective, combining a thorough investigation of the VBHC dilemma with an in-depth stakeholder analysis is key to the successful implementation of a VBHC project.

Implementation of simulation-based health systems science modules for resident physicians

BACKGROUND

Health system science (HSS) encompasses both core and cross-cutting domains that emphasize the complex interplay of care delivery, finances, teamwork, and clinical practice that impact care quality and safety in health care. Although HSS skills are required during residency training for physicians, current HSS didactics have less emphasis on hands-on practice and experiential learning. Medical simulation can allow for experiential participation and reflection in a controlled environment. Our goal was to develop and pilot three simulation scenarios as part of an educational module for resident physicians that incorporated core and cross-cutting HSS domains.  METHODS: Each scenario included a brief didactic, an interactive simulation in small-group breakout rooms, and a structured debriefing. The case scenario topics consisted of educational leadership, quality and safety, and implementation science. Learners from four residency programs (psychiatry, emergency medicine, orthopedics, ophthalmology) participated January - March 2021.

RESULTS

A total of 95 resident physicians received our curricular module, and nearly all (95%) participants who completed a post-session survey reported perceived learning gains. Emotional reactions to the session were positive especially regarding the interactive role-play format. Recommendations for improvement included participation from non-physician professions and tailoring of scenarios for specific disciplines/role. Knowledge transfer included use of multiple stakeholder perspectives and effective negotiation by considering power/social structures.

CONCLUSIONS

The simulation-based scenarios can be feasibly applied for learner groups across different residency training programs. Simulations were conducted in a virtual learning environment, but future work can include in-person and actor-based simulations to further enhance emotional reactions and the reality of the case scenarios.

Optimizing allocation of curricular content across the Undergraduate & Graduate Medical Education Continuum

BACKGROUND

Medical educators struggle to incorporate socio-cultural topics into crowded curricula. The "continuum of learning" includes undergraduate and graduate medical education. Utilizing an exemplar socio-cultural topic, we studied the feasibility of achieving expert consensus among two groups of faculty (experts in medical education and experts in social determinants of health) on which aspects of the topic could be taught during undergraduate versus graduate medical education.

METHODS

A modified Delphi method was used to generate expert consensus on which learning objectives of social determinants of health are best taught at each stage of medical education. Delphi respondents included experts in medical education or social determinants of health. A survey was created using nationally published criteria for social determinants of health learning objectives. Respondents were asked 1) which learning objectives were necessary for every physician (irrespective of specialty) to develop competence upon completion of medical training and 2) when the learning objective should be taught. Respondents were also asked an open-ended question on how they made the determination of when in the medical education continuum the learning objective should be taught.

RESULTS

26 out of 55 experts (13 social determinants of health and 13 education experts) responded to all 3 Delphi rounds. Experts evaluated a total of 49 learning objectives and were able to achieve consensus for at least one of the two research questions for 45 of 49 (92%) learning objectives. 50% more learning objectives reached consensus for inclusion in undergraduate (n = 21) versus graduate medical education (n = 14).

CONCLUSIONS

A modified Delphi technique demonstrated that experts could identify key learning objectives of social determinants of health needed by all physicians and allocate content along the undergraduate and graduate medical education continuum. This approach could serve as a model for similar socio-cultural content. Future work should employ a qualitative approach to capture principles utilized by experts when making these decisions.

'Everyone is trying to outcompete each other': a qualitative study of medical student attitudes to a novel peer-assessed undergraduate teamwork module

The centrality of teamwork in ensuring the effective functioning of institutions across all sectors is undeniable. However, embedding teamwork into higher education has been hampered due to a range of deeply entrenched practices associated broadly with the foregrounding of knowledge, beliefs about the place of skill training and routines of assessment. As a result, despite an urgent need to address teamwork, little progress has been made with respect to progressing teamwork education. We have designed and evaluated a novel teamwork module delivered to fourth-year undergraduate medical students involving placements, a cocreated piece of work, reflection and summative peer assessment. This paper aimed to investigate whether the module increased students' insight into teamwork, including their own skill development, and whether their perceptions of teamwork changed. Throughout the evaluation, students played a key role, with four final-year medical students working alongside others in the multidisciplinary project team. Five distinct themes emerged from our in-depth, semi-structured interviews: (a) importance and meaning; (b) insight into skill development; (c) transferability; (d) peer assessment; and (e) resistance to teamwork education. Themes had positive and negative components, and student perceptions changed in multiple ways after experiencing a longitudinal educational opportunity to develop their teamwork skills. Before practice, students focused on superficial explanations and on where they might improve. In contrast, after practice, students conveyed deeper insights, contextualisation, focus on how they might improve, and shared structured reflection.

Evolving the Systems-Based Practice Competency in Graduate Medical Education to Meet Patient Needs in the 21st-Century Health Care System

Medical education is increasingly recognizing the importance of the systems-based practice (SBP) competency in the emerging 21st-century U.S. health care landscape. In the wake of data documenting insufficiencies in care delivery, notably in patient safety and health care disparities, the Accreditation Council for Graduate Medical Education created the SBP competency to address gaps in health outcomes and facilitate the education of trainees to better meet the needs of patients. Despite the introduction of SBP over 20 years ago, efforts to realize its potential have been incomplete and fragmented. Several challenges exist, including difficulty in operationalizing and evaluating SBP in current clinical learning environments. This inconsistent evolution of SBP has compromised the professional development of physicians who are increasingly expected to advance systems of care and actively contribute to improving patient outcomes, patient and care team experience, and costs of care. The authors prioritize 5 areas of focus necessary to further evolve SBP: comprehensive systems-based learning content, a professional development continuum, teaching and assessment methods, clinical learning environments in which SBP is learned and practiced, and professional identity as systems citizens. Accelerating the evolution of SBP in these 5 focus areas will require health system leaders and educators to embrace complexity with a systems thinking mindset, use coproduction between sponsoring health systems and education programs, create new roles to drive alignment of system and educational goals, and use design thinking to propel improvement efforts. The evolution of SBP is essential to cultivate the next generation of collaboratively effective, systems-minded professionals and improve patient outcomes.

Integration of health systems science and women's healthcare

Health systems science addresses the complex interactions in healthcare delivery. At its core, health systems science describes the intricate details required to provide high-quality care to individual patients by assisting them in navigating the multifaceted and often complicated US healthcare delivery system. With advances in technology, informatics, and communication, the modern physician is required to have a strong working knowledge of health systems science to provide effective, low-cost, high-quality care to patients. Medical educators are poised to introduce health systems science concepts alongside the basic science and clinical science courses already being taught in medical school. Because of the common overlap of women's healthcare subject matter with health systems science topics, such as interprofessional collaboration, ethics, advocacy, and quality improvement, women's health medical educators are at the forefront of incorporating health systems science into the current medical school educational model. Here, the authors have described the concept of health systems science and discussed both why and how it should be integrated into the undergraduate medical education curriculum. Medical educators must develop physicians of the future who can not only provide excellent patient care but also actively participate in the advancement and improvement of the healthcare delivery system.

Expert Consensus Guidelines for Assessing Students on the Social Determinants of Health

PHENOMENON

Assessment and evaluation guidelines inform programmatic changes necessary for educational effectiveness. Presently, no widely accepted guidelines exist for educators to assess learners and evaluate programs regarding social determinants of health (SDOH) during physician and physician assistant (PA) education. We sought to garner expert consensus about effective SDOH learner assessment and program evaluation, so as to make recommendations for best practices related to SDOH education.

APPROACH

We used a Delphi approach to conduct our study (September 2019 to December 2020). To administer our Delphi survey, we followed a three-step process: 1) literature review, 2) focus groups and semi-structured interviews, 3) question development and refinement. The final survey contained 72 items that addressed SDOH content areas, assessment methods, assessors, assessment integration, and program evaluation. Survey participants included 14 SDOH experts at US medical schools and PA programs. The survey was circulated for three rounds seeking consensus, and when respondents reached consensus on a particular question, that question was removed from subsequent rounds.

FINDINGS

The geographically diverse sample of experts reached consensus on many aspects of SDOH assessment and evaluation. The experts selected three important areas to assess learners' knowledge, skills, and attitudes about SDOH. They identified assessment methods that were "essential", "useful, but not essential", and "not necessary." The essential assessment methods are performance rating scales for knowledge and attitudes and skill-based assessments. They favored faculty and patients as assessors, as well as learner self-assessment, over assessments conducted by other health professionals. Questions about separation versus incorporation of SDOH assessment with other educational assessment did not yield consensus opinion. The experts reached consensus on priority outcome measures to evaluate a school's SDOH program which included student attitudes toward SDOH, Competence-Based Assessment Scales, and the percentage of graduates involved in health equity initiatives.

INSIGHTS

Based on the Delphi survey results, we make five recommendations that medical and PA educators can apply now when designing learner assessments and evaluating SDOH programming. These recommendations include what should be assessed, using what methods, who should do the assessments, and how they should be incorporated into the curriculum. This expert consensus should guide future development of an assessment and evaluation toolkit to optimize SDOH education and clinical practice.

Supplemental data for this article is available online at https://doi.org/10.1080/10401334.2022.2045490 .

Social network analysis of publication collaboration of accelerating change in MedEd consortium

INTRODUCTION

The American Medical Association formed the Accelerating Change in Medical Education Consortium through grants to effect change in medical education. The dissemination of educational innovations through scholarship was a priority. The objective of this study was to explore the patterns of collaboration of educational innovation through the consortium's publications.

METHOD

Publications were identified from grantee schools' semi-annual reports. Each publication was coded for the number of citations, Altmetric score, domain of scholarship, and collaboration with other institutions. Social network analysis explored relationships at the midpoint and end of the grant.

RESULTS

Over five years, the 32 Consortium institutions produced 168 publications, ranging from 38 papers from one institution to no manuscripts from another. The two most common domains focused on health system science (92 papers) and competency-based medical education (30 papers). Articles were published in 54 different journals. Forty percent of publications involved more than one institution. Social network analysis demonstrated rich publishing relationships within the Consortium members as well as beyond the Consortium schools. In addition, there was growth of the network connections and density over time.

CONCLUSION

The Consortium fostered a scholarship network disseminating a broad range of educational innovations through publications of individual school projects and collaborations.

Student-faculty co-creation of experiential learning in health systems science

INTRODUCTION

Health Systems Science (HSS) teaches students critical skills to navigate complex health systems, yet medical schools often find it difficult to integrate into their curriculum due to limited time and student disinterest. Co-developing content with students and teaching through appropriate experiential learning can improve student engagement in HSS coursework.

METHODS

Medical students and faculty co-developed a patient outreach initiative during the early phases of the COVID-19 pandemic and integrated that experience into a new experiential HSS elective beginning May 2020. Students called patients identified as high-risk for adverse health outcomes and followed a script to connect patients to healthcare and social services. Subsequently, this initiative was integrated into the required third-year primary care clerkship.

RESULTS

A total of 255 students participated in HSS experiential learning through the elective and clerkship from May 2020 through July 2021. Students reached 3,212 patients, encountering a breadth of medical, social, and health systems issues; navigated the EMR; engaged interdisciplinary professionals; and proposed opportunities for health systems improvement.

DISCUSSION AND CONCLUSION

This educational intervention demonstrated the opportunity to partner with student-led initiatives, coproducing meaningful educational experiences for the learners within the confines of a busy medical curriculum.

Using Kern's 6-Step Approach to Integrate Health Systems Science Curricula Into Medical Education

The term "health systems science" (HSS) has recently emerged as a unifying label for competencies in health care delivery and in population and community health. Despite strong evidence that HSS competencies are needed in the current and future health care workforce, heretofore the integration of HSS into medical education has been slow or fragmented-due, in part, to a lack of evidence that these curricula improve education or population outcomes. The recent COVID-19 pandemic and the national reckoning with racial inequities in the United States further highlight the time-sensitive imperative to integrate HSS content across the medical education continuum. While acknowledging challenges, the authors highlight the unique opportunities inherent in an HSS curriculum and present an elaborated curricular framework for incorporating health care delivery and population health into undergraduate medical education. This framework includes competencies previously left out of medical education, increases the scope of faculty development, and allows for evidence of effectiveness beyond traditional learner-centric metrics. The authors apply a widely adopted 6-step approach to curriculum development to address the unique challenges of incorporating HSS. Two examples-of a module on quality improvement (health care delivery) and of an introductory course on health equity (population and community health)-illustrate how the 6-step approach can be used to build HSS curricula. The Supplemental Digital Appendix (at http://links.lww.com/ACADMED/B106) outlines this approach and provides specific examples and resources. Adapting these resources within local environments to build HSS curricula will allow medical educators to ensure future graduates have the expertise and commitment necessary to effect health systems change and to advocate for their communities, while also building the much-needed evidence for such curricula.

Health systems science education: The new post-Flexner professionalism for the 21st century

The foundations of medical education have drawn from the Flexner Report to prepare students for practice for over a century. These recommendations relied, however, upon a limited set of competencies and a relatively narrow view of the physician's role. There have been increasing calls and recommendations to expand those competencies and the professional identity of the physician to better meet the current and future needs of patients, health systems, and society. We propose a framework for the twenty-first century physician that includes an expectation of new competency in health systems science (HSS), creating 'system citizens' who are effective stewards of the health care system. Experiential educational strategies, in addition to knowledge-centered learning, are critically important for students to develop their professional identity as system citizens working alongside interprofessional colleagues. Challenges to HSS adoption range from competing priorities for learners, to the need for faculty development, to the necessity for buy-in by medical schools and their associated health care systems. Ultimately, success will depend on our ability to articulate, encourage, support, and evaluate system citizenship and its impact on health care and health care systems.

The Accelerating Change in Medical Education Consortium: Key Drivers of Transformative Change

The American Medical Association's (AMA's) Accelerating Change in Medical Education (ACE) initiative, launched in 2013 to foster advancements in undergraduate medical education, has led to the development and scaling of innovations influencing the full continuum of medical training. Initial grants of $1 million were awarded to 11 U.S. medical schools, with 21 schools joining the consortium in 2016 at a lower funding level. Almost one-fifth of all U.S. MD- and DO-granting medical schools are represented in the 32-member consortium. In the first 5 years, the consortium medical schools have delivered innovative educational experiences to approximately 19,000 medical students, who will provide a potential 33 million patient care visits annually. The core initiative objectives focus on competency-based approaches to medical education and individualized pathways for students, training in health systems science, and enhancing the learning environment. At the close of the initial 5-year grant period, AMA leadership sought to catalogue outputs and understand how the structure of the consortium may have influenced its outcomes. Themes from qualitative analysis of stakeholder interviews as well as other sources of evidence aligned with the 4 elements of the transformational leadership model (inspirational motivation, intellectual stimulation, individualized consideration, and idealized influence) and can be used to inform future innovation interventions. For example, the ACE initiative has been successful in stimulating change at the consortium schools and propagating those innovations broadly, with outputs involving medical students, faculty, medical schools, affiliated health systems, and the broader educational landscape. In summary, the ACE initiative has fostered a far-reaching community of innovation that will continue to drive change across the continuum of medical education.

The Mystery Dinner RCA: Using Gamification and Simulation to Teach Root Cause Analysis

Introduction

Root cause analysis (RCA) is a widely utilized tool for investigating systems issues that lead to patient safety events and near misses, yet only 38% of learners participate in an interdisciplinary patient safety investigation during training. Common barriers to RCA education and participation include faculty time and materials, trainee time constraints, and learner engagement.

Methods

We developed a simulated RCA workshop to be taught to a mix of medical and surgical specialties from over 11 GME programs and to third-year medical students. The workshop was a single 90-minute session formatted as a gamified mystery dinner including characters and sequentially revealed clues to promote engagement. Participant satisfaction and subjective knowledge, skills, and attitudes were assessed with a pre/post survey.

Results

The workshop was completed by 134 learners between October 2018 and October 2019. The short workshop duration and premade simulation allowed a small number of faculty to train a wide variety of learners in various educational settings. Participants' presurvey (124 out of 134, 92%) versus postsurvey (113 out of 134, 84%) responses showed that attitudes about RCA were statistically improved across all domains queried, with an average effect size of 0.6 (moderate effect); 91% of participants would recommend this course to a colleague.

Discussion

A 90-minute, gamified, simulated RCA workshop was taught to medical students and multiple GME specialties with subjective improvements in patient safety attitudes and knowledge while alleviating faculty time constraints in case development.

Attributes and generic competencies required of doctors: findings from a participatory concept mapping study

BACKGROUND

Medical education should ensure graduates are equipped for practice in modern health-care systems. Practicing effectively in complex health-care systems requires contemporary attributes and competencies, complementing core clinical competencies. These need to be made overt and opportunities to develop and practice them provided. This study explicates these attributes and generic competencies using Group Concept Mapping, aiming to inform pre-vocational medical education curriculum development.

METHODS

Group Concept Mapping is a mixed methods consensus building methodology whereby ideas are generated using qualitative techniques, sorted and grouped using hierarchical cluster analysis, and rated to provide further quantitative confirmation of value. Health service providers from varied disciplines (including medicine, nursing, allied health), health profession educators, health managers, and service users contributed to the conceptual model's development. They responded to the prompt 'An attribute or non-clinical competency required of doctors for effective practice in modern health-care systems is...' and grouped the synthesized responses according to similarity. Data were subjected to hierarchical cluster analysis. Junior doctors rated competencies according to importance to their practice and preparedness at graduation.

RESULTS

Sixty-seven contributors generated 338 responses which were synthesised into 60 statements. Hierarchical cluster analysis resulted in a conceptual map of seven clusters representing: value-led professionalism; attributes for self-awareness and reflective practice; cognitive capability; active engagement; communication to build and manage relationships; patient-centredness and advocacy; and systems awareness, thinking and contribution. Logic model transformation identified three overarching meta-competencies: leadership and systems thinking; learning and cognitive processes; and interpersonal capability. Ratings indicated that junior doctors believe system-related competencies are less important than other competencies, and they feel less prepared to carry them out.

CONCLUSION

The domains that have been identified highlight the competencies necessary for effective practice for those who work within and use health-care systems. Three overarching domains relate to leadership in systems, learning, and interpersonal competencies. The model is a useful adjunct to broader competencies frameworks because of the focus on generic competencies that are crucial in modern complex adaptive health-care systems. Explicating these will allow future investigation into those that are currently well achieved, and those which are lacking, in differing contexts.

Assessing the Transition of Training in Health Systems Science From Undergraduate to Graduate Medical Education

BACKGROUND

The American Medical Association Accelerating Change in Medical Education (AMA-ACE) consortium proposes that medical schools include a new 3-pillar model incorporating health systems science (HSS) and basic and clinical sciences. One of the goals of AMA-ACE was to support HSS curricular innovation to improve residency preparation.

OBJECTIVE

This study evaluates the effectiveness of HSS curricula by using a large dataset to link medical school graduates to internship Milestones through collaboration with the Accreditation Council for Graduate Medical Education (ACGME).

METHODS

ACGME subcompetencies related to the schools' HSS curricula were identified for internal medicine, emergency medicine, family medicine, obstetrics and gynecology (OB/GYN), pediatrics, and surgery. Analysis compared Milestone ratings of ACE school graduates to non-ACE graduates at 6 and 12 months using generalized estimating equation models.

RESULTS

At 6 months both groups demonstrated similar HSS-related levels of Milestone performance on the selected ACGME competencies. At 1 year, ACE graduates in OB/GYN scored minimally higher on 2 systems-based practice (SBP) subcompetencies compared to non-ACE school graduates: SBP01 (1.96 vs 1.82, 95% CI 0.03-0.24) and SBP02 (1.87 vs 1.79, 95% CI 0.01-0.16). In internal medicine, ACE graduates scored minimally higher on 3 HSS-related subcompetencies: SBP01 (2.19 vs 2.05, 95% CI 0.04-0.26), PBLI01 (2.13 vs 2.01; 95% CI 0.01-0.24), and PBLI04 (2.05 vs 1.93; 95% CI 0.03-0.21). For the other specialties examined, there were no significant differences between groups.

CONCLUSIONS

Graduates from schools with training in HSS had similar Milestone ratings for most subcompetencies and very small differences in Milestone ratings for only 5 subcompetencies across 6 specialties at 1 year, compared to graduates from non-ACE schools. These differences are likely not educationally meaningful.

Learning New Skills in Innovation, Leadership, and Discovery During a 9-Month Scholarly Concentration: Results from the First Cohort at a New Medical School

Dell Medical School (DMS) has weaved health systems science (HSS) throughout its curriculum. During the third year, students complete a master's degree program or an immersive distinction in research or design during a 9-month Innovation, Leadership, and Discovery (ILD) block. Faculty assessments revealed all students met expectations, but dual-degree students were rated higher than distinction students in leading future innovative teams competencies. Student self-assessments revealed statistically significant improvements in HSS competencies during the block with little difference by ILD choice (dual degree or distinction). We will continue to examine the long-term impact of these experiences and skills in career trajectories.

Association of a Health Equity Curriculum With Medical Students' Knowledge of Social Determinants of Health and Confidence in Working With Underserved Populations

IMPORTANCE

National organizations recommend that medical schools train students in the social determinants of health.

OBJECTIVE

To develop and evaluate a longitudinal health equity curriculum that was integrated into third-year clinical clerkships and provided experiential learning in partnership with community organizations.

DESIGN, SETTING, AND PARTICIPANTS

This longitudinal cohort study was conducted from June 2017 to October 2020 to evaluate the association of the curriculum with medical students' self-reported knowledge of social determinants of health and confidence working with underserved populations. Students from 1 large medical school in the southeastern US were included. Students in the class of 2019 and class of 2020 were surveyed at baseline (before the start of their third year), end of the third year, and graduation. The class of 2018 (No curriculum) was surveyed at graduation to serve as a control. Data analysis was conducted from June to September 2020.

EXPOSURES

The curriculum began with a health equity simulation followed by a series of modules. The class of 2019 participated in the simulation and piloted the initial 3 modules (pilot), and the class of 2020 participated in the simulation and the full 9 modules (full).

MAIN OUTCOMES AND MEASURES

A linear mixed-effects model was used to evaluate the change in the self-reported knowledge and confidence scores over time (potential scores ranged from 0 to 32, with higher scores indicating higher self-reported knowledge and confidence working with underserved populations). In secondary analyses, a Kruskal-Wallis test was conducted to compare graduation scores between the no, pilot, and full curriculum classes.

RESULTS

A total of 314 students (160 women [51.0%], 205 [65.3%] non-Hispanic White participants) completed at least 1 survey, including 125 students in the pilot, 121 in the full, and 68 in the no curriculum classes. One hundred forty-one students (44.9%) were interested in primary care. Total self-reported knowledge and confidence scores increased between baseline and end of clerkship (15.4 vs 23.7, P = .001) and baseline and graduation (15.4 vs 23.7, P = .001) for the pilot and full curriculum classes. Total scores at graduation were higher for the pilot curriculum (median, 24.0; interquartile range [IQR], 21.0-27.0; P = .001) and full curriculum classes (median, 23.0; IQR, 20.0-26.0; P = .01) compared with the no curriculum class (median, 20.5; IQR, 16.25-24.0).

CONCLUSIONS AND RELEVANCE

In this cohort study of medical students, a dedicated health equity curriculum was associated with a significant improvement in students' self-reported knowledge of social determinants of health and confidence working with underserved populations.

Interprofessional Education: Reaching Health Professionals With an Interactive Professional Virtual/Online Event on Advocacy and Policy

Competencies in health policy and advocacy should be developed by all health professionals to effectively advance their professions but also effectively collaborate in interprofessional teams to improve public health. However, the COVID-19 epidemic presents a challenge to reaching students of health professions through face-to-face offerings. To meet this need, the University of South Florida College of Public Health developed asynchronous and synchronous online health policy and advocacy modules delivered to an interprofessional group of students pursuing health careers. After learning policy and advocacy material individually through a self-paced online curriculum, faculty gathered the students for a synchronous online event where they formed collaborative groups. In interprofessional teams, students prepared and presented advocacy briefs that were critiqued by the faculty. Post-event evaluation results showed that most students strongly agreed that the interprofessional event was very effective, and they all would recommend the program to other students. Universities and colleges educating students of health professions can take advantage of the technologies employed to keep students safe in the COVID-19 pandemic and still reach students effectively with interprofessional health policy and advocacy content.

Rapid transition of a preclinical health systems science and social justice course to remote learning in the time of coronavirus

As the coronavirus pandemic started, we rapidly transitioned a preclinical social justice and health systems sciences course at our medical school to asynchronous, remote learning. We describe processes, curricular innovations, and lessons learned. Small groups were converted into independent learning modules and lectures were given live via videoconferencing technology. We started with a simplified approach and then built technological capabilities over time. Current events were incorporated into curriculum and assessment. Our course ran from 16 March-3 April 2020 for the 155-person first-year class. Student attendance for optional, synchronous remote sessions was higher than in-person attendance in previous years. Completion rates for assignments were high but with minimal student collaboration. Faculty office hours were underutilized. Focus group and formal evaluations were largely positive, with numerical ratings for quality of the course and faculty teaching higher than the 2 years prior. Student engagement with social justice topics in aremote format was successful through modifications to small groups and lecture structure. Students, faculty, and administrative staff appreciated the consistency of session format throughout the course. Students exam performance was similar to prior years. Attention should be paid to what can be learned via self-study as opposed to small group learning. Better methods of soliciting real-time student feedback, and encouraging engagement with each other and with faculty in aremote environment are needed.

A Medical Education Recommendation for Improving Sexual Health and Humanism and Professionalism

INTRODUCTION

Sexual health in the United States is poor, yet most physicians do not address the topic. Sexual health education (SHE) guidelines are available but not used. The lack of SHE in undergraduate medical education (UME) impacts sexual and general health outcomes, as SHE in UME increases physicians' awareness of and ability to address sexual health, which is bidirectionally correlated with other health.

OBJECTIVE

To design and assess the need, feasibility, and outcomes of an educational recommendation for increased incorporation of SHE in UME.

METHODS

Comprehensive literature review was used to assess current and future needs of SHE in UME and humanism and professionalism education (HPE). Qualitative analysis was used to assess a potential solution. The main outcome measure was an educational recommendation based on qualitative analysis of (1) the benefits of SHE and HPE in UME, (2) the SHE and HPE overlap, and (3) the potential effect of a formally combined delivery on UME and patient and practitioner outcomes.

RESULTS

Available literature on medical SHE supports increased SHE is necessary and should be incorporated into existing HPE whenever possible, secondary to numerous intersections. Qualitative analysis supports HPE could be enhanced when consistently exemplified through SHE, and this approach could be beneficial for (1) increased understanding, retention, application, and advocacy of both topics; (2) long-term improvement of sexual and general health at the patient and population levels; and (3) increased practice of humanism and professionalism, potentially resulting in better patient outcomes and professional satisfaction for physicians.

CONCLUSION

Cross-disciplinary qualitative analysis supports using SHE as the primary topic to teach HPE is a viable method to increase SHE and potentially creates physicians who address sexual health and practice with increased humanism and professionalism, leading to population-level sexual and general health improvements. Gordon EG. A Medical Education Recommendation for Improving Sexual Health and Humanism and Professionalism. Sex Med Rev 2021;9:23-35.

Health Systems Science in Medical Education: Unifying the Components to Catalyze Transformation

Medical education exists in the service of patients and communities and must continually calibrate its focus to ensure the achievement of these goals. To close gaps in U.S. health outcomes, medical education is steadily evolving to better prepare providers with the knowledge and skills to lead patient- and systems-level improvements. Systems-related competencies, including high-value care, quality improvement, population health, informatics, and systems thinking, are needed to achieve this but are often curricular islands in medical education, dependent on local context, and have lacked a unifying framework. The third pillar of medical education-health systems science (HSS)-complements the basic and clinical sciences and integrates the full range of systems-related competencies. Despite the movement toward HSS, there remains uncertainty and significant inconsistency in the application of HSS concepts and nomenclature within health care and medical education. In this Article, the authors (1) explore the historical context of several key systems-related competency areas; (2) describe HSS and highlight a schema crosswalk between HSS and systems-related national competency recommendations, accreditation standards, national and local curricula, educator recommendations, and textbooks; and (3) articulate 6 rationales for the use and integration of a broad HSS framework within medical education. These rationales include: (1) ensuring core competencies are not marginalized, (2) accounting for related and integrated competencies in curricular design, (3) providing the foundation for comprehensive assessments and evaluations, (4) providing a clear learning pathway for the undergraduate-graduate-workforce continuum, (5) facilitating a shift toward a national standard, and (6) catalyzing a new professional identity as systems citizens. Continued movement toward a cohesive framework will better align the clinical and educational missions by cultivating the next generation of systems-minded health care professionals.

From Knowing to Doing: Integrating Systems-Ready Physician Competencies in the Clerkship Setting

There are increasing calls to graduate physicians with a strong understanding of health systems science (HSS). Many schools have incorporated didactics on health systems science content such as quality improvement, patient safety, or interprofessional education. Creating a systems-ready physician requires more than teaching content in classroom settings. Using Miller's pyramid of assessment of clinical performance, we have developed strategies to move our learners from the cognitive-based "knows" level to the behavior-based "does" level of understanding of the HSS competencies. Our medical students begin learning HSS in classroom settings. Next, the students apply this knowledge during their core clerkships. This gives them an opportunity to get feedback increasingly from high-fidelity clinical settings. We embedded assessment strategies and tools in the clerkship year to facilitate the demonstration, observation, and assessment of HSS competencies in the setting of our core clerkships. We also have students self-assess their competence in our graduation competencies at the end of each year. Student self-assessment from the beginning of the clerkship year to the end showed significant increases in the HSS competencies. Our clerkship student assessment data from our first cohort suggest that faculty had difficulty observing and assessing some of the competencies unique to health systems science. The clerkships have developed multiple projects and assignments to allow students to demonstrate HSS competencies. Faculty and resident training to prompt, observe, and assess these competencies is ongoing to close the assessment gap. In the area of professionalism, student self-assessment and faculty clinical assessment correlate strongly.

General Internists as Change Agents: Opportunities and Barriers to Leadership in Health Systems and Medical Education Transformation

Health systems are increasingly engaging in mission development around the quadruple aim of patient experience of care, population health, cost of care, and work-life balance of clinicians. This integrated approach is closely aligned with the education principles and competencies of health systems science (HSS), which includes population health, high-value care, leadership, teamwork, collaboration, and systems thinking. Influenced by health outcomes research, the systems-based practice competency, and the Clinical Learning Environment Review, many medical schools and residency programs are taking on the challenge of comprehensively incorporating these HSS competencies into the education agenda. General internal medicine physicians, inclusive of hospitalists, geriatricians, and palliative and primary care physicians, are at the frontlines of this transformation and uniquely positioned to contribute to and lead health system transformation, role model HSS competencies for trainees, and facilitate the education of a new workforce equipped with HSS skills to accelerate change in healthcare. Although GIM faculty are positioned to be early adopters and leaders in evolving systems of care and education, professional development and changes with academic health systems are required. This Perspective article explores the conceptualization and opportunities to effectively link GIM with healthcare and medical education transformation.

Unpacking Medical Students' Mixed Engagement in Health Systems Science Education

Phenomenon: Medical education is better aligning with the needs of health systems. Health systems science competencies, such as high-value care, population health, and systems thinking, are increasingly being integrated into curricula, but not without challenges. One challenge is mixed receptivity by students, the underlying reasons of which have not been extensively explored. In this qualitative study, we explored the research question: "How do students perceive health systems science curricula across all four years, and how do such perceptions inform the reasons for mixed quality ratings?" Approach: Following large-scale health systems science curricular changes in their medical school, we used students' open-ended comments obtained from course evaluations related to 1^st-, 2^nd-, and 4^th-year courses and performed a qualitative thematic analysis to explore students' perceptions. We identified themes, synthesized findings into a conceptual figure, and agreed upon results and quotations. Findings: Five themes were identified: (1) perceived importance and relevance of health systems science education, (2) tension between traditional and evolving health systems science-related professional identity, (3) dissatisfaction with redundancy of topics, (4) competition with basic and clinical science curricula, and, (5) preference for discrete, usable, testable facts over complexity and uncertainty. The relationship between themes is described along a continuum of competing agendas between students' traditional mindset (which focuses on basic/clinical science) and an emerging medical education approach (which focuses on basic, clinical, and health systems science). Insights: Health systems science education can be viewed by learners as peripheral to their future practice and not aligned with a professional identity that places emphasis on basic and clinical science topics. For some students, this traditional identity limits engagement in health systems science curricula. If health systems science is to achieve its full potential in medical education, further work is required to explore the adoption of new perspectives by students and create activities to accelerate the process.

Addressing the Social Determinants of Health in Undergraduate Medical Education Curricula: A Survey Report

PURPOSE

Social determinants of health (SDH) are recognized as important factors that affect health and well-being. Medical schools are encouraged to incorporate the teaching of SDH. This study investigated the level of commitment to teaching SDH; learning objectives/goals regarding student knowledge, skills, and attitudes; location in the curriculum and teaching strategies; and perceived barriers to teaching SDH.

METHODS

A team from the American Medical Association's Accelerating Change in Medical Education Consortium developed a 23-item inventory survey to document consortium school SDH curricula. The 32 consortium schools were invited to participate.

RESULTS

Twenty-nine (94%) schools responded. Most respondents indicated the teaching of SDH was low priority (10, 34%) or high priority (12, 41%). Identified learning objectives/goals for student knowledge, skills, and attitudes regarding SDH were related to the importance of students developing the ability to identify and address SDH and recognizing SDH as being within the scope of physician practice. Curricular timing and teaching strategies suggested more SDH education opportunities were offered in the first and second undergraduate medical education years. Barriers to integrating SDH in curricula were identified: addressing SDH is outside the realm of physician responsibility, space in curriculum is limited, faculty lack knowledge and skills to teach material, and concepts are not adequately represented on certifying examinations.

CONCLUSION

Despite the influence of SDH on individual and population health, programs do not routinely prioritize SDH education on par with basic or clinical sciences. The multitude of learning objectives and goals related to SDH can be achieved by increasing the priority level of SDH and employing better teaching strategies in all years. The discordance between stated objectives/goals and perceived barriers, as well as identification of the variety of strategies utilized to teach SDH during traditional "preclinical" years, indicates curricular areas in need of attention.

Teaching Systems Improvement to Early Medical Students: Strategies and Lessons Learned

PURPOSE

Despite increasing emphasis in medical school education on quality and systems improvement, many medical schools lack sufficient faculty with expertise to teach systems improvement. Using the pedagogical content knowledge framework, this study explores how faculty engage students in systems improvement work and faculty perceptions of the outcomes for the health system and students.

METHOD

In May-June 2017, the authors interviewed 12 of 13 invited faculty with experience in teaching and engaging first-year medical students in systems improvement work, the course of students' systems improvement work over time, the impact of students' projects on health systems, and students' learning and attitudes about systems improvement. The authors conducted qualitative analysis iteratively with data collection to sufficiency.

RESULTS

Six emergent themes characterized faculty's approach to guiding students in systems improvement work: faculty-student relationship, faculty role, student role, faculty-student shared responsibility for projects, faculty and student content knowledge, and project outcomes. The faculty-student relationship was foundational for successful systems improvement work. Faculty roles included project selection, project management, and health systems interactions. Students engaged in systems improvement as their faculty leveraged their knowledge and skills and created meaningful student roles. Faculty and students shared responsibility and colearned systems improvement content knowledge. Faculty defined successful outcomes as students' learning about the systems improvement process and interprofessional collaboration.

CONCLUSIONS

Findings highlight the critical importance of pedagogical content knowledge to engage early learners in systems improvement work, understand their learning interests and needs, and manage their projects longitudinally.

Minimal effects of reduced teaching hours on undergraduate medical student learning outcomes and course evaluations

Introduction: Various pressures exist for curricular change, including economic forces, burgeoning knowledge, broadening learning outcomes, and improving quality and outcomes of learning experiences. In an Australian 5-year undergraduate medical course, staff were asked to reduce teaching hours by 20% to alleviate perceived overcrowded preclinical curriculum, achieve operating efficiencies and liberate time for students' self-directed learning.Methods: A case study design with mixed methods was used to evaluate outcomes.Results: Teaching hours were reduced by 198 hours (14%) overall, lectures by 153 hours (19%) and other learning activities by 45 hours (7%). Summative assessment scores did not change significantly after the reductions: 0.4% increase, 1.5% decrease and 1.7% increase in Years 1, 2 and 3, respectively. The percentage of students successfully completing their academic year did not change significantly: 94.4% before and 93.3% after the reductions. Student evaluations from eVALUate surveys changed little, except workload was perceived to be more reasonable.Conclusions: Teaching hours, particularly lectures, can be moderately reduced with little impact on student learning outcomes or satisfaction with an undergraduate medical course.

Incorporating content related to value and cost-considerations in clinical decision-making: enhancements to medical education

Although incorporating cost-considerations during healthcare decision-making is increasingly important to American patients and physicians, content related to these constructs is not routinely included in medical education. As a result, physicians are ill-equipped to consider costs. This study sought input from practicing physicians on perceived deficiencies in current teaching and recommendations for necessary content to include in medical teaching. We conducted a qualitative descriptive study using semi-structured interviews utilizing a purposeful maximum variation sample of cardiologists and neonatologists practicing in diverse settings. We analyzed interviews using conventional content analysis. 18 cardiologists and 17 neonatologists participated in this study. Respondents perceived that current teaching does not impart sufficient knowledge of value and cost considerations to achieve patient-centered, high-value decision-making. They identified the following priority areas for education related to healthcare costs: the business of medicine and information about out-of-pocket patient costs, training in health research interpretation skills to critically appraise evidence, and communication skills to engage patients as partners in shared decision-making. Participants recommended a variety of teaching methods, including didactic sessions on core topics, role modeling and case studies. American physicians perceive learning needs related to the incorporation of costs into clinical decision-making that can inform curriculum development initiatives in this field. Physicians perceive knowledge of these topics and skills to be crucial to achieving patient-centered high-value care. Concomitant health system reforms supporting the needs of the patient at its center are essential to enable physicians to focus on a patient-centered approach to healthcare delivery.

Health Systems Science: The "Broccoli" of Undergraduate Medical Education

Health system leaders are calling for reform of medical education programs to meet evolving needs of health systems. U.S. medical schools have initiated innovative curricula related to health systems science (HSS), which includes competencies in value-based care, population health, system improvement, interprofessional collaboration, and systems thinking. Successful implementation of HSS curricula is challenging because of the necessity for new curricular methods, assessments, and educators and for resource allocation. Perhaps most notable of these challenges, however, is students' mixed receptivity. Although many students are fully engaged, others are dissatisfied with curricular time dedicated to competencies not perceived as high yield. HSS learning can be viewed as "broccoli"-students may realize it is good for them in the long term, but it may not be palatable in the moment. Further analysis is necessary for accelerating change both locally and nationally.With over 11 years of experience in global HSS curricular reform in 2 medical schools and informed by the curricular implementation "performance gap," the authors explore student receptivity challenges, including marginalization of HSS coursework, infancy of the HSS field, relative nascence of curricula and educators, heterogeneity of pedagogies, tensions in students' perceptions of their professional role, and culture of HSS integration. The authors call for the reexamination of 5 issues influencing HSS receptivity: student recruitment processes, faculty development, building an HSS academic "home," evaluation metrics, and transparent collaboration between medical schools. To fulfill the social obligation of meeting patients' needs, educators must seek a shared understanding of underlying challenges of HSS innovations.

Engaging Medical Students in Leadership Development

Leadership development plays a critical role in preparing collaborative, systems-based physicians. Medical schools across the globe have dedicated significant effort towards programming for medical student leadership development. Students report a variety of existing leadership opportunities, ranging from formal didactics to leadership positions within the community. Students identify lack of time, funding, and the hierarchy of medicine as significant barriers for engaging in leadership opportunities. Students favor a formal leadership curriculum coupled with hands-on opportunities to practice leadership skills. In order to train medical students to be engaged physician leaders, it is imperative to foster practical opportunities for leadership development.

Engaging Medical Students in Leadership Development

Leadership development plays a critical role in preparing collaborative, systems-based physicians. Medical schools across the globe have dedicated significant effort towards programming for medical student leadership development. Students report a variety of existing leadership opportunities, ranging from formal didactics to leadership positions within the community. Students identify lack of time, funding, and the hierarchy of medicine as significant barriers for engaging in leadership opportunities. Students favor a formal leadership curriculum coupled with hands-on opportunities to practice leadership skills. In order to train medical students to be engaged physician leaders, it is imperative to foster practical opportunities for leadership development.

Medical education today: all that glitters is not gold

BACKGROUND

The medical education system based on principles advocated by Flexner and Osler has produced generations of scientifically grounded and clinically skilled physicians whose collective experiences and contributions have served medicine and patients well. Yet sweeping changes launched around the turn of the millennium have constituted a revolution in medical education. In this article, a critique is presented of the new undergraduate medical education (UME) curricula in relationship to graduate medical education (GME) and clinical practice.

DISCUSSION

Medical education has changed and will continue to change in response to scientific advances and societal needs. However, enthusiasm for reform needs to be tempered by a more measured approach to avoid unintended consequences. Movement from novice to master in medicine cannot be rushed. An argument is made for a shoring up of biomedical science in revised curricula with the beneficiaries being nascent practitioners, developing physician-scientists --and the public.

CONCLUSION

Unless there is further modification, the new integrated curricula are at risk of produce graduates deficient in the characteristics that have set physicians apart from other healthcare professionals, namely high-level clinical expertise based on a deep grounding in biomedical science and understanding of the pathologic basis of disease. The challenges for education of the best possible physicians are great but the benefits to medicine and society are enormous.