GOTMeDS?: Development and Evaluation of an Interactive Module for Trainees on Reducing Patient's Drug Costs

Development and Implementation of an Experiential Longitudinal Health Systems Science Thread Into an Existing Medical School Curriculum

PROBLEM

Medical school graduates enter a complex health care delivery system involving interprofessional teamwork and multifaceted value-based patient care decisions. However, current curricula on health systems science (HSS) are piecemeal, lecture based, and confined to preclinical training.

APPROACH

The VISTA program is a longitudinal, immersive learning curriculum integrated into the University of Chicago Pritzker School of Medicine curriculum between 2016 and 2018. Key components include a unit-based nursing interprofessional team experience, a discharge objective structured clinical examination (OSCE), a patient safety simulation, and the implementation of a Choosing Wisely SmartPhrase. Graduates before 2016-2017 and after 2018-2020 VISTA implementation completed a Likert-style survey assessing attitudes, knowledge, and behaviors on HSS topics. A free response question solicited improvement areas. The Association of American Medical Colleges (AAMC) Graduation Questionnaire (GQ) was also examined.

OUTCOMES

The overall VISTA survey response rate was 59%, with 126 fourth-year medical student respondents before VISTA and 120 after VISTA. Compared with pre-VISTA graduates, post-VISTA graduates reported a significantly higher rate of competence on the HSS questions, with the greatest increases seen in effective communication at discharge (n = 73/126 [57.9%] to 116/120 [96.7%], P < .001), knowledge on safety event reporting (n = 53/126 [42.1%] to 96/120 [79.8%], P < .001), and considering costs in making health care decisions (n = 76/126 [60.3%] to 117/120 [97.5%], P < .001). All were directly addressed through experiential learning interventions, and 2 were intended practice behaviors. VISTA graduate responses to free-text questions demonstrated a more nuanced understanding of HSS compared with pre-VISTA responses. The AAMC GQ data showed increased agreement with an item that mapped to HSS understanding.

NEXT STEPS

The VISTA program provides a model for institutions to enhance HSS education between curricular overhauls. Next steps include implementing value-added roles and additional immersive learning exercises.

High-Value, Cost-Conscious Communication Skills in Undergraduate Medical Education: Validity Evidence for Scores Derived from Two Standardized Patient Scenarios

INTRODUCTION

Training in high-value, cost-conscious care (HVCCC) is increasingly being incorporated into medical school curricula, but students may have limited opportunities to engage patients in HVCCC conversations. The aim of this study was to develop two standardized patient scenarios with associated checklists, hypothesizing that resulting scores would allow for valid formative assessments of HVCCC communication skills.

METHODS

Scenarios were designed to generate a less-is-more conversation (in response to a patient requesting an unnecessary test) and a shared decision-making conversation (in response to a patient choosing between multiple effective treatment options). Checklists were developed by experts and informed by the existing literature. Validity evidence was collected from content, response process, internal structure, relations to other variables, and consequences of testing.

RESULTS

Ninety-three third-year medical students participated during 2014-2015. Mean checklist scores were 79% (SD = 18, Cronbach α = 0.72) and 72% (SD = 13, Cronbach α = 0.62) for the less-is-more and shared decision-making scenarios, respectively. Checklist scores correlated with global ratings of performance (r = 0.65 and 0.54, respectively, both P < 0.001), and overall interrater reliability was good (r = 0.66). Checklist scores discriminated between higher and lower performers (discrimination indices of 0.84 and 0.65, respectively, both P < 0.001). Most students (83/90, 92%) agreed that the session improved their HVCCC communication skills.

CONCLUSIONS

This study provides validity evidence supporting the use of scores derived from two standardized patient scenarios for formative assessment of HVCCC communication skills among third-year medical students. These scenarios can help equip students with practical, patient-centered strategies for promoting value in clinical encounters.