Student perspectives on programmatic assessment in a large medical programme: A critical realist analysis

Training as imagined? A critical realist analysis of Scotland's internal medicine simulation programme

BACKGROUND

Evaluating the impact of simulation-based education (SBE) has prioritised demonstrating a causal link to improved patient outcomes. Recent calls herald a move away from looking for causation to understanding 'what else happened'. Inspired by Shorrock's varieties of human work from patient safety literature, this study draws on the concept of work-as-done versus work-as-imagined. Applying this to SBE recognises that some training impacts will be unexpected, and the realities of training will never be quite as imagined. This study takes a critical realist stance to explore the experience and consequences, intended and unintended, of the internal medicine training (IMT) simulation programme in Scotland, to better understand 'training-as-done'.

METHODS

Critical realism accepts that there is a reality to uncover but acknowledges that our knowledge of reality is inevitably our construction and cannot be truly objective. The IMT simulation programme involves three courses over a 3-year period: a 3-day boot camp, a skills day and a 2-day registrar-ready course. Following ethical approval, interviews were conducted with trainees who had completed all courses, as well as faculty and stakeholders both immersed in and distant from course delivery. Interviews were audio-recorded, transcribed verbatim and analysed using critical realist analysis, influenced by Shorrock's proxies for work-as-done.

RESULTS

Between July and December 2023, 24 interviews were conducted with ten trainees, eight faculty members and six stakeholders. Data described proxies for training-as-done within three broad categories: design, experience and impact. Proxies for training design included training-as-prescribed, training-as-desired and training-as-prioritised which compete to produce training-as-standardised. Experience included training-as-anticipated with pre-simulation anxiety and training-as-unintended with the valued opportunity for social comparison as well as a sense of identity and social cohesion. The impact reached beyond the individual trainee with faculty development and inspiration for other training ventures.

CONCLUSION

Our findings highlight unintended consequences of SBE such as social comparison and feeling 'valued as a trainee, valued as a person'. It sheds light on the fear of simulation, reinforcing the importance of psychological safety. A critical realist approach illuminated the 'bigger picture', revealing insights and underlying mechanisms that allow this study to present a new framework for conceptualising training evaluation.

Capital sharing and socialization in an interprofessional student-led clinic: a Bourdieuan analysis

BACKGROUND

Interprofessional student-led clinics offer authentic clinical experiences of collaborative patient care. However, theoretical research on the sustainability of these clinics, considering forms of capital beyond the economic, remains limited. This study addresses this gap by employing Bourdieu's theoretical framework to explore how alternative conceptions of capital; both social and cultural might sustain conditions for interprofessional working in a student-led clinic serving patients living with a chronic neurological impairment.

METHODS

The teaching and learning focussed clinic was established in 2018 to mirror a clinical service. Semi-structured focus groups with participants involving 20 students from 5 professions and 11 patients gathered in-depth insights into their experiences within the clinic. A thematic analysis was guided by Bourdieu's concepts of field, habitus, and capital.

RESULTS

In the complex landscape of the student-led clinic, at the intersection of a patient support group, a hospital-based aged care facility, and university-based healthcare professions, three pivotal mechanisms emerged underpinning its sustainability: Fostering students' disposition to interprofessional care, Capitalizing on collaboration and patient empowerment, and a Culture of mutual exchange of capital. These themes illustrate how students and patients specific dispositions towards interprofessional healthcare enriched their habitus by focusing on shared patient well-being goals. Diverse forms of capital exchanged by students and patients fostered trust, respect, and mutual empowerment, enhancing the clinic experience.

CONCLUSION

This study bridges an important gap in theoretically informed explorations of the conditions for sustaining student-led clinics, drawing on Bourdieu's theory. It accentuates the significance of investment of diverse forms of capital in such clinics beyond the economic, whilst emphasizing a primary commitment to advancing interprofessional healthcare expertise. Recognizing patients as equal partners shapes clinic dynamics. In order for student clinics to thrive in a sustainable fashion, educators must shift their focus beyond solely maximizing financial resources. Instead, they should champion investments in a wider range of capital forms. This requires active participation from all stakeholders; faculties, patient partners, service providers, and students. These findings underscore the importance of investing in interprofessional learning by optimizing various forms of capital, and embracing patients as dynamic contributors to the clinic's sustainability.

"It Changed How I Think"-Impact of Programmatic Assessment Upon Practicing Physicians: A Qualitative Study

Programmatic assessment is a systematic approach used to document and assess learner performance. It offers learners frequent formative feedback from a variety of contexts and uses both high- and low-stakes assessments to determine student progress. Existing research has explored learner and faculty perceptions of programmatic assessment, reporting favorable impact on faculty understanding of the importance of assessment stakes and feedback to learners while students report the ability to establish and navigate towards goals and reflect on their performance. The Cleveland Clinic Lerner College of Medicine (CCLCM) of Case Western Reserve University adopted programmatic assessment methods at its inception. With more than 18 years' experience with programmatic assessment and a portfolio-based assessment system, CCLCM is well-positioned to explore its graduates' perceptions of their programmatic assessment experiences during and after medical school. In 2020, the investigators interviewed 26 of the 339 physician graduates. Participants were purposefully sampled to represent multiple class cohorts (2009-2019), clinical specialties, and practice locations. The investigators analyzed interview transcripts using thematic analysis informed by the frameworks of self-determination theory and professional identity formation. The authors identified themes and support each with participant quotes from the interviews. Based on findings, the investigators compiled a series of recommendations for other institutions who have already or plan to incorporate elements of programmatic assessment into their curricula. The authors concluded by discussing future directions for research and additional avenues of inquiry.

Situated learning in community environments (SLICE): Systems design of an immersive and integrated curriculum for community-based learning

PURPOSE

We sought to design a micro-curriculum to structure supervised clinical placements for junior medical students within a variety of community-based settings of differing clinical disciplines. Given the gaps in the literature, this paper reflects on the opportunities and challenges of our design, implementation, and evaluation strategies in constructing an integrated task-based micro-curriculum for interprofessional community-based learning in year 2 of a four-year graduate entry program.

METHODS

The design was informed by a systems thinking framework and guided by contemporary curricular theories on self-directed and interprofessional learning. Extensive consultations with stakeholders were undertaken. Alignment with relevant national level documents and curricular frameworks was ensured.

RESULTS

The systems thinking approach provided first, an experience of applying thinking tools for a deeper understanding of how various parts of this micro-curriculum and subsystems should be integrated. Second, applying the toolkit uncovered tension points on which leverage could optimise future enhancements. Eighteen types of health professions were recruited including 105 general practitioners and 253 healthcare practitioners from a range of disciplines.

CONCLUSION

Systems thinking allows for the identification of various interacting elements within the curriculum to be considered as part of an integrated whole. Insights from this model could inform the design of similar innovative curricula.