Getting Real: Embracing the Conditions of the Third-Year Clerkship and Reimagining the Curriculum to Enable Deliberate Practice

Coachability: A Longitudinal Curriculum to Promote Medical Students' Growth Mindset, Feedback Utilization, and Resilience

Introduction

The concept of medical student coachability, adapted from athletics and business management, offers a framework for characterizing students' roles as clinical learners. We defined coachability as effectively seeking, receiving, and using feedback-even negative feedback-to change behavior and reach learning goals. To facilitate success in our clinical clerkships, we sought to empower preclerkship students' capacity to be coached.

Methods

Our curriculum comprised two large-group presentations and three small-group seminars totaling approximately 5 hours, distributed over 2 years: a year 1 orientation, a year 2 refresher, and a longitudinal year 2 seminar series. Medical students designed and first implemented the curriculum under faculty supervision in academic year (AY) 2015-2016 and have continuously managed and run it since. The AY 2022-2023 curriculum management team evaluated the curriculum cross-sectionally via student survey and focus groups.

Results

Approximately 575 students have completed the curriculum since 2015. Immediately following curriculum delivery, AY 2022-2023 year 2 students (response rate: 70%-97%) rated it a valuable educational experience and described plans to implement the lessons learned in their clerkship. Focus group participants (eight clerkship students who participated in the coachability curriculum in AY 2021-2022) reported using coachability strategies to positive effect for their clinical learning and well-being.

Discussion

Our curriculum's flexible, modular format facilitates adoption by others. Future development could expand coachability offerings across the continuum of medical school. However, the curriculum should remain led by students passionate about medical education and willing to try new things to continuously adapt content and instructional strategies.

Exploring medical students' use of principles of self-explanation and structured reflection during clerkship

Background

While educators observe gaps in clerkship students' clinical reasoning (CR) skills, students report few opportunities to develop them. This study aims at exploring how students who used self-explanation (SE) and structured reflection (SR) for CR learning during preclinical training, applied these learning strategies during clerkship.

Methods

We conducted an explanatory sequential mixed-methods study involving medical students. With a questionnaire, we asked students how frequently they adopted behaviours related to SE and SR during clerkship. Next, we conducted a focus group with students to explore why they adopted these behaviours.

Results

Fifty-two of 198 students answered the questionnaire and five participated in a focus group. Specific behaviours adopted varied from 50% to 98%. We identified three themes about why students used these strategies: as "just in time" learning strategies; to deepen their understanding and identify gaps in knowledge; to develop a practical approach to diagnosis. A fourth theme related to the balance between learning and assessment and its consequence on adopting SE behaviours.

Conclusions

Students having experienced SE and SR regularly in preclinical training tend to transpose these strategies into the clerkship providing them with a practical way to reflect deliberately and capture learning opportunities of the unpredictable clinical context.

The Case for Feedback-in-Practice as a Topic of Educational Scholarship

The importance of clinical performance feedback is well established and the factors relevant to its effectiveness widely recognized, yet feedback continues to play out in problematic ways. For example, learning culture modifications shown to facilitate feedback have not seen widespread adoption, and the learner-educator interactions prescribed by research rarely occur organically. Nevertheless, medical learners achieve clinical competence, suggesting a need to expand educational scholarship on this topic to better account for learner growth. This Scholarly Perspective argues for a more extensive exploration of feedback as an educational activity embedded in clinical practice , where joint clinical work that involves an educator and learner provides a locus for feedback in the midst of performance. In these clinically embedded feedback episodes, learning and performance goals are constrained by the task at hand, and the educator guides the learner in collaboratively identifying problematic elements, naming and reframing the source of challenge, and extrapolating implications for further action. In jointly conducting clinical tasks, educators and learners may frequently engage in feedback interactions that are both aligned with workplace realities and consistent with current theoretical understanding of what feedback is. However, feedback embedded in practice may be challenged by personal, social, and organizational factors that affect learners' participation in workplace activity. This Scholarly Perspective aims to provide a conceptual framework that helps educators and learners be more intentional about and fully participatory in this important educational activity. By topicalizing this feedback-in-practice and exploring its integration with the more commonly foregrounded feedback-on-practice , future educational scholarship may achieve optimal benefit to learners, educators, and clinical practice.

If You Build It, Will They Come? Exploring the Impact of Medical Student Engagement on Clerkship Curriculum Outcomes

Introduction

Inconsistent or superficial access to workplace learning experiences can impede medical students' development. Well-designed clerkship curricula provide comprehensive education by offering developmental opportunities in and out of the workplace, explicitly linked to competency objectives. Questions remain about how students engage with clerkship curriculum offerings and how this affects their achievement. This study investigated student engagement as the source of an apparent clerkship curriculum malfunction: increasing rate of substandard summative clinical competency exam (SCCX) performance over 3 years following curriculum reform.

Materials and Methods

We sampled from three cohorts of US medical students (classes of 2018-2020) based on their post-clerkship SCCX performance: substandard (N = 33) vs. exemplary (N = 31). Using a conceptually based, locally developed rubric, a five-person team rated students' engagement in a curriculum offering designed to provide standardized deliberate practice on the clerkship's competency objectives. We examined the association between engagement and SCCX performance, taking prior academic performance into account.

Results

Rate of substandard SCCX performance could not be explained by cohort differences in prior academic performance. Student engagement differed across cohorts and was significantly associated with SCCX performance. However, engagement did not meaningfully predict individual students' SCCX performance, particularly in light of prior academic performance.

Discussion

Engagement with a particular learning opportunity may not affect clerkship outcomes, but may reflect students' priorities when navigating curricular offerings, personal learning goals, and curriculum policy. Proposing four patterns of engagement in clerkship learning, this study prompts reflection on the complex interaction among factors that affect engagement and outcomes.

Difficulties with Learning Musculoskeletal Physical Examination Skills: Student Perspectives and General Lessons Learned for Curricular Design

Phenomenon: The development of foundational clinical skills, such as physical examination, is essential to becoming a competent clinician. Musculoskeletal medicine is often considered a specialized area of practice despite the high prevalence of musculoskeletal conditions in the general population and presenting to general clinical practices. Prior work has shown that medical learners and practicing clinicians have low confidence in these skills but understanding of the student perspective on why these skills are more difficult to acquire is unclear.Approach: Our study was guided by social constructivist learning theory to explore the learner experience and present their perspectives. Qualitative analysis investigated the difference between learning musculoskeletal physical examination versus other body systems, using the voices from 11 semi-structured focus group interviews. Participants included third-year medical students across two academic cohorts at one institution. Our analysis was grounded in the principles of phenomenology and used triangulation and reflexivity to provide rigorous analysis.Findings: Students provided rich and insightful perspectives regarding their experiences in learning musculoskeletal physical examination techniques. Four themes were developed from our data: a) the need for opportunities for both supervised and self-directed practice; b) assessment and competence as motivations for learning; c) the need for a different approach to the content and structure of musculoskeletal medicine and its associated examination techniques; and d) the need for distinct expertise and technical skill from musculoskeletal examination teachers.Insights: This study provides a valuable lens to critically reflect on existing curriculum and pedagogical approaches to musculoskeletal examination skills. Lessons from this study may be applicable to curriculum design in general, especially the teaching of physical examination skills, such as how it is taught and integrated with other content (including anatomy), how much practice is required, who teaches physical examination skills, and what faculty development is needed to standardize teaching. Promoting a learner-centered approach to the teaching and learning of these clinical skills will be beneficial to all stakeholders, especially to our future physicians and their patients.Supplemental data for this article is available online at https://doi.org/10.1080/10401334.2021.1954930 .

e-Learning for enhancement of medical student performance at the Objective Structured Clinical Examination (OSCE)

This study aimed to investigate the impact of student e-learning on the development of clinical competencies. The study participants were 3^rd year students (n = 43) at a private mid-sized medical school located in a South Korean suburb on a four-year medical program. Educational intervention was implemented to enhance student clinical performance. Students engaged in learning activities that intended to promote their self-directed learning abilities and clinical performances using e-learning resources. Intervention was conducted for the duration of six months during the 3^rd year and its effectiveness was investigated by comparing student performances in OSCEs in a pre- and post- comparison format and also by comparing them with national scores. In addition, student perceptions of the impact of e-learning on their OSCE performances were assessed using a questionnaire, which included 36 items that elicited student perceptions of their experiences of e-learning and readiness for e-learning. Student OSCE scores improved significantly after educational intervention in all domains of clinical competencies assessed and for total scores (p < 0.001). Furthermore, students achieved higher OSCE scores than national average scores in the post-test, whereas they had performed lower than national average scores in the pre-test. Students showed neutral or slightly positive responses to the effectiveness of e-learning, and their perceptions of e-learning were not associated with their e-learning readiness scores. The study shows student OSCE performance improved significantly after educational intervention, which indicate the effectiveness of e-learning to support student learning of clinical performance. Despite significant improvements in student OSCE scores after e-learning, their perceptions of its effectiveness were neutral. Furthermore, student perceptions of e-learning were not associated with their readiness for it. Suggestions are made to help students use e-learning more effectively to enhance their clinical competencies.

Machine Scoring of Medical Students' Written Clinical Reasoning: Initial Validity Evidence

PURPOSE

Developing medical students' clinical reasoning requires a structured longitudinal curriculum with frequent targeted assessment and feedback. Performance-based assessments, which have the strongest validity evidence, are currently not feasible for this purpose because they are time-intensive to score. This study explored the potential of using machine learning technologies to score one such assessment-the diagnostic justification essay.

METHOD

From May to September 2018, machine scoring algorithms were trained to score a sample of 700 diagnostic justification essays written by 414 third-year medical students from the Southern Illinois University School of Medicine classes of 2012-2017. The algorithms applied semantically based natural language processing metrics (e.g., coherence, readability) to assess essay quality on 4 criteria (differential diagnosis, recognition and use of findings, workup, and thought process); the scores for these criteria were summed to create overall scores. Three sources of validity evidence (response process, internal structure, and association with other variables) were examined.

RESULTS

Machine scores correlated more strongly with faculty ratings than faculty ratings did with each other (machine: .28-.53, faculty: .13-.33) and were less case-specific. Machine scores and faculty ratings were similarly correlated with medical knowledge, clinical cognition, and prior diagnostic justification. Machine scores were more strongly associated with clinical communication than were faculty ratings (.43 vs .31).

CONCLUSIONS

Machine learning technologies may be useful for assessing medical students' long-form written clinical reasoning. Semantically based machine scoring may capture the communicative aspects of clinical reasoning better than faculty ratings, offering the potential for automated assessment that generalizes to the workplace. These results underscore the potential of machine scoring to capture an aspect of clinical reasoning performance that is difficult to assess with traditional analytic scoring methods. Additional research should investigate machine scoring generalizability and examine its acceptability to trainees and educators.

Teaching online: foundational concepts of online learning and practical guidelines

Medical schools have been slowly adopting online learning into pedagogical methods for more than a decade. While some medical educators are reluctant to accept these changes, the ongoing coronavirus disease 2019 (COVID-19) pandemic poses a threat to the delivery of traditional medical education, which has accelerated the inevitable implementation of online learning. This sudden change may be a new challenge to medical educators who are new to this territory. Therefore, this review aims to provide foundational concepts of online learning and practical guidelines in the context of medical education. The authors first identify three foundational concepts, which are transactional distance, presence, and independent learners. In online learning, transactional distance, determined by dialogue and structure, becomes more important than physical distance. Furthermore, effective and successful online learning requires the achievement and accommodation of cognitive, social, and teaching presences. It is also crucial to recognize learners not as passive recipients of information predefined by a teacher, but as active, capable, and independent individuals. The authors, then, discuss the practical guidelines for designing an effective online curriculum. Five online pedagogical guidelines are laid out in this review: design structures and flows to embrace experiential learning, accommodate both synchronous and asynchronous learning, design/facilitate interactions, promote practice opportunities, and promote a learning community. By understanding the foundational concepts and applying these guidelines, the adoption of online learning in the medical school may supplement the traditional medical education or even provide additional benefits in the new normal after the COVID-19 pandemic.

The journeys of three ASPIRE winning medical schools toward excellence in student assessment

Introduction: ASPIRE Excellence Awards in Student Assessment are offered to medical schools with innovative and comprehensive assessment programmes adjudged by international experts, using evidence-based criteria. The journeys of three ASPIRE-winning medical schools toward "assessment excellence" are presented. These schools include Aga Khan University Medical College (AKU-MC), Pakistan, Southern Illinois University School of Medicine (SIUSOM), USA, and University of Leeds School of Medicine, UK. Methods: The unfolding journeys highlighting achievements, innovations, and essential components of each assessment programme were compared to identify differences and commonalities. Results: Cultural contextual differences included developed-versus-developing country, east-west, type of regulatory bodies, and institutional-versus-national certifying/licensing examinations, which influence curricula and assessments. In all, 12 essential commonalities were found: alignment with institutional vision; sustained assessment leadership; stakeholder engagement; communication between curriculum and assessment; assessment-for-learning and feedback; longitudinal student profiling of outcome achievement; assessment rigor and robustness; 360° feedback from-and-to assessment; continuous enrichment through rigorous quality assurance; societal sensitivity; influencing others; and a "wow factor." Conclusions: Although the journeys of the three medical schools were undertaken in different cultural contexts, similar core components highlight strong foundations in student assessment. The journeys continue as assessment programmes remain dynamic and measurement science expands. This article may be helpful to other institutions pursuing excellence in assessment.

Clerkship Curriculum Design and USMLE Step 2 Performance: Exploring the Impact of Self-Regulated Exam Preparation

PURPOSE

This study examined medical students' stress and certification exam preparation practices in a reformed clerkship curriculum that excluded high-stakes knowledge testing from end-of-rotation performance evaluation.

METHOD

Stress and exam preparation practices were assessed via a survey comprising locally developed questions, three subscales of the Motivated Strategies for Learning Questionnaire, and two subscales of the Medical Student Stressor Questionnaire. The association between stress, learning self-regulation, and certification exam scores was evaluated retrospectively using non-parametric tests of association (Spearman's rho).

RESULTS

Forty students responded to the survey and consented to use of academic performance data (57% participation rate). Mean certification exam scores were indistinguishable from historical controls. Exam preparation practices resembled those of pre-clinical students: exam-related worrying and time devoted to studying were high, increasing as the exam drew near; preferred study resources were directly analogous to exam questions; and study involved relatively few generative strategies (e.g., concept mapping). Sustaining effort and creating time and space to study were associated with better exam performance, as was participation in this study.

DISCUSSION

On the surface, the absence of regularly spaced, high-stakes testing from clerkship performance evaluation appears to "do no harm" to students' certification exam scores. Students already performing better academically may excel due in part to effective learning self-regulation strategies. However, a clerkship curriculum that does not scaffold self-regulation via cumulative knowledge assessment could further disadvantage students already earning lower scores. Evaluating the impact of curriculum reforms should continuously examine changes to learners' experience in context.

Relationships Matter: Enhancing Trainee Development with a (Simple) Clerkship Curriculum Reform

PROBLEM

The traditional clerkship model of brief encounters between faculty and students results in reduced meaningful learning opportunities due to the lack of a relationship that enables repeated observation, supervisor feedback, trust formation, and growth.

INTERVENTION

Clinical clerkships at our institution were restructured to decrease fragmentation of supervision and foster an educational alliance between faculty and student. A mixed-methods approach was used to study the impact of this curriculum reform on the student experience in the obstetrics and gynecology clerkship. Student participation in patient care was assessed by comparing the number of common obstetric procedures performed before and after clerkship reform. Separate qualitative analyses of comments from student surveys and a faculty focus group revealed themes impacting student involvement. The supervisor-trainee relationship was further investigated by analysis of "rich picture" discussions with students and faculty.

CONTEXT

Clerkships in the 3rd year of our 4-year undergraduate medical curriculum were converted from an experience fragmented by both didactic activities and multiple faculty supervisors to one with a single supervisor and the elimination of competing activities.

OUTCOMES

Students in the revised clerkship performed twice the number of obstetric procedures. Objective measures (United States Medical Licensing Examination Step 1 scores, receiving clerkship honors, self-reported interest in obstetrics, and gender) did not correlate with the number of procedures performed by students. Qualitative analysis of student survey comments revealed that procedure numbers were influenced by being proactive, having a supervisor with a propensity to teach (trust), and contextual factors (busy service or competition with other learners). Themes identified by faculty that influenced student participation included relationship continuity; growth of patient care skills; and observed student engagement, interest, and confidence. The quality of the relationship was cited by both students and faculty as a factor influencing meaningful clinical participation. Discussions of "rich pictures" drawn by students and faculty revealed that relationships are influenced by continuity, early alignment of goals, and the engagement and attitude of both student and faculty.

LESSONS LEARNED

Clinical curricular reforms that strengthen the continuity of the supervisor-trainee relationship promote mutual trust and can result in a more meaningful training experience in less time. Reciprocal engagement and early alignment of goals between supervisor and trainee are critical for creating a positive relationship.

Positive Outcomes of Optimizing Student-Preceptor Continuity in a Traditional Block Clerkship

PROBLEM

Student-preceptor discontinuity during 3rd-year clerkships limits the quality and quantity of supervision, teaching, and feedback. Although longitudinal integrative clerkships increase continuity and are associated with improved student and preceptor experience, they require schoolwide curricular reform. Alternative innovations enhancing student-preceptor relationships within the constraints of a traditional block clerkship may demonstrate similar benefits.

INTERVENTION

We piloted a continuity-enhanced general pediatric ambulatory schedule during 2 consecutive clerkship blocks in 2013. Students in the continuity-enhanced model (n = 29) were assigned 1-3 primary clinic preceptors, whereas those in the traditional model (n = 30) worked with 5-8. Data were gathered from student assessments and anonymous student and preceptor surveys. We used t and Fisher's exact tests to compare the two groups and performed thematic analysis of free-text survey comments.

CONTEXT

Our school utilizes a block clerkship model with approximately 30 students rotating through the pediatric clerkship every 8 weeks. During the 3-week ambulatory portion, students spend 8 half days in the general pediatric ambulatory clinic. At the conclusion of each clinic, attendings completed brief student evaluation cards. Traditionally, student and attending schedules were created independently, resulting in transient supervisory relationships and dissatisfaction with clinical engagement, feedback, and evaluation.

OUTCOME

Seventy-three percent (43/59) of the students completed the survey. Ten general ambulatory attendings collectively completed 87.5% (35/40) of the monthly surveys. Continuity students received significantly more narrative evaluation comments (10.6 vs. 5.8, p <. 001) from general ambulatory clinic attendings and were more likely to have at least one general ambulatory clinic attending endorse being able to provide meaningful feedback and evaluation (n = 29, 100% vs. n = 20, 66.7%, p <. 001). Continuity students were also more likely to endorse being able to ask at least one of these attendings for a letter of recommendation (71.4% vs. 9.1%, p <. 001) and to have at least one general ambulatory clinic attending endorse being able to provide a meaningful letter of recommendation if asked (62.1% vs. 3.3%, p <. 001). Students (88.4%) and attendings (85.7%) preferred the continuity-enhanced schedule. The most frequent theme of both student and attending free-text survey remarks were relationships and assessment.

LESSONS LEARNED

Intentional scheduling of clerkship students to enhance preceptor continuity resulted in significant positive outcomes echoing the relationship-based educational benefits of longitudinal clerkships, particularly in regards to student assessment and feedback. Clerkship directors and other medical educators should consider implementing small changes within block clerkships to maximize student-preceptor continuity.

"A steep learning curve": junior doctor perspectives on the transition from medical student to the health-care workplace

BACKGROUND

The transition from medical student to hospital-based first year junior doctor (termed "intern" in Australia) is known to be challenging, and recent changes in clinical learning environments may reduce graduate preparedness for the intern workplace. Although manageable challenges and transitions are a stimulus to learning, levels of burnout in junior medical colleagues are concerning. In order to prepare and support medical graduates, educators need to understand contemporary junior doctor perspectives on this transition.

METHODS

Final-year University of Queensland medical students recruited junior doctors working in diverse hospital settings, and videorecorded individual semi-structured interviews about their transition from medical student to working as a junior doctor. Two clinical academics (NS and JT) and an intern (ZT) independently conducted a descriptive analysis of interview transcripts, and identified preliminary emerging concepts and themes, before reaching agreement by consensus on the major overarching themes.

RESULTS

Three key themes emerged from the analysis of 15 interviews: internship as a "steep learning curve"; relationships and team; and seeking help. Participants described the intern transition as physically, mentally and emotionally exhausting. They learned to manage long days, administrative and clinical tasks, frequent interruptions and time pressures; identify priorities; deal with criticism without compromising key relationships; communicate succinctly; understand team roles (including their own status within hospital hierarchies); and negotiate conflict. Participants reported a drop in self-confidence, and difficulty maintaining self-care and social relationships. Although participants emphasised the importance of escalating concerns and seeking help to manage patients, they appeared more reluctant to seek help for personal issues and reported a number of barriers to doing so.

CONCLUSION

Findings may assist educators in refining their intern preparation and intern training curricula, and ensuring that medical school and intern preparation priorities are not seen as competing. Insights from non-medical disciplines into the organisational and relational challenges facing junior doctors and their health-care teams may enhance inter-professional learning opportunities. Workplace support and teaching, especially from junior colleagues, is highly valued during the demanding intern transition.

Competencies, milestones, and EPAs - Are those who ignore the past condemned to repeat it?

BACKGROUND

The idea of competency-based education sounds great on paper. Who wouldn't argue for a standardized set of performance-based assessments to assure competency in graduating students and residents? Even so, conceptual concerns have already been raised about this new system and there is yet no evidence to refute their veracity.

AIMS

We argue that practical concerns deserve equal consideration, and present evidence strongly suggesting these concerns should be taken seriously.

METHOD

Specifically, we share two historical examples that illustrate what happened in two disparate contexts (K-12 education and the Department of Defense [DOD]) when competency (or outcomes-based) assessment frameworks were implemented. We then examine how observation and assessment of clinical performance stands currently in medical schools and residencies, since these methodologies will be challenged to a greater degree by expansive lists of competencies and milestones.

RESULTS/CONCLUSIONS

We conclude with suggestions as to a way forward, because clearly the assessment of competency and the ability to guarantee that graduates are ready for medical careers is of utmost importance. Hopefully the headlong rush to competencies, milestones, and core entrustable professional activities can be tempered before even more time, effort, frustration and resources are invested in an endeavor which history suggests will collapse under its own weight.

Effectiveness of a rural longitudinal integrated clerkship in preparing medical students for internship

BACKGROUND

We interviewed graduates from the first two cohorts of a postgraduate medical program that had a senior year longitudinal integrated clerkship (LIC) in a practice setting in rural New South Wales, Australia to determine how well their training prepared them to be junior doctors (3-4 years after graduation), and what aspects of that training they thought were particularly useful.

METHODS

In-depth interviews.

RESULTS

Fourteen junior doctors were interviewed. Participants reported feeling well prepared in ability to develop close relationships with clinical supervisors, good clinical and procedural skills, ability to work autonomously and work in teams, knowledge of health systems, ability to ensure self-care, and professionalism. Consensus view was that a rural placement was an excellent way to learn medicine for a variety of reasons including relationships with clinicians, less competition for access to patients, and opportunities to extend their clinical skills and act up to intern level.

CONCLUSION

The advantages we found in the training these junior doctors received which prepared them well for internship were integral both to the longitudinal, unstructured placement, and to the fact that it was carried out in a rural area. The two aspects of these placements appear to act synergistically, reinforcing the learning experience.