Profiles for Success: Examining the Relationship between Student Profiles and Clerkship Performance Using Latent Profile Analysis

Tailoring support following summative assessments: a latent profile analysis of student outcomes across five medical specialities

Summative assessments are often underused for feedback, despite them being rich with data of students' applied knowledge and clinical and professional skills. To better inform teaching and student support, this study aims to gain insights from summative assessments through profiling students' performance patterns and identify those students missing the basic knowledge and skills in medical specialities essential for their future career. We use Latent Profile Analysis to classify a senior undergraduate year group (n = 295) based on their performance in applied knowledge test (AKT) and OSCE, in which items and stations are pre-classified across five specialities (e.g. Acute and Critical Care, Paediatrics,…). Four distinct groups of students with increasing average performance levels in the AKT, and three such groups in the OSCE are identified. Overall, these two classifications are positively correlated. However, some students do well in one assessment format but not in the other. Importantly, in both the AKT and the OSCE there is a mixed group containing students who have met the required standard to pass, and those who have not. This suggests that a conception of a borderline group at the exam-level can be overly simplistic. There is little literature relating AKT and OSCE performance in this way, and the paper discusses how our analysis gives placement tutors key insights into providing tailored support for distinct student groups needing remediation. It also gives additional information to assessment writers about the performance and difficulty of their assessment items/stations, and to wider faculty about student overall performance and across specialities.

Self-regulated learning profiles including test anxiety linked to stress and performance: A latent profile analysis based across multiple cohorts

INTRODUCTION

Medical educators aim to understand why students differ in performance and stress. While performance and stress are associated with student demographics, school factors and aspects of self-regulated learning (SRL), it remains unclear how these elements interact within individuals. This multi-cohort study identified SRL profiles among medical students and explored their associations with performance and stress. Additionally, we examined the identified profiles' associations with gender, migration status and assessment policy.

METHODS

We used latent profile analysis (LPA) to identify profiles on Motivated Strategies for Learning Questionnaire (MSLQ) scores of six cohorts (2014-2019) of Year 1, first semester medical students (n = 1894) in a Dutch medical school. We used nine MSLQ subscales that measure test anxiety (TA), self-efficacy, deep learning, resource management and value. The university's assessment policy varied, demanding students to obtain 100% or 75% of Year 1 credits to remain enrolled. We defined optimal performance as obtaining all credits at the end of Year 1. Two cohorts completed the Perceived Stress Scale (PSS-14, n = 409) in the 2nd semester.

RESULTS

We identified three distinct student profiles: 693/1894(36.6%) were classified as TAhighSRLhigh, 661/1894(34.9%) as TAlowSRLhigh and 540/1894(28.5%) as TAmoderateSRLlow. Females were more likely to belong to TAhighSRLhigh profiles compared to males (effect size [ES] Cramer's V = .13, small). Migration background was not associated with these profiles. The TAhighSRLhigh profile was more prevalent under the 100% assessment policy (ES Cramer's V = .10, negligible). TAlowSRLhigh students demonstrated lower stress levels (PSS = 23.9 out of 56) compared to TAhighSRLhigh students (PSS = 28.7, ES Cohen's d = .62, medium) and TAmoderateSRLlow students (PSS = 28.2, ES Cohen's d = .51, medium). Performance differed among the three profiles (ES Cramer's V = .16, small): 82.5% optimal performance in the TAlowSRLhigh, 71.9% in the TAhighSRLhigh and 65.2% in the TAmoderateSRLlow profile.

DISCUSSION

Three distinct SRL student profiles associated with gender, academic performance and perceived stress were identified. Test anxiety had additional value in distinguishing subgroups with differential academic performance and stress. These profiles may aid educators to inform personalised support strategies for novice learners.

An exploratory study of goal orientations of traditional block and longitudinal integrated clerkship students

BACKGROUND

Achievement goal theory links goal setting, motivation, and learning and describes three orientations: 'mastery' (seeking learning), 'performance' (seeking positive judgments), and 'performance-avoidance' (avoiding negative judgments). Mastery orientation is considered most adaptive. The authors investigated goal orientations of traditional block clerkship (TBC) and longitudinal integrated clerkship (LIC) students.

METHODS

This was an exploratory study conducted at one US medical school. Three hundred and twenty students completed an anonymous survey consisting of three tools with validation evidence: Patterns of Adaptive Learning Survey, Task-choice Goal Measures, and Questionnaire Goal Choice Items. The authors analyzed the data using regression analyses, Chi-square, and Wilcoxon's rank-sum tests.

RESULTS

While all students rated mastery items most highly on the five-point Likert scale (mean 4.58/5.00), LIC students rated performance-orientation lower (β = -0.36, p = .04), chose personal mastery-orientation items more frequently (92% vs. 64.4%, p = .005), and perceived their learning environment as promoting less performance (β = -0.60, p = .002) and performance-avoidance (β = -0.78, p < .001) compared to TBC students.

CONCLUSIONS

LIC and TBC students differed in their report of personal and clerkship goal orientations. These differences may inform educational design and future research to promote students' mastery orientation.