Supervisor perspectives on the summative in-training assessment

Assessor discomfort and failure to fail in clinical performance assessments

BACKGROUND

Assessment of trainee performance in the workplace is critical to ensuring high standards of clinical care. However, some supervisors find the task to be challenging, and may feel unable to deliver their true judgement on a trainee's performance. They may 'keep MUM' (that is, keep mum about undesirable messages) and fail to fail an underperforming trainee. In this study, we explore the effect of discomfort on assessors.

METHODS

Using a survey method, supervisors of trainees in the Australasian College of Dermatologists were asked to self-report experiences of discomfort in various aspects of trainee workplace assessment and for their engagement in MUM behaviours including failure to fail.

RESULTS

Sixty-one responses were received from 135 eligible assessors. 12.5% of assessors self-reported they had failed to fail a trainee and 18% admitted they had grade inflated a trainee's score on a clinical performance assessment in the previous 12-month period. Assessors who reported higher levels of discomfort in the clinical performance assessment context were significantly more likely to report previously failing to fail a trainee. The study did not reveal significant associations with assessor demographics and self-reports of discomfort or MUM behaviours.

CONCLUSIONS

This study reveals the impact of assessor discomfort on the accuracy of assessment information and feedback to trainees, including as a contributing factor to the failure to fail phenomenon. Addressing assessor experience of discomfort offers one opportunity to impact on the complex and multifactorial issue that failure to fail represents.

In-training assessments: 'The difficulty is trying to balance reality and really tell the truth'

BACKGROUND

In-training assessments (ITA) aim to evaluate trainees' progress and give valuable feedback on their performance. Many factors can affect supervisors during their completion of assessments and these can influence the final results recorded.

METHODS

This is the second part of a study of supervisors of the Australasian College of Dermatologists (ACD) and presents the qualitative data on their opinions of the ACD ITA process and the influences on their ITA ratings.

RESULTS

Supervisors noted the benefits of this assessment tool, together with many limitations. Potential influences upon supervisor ratings included the relationship between the supervisor and trainee and the level of honesty in completing and delivery of the assessment.

CONCLUSIONS

Many factors influence supervisors in the completion of the ITA. These include the impact of interpersonal relationships and concerns about the consequences of delivering a negative assessment, which sometimes lead supervisors to modify the assessment they deliver to the trainee. Further research is needed into honesty in assessment judgements.