Their OSCE, not your Oscar: Simulated Patients' Perspectives

CARECOS study: Medical students' empathy as assessed with the CARE measure by examiners versus standardized patients during a formative Objective and Structured Clinical Examination (OSCE) station

PURPOSE

To assess the Consultation And Relational Empathy (CARE) measure as a tool for examiners to assess medical students' empathy during Objective and Structured Clinical Examinations (OSCEs), as the best tool for assessing empathy during OSCEs remains unknown.

METHODS

We first assessed the psychometric properties of the CARE measure, completed simultaneously by examiners and standardized patients (SP, either teachers - SPteacher - or civil society members - SPcivil society), for each student, at the end of an OSCE station. We then assessed the qualitative/quantitative agreement between examiners and SP.

RESULTS

We included 129 students, distributed in eight groups, four groups for each SP type. The CARE measure showed satisfactory psychometric properties in the context of the study but moderate, and even poor inter-rater reliability for some items. Considering paired observations, examiners scored lower than SPs (p < 0.001) regardless of the SP type. However, the difference in score was greater when the SP was a SPteacher rather than a SPcivil society (p < 0.01).

CONCLUSION

Despite acceptable psychometric properties, inter-rater reliability of the CARE measure between examiners and SP was unsatisfactory. The choice of examiner as well as the type of SP seems critical to ensure a fair measure of empathy during OSCEs.

How simulated patients contribute to student learning in an authentic way, an interview study

INTRODUCTION

Simulated patients (SPs) play an instrumental role in teaching communication skills and enhancing learning outcomes. Prior research mostly focused on the SP's contribution to students' learning outcomes by providing feedback afterwards. A detailed understanding of the contribution of the SP during SP-student encounters is currently lacking although the majority of the interaction between SPs and students occurs during the SP-student encounter. Therefore, this study focuses on how SPs see their contribution to meaningful student learning experiences during SP-student encounters.

METHODS

We interviewed fifteen simulated patients from one institution. We explored their perspectives on meaningful learning experiences during SP-student encounters through in-depth, semi-structured interviews and analyzed using thematic analysis.

RESULTS

SPs view their contribution to meaningful student learning during SP-student encounters from two perspectives. A collective perspective as a member of the community of SPs and an individual perspective. From the collective perspective, SPs believe that the fact that students deal with multiple varied SP-student encounters over time is of value for meaningful learning. From the individual perspective, we noticed that SPs think, act, and react from three different positions. First, as the patient in the role description, second, as a teaching aid and third, as an individual with personal experiences, beliefs, and values. SPs mentioned that the ratio between these different positions can vary within and between encounters.

CONCLUSIONS

According to SPs, we should value the variation between SPs, thereby creating meaningful variation in authentic interactions in SP-student encounters. SPs should be allowed to act and react from different positions during SP-student encounters, including their role description, as teaching aid, and based on their own experiences. In this way, SP-student encounters are optimized to contribute to meaningful student learning through authenticity.

'How can we help the students learn?' A grounded theory study of simulated participants as educators

PURPOSE

Despite the demonstrated value of simulated participant (SP) feedback, we are only beginning to understand how to optimize SPs' feedback practices for communication skills and strengthen their role as educators. SPs portray roles and engage in feedback practices to support simulated-based learning for communication skills training. SPs come to their role with diverse experiences, knowledge, and training, such as (a) professional actors, (b) lay people, and (c) health professions educators. This study explored what factors influenced SPs' role as educators, including their preparation, training, and approach to role portrayal and feedback practices and how these aspects were influenced by SPs' backgrounds.

METHODS

Using grounded theory methodology, we collected and analysed data iteratively from 16 semi-structured in-depth interviews. We identified key concepts, using constant comparison and by exploring how concepts were related , to develop a conceptual model of SPs as educators.

RESULTS

The SP role as educator was shaped by several interrelated dualities which spanned both the SP and learner roles and contributed to the identity formation of both SP and learner: (a) building competence (SP competence as educator and learner competence as healthcare professional), (b) engaging in reflective practice (SPs prompting learner reflection and SPs reflecting on their own role), and (c) establishing a safe space (SP needing to feel safe in their role to create safety to support learner engagement). SPs' backgrounds influenced how they learned to portray roles and how they engaged in feedback practices, both in-action, through in-role prompts and cues, and on-action, through post-scenario feedback discussions.

CONCLUSION

Our conceptual model about SPs as educators informs SP selection and training. Further, this model enables practical suggestions for SP educators and faculty who involve SPs in teaching. Enhanced feedback practices have the potential to improve learning from simulated encounters.

Evaluation of Virtual Assessment for a High Stakes' Clinical Examination-Physician Assistant Students' and Their Examiners' Perspectives

PURPOSE

This case study emerged from the necessity to reschedule an in-person long case examination to an online platform for physician assistant students' final clinical examination during COVID-19 restrictions. The aim of this study was to evaluate the experiences of students and examiners for a high stakes' clinical examination online.

METHODS

This was an evaluation research study using the Context, Input, Process, Product model, which provided a framework to establish the effectiveness and/or success of an online format for a high stakes' clinical examination. All students and examiners were invited to take part in virtual interviews.

RESULTS

The results suggest that both students (n = 5) and examiners (n = 7) agree that, although the stress of a face-to-face examination was lessened for the student, this was balanced by a new stressor of potential Internet problems. All agreed that a virtual setting for a high stakes' assessment is not transferable, with both groups citing the lack of opportunities to "read the patient" and "showcase their physical examination skills" as challenging.

CONCLUSION

Our study suggests that, in the context of balancing the risks of the pandemic with graduating health care professionals, the online clinical examination format met the required assessment criteria. Recommendations suggest that the long case could be planned so that students and patients are in the same setting to perform a physical examination, confirming the finding that questions on "how to" examine a patient are no substitute for "doing."