Simulated patients and objective structured clinical examinations: review of their use in medical education

Status of abortion curriculum in genetic counseling: Survey of graduate programs and recent graduates in the United States

Genetic counselors (GCs) are trained to help individuals navigate the medical and psychological implications of genetic test results, familial conditions, and ultrasound anomalies. Therefore, familiarity with reproductive options, including abortion, is vital. However, previous studies have found gaps in GCs' knowledge regarding abortion care and there are currently no recommendations regarding abortion curriculum. This study aimed to assess the state of abortion curriculum in genetic counseling graduate programs in the United States and to examine and compare the satisfaction levels of program representatives and recent graduates. Program representatives and recent graduates were invited to complete an anonymous survey evaluating the abortion curriculum, satisfaction with said curriculum, and perceived preparedness to counsel on abortion. Quantitative data from 46 program representatives and 123 recent graduates were analyzed using descriptive statistics and appropriate statistical analyses, including the Mann-Whitney U-test and the Kruskal-Wallis test. Large variability existed in the amount and types of abortion training. Results showed greater satisfaction and feelings of preparation to counsel on abortion in graduates whose program provided a dedicated abortion curriculum (p < 0.001, p = 0.005). In addition, graduates with abortion counseling experience felt less prepared to counsel on abortion than their programs believed them to be (p = 0.04). Graduates perceived procedural timing, facilitation of genetic testing, and resources/support desired by patients before, during, or after an abortion, to be the most important topics, although these were not included in all programs' curriculum. Program representatives and recent graduates alike noted that variability in clinical training is a barrier to abortion education. Our results demonstrate a need for curricular reform to reduce variability in training and ensure that all graduates receive the same foundational abortion education. Further research is needed to determine the scope of GCs in abortion care, as well as which topics and education formats are most helpful in graduate education.

Simulated Participants' Experiences and Challenges With Online and Face-to-Face Interactions During COVID-19: A Case Study in UAEU

INTRODUCTION

Direct patient contact is essential when training health professionals for future patient-centered interactions. Simulated participants (SPs) play a critical role during training; however, limited information is available about their personal perspectives. This study explored SPs at the College of Medicine and Health Sciences experiences, adaptations, and preferences regarding online and face-to-face encounters.

METHODS

After ethical approval, a qualitative research study using structured in-depth interviews was conducted online with 16 SPs, applying critical incident narratives and storytelling. Interview data were transcribed and encoded using thematic framework analysis, after which member checking was conducted to increase credibility.

RESULTS

All SPs acknowledged the benefits of online delivery models during the pandemic, including the convenience of working from home, continued clinical skills training, and personal protection from COVID infection. Participants preferred face-to-face delivery over online encounters, except for one SP, who saw no difference. Challenges included technical issues, communication problems, and lack of realism.

CONCLUSIONS

Although these results cannot be generalized, all participants acknowledged the relevance of online portrayals during the pandemic. Most preferred face-to-face delivery models for improving role-playing and enhancing personal communication to achieve better patient outcomes, while one SP had no preference. The use of concurrent online and face-to-face methods may more effectively engage SPs in simulation-based education. Before restructuring programs, further research is needed, including a deeper exploration of students' and educators' perspectives.

A systematic review of effective quality feedback measurement tools used in clinical skills assessment

BACKGROUND

Objective Structured Clinical Examination (OSCE) is a valid tool to assess the clinical skills of medical students. Feedback after OSCE is essential for student improvement and safe clinical practice. Many examiners do not provide helpful or insightful feedback in the text space provided after OSCE stations, which may adversely affect learning outcomes. The aim of this systematic review was to identify the best determinants for quality written feedback in the field of medicine.   Methods: PubMed, Medline, Embase, CINHAL, Scopus, and Web of Science were searched for relevant literature up to February 2021. We included studies that described the quality of good/effective feedback in clinical skills assessment in the field of medicine. Four independent reviewers extracted determinants used to assess the quality of written feedback. The percentage agreement and kappa coefficients were calculated for each determinant. The ROBINS-I (Risk Of Bias In Non-randomized Studies of Interventions) tool was used to assess the risk of bias.

RESULTS

14 studies were included in this systematic review. 10 determinants were identified for assessing feedback. The determinants with the highest agreement among reviewers were specific, described gap, balanced, constructive and behavioural; with kappa values of 0.79, 0.45, 0.33, 0.33 and 0.26 respectively. All other determinants had low agreement (kappa values below 0.22) indicating that even though they have been used in the literature, they might not be applicable for good quality feedback. The risk of bias was low or moderate overall.

CONCLUSIONS

This work suggests that good quality written feedback should be specific, balanced, and constructive in nature, and should describe the gap in student learning as well as observed behavioural actions in the exams.  Integrating these determinants in OSCE assessment will help guide and support educators for providing effective feedback for the learner.

Virtual objective structured clinical examination during the COVID-19 pandemic: An essential addition to dental assessment

INTRODUCTION

COVID-19 has profoundly affected dental undergraduate teaching and assessment. The pandemic resulted in cessation of face-to face teaching and assessment in many countries, with an associated move online. Objective structured Clinical Examination (OSCE), an important modality for clinical assessment in dentistry and medicine, is not possible with pandemic restrictions in place. As a result, interest in virtual objective structured clinical examination (VOSCE) has been revived. Student and staff evaluation of any assessment process is important, where the views of all involved are required in establishment of authenticity. This papers aims to explore and describe the views of undergraduate dental students and staff in relation to VOSCE MATERIALS AND METHOD: Qualitative methods utilising online focus groups and video recording were used in this study. Five focus groups, involving 24 participants were undertaken.

RESULTS

Thematic analysis following a deductive semantic approach was carried out resulting in the identification of six themes relating to the VOSCE: VOSCE preconceptions, examination preparation, examination process, fairness, comparison with OSCE and possible improvements. Consideration of these themes, and their interaction, is likely to prove important for optimisation of this assessment modality.

CONCLUSIONS

Overall, both staff and students considered the VOSCE a useful and fair examination and a suitable alternative to OSCE. The potential for a number of improvements in the assessment process was identified.

The influence of candidates' physical attributes on patient ratings in simulated assessments of clinical practice

BACKGROUND

We have previously shown that clinical examiners' scoring is not negatively impacted when a candidate has a tattoo, unnatural hair colour, or a regional accent. We investigated whether these physical attributes in exam candidates impact patient scoring.

METHODS

Simulated/real patients were randomly assigned to watch five videos of simulated candidate performances of a cranial nerve examination: clear fail, borderline, good, 'clear pass' without an attribute, and 'clear pass' with one of the attributes (tattoo, purple hair, accent). Participants scored domains of communication and professionalism. We compared scores for the clear pass candidates with and without attributes.

RESULTS

One hundred and eighty three patients participated. The total scores for the candidates with tattoos and purple hair were higher than the candidate with no physical attribute (p < 0.001). For the candidate with a Liverpool English accent no difference was identified (p = 0.120).

CONCLUSIONS

The presence of certain physical attributes (tattoos or purple hair) was associated with higher scores given by patients to candidates in a simulated physical examination station.

A systematic review of effective quality feedback measurement tools used in clinical skills assessment

Background: Objective Structured Clinical Examination (OSCE) is a valid tool to assess the clinical skills of medical students. Feedback after OSCE is essential for student improvement and safe clinical practice. Many examiners do not provide helpful or insightful feedback in the text space provided after OSCE stations, which may adversely affect learning outcomes. The aim of this systematic review was to identify the best determinants for quality written feedback in the field of medicine.   Methods: PubMed, Medline, Embase, CINHAL, Scopus, and Web of Science were searched for relevant literature up to February 2021. We included studies that described the quality of good/effective feedback in clinical skills assessment in the field of medicine. Four independent reviewers extracted determinants used to assess the quality of written feedback. The percentage agreement and kappa coefficients were calculated for each determinant. The ROBINS-I (Risk Of Bias In Non-randomized Studies of Interventions) tool was used to assess the risk of bias. Results: 14 studies were included in this systematic review. 10 determinants were identified for assessing feedback. The determinants with the highest agreement among reviewers were specific, described gap, balanced, constructive and behavioural; with kappa values of 0.79, 0.45, 0.33, 0.33 and 0.26 respectively. All other determinants had low agreement (kappa values below 0.22) indicating that even though they have been used in the literature, they might not be applicable for good quality feedback. The risk of bias was low or moderate overall. Conclusions: This work suggests that good quality written feedback should be specific, balanced, and constructive in nature, and should describe the gap in student learning as well as observed behavioural actions in the exams.  Integrating these determinants in OSCE assessment will help guide and support educators for providing effective feedback for the learner.

Twelve tips to organise a mock OSCE

The objective structured clinical examination (OSCE) is central to assessing clinical competence in undergraduate and postgraduate exams for medical and allied healthcare professions. A mock OSCE on the other hand is a simulation of the OSCE and a unique learning experience for the examinee. They benefit in a variety of ways; from enhancing their time management skills to receiving feedback that can improve their clinical skills. Unfortunately, opportunities to participate in simulated OSCEs remain limited. Reasons include difficulty in fulfilling organisational requirements and equipment-related costs. Mock OSCEs can be set up by undergraduate students or junior trainees for peers, without senior supervision or direct guidance. This article will discuss 12 tips regarding the arrangement of mock OSCEs to guide organisers, including accessing resources and establishing the content of the exam.

Understanding patient involvement in judging students' communication skills in OSCEs

INTRODUCTION

Communication skills are assessed by medically-enculturated examiners using consensus frameworks which were developed with limited patient involvement. Assessments consequently risk rewarding performance which incompletely serves patients' authentic communication needs. Whilst regulators require patient involvement in assessment, little is known about how this can be achieved. We aimed to explore patients' perceptions of students' communication skills, examiner feedback and potential roles for patients in assessment.

METHODS

Using constructivist grounded theory we performed cognitive stimulated, semi-structured interviews with patients who watched videos of student performances in communication-focused OSCE stations and read corresponding examiner feedback. Data were analysed using grounded theory methods.

RESULTS

A disconnect occurred between participants' and examiners' views of students' communication skills. Whilst patients frequently commented on students' use of medical terminology, examiners omitted to mention this in feedback. Patients' judgements of students' performances varied widely, reflecting different preferences and beliefs. Participants viewed variability as an opportunity for students to learn from diverse lived experiences. Participants perceived a variety of roles to enhance assessment authenticity.

DISCUSSION

Integrating patients into communications skills assessments could help to highlight deficiencies in students' communication which medically-enculturated examiners may miss. Overcoming the challenges inherent to this is likely to enhance graduates' preparedness for practice.

Virtual Standardized Patients for Mental Health Education

PURPOSE OF REVIEW

The training of psychiatrists and other mental health professionals requires education on a range of interpersonal, communication, and psychotherapy techniques. Classroom and workshop training must be augmented by experiential learning with feedback for skill implementation with fidelity. Virtual standardized patients (VSPs) are computerized conversational agents that can support experiential learning through standardized, consequence-free training environments at reduced costs.

RECENT FINDINGS

Research on mental health VSPs is rife with feasibility and acceptability pilot studies across various training populations and settings. Users have generally reported positive reactions to training with VSPs, though frustrations with some VSP speech recognition or VSP response relevance has been reported. Several studies have demonstrated a promising transfer of clinical skills from VSP training to human standardized patients and randomized trials supporting improved skill relative to reading or academic study are encouraging. As technology improves and natural language processing and accurate computer response generation for broad ranging conversational topics emerges, the field would benefit from research on the characteristics of effective VSPs for a range of purposes and trainee populations. Well-designed randomized evaluations of VSPs relative to best practices in education are needed, particularly regarding the impact of VSPs on clinical practice among actual patients.

Delivering Difficult News: Simulation-Enhanced Training Improves Psychiatry Residents' Clinical Communication Skills

Background: Delivering difficult news to individuals diagnosed with mental health disorders and their family members can be challenging. The use of simulated patients (SP) is an effective teaching method to enhance clinical skills, particularly those around communication. We developed, implemented, and evaluated the effectiveness of an SP-based training module to improve psychiatric residents' clinical communication skills in delivering difficult news. Methods: We conducted 5-h workshops consisting of 3 components: (1) a high-fidelity simulation session with a professional actor; (2) a 30-min lecture; and (3) role-playing of 3 short scenarios, during which residents rotated taking on different roles (as psychiatrist, patient, or family member). We observed through a 1-way mirror and videotaped each resident's simulation session and followed it with personalized debriefing. Following the workshop, each resident received the full-length video of their simulated interview, together with a list of questions as a take-home assignment. Two months after the workshop, the residents were invited to a second SP-based session, during which 2 independent evaluators, each a board-certified psychiatrist with expertise in medical simulation, evaluated the participants' communication skills using a previously validated instrument. To avoid observation bias, the 2 evaluators rated the videotapes blind to the timing of the simulation (pre- vs. post-training). Participants completed self-report questionnaires on satisfaction and self-confidence, before, after, and 2 months following the workshop. Findings: Of the 28 psychiatric residents who participated in the training day, 24 (86%) completed the post-workshop evaluation. Mean communication score increased from 24.9 to 27.8 (paired t-test: 5.6, p < 0.001). The mean score for the self-confidence questionnaire, calculated on a 1 to 5 Likert scale, increased from 3.4 to 4.0 after the training day, and remained unchanged (4.2) 2 months later (p < 0.001). Conclusions: An SP-based training module proved useful in improving the objectively measured communication skills of psychiatric residents delivering difficult news. The training further enhanced participants' subjective sense of confidence in those clinical skills.

Characterizing standardized patients and genetic counseling graduate education

Standardized patients (SPs) are laypersons trained to portray patients, family members, and others in a consistent, measurable manner to teach and assess healthcare students, and to provide practice for emotionally and medically challenging cases. SP methodology has been studied with practicing genetic counselors; however, there is minimal empirical evidence characterizing its use in genetic counseling (GC) education. The Accreditation Council for Genetic Counseling (ACGC) Standards of Accreditation for Graduate Programs in Genetic Counseling include SP sessions as one way to achieve up to 20% of the 50 participatory cases required for graduation. The purpose of the current project was to determine the scope, frequency, and timing of SP methodology in ACGC-accredited programs to establish baseline usage, which happened prior to the SARS-CoV-2 pandemic. A 40-item investigator-created survey was developed to document the scope and frequency of SP use among programs. The survey was distributed through the Association of Genetic Counseling Program Directors' (AGCPD) listserv to 43 accredited and 6 programs under development. Surveys were analyzed from 25 accredited programs (response rate = 58%). Seventeen of these programs report inclusion of SP methodology in the curricula (68%), of which 13 report working with an established SP program. SPs are used predominantly for role-plays (70.6%), individualized instruction and remediation (29.4%), and for other reasons such as lecture demonstration, final examinations, practicing skills, and assessing students' goals. Sixteen of the participating programs use SPs to give GC students experience disclosing positive test results. Other details vary among the GC programs including the use of trained SPs, volunteer or paid SPs, actors with and without SP training, or GC students acting as patients. This study demonstrates that GC program SP experiences differ, but are largely viewed as valuable by the programs. Many GC programs report using SP encounters to create multiple opportunities for students to practice and refine clinical skills similar to SPs in medical school.

A framework to support the development of quality simulation-based learning programmes in speech-language pathology

BACKGROUND

Simulation-based learning provides students with a safe learning environment, guaranteed exposure to specific clinical scenarios and patients, time for reflection and repetition of tasks, and an opportunity to receive feedback from multiple sources. Research including studies specific to allied health training programmes have demonstrated that simulation-based learning also helps increase learners' confidence and reduces anxiety related to clinical environments, activities and skills. Such evidence, together with increasing challenges in provision of workplace clinical education, has supported an expansion of integrating simulation-based learning into university curricula.

AIMS

To provide detailed information about the processes and considerations involved in the development of a simulation-based learning programme for speech-language pathology.

METHODS & PROCEDURES

Through reflection on the development process of a 5-day simulation-based learning programme, and in light of existing research in simulation, this paper outlines the important steps and considerations required for the development of a simulation-based learning programme to support student competency development in adult speech pathology range of practice areas.

MAIN CONTRIBUTION

A proposed framework for the development of future simulation-based learning programmes in speech-language pathology.

CONCLUSIONS & IMPLICATIONS

The framework can be applied to simulation-based learning for university programmes and/or workplace training in speech-language pathology and across several other health disciplines.

Using PETTLEP imagery as a simulation technique in nursing: Research and guidelines

One of the most valuable skill sets developed in nurse education is the ability to develop the clinical and practical skills learned. This can take various forms such as university-based practice, simulation and direct experience with patients. To this end imagery, a process where all of the senses are used to create or recreate an experience in the mind, could represent simulated practice of clinical skills. Research on imagery has indicated that the technique, when used to assist in the performance of skill based procedures carried out by nurses can be beneficial. However, guidelines are lacking in this area of simulated practice. In this article, we review current research on the topic of imagery in enhancing skilled performance and outline a model that can assist in conducting interventions. Furthermore, we consider how this could be implemented within a nursing environment to produce beneficial performance effects in both pre-registration and registered nurses.

Use of Simulated Patients in Disaster Medicine Training: A Systematic Review

Simulation is an effective teaching tool in disaster medicine education, and the use of simulated patients (SPs) is a frequently adopted technique. Throughout this article, we critically analyzed the use and the preparation of SPs in the context of simulation in disaster medicine. A systematic review of English, French, and Italian language articles was performed on PubMed and Google Scholar. Studies were included if reporting the use of SPs in disaster medicine training. Exclusion criteria included abstracts, citations, theses, articles not dealing with disaster medicine, and articles not using human actors in simulation. Eighteen papers were examined. All the studies were conducted in Western countries. Case reports represent 50% of references. Only in 44.4% of articles, the beneficiaries of simulations were students, while in most of cases were professionals. In 61.1% of studies SPs were moulaged, and in 72.2%, a method to simulate victim symptoms was adopted. Ten papers included a previous training for SPs and their involvement in the participants' assessment at the end of the simulation. Finally, this systematic review revealed that there is still a lack of uniformity about the use of SPs in the disaster medicine simulations.

Single-Day Simulation-Based Training Improves Communication and Psychiatric Skills of Medical Students

BACKGROUND

Use of standardized (or simulated) patients (SP) is considered an effective teaching method for improving clinical and communication skills. This study assesses the effect of a single-day simulated patients (SP)-based training course on medical students' communication and basic skills in clinical psychiatry during their psychiatry rotation in a university-affiliated tertiary medical center.

METHODS

Forty-two third-year medical students participated. Communication and basic skills in clinical psychiatry were evaluated by a modified Four Habits Coding Scale (4HCS) and the psychiatric interview coding scale before and after SP training. An actual patient interview by the students 1 week after the training was evaluated by an attending psychiatrist blinded to the student's score during the SP-based training. Self-report questionnaires on satisfaction from the training and its impact on their self-confidence were administered at the end of training.

FINDINGS

The mean pre-training 4HCS score of 33.9 increased to 52.3 post-training (p < 0.001). The mean psychiatric interview coding scale score increased from 4.33 to 5.36 (p = 0.002). The self-report questionnaire yielded a mean score of 4.21 on a 1-5 Likert scale, implying high levels of satisfaction and self-confidence.

CONCLUSIONS

A single SP-based training course of medical students sufficed to improve clinical and communication skills in psychiatric settings and enhance their subjective perception of those skills.

Student perceptions of two simulated learning environments in paediatric audiology

Objective: To determine audiology student perceptions of two simulated learning environments (SLE) in paediatric audiology.Design: A one-shot case study design.Study sample: Fifteen audiology students who completed questionnaires after participating in two SLEs, one simulating auditory brainstem response (ABR) assessments of neonates in a hospital ward and one simulating visually reinforced orientation audiometry (VROA) assessments of young children in an audiology clinic.Results: The students responded positively to 11/11 areas of audiometric testing and client interaction in both SLEs, to 7/7 aspects of their interactions with the mannequins in both SLEs, and to 8/8 aspects of their interactions with fellow students playing the role of parent in the ABR SLE and 7/8 of these aspects in the VROA SLE. The students reported low levels of anxiety towards both SLEs but rated the ABR SLE more highly than the VROA SLE in areas of preparedness, effectiveness, realism, pre-SLE training, reinforcement of lecture content, and overall usefulness.Conclusions: The participating students responded positively to almost all aspects of both SLEs. Further research is warranted using research designs capable of determining if these SLEs directly improve student abilities as they transition from academic settings to clinical placements in paediatric audiology.

MCRDR Knowledge-Based 3D Dialogue Simulation in Clinical Training and Assessment

Dialogue-based simulation is a real-world practice technique for medical and clinical education that provides students with an opportunity to train using hands-on experiences without putting actual patients being put at risk. In this paper, a 3D interactive dialogue-based training and assessment system that supports the detailed development of clinical trial competency for medical students in a distributed virtual environment was proposed. For clinical training, MCRDR-based natural language understanding to realize the semantic representation of written dialog from the most relevant inference results was applied, and on the basis of this, a convolutional neural network model was also used to make the generated inference more exact and reliable. For clinical assessment, the dialogue-driven competency method was used to encompass medical knowledge, communication skill as well as professionalism skill based on the collected dialogue information. Finally, the potential of the created system was demonstrated with several clinical cases. The preliminary results indicate that the system demonstrates the potential of providing efficient training and flexible assessment, while saving time, improving practical skills and making students more confident.

It takes two to tango

This article explores ways in which simulated patients (SPs) can help with preparation for the Clinical Skills Assessment (CSA) of the MRCGP exam by sharpening up communication skills, keeping patients safe and making the most of the 10 minutes allotted. However, for this to work, candidates need to take the process seriously and appreciate the care and attention given by SPs to enhance learning and understanding in exam preparation. The article concludes with some useful hints and tips to improve performance in the CSA.

Blurred boundaries: sexuality and power in standardised patients' negotiations of the physical examination

Background

Working with standardised or simulated patients (SPs) is now commonplace in Simulated Learning Environments. Embracing the fact that they are not a homogenous group, some literature suggests expansion of learning with SPs in health professional education by foregrounding their personal experiences. Intimate examination teaching, whether with or without the help of SPs, is protected by a particular degree of ceremony given the degree of potential vulnerability. However, other examinations may be equally intrusive for example the close proximity of an eye examination or a chest examination in a female patient. In this study, we looked at SPs' experiences of boundary crossing in any examinations, sensitised by Foucault's concept of the clinical gaze. We wished to problematise power relations that construct and subject SPs as clinical tools within simulation-based education.

Methods

We collected data from 22 SPs, through five focus groups. Analysis was an iterative process, using thematic analysis. Data collection and reflexive analysis continued iteratively until concepts were fully developed and all theoretical directions explored.

Results

Students and SPs construct simulated teaching consultations by negotiating the unequal distribution of power between them. The SPs themselves discussed how they, perhaps unknowingly, acted in accordance with the discourse of the clinical gaze. However, SPs became disempowered when students deviated from the negotiated terms of consent and they used their agency to resist this. The SPs used strong sexual metaphors to express the subjugation they experienced, as discourses of sexuality and gender played out in the Simulated Learning Environment.

Conclusion

We demonstrate that power dynamics and the clinical gaze can have important consequences within the Simulated Learning Environment. Every physical examination can be potentially 'intimate' and can therefore be underpinned by discourses of sexuality and gendered undertones. In partnership with SPs, simulation-based education should create a teaching space that no longer fosters the discourse of the clinical gaze but facilitates students to learn to reflectively navigate, in the moment, the fine line between touching patients versus touching loved ones, and the blurred boundaries that exist in the gulf between sexual contact and benevolent touch.

Simulation in psychiatric teaching

The use of simulated patients in medicine offers students a standardised learning experience and a reproducible way of exploring attitudes and teaching communication skills. This would seem to be particularly relevant to psychiatry with its focus on attitudes and interpersonal skills, but doubts have been raised about the utility of simulated patients in teaching skills such as empathy and the generalisability of this learning to the real world. This, tempered with cost implications, may have limited the use of simulated patients to assessment through objective structured clinical examinations rather than to teaching and to learning. This article examines the educational advantages and disadvantages of the use of simulated patients in psychiatric teaching and argues that their judicious use complements undergraduate and postgraduate training in psychiatry. The article offers practical tips on writing simulated patient scenarios to deliver specific learning objectives and discusses the potential use of novel simulation techniques in psychiatric education.

Organising a mock OSCE for the MRCPsych Part I examination

Aims and Method

With the changes introduced recently to the Part I clinical examination, trainers will be expected to modify MRCPsych course teaching accordingly. The aim of this paper is to describe the procedure for organising a mock objective structured clinical examination (OSCE) for MRCPsych trainees.

Results

Prior to the introduction of the new OSCE, we organised an authentic mock OSCE for our trainees. We have now run three consecutive mock examinations which have been successfully evaluated.

Clinical Implications

A well-organised mock OSCE requires significant investment in terms of planning, resources and enthusiasm, but can have a potentially beneficial impact on and preparation for the real OSCE and training in general.

The MRCPsych OSCE workshop: a new game to play?

In line with the Royal College of Psychiatrists' commitment to improve its professional examinations based on the best current evidence, Spring 2003 has seen the introduction of the objective structured clinical examination (OSCE). This has replaced the individual patient assessment (IPA) in the MRCPsych Part I clinical examination. An OSCE consists of a series of time-limited clinical tasks that candidates have to perform in a consecutive series of ‘stations' or booths. They have the advantage of being able to test clinical competence using a number of different scenarios via a standardised format (Katona et al, 2000). Their use has become widespread over recent years, particularly in undergraduate psychiatry exams (Brewin & Cantwell, 1997), as they have good reliability and validity (Hodges et al, 1998). This was confirmed by the College's initial pilot OSCE, which had a κ score of around 0.8 for the examination as a whole (Oyebode, 2002).

Standardized Patients' Perspectives on Workplace Satisfaction and Work-Related Relationships: A Multicenter Study

INTRODUCTION

The use of standardized patients (SPs) in health care education has grown in the last 50 years. In addition, the requirements for SPs have increased steadily, and thus, the work of SPs has become more difficult and demanding. It has been claimed that SP programs are highly contextualized, having emerged from local, institutional, professional, and national conditions, but their effects on SPs have not been investigated. We have studied the effects of this job development on SPs and their programs.

METHODS

The study was conducted using a qualitative research design, with semistructured individual in-depth interviews to understand the reactions, values, and perceptions that underlie and influence SP behavior. To cover SP perspectives from more than 1 SP program, a total of 15 SPs from 8 different nursing schools and medical schools in Switzerland were asked to participate.

RESULTS

Standardized patients feel motivated, engaged, and willing to invest effort in their task and do not mind demands increasing as long as the social environment in SP programs is supportive. The role of the SP trainer and the use of feedback are considered very important.

CONCLUSIONS

Standardized patient programs require concepts in which the SP perspective has been integrated to better serve SPs' well-being. Standardized patients are valuable partners in the training of health professionals-we need to take care of them.

Evaluation of the performance of general practitioners in a collaborative care program by employing simulated patients

OBJECTIVE

To compare the performance of the general practitioners (GPs) in a collaborative care (CC) program in Iran with a control group of GPs in the usual care by employing simulated patients.

METHODS

Six trained simulated patients (SPs) made unannounced visits to 26 GP offices participating in the CC program and to 26 age and sex matched controls. The SPs role played five clinical scenarios of mental disorders and filled out checklists to evaluate the GPs' performance regarding interviewing, taking history, establishing rapport, showing empathy, and giving advice to patients. Additionally, the GPs' plan of care and prescriptions were evaluated later by a psychiatrist based on the documents provided by the SPs.

RESULTS

There was a significant difference between collaborative care and control group physicians in their global performance; CC physicians built up better patient-physician relationship. They performed better in evaluating a psychotic patient, although not better in their management. CC physicians were marginally better in approach to patients with generalized anxiety disorder (GAD) and mild major depressive disorder.

CONCLUSION

The overall performance of physicians in CC was better than the GPs in the control group in making an effective patient-physician relationship, and evaluating a psychotic patient. The main weakness of the GPs was in proper treatment of the minor and more common psychiatric disorders and in evaluation of patients with suicidal ideations who were in need for emergent referral. Evaluating performance of the practitioners is feasible employing SPs and the findings can be translated into improvements in the available services.

Examiner and simulated patient ratings of empathy in medical student final year clinical examination: are they useful?

BACKGROUND

Many medical schools state that empathy is important and have curricular learning outcomes covering its teaching. It is thought to be useful in team-working, good bedside manner, patient perspective taking, and improved patient care. Given this, one might expect it to be measured in assessment processes. Despite this, there is relatively little literature exploring how measures of empathy in final clinical examinations in medical school map onto other examination scores. Little is known about simulated patient (actors) rating of empathy in examinations in terms of inter-rater reliability compared with clinical assessors or correlation with overall examination results.

METHODS

Examiners in final year clinical assessments in one UK medical school rated 133 students on five constructs in Objective Structured Long Examination Record (OSLER) with real patients: gathering information, physical examination, problem solving, managing the diagnosis, and relationship with the patient. Scores were based on a standardized well-established penalty point system. In separate Objective Structured Clinical Examination (OSCE) stations, different examiners used the same penalty point system to score performance in both interactional and procedural stations. In the four interaction-based OSCE stations, examiners and simulated patient actors also independently rated empathy of the students.

RESULTS

The OSLER score, based on penalty points, had a correlation of -0.38 with independent ratings of empathy from the interactional OSCE stations. The intra-class correlation (a measure of inter-rater reliability) between the observing clinical tutor and ratings from simulated patients was 0.645 with very similar means. There was a significant difference between the empathy scores of the 94 students passing the first part of the sequential examination, based on combined OSCE and OSLER scores (which did not include the empathy scores), and 39 students with sufficient penalty points to trigger attendance for the second part (Cohen's d = 0.81).

CONCLUSIONS

These findings suggest that empathy ratings are related to clinical performance as measured by independent examiners. Simulated patient actors are able to give clinically meaningful assessment scores. This gives preliminary evidence that such empathy ratings could be useful for formative learning, and bolsters the call for more research to test whether they are robust enough to be used summatively.

Clinical examiners, simulated patients, and student self-assessed empathy in medical students during a psychiatry objective structured clinical examination

OBJECTIVES

This study aims to assess and compare objective and subjective scores of empathy in final-year medical students by using firstly a validated student self-assessment just prior to the psychiatry objective structured clinical examination (OSCE), and then comparing this to clinical examiner's and simulated patient's (SP's) assessments of empathy of students using a Global Rating of Empathy scale (GRE) during a psychiatry OSCE.

METHODS

In 2011, all final-year medical students in the University College Dublin were invited to complete a subjective, self-assessed empathy questionnaire (The Jefferson scale of physician empathy-student version (JSPE-S)). They were also assessed for empathy in four OSCEs by the clinical examiner and the SP acting in that OSCE scenario.

RESULTS

Included in the analysis were 163 of 184 final-year students JSPE-S (88.6%) questionnaires. The female students scores on the JSPE-S were significantly higher than those of their male peers (t=3.34, p=0.001). Concurrent validity was greater between the SPs' assessments of empathy in the OSCE and the JSPE-S score than between the clinical examiners assessments of empathy and the JSPE-S score (r=0.23, p<0.005; r=0.14, p<0.08). Inter-rater reliability of SP's and clinical examiner's using the GRE was found to be high (F=0.868 (df=171, 171), p value<0.001).

CONCLUSIONS

SPs may be valid assessors of empathy in medical students during an OSCE.

Effectiveness of the 'availability, current issues and anticipation' (ACA) training programme for general practice trainees on communication with palliative care patients: a controlled trial

OBJECTIVE

This study aimed to evaluate the effectiveness of a new palliative care 'availability, current issues and anticipation' (ACA) training programme to improve communication skills of general practice trainees (GPTs).

METHODS

In a controlled trial among third-year GPTs, we videotaped one 20-min consultation between each GPT and a simulated palliative care patient at baseline and at six months follow-up. We measured the number of issues discussed and the quality of communication skills and analysed between-group differences using linear mixed models and logistic regression.

RESULTS

Fifty-four GPTs were assigned to the intervention and 64 to the control group. We found no effect of the programme on the number of issues discussed or on the quality of GPT communicative behaviour. GPTs infrequently addressed 'spiritual/existential issues' and 'unfinished business'. In a selection of the consultations, simulated patients brought up more issues than the GPTs did.

CONCLUSION

The ACA training programme was not effective in the way it was carried out and evaluated in this trial.

PRACTICE IMPLICATIONS

The ACA programme should focus on the issues that scored low in this trial. Future research on GPT-patient communication in palliative care should consider using real patients in a series of consultations to evaluate effectiveness.

Influence of standardized patient body habitus on undergraduate student performance in an Objective Structured Clinical Examination

PURPOSE

Previous studies have shown that the standardized patient's (SP) gender may affect student performance in an Objective Structured Clinical Examination (OSCE). The aim of this study is to investigate the influence of the SPs' body habitus on students' performance in an OSCE counseling station.

METHODS

Four equally trained female SPs, with either a normal or an obese BMI participated in an OSCE counseling station for cardiovascular risk factors. Ninety-two, second year medical students were randomly assigned to one of the SPs. Station scores were compared and student behavior and opinion regarding the influence of their SP's body habitus on their performance was assessed.

RESULTS

There was no difference in mean exam scores for students interacting with SPs with a normal BMI versus increased BMI (14.9 ± 2.2 versus 14.01 ± 2.2/20 respectively, p = 0.06). Additionally, almost all students gave advice about healthy diets (93.5% versus 95.7%) with no specificity regarding the BMI of the SP.

CONCLUSIONS

The body habitus of the SP did not significantly affect students' performance in an undergraduate OSCE about cardiovascular risk factors, suggesting that students at that level may primarily focus on gaining points the diagnostic checklist without considering SPs as real patients.

The Psychiatry OSCE: a 20-year retrospective

OBJECTIVE

Twenty years ago researchers at the University of Toronto launched the Psychiatry Skills Assessment Project (PSAP), a research program exploring Objective Structured Clinical Examinations (OSCEs) in psychiatry. Between 1994 and 2005 PSAP produced publications on the feasibility, reliability, validity, ethics, and practical concerns of OSCEs in psychiatry. The current review has two parts: a review of the state of the art of OSCEs in psychiatry 20 years after they were introduced and documentation of the impact of the PSAP research program.

METHODS

A literature search identified all publications on OSCEs and psychiatry. Articles were coded thematically, and locations of agreement and controversies were identified. Bibliometric analysis identified citations of PSAP research papers, which were analyzed thematically.

RESULTS

As of May 2013, there were 250 publications related to OSCEs in psychiatry (not including 10 PSAP papers), published in 29 different countries and ten languages. Prominent topics were the validity and acceptability of OSCEs and SPs, systems issues in adopting OSCEs in psychiatry, and the effects on learning. Eighty-eight percent of all publications cited PSAP work (300 citations). Citations were employed for four purposes: as evidence/justification (54 %); to frame replication research (14 %); to support adaptation of OSCEs in other countries and professions (15 %); and for debate (18 %).

CONCLUSIONS

Over the past 20 years, use of OSCEs has grown steadily in psychiatry, and several national certification organizations have adopted OSCEs. PSAP work, introduced two decades ago, continues to provide a scholarly foundation for psychometric, practical, and ethical issues of interest to this field.

Improving the standardized patient experience

BACKGROUND

As the facilitator of the standardized patient rotation at the Ohio College of Podiatric Medicine (now Kent State University College of Podiatric Medicine [KSUCPM]) for the past 4 years, I have felt that there is underused time in the program. Therefore, I sought the views of podiatric medical students at KSUCPM who have completed the standardized patient rotation to see how they felt their time in the course was used and whether they felt that the course was useful to them in terms of advancing their podiatric medical education.

METHODS

A survey was administered to 105 third-year podiatric medical students. These students had already completed the standardized patient rotation, which at KSUCPM is in the second year.

RESULTS

Seventy-seven students completed the survey. Most of these students felt that there was improperly used time in the course, and many recommended ways of improving the course organization.

CONCLUSIONS

The students answered positively that the standardized patient rotation was important in terms of improving interviewing skills and worthwhile for future professional development. The students agreed that there likely was underused time in the course and even suggested ways in which they would make the course run more efficiently.

The Objective Structured Clinical Examination (OSCE): AMEE Guide No. 81. Part I: an historical and theoretical perspective

The Objective Structured Clinical Examination (OSCE) was first described by Harden in 1975 as an alternative to the existing methods of assessing clinical performance (Harden et al. 1975). The OSCE was designed to improve the validity and reliability of assessment of performance, which was previously assessed using the long case and short case examinations. Since then the use of the OSCE has become widespread within both undergraduate and postgraduate clinical education. We recognise that the introduction of the OSCE into an existing assessment programme is a challenging process requiring a considerable amount of theoretical and practical knowledge. The two parts of this Guide are designed to assist all those who intend implementing the OSCE into their assessment systems. Part I addresses the theoretical aspects of the OSCE, exploring its historical development, its place within the range of assessment tools and its core applications. Part II offers more practical information on the process of implementing an OSCE, including guidance on developing OSCE stations, choosing scoring rubrics, training examiners and standardised patients and managing quality assurance processes. Together we hope these two parts will act as a useful resource both for those choosing to implement the OSCE for the first time and also those wishing to quality assure their existing OSCE programme.

Using Objective Structured Clinical Examination (OSCE) in undergraduate psychiatric nursing education: is it reliable and valid?

While there is widespread use of OSCE in general nursing specialties, psychiatric nursing has been slow to adopt this evaluation method and it has only recently been introduced to psychiatric nursing education.

AIM

The main aim of the present study is to test the first application, validity and reliability of the OSCE in undergraduate psychiatric nursing education.

METHOD

OSCE was developed to assess undergraduate psychiatric nursing students' clinical skills. The students' evaluation of the OSCE process was obtained after the completion of each OSCE circuit.

RESULTS

The psychiatric nursing OSCE proved to be a reliable and valid method in assessing psychiatric nursing clinical competencies. In general, the students perceived OSCE as a positive experience and stressful on the other hand.

CONCLUSION

OSCE is a reliable and valid method of assessing the students' psychiatric nursing competency skills. It has been shown to have many advantages over traditional methods of assessment and has the ability to objectively assess psychiatric nursing skills.

Individualized education and competency development of Croatian community pharmacists using the general level framework

OBJECTIVES

To measure Croatian community pharmacists' progress in competency development using the General Level Framework (GLF) as an educational tool in a longitudinal study.

METHODS

Patient care competencies of 100 community pharmacists were evaluated twice, in 2009 and in 2010 in a prospective cohort study. During this 12-month period, tailored educational programs based on the GLF were organized and conducted, new services and standard operating procedures were implemented, and documentation of contributions to patient care in the pharmacist's portfolio became mandatory.

RESULTS

Pharmacists' development of all GLF patient care competencies was significant with the greatest improvements seen in the following competencies: patient consultation, monitoring drug therapy, medicine information and patient education, and evaluation of outcomes.

CONCLUSIONS

This study, which retested the effectiveness of an evidence-based competency framework, confirmed that GLF is a valid educational tool for pharmacist development.

[Use of Simulated Pacients in Psychiatry]

INTRODUCTION

Scientific advances and the complexity of human knowledge generate a constant need for creating new tools intended to facilitate learning in an agreeable and lasting form. Simulated patients are one of such tools in medical education. Standardized or simulated patients are actors or people vigorously trained to represent a medical history or, if possible, specific physical findings with the purpose of using such representations as an educational and evaluating supplement in clinic practice. The use of simulated patients has been very well received, particularly in the psychiatric field; however, its usefulness in areas such as psychotherapy or evaluation of residents remains questionable.

METHODS

A search was made in PubMed with the MESH words ("Psychiatry/education" and "Patient Simulation"); a search was also made in LILACS and scholar Google using similar words.

RESULTS

Simulated patients are widely used throughout the world in the psychiatry field and their usefulness as an academic tool for pre-graduate students is confirmed in most of the literature reviewed. One of the main benefits of the use of this kind of patients is the acquisition of specific abilities (e.g.: medical history recording); nevertheless, its efficacy in more complex experiences like psychotherapy or certification of psychiatry residents is questioned.

CONCLUSIONS

Notwithstanding the controversy, most of the literature reviewed confirms the benefits and acceptance of this methodology in the formation of students and psychiatrists.

Evaluation of Croatian community pharmacists' patient care competencies using the general level framework

OBJECTIVES

To assess Croatian community pharmacists' patient care competencies using the General Level Framework (GLF).

METHODS

The competencies of 100 community pharmacists working in 38 community pharmacies were evaluated using an adapted version of the GLF.

RESULTS

Pharmacists demonstrated the best performance in the competency areas drug specific issues and provision of drug products; the poorest performance was in the competency areas evaluation of outcomes and monitoring drug therapy. Pharmacists' behavior varied the most in the following areas: ensuring that the prescription is legal, prioritization of medication management problems, and identification of drug-drug interactions.

CONCLUSIONS

Competencies were identified that need to be developed to improve pharmacist interventions in community settings. This study provides the first data on pharmacists' performance in Croatia and serves as a starting point for future studies and actions.

Detection of depression with different interpreting methods among Chinese and Latino primary care patients: a randomized controlled trial

Language barriers may contribute to the under-detection of depression in Latinos and Asians. A total of 782 English, Spanish, and Chinese-speaking primary care patients were enrolled in a randomized controlled trial. Language discordant patients were randomized to Remote Simultaneous Medical Interpreting (RSMI) or usual and customary (U&C) interpreting. The Beck Depression Inventory-Fast Screen (BDI-FS) was administered. Patients were tracked for 1 year. A total of 462 patients completed the BDI-FS. Thirty-three percent had a positive (> or = 4) screen. Twenty-seven percent of BDI-FS positive patients were diagnosed with depression. Among BDI-FS positive patients, Chinese-speakers were less likely to be diagnosed compared with English speakers (31% vs. 10%, P < 0.05). There was a trend towards greater diagnosis with RSMI (27% detection with RSMI vs. 20% U&C, P = 0.41). The diagnosis of depression among BDI-FS positive patients in our population was low, particularly among Chinese-speakers. RSMI could be an important part of a multi-faceted approach to improving the detection of depression.

Postgraduate trainees as simulated patients in psychiatric training: Role players and interviewers perceptions

BACKGROUND

Teaching skills to enhance competence in clinical settings need to have a focus on learning how to do. This paper describes the subjective experiences and feedback of trainees who participated in a teaching technique using postgraduate trainees as simulated patients.

MATERIALS AND METHODS

The Objective Structured Clinical Assessment and Feedback was employed for training using trainees as simulated patients and interviewers. This exercise is performed in front of consultants and peers who subsequently provide feedback about the content and process using a structured format. In order to assess the subjective experience of the interviewer and the role players they were requested to provide structured feedback on several aspects. The trainee role player provided feedback on comfort in playing the role, need for further inputs, satisfaction regarding role play, satisfaction with the interview, and the overall effect of the activity. The trainee interviewer gave feedback on his/her level of comfort performing in front of a peer group, being watched, and evaluated in a group.

RESULTS

The feedback forms from 15 sessions were analyzed. Only two of the role players indicated that they felt very uncomfortable while the rest reported comfort. Twelve of the 15 trainees who simulated patients felt they needed more inputs to improve the clarity of the role play; however they all reported feeling satisfied with the role play or interview. The feedback from the interviewers indicated that most were comfortable in all aspects, i.e. conducting the interview, performing in front of a group, being evaluated, and given feedback in front of a group.

CONCLUSION

The trainees report indicates that those simulating patients need more clarity on their roles and majority had no discomfort performing in front of a group. Interviewers were satisfied and comfortable with all aspects. On the whole, simulated interviews and role plays were found to be an acceptable teaching method by postgraduate psychiatry trainees.

Competency-based training: objective structured clinical exercises (OSCE) in marriage and family therapy

The field of marriage and family therapy (MFT) has recently engaged in the process of defining core competencies for the profession. Many MFT training programs are adapting their curriculum to develop more competency-based training strategies. The Objective Structured Clinical Examination (OSCE) is widely used in the medical profession to assess clinical competence. These examinations involve using simulated clinical situations as a tool in conducting summative evaluations of trainee competence. This article describes an adaptation of the OSCE procedures for competency-based training of MFT students. Instead of using the procedures as a summative examination as is typical in medical education, this article proposes how to use them as formative exercises in the development of student competence. The development of the OSCE is discussed, including "blueprinting," focused competencies, procedures, and feedback protocols. The article concludes with suggestions of how to continue the development of the OSCE for evaluation in MFT education.

A review of standardized patients in clinical education: Implications for speech-language pathology programs

The use of standardized patients has been reported as a viable addition to traditional models of professional practice education in medicine, nursing and allied health programs. Educational programs rely on the inclusion of work-integrated learning components in order to graduate competent practitioners. Allied health programs world-wide have reported increasing difficulty in attaining sufficient traditional placements for students within the workplace. In response to this, allied health professionals are challenged to be innovative and problem-solving in the development and maintenance of clinical education placements and to consider potential alternative learning opportunities for students. Whilst there is a bank of literature describing the use of standardized patients in medicine and nursing, reports of its use in speech-language pathology clinical education are limited. Therefore, this paper aims to (1) provide a review of literature reporting on the use of standardized patients within medical and allied health professions with particular reference to use in speech-language pathology, (2) discuss methodological and practical issues involved in establishing and maintaining a standardized patient program and (3) identify future directions for research and clinical programs using standardized patients to build foundation clinical skills such as communication, interpersonal interaction and interviewing.