Simulated patients and the assessment of medical students' interpersonal skills

Structures, processes and outcomes of objective structured clinical examinations in dental education during the COVID-19 pandemic: A scoping review

INTRODUCTION

Objective structured clinical examinations (OSCEs) are an essential examination tool within undergraduate dental education. Fear of spread of the COVID-19 virus led to dental institutions exploring alternative means of conducting OSCEs. The aim of this scoping review was to investigate what structures, processes and outcomes of dental OSCEs were reported during the COVID-19 pandemic.

MATERIALS AND METHODS

This scoping review was conducted and reported adhering to the Preferred Reporting Items for Systematic Reviews and Meta-analyses extension for scoping review guidelines (PRISMA-ScR). Published literature was identified through a systematic search of PubMed, Embase, Cumulative Index to Nursing and Allied Health Literature (CINAHL), Education Resources Information Center (Eric), ProQuest and Google Scholar. Identified articles were independently reviewed by two authors (KS, AD), followed by synthesis in terms of the reported structures, processes and outcomes. Articles reporting cancellation or rescheduling were also included, extracting data on reasons and any suggestions/recommendations.

RESULTS

The search yielded a total of 290 studies of which 239 sources were excluded after removal of duplicates, leaving 51 studies for title and abstract evaluation. Thirty-four articles were excluded as they did not report on the topic of interest, leaving 17 for full-text evaluation, of which nine were analysed according to the pre-set themes. All dental OSCEs taking place (n = 6) were conducted online whilst the remaining (n = 3) were either cancelled or rescheduled. Data on structures reported specific online videoconferencing software used and provision of staff and student training. Processes on the execution of online OSCEs varied significantly from one study to the other, providing rich data on how dental institutions may carry out such assessments tailored to their need. Information regarding outcomes was sparse, as little attention was paid to the results of the students compared to pre-pandemic, lacking investigation into reliability and validity of online dental OSCEs.

CONCLUSION

Dental OSCEs could be conducted online implementing well-planned structures and processes; however, further evidence is needed to prove its reliability and validity based on outcomes. Dental institutions may need to consider alternative methods to assess practical competencies if online OSCEs are to take place.

Evaluating Communication Training at AVMA COE-Accredited Institutions and the Need to Consider Diversity within Simulated Client Pools

The push for competency-based veterinary medical education by accrediting bodies has led to the inclusion of non-technical skills within curricula. Communication, self-awareness, and cultural humility are considered essential for post-graduate success. To facilitate skills development, veterinary educators have incorporated a variety of modalities including lecture, group discussions, virtual and peer-assisted learning, role play, video review of consultations, and simulated clients (SCs). The overarching goal is developing students into self-reflective practitioners through exposure to clinical scenarios that enhance and embody diversity. Decision making about case management is subject to stereotypes, bias, and assumptions. Racial and ethnic disparities reported in health care can adversely impact patient outcomes. This study was conducted to evaluate communication training and diversity among SC pools within veterinary colleges. A questionnaire was electronically disseminated to assistant/associate deans and/or directors of curriculum/education at 54 American Veterinary Medical Association Council on Education-accredited or provisionally accredited colleges of veterinary medicine. Twenty-one institutions are represented within the data set. Participating institutions summarized their communication curricula: 18 (85.71%) used SCs. Over 55% of these did not track SC demographic data or social identities; among institutions that did track, SCs were primarily monolingual English-speaking (77%), non-disabled (94.2%), white (90.4%), non-Hispanic/Latinx (98.6%) women (57%) over age 56 (64%). Sixteen institutions agreed with the statement "I do not feel that our SC pool is adequately diverse." Respondents shared that lack of time and capacity for recruitment were barriers to diversifying SC pools and proposed strategies to improve outreach.

Training students from rehabilitation professions on communicating with patients with communication disorders

BACKGROUND

FRAME, a mnemonic referring to a program for helping health care providers adapt patient-provider communication when working with patients with communication disorders, improves the knowledge, confidence, and communication skills of medical students for working with this population. However, the impact of the FRAME program for preparing students from the rehabilitation disciplines to work with patients with communication disorders is unknown.

OBJECTIVE

To examine the effects of the FRAME program on the knowledge, confidence, and communication skills of students in physical therapy (PT), occupational therapy (OT), and prosthetics and orthotics (P&O) in terms of how to communicate effectively with patients with communication disorders.

DESIGN

An exploratory, quasi-experimental pretest-posttest design.

SETTING

PT, OT, and P&O clinical education programs at the University of Washington's Department of Rehabilitation Medicine.

PARTICIPANTS

Twenty rehabilitation students (PT = 12; OT = 7; and P&O = 1) participated in the FRAME training.

INTERVENTIONS

The FRAME program, delivered in a single, 2-hour session teaches students communication skills to use with patients with various types of communication disorders.

MAIN OUTCOME MEASURES

A quiz of students' knowledge about communication disorders and a self-rating of confidence for interacting with this patient population were used. Speech-language pathology graduate clinicians rated students' use of communication strategies from each area of the FRAME training during interactions with standardized patients portraying aphasia and dysarthria. Student qualitative feedback were also collected.

RESULTS

Students' knowledge, confidence, and use of communication strategies improved significantly following training. Greatest gains were observed in students' ability to familiarize themselves with how a patient communicates and establish a method of communication before proceeding with the interview. Qualitative feedback aligned with these findings.

CONCLUSIONS

The FRAME program increases the knowledge, confidence, and use of communication strategies in rehabilitation students in order to communicate more effectively with patients with communication disorders in their future careers.

Working experience is not a predictor of good communication: Results from a controlled trial with simulated patients

INTRODUCTION

The importance of good communication in dentistry is proven in terms of both medical satisfaction and patient-related recovery and prevention. The present work deals with the comparison of communicative abilities and the communicative self-assessment of licensed dentists as well as students of dentistry with special emphasis on the influence of the treatment experience.

MATERIALS AND METHODS

A total of 34 dentists (experimental group) with an average work experience of 16 years and 36 students (control group) with an average of 1.4 years of treatment experience were included. In addition to a tutor, four types of simulation patients with standardised trained roles (anxious, critical, dissatisfied and difficult to motivate) were used to create reproducible conversations. The self-assessment and evaluation of the conversation took place by completing questionnaires. Here, an introductory questionnaire was distributed to the participants prior to the conversation and another one after intervention. Whilst the tutors completed their survey during the intervention, the simulation patients answered their questions after the conversation.

RESULTS

The results showed that the dentists rated their own communication skills significantly higher than the students for anxious (P < 0.001) and unmotivated patients (P = 0.026). However, the evaluation of the simulated patients showed that the students achieved higher overall empathy scores (42.03 vs 38.77, P = 0.016).

CONCLUSION

Due to the declining empathy values with increasing treatment experience, communication training is useful for the daily routine of treatment even for experienced dentists.

Simulated patients and objective structured clinical examinations: review of their use in medical education

Simulated or standardised patients have been used in medical education and other medical settings for some 30 years (Box 1). Their use encompasses undergraduate and postgraduate learning, the monitoring of doctors' performance and standardisation of clinical examinations. Simulation has been used for instruction in industry and the military for much longer (Jason et al, 1971) but the first known effective use of simulated patients was by Barrows & Abrahamson (1964), who used them to appraise students' performance in clinical neurology examinations.

Physicians' psychophysiological stress reaction in medical communication of bad news: A critical literature review

INTRODUCTION

Stress is a common phenomenon in medical professions. Breaking bad news (BBN) is reported to be a particularly distressing activity for physicians. Traditionally, the stress experienced by physicians when BBN was assessed exclusively using self-reporting. Only recently, the field of difficult physician-patient communication has used physiological assessments to better understand physicians' stress reactions.

METHOD

This paper's goals are to (a) review current knowledge about the physicians' psychophysiological stress reactions in BBN situations, (b) discuss methodological aspects of these studies and (c) suggest directions for future research.

RESULTS

The seven studies identified all used scenarios with simulated patients but were heterogeneous with regard to other methodological aspects, such as the psychophysiological parameters, time points and durations assessed, comparative settings, and operationalisation of the communication scenarios. Despite this heterogeneity, all the papers reported increases in psychological and/or physiological activation when breaking bad news in comparison to control conditions, such as history taking or breaking good news.

CONCLUSION

Taken together, the studies reviewed support the hypothesis that BBN is a psychophysiologically arousing and stressful task for medical professionals. However, much remains to be done. We suggest several future directions to advance the field. These include (a) expanding and refining the conceptual framework, (b) extending assessments to include more diverse physiological parameters, (c) exploring the modulatory effects of physicians' personal characteristics (e.g. level of experience), (d) comparing simulated and real-life physician-patient encounters and (e) combining physiological assessment with a discourse analysis of physician-patient communication.

Attachment styles and clinical communication performance in trainee doctors

OBJECTIVE

To investigate the relationship between trainee doctors' attachment style and their performance in qualifying clinical and communication skills assessments.

METHODS

Participants were 190 undergraduate medical students whose performance was assessed by examiners across two areas (communication and clinical skills) during their qualifying Objective Structured Clinical Examination (OSCE). Simulated patients also rated communication skills. Participants' attachment style was rated across two dimensions, avoidance and anxiety, using the Relationship Questionnaire (RQ).

RESULTS

Lower levels of attachment avoidance and anxiety significantly predicted higher performance in both communication and clinical skills.

CONCLUSION

Trainee doctors' attachment styles are associated with patient communication and clinical performance. Further research is needed to investigate the impact of attachment on consultations between doctors and patients within clinical settings.

PRACTICE IMPLICATION

Attachment theory can inform our understanding why, for some student doctors, interacting with patients may be particularly challenging and require additional support by medical educators.

Learning Empathy Through Simulation: A Systematic Literature Review

STATEMENT

Simulation is increasingly used as an educational methodology for teaching empathy to preservice health professional students. This systematic review aimed to determine if and how simulation, including games, simulated patients, and role-play, might develop empathy and empathetic behaviors in learners. Eleven databases or clearing houses including MEDLINE, EMBASE, CINAHL, PsychInfo, and ERIC were searched for all articles published from any date until May 2014, using terms relating to (i) preservice health professional students, (ii) simulation, and (iii) empathy. Twenty-seven studies met the inclusion criteria, including 9 randomized controlled trials. A narrative synthesis suggests that simulation may be an appropriate method to teach empathy to preservice health professional students and identifies the value of the learner taking the role of the patient.

Assessing empathy development in medical education: a systematic review

CONTEXT

Empathy in doctor-patient relationships is a familiar topic for medical scholars and a crucial goal for medical educators. Nonetheless, there are persistent disagreements in the research literature concerning how best to evaluate empathy among physicians, and whether empathy declines or increases across medical education. Some researchers have argued that the instruments used to study 'empathy' may not measure anything meaningful to clinical practice or patient satisfaction.

METHODS

We performed a systematic review to learn how empathy is conceptualised in medical education research. We examined how researchers define the central construct of empathy and what they choose to measure, and investigated how well definitions and operationalisations match.

RESULTS

Among the 109 studies that met our search criteria, 20% failed to define the central construct of empathy at all and only 13% used an operationalisation that was well matched to the definition provided. The majority of studies were characterised by internal inconsistencies and vagueness in both the conceptualisation and operationalisation of empathy, constraining the validity and usefulness of the research. The methods most commonly used to measure empathy relied heavily on self-report and cognition divorced from action, and may therefore have limited power to predict the presence or absence of empathy in clinical settings. Finally, the large majority of studies treated empathy itself as a 'black box', using global construct measurements that are unable to shed light on the underlying processes that produce an empathic response.

CONCLUSIONS

We suggest that future research should follow the lead of basic scientific research that conceptualises empathy as relational - an engagement between a subject and an object - rather than as a personal quality that may be modified wholesale through appropriate training.

Interventions to cultivate physician empathy: a systematic review

BACKGROUND

Physician empathy is both theoretically and empirically critical to patient health, but research indicates that empathy declines throughout medical school and is lower than ideal among physicians. In this paper, we synthesize the published literature regarding interventions that were quantitatively evaluated to detect changes in empathy among medical students, residents, fellows and physicians.

METHODS

We systematically searched PubMed, EMBASE, Web of Science and PsychINFO in June of 2014 to identify articles that quantitatively assessed changes in empathy due to interventions among medical students, residents, fellows and physicians.

RESULTS

Of the 1,415 articles identified, 64 met inclusion criteria. We qualitatively synthesized the findings of qualified studies by extracting data for ten study metrics: 1) source population, 2) sample size, 3) control group, 4) random assignment, 5) intervention type, 6) intervention duration, 7) assessment strategy, 8) type of outcome measure, 9) outcome assessment time frame, and 10) whether a statistically significant increase in empathy was reported. Overall, the 64 included studies were characterized by relatively poor research designs, insufficient reporting of intervention procedures, low incidence of patient-report empathy assessment measures, and inadequate evaluations of long-term efficacy. 8 of 10 studies with highly rigorous designs, however, found that targeted interventions did increase empathy.

CONCLUSIONS

Physician empathy appears to be an important aspect of patient and physician well-being. Although the current empathy intervention literature is limited by a variety of methodological weaknesses, a sample of high-quality study designs provides initial support for the notion that physician empathy can be enhanced through interventions. Future research should strive to increase the sample of high-quality designs through more randomized, controlled studies with valid measures, explicit reporting of intervention strategies and procedures, and long-term efficacy assessments.

Teaching communication skills in clinical settings: comparing two applications of a comprehensive program with standardized and real patients

BACKGROUND

Communication is important for the quality of clinical practice, and programs have been implemented to improve healthcare providers' communication skills. However, the consistency of programs teaching communication skills has received little attention, and debate exists about the application of acquired skills to real patients. This study inspects whether (1) results from a communication program are replicated with different samples, and (2) results with standardized patients apply to interviews with real patients.

METHODS

A structured, nine-month communication program was applied in two consecutive years to two different samples of healthcare professionals (25 in the first year, 20 in the second year). Results were assessed at four different points in time, each year, regarding participants' confidence levels (self-rated), basic communication skills in interviews with standardized patients, and basic communication skills in interviews with real patients. Data were analyzed using GLM Repeated-Measures procedures.

RESULTS

Improvements were statistically significant in both years in all measures except in simulated patients' assessment of the 2008 group. Differences between the two samples were non-significant. Differences between interviews with standardized and with real patients were also non-significant.

CONCLUSIONS

The program's positive outcomes were replicated in different samples, and acquired skills were successfully applied to real-patient interviews. This reinforces this type of program structure as a valuable training tool, with results translating into real situations. It also adds to the reliability of the assessment instruments employed, though these may need adaptation in the case of real patients.

Frequency of high-quality communication behaviors used by primary care providers of heterozygous infants after newborn screening

OBJECTIVE

To examine the quality of communication likely to be experienced by parents when being first informed about how newborn screening identified heterozygous "carrier" status for cystic fibrosis or sickle cell disease.

METHODS

Primary care providers (PCPs) of infants found to have carrier status were telephoned over a 48-month period, and asked to rehearse with a standardized patient how they would inform the infants' parent(s). 214 rehearsal transcripts were abstracted using explicit criteria methods to measure the frequency of five categories of high-quality communication behaviors.

RESULTS

Overall, PCPs used large amounts of jargon and failed to use high quality communication behaviors. On average, PCPs used 18.6 total jargon words (8.7 unique words), but explained 2.4 jargon words. The most frequent assessment of understanding was the close-ended version, although it was only seen in 129 of 214 transcripts. The most common organizing behavior was importance emphasis (121/214). Precautionary empathy was rare; the most frequent behavior was "instruction about emotion" (33/214).

CONCLUSION

The limited use of high-quality communication behaviors in rehearsals raises concern about parental understanding, decision-making, and psychosocial outcomes after newborn screening.

PRACTICE IMPLICATIONS

Measurement of specific behaviors may help PCPs to improve communication, and thereby improve the patient experience.

Objective structured clinical examination: the assessment of choice

The Objective Structured Clinical Examination is a versatile multipurpose evaluative tool that can be utilized to assess health care professionals in a clinical setting. It assesses competency, based on objective testing through direct observation. It is precise, objective, and reproducible allowing uniform testing of students for a wide range of clinical skills. Unlike the traditional clinical exam, the OSCE could evaluate areas most critical to performance of health care professionals such as communication skills and ability to handle unpredictable patient behavior.

The impact of trained patient educators on musculoskeletal clinical skills attainment in pre-clerkship medical students

BACKGROUND

Despite the high burden of musculoskeletal (MSK) diseases, few generalists are comfortable teaching MSK physical examination (PE) skills. Patient Partners® in Arthritis (PP®IA) is a standardized patient educator program that could potentially supplement current MSK PE teaching. This study aims to determine if differences exist in MSK PE skills between non-MSK specialist physician and PP®IA taught students.

METHODS

Pre-clerkship medical students attended 2-hour small group MSK PE teaching by either non-MSK specialist physician tutors or by PP®IA. All students underwent an MSK OSCE and completed retrospective pre-post questionnaires regarding comfort with MSK PE and interest in MSK.

RESULTS

83 students completed the OSCE (42 PP®IA, 41 physician taught) and 82 completed the questionnaire (42 PP®IA, 40 physician taught). There were no significant differences between groups in OSCE scores. For all questionnaire items, post-session ratings were significantly higher than pre-session ratings for both groups. In exploratory analysis PP®IA students showed significantly greater improvement in 12 of 22 questions including three of five patient-centred learning questions.

CONCLUSIONS

PP®IA MSK PE teaching is as good as non-MSK specialist physician tutor teaching when measured by a five station OSCE and provide an excellent complementary resource to address current deficits in MSK PE teaching.

Standardisation of role players for the Clinical Skills Assessment of the MRCGP

This paper describes the processes used to prepare the role players who simulate the 'patients' in the MRCGP Clinical Skills Assessment (CSA) examination, one of the licensing qualifications for GPs completing their training. Because it is such a high-stakes exam, the CSA must be seen to be fair and trustworthy, and such attributes could be compromised by inadequate role player performance. On a CSA examination day, three role players simulate the same 'patient' simultaneously on three different exam floors, each playing the same case up to 26 times on the day, and these 'patients' must present in a consistent and reliable manner to ensure that all candidates face the same test situation. The paper describes the initial selection and training of the actors, how they are prepared on the day of the exam itself, and the quality assurance processes designed to ensure that the exam has excellent role players performing as the simulated 'patients'.

Postgraduate trainees as simulated patients in psychiatric training: Role players and interviewers perceptions

BACKGROUND

Teaching skills to enhance competence in clinical settings need to have a focus on learning how to do. This paper describes the subjective experiences and feedback of trainees who participated in a teaching technique using postgraduate trainees as simulated patients.

MATERIALS AND METHODS

The Objective Structured Clinical Assessment and Feedback was employed for training using trainees as simulated patients and interviewers. This exercise is performed in front of consultants and peers who subsequently provide feedback about the content and process using a structured format. In order to assess the subjective experience of the interviewer and the role players they were requested to provide structured feedback on several aspects. The trainee role player provided feedback on comfort in playing the role, need for further inputs, satisfaction regarding role play, satisfaction with the interview, and the overall effect of the activity. The trainee interviewer gave feedback on his/her level of comfort performing in front of a peer group, being watched, and evaluated in a group.

RESULTS

The feedback forms from 15 sessions were analyzed. Only two of the role players indicated that they felt very uncomfortable while the rest reported comfort. Twelve of the 15 trainees who simulated patients felt they needed more inputs to improve the clarity of the role play; however they all reported feeling satisfied with the role play or interview. The feedback from the interviewers indicated that most were comfortable in all aspects, i.e. conducting the interview, performing in front of a group, being evaluated, and given feedback in front of a group.

CONCLUSION

The trainees report indicates that those simulating patients need more clarity on their roles and majority had no discomfort performing in front of a group. Interviewers were satisfied and comfortable with all aspects. On the whole, simulated interviews and role plays were found to be an acceptable teaching method by postgraduate psychiatry trainees.

A review of standardized patients in clinical education: Implications for speech-language pathology programs

The use of standardized patients has been reported as a viable addition to traditional models of professional practice education in medicine, nursing and allied health programs. Educational programs rely on the inclusion of work-integrated learning components in order to graduate competent practitioners. Allied health programs world-wide have reported increasing difficulty in attaining sufficient traditional placements for students within the workplace. In response to this, allied health professionals are challenged to be innovative and problem-solving in the development and maintenance of clinical education placements and to consider potential alternative learning opportunities for students. Whilst there is a bank of literature describing the use of standardized patients in medicine and nursing, reports of its use in speech-language pathology clinical education are limited. Therefore, this paper aims to (1) provide a review of literature reporting on the use of standardized patients within medical and allied health professions with particular reference to use in speech-language pathology, (2) discuss methodological and practical issues involved in establishing and maintaining a standardized patient program and (3) identify future directions for research and clinical programs using standardized patients to build foundation clinical skills such as communication, interpersonal interaction and interviewing.

Instructiveness of real patients and simulated patients in undergraduate medical education: a randomized experiment

PURPOSE

Few studies have compared the instructiveness of real patient contacts with simulated patient (SP) contacts. Although most of these studies found no difference, students often comment that the instructiveness of both encounters is dissimilar. The aims of this study were to evaluate which contact (real patient or SP) is perceived as most instructive by students and which variables contribute to this.

METHOD

The authors performed an experiment involving 163 first-year medical students, randomized to having a real patient contact (n = 61) or SP contact (n = 102). Quantitative (questionnaires) and qualitative (focus groups) methods were used to evaluate the perceived instructiveness of the contact.

RESULTS

The general instructiveness of both real patient contacts and SP contacts was marked high. Several differences between the evaluations of real patient contacts and SP contacts were found. For example, students considered real patient contacts less helpful in practicing communication skills and considered the real patients' feedback less relevant. The focus group interviews yielded explanations for many of the differences found. Students regarded real patients as more authentic. However, SPs were better informed about the purpose of the consultation and provided the student with more specific feedback.

CONCLUSIONS

Students consider authenticity an important advantage of real patients. Their difficult recruitment is an important disadvantage, however, SPs have important advantages compared with real patients--for example, their feedback. The choice of real patient contacts or SP contacts for medical education depends on factors like the phase of the curriculum and the aim of the encounter.

Assessing competency in Evidence Based Practice: strengths and limitations of current tools in practice

BACKGROUND

Evidence Based Practice (EBP) involves making clinical decisions informed by the most relevant and valid evidence available. Competence can broadly be defined as a concept that incorporates a variety of domains including knowledge, skills and attitudes. Adopting an evidence-based approach to practice requires differing competencies across various domains including literature searching, critical appraisal and communication. This paper examines the current tools available to assess EBP competence and compares their applicability to existing assessment techniques used in medicine, nursing and health sciences.

DISCUSSION

Only two validated assessment tools have been developed to specifically assess all aspects of EBP competence. Of the two tools (Berlin and Fresno tools), only the Fresno tool comprehensively assesses EBP competency across all relevant domains. However, both tools focus on assessing EBP competency in medical students; therefore neither can be used for assessing EBP competency across different health disciplines. The Objective Structured Clinical Exam (OSCE) has been demonstrated as a reliable and versatile tool to assess clinical competencies, practical and communication skills. The OSCE has scope as an alternate method for assessing EBP competency, since it combines assessment of cognitive skills including knowledge, reasoning and communication. However, further research is needed to develop the OSCE as a viable method for assessing EBP competency.

SUMMARY

Demonstrating EBP competence is a complex task - therefore no single assessment method can adequately provide all of the necessary data to assess complete EBP competence. There is a need for further research to explore how EBP competence is best assessed; be it in written formats, such as the Fresno tool, or another format, such as the OSCE. Future tools must also incorporate measures of assessing how EBP competence affects clinician behaviour and attitudes as well as clinical outcomes in real-time situations. This research should also be conducted across a variety of health disciplines to best inform practice.

Strengths and weaknesses of simulated and real patients in the teaching of skills to medical students: a review

The aim of this review was to identify the strengths and weaknesses of the roles of real and simulated patients in undergraduate medical education. The literature was reviewed in relation to four patient roles: real patients as educational "resource" (passive role), real patients as teachers (active role), and simulated patients as educational resource and teachers. Each of the four patient roles was found to have specific advantages and disadvantages from the perspectives of teachers, students, and patients. For example, advantages of real patients as educational resource were patient-centered learning and high patient satisfaction. Disadvantages were their limited availability and the variability in learning experiences among students. Despite the considerable amount of literature we found, many gaps in knowledge about patient roles in medical education remain and should be addressed by future studies.

The use of a virtual patient case in an OSCE-based exam--a pilot study

BACKGROUND

This study focuses on a skills test based clinical assessment where 118 fourth-year medical students at the four teaching hospitals of Karolinska Institutet participated in the same 12-module OSCE. The goal of one of the twelve examination modules was to assess the students' skills and ability to solve a virtual patient (VP) case (the ISP system), which included medical history taking, lab tests, physical examinations and suggestion of a preliminary diagnosis.

AIMS

The primary aim of this study was to evaluate the potential of a VP as a possible tool for assessment of clinical reasoning and problem solving ability among medical students. The feeling of realism of the VP and its possible affective impact on the student's confidence were also investigated.

METHOD

We observed and analysed students' reactions, engagement and performance (activity log files) during their interactive sessions with the simulation. An individual human assistant was provided along with the computer simulation and the videotaped interaction student/assistant was then analysed in detail and related to the students' outcomes.

RESULTS

The results indicate possible advantages of using ISP-like systems for assessment. The VP was for instance able to reliably differentiate between students' performances but some weaknesses were also identified, like a confounding influence on students' outcomes by the assistants used. Significant differences, affecting the results, were found between the students in their degree of affective response towards the system as well as the perceived usefulness of assistance.

CONCLUSION

Students need to be trained beforehand in mastering the assessment tool. Rating compliance needs to be targeted before VP-based systems like ISP can be used in exams and if such systems would be used in high-stake exams, the use of human assistants should be limited and scoring rubrics validated (and preferably automated).

Viewpoint: power and communication: why simulation training ought to be complemented by experiential and humanist learning

The authors present an analysis of communication training for medical students using simulation patients, and its possible influence on later doctor-patient relationships. Many empirical studies have shown the various benefits of using simulation patients to teach communication skills, but theoretical sociology and humanistic reflection shed light on some fundamental differences between the student-doctor/actor-patient interactions practiced in simulation encounters and real doctor-patient relationships. In contrast to the usual power dynamics of a doctor-patient relation, those of simulation encounters are inverted and overwritten by an entirely different set of power relations, namely, those of the evaluator-student relationship. Since the power dynamics of real doctor-patient relations are generally overlooked, the altered dynamics of the simulation encounter are not readily perceived, and simulation encounters are thus often mistaken as accurate representations of clinical reality. Exclusive reliance on this pedagogic approach of simulation training may be encouraging students to become "simulation doctors" who act out a good relationship to their patients but have no authentic connection with them. The authors propose that liberal-arts learning and encounters with real patients should be used to cultivate students' abilities to create good doctor-patient relationships, as a compliment to the pedagogic benefits of simulation encounters.

The Objective Structured Clinical Examination: three decades of development

The Objective Structured Clinical Examination (OSCE) has become a standard for performance-based assessment in many health professions. Originally developed for assessment in medical schools, the OSCE has been widely adopted for teaching, assessment, and certification purposes in most health professions. This article outlines the reasons for the rapid uptake of OSCEs and explores some of the key features of OSCE development that have implications for use in veterinary medicine.

Open-Ended Questions: Are They Really Beneficial for Gathering Medical Information from Patients?

Open-ended questions, which allow patients to discuss their concerns freely, are widely considered an efficient method gathering medical information from patients during a medical interview. However, few studies have examined the relationship between the use of open-ended questions and the amount of information obtained from patients during the medical interview. This study examines this relationship using a relatively large sample size under more standardized conditions than in previous studies. The Japanese Group for Research on the Medical Interview undertook this research in 2002-2003. A total of 1,527 medical students conducted medical interviews with standardized patients, and 1,220 met the inclusion criteria for this study. The interview was limited to five minutes. Evaluators (medical school faculty physicians) evaluated the use of open-ended questions during the medical interview. The reliability of the evaluation sheet was also examined. The amount of information obtained was measured through the medical interview evaluation sheet. The use of open-ended questions was positively related to the amount of information elicited from the patients (F = 41.0, p < 0.0001). This study provides data to support the hypothesis regarding the favorable relationship between the use of the open-ended questions and the amount of information from the patients.

The effectiveness of unannounced standardised patients in the clinical setting as a teaching intervention

PURPOSE

Teaching medical students to spontaneously identify biopsychosocial issues (e.g. family violence) remains a challenge. We examined the extent to which using unannounced standardised patients (SPs) presenting in a clerk's clinical setting could assist with this teaching challenge.

METHODS

All clerks attended a family violence seminar in their family medicine rotation. Intervention students additionally saw an unannounced SP portraying 1 of 2 scenarios in their preceptor's office during the rotation, and received immediate feedback about their performance. An end of rotation objective structured clinical examination (OSCE) included an SP presentation similar to that seen by the intervention students.

RESULTS

Clerks who received the intervention demonstrated increased questioning about family violence, from 0% (0 of 29 students) to 19% (5 of 26 students) in 1 OSCE scenario (P = 0.019), and from 40% (12 of 30 students) to 76% (19 of 25 students) in the other (P = 0.007).

CONCLUSIONS

Seeing unannounced SPs had a dramatic effect on later student performance. This potentially powerful intervention could be applied to a range of clinical issues.

Physiological and psychological effects of delivering medical news using a simulated physician-patient scenario

We examined the acute stress response associated with having to deliver either bad or good medical news using a simulated physician-patient scenario. Twenty-five healthy medical students were randomly assigned to a bad medical news (BN), a good medical news (GN), or a control group that read magazines during the session. Self-report measures were obtained before and after the task. Blood pressure and heart rate were measured throughout the task period. Four blood samples were obtained across the task period. The BN and GN tasks produced significant increases in self-reported distress and cardiovascular responses compared with the control group. There was also a significant increase in natural killer cell function 10 min into the task in the BN group compared with the control group. The BN task was also somewhat more stressful than the GN task, as shown by the self-report and cardiovascular data. These findings suggest that a simulated physician-patient scenario produces an acute stress response in the "physician," with the delivery of bad medical news more stressful than the delivery of good medical news.

Hitting the mark: negotiated marking and performance factors in the communication skills element of the VOICE examination

INTRODUCTION

Communication skills assessment is complex. Standardised patient use is widespread, but anxiety exists around the use of role players as assessors of competence in high stakes examinations. This study measures the level of agreement between scoring examiners and role players, and considers their influence on each other. Examiner status and question choices are analysed as variables.

METHOD

The valid oral interactive contextualised examination (VOICE) is a general practice examination styled as an objective structured clinical examination (OSCE) of six 15-minute stations, which include two role-played consultations with professional role players. The examination candidates are final year medical students. Clinical components are examined by a general practitioner (GP). Communication skills are assessed by these examiners in conjunction with the role players, through a process of negotiation. Descriptive professionalism/attitude bandings are used as percentage-scoring guidelines. Checklists are not used. For this study, the initial (independently) perceived marks of the two scoring groups and their agreed final (awarded) marks were recorded, along with other variables including gender, performance factors, demographics and the nature of the question. Data represents 512 students undertaking 1024 simulated consultations, examined by 28 role players and 46 examiners. Analysis was carried out using SPSS Version 10.

RESULTS

Results show that the examination and negotiation process is consistent. Role players have a direct influence on scoring. The examiner's background is a significant variable [F9,1014 = 4.207, P < 0.001]. Students perform less well on questions involving higher degrees of clinical information giving. Question choice is not significant [F30,3039 = 1.397, P=0.074].

DISCUSSION

The variables in the examination do not indicate any discrepancy substantial enough to bias a student's grade. Negotiated marking in this context is considered safe and reliable.

Refuting patients' obligations to clinical training: a critical analysis of the arguments for an obligation of patients to participate in the clinical education of medical students

CONTEXT

The clinical teaching of medical students is essential to the continuation of medicine, but it has a major impact on the patient's health care and autonomy. Some people believe that there is a moral obligation for patients to participate in this training. Such an obligation, real or perceived, may endanger patients' autonomy.

OBJECTIVES

The author makes a critical analysis of the main arguments he encounters supporting such an obligation. These arguments are: (1) the furthering of medical education; (2) compensation when uninsured or unable to pay; (3) an equitable return for the care received in a teaching hospital, and (4) fulfilment of a student's need for (and some say right to) clinical training.

METHODS

Related literature is reviewed in search of evidence and/or support for such arguments.

CONCLUSIONS

The review reveals that these arguments either cannot be verified or do not necessarily place any obligations on the patient. It is argued that, while a medical student may have a right to clinical education, the obligation to fulfil this right rests with the medical university and not on the patients of its teaching hospitals.

SOLUTIONS

Several proposals are made about how to satisfy this need without infringing on the patient's right to refuse participation, explaining the patient's rights and role in clinical teaching, and the use of standardized patients where necessary.

Assessing the acquisition of core clinical skills through the use of serial standardized patient assessments

PURPOSE

Students in many medical schools now undergo multiple standardized-patient-based assessments. In this study, the authors examine the ability of such serial assessments to detect interval learning.

METHOD

Twenty-one students from the University of California, Irvine, College of Medicine, class of 1999, underwent a clinical skills appraisal after three months of their third-year instruction. After nine months, all 89 members of that class completed an OSCE. Subsequently, all 87 students in the class of 2000 also completed clinical skills assessments after their third and ninth months of third-year instruction. All of these exercises included identical or similar stations measuring history, physical examination, and communication skills. Communication skills were measured somewhat differently during some of the exercises, using checklists that were either "content-" or "process-"oriented. The authors compared the performances for all groups.

RESULTS

Both classes demonstrated significant improvement in physical examination performance, while their history performances remained unchanged. According to the assessments, their communication skills deteriorated over the course of their third-year instruction. Repeated exposures to similar or identical cases on the serial assessments did not impact the students' performances. Both content- and process-oriented measures of communication skills yielded highly similar results.

CONCLUSIONS

Serial assessments using standardized patients can detect interval changes in performance that are independent of repeated exposures to similar or identical cases. Changes detected using this approach may have important curricular implications.

Health care perceptions of the standardized patient

As the use of standardized patients (SPs) for education and assessment continues to grow, there becomes an ever-increasing cohort of patients in our clinical practices who have participated as SPs. The present study is part of a five-year longitudinal study to examine the impact of participation as a standardized patient on the perceptions of the standardized patient's own health care. SPs participating in the 1993, 1994 and 1995 Objective Structured Clinical Examinations (OSCE) for medical students at the end of their third year were requested to respond to mailed questionnaires before, immediately after and one year after their participation in the OSCE(s). Results indicated that, while overall the SP's perceptions of their interactions with their doctors were positive both before and after participation in the OSCE, as a group, their perceptions of their own health care was significantly worse at one year post-OSCE. Additionally, when divided according to SP experience, that is novice versus experienced SP, most of the items on which there were changes were mutually exclusive between the groups. If these significant negative changes are due to the SPs becoming more educated consumers of medical care, this can be seen as a positive outcome. However, if the changes are due to variables particular to the third-year medical student OSCEs themselves, debriefing of the SPs following their participation in the OSCE may be warranted.

Standardized patients in the assessment of general practice consulting skills (694)

This paper describes the use of standardized patient interviews as a means of assessing the consulting skills of fifth year medical students studying general practice. Interviews are restricted to a duration of 9 minutes and focus on either diagnostic or management tasks. Volunteers are trained to play standardized roles depicting common general practice presentations. A detailed marksheet has been developed to increase inter-examiner reliability, discourage global marking and incorporate a patient assessment of the student. Issues of reliability, validity and security in this form of assessment are discussed.

Interviewing skills: self-evaluation by medical students

In an independent learning project, 52 third-year medical students carried out a structured self-assessment of two videotaped psycho-social interviews they had conducted with volunteer clients 1 year earlier, as part of a previous course. The interviews had been conducted in small tutorials with feedback from their clients, fellow students and tutors, facilitated by videotape playback. During the sequence of 16 tutorials each student had carried out an early and a late interview and had observed and participated in the discussion of the interviews of 14 peers. Students were asked to tally the frequencies of various interview behaviours, to evaluate the quality of their behaviours, and to establish priorities for future learning. The videotapes were also reliably rated by an independent observer. Students' overall self-assessments correlated 0.46 with those of the independent observer. This correlation was higher than is typically reported in studies of the validity of self-assessment. In absolute terms, the students' mean rating of interviewing performance was 3.2 (adequate plus) which was significantly lower than the observer's mean of 3.6 (adequate to good). Results are discussed in terms of Gordon's (1992) two recommendations for improving the validity of self-assessments and two further suggestions, for paired comparisons and low-threat learning environments, are added.

Videotaped interviewing of non-English speakers: training for medical students with volunteer clients

In a multicultural society such as Australia, with over 20% of its population born overseas, interpreters are often required to facilitate medical interviews. However, where a patient has some proficiency in English, medical interviews are sometimes conducted across the boundaries of culture and language. This is a report of an educational innovation to teach interviewing skills to pre-clinical medical students with the assistance of volunteers of non-English-speaking backgrounds. Pre-clinical students interviewed community volunteers on topics of general life history in a sequence of 16 tutorials. Each student conducted two interviews. Teaching methods included feedback from the volunteers, tutorial discussion facilitated by playback of videotapes, and modelling of skills by the teachers. Evaluations by volunteers and students indicated high satisfaction with the teaching methods and outcomes. Students gained confidence in interviewing people from different cultures. Evaluation of students' pairs of videotapes by an independent rater achieved satisfactory reliabilities and indicated significant gains in inquiry skills and the communication of positive attitudes. Skills in communicating empathy and in using simple language did not improve measurably.

Evaluating communication skills in the OSCE format: reliability and generalizability

In most objective structured clinical examinations (OSCEs), communication skills are assessed as an 'add-on' to history-taking stations, rather than in stations designed to assess communication skills in the broadest sense. This study investigated the feasibility of developing such stations. In part one, 60 clinical clerks and 36 residents were rated in four 10-min emotionally charged situations portrayed by standardized patients. Inter-rater reliability was demonstrated (r = 0.59-0.63) and a highly significant effect of educational level was found. Generalizability between communication stations was low (0.17-0.20). Several explanations for poor generalizability, including poor discrimination as a result of low score variance and the confounding effect of content knowledge, were addressed in part 2. Ninety-five final-year medical students participated in an OSCE in which six 10-min encounters examined the students' ability to manage difficult emotional situations such as fear, anxiety, mania, sadness, confusion and anger. Half the students encountered a patient with moderate emotional symptoms and half an extreme emotional state. For difficult stations, students' scores were lower and standard deviation higher, suggesting that manipulating difficulty increases score variance and potentially discrimination. However, a strong interaction was found between difficulty and station content, and communication scores were highly correlated with content. Scenarios which created major communication difficulties (such as mania) resulted in much larger differences in scores between the easy and difficult versions. Communication OSCE stations can be created with acceptable reliability including difficult cases which address communication skills beyond simple history taking. Nevertheless, a generalizable set of communication skills remains elusive.

Preparing patients for invasive medical and surgical procedures. 1: Adding behavioral and cognitive interventions

The authors of three related articles look at various aspects of preparing adult and child patients psychologically for invasive surgical procedures. The first article is a review of the literature in the field, primarily from the last 30 years. Researchers have examined anxiety and coping mechanisms, patient-practitioner relationships, medical phobias, and the effectiveness of different types of psychological intervention. In the second article, the authors offer practical suggestions for implementing preparatory psychological interventions, describing effective communication techniques such as active listening, role plays, imaging, modeling, and progressive relaxation. In the final article in the series, the author considers policy, practice, and educational implications of the use of behavioral and cognitive interventions for patients, medical practitioners, and healthcare planners.

Use of standardized patients in a freshman emergency medicine course

The curriculum of our freshman emergency medicine course now includes group interviews with standardized patients to introduce communication skills more effectively to students. Our goals for the standardized patient encounters are 1) to start the interview learning process in a nonthreatening environment, 2) to begin to use rudimentary techniques to obtain a history of present illness, 3) to gain insight into a patient's perception of a medical interview, and 4) to learn to project empathy and compassion when talking with patients. The standardized patients technique is one method emergency medicine educators can use to maximize effectiveness in undergraduate medical education.

The teaching of communication skills in United Kingdom medical schools

A survey was carried out of the teaching of communication skills in medical schools in the United Kingdom during the academic year 1989/90. Comparison with previous surveys shows a considerable development over the last 10 years. Departments of psychiatry and general practice continue to play a major part in such teaching. There was wide variation in educational objectives and in the curricular time available. Concern is expressed about the methods of assessment and the degree of integration between departments. Future plans and the perceived barriers are reported and the implications discussed.

Evaluating interns' performance using simulated patients in a casualty department

An observational study examined the care that was provided by 61 interns for three simulated (standardized) patients in a casualty department within a large teaching hospital. The consultations were recorded on videotape and were scored by reference to explicit criteria that were set by an expert panel. The criteria described standards of clinical competence, communication skills and preventive care for each of the three cases. An additional list of the general opportunities for preventive advice that were suggested by the patients' case histories also was compared with the interns' actual behaviour. Clinical competence was not demonstrated uniformly across the three cases. The problem of urinary-tract infection was managed best; 19% of the interns complied with all criteria, and 93% of the interns complied with 75% of the criteria. For tension headache, only 3% of the interns complied with all the criteria but 67% of interns complied with 75% of the criteria. In the case of bronchitis, only 3% of interns complied with all the criteria but 58% of interns met 75% of the criteria. The quality of preventive care also varied from case to case, being best for the patient with bronchitis and worst for the patient with tension headache. Over all, only three of the 13 criteria were met by more than half the interns. The communication-skills criteria identified three behaviours which the interns were most likely to omit: the interns summarized the patients' problems in only 73 of the 173 consultations; they explained the aetiology of the problems in only 127 of the 173 consultations; and they ensured that the patients understood their plan of management in only 21 of the 173 consultations.

Interviewing skills in relation to psychiatric residency

A review of the literature suggests that the teaching of interviewing skills in psychiatry residency programs has been largely ignored. The consequences of poor interviewing, the characteristics of good interviewing, and what is known about effective training techniques for the mastery of clinical interviewing are reviewed. The relevance of psychiatric training is discussed. Issues which warrant further research are presented.

Teaching interviewing skills to paediatric junior clerks using simulated mothers

In this article a training programme is described for improving interviewing skills of students in the fifth year (junior clerkship) of the medical curriculum. Two interviews with a 'simulated mother' form the core of the programme. The interviews are immediately followed by a feedback session in which the simulated mother discusses the strong and the weak points of the interview. In the feedback she makes use of a checklist with relevant points concerning the content and the process of the interview. Where required the comments are substantiated with fragments of the videotaped interview. In a 2-hour theoretical session, students are told how to prepare themselves for the interview. The learning effects of the training programme using simulated mothers were evaluated in order to determine: (1) the subsequent improvement in interviewing skills; and (2) the effect of the feedback session. It was found that students' interviewing skills improved significantly on the content and the process aspects after one or two interviews. In addition the feedback sessions proved very helpful, although no significant differences were revealed, when comparing the mean group scores for students who had had feedback sessions with the scores for those who had not. The results also revealed that two interviews were insufficient and that the training should include at least three interviews. This was borne out by the large number of students who asked for more interviews with simulated mothers. In the training programme the simulated mothers perform two functions: (1) playing the role of the mother of a sick child; and (2) giving feedback to students regarding their interviewing skills.(ABSTRACT TRUNCATED AT 250 WORDS)

The role of actors in teaching communication

This paper describes a series of communication workshops designed to improve the consultation skills of third-year clinical medical students during their period of attachment in general practice, and to enable them to understand the differences in perspective and attitude existing between doctor and patient and their effect on the process and outcome of the clinical interview. The workshops involve a group of professional actors as simulated patients. The advantages of this method are discussed in terms of increased lay participation in the teaching.

Self-assessment of specific interpersonal skills of medical undergraduates using immediate feedback through closed-circuit television

For a 2-week period, fifth-year medical students of the University of Melbourne are attached to a general practice to obtain experience in primary medical care. During this time they also attend a number of seminars in the Department of Community Medicine. In one session of 45 minutes duration, pairs of students are videotaped, each role-playing a diagnostic and a management interview. To determine the value of this session in improving clinical history-taking specific interpersonal skills by self-assessment and discussion, a questionnaire was administered consecutively to three groups, each of twenty-six students. It was found that being videotaped in a role-playing situation was an acceptable procedure to most students. An analysis of the results shows that the method outlined is a practical form of immediate self-assessment, and that the technique could be used to reinforce clinical history-taking, and specific interpersonal skills of students.