Examination of standardized patient performance: accuracy and consistency of six standardized patients over time

A study on the standard setting, validity, and reliability of a standardized patient performance rating scale - student version

INTRODUCTION

The quality of the performances of standardized patients plays a significant role in the effectiveness of clinical skills education. Therefore, providing standardized patients with constant feedback is essential. It is especially important to get students' perspectives immediately following their encounters with standardized patients. In the literature, there is no scale for use by students to evaluate the performance of standardized patients. Thus, the three main goals of this study were to: (1) develop a scale for use by students to evaluate the performance of standardized patients, (2) examine the psychometric properties of the scale, and (3) determine a cut-off score for the scale in a standard-setting.

MATERIALS AND METHODS

Seven hundred and two medical students participated in the scale- development process, the pilot test, and the validation process, and seven educators took part in the standard-setting process. After the evaluation of content validity, construct validity was assessed via exploratory and confirmatory factor analyses. For the standard-setting study, the extended Angoff method was used.

RESULTS

The exploratory factor analysis revealed that the scale had a single-factor structure, which was confirmed by confirmatory factor analysis. The Cronbach's alpha internal consistency coefficient was 0.91. The scale consists of nine items. The cut-off score was determined to be 24.11/45, which represents the minimum acceptable standard for standardized patient performance.

CONCLUSIONS

Our study outlined the critical steps in developing a measurement tool and produced a valid and reliable scale that allows medical students to assess the performance of standardized patients immediately following their interaction with the standardized patient. This scale constitutes an important contribution to the literature as it provides a tool for standardized patient trainers to assess standardized patients' weaknesses and help them improve their performance.KEY MESSAGESEvaluation of SP performance is essential to ensure the educational quality of clinical skills training programs.Students are the most relevant stakeholders to give feedback about SP performance immediately after encounters.The 'Standardized Patient Performance Rating Scale - Student Version' is a valid, reliable scale that can be used by students for the evaluation of standardized patients' strengths and weaknesses at individual-performance levels quickly.

Efficacy of an online communication skill training intervention on genetic counseling students' performance during standardized patient sessions

OBJECTIVE

To examine the efficacy of a brief, online intervention designed to enhance genetic counseling students' patient-centered communication.

METHODS

Genetic counseling students and recent graduates were randomized to two groups following a baseline standardized patient (SP) session: (1) immediate intervention exposure, which consisted of five modules that taught patient-centered communication skills followed by a second SP session, or (2) delayed intervention exposure following completion of the second session. Sessions were coded using the Roter Interaction Analysis System. Short-term efficacy was assessed by comparing communication during the second session between the delayed and immediate intervention exposure groups. Longer-term efficacy was assessed by comparing communication during a third session approximately five weeks later.

RESULTS

During the second session, students in the immediate intervention exposure group (n = 18) used more emotionally responsive statements and were more likely to use teach-back than those in the delayed intervention exposure group (n = 23). Students' emotionally responsive statements decreased among the immediate intervention exposure group during the third session.

CONCLUSION

Exposure to the intervention was associated with multiple, positive changes to students' patient-centered communication behavior.

PRACTICE IMPLICATIONS

These time- and resource-efficient modules may be beneficial as an introduction to communication skills training or a supplement to existing training.

Defining orienting language in the genetic counseling process

We defined orienting language in genetic counseling sessions as 'language intended to direct focus to a particular aspect of the counseling process; a physical, emotional, or cognitive space; or an outcome'. This is a concept expanding on the idea of 'orientation' statements in the genetic counseling literature. We propose that orienting language is an important component of effective communication in the genetic counseling process. Our goals were to document the presence of orienting language in genetic counseling sessions with practicing genetic counselors and simulated clients, categorize types of orienting language, and evaluate the purpose of this language. A sample of Genetic Counseling Video Project videotape transcripts was evaluated through consensus coding for orienting language. Orienting language was found to be abundant in the dataset evaluated. Each excerpt was coded for orienting language Strategies and Purpose. The six categories of Strategy codes identified were Logical Consistency, Providing Context, Guidance, Structuring the Session, Anchoring, and Procedural. The six categories of Purpose codes were Counselee Understanding, Guidance, Engagement, Promoting Effective Counselor/Counselee Interactions, Counselee Adaptation, and Relationship Building. Results support our expanded definition of orienting language, which was similar in both cancer and prenatal specialties and across years of counselor experience. Orienting language acts as a series of signposts to help clients navigate the sometimes complex and unfamiliar territory of a genetic counseling session. The introduction of this term into the genetic counseling literature allows its use by genetic counselors to be further evaluated and potentially incorporated into genetic counselor training.

Standardized Patients' Perspectives on Bias in Student Encounters

PURPOSE

Standardized patient (SP) encounters are widely used in health professional education to evaluate trainees' clinical skills. Prior literature suggests that bias can influence the evaluations of student learners in SP-student encounters. Understanding how SPs perceive bias in their work and how they view their role in mitigating or perpetuating bias in simulation is an important first step in addressing bias in the SP-student encounter.

METHOD

Researchers designed a qualitative interview study and conducted 16 semistructured interviews with SPs at the University of California, San Francisco Kanbar Simulation Center from July through September of 2020. Participants were selected using purposive sampling. The interviews were transcribed and analyzed by researchers using inductive thematic analysis. Researchers met iteratively to reconcile codes and identify themes.

RESULTS

SPs identified bias occurring in multiple directions: SP-to-student, student-to-SP, student-to-character, and SP-to-character. SPs were hesitant to label their own biases and instead used words such as "comfort" or "preference." SPs reported little bias from students, because students were being evaluated and therefore behaving carefully. Additionally, SPs perceived bias in the implementation of health care simulation, which manifests as underrepresentation of certain groups amongst actors and character descriptions. Most SPs felt that they should play a role in mitigating bias in SP-student encounters, including addressing bias that occurs, challenging stereotypes, teaching about cultural differences, and/or being conscious of bias in their assessments of learners.

CONCLUSIONS

In the SP-student encounter, bias can occur on many levels and between many individuals, including between the SP and the character they are portraying. Identifying the areas in which bias can exist can help simulation educators mitigate bias.

Quality in Standardized Patient Training and Delivery: Retrospective Documentary Analysis of Trainer and Instructor Feedback

Background

An important aspect of developing and maintaining a high-quality standardized patient (SP) program is incorporating quality assurance processes. Trainer and instructor feedbacks are considered critical in achieving these goals. The aim of this study is to determine programmatic and systematic issues in the scope of quality assurance and improvement through trainer and instructor feedback on SP performance. We also presented a logic model based on a synthesis of the current literature to ensure the development and maintenance of a quality management culture in the SP program.

Methods

A retrospective analysis of SP scoring was conducted, and written feedback forms completed by trainers and instructors in a large Canadian university’s SP program were collected. The previous six years (2014-2020) of SP feedback forms in the scope of quality assurance were reviewed and analyzed. Descriptive statistics were utilized to analyze the ratings. Thematic analysis was conducted on the data gathered from the written feedback.

Results

A total of 138 feedback forms were reviewed and analyzed in the study. The mean ratings given by the trainers for feedback and professionalism were 4.27 ± 1.29 and 4.77 ± 0.8, respectively. The mean ratings given by the instructors for knowledge of case information, appropriate responses, and affect were 4.84 ± 0.64, 4.86 ± 0.35, and 4.71 ± 0.76, respectively (from a range of 1 to 5). Four key themes emerged from the written feedback: nonverbal behaviors in simulation activity or feedback sessions, providing feedback from the patient perspective, consistency between role portrayal and scenario, and adapting easily to changing situations.

Conclusions

Component scoring on SP performance did not discriminate individual issues, but the qualitative comments identified certain specific issues. Further research is needed to establish standards of continuous quality improvement (CQI) within an SP program.

"I Guess I Didn't Like That Word Unfortunately": Standardized Patients' Unscripted Techniques for Training Medical Students

INTRODUCTION

This article explores tacit techniques embedded in standardized patients' (SPs) unscripted dialog in a context of breaking bad news (BBN) education. It identifies a technique in which the SP explicitly repeats 1 or more of the medical student's words and analyzes the function and impact of this technique.

METHODS

This film-based ethnographic inquiry used conversation analysis to examine so-called echo utterances, through which the SP repeats all or part of what the student has said. The data set includes 9 student encounters with 2 female SPs who specialize in the BBN simulation.

RESULTS

The authors identified a technique of "repair request" used by the SPs to provide an opportunity for the student to reformulate their utterance in character. Repair requests emerged from 4 main types of student speech: speculative language, inappropriate utterances, awkward timing, and medical jargon.

CONCLUSIONS

The technique of repair request is used to heighten the student's language sensitivity and foster the ability to respond to criticism or misunderstanding in character. Discovery of the tacit, unscripted technique of repair request in this study provides an opportunity to disseminate this technique in SP training for BBN and other simulation scenarios. These findings suggest the need for further research to identify additional tacit techniques used by SPs to improve medical education.

Training and Validation of Incognito Standardized Patients for Assessing Oncology Fellows’ Performance Regarding Breaking Bad News

Background: Standardized patient (SP) has been applied to measure learner’s communication challenges such as breaking bad news (BBN). When utilizing SP-based assessment, 2 steps should be considered in SP training; assessing SPs portrayal as the real patient (authenticity) and how SPs checklist fill out reproducibility. Objectives: In this study, we described the process of training authentic and consistent SPs for evaluating oncology fellows’ performance regarding BBN in Iran. Methods: In this cross-sectional study, 8 eligible SPs took part in a 3-day educational meeting. Four different scenarios were developed regarding cancer patients along with corresponding checklists representing common presentations of illness. The accuracy of SPs portrayal was evaluated by experts, using a previously validated rating scale during observation of their role-playing. The reproducibility of SPs’ portraits was measured, using a test-retest approach. The inter-rater agreement of the SPs’ ability to fill out the BBN scale was measured by comparing the correlation between the SPs, who completed the scale, and oncologist faculty members’ judgments, which is considered a gold standard. Results: The findings of this study indicated that the cut-off score for the SPs’ portrayal validity was 95%. The reliability of SPs portrayal was acceptable (r = 0.89). The inter-rater agreement between SPs and experts in filling the BBN scale (k = 0.82), as well as, the consistency of filling the BBN scale between SP groups were highly acceptable (k = 0.86). Conclusions: The present study has demonstrated that if SP is trained appropriately, they shave a high degree of reliability and validity to assess oncology fellows’ performance regarding BBN skills.

Description of a training protocol to improve research reproducibility for dignity therapy: an interview-based intervention

BACKGROUND

Dignity Therapy (DT) has been implemented over the past 20 years, but a detailed training protocol is not available to facilitate consistency of its implementation. Consistent training positively impacts intervention reproducibility.

OBJECTIVE

The objective of this article is to describe a detailed method for DT therapist training.

METHOD

Chochinov's DT training seminars included preparatory reading of the DT textbook, in-person training, and practice interview sessions. Building on this training plan, we added feedback on practice and actual interview sessions, a tracking form to guide the process, a written training manual with an annotated model DT transcript, and quarterly support sessions. Using this training method, 18 DT therapists were trained across 6 sites.

RESULTS

The DT experts' verbal and written feedback on the practice and actual sessions encouraged the trainees to provide additional attention to eight components: (1) initial framing (i.e., clarifying and organizing of the patient's own goals for creating the legacy document), (2) verifying the patient's understanding of DT, (3) gathering the patient's biographical information, (4) using probing questions, (5) exploring the patient's story thread, (6) refocusing toward the legacy document creation, (7) inviting the patient's expression of meaningful messages, and (8) general DT processes. Evident from the ongoing individual trainee mentoring was achievement and maintenance of adherence to the DT protocol.

DISCUSSION

The DT training protocol is a process to enable consistency in the training process, across waves of trainees, toward the goal of maintaining DT implementation consistency. This training protocol will enable future DT researchers and clinicians to consistently train therapists across various disciplines and locales. Furthermore, we anticipate that this training protocol could be generalizable as a roadmap for implementers of other life review and palliative care interview-based interventions.

Characterizing standardized patients and genetic counseling graduate education

Standardized patients (SPs) are laypersons trained to portray patients, family members, and others in a consistent, measurable manner to teach and assess healthcare students, and to provide practice for emotionally and medically challenging cases. SP methodology has been studied with practicing genetic counselors; however, there is minimal empirical evidence characterizing its use in genetic counseling (GC) education. The Accreditation Council for Genetic Counseling (ACGC) Standards of Accreditation for Graduate Programs in Genetic Counseling include SP sessions as one way to achieve up to 20% of the 50 participatory cases required for graduation. The purpose of the current project was to determine the scope, frequency, and timing of SP methodology in ACGC-accredited programs to establish baseline usage, which happened prior to the SARS-CoV-2 pandemic. A 40-item investigator-created survey was developed to document the scope and frequency of SP use among programs. The survey was distributed through the Association of Genetic Counseling Program Directors' (AGCPD) listserv to 43 accredited and 6 programs under development. Surveys were analyzed from 25 accredited programs (response rate = 58%). Seventeen of these programs report inclusion of SP methodology in the curricula (68%), of which 13 report working with an established SP program. SPs are used predominantly for role-plays (70.6%), individualized instruction and remediation (29.4%), and for other reasons such as lecture demonstration, final examinations, practicing skills, and assessing students' goals. Sixteen of the participating programs use SPs to give GC students experience disclosing positive test results. Other details vary among the GC programs including the use of trained SPs, volunteer or paid SPs, actors with and without SP training, or GC students acting as patients. This study demonstrates that GC program SP experiences differ, but are largely viewed as valuable by the programs. Many GC programs report using SP encounters to create multiple opportunities for students to practice and refine clinical skills similar to SPs in medical school.

Feasibility, face validity, and sensitivity of a web-based simulation tool for assessing genetic counseling communication

We conducted a test of concept study to explore feasibility, face validity, and sensitivity of an interactive web-based video tool designed to assess communication practices of genetic counselors in response to standardized video prompts. A convenience sample of genetic counselors was recruited from the National Society of Genetic Counselors to respond verbally to a set of brief standardized video prompts from a virtual client in a prenatal genetic counseling session and a cancer genetic counseling session, embedded in an interactive online platform. Participant verbal responses to prompts were captured through a secure voicemail service. A total of 89 participants attempted to use the online tool and 51 (57%) successfully completed the simulation and produced an audio record of their responses. The average length of recordings was 12.2 min. Face validity was high; participants rated the virtual client as similar to clients seen in practice (75% agree; 12% strongly agree, 7% neutral, 6% disagree) and rated their own responses to the virtual client prompts as similar to those in practice (63% agree; 19% strongly agree; 12% neutral, 6% disagree). Feasibility was assessed by ratings of ease of use (57% agreed, 24% strongly agreed, 17% were neutral, and none disagreed). Content checklists showed that the tool was sensitive enough to detect variation in frequency of certain topics discussed by participants that was similar to previous descriptive studies. The test of concept demonstrated feasibility, face validity, and sensitivity of this communication tool with possible applications in research, training, and program evaluation.

Individuation and implicit racial bias in genetic counseling communication

OBJECTIVES

Genetic counselors (GCs) can frame information in either general terms (i.e., population risks) or individual terms (i.e., tailoring to specific client characteristics). We investigated whether informational framing might reflect GCs' implicit racial bias.

METHODS

We analyzed previously videotaped genetic counseling sessions with white and minority (Black and Latino) simulated clients (SCs) and modeled the relationship between sixty GCs' implicit racial bias, as measured by the Implicit Association Test (IAT), and informational framing (general or individual) as characterized by the Roter Interaction Analysis System.

RESULTS

Higher (more pro-white) IAT scores predicted less informational individuation for minority relative to white SCs. Similarly, higher IAT predicted fewer facilitation and activation statements to minority relative to white SCs. With higher IAT-scoring GCs, minority SCs disclosed less psychosocial and lifestyle information, and asked fewer medical questions (all p < 0.05).

CONCLUSION

GCs' racial implicit bias may be associated with less individualized communication style when counseling minority clients.

PRACTICE IMPLICATIONS

Future research should address whether increasing informational individuation can ameliorate negative consequences of implicit bias and help providers reframe perceptions of minority patients in individual rather than categorical terms.

Genetic counselor implicit bias and its effects on cognitive and affective exchanges in racially discordant simulations

Previous studies have linked clinicians' implicit racial bias with less patient-centered communication between healthcare providers and patients in a variety of healthcare contexts. The current study extends this research by exploring the influence of implicit racial bias in genetic counselors' (GCs') facilitation of simulated clients' cognitive and emotional processing during genetic counseling sessions. We conducted a secondary analysis of a nationally representative sample of genetic counseling sessions of White and ethnic and/or racial minority (Black and Latinx) simulated clients with a subset of 60 GCs who had completed a Race Implicit Association Test (IAT). Linguistic Inquiry Word Count (LIWC) was applied to session transcripts to identify word use by the simulated client consistent with emotional and cognitive processing. The Roter Interaction Analysis System (RIAS) was used to link GC statements consistent with facilitation of emotional and cognitive processing, as used in previous studies. Multiple linear regression analyses were performed to relate LIWC and RIAS variables to GC IAT scores, client race/ethnicity, and statistical interaction between GC IAT scores and client race/ethnicity. GCs used more cognitive facilitation strategies with ethnic and/or racial minority than with White clients (p = .04). There were no statistically significant associations between GCs' pro-White implicit bias and GCs' facilitation of cognitive and emotional processing or clients' use of positive, negative, or cognitive process words. While implicit bias may affect some communication processes, our analysis did not show a relationship between GC IAT score and how GCs help clients process emotional or cognitive information conveyed during a session. It is also possible that the LIWC measure of cognitive and emotional processing is not a sensitive enough measure to capture an implicit bias effect if indeed one is present.

Evaluation of a shared decision-making communication skills training for physicians treating patients with asthma: a mixed methods study using simulated patients

Background

Shared decision-making (SDM) is a key principle in asthma management, but continues to be poorly implemented in routine care. This study aimed to evaluate the impact of a SDM communication skills training for physicians treating patients with asthma on the SDM behaviors of physicians, and to analyze physician views on the training.

Methods

A mixed methods study with a partially mixed sequential equal status design was conducted to evaluate a 12 h SDM communication skills training for physicians treating patients with asthma. It included a short introductory talk, videotaped consultations with simulated asthma patients, video analysis in small group sessions, individual feedback, short presentations, group discussions, and practical exercises. The quantitative evaluation phase consisted of a before (t0) after (t1) comparison of SDM performance using the observer-rated OPTION⁵, the physician questionnaire SDM-Q-Doc, and the patient questionnaire SDM-Q-9, using dependent t-tests. The qualitative evaluation phase (t2) consisted of a content analysis of audiotaped and transcribed interviews.

Results

Initially, 29 physicians participated in the study, 27 physicians provided quantitative data, and 22 physicians provided qualitative data for analysis. Quantitative results showed significantly improved performance in SDM following the training (t1) when compared with performance in SDM before the training (t0) (OPTION⁵: t (26) = − 5.16; p < 0.001) (SDM-Q-Doc: t (26) = − 4.39; p < 0.001) (SDM-Q-9: t (26) = − 5.86; p < 0.001). The qualitative evaluation showed that most physicians experienced a change in attitude and behavior after the training, and positively appraised the training program. Physicians considered simulated patient consultations, including feedback and video analysis, beneficial and suggested the future use of real patient consultations.

Conclusion

The SDM communication skills training for physicians treating patients with asthma has potential to improve SDM performance, but would benefit from using real patient consultations.

Physician Communication of Genomic Results in a Diagnostic Odyssey Case Series

BACKGROUND AND OBJECTIVES

The availability of whole genome sequencing (WGS) is increasing in clinical care, and WGS is a promising tool in diagnostic odyssey cases. Physicians' ability to effectively communicate genomic information with patients, however, is unclear. In this multiperspective study, we assessed physicians' communication of patient genome sequencing information in a diagnostic odyssey case series.

METHODS

We evaluated physician communication of genome sequencing results in the context of an ongoing study of the utility of WGS for the diagnosis of rare and idiopathic diseases. A modified version of the Medical Communication Competence Scale was used to compare patients' ratings of their physicians' communication of general medical information to communication of genome sequencing information. Physician self-ratings were also compared with patient ratings.

RESULTS

A total of 47 patients, parents, and physicians across 11 diagnostic odyssey cases participated. In 6 of 11 cases (54%), the patient respondent rated the physician's communication of genome sequencing information as worse than that of general medical information. In 9 of 11 cases (82%), physician self-ratings of communication of genome sequencing information were worse than the patient respondent's rating. Identification of a diagnosis via WGS was positively associated with physician self-ratings (P = .021) but was not associated with patient respondent ratings (P = .959).

CONCLUSIONS

These findings reveal that even in diagnostic odyssey cases, in which genome sequencing may be clinically beneficial, physicians may not be well-equipped to communicate genomic information to patients. Future studies may benefit from multiperspective approaches to assessing and understanding physician-patient communication of genome-sequencing information.

Quality assurance processes for standardized patient programs

OUR PROBLEM

As the pharmacy profession evolves to include non-dispensing services and collaborative care, greater emphasis is placed on communication skills building through standardized patient programs. Best practices for assuring the quality of standardized patient (SP) programs, however, remains unclear. The objective of this manuscript is to summarize quality assurance processes for standardized patient programs from health professions education literature.

METHODOLOGICAL LITERATURE REVIEW

A search of PubMed and Scopus between 2011 and 2016 was conducted and 22 articles were retained for thematic analysis. Articles were screened for relevance to quality assurance.

OUR RECOMMENDATIONS AND THEIR APPLICATIONS

The thematic analysis revealed four themes: (1) enhanced SP training programs, (2) structured feedback to students, (3) statistical measurements to ensure inter-rater reliability, and (4) observation and evaluation of the SP to improve SP performance. Specific methods to assure the quality of an SP program were identified, including training program content and feedback techniques.

POTENTIAL IMPACT

Although SP programs varied widely in their implementation, there were several common strategies used to evaluate the consistency of performance, effectiveness of feedback to students, and reliability of grading. Additional research is necessary to establish standards for SP programs across professional healthcare disciplines.

Assessing the Believability of Standardized Patients Trained to Portray Communication Disorders

PURPOSE

The purpose of this study was to evaluate the believability of standardized patients portraying individuals with communication disorders as part of a larger study in which standardized patients help train medical and allied health students about communication disorders.

METHOD

Two women portrayed persons with aphasia, and 2 men depicted persons with dysarthria associated with Parkinson's disease. Two stakeholder groups rated believability. Speech-language pathologists rated believability of videos online. Persons with aphasia rated aphasia videos during in-person sessions with the researchers.

RESULTS

Targeted believability was 80 or higher (0-100 scale; 0 = not at all believable, 100 = very believable). For speech-language pathologist raters, average ratings met the target for the portrayals of the aphasia characteristics of word-finding problems, agrammaticism, nonverbal communication, and overall portrayal but not for auditory comprehension problems. Targets for the portrayals were met for the dysarthria characteristics of reduced speech movements, reduced loudness, reduced intonation, flat affect, and overall portrayal but not for speech rate. Ratings for different standardized patients portraying the same case were not significantly different from each other on most characteristics. Ratings from persons with aphasia were highly variable.

CONCLUSION

Standardized patients who do not have communication disorders can portray disorder characteristics in a believable manner.

GPs' patterns of clinical assessment when faced with a patient suspected for spondyloarthritis: a prospective educational intervention study

Background

Timely recognition and referral of patients with spondyloarthritis (SpA) is challenging due to the frequent unawareness of the clinical picture.

Aim

To identify clinical assessment patterns of GPs and GP-residents when facing a patient suspected of having SpA, and to determine which components of clinical assessment were most prevalent prior to referral to the rheumatologist and whether targeted education could positively influence pattern recognition.

Design & setting

Prospective multicentre educational intervention study in primary care practices in the Netherlands.

Method

GPs and GP-residents were visited in two rounds by standardised patients (SPs) simulating axial or peripheral SpA (dactylitis). Between these rounds, an educational intervention regarding SpA took place for part of the participants. SPs completed a case-specific checklist inquiring about disease-related items and items on physical examination.

Results

Sixty-eight participants (30 GPs and 38 GP-residents) were included and 19 (28%) received the educational intervention. In round 1, about half of the participants asked at least one question to differentiate between an inflammatory or mechanical origin of the back pain or peripheral complaint; on average, <15% asked for extra-articular manifestations. After education, GP-residents inquired more about the presence of extra-articular manifestations and family history of axial SpA; this pattern was also observed in the GPs and GP-residents who correctly referred the SP. In the peripheral SpA case, the observed gain was less evident when compared to the axial SpA case.

Conclusion

Pattern recognition of patients suspected for SpA by GP(-residents) is essential for referral to a rheumatologist and can be improved by education.

The Benefits and Risks of Being a Standardized Patient: A Narrative Review of the Literature

Standardized patients (SPs) are a widely used, valid, and reliable means of teaching and evaluating healthcare providers (HCPs) across all levels of training and across multiple domains of both clinical and communication skills. Most research on SP programs focuses on outcomes pertinent to the learners (i.e., HCPs) rather than how this experience affects the SPs themselves. This review seeks to summarize the current literature on the risks and benefits of being an SP. We reviewed the literature on the effects that simulation has on adults, children/adolescents, and medical professionals who serve as SPs, in addition to real patients (RPs) who are involved in teaching by sharing their medical histories and experiences. To collect the literature, we conducted two separate systematic searches: one for SPs and one for RPs. Following the searches, we applied standardized eligibility criteria to narrow the literature down to articles within the scope of this review. A total of 67 studies were included that focused on the outcomes of SPs or RPs. The benefits for those portraying SP roles include improved health knowledge and attitudes, relationships with their HCPs, and changed health behaviors. Negative effects of being an SP include anxiety, exhaustion/fatigue, and physical discomfort immediately following a simulation, but the literature to date appears to indicate that there are no long-lasting effects. These findings are consistent across age groups and the type of role being simulated. They are also supported by studies of RPs who are involved in medical education. Overall, the benefits of being an SP appear to outweigh the known risks. However, there are significant limitations in the current literature, and additional studies are needed to better characterize the SP experience.

A questionnaire identifying four key components of patient satisfaction with physician communication

OBJECTIVE

To improve efficiency and retain the 4 factors of a reliable, valid interview satisfaction questionnaire (ISQ).

METHOD

105 residents conducted 301 patient-centered interviews with 10 simulated patients (SP). SPs portrayed three scenarios for each resident and completed the ISQ and the Communication Assessment Tool (CAT) after each. A confirmatory factor analysis (CFA) of the ISQ and CAT determined which items had >0.5 factor loadings and <0.1 error, criteria for retaining items in a shortened scale.

RESULTS

After the CFA, 13 items were deleted resulting in a 12-item scale (RMSE=0.06) that confirmed the initial 4 factor structure of satisfaction with: open-endedness, empathy, confidence in the resident, and general. Scale reliability of each factor was high (Cronbach's alpha ranged from .74 to .93). Demonstrating concurrent validity, all four factors of the ISQ correlated highly with the one-factor CAT (r>.7, p<.001), and the second order unidimensional ISQ scale also correlated highly with the CAT (r=.83, p<.001).

CONCLUSIONS

The ISQ is an efficient, reliable, and valid instrument that uniquely deconstructs satisfaction with the patient-physician interaction into 4 key components.

PRACTICE IMPLICATIONS

The 4 components provide a means for better understanding poor satisfaction results.

Recommendations for enhancing psychosocial support of NICU parents through staff education and support

Providing psychosocial support to parents whose infants are hospitalized in the neonatal intensive care unit (NICU) can improve parents' functioning as well as their relationships with their babies. Yet, few NICUs offer staff education that teaches optimal methods of communication with parents in distress. Limited staff education in how to best provide psychosocial support to families is one factor that may render those who work in the NICU at risk for burnout, compassion fatigue and secondary traumatic stress syndrome. Staff who develop burnout may have further reduced ability to provide effective support to parents and babies. Recommendations for providing NICU staff with education and support are discussed. The goal is to deliver care that exemplifies the belief that providing psychosocial care and support to the family is equal in importance to providing medical care and developmental support to the baby.

Association between job strain, mental health and empathy among intensive care nurses

BACKGROUND

Nursing shortage is a worldwide issue. It could influence factors such as job strain, nurses' mental health and nurse empathy towards patients.

AIM

The aim of the study is to explore the associations between job strain, psychological distress, psychological well-being and empathy in intensive care units (ICUs).

DESIGN

A cross-sectional descriptive correlational design.

METHODS

Data were collected using questionnaires and an observation tool completed by three observers during a standardized clinical simulation (SCS). A total of 26 nurses practicing in three ICUs participated in the study, which took place over 3 days in December 2011.

RESULTS

One dimension of job strain, psychological demand, was associated with two subscales of mental health (psychological distress positively and psychological well-being negatively). Positive correlations were demonstrated between psychological distress and nurse empathy as perceived by both the observers and the actor who played the role of patient.

CONCLUSION

Some associations have been confirmed between job strain, psychological distress, psychological well-being and empathy in the ICU while others needs further investigation.

RELEVANCE TO CLINICAL PRACTICE

It is important to reduce psychological demand among intensive care nurses in order to prevent psychological distress. The exploration of the connection between empathy and psychological distress should be advanced. This study suggests that SCSs provide an innovative approach that is useful for research.

Education improves referral of patients suspected of having spondyloarthritis by general practitioners: a study with unannounced standardised patients in daily practice

OBJECTIVES

To evaluate the practice performance of general practitioners (GPs) and GP residents in recognising and referring patients suspected for having axial or peripheral spondyloarthritis (SpA), and to investigate the influence of education on this performance.

METHODS

GP (residents) were visited in two rounds by standardised patients (SPs) simulating axial SpA, peripheral SpA or carpal tunnel syndrome (CTS) with in between an educational intervention on SpA for part of the participants. Participants were unaware of the nature of the medical problem and study purpose. CTS was included as diversionary tactic. The primary outcome was ≥40% improvement in (considering) referral of the SPs with SpA to the rheumatologist after education. Secondary outcomes included ordering additional diagnostic tests, correct recognition of SpA and identification of variables contributing to this.

RESULTS

68 participants (30 GPs and 38 GP residents) were included, of which 19 received education. The primary outcome was met. A significantly higher proportion of GP (residents) from the intervention group referred patients to the rheumatologist compared with the control group after education (change scores, axial SpA +71% vs +15% (p<0.01); peripheral SpA +48% vs 0% (p<0.001)). Participants who received education, more frequently correctly recognised SpA compared with controls (change scores, axial SpA +50% vs -5% (p<0.001); peripheral SpA +21% vs 0% (p=0.01).

CONCLUSIONS

Recognition and referral of patients suspected for having SpA by GP (residents) is low, but targeted education markedly improved this. This supports the development of educational initiatives to improve recognition of SpA and hence referral to a rheumatologist.

Standardized Patient Training Programs: an Efficient Solution to the Call for Quality Improvement in Oncologist Communication Skills

Several key medical and oncologic professional societies have endorsed the importance of physician communication as a quality improvement metric. Despite this clear message, there remain substantial barriers to communication skills training (CST) in oncologic specialties. Herein, we describe the major barriers to communications training and propose standardized patient (SP) programs as efficient and strategic starting points and as expansion opportunities for new and existing CSTs.

Genetic counselors' implicit racial attitudes and their relationship to communication

OBJECTIVE

Implicit racial attitudes are thought to shape interpersonal interactions and may contribute to health-care disparities. This study explored the relationship between genetic counselors' implicit racial attitudes and their communication during simulated genetic counseling sessions.

METHOD

A nationally representative sample of genetic counselors completed a web-based survey that included the Race Implicit Association Test (IAT; Greenwald, McGhee, & Schwartz, 1998; Cooper et al., 2012). A subset of these counselors (n = 67) had participated in an earlier study in which they were video recorded counseling Black, Hispanic, and non-Hispanic White SCs about their prenatal or cancer risks. The counselors' IAT scores were related to their session communications through robust regression modeling.

RESULTS

Genetic counselors showed a moderate to strong pro-White bias on the Race IAT (M = 0.41, SD = 0.35). Counselors with stronger pro-White bias were rated as displaying lower levels of positive affect (p < .05) and tended to use less emotionally responsive communication (p < .10) when counseling minority SCs. When counseling White SCs, pro-White bias was associated with lower levels of verbal dominance during sessions (p < .10). Stronger pro-White bias was also associated with more positive ratings of counselors' nonverbal effectiveness by White SCs.

CONCLUSION

Implicit racial bias is associated with negative markers of communication in minority client sessions and may contribute to racial disparities in processes of care related to genetic services.

Error disclosure and family members' reactions: does the type of error really matter?

OBJECTIVE

To describe how Italian clinicians disclose medical errors with clear and shared lines of responsibility.

METHODS

Thirty-eight volunteers were video-recorded in a simulated conversation while communicating a medical error to a simulated family member (SFM). They were assigned to a clear responsibility error scenario or a shared responsibility one. Simulations were coded for: mention of the term "error" and apology; communication content and affect using the Roter Interaction Analysis System. SFMs rated their willingness to have the patient continue care with the clinician.

RESULTS

Clinicians referred to an error and/or apologized in 55% of the simulations. The error was disclosed more frequently in the clear responsibility scenario (p<0.02). When the "error" was explicitly mentioned, the SFM was more attentive, sad and anxious (p≤0.05) and less willing to have the patient continue care (p<0.05). Communication was more patient-centered (p<0.05) and affectively dynamic with the SFMs showing greater anxiety, sadness, attentiveness and respectfulness in the clear responsibility scenario (p<0.05).

CONCLUSIONS

Disclosing errors is not a common practice in Italy. Clinicians disclose less frequently when responsibility is shared and indicative of a system failure.

PRACTICE IMPLICATIONS

Training programs to improve disclosure practice considering the type of error committed should be implemented.

The performance of standardized patients in portraying clinical scenarios in speech-language therapy

BACKGROUND

Standardized patients (SPs) are frequently included in the clinical preparation of students in the health sciences. An acknowledged benefit of using SPs is the opportunity to provide a standardized method by which students can demonstrate and develop their competency. Relatively little is known, however, about the capacity of SPs to offer an accurate and standardized performance across a speech-language therapy student cohort.

AIMS

To investigate the accuracy, reproducibility (consistent performance of each SP across student interviews) and replicability (consistent performance of a number of SPs across each scenario) of SPs portraying three scenarios, each as a parent of a child presenting with a speech disorder.

METHODS & PROCEDURES

Forty-four speech-language therapy students interviewed four SPs to gain a case history. All interviews were videotaped. The accuracy of SP portrayal of key features of each scenario was scored by an expert rater and two other raters. Data were analysed to determine levels of accuracy, reproducibility and replicability, and inter-rater reliability was evaluated.

OUTCOMES & RESULTS

SPs were found to have moderate to high levels of accuracy across the three scenarios. There were no significant differences in the performances of each individual SP across interviews or between all SPs on each scenario, indicating that reproducibility and replicability were achieved. Overall inter-rater reliability between raters across all scenarios was greater than 80%.

CONCLUSIONS & IMPLICATIONS

The results would seem to indicate that SPs can present in a standardized manner within a speech-language therapy context, confirming the value of their inclusion in clinical education programmes. Suggestions for improving the training of SPs in order to maintain accuracy are highlighted.

Genetic counseling for prenatal testing: where is the discussion about disability?

There are little data revealing how genetic counselors talk about disability in the prenatal setting. We performed a qualitative analysis of 93 existing transcripts from simulated patient (SP) genetic counseling sessions conducted in 2003–4 through the Genetic Counseling Video Project. We found that most genetic counselors (95%) focused on the physical aspects of disability while fewer (27%) discussed the social aspects. In addition, few genetic counselors (38%) asked patients about personal experiences with disability. When discussing options available if a pregnancy were diagnosed with a disability, most genetic counselors mentioned termination (86%) while fewer mentioned the continuation of the pregnancy (37%) or adoption (13%). Only half of the genetic counselors asked the SP if she had thought about how she might use the results of prenatal screening. To better facilitate informed decision-making that is consistent with patient values, we recommend genetic counselors engage prenatal patients in a deeper discussion about their ability and willingness to parent a child with a disability.

Genetic counseling for prenatal testing: where is the discussion about disability?

There are little data revealing how genetic counselors talk about disability in the prenatal setting. We performed a qualitative analysis of 93 existing transcripts from simulated patient (SP) genetic counseling sessions conducted in 2003–4 through the Genetic Counseling Video Project. We found that most genetic counselors (95%) focused on the physical aspects of disability while fewer (27%) discussed the social aspects. In addition, few genetic counselors (38%) asked patients about personal experiences with disability. When discussing options available if a pregnancy were diagnosed with a disability, most genetic counselors mentioned termination (86%) while fewer mentioned the continuation of the pregnancy (37%) or adoption (13%). Only half of the genetic counselors asked the SP if she had thought about how she might use the results of prenatal screening. To better facilitate informed decision-making that is consistent with patient values, we recommend genetic counselors engage prenatal patients in a deeper discussion about their ability and willingness to parent a child with a disability.

Standardized patients: a promising tool for health education and health promotion

Standardized patients (SPs) are trained actors who are used to engage health care providers in various types of clinical encounters for the purposes of training and evaluation. In the past, SPs have most often been a tool for training clinicians in "traditional" medical skills such as the taking of medical histories or the conduct of physical exams. More recently, however, SPs have been increasingly used to assist in the development and assessment of psychosocial skills, including those related to patient-centered communication, relationship building, and motivational interviewing. Given this shift, it is argued that the time is ripe for exploring ways that health educators can adopt SP methodologies, whether for providing continuing education for individual providers or evaluating organizations or programs. This article introduces ways of using SPs and discusses strengths and challenges related to various approaches.

Using Self-Guided Treatment Software (ePST) to Teach Clinicians How to Deliver Problem-Solving Treatment for Depression

Problem-solving treatment (PST) offers a promising approach to the depression care; however, few PST training opportunities exist. A computer-guided, interactive media program has been developed to deliver PST electronically (ePST), directly to patients. The program is a six-session, weekly intervention modeled on an evidence-based PST protocol. Users are guided through each session by a clinician who is presented via hundreds of branching audio and video clips. Because expert clinician behaviors are modeled in the program, not only does the ePST program have the potential to deliver PST to patients but it may also serve as a training tool to teach clinicians how to deliver PST. Thirteen social workers and trainees used ePST self-instructionally and subsequently attended a day-long workshop on PST. Participants' PST knowledge level increased significantly from baseline to post-ePST (P = .001) and did not increase significantly further after attending the subsequent workshop. Additionally, attending the workshop did not significantly increase the participants' skill at performing PST beyond the use of the ePST program. Using the ePST program appears to train novices to a sufficient level of competence to begin practicing PST under supervision. This self-instructional training method could enable PST for depression to be widely disseminated, although follow-up supervision is still required.