Learning adolescent psychosocial interviewing using simulated patients

The Use of Feedback in Improving the Knowledge, Attitudes and Skills of Medical Students: a Systematic Review and Meta-analysis of Randomized Controlled Trials

This study aims to investigate the effectiveness of the use of different feedback modalities in improving the knowledge, attitudes, and skills of medical students compared to students receiving no feedback or unstructured feedback. A systematic review and meta-analysis of randomized controlled trials was conducted based on a search of the Cochrane, ERIC, PubMed, Scopus, and Web of Science databases. A total of 26 studies were included for the systematic review and 13 for the meta-analysis. The meta-analysis revealed that the use of feedback was associated with better results compared to control groups (SMD = 0.80 [0.56-1.04], p < 0.001), and also when only high-quality studies were included (SMD = 0.86 [0.56-1.16], p < 0.001). Our findings revealed high heterogeneity in the use of feedback in medical education. However, the results of most of the studies and of the meta-analysis were positive, showing that feedback had a positive influence on the education-learning process of the students. PROSPERO registration: CRD42018112688.

Interventions for improving medical students' interpersonal communication in medical consultations

BACKGROUND

Communication is a common element in all medical consultations, affecting a range of outcomes for doctors and patients. The increasing demand for medical students to be trained to communicate effectively has seen the emergence of interpersonal communication skills as core graduate competencies in medical training around the world. Medical schools have adopted a range of approaches to develop and evaluate these competencies.

OBJECTIVES

To assess the effects of interventions for medical students that aim to improve interpersonal communication in medical consultations.

SEARCH METHODS

We searched five electronic databases: Cochrane Central Register of Controlled Trials, MEDLINE, Embase, PsycINFO, and ERIC (Educational Resource Information Centre) in September 2020, with no language, date, or publication status restrictions. We also screened reference lists of relevant articles and contacted authors of included studies.

SELECTION CRITERIA

We included randomised controlled trials (RCTs), cluster-RCTs (C-RCTs), and non-randomised controlled trials (quasi-RCTs) evaluating the effectiveness of interventions delivered to students in undergraduate or graduate-entry medical programmes. We included studies of interventions aiming to improve medical students' interpersonal communication during medical consultations. Included interventions targeted communication skills associated with empathy, relationship building, gathering information, and explanation and planning, as well as specific communication tasks such as listening, appropriate structure, and question style.

DATA COLLECTION AND ANALYSIS

We used standard methodological procedures expected by Cochrane. Two review authors independently reviewed all search results, extracted data, assessed the risk of bias of included studies, and rated the quality of evidence using GRADE.

MAIN RESULTS

We found 91 publications relating to 76 separate studies (involving 10,124 students): 55 RCTs, 9 quasi-RCTs, 7 C-RCTs, and 5 quasi-C-RCTs. We performed meta-analysis according to comparison and outcome. Among both effectiveness and comparative effectiveness analyses, we separated outcomes reporting on overall communication skills, empathy, rapport or relationship building, patient perceptions/satisfaction, information gathering, and explanation and planning. Overall communication skills and empathy were further divided as examiner- or simulated patient-assessed. The overall quality of evidence ranged from moderate to very low, and there was high, unexplained heterogeneity. Overall, interventions had positive effects on most outcomes, but generally small effect sizes and evidence quality limit the conclusions that can be drawn. Communication skills interventions in comparison to usual curricula or control may improve both overall communication skills (standardised mean difference (SMD) 0.92, 95% confidence interval (CI) 0.53 to 1.31; 18 studies, 1356 participants; I² = 90%; low-quality evidence) and empathy (SMD 0.64, 95% CI 0.23 to 1.05; 6 studies, 831 participants; I² = 86%; low-quality evidence) when assessed by experts, but not by simulated patients. Students' skills in information gathering probably also improve with educational intervention (SMD 1.07, 95% CI 0.61 to 1.54; 5 studies, 405 participants; I² = 78%; moderate-quality evidence), but there may be little to no effect on students' rapport (SMD 0.18, 95% CI -0.15 to 0.51; 9 studies, 834 participants; I² = 81%; low-quality evidence), and effects on information giving skills are uncertain (very low-quality evidence). We are uncertain whether experiential interventions improve overall communication skills in comparison to didactic approaches (SMD 0.08, 95% CI -0.02 to 0.19; 4 studies, 1578 participants; I² = 4%; very low-quality evidence). Electronic learning approaches may have little to no effect on students' empathy scores (SMD -0.13, 95% CI -0.68 to 0.43; 3 studies, 421 participants; I² = 82%; low-quality evidence) or on rapport (SMD 0.02, 95% CI -0.33 to 0.38; 3 studies, 176 participants; I² = 19%; moderate-quality evidence) compared to face-to-face approaches. There may be small negative effects of electronic interventions on information giving skills (low-quality evidence), and effects on information gathering skills are uncertain (very low-quality evidence).  Personalised/specific feedback probably improves overall communication skills to a small degree in comparison to generic or no feedback (SMD 0.58, 95% CI 0.29 to 0.87; 6 studies, 502 participants; I² = 56%; moderate-quality evidence). There may be small positive effects of personalised feedback on empathy and information gathering skills (low quality), but effects on rapport are uncertain (very low quality), and we found no evidence on information giving skills. We are uncertain whether role-play with simulated patients outperforms peer role-play in improving students' overall communication skills (SMD 0.17, 95% CI -0.33 to 0.67; 4 studies, 637 participants; I² = 87%; very low-quality evidence). There may be little to no difference between effects of simulated patient and peer role-play on students' empathy (low-quality evidence) with no evidence on other outcomes for this comparison. Descriptive syntheses of results that could not be included in meta-analyses across outcomes and comparisons were mixed, as were effects of different interventions and comparisons on specific communication skills assessed by the included trials. Quality of evidence was downgraded due to methodological limitations across several risk of bias domains, high unexplained heterogeneity, and imprecision of results. In general, results remain consistent in sensitivity analysis based on risk of bias and adjustment for clustering. No adverse effects were reported.  AUTHORS' CONCLUSIONS: This review represents a substantial body of evidence from which to draw, but further research is needed to strengthen the quality of the evidence base, to consider the long-term effects of interventions on students' behaviour as they progress through training and into practice, and to assess effects of interventions on patient outcomes. Efforts to standardise assessment and evaluation of interpersonal skills will strengthen future research efforts.

An examination of eating disorder education and experience in a 1-month adolescent medicine rotation: what is sufficient to foster adequate self-efficacy?

Objective Medical students and professionals report receiving limited education/training related to treating eating disorders. Because medical professionals are the point of initial contact for these patients and are involved necessarily in their treatment, sufficient knowledge on identification and intervention are imperative. This research set out to examine the impact of the eating disorder education and experience offered through a 1-month Adolescent Medicine rotation at a medical university on medical student/resident self-efficacy. Methods The 1-month rotation includes a standardized patient (SP) simulation, 1.5 h of didactic education, and 1 day observing the MD, nutritionist and psychologist within the outpatient Multidisciplinary Child/Adolescent Eating Disorders Clinic. All residents' (n = 132) eating disorder self-efficacy was assessed before (PRE) completing simulation and didactic session and again at the end of the 1-month rotation (END). Self-efficacy was also assessed after simulation and before the didactic session for group 1 (n = 92) and after simulation and didactic session for group 2 (n = 40). Results For group 1, self-efficacy was not significantly impacted PRE to POST. For group 2, self-efficacy significantly improved PRE to POST. POST to END changes were significant for both groups; however, group 2 scored significantly better across all self-efficacy areas at END. Conclusion Resident training in eating disorders requires more than is offered in many residency programs. SP simulation is strengthened as an effective training tool in assessing and promoting resident self-efficacy if it is followed by didactic education. Clinical observation and extended practice that includes ongoing guidance/feedback on performance is recommended in fostering self-efficacy.

Skills for Interviewing Adolescent Patients: Sustainability of Structured Feedback in Undergraduate Education on Performance in Residency

BACKGROUND

Effective adolescent (10 to 19 years) interviewing by physicians is an essential skill that many trainees can find challenging.

OBJECTIVE

We assessed whether structured adolescent interviewing using standardized patients (SPs) and feedback in undergraduate medical education (UME) has a sustained effect on residents' skills.

METHODS

Postgraduate year (PGY) 1 residents conducted interviews with a SP adolescent-mother pair. The SPs independently scored each PGY-1 interview using the structured communication adolescent guide (SCAG). Unpaired t tests were conducted comparing "Total-Item" and "Global" scores of PGY-1s who received structured SP adolescent interviewing with feedback in UME ("structured training" group) to those who had not ("no structured training" group).

RESULTS

PGY-1s in the structured training group (n = 23) received significantly higher mean Total-Item scores from both the SP adolescent (40.78 ± 7.04 and 32.41 ± 10.12, respectively; P = .001) and the SP mother (40.48 ± 7.90 and 33.34 ± 10.90, respectively; P = .01) than those without structured training (n = 29). Statistically significant results favoring PGY-1s with prior training were also seen with the SP adolescent and mother total Global SCAG scores.

CONCLUSIONS

Structured training in adolescent interviewing with SPs and feedback in UME appears to have a sustained effect on residents' adolescent interviewing skills. PGY-1s will interview adolescents and may benefit from structured adolescent SP interviewing with feedback, especially individuals who did not have this experience during their medical school training.

A systematic review: Children & Adolescents as simulated patients in health professional education

Simulated patients (SP) contribute to health professional education for communication, clinical skills teaching, and assessment. Although a significant body of literature exists on the involvement of adult SPs, limited research has been conducted on the contribution of children and adolescents. This systematic review, using narrative summary with thematic synthesis, aims to report findings related to children/adolescents as simulated patients in health professions education (undergraduate or post-graduate). A systematic review of qualitative and quantitative literature published between 1980 and September 2014 was undertaken using databases including CINAHL, Ovid Medline and Scopus. The lack of literature related to the employment of children and adolescents in nursing education dictated the expansion of the search to the wider health professions. Key search terms related to the employment of children and adolescents in health professional education programs. A total of 58 studies reduced to 36 following exclusion based on abstract review. Twenty-two studies reached full text review; following application of inclusion and exclusion criteria, 15 English language studies involving children and/or adolescents in simulation formed part of this systematic review. Five key themes emerged: Process related to recruitment, duration and content of training programs, support and debriefing practice, ethical considerations, and effects of participation for key stakeholders such as children and adolescents, parent and faculty, and learner outcomes. The results suggest that the involvement of children and adolescents in simulation for education and assessment purposes is valuable and feasible. The review identified the potential for harm to children/adolescents; however, rigorous selection, training and support strategies can mitigate negative outcomes. The ability of children to portray a role consistently across assessments, and deliver constructive feedback remains ambiguous.

The use of simulation to develop advanced communication skills relevant to psychiatry

Objective

Using simulation, we developed an advanced communication skill training programme with the objective of improving core psychiatry trainees’ confidence in managing difficult situations at work.

Design

Two simulation courses, comprising six scenarios, were developed for psychiatry core trainees (CTs) on the University College London Partners (UCLP) training scheme. Trainees were divided into small groups. Each trainee undertook two scenarios each. Feedback was delivered by facilitators, peers and the simulated patients. Written feedback was also given.

Setting

The courses were delivered in a local postgraduate medical education centre.

Patients

Actors were used to simulate adult psychiatric patients and their relatives. Other scenarios involved actors portraying colleagues.

Interventions

The simulations offered an opportunity for experiential learning while the debriefs allowed for focused feedback on trainees’ communication styles.

Main outcome measures

Changes in trainees’ perception of their ability to deal with difficult situations at work were measured. Semistructured interviews further explored trainees’ experience of the course and its educational impact.

Results

100% (n=39) of the trainees felt that their communication skills had improved after the training. 97% felt more able to defuse an angry/tense situation at work while 92% felt more able to deal with a difficult situation requiring sophisticated communication skills. 97% felt that regular simulation training would be valuable while 100% (n=24) of facilitators agreed that the experience was valuable to the trainees’ professional development. Qualitative analysis showed that trainees found the scenarios realistic, that the experience had led to an increased awareness of their communication style and that original improvements in confidence had translated to their clinical work.

Conclusions

The programme demonstrates that it is possible to use simulation in a simple, inexpensive and time-effective manner to provide realistic, enjoyable and educationally beneficial advanced communication skill training relevant to psychiatric practice.

Twelve tips on teaching and learning humanism in medical education

BACKGROUND

The teaching of humanistic values is recognized as an essential component of medical education and continuing professional development of physicians. The application of humanistic values in medical care can benefit medical students, clinicians and patients.

AIMS

This article presents 12 tips on fostering humanistic values in medical education.

METHOD

The authors reviewed the literature and present 12 practical tips that are relevant to contemporary practices.

RESULTS

The tips can be used in teaching and sustaining humanistic values in medical education.

CONCLUSIONS

Humanistic values can be incorporated in formal preclinical environments, the transition into clinical settings, medical curricula and clinical clerkships. Additionally, steps can be taken so that medical educators and institutions promote and sustain humanistic values.

Ethical participation of children and youth in medical education

Children and youth (referred to as 'children' in the present statement), whether actual patients or volunteers, frequently participate in medical education. The present position statement discusses the numerous ethical challenges that may arise including respect for persons, truth telling and confidentiality. The statement provides guidelines that may be helpful to educators from a wide variety of disciplines.

Effect of feedback from standardized patients on medical students' performance and perceptions of the neurological examination

BACKGROUND

Feedback can have a powerful influence on the performance of learners, and has traditionally been provided by faculty.

AIM

This study set out to explore whether feedback from a standardized patient (SP) can improve students' performance of the neurological examination.

METHODS

A randomized controlled design was used with final year medical students. The control group did not receive any feedback. The intervention groups received either written feedback or a combination of written and verbal feedback. A written test was given prior to the intervention to assess comparability of the three groups. Pretest and post-test scores on the neurological examination were compared. Attitudinal questionnaires were administered at the time of the posttest, and 6 months later.

RESULTS

Students receiving feedback from the SPs had significantly greater scores on the posttest than the control group. In the intervention groups, students receiving both verbal and written feedback scored significantly higher than those who received only written feedback. More positive perceptions of learning outcomes and the value of SP feedback were noted in the intervention groups.

CONCLUSION

SP feedback was associated with a significant increase in student scores on the neurological examination, as well as more favorable perceptions of the experience.

Lessons learned from an adolescent simulated patient educational program: Five years of experience

BACKGROUND

The use of adolescents as standardized patients (SPs) in medical education has scarcely been reported. We evaluated the views of teachers, students and adolescent SPs with regard to the adolescent SP program in our under graduate curriculum and the changes that were made to the program in the past five years (from 2002-2003 until 2006-2007).

METHOD

Adolescent girls were recruited to portray roles of adolescents asking their general practitioner for an oral contraceptive.Students rated the quality of the adolescent SPs? role performance and feedback on a validated questionnaire (the MaSP). Both adolescent SPs and faculty teachers completed questionnaires on their experiences.

RESULTS

Over the past five years, 201 to 341 students gave the adolescent SPs? general performance a mean mark that varied from 7.5 to 8 out of 10. Generally, evaluations by teachers and adolescent SPs about the adolescent SP program were also very positive.The quality of the feedback by adolescent SPs has shown improvement over the past five years, although adolescents find it quite difficult to give feedback.

CONCLUSIONS

Teachers, students and adolescent SPs have highly valued the adolescent SP program over the past five years.The program has been changed on the basis of the lessons learned and has become mature.

Feedback by simulated patients in undergraduate medical education: a systematic review of the literature

OBJECTIVES

Although the importance of feedback by simulated patients (SPs) is generally recognised, knowledge is scarce about the most effective ways in which SPs can provide feedback. In addition, little is known about how SPs are trained to provide feedback. This study aimed to provide a systematic overview of the ways in which SPs provide feedback to undergraduate medical students, the domains in which SPs provide feedback and the ways in which SPs are trained to provide feedback.

METHODS

We performed a systematic search of the literature using PubMed, PsychINFO and ERIC and searched for additional papers cited in reference lists. Papers were selected on the basis of pre-established inclusion and exclusion criteria and were classified, using a pre-established form, according to three aspects of SP feedback: training in giving feedback; the process of delivering feedback, and the domain(s) in which feedback is given.

RESULTS

A total of 49 studies were included and described in detail on the basis of the three aspects of SP feedback described above. The ways in which SPs were trained to give feedback were largely heterogeneous, as were the processes by which feedback was provided by SPs. Only a few studies described feedback processes that were in accordance with general recommendations for the delivery of effective feedback. Although feedback from the patient's perspective is generally recommended, most SPs provided feedback on clinical skills and communication skills.

DISCUSSION

There appear to be no clear standards with regard to effective feedback training for SPs. Furthermore, the processes by which feedback is provided by SPs and the selection of domain(s) in which SPs give feedback often seem to lack a solid scientific basis. Suggestions for further research are provided.

Reducing disparities downstream: prospects and challenges

Addressing upstream or fundamental causes (such as poverty, limited education, and compromised healthcare access) is essential to reduce healthcare disparities. But such approaches are not sufficient, and downstream interventions, addressing the consequences of those fundamental causes within the context of any existing health system, are also necessary. We present a definition of healthcare disparities and two key principles (that healthcare is a social good and disparities in outcomes are a quality problem) that together provide a framework for addressing disparities downstream. Adapting the chronic care model, we examine a hierarchy of three domains for interventions (health system, provider-patient interactions, and clinical decision making) to reduce disparities downstream and discuss challenges to implementing the necessary changes.

A structured communication adolescent guide (SCAG): assessment of reliability and validity

PURPOSE

To assess the reliability and validity of a Structured Communication Adolescent Guide (SCAG) in an undergraduate medical education setting using trained adolescent raters.

METHOD

The SCAG is a 49-item, 6-section (A-F), protocol derived from the Calgary Cambridge Observation Guide that incorporates adolescent psychosocial data collection with the physician's communication skills. Four trained female adolescents scored 42 videotaped adolescent clinical encounters using the SCAG; a trained psychologist's rating for each videotape was used as the gold standard.

RESULTS

Agreement among adolescent raters was determined by calculating intraclass correlation coefficients (ICC). The individual SCAG item scores, combined with the global ratings for each section, resulted in an overall ICC value of 0.93, indicating very strong agreement among the 4 raters. The global rating scores for the sections ('initiating the session', 'initiating separation', 'once adolescent is alone--lifestyle' and 'closure') produced an ICC range of 0.58-0.93. However, the ICC values for the 2 remaining sections ('how was information collected' and 'gathering information') global rating scores were below 0.30, signifying low agreement. Overall agreement between the adolescent raters and the gold standard resulted in an ICC value of 0.78. This is evidence of the SCAG's criterion validity.

CONCLUSION

The SCAG is a reasonably valid tool for use in guiding an encounter with an adolescent patient. However, 2 sections require modifications to improve their reliability and thus the SCAG's overall performance. Our results suggest that the SCAG shows promise as a potentially useful teaching resource in undergraduate medical education in adolescent medical interviewing.

Use of standardized patients to enhance a psychiatry clerkship

Changes in psychiatric health care delivery driven by such major shifts as deinstitutionalization, community-based care, and managed care have greatly altered the educational milieu for third-year psychiatry clerkships. Students may be assigned exclusively to alcohol and substance abuse treatment units, consultation-liaison services, or outpatient clinics, and may not have as broad an exposure as is desirable to patients with a variety of psychiatric illnesses. The authors describe a pilot course they developed in 2001, Clinical Psychiatric Assessment and Diagnosis, for third-year medical students at the Uniformed Services University of the Health Sciences medical school. The course uses standardized patients (SPs) to help students gain broader clinical experience. In psychiatry, a growing body of literature supports the acceptability, reliability, and validity of objective structured clinical examination assessment using SPs for medical students. Only a few articles report the use of SPs to primarily teach psychiatry instead of evaluating student proficiency in clinical psychiatry. Since this course was developed, the National Board of Medical Examiners announced that all medical students will be required to pass a clinical skills test in order to practice medicine, beginning with the class of 2005. The examination will use SPs modeling different clinical scenarios. In light of this change, many medical schools may have to reevaluate and possibly revamp their curriculums to insure sufficient acquisition of clinical skills in different specialties. The use of SPs in psychiatry could provide an effective, primary clinical teaching experience to address this new requirement as well.

Adolescent standardized patients: method of selection and assessment of benefits and risks

BACKGROUND

Our psychiatric Objective Structured Clinical Examination (OSCE) group wishes to develop adolescent psychiatry OSCE stations. The literature regarding adolescent standardized patient (SP) selection methods and simulation effects, however, offered limited assurance that such adolescents would not experience adverse simulation effects.

PURPOSE

Evaluation of adolescent SP selection methods and simulation effects for low- and high-stress roles.

METHOD

A two-component (employment-psychological) SP selection method was used. Carefully selected SPs were assigned across three conditions: low-stress medical role, high-stress psychosocial role, and wait list control. Qualitative and quantitative measures were used to assess simulation effects.

RESULTS

Our selection method excluded 21% (7% employment and 14% psychological) of SP applicants. For SP participants, beneficial effects included acquisition of job skills and satisfaction in making an important contribution to society. SP reactions of discomfort to roles were reported. Long-term adverse effects were not identified.

CONCLUSIONS

A two-component adolescent SP selection method is recommended. Adolescent SP benefits outweigh risks.