1
|
Doyle AJ, Sullivan C, O'Toole M, Tjin A, Simiceva A, Collins N, Murphy P, Anderson MJ, Mulhall C, Condron C, Nestel D, MacAulay R, McNaughton N, Coffey F, Eppich W. Training simulated participants for role portrayal and feedback practices in communication skills training: A BEME scoping review: BEME Guide No. 86. MEDICAL TEACHER 2024; 46:162-178. [PMID: 37552799 DOI: 10.1080/0142159x.2023.2241621] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 08/10/2023]
Abstract
BACKGROUND Providing feedback is a key aspect of simulated participants' (SPs) educational work. In teaching contexts, the ability to provide feedback to learners is central to their role. Suboptimal feedback practices may deny learners the valuable feedback they need to learn and improve. This scoping review systematically maps the evidence related to SPs' role as educators and identifies how SPs prepare for their role and feedback practices. METHODS The authors conducted a scoping review and included a group of international stakeholders with experience and expertise in SP methodology. Five online databases were systematically searched and ERIC, MedEdPortal and MedEdPublish were hand searched to identify relevant studies. Inclusion/exclusion criteria were developed. Data screening and subsequently data charting were performed in pairs. The results of data charting were thematically analysed including categories relating to the Association of SP Educators (ASPE) Standards of Best Practice (SOBP). RESULTS From 8179 articles identified for the title and abstract screening, 98 studies were included. Studies reported the benefit of SPs' authentic role portrayal and feedback interactions for learners and on the reported learning outcomes. Data was heterogeneous with a notable lack of consistency in the detail regarding the scenario formats for communication skills training interventions, SP characteristics, and approaches to training for feedback and role portrayal. CONCLUSIONS The published literature has considerable heterogeneity in reporting how SPs are prepared for role portrayal and feedback interactions. Additionally, our work has identified gaps in the implementation of the ASPE SOBP, which promotes effective SP-learner feedback interactions. Further research is required to identify effective applications of SP methodology to prepare SPs for their role as educators.
Collapse
Affiliation(s)
- Andrea J Doyle
- RCSI SIM Centre for Simulation Education and Research, RCSI University of Medicine and Health Sciences, Dublin, Ireland
| | - Clare Sullivan
- RCSI SIM Centre for Simulation Education and Research, RCSI University of Medicine and Health Sciences, Dublin, Ireland
| | - Michelle O'Toole
- RCSI SIM Centre for Simulation Education and Research, RCSI University of Medicine and Health Sciences, Dublin, Ireland
| | - Anna Tjin
- RCSI SIM Centre for Simulation Education and Research, RCSI University of Medicine and Health Sciences, Dublin, Ireland
| | - Anastasija Simiceva
- RCSI SIM Centre for Simulation Education and Research, RCSI University of Medicine and Health Sciences, Dublin, Ireland
| | - Naoise Collins
- Department of Visual & Human Centred Computing, Dundalk Institute of Technology, Co. Louth
| | - Paul Murphy
- RCSI Library, RCSI University of Medicine and Health Sciences, Dublin Ireland
| | - Michael J Anderson
- RCSI SIM Centre for Simulation Education and Research, RCSI University of Medicine and Health Sciences, Dublin, Ireland
| | - Claire Mulhall
- RCSI SIM Centre for Simulation Education and Research, RCSI University of Medicine and Health Sciences, Dublin, Ireland
| | - Claire Condron
- RCSI SIM Centre for Simulation Education and Research, RCSI University of Medicine and Health Sciences, Dublin, Ireland
| | - Debra Nestel
- School of Clinical Sciences, Faculty of Medicine, Nursing & Health Sciences, Monash University, Australia
- Department of Surgery, University of Melbourne, Australia
| | - Robert MacAulay
- School of Medicine, University of California San Diego, United States of America
| | - Nancy McNaughton
- The Wilson Centre for Research in Education, Dalla Lana School of Public Health, University of Toronto, Toronto, Canada
| | - Frank Coffey
- DREEAM (Department of Research and Education in Emergency and Acute medicine, Nottingham University Hospitals' NHS Trust)
- School of Health Sciences, University of Nottingham, UK
| | - Walter Eppich
- RCSI SIM Centre for Simulation Education and Research, RCSI University of Medicine and Health Sciences, Dublin, Ireland
| |
Collapse
|
2
|
Piot MA, Dechartres A, Attoe C, Jollant F, Lemogne C, Layat Burn C, Rethans JJ, Michelet D, Cross S, Billon G, Guerrier G, Tesniere A, Falissard B. Simulation in psychiatry for medical doctors: A systematic review and meta-analysis. MEDICAL EDUCATION 2020; 54:696-708. [PMID: 32242966 DOI: 10.1111/medu.14166] [Citation(s) in RCA: 39] [Impact Index Per Article: 9.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/13/2019] [Revised: 03/14/2020] [Accepted: 03/23/2020] [Indexed: 05/06/2023]
Abstract
CONTEXT Most medical doctors are likely to work with patients experiencing mental health conditions. However, educational opportunities for medical doctors to achieve professional development in the field of psychiatry are often limited. Simulation training in psychiatry may be a useful tool to foster this development. OBJECTIVES The purpose of this study was to assess the effectiveness of simulation training in psychiatry for medical students, postgraduate trainees and medical doctors. METHODS For this systematic review and meta-analysis, we searched eight electronic databases and trial registries up to 31 August 2018. We manually searched key journals and the reference lists of selected studies. We included randomised and non-randomised controlled studies and single group pre- and post-test studies. Our main outcomes were based on Kirkpatrick levels. We included data only from randomised controlled trials (RCTs) using random-effects models. RESULTS From 46 571 studies identified, we selected 163 studies and combined 27 RCTs. Interventions included simulation by role-play (n = 69), simulated patients (n = 72), virtual reality (n = 22), manikin (n = 5) and voice simulation (n = 2). Meta-analysis found significant differences at immediate post-tests for simulation compared with active and inactive control groups for attitudes (standardised mean difference [SMD] = 0.52, 95% confidence interval [CI] 0.31-0.73 [I2 = 0.0%] and SMD = 0.28, 95% CI 0.04-0.53 [I2 = 52.0%], respectively), skills (SMD = 1.37, 95% CI 0.56-2.18 [I2 = 93.0%] and SMD = 1.49, 95% CI 0.39-2.58 [I2 = 93.0%], respectively), knowledge (SMD = 1.22, 95% CI 0.57-1.88 [I2 = 0.0%] and SMD = 0.72, 95% CI 0.14-1.30 [I2 = 80.0%], respectively), and behaviours (SMD = 1.07, 95% CI 0.49-1.65 [I2 = 68.0%] and SMD = 0.45, 95% CI 0.11-0.79 [I2 = 41.0%], respectively). Significant differences in terms of patient benefit and doctors' behaviours and skills were found at the 3-month follow-up. CONCLUSIONS Despite heterogeneity in methods and simulation interventions, our findings demonstrate the effectiveness of simulation training in psychiatry training.
Collapse
Affiliation(s)
- Marie-Aude Piot
- Epidemiological and Public Health Research Centre, Villejuif, France
- University of Paris, Faculty of Health, Medicine School, Paris, France
- Department of Psychiatry, Institute Mutualiste Montsouris, Paris, France
- Health Care Simulation Center iLumens, University of Paris, France
| | - Agnès Dechartres
- Sorbonne Université, Institut National de la Santé et de la Recherche Médicale (INSERM), Institut Pierre Louis d'Epidémiologie et de Santé Publique, AP-HP.Sorbonne Université, Hôpital Pitié Salpêtrière, Département de Santé Publique, Paris, France
| | - Chris Attoe
- Maudsley Simulation, South London and Maudsley NHS Foundation Trust, London, UK
| | - Fabrice Jollant
- University of Paris, Faculty of Health, Medicine School, Paris, France
- Department of Psychiatry, GHU Paris Psychiatry and Neurosciences, Sainte-Anne Hospital Center, Paris, France
- Department of Psychiatry, Nîmes Academic Hospital (CHU), Nîmes, France
- Department of Psychiatry, McGill University, Montréal, Québec, Canada
| | - Cédric Lemogne
- University of Paris, Faculty of Health, Medicine School, Paris, France
- University of Paris, INSERM, Institute of Psychiatry and Neurosciences of Paris (IPNP), Paris, France
- AP-HP.Centre-University of Paris, European Georges-Pompidou Hospital, Department of Psychiatry, Paris, France
| | - Carine Layat Burn
- Department of Orthopaedic Surgery, La Providence Hospital, Neuchâtel, Switzerland
- Department of Psychotherapy, Berger Psychotherapeutic Centre, Neuchâtel, Switzerland
| | - Jan-Joost Rethans
- Institute for Education and Skills Lab, Faculty of Health, Medicine and Life Sciences, Maastricht University, the Netherlands
| | - Daphne Michelet
- Health Care Simulation Center iLumens, University of Paris, France
- Department of Pediatric Anesthesia, CHU of Reims Hôpital Maison Blanche, Reims, France
| | - Sean Cross
- Maudsley Simulation, South London and Maudsley NHS Foundation Trust, London, UK
| | - Gregoire Billon
- Maudsley Simulation, South London and Maudsley NHS Foundation Trust, London, UK
| | - Gilles Guerrier
- University of Paris, Faculty of Health, Medicine School, Paris, France
- Health Care Simulation Center iLumens, University of Paris, France
- Department of Anaesthesiology, Cochin Hospital, AP-HP, Paris, France
| | - Antoine Tesniere
- University of Paris, Faculty of Health, Medicine School, Paris, France
- Health Care Simulation Center iLumens, University of Paris, France
| | - Bruno Falissard
- Epidemiological and Public Health Research Centre, Villejuif, France
- Department of Public health, School of Medecine, University Paris Saclay, Villejuif, France
| |
Collapse
|
3
|
Fønhus MS, Dalsbø TK, Johansen M, Fretheim A, Skirbekk H, Flottorp SA. Patient-mediated interventions to improve professional practice. Cochrane Database Syst Rev 2018; 9:CD012472. [PMID: 30204235 PMCID: PMC6513263 DOI: 10.1002/14651858.cd012472.pub2] [Citation(s) in RCA: 40] [Impact Index Per Article: 6.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/14/2022]
Abstract
BACKGROUND Healthcare professionals are important contributors to healthcare quality and patient safety, but their performance does not always follow recommended clinical practice. There are many approaches to influencing practice among healthcare professionals. These approaches include audit and feedback, reminders, educational materials, educational outreach visits, educational meetings or conferences, use of local opinion leaders, financial incentives, and organisational interventions. In this review, we evaluated the effectiveness of patient-mediated interventions. These interventions are aimed at changing the performance of healthcare professionals through interactions with patients, or through information provided by or to patients. Examples of patient-mediated interventions include 1) patient-reported health information, 2) patient information, 3) patient education, 4) patient feedback about clinical practice, 5) patient decision aids, 6) patients, or patient representatives, being members of a committee or board, and 7) patient-led training or education of healthcare professionals. OBJECTIVES To assess the effectiveness of patient-mediated interventions on healthcare professionals' performance (adherence to clinical practice guidelines or recommendations for clinical practice). SEARCH METHODS We searched MEDLINE, Ovid in March 2018, Cochrane Central Register of Controlled Trials (CENTRAL) in March 2017, and ClinicalTrials.gov and the International Clinical Trials Registry (ICTRP) in September 2017, and OpenGrey, the Grey Literature Report and Google Scholar in October 2017. We also screened the reference lists of included studies and conducted cited reference searches for all included studies in October 2017. SELECTION CRITERIA Randomised studies comparing patient-mediated interventions to either usual care or other interventions to improve professional practice. DATA COLLECTION AND ANALYSIS Two review authors independently assessed studies for inclusion, extracted data and assessed risk of bias. We calculated the risk ratio (RR) for dichotomous outcomes using Mantel-Haenszel statistics and the random-effects model. For continuous outcomes, we calculated the mean difference (MD) using inverse variance statistics. Two review authors independently assessed the certainty of the evidence (GRADE). MAIN RESULTS We included 25 studies with a total of 12,268 patients. The number of healthcare professionals included in the studies ranged from 12 to 167 where this was reported. The included studies evaluated four types of patient-mediated interventions: 1) patient-reported health information interventions (for instance information obtained from patients about patients' own health, concerns or needs before a clinical encounter), 2) patient information interventions (for instance, where patients are informed about, or reminded to attend recommended care), 3) patient education interventions (intended to increase patients' knowledge about their condition and options of care, for instance), and 4) patient decision aids (where the patient is provided with information about treatment options including risks and benefits). For each type of patient-mediated intervention a separate meta-analysis was produced.Patient-reported health information interventions probably improve healthcare professionals' adherence to recommended clinical practice (moderate-certainty evidence). We found that for every 100 patients consulted or treated, 26 (95% CI 23 to 30) are in accordance with recommended clinical practice compared to 17 per 100 in the comparison group (no intervention or usual care). We are uncertain about the effect of patient-reported health information interventions on desirable patient health outcomes and patient satisfaction (very low-certainty evidence). Undesirable patient health outcomes and adverse events were not reported in the included studies and resource use was poorly reported.Patient information interventions may improve healthcare professionals' adherence to recommended clinical practice (low-certainty evidence). We found that for every 100 patients consulted or treated, 32 (95% CI 24 to 42) are in accordance with recommended clinical practice compared to 20 per 100 in the comparison group (no intervention or usual care). Patient information interventions may have little or no effect on desirable patient health outcomes and patient satisfaction (low-certainty evidence). We are uncertain about the effect of patient information interventions on undesirable patient health outcomes because the certainty of the evidence is very low. Adverse events and resource use were not reported in the included studies.Patient education interventions probably improve healthcare professionals' adherence to recommended clinical practice (moderate-certainty evidence). We found that for every 100 patients consulted or treated, 46 (95% CI 39 to 54) are in accordance with recommended clinical practice compared to 35 per 100 in the comparison group (no intervention or usual care). Patient education interventions may slightly increase the number of patients with desirable health outcomes (low-certainty evidence). Undesirable patient health outcomes, patient satisfaction, adverse events and resource use were not reported in the included studies.Patient decision aid interventions may have little or no effect on healthcare professionals' adherence to recommended clinical practice (low-certainty evidence). We found that for every 100 patients consulted or treated, 32 (95% CI 24 to 43) are in accordance with recommended clinical practice compared to 37 per 100 in the comparison group (usual care). Patient health outcomes, patient satisfaction, adverse events and resource use were not reported in the included studies. AUTHORS' CONCLUSIONS We found that two types of patient-mediated interventions, patient-reported health information and patient education, probably improve professional practice by increasing healthcare professionals' adherence to recommended clinical practice (moderate-certainty evidence). We consider the effect to be small to moderate. Other patient-mediated interventions, such as patient information may also improve professional practice (low-certainty evidence). Patient decision aids may make little or no difference to the number of healthcare professionals' adhering to recommended clinical practice (low-certainty evidence).The impact of these interventions on patient health and satisfaction, adverse events and resource use, is more uncertain mostly due to very low certainty evidence or lack of evidence.
Collapse
Affiliation(s)
- Marita S Fønhus
- Norwegian Institute of Public HealthPO Box 4404, NydalenOsloNorwayN‐0403
| | - Therese K Dalsbø
- Norwegian Institute of Public HealthPO Box 4404, NydalenOsloNorwayN‐0403
| | - Marit Johansen
- Norwegian Institute of Public HealthPO Box 4404, NydalenOsloNorwayN‐0403
| | - Atle Fretheim
- Norwegian Institute of Public HealthPO Box 4404, NydalenOsloNorwayN‐0403
| | - Helge Skirbekk
- Norwegian National Advisory Unit on Learning and Mastery in Health, Oslo University HospitalOsloNorway0586
- Institute of Health and Society, Medical Faculty, University of OsloDepartment of Health Management and Health EconomicsOsloNorway
| | - Signe A. Flottorp
- Norwegian Institute of Public HealthPO Box 4404, NydalenOsloNorwayN‐0403
| | | |
Collapse
|
4
|
Kokotailo PK, Baltag V, Sawyer SM. Educating and Training the Future Adolescent Health Workforce. J Adolesc Health 2018; 62:511-524. [PMID: 29472128 DOI: 10.1016/j.jadohealth.2017.11.299] [Citation(s) in RCA: 22] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/16/2017] [Revised: 10/23/2017] [Accepted: 11/14/2017] [Indexed: 10/18/2022]
Abstract
Unprecedented attention is now focused on adolescents with growing appreciation of their disease burden and of the opportunities of investing in adolescent health. New investments are required to build the technical capacity for policy, programming, research, and clinical care across the world, especially in resource-poor settings where most adolescents live. Strategies to educate and train the future workforce are needed. Competency-based education and training is the standard of education in preservice (undergraduate and postgraduate) health education and medical specialty training. Yet competency is difficult to quantify and standardize, as are the processes that underpin competency-based education and training. The primary objective of this review was to identify how quality education in adolescent health and medicine is determined. This information was used to inform the development of a conceptual framework for institutions teaching adolescent health, which can be used to assess the quality of teaching and learning and to monitor the implementation of these adolescent health competencies. Specific teaching modalities and assessment tools that have been used to teach adolescent health are described to exemplify how an educational program can be delivered and assessed. This framework is a step toward the development of a more adolescent-competent health workforce.
Collapse
Affiliation(s)
- Patricia K Kokotailo
- Department of Pediatrics, University of Wisconsin-Madison School of Medicine and Public Health, Madison, Wisconsin.
| | - Valentina Baltag
- World Health Organization, Department of Maternal, Newborn, Child and Adolescent Health, Geneva, Switzerland
| | - Susan M Sawyer
- Centre for Adolescent Health, Royal Children's Hospital; Department of Paediatrics, The University of Melbourne; Murdoch Childrens Research Institute, Melbourne, Victoria, Australia
| |
Collapse
|
5
|
DiVasta AD, Trudell EK, Francis M, Focht G, Jooma F, Vernacchio L, Forman SF. Practice-Based Quality Improvement Collaborative to Increase Chlamydia Screening in Young Women. Pediatrics 2016; 137:peds.2015-1082. [PMID: 27244777 DOI: 10.1542/peds.2015-1082] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Accepted: 11/16/2015] [Indexed: 11/24/2022] Open
Abstract
BACKGROUND AND OBJECTIVE Chlamydia trachomatis infections are common among sexually active young women. We developed a practice-based quality improvement (QI) collaborative to increase Chlamydia screening in at-risk young women. METHODS Structured data fields were integrated into the electronic record for practices affiliated with Boston Children's Hospital. A learning community (LC) was developed. Content included the adolescent well visit, assessment of sexual/risk behaviors, epidemiology of sexually transmitted diseases, and screening methods. The QI initiative effectiveness was assessed by comparing preintervention and postintervention rates of Chlamydia screening by using statistical process control analyses and logistic regressions. RESULTS LC participants demonstrated significant increases in recommended Chlamydia screening, as illustrated by using Healthcare Effectiveness Data and Information Set (HEDIS) screening rates (LC1: 52.8% preintervention vs 66.7% postintervention [P < .0001]; LC2: 57.8% preintervention vs 69.3% postintervention [P < .0001]). Participating practices reported total improvements larger than nonparticipating practices (13.9% LC1, 11.5% LC2, and 7.8% nonparticipants). QI and LC efforts also led to increased documentation of sexual activity status in the record (LC1: 61.2% preintervention to 91.2% postintervention [P < .0001]; LC2: 43.3% preintervention to 61.2% postintervention [P < .0001]). Nonparticipating practices were more likely to perform indiscriminate screening. CONCLUSIONS Through our QI and LC efforts, statistically and clinically meaningful improvements in Chlamydia screening rates were attained. Differences in rates of improvement indicate that LC participation likely had effects beyond electronic medical record changes alone. During the project time frame, national HEDIS screening rates remained unchanged, suggesting that the observed improvements were related to the interventions and not to a national trend. As a result of QI tools provided through the LCs, HEDIS screening goals were achieved in a primary care setting.
Collapse
Affiliation(s)
- Amy D DiVasta
- Divisions of Adolescent Medicine and Department of Pediatrics, Harvard Medical School, Boston, Massachusetts; and
| | - Emily K Trudell
- Pediatric Physicians' Organization at Children's, Brookline, Massachusetts
| | - Mary Francis
- Pediatric Physicians' Organization at Children's, Brookline, Massachusetts
| | - Glenn Focht
- Pediatric Physicians' Organization at Children's, Brookline, Massachusetts
| | - Farah Jooma
- Pediatric Physicians' Organization at Children's, Brookline, Massachusetts
| | - Louis Vernacchio
- Department of Pediatrics, Harvard Medical School, Boston, Massachusetts; and Pediatric Physicians' Organization at Children's, Brookline, Massachusetts Division of General Pediatrics, Boston Children's Hospital, Boston, Massachusetts
| | - Sara F Forman
- Divisions of Adolescent Medicine and Department of Pediatrics, Harvard Medical School, Boston, Massachusetts; and
| |
Collapse
|
6
|
Taylor MM, Frasure-Williams J, Burnett P, Park IU. Interventions to Improve Sexually Transmitted Disease Screening in Clinic-Based Settings. Sex Transm Dis 2016; 43:S28-41. [PMID: 26779685 PMCID: PMC6751565 DOI: 10.1097/olq.0000000000000294] [Citation(s) in RCA: 39] [Impact Index Per Article: 4.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
Abstract
BACKGROUND The asymptomatic nature and suboptimal screening rates of sexually transmitted diseases (STD) call for implementation of successful interventions to improve screening in community-based clinic settings with attention to cost and resources. METHODS We used MEDLINE to systematically review comparative analyses of interventions to improve STD (chlamydia, gonorrhea, or syphilis) screening or rescreening in clinic-based settings that were published between January 2000 and January 2014. Absolute differences in the percent of the target population screened between comparison groups or relative percent increase in the number of tests or patients tested were used to score the interventions as highly effective (>20% increase) or moderately effective (5%-19% increase) in improving screening. Published cost of the interventions was described where available and, when not available, was estimated. RESULTS Of the 4566 citations reviewed, 38 articles describing 42 interventions met the inclusion criteria. Of the 42 interventions, 16 (38.1%) were categorized as highly effective and 14 (33.3%) as moderately effective. Effective low-cost interventions (<$1000) included the strategic placement of specimen collection materials or automatic collection of STD specimens as part of a routine visit (7 highly effective and 1 moderately effective) and the use of electronic health records (EHRs; 3 highly effective and 4 moderately effective). Patient reminders for screening or rescreening (via text, telephone, and postcards) were highly effective (3) or moderately effective (2) and low or moderate cost (<$1001-10,000). Interventions with dedicated clinic staff to improve STD screening were highly effective (2) or moderately effective in improving STD screening (1) but high-cost ($10,001-$100,000). CONCLUSIONS Successful interventions include changing clinic flow to routinely collect specimens for testing, using EHR screening reminders, and reminding patients to get screened or rescreened. These strategies can be tailored to different clinic settings to improve screening at a low cost.
Collapse
Affiliation(s)
- Melanie M Taylor
- From the *Division of STD Prevention, Centers for Disease Control and Prevention (CDC), Atlanta, GA; †Arizona Department of Health Services, STD Program, Phoenix, AZ; ‡STD Control Branch, Division of Communicable Disease Control (DCDC), Center for Infectious Diseases (CID), California Department of Public Health (CDPH), Sacramento, CA; and §Baltimore Department of Public Health, Baltimore, MD
| | | | | | | |
Collapse
|