An educational intervention to increase internists' confidence with and provision of preventive services to adolescents and young adults

Training simulated participants for role portrayal and feedback practices in communication skills training: A BEME scoping review: BEME Guide No. 86

BACKGROUND

Providing feedback is a key aspect of simulated participants' (SPs) educational work. In teaching contexts, the ability to provide feedback to learners is central to their role. Suboptimal feedback practices may deny learners the valuable feedback they need to learn and improve. This scoping review systematically maps the evidence related to SPs' role as educators and identifies how SPs prepare for their role and feedback practices.

METHODS

The authors conducted a scoping review and included a group of international stakeholders with experience and expertise in SP methodology. Five online databases were systematically searched and ERIC, MedEdPortal and MedEdPublish were hand searched to identify relevant studies. Inclusion/exclusion criteria were developed. Data screening and subsequently data charting were performed in pairs. The results of data charting were thematically analysed including categories relating to the Association of SP Educators (ASPE) Standards of Best Practice (SOBP).

RESULTS

From 8179 articles identified for the title and abstract screening, 98 studies were included. Studies reported the benefit of SPs' authentic role portrayal and feedback interactions for learners and on the reported learning outcomes. Data was heterogeneous with a notable lack of consistency in the detail regarding the scenario formats for communication skills training interventions, SP characteristics, and approaches to training for feedback and role portrayal.

CONCLUSIONS

The published literature has considerable heterogeneity in reporting how SPs are prepared for role portrayal and feedback interactions. Additionally, our work has identified gaps in the implementation of the ASPE SOBP, which promotes effective SP-learner feedback interactions. Further research is required to identify effective applications of SP methodology to prepare SPs for their role as educators.

Simulation in psychiatry for medical doctors: A systematic review and meta-analysis

CONTEXT

Most medical doctors are likely to work with patients experiencing mental health conditions. However, educational opportunities for medical doctors to achieve professional development in the field of psychiatry are often limited. Simulation training in psychiatry may be a useful tool to foster this development.

OBJECTIVES

The purpose of this study was to assess the effectiveness of simulation training in psychiatry for medical students, postgraduate trainees and medical doctors.

METHODS

For this systematic review and meta-analysis, we searched eight electronic databases and trial registries up to 31 August 2018. We manually searched key journals and the reference lists of selected studies. We included randomised and non-randomised controlled studies and single group pre- and post-test studies. Our main outcomes were based on Kirkpatrick levels. We included data only from randomised controlled trials (RCTs) using random-effects models.

RESULTS

From 46 571 studies identified, we selected 163 studies and combined 27 RCTs. Interventions included simulation by role-play (n = 69), simulated patients (n = 72), virtual reality (n = 22), manikin (n = 5) and voice simulation (n = 2). Meta-analysis found significant differences at immediate post-tests for simulation compared with active and inactive control groups for attitudes (standardised mean difference [SMD] = 0.52, 95% confidence interval [CI] 0.31-0.73 [I²  = 0.0%] and SMD = 0.28, 95% CI 0.04-0.53 [I²  = 52.0%], respectively), skills (SMD = 1.37, 95% CI 0.56-2.18 [I²  = 93.0%] and SMD = 1.49, 95% CI 0.39-2.58 [I²  = 93.0%], respectively), knowledge (SMD = 1.22, 95% CI 0.57-1.88 [I²  = 0.0%] and SMD = 0.72, 95% CI 0.14-1.30 [I²  = 80.0%], respectively), and behaviours (SMD = 1.07, 95% CI 0.49-1.65 [I²  = 68.0%] and SMD = 0.45, 95% CI 0.11-0.79 [I²  = 41.0%], respectively). Significant differences in terms of patient benefit and doctors' behaviours and skills were found at the 3-month follow-up.

CONCLUSIONS

Despite heterogeneity in methods and simulation interventions, our findings demonstrate the effectiveness of simulation training in psychiatry training.

Patient-mediated interventions to improve professional practice

BACKGROUND

Healthcare professionals are important contributors to healthcare quality and patient safety, but their performance does not always follow recommended clinical practice. There are many approaches to influencing practice among healthcare professionals. These approaches include audit and feedback, reminders, educational materials, educational outreach visits, educational meetings or conferences, use of local opinion leaders, financial incentives, and organisational interventions. In this review, we evaluated the effectiveness of patient-mediated interventions. These interventions are aimed at changing the performance of healthcare professionals through interactions with patients, or through information provided by or to patients. Examples of patient-mediated interventions include 1) patient-reported health information, 2) patient information, 3) patient education, 4) patient feedback about clinical practice, 5) patient decision aids, 6) patients, or patient representatives, being members of a committee or board, and 7) patient-led training or education of healthcare professionals.

OBJECTIVES

To assess the effectiveness of patient-mediated interventions on healthcare professionals' performance (adherence to clinical practice guidelines or recommendations for clinical practice).

SEARCH METHODS

We searched MEDLINE, Ovid in March 2018, Cochrane Central Register of Controlled Trials (CENTRAL) in March 2017, and ClinicalTrials.gov and the International Clinical Trials Registry (ICTRP) in September 2017, and OpenGrey, the Grey Literature Report and Google Scholar in October 2017. We also screened the reference lists of included studies and conducted cited reference searches for all included studies in October 2017.

SELECTION CRITERIA

Randomised studies comparing patient-mediated interventions to either usual care or other interventions to improve professional practice.

DATA COLLECTION AND ANALYSIS

Two review authors independently assessed studies for inclusion, extracted data and assessed risk of bias. We calculated the risk ratio (RR) for dichotomous outcomes using Mantel-Haenszel statistics and the random-effects model. For continuous outcomes, we calculated the mean difference (MD) using inverse variance statistics. Two review authors independently assessed the certainty of the evidence (GRADE).

MAIN RESULTS

We included 25 studies with a total of 12,268 patients. The number of healthcare professionals included in the studies ranged from 12 to 167 where this was reported. The included studies evaluated four types of patient-mediated interventions: 1) patient-reported health information interventions (for instance information obtained from patients about patients' own health, concerns or needs before a clinical encounter), 2) patient information interventions (for instance, where patients are informed about, or reminded to attend recommended care), 3) patient education interventions (intended to increase patients' knowledge about their condition and options of care, for instance), and 4) patient decision aids (where the patient is provided with information about treatment options including risks and benefits). For each type of patient-mediated intervention a separate meta-analysis was produced.Patient-reported health information interventions probably improve healthcare professionals' adherence to recommended clinical practice (moderate-certainty evidence). We found that for every 100 patients consulted or treated, 26 (95% CI 23 to 30) are in accordance with recommended clinical practice compared to 17 per 100 in the comparison group (no intervention or usual care). We are uncertain about the effect of patient-reported health information interventions on desirable patient health outcomes and patient satisfaction (very low-certainty evidence). Undesirable patient health outcomes and adverse events were not reported in the included studies and resource use was poorly reported.Patient information interventions may improve healthcare professionals' adherence to recommended clinical practice (low-certainty evidence). We found that for every 100 patients consulted or treated, 32 (95% CI 24 to 42) are in accordance with recommended clinical practice compared to 20 per 100 in the comparison group (no intervention or usual care). Patient information interventions may have little or no effect on desirable patient health outcomes and patient satisfaction (low-certainty evidence). We are uncertain about the effect of patient information interventions on undesirable patient health outcomes because the certainty of the evidence is very low. Adverse events and resource use were not reported in the included studies.Patient education interventions probably improve healthcare professionals' adherence to recommended clinical practice (moderate-certainty evidence). We found that for every 100 patients consulted or treated, 46 (95% CI 39 to 54) are in accordance with recommended clinical practice compared to 35 per 100 in the comparison group (no intervention or usual care). Patient education interventions may slightly increase the number of patients with desirable health outcomes (low-certainty evidence). Undesirable patient health outcomes, patient satisfaction, adverse events and resource use were not reported in the included studies.Patient decision aid interventions may have little or no effect on healthcare professionals' adherence to recommended clinical practice (low-certainty evidence). We found that for every 100 patients consulted or treated, 32 (95% CI 24 to 43) are in accordance with recommended clinical practice compared to 37 per 100 in the comparison group (usual care). Patient health outcomes, patient satisfaction, adverse events and resource use were not reported in the included studies.

AUTHORS' CONCLUSIONS

We found that two types of patient-mediated interventions, patient-reported health information and patient education, probably improve professional practice by increasing healthcare professionals' adherence to recommended clinical practice (moderate-certainty evidence). We consider the effect to be small to moderate. Other patient-mediated interventions, such as patient information may also improve professional practice (low-certainty evidence). Patient decision aids may make little or no difference to the number of healthcare professionals' adhering to recommended clinical practice (low-certainty evidence).The impact of these interventions on patient health and satisfaction, adverse events and resource use, is more uncertain mostly due to very low certainty evidence or lack of evidence.

Educating and Training the Future Adolescent Health Workforce

Unprecedented attention is now focused on adolescents with growing appreciation of their disease burden and of the opportunities of investing in adolescent health. New investments are required to build the technical capacity for policy, programming, research, and clinical care across the world, especially in resource-poor settings where most adolescents live. Strategies to educate and train the future workforce are needed. Competency-based education and training is the standard of education in preservice (undergraduate and postgraduate) health education and medical specialty training. Yet competency is difficult to quantify and standardize, as are the processes that underpin competency-based education and training. The primary objective of this review was to identify how quality education in adolescent health and medicine is determined. This information was used to inform the development of a conceptual framework for institutions teaching adolescent health, which can be used to assess the quality of teaching and learning and to monitor the implementation of these adolescent health competencies. Specific teaching modalities and assessment tools that have been used to teach adolescent health are described to exemplify how an educational program can be delivered and assessed. This framework is a step toward the development of a more adolescent-competent health workforce.

Practice-Based Quality Improvement Collaborative to Increase Chlamydia Screening in Young Women

BACKGROUND AND OBJECTIVE

Chlamydia trachomatis infections are common among sexually active young women. We developed a practice-based quality improvement (QI) collaborative to increase Chlamydia screening in at-risk young women.

METHODS

Structured data fields were integrated into the electronic record for practices affiliated with Boston Children's Hospital. A learning community (LC) was developed. Content included the adolescent well visit, assessment of sexual/risk behaviors, epidemiology of sexually transmitted diseases, and screening methods. The QI initiative effectiveness was assessed by comparing preintervention and postintervention rates of Chlamydia screening by using statistical process control analyses and logistic regressions.

RESULTS

LC participants demonstrated significant increases in recommended Chlamydia screening, as illustrated by using Healthcare Effectiveness Data and Information Set (HEDIS) screening rates (LC1: 52.8% preintervention vs 66.7% postintervention [P < .0001]; LC2: 57.8% preintervention vs 69.3% postintervention [P < .0001]). Participating practices reported total improvements larger than nonparticipating practices (13.9% LC1, 11.5% LC2, and 7.8% nonparticipants). QI and LC efforts also led to increased documentation of sexual activity status in the record (LC1: 61.2% preintervention to 91.2% postintervention [P < .0001]; LC2: 43.3% preintervention to 61.2% postintervention [P < .0001]). Nonparticipating practices were more likely to perform indiscriminate screening.

CONCLUSIONS

Through our QI and LC efforts, statistically and clinically meaningful improvements in Chlamydia screening rates were attained. Differences in rates of improvement indicate that LC participation likely had effects beyond electronic medical record changes alone. During the project time frame, national HEDIS screening rates remained unchanged, suggesting that the observed improvements were related to the interventions and not to a national trend. As a result of QI tools provided through the LCs, HEDIS screening goals were achieved in a primary care setting.

Interventions to Improve Sexually Transmitted Disease Screening in Clinic-Based Settings

BACKGROUND

The asymptomatic nature and suboptimal screening rates of sexually transmitted diseases (STD) call for implementation of successful interventions to improve screening in community-based clinic settings with attention to cost and resources.

METHODS

We used MEDLINE to systematically review comparative analyses of interventions to improve STD (chlamydia, gonorrhea, or syphilis) screening or rescreening in clinic-based settings that were published between January 2000 and January 2014. Absolute differences in the percent of the target population screened between comparison groups or relative percent increase in the number of tests or patients tested were used to score the interventions as highly effective (>20% increase) or moderately effective (5%-19% increase) in improving screening. Published cost of the interventions was described where available and, when not available, was estimated.

RESULTS

Of the 4566 citations reviewed, 38 articles describing 42 interventions met the inclusion criteria. Of the 42 interventions, 16 (38.1%) were categorized as highly effective and 14 (33.3%) as moderately effective. Effective low-cost interventions (<$1000) included the strategic placement of specimen collection materials or automatic collection of STD specimens as part of a routine visit (7 highly effective and 1 moderately effective) and the use of electronic health records (EHRs; 3 highly effective and 4 moderately effective). Patient reminders for screening or rescreening (via text, telephone, and postcards) were highly effective (3) or moderately effective (2) and low or moderate cost (<$1001-10,000). Interventions with dedicated clinic staff to improve STD screening were highly effective (2) or moderately effective in improving STD screening (1) but high-cost ($10,001-$100,000).

CONCLUSIONS

Successful interventions include changing clinic flow to routinely collect specimens for testing, using EHR screening reminders, and reminding patients to get screened or rescreened. These strategies can be tailored to different clinic settings to improve screening at a low cost.