Simulation-based assessments in health professional education: a systematic review

Initial Experience of Using First-Person Wearable Video Recording Technology During Central Venous Catheter Placement in the Cardiac Operating Room

OBJECTIVE

The aim of this study was to use wearable video-recording technology to measure precisely the timing of discrete events during perioperative central venous catheter (CVC) placements.

DESIGN

A single-center, observational, exploratory study on the use of wearable video-recording technology during intraoperative CVC placement.

SETTING

The study was conducted at a University Hospital.

PARTICIPANTS

Clinical anesthesia residents, cardiothoracic anesthesia fellows, and attending anesthesiologists participated in this study.

INTERVENTIONS

Participants were asked to use eye-tracking glasses prior to the placement of a CVC in the cardiac operating rooms. No other instruction was given to the participants.

MEASUREMENTS AND MAIN RESULTS

The authors measured the total time to complete the CVC placement, phase-specific time, and specific times of interest. They compared these times across 3 training levels and tested differences with analysis of variance. The authors' findings indicated significant differences in total CVC placement time when the procedure included a pulmonary artery catheter insertion (1,170 ± 364, 923 ± 272, and 596 ± 226 seconds; F2,63 = 12.71, p < 0.0001). Additionally, they found differences in interval times and times of interest. The authors observed a reduction of variability with increasing experience during the CVC placement phase.

CONCLUSIONS

In this observational study, the study authors describe their experience using first-person wearable video-recording technology to precisely measure the timing of discrete events during CVC placement by anesthesia residents and anesthesiologists. Future work will leverage the eye-tracking capabilities of the existing hardware to identify areas of inefficiency to develop actionable targets for interventions that could improve trainee performance and patient safety.

Simulation in contemporary medical education: Current practices and the way forward

Integration of theoretical knowledge and practical skills is critical for effective medical education. Simulation is crucial in bridging the gap to prepare medical professionals for high-quality patient care in a safe environment. Simulation-based teaching has become the standard practice in medical education, especially in postgraduate courses like Anaesthesia. However, undergraduate medical education and other doctoral courses are still nascent. In line with the current National Medical Commission guidelines, it is imperative to complement the existing curriculum with a simulation-based approach as early as the first year of medical school. This review focuses on the current practices related to simulation-based medical education during undergraduate and postgraduate courses, particularly on anaesthesiology. We aim to discuss different types of simulation, the advantages of integration, students' perspectives, and the role of simulation in assessment and feedback. Finally, recommendations for future advancements of simulation in medical education and the way forward will be laid.

Untapped resource: the simulation-based healthcare environment as a means to study human stress

The effects of 'stress' within the healthcare professions are wide-reaching, not least of all within the field of simulation-based healthcare education. Whilst this popular method of experiential learning offers a 'safe space' for participants to develop their skillset, it also has a more surreptitious action; namely, the incubation of simulation-related stress. Currently, research concerning the complex relationship between stress, learning, and performance is ambiguous, leaving fertile ground for simulationists to debate what level of stress is appropriate for an optimised educational experience. In this narrative review, we examine the human response to stress and outline the various methods that have been used by researchers to measure stress in a quantifiable and standardised way. We then provide a brief overview of simulation-based healthcare education before describing why stress responses have been of interest to healthcare educationalists for some time. Finally, we outline how simulation education environments might provide an ideal environment for studying the human response to stress generally, with ramifications extending beyond the field of medical education.

Simulation training in suicide risk assessment and intervention: a systematic review and meta-analysis

PURPOSE

Suicide is a major cause of preventable death worldwide. Adequate training in risk assessment and intervention is key to suicide prevention. The use of simulation (role plays, simulated patients, virtual reality…) for practical training is a promising tool in mental health. The purpose of this study was to assess the effectiveness of simulation training in suicide risk assessment and intervention for healthcare professionals and gatekeepers.

METHODS

We conducted a systematic review in Medline and PsycINFO up to 31 July 2021 of randomized controlled trials (RCTs), non-randomized controlled trials, and pre/post-test studies. RCTs were furthermore included in a meta-analysis. We assessed the methodological quality of all studies with the Medical Education Research Study Quality Instrument, and the Cochrane Risk of Bias tool 2.0 for RCTs. Primary outcomes were changes in Kirkpatrick criteria: attitudes, skills, knowledge, behaviors, and patient outcomes.

RESULTS

We included 96 articles representing 43,656 participants. Most pre/post-test (n = 65) and non-randomized controlled (n = 14) studies showed significant improvement in attitudes, skills, knowledge, and behaviors. The meta-analysis of 11 RCTs showed positive changes in attitudes immediately after training and at 2-4 months post-training; in self-perceived skills at 6 months post-training; but not in factual knowledge. Studies assessing benefits for patients are still limited.

CONCLUSIONS

The heterogeneity of methodological designs, interventions, and trained populations combined with a limited number of RCTs and studies on patients' outcomes limit the strength of the evidence. However, preliminary findings suggest that simulation is promising for practical training in suicidal crisis intervention and should be further studied.

Assessment of learning in simulator-based arthroscopy training with the diagnostic arthroscopy skill score (DASS) and neurophysiological measures

PURPOSE

Virtual arthroscopic training has become increasingly popular. However, there is a lack of efficiency-based tracking of the trainee, which may be critical for determining the specifics of training programs and adapting them for the needs of each trainee. This study aims to evaluate and compare the measures obtained with a non-invasive neurophysiological method with The Diagnostic Arthroscopy Skill Score (DASS), a commonly used assessment tool for evaluating arthroscopic skills.

METHODS

The study collected simulator performance scores, consisting of "Triangulation Right Hand", "Triangulation Left Hand", "Catch the Stars" and "Three Rings" and DASS scores from 22 participants (11 novices, 11 experts). These scores were obtained while participants underwent a structured program of exercises for the fundamentals of arthroscopic surgery training (FAST) and knee module using a simulator-based arthroscopy device. During the evaluation, data on oxy-hemoglobin and deoxy-hemoglobin levels in the prefrontal cortex were collected using the Functional Near-Infrared Spectroscopy (fNIRS) imaging system. Performance scores, DASS scores, and fNIRS data were subsequently analyzed to determine any correlation between performance and cortex activity.

RESULTS

The simulator performance scores and the DASSPart2 scores were significantly higher in the expert group compared to the novice group (200.1 ± 28.5 vs 172.5 ± 48.9, p = 0.04 and 9.4 ± 5.6 vs. 5.4 ± 5.6 p = 0.02). In the expert group, fNIRS data showed a significantly lower prefrontal cortex activation during fundamental tasks in the FAST module, indicating significantly more efficient mental resource use.

CONCLUSION

The analysis of cognitive workload changes during simulation-based arthroscopy training revealed a significant correlation between the trainees' DASS scores and fNIRS data. This correlation suggests the potential use of fNIRS data and DASS scores as additional metrics to create adaptive training protocols for each participant. By incorporating these metrics, the training process can be optimized, leading to more efficient arthroscopic training and better preparedness for clinical operations.

LEVEL OF EVIDENCE

III.

Diagnostic Reasoning Competency and Accuracy by Nurse Practitioner Students Following the Use of Structured Reflection in Simulation: A Mixed-Methods Experiment

AIM

The aim of this study was to examine the effect of structured reflection used during a simulated patient's diagnostic workup on diagnostic reasoning competency and accuracy and explore participants' cognitive bias experience and perceived utility of structured reflection.

BACKGROUND

Reasoning flaws may lead to diagnostic errors. Medical learners who used structured reflection demonstrated improved diagnosis accuracy.

METHOD

Embedded mixed-methods experiment examined diagnostic reasoning competency and accuracy of nurse practitioner students who did and did not use structured reflection. Cognitive bias experience and perceptions of structured reflection's utility were explored.

RESULTS

Diagnostic Reasoning Assessment mean competency scores and categories were not changed. Accuracy trended toward improvement with structured reflection. The theme, diagnostic verification, prompted diagnosis change by both structured reflection users and control participants.

CONCLUSION

Despite no changes in quantitative outcomes, explicit users of structured reflection believed that this strategy is helpful to their reasoning, and control participants used the strategy's components with the same noted benefits.

Diagnosing virtual patients: the interplay between knowledge and diagnostic activities

Clinical reasoning theories agree that knowledge and the diagnostic process are associated with diagnostic success. However, the exact contributions of these components of clinical reasoning to diagnostic success remain unclear. This is particularly the case when operationalizing the diagnostic process with diagnostic activities (i.e., teachable practices that generate knowledge). Therefore, we conducted a study investigating to what extent knowledge and diagnostic activities uniquely explain variance in diagnostic success with virtual patients among medical students. The sample consisted of N = 106 medical students in their third to fifth year of university studies in Germany (6-years curriculum). Participants completed professional knowledge tests before diagnosing virtual patients. Diagnostic success with the virtual patients was assessed with diagnostic accuracy as well as a comprehensive diagnostic score to answer the call for more extensive measurement of clinical reasoning outcomes. The three diagnostic activities hypothesis generation, evidence generation, and evidence evaluation were tracked. Professional knowledge predicted performance in terms of the comprehensive diagnostic score and displayed a small association with diagnostic accuracy. Diagnostic activities predicted comprehensive diagnostic score and diagnostic accuracy. Hierarchical regressions showed that the diagnostic activities made a unique contribution to diagnostic success, even when knowledge was taken into account. Our results support the argument that the diagnostic process is more than an embodiment of knowledge and explains variance in diagnostic success over and above knowledge. We discuss possible mechanisms explaining this finding.

Improvement in medical students' knowledge on chronic pain assessment through integrative learning approaches: a randomized controlled trial

Introduction

This study aimed to compare the knowledge and skills of medical students in chronic pain assessment after being trained using the PQRST (P, provoke and palliate; Q, quality; R, region and radiation; S, severity; T, time) and ACT-UP (A, activity; C, coping; T, think; U, upset; P, people) mnemonics with those using only the PQRST mnemonic.

Methods

A double-blind, randomized controlled trial was conducted at the Faculty of Medicine, Universitas Indonesia, including forty students who participated in a simulation-based chronic pain assessment workshop. Pre- and post-test scores were used to assess participants' knowledge. Two independent raters assessed the students' skills.

Results

No significant differences in knowledge or skills were observed between the groups; however, a significant improvement in the post-test scores (85.71 [71.43-95.24]) compared to the pre-test scores (61.90 [25.87-90.48]) was observed. The students reported high satisfaction with the workshop.

Conclusions

Training with the PQRST and ACT-UP mnemonics is not better than training with the PQRST mnemonic alone in improving students' knowledge and skills in chronic pain assessment. Nevertheless, this pain education workshop was beneficial for student learning. Learning of patient-oriented chronic pain assessment should be provided in a repetitive and integrative fashion using different approaches, such as lectures, demonstrations, simulations, and interactions with patients experiencing chronic pain. To conclude, mnemonics are helpful but not a primary learning tool.

Automating medical simulations

OBJECTIVE

This study aims to explore speech as an alternative modality for human activity recognition (HAR) in medical settings. While current HAR technologies rely on video and sensory modalities, they are often unsuitable for the medical environment due to interference from medical personnel, privacy concerns, and environmental limitations. Therefore, we propose an end-to-end, fully automatic objective checklist validation framework that utilizes medical personnel's uttered speech to recognize and document the executed actions in a checklist format.

METHODS

Our framework records, processes, and analyzes medical personnel's speech to extract valuable information about performed actions. This information is then used to fill the corresponding rubrics in the checklist automatically.

RESULTS

Our approach to activity recognition outperformed the online expert examiner, achieving an F1 score of 0.869 on verbal tasks and an ICC score of 0.822 with an offline examiner. Furthermore, the framework successfully identified communication failures and medical errors made by physicians and nurses.

CONCLUSION

Implementing a speech-based framework in medical settings, such as the emergency room and operation room, holds promise for improving care delivery and enabling the development of automated assistive technologies in various medical domains. By leveraging speech as a modality for HAR, we can overcome the limitations of existing technologies and enhance workflow efficiency and patient safety.

Implementing an Experiential Telehealth Training and Needs Assessment for Residents and Faculty at a Veterans Affairs Primary Care Clinic

Background

The transition to telehealth during the COVID-19 pandemic revealed a lack of preexisting telehealth training for clinicians. As a workplace-based simulation methodology designed to improve virtual clinical skills, announced standardized patients (ASPs) may help meet evolving educational needs to sustain quality telehealth care.

Objective

We describe the development and implementation of an ASP program to assess and provide feedback to resident and faculty clinicians in virtual practice, and report on performance, feasibility, and acceptability.

Methods

From June 2021 to April 2022, resident and faculty clinicians at a VA primary care clinic participated in a video visit in which an ASP portrayed either a 70-year-old man with hearing loss and hypertension or a 60-year-old man with hypertension and financial stress. Following the visit, ASPs provided verbal feedback and completed a behaviorally anchored checklist to rate telehealth and communication skills, chronic disease management, and use of resources. Domain summary scores were calculated as the mean percentage of "well done" items. Participants completed a feedback survey on their experience.

Results

Seventy-six televisits (60 primary care residents [postgraduate year 1-3], 16 internal medicine faculty) were conducted from August 2021 to April 2022. Clinicians performed well in communication skills: information gathering (79%, 60 of 76, well done), relationship development (67%, 51 of 76), education and counseling (71%, 54 of 76), and patient satisfaction (86%, 65 of 76). They performed less well in telemedicine skills (38%, 29 of 76). Participants agreed that the experience was a good use of their time (88%, 67 of 76).

Conclusions

An ASP-facilitated training for resident and faculty clinicians assessed telehealth skills and clinical practice and identified areas for intervention. Clinicians responded well to the training and feedback.

Can Simulation Scenarios Be Designed to Assess Ongoing Nursing Competence?

Learner-centered verification methods are at the core of Donna Wright's model for competency assessment. Using Wright's framework, an academic medical center studied the use of simulation as a verification method for their annual ongoing nursing competency assessment. Of the 10 pilot participants, 60% used simulation as a verification method to successfully show competence. Assuming adequate professional development practitioner and facility resources, simulation can be used as an option for ongoing competency assessment.

A comparative study of the effects of multimedia training materials on mini CEX scores of internal medicine residents in Isfahan University of Medical Sciences

BACKGROUND

Role of multimedia training materials on Mini-CEX scores of internal medicine residents. We aimed to assess the effect of multi multimedia training materials on Mini-CEX scores of internal medicine residents of Isfahan University of Medical Sciences.

SETTINGS AND DESIGN

A quasi-experimental action research study on 1^st, 2^nd, and 3^rd-year internal medicine residents were implemented.

MATERIALS AND METHODS

The Mini-CEX test measures students' performance in six core skills necessary for medical practice. Mini-CEX scores of 135 internal medicine residents in 2017-2018 were compared before and after the training with prepared multimedia materials. We used repeated measured ANOVA and Mann-Whitney U test to compare the distribution of Mini-CEX scores across corresponding groups. Analysis was done using the SPSS software version 23 (IBM SPSS Statistics for Windows. Armonk, NY, USA: IBM Corp).

RESULTS

The median Mini-CEX score (IQR) of students in preintervention and postintervention groups were 16.14 (5.19) and 19.62 (3.13), respectively. Findings of this study showed a significant increase in mini-CEX scores of the groups who used the multimedia learning material compared to those who did not use it (P < 0.001).

CONCLUSIONS

Multimedia learning resources demonstrated a promising influence on internal residents' mini-CEX scores in this study. They demonstrate significantly greater performance after using multimedia learning materials compared to their same-year residents who did not benefit from it. This demonstrates the favorable effect of multimedia on the acquisition of practical skills such as obtaining a history or performing a physical examination.

Impact of high-fidelity simulation exposure of nursing students with their objective structured clinical examination: A quasi-experimental study

AIM

The study aimed to establish the impact of high-fidelity simulation (HFS) in the objective structured clinical examination (OSCE) of nursing students enrolled in four undergraduate courses (medical-surgical, critical-care, maternal-health and paediatric nursing).

DESIGN

This quasi-experimental research study was performed during the midterm and final OSCEs of nursing students at the institution, and their OSCE performance was assessed.

METHODS

The students were divided into two: those who were exposed to HFS in addition to their clinical training and the other group who underwent clinical training without HFS exposure.

RESULTS

The combined mean midterm and final OSCE results of the group of nursing students with HFS exposure and those without HFS exposure were 92.58 and 82.66, respectively, with a mean between-group difference of 9.92% (p < .01). Our findings reveal that the HFS exposure in addition to clinical training enhanced the students' OSCE performance.

Simulation-based clinical assessment identifies threshold competence to practise physiotherapy in Australia: a crossover trial

BACKGROUND

Although evidence exists for the efficacy of high-fidelity simulation as an educational tool, there is limited evidence for its application in high-stakes professional threshold competency assessment. An alternative model of simulation-based assessment was developed by the Australian Physiotherapy Council (APC), using purpose-written standardised patients, mapped to the appropriate threshold level. The aim of this two-phase study was to investigate whether simulation-based clinical assessments resulted in equivalent outcomes to standard, real-life assessments for overseas-trained physiotherapists seeking registration to practice in Australia.

METHODS

A randomised crossover trial comparing simulation-based assessment to real-life assessment was completed. Participants were internationally trained physiotherapists applying for registration to practice in Australia, voluntarily recruited from the Australian Physiotherapy Council (APC) assessment waiting list: study 1 n = 25, study 2 n = 144. Study 1 participants completed usual APC real-life assessments in 3 practice areas, completed on different days at APC partner healthcare facilities. Participants also underwent 3 practice area-matched simulation-based assessments, completed on the same day at purpose-designed simulation facilities. Study 2 participants completed 3 simulation-based assessments and 1 real-life assessment that was randomly allocated for order and practice area. Assessment of competency followed the standard APC procedure of 90-minute examinations using The Moderated Assessment Form (MAF).

RESULTS

The overall pass rate was higher for real-life assessments in both studies: study 1, 50% versus 42.7%; study 2, 55.6% versus 44.4%. Chi-square analysis showed a high to moderate level of exact matching of pass/fail grades across all assessments: study 1, 73.4% (p < 0.001); study 2, 58.3% (p = 0.027). Binary logistic regression showed that the best predictors of real-life pass/fail grade were simulation-based MAF pass/fail grade (study 1, OR 7.86 p < 0.001; study 2, OR 2.037, p = 0.038) and simulation-based total MAF score (study 1, OR 1.464 p < 0.001; study 2, OR 1.234, p = 0.001).

CONCLUSION

Simulation-based assessment is a significant predictor of clinical performance and can be used to successfully identify high stakes threshold competence to practice physiotherapy in Australia.

Impact of educational instruction on medical student performance in simulation patient

OBJECTIVES

This study aimed to evaluate the effects, and timing of, a video educational intervention on medical student performance in manikin-based simulation patient encounters.

METHODS

This prospective mixed-methods study was conducted as part of the University of Toledo College of Medicine and Life Sciences undergraduate medical curriculum. One hundred sixty-six students second-year students participated in two simulations on a single day in September 2021. A 7-minute video intervention outlining the clinical diagnostic approach to pulmonary complaints was implemented. Students were randomized into 32 groups which were divided into two cohorts. One received the video prior to simulation-1 (n=83) and the other between simulation-1 and simulation-2 (n=83). Each simulation was recorded and assessed using a 44-point standardized checklist. Comparative analysis to determine differences in performance scores was performed using independent t-tests and paired t-tests.

RESULTS

Independent t-tests revealed the video-prior cohort performed better in simulation-1 (t₍₃₀₎= 2.27, p= .03), however in simulation-2 no significant difference was observed between the cohorts. Paired t-test analysis revealed the video-between cohort had significant improvement from simulation-1 to simulation-2 (t₍₁₅₎= 3.06, p = .01); no significant difference was found for the video-prior cohort. Less prompting was seen in simulation-2 among both the video-prior (t₍₁₅₎= -2.83, p= .01) and video-between cohorts (t₍₁₅₎= -2.18, p= .04).

CONCLUSIONS

Simulation training, and targeted educational interventions, facilitate medical students to become clinically competent practitioners. Our findings indicate that guided video instruction advances students' clinical performance greater than learning through simulation alone. To confirm these findings, similar investigations in other clinical training exercises should be considered.

A Scoping Review of Assessment Methods Following Undergraduate Clinical Placements in Anesthesia and Intensive Care Medicine

Introduction

Anesthesia and intensive care medicine are relatively new undergraduate medical placements. Both present unique learning opportunities and educational challenges to trainers and medical students. In the context of ongoing advances in medical education assessment and the importance of robust assessment methods, our scoping review sought to describe current research around medical student assessment after anesthesia and intensive care placements.

Methods

Following Levac's 6 step scoping review guide, we searched PubMed, EMBASE, EBSCO, SCOPUS, and Web of Science from 1980 to August 2021, including English-language original articles describing assessment after undergraduate medical placements in anesthesia and intensive care medicine. Results were reported in accordance with PRISMA scoping review guidelines.

Results

Nineteen articles published between 1983 and 2021 were selected for detailed review, with a mean of 119 participants and a median placement duration of 4 weeks. The most common assessment tools used were multiple-choice questions (7 studies), written assessment (6 studies) and simulation (6 studies). Seven studies used more than one assessment tool. All pre-/post-test studies showed an improvement in learning outcomes following clinical placements. No studies used workplace-based assessments or entrustable professional activities. One study included an account of theoretical considerations in study design.

Discussion

A diverse range of evidence-based assessment tools have been used in undergraduate medical assessment after anesthesia and intensive care placements. There is little evidence that recent developments in workplace assessment, entrustable activities and programmatic assessment have translated to undergraduate anesthesia or intensive care practice. This represents an area for further research as well as for curricular and assessment developments.

Uporaba virtualnih simulacij ali virtualnih pacientov pri izobraževanju študentov v zdravstveni negi

Uvod: Epidemija covida-19 je omejila praktično usposabljanje študentov zdravstvene nege. V zdravstveni negi simulacije niso novost, razmeroma novo področje izobraževanja pa so virtualne simulacije ali virtualni pacienti. Namen pregleda je bil preučiti najnovejše empirične ugotovitve o učinkovitosti oziroma uspešnosti uporabe virtualnih simulacij ali virtualnih pacientov pri študiju zdravstvene nege po svetu.Metode: Pregledani so bili znanstveni članki, objavljeni med letoma 2016 in 2021 v bibliografskih bazah CINAHL, MEDLINE, ERIC ter v kataložno-bibliografski bazi podatkov COBIB. Proučevani so bili članki, ki so obravnavali študente zdravstvene nege, pri katerih sta bila virtualna simulacija ali virtualni pacient uporabljena za način učenja in ne kot način preverjanja usvojenega znanja druge učne metode. Sinteza rezultatov je bila narejena s tematsko analizo.Rezultati: Vključenih je bilo 12 raziskav, ki so bile večinoma opravljene v razvitih državah. Rezultati so pokazali pozitiven vpliv virtualnih simulacij ali virtualnih pacientov na kognitivno in afektivno domeno znanja, praktično izvedbo intervencij, oceno samoučinkovitosti, kompetentnosti in zadovoljstva študentov.Diskusija in zaključek: Kadar kliničnega usposabljanja za študente zdravstvene nege ni mogoče zagotoviti, so virtualne simulacije ali virtualni pacienti lahko eno izmed možnih okolij za trening kliničnih odločitev, ki bi jih študent sicer pridobil v klinični praksi, ne morejo pa nadomestiti kliničnega usposabljanja in izkušenj, ki jih študent pridobi ob pacientu. 

Virtual patient simulation platforms challenging traditional CME: Identification of gaps in knowledge in the management of Type 2 diabetes and Hyperlipidaemia

As any other aspect of contemporary life, an old and established field of CME undergoes a transformation into a "digital age." Virtual patient simulation (VPS) has shown to be an interactive and efficient way of engaging healthcare professionals (HCP) in continuing medical education. VPS can identify gaps in knowledge and improve competence, using engaging, online tools. The Edocate VPS Platform has been developed by a group of physicians, education experts, and computer specialists. In this communication, we report the experience of several hundreds of HCP using the Edocate VPS application in the fields of type 2 diabetes (T2DM) and hyperlipidemia. The Edocate VPS application, displaying both simple and complex clinical situations, was presented to an international group of HCPs who had the task to perform physical exams, order lab and imaging tests, update the medical record with the right diagnoses, prescribe medications, and perform long-term follow-up through multiple visits. The HCPs received personalized, guideline-based, feedback on their actions. The analytical capabilities of the Edocate VPS platform run very deep and allow in-depth analysis of learners' competence in achieving the best outcomes, while teaching to apply a personalized approach, avoiding side effects of medications, and providing instantaneous access to the most current references in the field. The data collected from the program has shown significant gaps in knowledge and adherence to guidelines in the areas of management of T2DM and hyperlipidemia. Only about 50% of all participants achieved guideline-compatible glycemic control - namely HbA1c below 7%. Furthermore, only 41% of practicing physicians and 23% of family medicine residents achieved levels of LDL below 70 mg/dl in their virtual patients. In conclusion, the data presented in this communication strongly suggests that this novel simulation platform can enable medical organizations to create immersive VPS cases for their primary educational and CME efforts.

Barriers and enablers to implementing 'DEALTS2' simulation-based train-the-trainer dementia training programme in hospital settings across England: a qualitative study

Background

Despite approaches to provide effective dementia training in acute care settings, little is known about the barriers and enablers to implement and embed learning into practice. We were commissioned by Health Education England to develop and evaluate a new dementia training intervention ‘Dementia Education And Learning Through Simulation 2’ (DEALTS2), an innovative simulation toolkit to support delivery of dementia training in acute care across England. This study aimed to explore barriers and enablers experienced by trainers implementing DEALTS2 and extent to which it impacted on delivery of training and staff clinical practice.

Methods

We conducted twelve one-day DEALTS2 train-the-trainer (TTT) workshops across England in 2017 for National Health Service Trust staff employed in dementia training roles (n = 199 trainers); each receiving a simulation toolkit. Qualitative data were collected through telephone interviews 6–8 months after TTT workshops with 17 of the trainers. Open ended questions informed by the Kirkpatrick model enabled exploration of implementation barriers, enablers, and impact on practice.

Results

Thematic analysis revealed six themes: four identified interrelated factors that influenced implementation of DEALTS2; and two outlined trainers perceived impact on training delivery and staff clinical practice, respectively: (i) flexible simulation and implementation approach (ii) management support and adequate resources (iii) time to deliver training effectively (iv) trainer personal confidence and motivation (v) trainers enriched dementia teaching practice (vi) staff perceived to have enhanced approach to dementia care. Trainers valued the DEALTS2 TTT workshops and adaptability of the simulation toolkit. Those supported by management with adequate resources and time to deliver effective dementia training, were likely to implement DEALTS2. Trainers described positive impacts on their teaching practice; and perceived staff had enhanced their approach to caring for people with dementia.

Conclusions

Trainers explained individual and organisational barriers and enablers during implementation of DEALTS2. The flexible simulation and implementation approach were key to supporting adherence of DEALTS2. To ensure wider implementation of DEALTS2 nationally, Trusts need to allocate appropriate time to deliver effective dementia training. Future research should measure staff behaviour change, patient perspectives of the intervention, and whether and how DEALTS2 has improved health and care outcomes.

Simulated consult and treatment exercise improves radiation oncology trainee confidence and knowledge

Malignant epidural spinal cord compression (MESCC) represents the most common indication for emergent radiotherapy. First-year residents must quickly gain competence in managing this condition prior to taking call for the department. We sought to develop a hybrid didactic/simulation exercise to assist first-year radiation oncology residents in developing a skillset relevant to treating a MESCC case in an emergency situation. This was a prospective, qualitative survey study conducted at the University of California, Los Angeles, during the years 2014-2016. Following an introductory lecture during orientation for academic years 2014-2016, residents completed a simulated consultation on a patient with suspected MESCC. Subsequently, they worked with radiation therapists to complete the clinical treatment procedure (including field placement and manual calculation of monitor units needed to deliver the prescribed dose) to a phantom placed on a linear accelerator. Residents were then surveyed about whether the exercise increased confidence in their ability to successfully complete a consult, and urgent treatment if needed, for MESCC. All residents agreed or strongly agreed that this exercise had improved this ability, and all agreed or strongly agreed that the exercise was valuable and should be retained in the curriculum. Simulated consultation and treatment of MESCC provides new residents with increased confidence and knowledge regarding this relatively common indication for emergent radiation.

Comparing formative and summative simulation-based assessment in undergraduate nursing students: nursing competency acquisition and clinical simulation satisfaction

BACKGROUND

Formative and summative evaluation are widely employed in simulated-based assessment. The aims of our study were to evaluate the acquisition of nursing competencies through clinical simulation in undergraduate nursing students and to compare their satisfaction with this methodology using these two evaluation strategies.

METHODS

Two hundred eighteen undergraduate nursing students participated in a cross-sectional study, using a mixed-method. MAES© (self-learning methodology in simulated environments) sessions were developed to assess students by formative evaluation. Objective Structured Clinical Examination sessions were conducted to assess students by summative evaluation. Simulated scenarios recreated clinical cases of critical patients. Students´ performance in all simulated scenarios were assessed using checklists. A validated questionnaire was used to evaluate satisfaction with clinical simulation. Quantitative data were analysed using the IBM SPSS Statistics version 24.0 software, whereas qualitative data were analysed using the ATLAS-ti version 8.0 software.

RESULTS

Most nursing students showed adequate clinical competence. Satisfaction with clinical simulation was higher when students were assessed using formative evaluation. The main students' complaints with summative evaluation were related to reduced time for performing simulated scenarios and increased anxiety during their clinical performance.

CONCLUSION

The best solution to reduce students' complaints with summative evaluation is to orient them to the simulated environment. It should be recommended to combine both evaluation strategies in simulated-based assessment, providing students feedback in summative evaluation, as well as evaluating their achievement of learning outcomes in formative evaluation.

The impact of local health professions education grants: is it worth the investment?

BACKGROUND

Local grants programs are important since funding for medical education research is limited. Understanding which factors predict successful outcomes is highly relevant to administrators. The purpose of this project was to identify factors that contribute to the publication of local medical education grants in a Canadian context.

METHODS

Surveys were distributed to previous Department of Innovation in Medical Education (DIME) and Department of Medicine (DOM) grant recipients (n = 115) to gather information pertaining to PI demographics and research outcomes. A backward logistic regression was used to determine the effects several variables on publication success.

RESULTS

The overall publication rate was 64/115 (56%). Due to missing data, 91 grants were included in the logistic regression. Variables associated with a higher rate of publication; cross departmental compared to single department OR = 2.82 (p = 0.04), being presented OR = 3.30 (p = 0.01), and multiple grant acquisition OR = 3.85 (p = 0.005).

CONCLUSION

Although preliminary, our data suggest that increasing research publications from local grants may be facilitated by pooling funds across departments, making research presentations mandatory, and allowing successful researchers to re-apply.

Reliability of simulation-based assessment for practicing physicians: performance is context-specific

INTRODUCTION

Even physicians who routinely work in complex, dynamic practices may be unprepared to optimally manage challenging critical events. High-fidelity simulation can realistically mimic critical clinically relevant events, however the reliability and validity of simulation-based assessment scores for practicing physicians has not been established.

METHODS

Standardised complex simulation scenarios were developed and administered to board-certified, practicing anesthesiologists who volunteered to participate in an assessment study during formative maintenance of certification activities. A subset of the study population agreed to participate as the primary responder in a second scenario for this study. The physicians were assessed independently by trained raters on both teamwork/behavioural and technical performance measures. Analysis using Generalisability and Decision studies were completed for the two scenarios with two raters.

RESULTS

The behavioural score was not more reliable than the technical score. With two raters > 20 scenarios would be required to achieve a reliability estimate of 0.7. Increasing the number of raters for a given scenario would have little effect on reliability.

CONCLUSIONS

The performance of practicing physicians on simulated critical events may be highly context-specific. Realistic simulation-based assessment for practicing physicians is resource-intensive and may be best-suited for individualized formative feedback. More importantly, aggregate data from a population of participants may have an even higher impact if used to identify skill or knowledge gaps to be addressed by training programs and inform continuing education improvements across the profession.

High-Fidelity Virtual Objective Structured Clinical Examinations with Standardized Patients in Nursing Students: An Innovative Proposal during the COVID-19 Pandemic

In response to the cancellation of in-person objective structured clinical examinations (OSCEs) prompted by confinement due to the COVID-19 pandemic, we designed a solution to adapt our traditional OSCEs to this new reality in nursing education. We implemented an innovative teaching proposal based on high-fidelity virtual OSCEs with standardized patients. The purposes of our study were to describe this innovative teaching proposal and compare nursing competence acquisition in final year nursing students through virtual and in-person OSCE modalities. The study included 234 undergraduate students: 123 students were assessed through high-fidelity virtual OSCEs during May 2020, whereas 111 students were assessed through in-person OSCEs during May 2019. The structure of OSCEs, including its stations, clinical simulated scenarios, and checklists, was the same in both OSCE modalities. The effect size of the differences among the competence categories of checklists, including their total scores, was small. Regarding our virtual OSCEs was similarly successful to in-person OSCEs, this online format was found to be useful, feasible, and cost-saving when in-person OSCE was not possible. Therefore, high-fidelity virtual OSCEs with standardized patients could be considered as another choice of OSCE not only in the current COVID-19 pandemic but could also be extended to normal situations, even post-pandemic.

Delivering Difficult News: Simulation-Enhanced Training Improves Psychiatry Residents' Clinical Communication Skills

Background: Delivering difficult news to individuals diagnosed with mental health disorders and their family members can be challenging. The use of simulated patients (SP) is an effective teaching method to enhance clinical skills, particularly those around communication. We developed, implemented, and evaluated the effectiveness of an SP-based training module to improve psychiatric residents' clinical communication skills in delivering difficult news. Methods: We conducted 5-h workshops consisting of 3 components: (1) a high-fidelity simulation session with a professional actor; (2) a 30-min lecture; and (3) role-playing of 3 short scenarios, during which residents rotated taking on different roles (as psychiatrist, patient, or family member). We observed through a 1-way mirror and videotaped each resident's simulation session and followed it with personalized debriefing. Following the workshop, each resident received the full-length video of their simulated interview, together with a list of questions as a take-home assignment. Two months after the workshop, the residents were invited to a second SP-based session, during which 2 independent evaluators, each a board-certified psychiatrist with expertise in medical simulation, evaluated the participants' communication skills using a previously validated instrument. To avoid observation bias, the 2 evaluators rated the videotapes blind to the timing of the simulation (pre- vs. post-training). Participants completed self-report questionnaires on satisfaction and self-confidence, before, after, and 2 months following the workshop. Findings: Of the 28 psychiatric residents who participated in the training day, 24 (86%) completed the post-workshop evaluation. Mean communication score increased from 24.9 to 27.8 (paired t-test: 5.6, p < 0.001). The mean score for the self-confidence questionnaire, calculated on a 1 to 5 Likert scale, increased from 3.4 to 4.0 after the training day, and remained unchanged (4.2) 2 months later (p < 0.001). Conclusions: An SP-based training module proved useful in improving the objectively measured communication skills of psychiatric residents delivering difficult news. The training further enhanced participants' subjective sense of confidence in those clinical skills.

Navigate the Challenges of Simulation for Assessment: A Faculty Development Workshop

INTRODUCTION

Given barriers to learner assessment in the authentic clinical environment, simulated patient encounters are gaining attention as a valuable opportunity for competency assessment across the health professions. Simulation-based assessments offer advantages over traditional methods by providing realistic clinical scenarios through which a range of technical, analytical, and communication skills can be demonstrated. However, simulation for the purpose of assessment represents a paradigm shift with unique challenges, including preservation of a safe learning environment, standardization across learners, and application of valid assessment tools. Our goal was to create an interactive workshop to equip educators with the knowledge and skills needed to conduct assessments in a simulated environment.

METHODS

Participants engaged in a 90-minute workshop with large-group facilitated discussions and small-group activities for practical skill development. Facilitators guided attendees through a simulated grading exercise followed by in-depth analysis of three types of assessment tools. Participants designed a comprehensive simulation-based assessment encounter, including selection or creation of an assessment tool.

RESULTS

We have led two iterations of this workshop, including an in-person format at an international conference and a virtual format at our institution during the COVID-19 pandemic, with a total of 93 participants. Survey responses indicated strong overall ratings and impactfulness of the workshop.

DISCUSSION

Our workshop provides a practical, evidence-based framework to guide educators in the development of a simulation-based assessment program, including optimization of the environment, design of the simulated case, and utilization of meaningful, valid assessment tools.

The Feasibility of Virtual Reality and Student-Led Simulation Training as Methods of Lumbar Puncture Instruction

BACKGROUND

There is limited data assessing simulation and virtual reality training as a standardized tool in medical education. This feasibility study aimed to evaluate the effectiveness of virtual reality training and a student-led simulation module in preparing medical students to perform a lumbar puncture.

METHODS

Twenty-five medical students completed a pre-intervention survey, and a baseline video recorded lumbar puncture procedure on a task trainer. Students were randomly distributed into the virtual reality group, or the curriculum's standard student-led procedural instruction group. Participants were then given 45 min to practice the lumbar puncture procedure. After the intervention, all participants were video recorded again as they performed a post-intervention lumbar puncture and completed a post-intervention survey. Pre- and post-intervention videos were scored using a critical action checklist in conjunction with time needed to complete the procedure to evaluate proficiency.

RESULTS

At baseline, there were no major statistically significant differences between groups. Assessing overall post-intervention performance, both groups showed improvement in aggregate score (p < 0.001) and time required to complete (p = 0.002) the lumbar puncture. Following interventions, the student-led group improved over the virtual reality group in a variety of metrics. The student-led group increased their aggregate score by 3.49 and decreased their time to completion by 34 s over the VR group when controlling for baseline measures.

CONCLUSIONS

Both virtual reality and student-led simulation training were useful training modalities, with hands-on simulation showing better results versus virtual reality training in this setting.

SUPPLEMENTARY INFORMATION

The online version contains supplementary material available at 10.1007/s40670-020-01141-6.

Effects of the reservoir bag disconnection on inspired gases during general anesthesia: a simulator-based study

BACKGROUND

Fresh gas decoupling is a feature of the modern anesthesia workstation, where the fresh gas flow (FGF) is diverted into the reservoir bag and is not added to the delivered tidal volume, which thus remains constant. The present study aimed to investigate the entraining of the atmospheric air into the anesthesia breathing circuit in case the reservoir bag was disconnected.

METHODS

We conducted a simulator-based study, where the METI HPS simulator was connected to the anesthesia workstation. The effect of the disconnected reservoir bag was evaluated using oxygen (O2) and air or oxygen and nitrous oxide (N2O) as a carrier gas at different FGF rates. We disconnected the reservoir bag for 10 min during the maintenance phase. We recorded values for inspiratory O2, N2O, and sevoflurane. The time constant of the exponential process was estimated during reservoir bag disconnection.

RESULTS

The difference of O2, N2O and sevoflurane concentrations, before, during, and after reservoir bag disconnection was statistically significant at 0.5, 1, and 2 L/min of FGF (p < 0.001). The largest decrease of the inspired O2 concentrations (FIO2) was detected in the case of oxygen and air as the carrier gas and an FGF of 1 L/min, when oxygen decreased from median [25th-75th percentile] 55.00% [54.00-56.00] to median 39.50% [38.00-42.50] (p < 0.001). The time constant for FIO2 during reservoir bag disconnection in oxygen and air as the carrier gas, were median 2.5, 2.5, and 1.5 min in FGF of 0.5, 1.0, and 2 L/min respectively.

CONCLUSIONS

During the disconnection of the anesthesia reservoir bag, the process of pharmacokinetics takes place faster compared to the wash-in and wash-out pharmacokinetic properties in the circle breathing system. The time constant was affected by the FGF rate, as well as the gradient of anesthetic gases between the anesthesia circle system and atmospheric air.

Simulation in Clinical Nursing Education

Background:

Simulation constitutes a teaching method and a strategy for learning and understanding theoretical knowledge and skills in the nursing and medical field.

Objective:

To review and present modern data related to this issue.

Methods:

Literature review of data related to the issue derived from Medline, Cinhal, and Scopus databases, in English, using the following keywords: nursing, simulation, simulator, nursing laboratory.

Results:

The implementation of simulation enables students to practice their clinical and decision-making skills for some significant issues they may face in their daily work. The protected environment and the sense of security enhance students’ self-esteem and confidence, thus promoting learning. In this way, the gap between theory and practice is substantially reduced.

Conclusion:

The further development of simulation, along with other instructional techniques, can significantly help the efforts made by the students to become integrated and successful healthcare professionals.

Use of Augmented and Virtual Reality in Remote Higher Education: A Systematic Umbrella Review

In this systematic umbrella review we aggregate the current knowledge of how virtual and augmented reality technologies are applicable to and impact remote learning in higher education; specifically, how they impact such learning outcomes as performance and engagement in all stages of higher education from course preparation to student evaluation and grading. This review was done as part of a state wide research effort of Latvia, to mitigate the impact of COVID-19 and specifically to provide a framework for a technological transformation of education in this context. In this work we search the Scopus and Web of Science databases for articles describing the use of virtual and/or augmented reality technologies in remote learning for higher education and their impact on learning outcomes. We identified 68 articles from which, after multiple screening and eligibility phases, nine review articles were left for extraction phase in which 30 structural elements with corresponding interventions and measured effects were extracted. Of these, 24 interventions had a measured effect on student performance (11 positive, seven negative, six no impact) and six interventions had a measured effect on student engagement (all six positive).

Virtual Patient Simulation in Continuing Education: Improving the Use of Guideline-Directed Care in Venous Thromboembolism Treatment

Results of a CME-certified activity completed by a total of 986 cardiologists and 783 haematologists-oncologists (haem-oncs) from around the world were examined to determine whether virtual patient simulation could improve decision-making and performance within the simulation related to patient evaluation, tailoring anticoagulant therapy, and patient management to improve adherence using patient-centred care strategies. Results showed a significant overall impact of education from pre- to post-clinical guidance (CG) on correct decisions made in both cases for cardiologists, with a relative improvement of 22% for Case 1 (45% pre- to 55% post-CG, n = 475, t(474) = 14.12, P<.001, Cohen’s d =.46) and 19% for Case 2 (62% pre- to 74% post-CG, n = 245, t(244) = 11.95, P<.001, Cohen’s d =.59). Impact also was seen for haem-oncs, with a relative improvement of 27% for Case 1 (45% pre- to 57% post-CG, n = 280, t(279) = 11.91, P <.001, Cohen’s d =.60) and 19% for Case 2 (63% pre- to 75% post-CG, n = 147, t(146) = 9.52, P <.001, Cohen’s d =.58). Virtual patient simulation improved cardiologists’ and haem-oncs management of patients with pulmonary embolism in a simulated environment.

Using Simulation to Teach Methods for Improving Patient Literacy about Medicines

Pharmacists have a role in educating patients on the self-management of their medications, using accurate medicines lists. Thus, pharmacy students need to be adequately trained and assessed in health-literacy skills to be competent for future patient-education consultations using medicines lists. Performance-based assessments using patient simulation are often utilized to examine students' competence in clinical knowledge and communication skills. Due to COVID-19, education systems changed to remote online delivery utilizing video conferencing platforms (i.e., ZoomTM), which proved challenging for performance-based assessments. These challenges include difficulty in observing non-verbal cues over ZoomTM and not having adequate internet access. Adaptations to reduce reliance on internet access were made where students submitted a video-recording task wherein they educated a simulated patient on a medicines list, under lockdown restrictions during the pandemic. A total of 304 submissions were received where students performed the role-play with a simulated patient, such as their family members, housemates or peers either at home in person or via ZoomTM. Although it was not an original goal of the task, the collaborative effort between pharmacy instructors, students and the public helped increase awareness of medicines lists through this task.

Assessing competency using simulation: the SimZones approach

Introduction

Competency-based medical education (CBME) is a system of medical training that focuses on a structured approach to developing the clinical abilities of medical education graduates and practicing physicians. CBME requires a robust and multifaceted system of assessment in order to both measure and guide the progress of learners toward pre-established goals. Simulation has been proposed as one method for assessing competency in healthcare workers. However, a longitudinal framework for assessing competency using simulation has not been developed.

Methods

Conjecture mapping methodology was used to map Miller's framework for competency assessment-'knows', 'knows how', 'shows how', and 'does'-to the five SimZones described by Roussin and Weinstock. The SimZones describe a system of organising the development and delivery of simulation-based education and offer a foundation for both guiding and organising assessment in a simulation context.

Results

A conceptualised alignment of the SimZones with Miller's pyramid of assessment was developed, as well as a detailed conjecture map. SimZone 0 (auto-feedback) and SimZone 1 (foundational instruction) mapped to 'knows' and 'knows how'. SimZone 2 (acute care instruction) mapped to 'shows how'. SimZone 3 (team and system development) mapped to 'shows how'. SimZone 4 (real-life debriefing and development) mapped to 'does'.

Conclusion

The SimZones system of competency assessment offers a robust, flexible, and multifaceted system to guide both formative and summative assessment in CBME. The SimZones approach adds to the many methods of competency assessment available to educators. Adding SimZones to the vocabulary of CBME may be helpful for the full deployment of CBME.

Simulation-based education improves student self-efficacy in physiotherapy assessment and management of paediatric patients

BACKGROUND

The Australian Physiotherapy Council mandates that physiotherapy clinical education be sufficient to produce graduates who are competent to practice across the lifespan. Due to a lack of opportunities for paediatric clinical placements, there is a risk of graduates not having the opportunity to develop competency in paediatric physiotherapy. To address this risk, simulation-based education (SBE) has been proposed as an educational strategy to address the placement shortfall. Despite encouraging evidence for its use in physiotherapy education, there is limited evidence supporting its use specifically in paediatric populations. The aims of this research were to investigate the effect of SBE on student self-efficacy in the physiotherapy assessment and management of paediatric clients, and to determine student satisfaction with SBE as a learning strategy.

METHODS

Three interactive SBE sessions were run during the undergraduate paediatric physiotherapy unit at the campus of one Australian university. Self-efficacy was surveyed before and after each session, to determine confidence in clinical skills, clinical decision-making, treatment preparation and planning, communication skills; evaluating and modifying interventions, and interprofessional practice. Student satisfaction with SBE as a learning strategy was surveyed after the final SBE session.

RESULTS

For the 164 participants included in this study, self-efficacy survey response rate varied from 77 to 96% for each session. Significant increases in mean student self-efficacy were recorded for all questions (p <  0.001). A total of 139 (85%) responded to the learning reactionnaire with 78.6% indicating they were very satisfied with SBE as a learning strategy. Written comments from 41 participants identified 'experience' as the primary theme.

CONCLUSION

SBE had a significant positive effect on student self-efficacy in the physiotherapy assessment and management of paediatric patients. Students also perceived SBE to be a valuable learning experience. Future research is needed to investigate whether the improvement in self-efficacy achieved through SBE translates into improved student performance during workplace-based clinical placements.

Effect of Paper- and Computer-based Simulated Instructions on Clinical Reasoning Skills of Undergraduate Medical Students: A Randomized Control Trial

Background and objectives Skilled clinical reasoning is a critical tool for physicians. Educators agree that this skill should be formally taught and assessed. Objectives related to the mastery of clinical reasoning skills appear in the documentation of most medical schools and licensing bodies. We conducted this study to assess the differences in clinical reasoning skills in medical students following paper- and computer-based simulated instructions. Materials and methods  A total of 52 sixth semester medical students of the Dow University of Health Sciences were included in this study. A tutorial was delivered to all students on clinical reasoning and its importance in clinical practice. Students were divided randomly into two groups: group A received paper-based instructions while group B received computer-based instructions (as Flash-based scenarios developed with Articulate Storyline software [https://articulate.com/p/storyline-3]) focused on clinical reasoning skills in history-taking of acute and chronic upper abdominal pain. After one week, both groups were tested at two objective structured clinical examination (OSCE) stations to assess acute and chronic pain history-taking skills in relation to clinical reasoning. Results There were 27 students in group A and 25 students in group B. The mean OSCE score for group A (paper-based) was 28.6 ± 9.4 and that for group B (computer-based) was 38.5 ± 6.0. Group B's mean score was statistically significantly greater (p < 0.001) than group A's mean score for clinical reasoning skills.  Conclusion A computer simulation program can enhance clinical reasoning skills. This technology could be used to acquaint students with real-life experiences and identify potential areas for more training before facing real patients.

Current Trends and Opportunities for Competency Assessment in Pharmacy Education-A Literature Review

An increasing emphasis on health professional competency in recent times has been matched by an increased prevalence of competency-based education models. Assessments can generate information on competence, and authentic, practice-based assessment methods are critical. Assessment reform has emerged as an academic response to the demands of the pharmacy profession and the need to equip graduates with the necessary knowledge, skills and attributes to face the challenges of the modern workforce. The objective of this review was to identify and appraise the range of assessment methods used in entry-level pharmacy education and examine current trends in health professional assessment. The initial search located 2854 articles. After screening, 36 sources were included in the review, 13 primary research studies, 12 non-experimental pharmacy research papers, and 11 standards and guidelines from the grey literature. Primary research studies were critically appraised using the Medical Education Research Study Quality Instrument (MERSQI). This review identified three areas in pharmacy practice assessment which provide opportunities for expansion and improvement of assessment approaches: (1) integrated approaches to performance assessment; (2) simulation-based assessment approaches, and; (3) collection of validity evidence to support assessment decisions. Competency-based assessment shows great potential for expanded use in pharmacy, but there is a need for further research and development to ensure its appropriate and effective use.

The Past, Present, and Future of Virtual Reality in Pharmacy Education

Objective. To characterize how virtual reality (VR) has been and is being used in pharmacy education, and evaluate the projected utility of VR technology in pharmacy education in the future. Findings. Virtual reality technology has been used in pharmacy education for many years to provide engaging learning experiences. Although these learning experiences were not available in the three-dimensional digital environments provided by current VR, they demonstrated improvements in learning. Recent technological advancements have substantially increased the potential usefulness of VR for pharmacy education by providing immersive educational activities that mimic real world experiences to reinforce didactic and laboratory concepts. Virtual reality training that uses head-mounted displays is just beginning in pharmacy education, but more educational VR programs are becoming available. Further research will be necessary to fully understand the potential impact of VR on pharmacy education. Summary. Virtual reality technology can provide an immersive and interactive learning environment, overcoming many of the early challenges faced by instructors who used virtual activities for pharmacy education. With further technological and software development, VR has the potential to become an integral part of pharmacy education.

A Web-Based Serious Game on Delirium as an Educational Intervention for Medical Students: Randomized Controlled Trial

Background

Adequate delirium recognition and management are important to reduce the incidence and severity of delirium. To improve delirium recognition and management, training of medical staff and students is needed.

Objective

In this study, we aimed to gain insight into whether the serious game, Delirium Experience, is suited as an educational intervention.

Methods

We conducted a three-arm randomized controlled trial. We enrolled 156 students in the third year of their Bachelor of Medical Sciences degree at the University Medical Centre Groningen. The Game group of this study played Delirium Experience. The Control D group watched a video with explanations on delirium and a patient’s experience of delirious episodes. The Control A group watched a video on healthy aging. To investigate students’ skills, we used a video of a delirious patient for which students had to give care recommendations and complete the Delirium Observations Screening Scale and Delirium Rating Scale R-98. Furthermore, students completed the Delirium Attitude Scale, the Learning Motivation and Engagement Questionnaire, and self-reported knowledge on delirium.

Results

In total, 156 students participated in this study (Game group, n=51; Control D group, n=51; Control A group, n=55). The Game group scored higher with a median (interquartile range) of 6 (4-8) for given recommendations and learning motivation and engagement compared with the Control D (1, 1-4) and A (0, 0-3) groups (P<.001). Furthermore, the Game group scored higher (7, 6-8) on self-reported knowledge compared with the Control A group (6, 5-6; P<.001). We did not find differences between the groups regarding delirium screening (P=.07) and rating (P=.45) skills or attitude toward delirious patients (P=.55).

Conclusions

The serious game, Delirium Experience, is suitable as an educational intervention to teach delirium care to medical students and has added value in addition to a lecture.

Simulation Experiences in Canadian Physiotherapy Programmes: A Description of Current Practices

Purpose: Although health care professional education programmes around the world are increasingly using sophisticated simulation technology, the scope of simulation use in Canadian physiotherapy programmes is currently undefined. The current study explores the definitions of simulation, its current use, and the perceived benefits and barriers in Canadian entry-to-practice physiotherapy programmes. Method: Using a qualitative, descriptive study approach, we contacted Canadian physiotherapy programmes to identify faculty members with simulation experience. Using a semi-structured interview format, we asked participants to discuss their perspectives of simulation in their physiotherapy programmes. Interviews were audio recorded, transcribed, and analyzed for themes. Results: Of 13 eligible Canadian physiotherapy programmes, participants from 8 were interviewed. The interviews revealed three major themes: (1) variability in the definition of fidelity in simulation, (2) variability in simulation use, and (3) the benefits of and barriers to the use of simulation. Conclusions: Variability in the definition of fidelity in simulation among Canadian physiotherapy programmes is consistent with the current literature, highlighting a spectrum of complexity from low fidelity to high fidelity. Physiotherapy programmes are using a variety of simulations, with the aim of creating a bridge from theoretical knowledge to clinical practice. This study describes the starting point for characterizing simulation implementation in Canadian physiotherapy programmes and reflects the diversity that exists across the country.

Status of Nordic research on simulation-based learning in healthcare: an integrative review

Background

Based on common geography, sociopolitics, epidemiology, and healthcare services, the Nordic countries could benefit from increased collaboration and uniformity in the development of simulation-based learning (SBL). To date, only a limited overview exists on the Nordic research literature on SBL and its progress in healthcare education. Therefore, the aim of this study is to fill that gap and suggest directions for future research.

Methods

An integrative review design was used. A search was conducted for relevant research published during the period spanning from 1966 to June 2016. Thirty-seven studies met the inclusion criteria. All included studies were appraised for quality and were analyzed using thematic analysis.

Results

The Nordic research literature on SBL in healthcare revealed that Finland has published the greatest number of qualitative studies, and only Sweden and Norway have published randomized control trials. The studies included interprofessional or uniprofessional teams of healthcare professionals and students. An assessment of the research design revealed that most studies used a qualitative or a descriptive design. The five themes that emerged from the thematic analysis comprised technical skills, non-technical skills, user experience, educational aspects, and patient safety.

Conclusion

This review has identified the research relating to the progress of SBL in the Nordic countries. Most Nordic research on SBL employs a qualitative or a descriptive design. Shortcomings in simulation research in the Nordic countries include a lack of well-designed randomized control trials or robust evidence that supports simulation as an effective educational method. In addition, there is also a shortage of studies focusing on patient safety, the primary care setting, or a combination of specialized and primary care settings. Suggested directions for future research include strengthening the design and methodology of SBL studies, incorporating a cross-country comparison of studies using simulation in the Nordic countries, and studies combining specialized and primary care settings.

Electronic supplementary material

The online version of this article (10.1186/s41077-018-0071-8) contains supplementary material, which is available to authorized users.

Identification of the technical and medical requirements for HEMS avalanche rescue missions through a 15-year retrospective analysis in a HEMS in Switzerland: a necessary step for quality improvement

BACKGROUND

Avalanche rescues mostly rely on helicopter emergency medical services (HEMS) and include technical rescue and complex medical situations under difficult conditions. The adequacy of avalanche victim management has been shown to be unexpectedly low, suggesting the need for quality improvement. We analyse the technical rescue and medical competency requirements of HEMS crewmembers for avalanche rescue missions, as well as their clinical exposure. The study aims to identify areas that should be the focus of future quality improvement efforts.

METHODS

This 15-year retrospective study of avalanche rescue by the Swiss HEMS Rega includes all missions where at least one patient had been caught by an avalanche, found within 24 h of the alarm being raised, and transported.

RESULTS

Our analyses included 422 missions (596 patients). Crews were frequently confronted with technical rescue aspects, including winching (29%) and patient location and extrication (48%), as well as multiple casualty accidents (32%). Forty-seven percent of the patients suffered potential or overt vital threat; 29% were in cardiac arrest. The on-site medical management of the victims required a large array of basic and advanced medical skills. Clinical exposure was low, as 56% of the physicians were involved in only one avalanche rescue mission over the study period.

CONCLUSIONS

Our data provide a solid baseline measure and valuable starting point for improving our understanding of the challenges encountered during avalanche rescue missions. We further suggest QI interventions, that might be immediately useful for HEMS operating under similar settings. A coordinated approach using a consensus process to determine quality indicators and a minimal dataset for the specific setting of avalanche rescue would be the logical next step.

A pilot study to assess the utility of a freely downloadable mobile application simulator for undergraduate clinical skills training: a single-blinded, randomised controlled trial

BACKGROUND

Medical simulators offer an invaluable educational resource for medical trainees. However, owing to cost and portability restrictions, they have traditionally been limited to simulation centres. With the advent of sophisticated mobile technology, simulators have become cheaper and more accessible. Touch Surgery is one such freely downloadable mobile application simulator (MAS) used by over one million healthcare professionals worldwide. Nevertheless, to date, it has never been formally validated as an adjunct in undergraduate medical education.

METHODS

Medical students in the final 3 years of their programme were recruited and randomised to one of three revision interventions: 1) no formal revision resources, 2) traditional revision resources, or 3) MAS. Students completed pre-test questionnaires and were then assessed on their ability to complete an undisclosed male urinary catheterisation scenario. Following a one-hour quarantined revision period, all students repeated the scenario. Both attempts were scored by allocation-blinded examiners against an objective 46-point mark scheme.

RESULTS

A total of 27 medical students were randomised (n = 9 per group). Mean scores improved between baseline and post-revision attempts by 8.7% (p = 0.003), 19.8% (p = 0.0001), and 15.9% (p = 0.001) for no resources, traditional resources, and MAS, respectively. However, when comparing mean score improvements between groups there were no significant differences.

CONCLUSIONS

Mobile simulators offer an unconventional, yet potentially useful adjunct to enhance undergraduate clinical skills education. Our results indicate that MAS's perform comparably to current gold-standard revision resources; however, they may confer significant advantages in terms of cost-effectiveness and practice flexibility.

TRIAL REGISTRATION

Not applicable.

Medical Student Evaluation With a Serious Game Compared to Multiple Choice Questions Assessment

Background

The gold standard for evaluating medical students’ knowledge is by multiple choice question (MCQs) tests: an objective and effective means of restituting book-based knowledge. However, concerns have been raised regarding their effectiveness to evaluate global medical skills. Furthermore, MCQs of unequal difficulty can generate frustration and may also lead to a sizable proportion of close results with low score variability. Serious games (SG) have recently been introduced to better evaluate students’ medical skills.

Objectives

The study aimed to compare MCQs with SG for medical student evaluation.

Methods

We designed a cross-over randomized study including volunteer medical students from two medical schools in Paris (France) from January to September 2016. The students were randomized into two groups and evaluated either by the SG first and then the MCQs, or vice-versa, for a cardiology clinical case. The primary endpoint was score variability evaluated by variance comparison. Secondary endpoints were differences in and correlation between the MCQ and SG results, and student satisfaction.

Results

A total of 68 medical students were included. The score variability was significantly higher in the SG group (σ² =265.4) than the MCQs group (σ²=140.2; P=.009). The mean score was significantly lower for the SG than the MCQs at 66.1 (SD 16.3) and 75.7 (SD 11.8) points out of 100, respectively (P<.001). No correlation was found between the two test results (R²=0.04, P=.58). The self-reported satisfaction was significantly higher for SG (P<.001).

Conclusions

Our study suggests that SGs are more effective in terms of score variability than MCQs. In addition, they are associated with a higher student satisfaction rate. SGs could represent a new evaluation modality for medical students.