Transfer of Clinical Reasoning Trained With a Serious Game to Comparable Clinical Problems: A Prospective Randomized Study

Games to support teaching clinical reasoning in health professions education: a scoping review

INTRODUCTION

Given the complexity of teaching clinical reasoning to (future) healthcare professionals, the utilization of serious games has become popular for supporting clinical reasoning education. This scoping review outlines games designed to support teaching clinical reasoning in health professions education, with a specific emphasis on their alignment with the 8-step clinical reasoning cycle and the reflective practice framework, fundamental for effective learning.

METHODS

A scoping review using systematic searches across seven databases (PubMed, CINAHL, ERIC, PsycINFO, Scopus, Web of Science, and Embase) was conducted. Game characteristics, technical requirements, and incorporation of clinical reasoning cycle steps were analyzed. Additional game information was obtained from the authors.

RESULTS

Nineteen unique games emerged, primarily simulation and escape room genres. Most games incorporated the following clinical reasoning steps: patient consideration (step 1), cue collection (step 2), intervention (step 6), and outcome evaluation (step 7). Processing information (step 3) and understanding the patient's problem (step 4) were less prevalent, while goal setting (step 5) and reflection (step 8) were least integrated.

CONCLUSION

All serious games reviewed show potential for improving clinical reasoning skills, but thoughtful alignment with learning objectives and contextual factors is vital. While this study aids health professions educators in understanding how games may support teaching of clinical reasoning, further research is needed to optimize their effective use in education. Notably, most games lack explicit incorporation of all clinical reasoning cycle steps, especially reflection, limiting its role in reflective practice. Hence, we recommend prioritizing a systematic clinical reasoning model with explicit reflective steps when using serious games for teaching clinical reasoning.

The development of an online serious game for oral diagnosis and treatment planning: evaluation of knowledge acquisition and retention

BACKGROUND

While serious games seem to be supportive in healthcare education, none of them had been designed to develop competence in diagnosis and treatment planning of oral lesions. Therefore, this research aimed to develop an online simulation-based serious game for training diagnosis and treatment planning of oral lesions (SimOL) and to evaluate its educational impact in terms of knowledge improvement and retention.

METHODS

As a mandatory task in an oral lesion course, all 28 students were required to participate in SimOL activities. Participants were instructed to complete a pre-knowledge assessment following a one-week washout period prior to the game activity. Subsequent to the game completion, they were tasked to complete a post-knowledge assessment I (Full score = 15) and satisfaction questionnaire. A post-knowledge assessment II was administered a week later to evaluate knowledge retention.

RESULTS

The findings demonstrated a significant increase in the assessment scores after interacting with the game (P < 0.001), where the pre- and immediate post-knowledge assessment scores were 8.00 (SD = 2.11) and 11.71 (SD = 2.39), respectively. The game also exhibited a positive impact on knowledge retention, as there was no significant difference between the scores of post-knowledge assessment I and II (P > 0.05). Additionally, students perceived the game as positively in all aspects, although the entertainment aspect achieved a slightly lower score of 3.70 (SD = 0.21), in comparison to the usefulness and ease of use with a score of 4.02 (SD = 0.11) and 4.02 (SD = 0.16), respectively.

CONCLUSION

SimOL demonstrated its potential as an effective learning tool for improving and retaining knowledge for diagnosis and treatment planning of oral lesions. The game was perceived positively by dental students in all aspects, however further improvements should prioritize the enhancement of entertaining components.

Instructional Design and Its Usability for Branching Model as an Educational Strategy

INTRODUCTION

Serious Games (SG) are an educational strategy used in the health professions with positive results in teaching diagnosis and facilitating the application of concepts and knowledge transfer. A type of SG is the branching scenario, which has the potential for a linear story or multiple options to achieve learning goals. There must be evidence for this type of SG's instructional design (InD) and usability.

OBJECTIVE

Propose an InD for the branching scenario and rate its usability.

MATERIALS AND METHODS

We conducted a two-phase study. In the first phase, we drafted an InD based on the literature review, and then, we applied an expert validation process through a modified Delphi technique. With the consent of InD, we built five branching scenarios. In the second phase, we apply an instrument to measure the SG usability of the branching scenarios in a cross-sectional study with 216 undergraduate medical students.

RESULTS

A proposal for an InD for branching scenarios was elaborated. This InD has five dimensions with steps and definitions that help the designer fulfill the requirements for the SG. With the InD, we developed five branching scenarios for undergraduate medical students. Finally, the rates for the usability of the branchings had high scores. The branching SG with multiple options offers different outcomes for the same clinical problem in a single activity.

DISCUSSION

The proposal of a specific InD for branching scenarios considered SG theory and was tested, at least in user usability. The steps proposed include the specificity of the requirements of an SG, such as levels, checkpoints, avatars, and gameplay characteristics, among others, in contrast to the other InD that do not explicitly consider them. One of the limitations of this study is that we applied it only using the H5P software to develop branching scenarios with no other evidence of the performance of the InD in different contexts or platforms.

CONCLUSIONS

We propose using an InD to construct branching scenarios. This kind of SG has specific characteristics for its correct operation. Using structured steps in developing SG improves the probability of developing decision-making skills. Using an instrument to assess the usability of at least one dimension of the SG is also recommended to identify opportunity areas.

Game-based learning in medical education

At present, medical education is rapidly evolving. Game-based learning (GBL) has been gradually used for education, and several innovations have emerged. The emergence of serious games and gamification provides alternative approaches for educators to improve the medical teaching process. Both serious games and gamification exert their education-promoting function by providing the possibility of combining learning activities such as feedback, testing, and spaced repetition with active participation and autonomy as well as positive experiences for students. Developing effective GBL modalities has the potential to bring immersive experiences for medical students and improve their study outcomes. Herein, we reviewed recent studies employing GBL in medical education, including serious games and gamification teaching. Furthermore, we also discussed the effectiveness and limitations of GBL to suggest future directions for the development and application of GBL in medical education.

Use of a Serious Game to Teach Infectious Disease Management in Medical School: Effectiveness and Transfer to a Clinical Examination

Purpose

Physicians of all specialties must be familiar with important principles of infectious diseases, but curricular time for this content is limited and clinical teaching requires considerable resources in terms of available patients and teachers. Serious games are scalable interventions that can help standardize teaching. This study assessed whether knowledge and skills acquired in a serious game translate to better performance in a clinical examination.

Methods

Fifth-year undergraduate medical students (n = 100) at Goettingen Medical School were randomized to three groups receiving different levels of exposure to virtual patients presenting with signs and symptoms of either infective endocarditis or community-acquired pneumonia in a serious game simulating an accident and emergency department. Student performance was assessed based on game logfiles and an objective standardized clinical examination (OSCE).

Results

Higher exposure to virtual patients in the serious game did not result in superior OSCE scores. However, there was good agreement between student performance in the OSCE and in game logfiles (r = 0.477, p = 0.005). An Item Response Theory analysis suggested that items from the serious game covered a wider range of ability, thus better differentiating between students within a given cohort.

Conclusion

Repeated exposure to virtual patients with infectious diseases in a serious game did not directly impact on exam performance but game logfiles might be good and resource-sparing indicators of student ability. One advantage of using serious games in medical education is standardized content, a lower inhibition threshold to learn, and a need of less staff time compared to small-group clinical teaching.

Use of digital teaching resources and predictors of medical student performance during the pandemic: A prospective study

Background

The coronavirus pandemic has led to increased use of digital teaching formats in medical education. A number of studies have assessed student satisfaction with these resources. However, there is a lack of studies investigating changes in student performance following the switch from contact to virtual teaching. Specifically, there are no studies linking student use of digital resources to learning outcome and examining predictors of failure.

Methods

Student performance before (winter term 2019/20: contact teaching) and during (summer term 2020: no contact teaching) the pandemic was compared prospectively in a cohort of 162 medical students enrolled in the clinical phase of a five-year undergraduate curriculum. Use of and performance in various digital resources (case-based teaching in a modified flipped classroom approach; formative key feature examinations of clinical reasoning; daily multiple choice quizzes) was recorded in summer 2020. Student scores in summative examinations were compared to examination scores in the previous term. Associations between student characteristics, resource use and summative examination results were used to identify predictors of performance.

Results

Not all students made complete use of the digital learning resources provided. Timely completion of tasks was associated with superior performance compared to delayed completion. Female students scored significantly fewer points in formative key feature examinations and digital quizzes. Overall, higher rankings within the student cohort (according to summative exams) in winter term 2019/20 as well as male gender predicted summative exam performance in summer 2020. Scores achieved in the first formative key feature examination predicted summative end-of-module exam scores.

Conclusions

The association between timely completion of tasks as well as early performance in a module and summative exams might help to identify students at risk and offering help early on. The unexpected gender difference requires further study to determine whether the shift to a digital-only curriculum disadvantages female students.

Outcomes, Measurement Instruments, and Their Validity Evidence in Randomized Controlled Trials on Virtual, Augmented, and Mixed Reality in Undergraduate Medical Education: Systematic Mapping Review

BACKGROUND

Extended reality, which encompasses virtual reality (VR), augmented reality (AR), and mixed reality (MR), is increasingly used in medical education. Studies assessing the effectiveness of these new educational modalities should measure relevant outcomes using outcome measurement tools with validity evidence.

OBJECTIVE

Our aim is to determine the choice of outcomes, measurement instruments, and the use of measurement instruments with validity evidence in randomized controlled trials (RCTs) on the effectiveness of VR, AR, and MR in medical student education.

METHODS

We conducted a systematic mapping review. We searched 7 major bibliographic databases from January 1990 to April 2020, and 2 reviewers screened the citations and extracted data independently from the included studies. We report our findings in line with the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines.

RESULTS

Of the 126 retrieved RCTs, 115 (91.3%) were on VR and 11 (8.7%) were on AR. No RCT on MR in medical student education was found. Of the 115 studies on VR, 64 (55.6%) were on VR simulators, 30 (26.1%) on screen-based VR, 9 (7.8%) on VR patient simulations, and 12 (10.4%) on VR serious games. Most studies reported only a single outcome and immediate postintervention assessment data. Skills outcome was the most common outcome reported in studies on VR simulators (97%), VR patient simulations (100%), and AR (73%). Knowledge was the most common outcome reported in studies on screen-based VR (80%) and VR serious games (58%). Less common outcomes included participants' attitudes, satisfaction, cognitive or mental load, learning efficacy, engagement or self-efficacy beliefs, emotional state, competency developed, and patient outcomes. At least one form of validity evidence was found in approximately half of the studies on VR simulators (55%), VR patient simulations (56%), VR serious games (58%), and AR (55%) and in a quarter of the studies on screen-based VR (27%). Most studies used assessment methods that were implemented in a nondigital format, such as paper-based written exercises or in-person assessments where examiners observed performance (72%).

CONCLUSIONS

RCTs on VR and AR in medical education report a restricted range of outcomes, mostly skills and knowledge. The studies largely report immediate postintervention outcome data and use assessment methods that are in a nondigital format. Future RCTs should include a broader set of outcomes, report on the validity evidence of the measurement instruments used, and explore the use of assessments that are implemented digitally.

Virtual Simulation in Undergraduate Medical Education: A Scoping Review of Recent Practice

Virtual simulation (VS) as an emerging interactive pedagogical strategy has been paid more and more attentions in the undergraduate medical education. Because of the fast development of modern computer simulation technologies, more and more advanced and emerging VS-based instructional practices are constantly increasing to promote medical education in diverse forms. In order to describe an overview of the current trends in VS-based medical teaching and learning, this scoping review presented a worldwide analysis of 92 recently published articles of VS in the undergraduate medical teaching and learning. The results indicated that 98% of included articles were from Europe, North America, and Asia, suggesting a possible inequity in digital medical education. Half (52%) studies reported the immersive virtual reality (VR) application. Evidence for educational effectiveness of VS in medical students’ knowledge or skills was sufficient as per Kirkpatrick’s model of outcome evaluation. Recently, VS has been widely integrated in surgical procedural training, emergency and pediatric emergency medicine training, teaching of basic medical sciences, medical radiation and imaging, puncture or catheterization training, interprofessional medical education, and other case-based learning experiences. Some challenges, such as accessibility of VS instructional resources, lack of infrastructure, “decoupling” users from reality, as well as how to increase students’ motivation and engagement, should be addressed.

Improving Academic Performance in Medical Students Using Immersive Virtual Patient Simulation: A Randomized Controlled Trial

OBJECTIVES

To determine whether immersive virtual patient simulation (IVPS) on the MedicActiv platform is influential in improving student academic performance in module validation tests.

DESIGN

In this prospective randomized controlled study a comparison was made between IVPS training combined with regular faculty courses versus courses alone. The primary endpoint was module validation grades. Secondary endpoints were satisfaction scores (overall interest, ergonomics, realism, immersion, and training efficiency).

SETTING

Angers School of Medicine, France.

PARTICIPANTS

2018 to 2019 class of fourth-year students, included on a voluntary basis. In the first semester 51 students were included, of whom 13 were excluded for lack of compliance (6 and 7 from the IVPS and control groups, respectively). In the second semester we included 57 students, of whom 10 were excluded for lack of compliance (2 and 8 from the IVPS and control groups, respectively).

RESULTS

Mean age was 21 years (±0.8). There were 85 female and 23 male students. In the first semester mean grades were 13.4 ± 1.6 versus 11/.9 ± 2.4 in the IVPS and control groups, respectively (p = 0.038). In the second semester mean grades were 15.3 ± 2.5 versus 11.9 ± 3.6 in the IVPS and control groups, respectively p < 0.001. The entire study population was pooled (n = 85): mean grades were 14.5 ± 2.4 versus 11.9 ± 3 in the IVPS group and the control group, respectively, p < 0.001. The satisfaction questionnaire response rate was 54% (46/85). Score percentages ≥4 regarding overall interest, ergonomics, realism, immersion and training efficiency were 89%, 85%, 100%, 93%, and 93% respectively.

CONCLUSIONS

Complementing conventional university education with simulation of virtual consultation cases on the MedicActiv platform improved student academic performance as compared with students studying regular courses. Students reported high levels of satisfaction with overall interest, ergonomics, realism, immersion and training efficiency on the MedicActiv platform.