Impact of Using a 3D Visual Metaphor Serious Game to Teach History-Taking Content to Medical Students: Longitudinal Mixed Methods Pilot Study

Game design elements of serious games in the education of medical and healthcare professions: a mixed-methods systematic review of underlying theories and teaching effectiveness

Serious games, as a learning resource, enhance their game character by embedding game design elements that are typically used in entertainment games. Serious games in its entirety have already proven their teaching effectiveness in different educational contexts including medical education. The embedded game design elements play an essential role for a game's effectiveness and thus they should be selected based on evidence-based theories. For game design elements embedded in serious games used for the education of medical and healthcare professions, an overview of theories for the selection lacks. Additionally, it is still unclear whether and how single game design elements affect the learning effectiveness. Therefore, the main aim of this systematic review is threefold. Firstly, light will be shed on the single game design elements used in serious games in this area. Second, the game design elements' underlying theories will be worked out, and third, the game design elements' effectiveness on student learning outcome will be assessed. Two literature searches were conducted in November 2021 and May 2022 in six literature databases with keywords covering the fields of educational game design, serious game, and medical education. Out of 1006 initial records, 91 were included after applying predefined exclusion criteria. Data analysis revealed that the three most common game design elements were points, storyline, and feedback. Only four underlying theories were mentioned, and no study evaluated specific game design elements. Since game design elements should be based on theories to ensure meaningful evaluations, the conceptual GATE framework is introduced, which facilitates the selection of evidence-based game design elements for serious games.

Rehearsal-based digital serious boardgame versus a game-free e-learning tool for anatomical education: Quasi-randomized controlled trial

Serious games may resolve problems relating to low motivation in complex medical topics such as anatomy. However, they remain relatively novel introductions to the science of learning, and further research is required to ascertain their benefits. This study describes the overall development and testing of a digital serious boardgame designed to facilitate the rehearsal of musculoskeletal anatomy based on self-determination theory with considerations for the psychological state of Flow. It was hypothesized that students assigned to the intervention game condition would attain higher Flow scores, a measure of engagement and intrinsic motivation, than students assigned to the game-free control, and that the intervention condition would report either superior or non-superior, but not inferior, scores on a surprise recall test. A total of 36 second-year undergraduate medical students participated in the quasi-randomized controlled trial, where the intervention groups went first and randomly drew questions that were mirrored into the control groups. All students were administered an identical 10-question baseline assessment before their interventions, the Short Flow Scale immediately after, and a surprise test four-to-six weeks later. Independent samples t-tests indicated that students of both conditions were of similar baseline knowledge (t = 0.7, p = 0.47), significantly higher Flow scores in the game condition (t = 2.99, p = 0.01), and no significant differences between surprise test scores (t = -0.3, p = 0.75). The game appears to be an appropriate game-based tool for student rehearsal of anatomical education, stemming from a strong theoretical base that facilitates high engagement and intrinsic motivation.

Investigating the effectiveness of Case-Based Technology-Enhanced workshops (e-Flipped vs. Online) among health worker nurses during the COVID-19 pandemic

AIM

This study aimed to compare the efficacy of e-flipped and online case-based workshops on the nurses' knowledge, attitude and behaviour regarding thalassemia during the COVID-19 pandemic.

DESIGN

A pre-test-posttest interventional study was conducted with two intervention groups and a control group.

METHODS

One hundred and fifty nurses were recruited from comprehensive urban health centres in June-December 2020. The nurses were randomly allocated to one of the three groups: case-based e-flipped workshop (n = 50), case-based online workshop (n = 50) and control (n = 50). A researcher-made questionnaire was completed by eligible subjects at baseline, after the end of the training sessions and 4 weeks after interventions to assess their knowledge, attitude and behaviour. Data were analysed in IBM SPSS v16.0. ANOVA and Tukey's post hoc tests were used to compare the three groups.

RESULTS

The mean knowledge, attitude and behaviour scores in the intervention groups increased significantly more than that in the control group (p < .001). One week and 4 weeks following the intervention, the mean score of knowledge, attitude and behaviour in the e-flipped group was greater than that in the online group (p < .001). According to the results, e-flipped and online case-based workshops can improve nurses' knowledge, attitude and behaviour regarding thalassemia.

Comparative satisfaction and effectiveness of virtual simulation and usual supervised work for postpartum hemorrhage management: a crossover randomized controlled trial

BACKGROUND

Because virtual simulation promotes learning and cognitive skill development, it may be useful for teaching students to manage postpartum hemorrhage (PPH) and its complex decision algorithm.

OBJECTIVE

This study aimed to compare the satisfaction and effectiveness of virtual simulation with usual supervised work in producing knowledge and satisfaction.

METHODS

This two-center two-stage crossover randomized controlled trial included student midwives. One group underwent the virtual simulation intervention in the first period (January 2018) and the usual supervised classroom work in the second (May 2018); the other group followed the reverse chronology. Satisfaction was the primary outcome. The secondary outcome was knowledge of the PPH management algorithm, assessed by responses to a case vignette after each intervention session.

RESULTS

The virtual simulation -supervised work (VS-SW) chronology was allocated to 48 students, and its inverse (SW-VS) to 47; Satisfaction was significantly higher for the virtual simulation for its overall grade (6.8 vs. 6.1, P = 0.009), engagingness (very good 82.1% vs. 24.3%, P < 0.001), and ease of use (very good 77.9% vs. 46.1%, P < 0.001). Knowledge did not differ between the two groups (respectively, 89.5% versus 83.5%, P = 0.3).

CONCLUSION

Satisfaction is higher with virtual simulation without lowering knowledge scores, which argues for the use of such innovative teaching strategies. This could lead to an increase in students' motivation to learn.

Exploring gamified learning for inculcating patient safety concepts in dentistry: A mixed-methods study

INTRODUCTION

Freshly graduated dentists transition from a supervised undergraduate school clinic into their workplace with limited knowledge on patient safety goals. Many studies have demonstrated benefits of using gamified media in clinical education, but no research has yet been conducted to find out its application in teaching patient safety concepts in dentistry. This study therefore aimed to find out the value of gamified learning in inculcating patient safety concepts in dentistry.

MATERIALS AND METHODS

This mixed-methods study was conducted on general dentists working in NDCS with a post-bachelor's degree graduation work experience of ≤5 years using a conceptual framework consisting of pre/post-knowledge assessment, game data and game performance review. A pre-intervention knowledge test was conducted before a gamified learning educational intervention involving participants assuming the role of a clinician avatar managing different clinical scenarios in a game. After the intervention, participants completed an online survey. Focus group interviews were then organised to find out more about their game experience. A post-intervention knowledge test was also conducted.

RESULTS

Quantitative results showed a significant improvement in test scores of participants after gamified learning. Qualitative feedback of the gamified learning experience was largely positive with majority of participants finding it beneficial though it also revealed some negative aspects and areas of improvement to work on.

CONCLUSION

Gamified learning was valuable in improving knowledge and enhancing learning of patient safety in this study group and has the potential for greater educational benefits given more funding to improve on the game prototype.

An Exploratory Digital Board Game Approach to the Review and Reinforcement of Complex Medical Subjects Like Anatomical Education: Cross-sectional and Mixed Methods Study

Background

Serious games have the potential to resolve educational problems faced by medical students, such as insufficient rehearsal due to boredom and lack of motivation. However, serious games’ relatively novel concepts in science and many genres of games that are common in recreation remain underresearched in the literature. Board games are one such genre that, despite their potential, affordability, and flexibility, are rarely designed for medical students, and little is known about student perceptions of them and their compatibility with rehearsal.

Objective

In this cross-sectional study, we sought to elicit, via an exploratory mixed methods approach, student perceptions of a digital serious board game specifically designed for the gamified rehearsal of complex medical subjects, with the chosen topic of anatomy.

Methods

A digital serious board game, based on self-determination theory (SDT), was first designed and developed to facilitate the rehearsal of anatomy information. Students were then voluntarily recruited to partake in the intervention and were randomly split into three teams of 2 players per game session, after which they were administered the Flow Short Scale (FSS), which is a 13-item measure where items were rated on a 7-point Likert scale ranging from 1 (“not at all”) to 7 (“very much”). Students then participated in a focus group discussion to elicit their perceptions of the game. Findings from the FSS were subject to descriptive analysis, and the focus group discussion was subject to inductive thematic analysis.

Results

A total of 12 undergraduate, second-year medical students from the Lee Kong Chian School of Medicine in Singapore participated in the study. FSS results indicated a moderate level of overall flow (mean score 4.94, SD 1.07) via the subdomains of fluency (mean score 4.77, SD 1.13) and absorption (mean score 5.21, SD 1.1). Students perceived the game as fun, enjoyable, engaging, and appropriate as a rehearsal tool that alleviated the monotony of traditional methods of rehearsal.

Conclusions

Our digital board game–based rehearsal tool, when based on SDT, appeared to be suitable for gamified rehearsal in a fun and enjoyable environment due to its facilitation of intrinsic motivation in its players.

Conceptual Ambiguity Surrounding Gamification and Serious Games in Health Care: Literature Review and Development of Game-Based Intervention Reporting Guidelines (GAMING)

BACKGROUND

In health care, the use of game-based interventions to increase motivation, engagement, and overall sustainability of health behaviors is steadily becoming more common. The most prevalent types of game-based interventions in health care research are gamification and serious games. Various researchers have discussed substantial conceptual differences between these 2 concepts, supported by empirical studies showing differences in the effects on specific health behaviors. However, researchers also frequently report cases in which terms related to these 2 concepts are used ambiguously or even interchangeably. It remains unclear to what extent existing health care research explicitly distinguishes between gamification and serious games and whether it draws on existing conceptual considerations to do so.

OBJECTIVE

This study aims to address this lack of knowledge by capturing the current state of conceptualizations of gamification and serious games in health care research. Furthermore, we aim to provide tools for researchers to disambiguate the reporting of game-based interventions.

METHODS

We used a 2-step research approach. First, we conducted a systematic literature review of 206 studies, published in the Journal of Medical Internet Research and its sister journals, containing terms related to gamification, serious games, or both. We analyzed their conceptualizations of gamification and serious games, as well as the distinctions between the two concepts. Second, based on the literature review findings, we developed a set of guidelines for researchers reporting on game-based interventions and evaluated them with a group of 9 experts from the field.

RESULTS

Our results show that less than half of the concept mentions are accompanied by an explicit definition. To distinguish between the 2 concepts, we identified four common approaches: implicit distinction, synonymous use of terms, serious games as a type of gamified system, and distinction based on the full game dimension. Our Game-Based Intervention Reporting Guidelines (GAMING) consist of 25 items grouped into four topics: conceptual focus, contribution, mindfulness about related concepts, and individual concept definitions.

CONCLUSIONS

Conceptualizations of gamification and serious games in health care literature are strongly heterogeneous, leading to conceptual ambiguity. Following the GAMING can support authors in rigorous reporting on study results of game-based interventions.

Interventions for improving medical students' interpersonal communication in medical consultations

BACKGROUND

Communication is a common element in all medical consultations, affecting a range of outcomes for doctors and patients. The increasing demand for medical students to be trained to communicate effectively has seen the emergence of interpersonal communication skills as core graduate competencies in medical training around the world. Medical schools have adopted a range of approaches to develop and evaluate these competencies.

OBJECTIVES

To assess the effects of interventions for medical students that aim to improve interpersonal communication in medical consultations.

SEARCH METHODS

We searched five electronic databases: Cochrane Central Register of Controlled Trials, MEDLINE, Embase, PsycINFO, and ERIC (Educational Resource Information Centre) in September 2020, with no language, date, or publication status restrictions. We also screened reference lists of relevant articles and contacted authors of included studies.

SELECTION CRITERIA

We included randomised controlled trials (RCTs), cluster-RCTs (C-RCTs), and non-randomised controlled trials (quasi-RCTs) evaluating the effectiveness of interventions delivered to students in undergraduate or graduate-entry medical programmes. We included studies of interventions aiming to improve medical students' interpersonal communication during medical consultations. Included interventions targeted communication skills associated with empathy, relationship building, gathering information, and explanation and planning, as well as specific communication tasks such as listening, appropriate structure, and question style.

DATA COLLECTION AND ANALYSIS

We used standard methodological procedures expected by Cochrane. Two review authors independently reviewed all search results, extracted data, assessed the risk of bias of included studies, and rated the quality of evidence using GRADE.

MAIN RESULTS

We found 91 publications relating to 76 separate studies (involving 10,124 students): 55 RCTs, 9 quasi-RCTs, 7 C-RCTs, and 5 quasi-C-RCTs. We performed meta-analysis according to comparison and outcome. Among both effectiveness and comparative effectiveness analyses, we separated outcomes reporting on overall communication skills, empathy, rapport or relationship building, patient perceptions/satisfaction, information gathering, and explanation and planning. Overall communication skills and empathy were further divided as examiner- or simulated patient-assessed. The overall quality of evidence ranged from moderate to very low, and there was high, unexplained heterogeneity. Overall, interventions had positive effects on most outcomes, but generally small effect sizes and evidence quality limit the conclusions that can be drawn. Communication skills interventions in comparison to usual curricula or control may improve both overall communication skills (standardised mean difference (SMD) 0.92, 95% confidence interval (CI) 0.53 to 1.31; 18 studies, 1356 participants; I² = 90%; low-quality evidence) and empathy (SMD 0.64, 95% CI 0.23 to 1.05; 6 studies, 831 participants; I² = 86%; low-quality evidence) when assessed by experts, but not by simulated patients. Students' skills in information gathering probably also improve with educational intervention (SMD 1.07, 95% CI 0.61 to 1.54; 5 studies, 405 participants; I² = 78%; moderate-quality evidence), but there may be little to no effect on students' rapport (SMD 0.18, 95% CI -0.15 to 0.51; 9 studies, 834 participants; I² = 81%; low-quality evidence), and effects on information giving skills are uncertain (very low-quality evidence). We are uncertain whether experiential interventions improve overall communication skills in comparison to didactic approaches (SMD 0.08, 95% CI -0.02 to 0.19; 4 studies, 1578 participants; I² = 4%; very low-quality evidence). Electronic learning approaches may have little to no effect on students' empathy scores (SMD -0.13, 95% CI -0.68 to 0.43; 3 studies, 421 participants; I² = 82%; low-quality evidence) or on rapport (SMD 0.02, 95% CI -0.33 to 0.38; 3 studies, 176 participants; I² = 19%; moderate-quality evidence) compared to face-to-face approaches. There may be small negative effects of electronic interventions on information giving skills (low-quality evidence), and effects on information gathering skills are uncertain (very low-quality evidence).  Personalised/specific feedback probably improves overall communication skills to a small degree in comparison to generic or no feedback (SMD 0.58, 95% CI 0.29 to 0.87; 6 studies, 502 participants; I² = 56%; moderate-quality evidence). There may be small positive effects of personalised feedback on empathy and information gathering skills (low quality), but effects on rapport are uncertain (very low quality), and we found no evidence on information giving skills. We are uncertain whether role-play with simulated patients outperforms peer role-play in improving students' overall communication skills (SMD 0.17, 95% CI -0.33 to 0.67; 4 studies, 637 participants; I² = 87%; very low-quality evidence). There may be little to no difference between effects of simulated patient and peer role-play on students' empathy (low-quality evidence) with no evidence on other outcomes for this comparison. Descriptive syntheses of results that could not be included in meta-analyses across outcomes and comparisons were mixed, as were effects of different interventions and comparisons on specific communication skills assessed by the included trials. Quality of evidence was downgraded due to methodological limitations across several risk of bias domains, high unexplained heterogeneity, and imprecision of results. In general, results remain consistent in sensitivity analysis based on risk of bias and adjustment for clustering. No adverse effects were reported.  AUTHORS' CONCLUSIONS: This review represents a substantial body of evidence from which to draw, but further research is needed to strengthen the quality of the evidence base, to consider the long-term effects of interventions on students' behaviour as they progress through training and into practice, and to assess effects of interventions on patient outcomes. Efforts to standardise assessment and evaluation of interpersonal skills will strengthen future research efforts.