Serious Games for Improving Technical Skills in Medicine: Scoping Review

An Original Remote Digital Serious Game for Neonatal Resuscitation Training: New Opportunities from COVID-19 Era

Background: The social restrictions imposed by the COVID-19 pandemic have disrupted traditional teaching methods and encouraged the development of innovative and safer approaches based on distance learning. Among these novel techniques, digital game-based learning (DGBL) is a method that facilitates learning through the efficient use of interactive software tailored to the user. Methods: In this work, we investigated the effectiveness of the DGBL methodology for remote training using a game-based digital learning software designed about remote neonatal resuscitation. The DGBL approach was validated in 52 anesthesiologist trainees and compared to a homogenous retrospective control group of pediatric trainees with the same prior knowledge, who followed an in-person training course using the digital serious game. Scores obtained during each game session are recorded and used to assess progress in knowledge of the flowchart, decision time, timing of assisted ventilation, and ability to check equipment. Results: The results confirmed the effectiveness of the remote training mode for each of the analyzed features, whereas no statistically significant advantages of using a supervised DGBL were found. Conclusion: In conclusion, the DGBL remote training approach is a valuable tool that can provide users with an interactive, effective, and enjoyable learning experience. Future developments will concern the implementation of multiplayer versions to stimulate interaction between users for the development of inter-professional and teamwork skills.

Education in Laparoscopic Cholecystectomy: Design and Feasibility Study of the LapBot Safe Chole Mobile Game

BACKGROUND

 Major bile duct injuries during laparoscopic cholecystectomy (LC), often stemming from errors in surgical judgment and visual misperception of critical anatomy, significantly impact morbidity, mortality, disability, and health care costs.

OBJECTIVE

 To enhance safe LC learning, we developed an educational mobile game, LapBot Safe Chole, which uses an artificial intelligence (AI) model to provide real-time coaching and feedback, improving intraoperative decision-making.

METHODS

 LapBot Safe Chole offers a free, accessible simulated learning experience with real-time AI feedback. Players engage with intraoperative LC scenarios (short video clips) and identify ideal dissection zones. After the response, users receive an accuracy score from a validated AI algorithm. The game consists of 5 levels of increasing difficulty based on the Parkland grading scale for cholecystitis.

RESULTS

 Beta testing (n=29) showed score improvements with each round, with attendings and senior trainees achieving top scores faster than junior residents. Learning curves and progression distinguished candidates, with a significant association between user level and scores (P=.003). Players found LapBot enjoyable and educational.

CONCLUSIONS

 LapBot Safe Chole effectively integrates safe LC principles into a fun, accessible, and educational game using AI-generated feedback. Initial beta testing supports the validity of the assessment scores and suggests high adoption and engagement potential among surgical trainees.

The Effect of a Novel Video Game on Young Soccer Players' Sports Performance and Attention: Randomized Controlled Trial

Background

Currently, the fusion of technology and sports is inevitable. The integration of various systems and devices has brought about significant transformations in established sports practices, impacting not only the rules but also physiological, biomechanical, and even psychological aspects.

Objective

The purpose of this study was to analyze the effect of an attention intervention through a video game on young soccer players.

Methods

Twelve young male soccer players (age: mean 8.5, SD 1 years) were divided into 2 groups: a control group (CG; n=10) and an experimental group (EG; n=10). During the 6-week training program, the EG received attention training through a video game twice a week for 15 minutes per session. Pre- and postintervention measurements included a specific decision-making soccer test and interviews with coaching staff. Additionally, success in the video game, muscular activity, and sweat levels were monitored.

Results

The EG demonstrated a significant improvement in video game success following the intervention program, as indicated by the achieved level (P<.001). However, no significant differences were found between groups regarding electromyographic (EMG) activity (P=.21) and sweating (P=.20). Prior to implementing the attention training program, both groups exhibited similar data for variables related to decision-making and execution mechanisms (≤10%). Only 2 decision-making variables exceeded 10% but remained below 15% (Shot_D=13.35%; Marking_with_Ball_D=-12.64%). Furthermore, changes in attacking action variables were more pronounced in execution-related variables, except for dribbling and fixing. Conversely, in defensive action variables, changes were greater in decision-related variables, except for marking with the ball and marking without the ball.

Conclusions

Our findings reveal that incorporating a specific attentional video game into a soccer training program enhances decision-making compared to a program without the video game. Therefore, it is advisable for practitioners to consider using this tool due to its high efficiency in terms of economic and temporal costs, particularly in improving a key psychological variable.

Teaching point-of-care ultrasound using a serious game: a randomized controlled trial

BACKGROUND

Point-of-care ultrasound (POCUS) is an important diagnostic tool for internists. However, there are important barriers in learning POCUS, including lack of practice time and lack of experts for supervision. Alternative learning tools may assist in overcoming these barriers. A serious game is being developed specifically for teaching ultrasound. In this study, we assessed the use of a serious game in learning POCUS.

METHODS

Ultrasound-native medical students were randomly assigned to the intervention group (N = 27) or the control group (N = 26). Both groups performed a real ultrasound on a volunteer after a brief introduction, but the intervention group played a serious game in advance. The endpoints were the assessments of the videos by experts (scoring quality of the probe movements) and the research team (counting probe movements), and probe movements measured with an accelerometer.

RESULTS

The intervention group completed the exam faster (247 s vs. 347 s, p = 0.006 (95% CI: [30.20;168.80]) and lifted the probe less frequently from the model (0.54 vs. 3.79, p = 0.001 (95% CI: [1.39;5.11]). Also, we found an in-game learning effect between levels, showing a 48% decrease in total playing time (p < 0.001), 36% reduction in attempts per coin (p = 0.007), a 33% reduction in total probe distance (p = 0.002), and a 61% decrease in contact moments (p < 0.001). However, there was no significant difference in expert score between the two groups.

CONCLUSION

The serious game 'Underwater' is a fun and useful addition to traditional bedside ultrasound learning, which also may overcome one of the most important barriers in learning ultrasound: lack of supervised practice time. We show that the game improves real-practice probe handling with faster and more goal-oriented probe movements.

Case-Based Serious Gaming for Complication Management in Colorectal and Pancreatic Surgery: Prospective Observational Study

BACKGROUND

The potential risk and subsequent impact of serious complications after pancreatic and colorectal surgery can be significantly reduced through early recognition, correct assessment, and timely initiation of appropriate therapy. Serious gaming (SG) is an innovative teaching method that combines play with knowledge acquisition, increased concentration, and quick decision-making and could therefore be used for clinically oriented education.

OBJECTIVE

This study aims to develop a case-based SG platform for complication management in pancreatic and colorectal surgery, validate the application by comparing game courses of various professional groups in the health care sector, and test the acceptance of the developed platform in the context of clinical education by measuring levels of usability and applicability within the framework of a validity and usefulness analysis.

METHODS

In this observational trial, a novel SG for management of postoperative complications was developed and prospectively validated in a cohort of 131 human caregivers with varying experience in abdominal surgery. A total of 6 realistic patient cases were implemented, representing common complications after pancreatic and colorectal surgery. Cases were developed and illustrated using anonymized images, data, and histories of postoperative patients. In the prospective section of this study, following a brief case presentation, participants were asked to triage the virtual patient, make an initial suspected diagnosis, and design a 3-step management plan, throughout which the results of selected diagnostic and therapeutic actions were presented. Participants' proposed case management was compared to ideal case management according to clinical guidelines. Usability, applicability, validity, and acceptance of the application were assessed using the Trier Teaching Evaluation Inventory as part of a noncomparative analysis. In addition, a comparative analysis of conventional teaching and learning formats was carried out.

RESULTS

A total of 131 cases were answered. Physicians selected more appropriate therapeutic measures than nonphysicians. In the Trier Teaching Evaluation Inventory, design, structure, relevance, timeliness, and interest promotion were predominantly rated positively. Most participants perceived the application to be superior to conventional lecture-based formats (training courses, lectures, and seminars) in terms of problem-solving skills (102/131, 77.9%), self-reflection (102/131, 77.9%), and usability and applicability (104/131, 79.4%).

CONCLUSIONS

Case-based SG has educational potential for complication management in surgery and could thereby contribute to improvements in postoperative patient care.

Unravelling the skillset of point-of-care ultrasound: a systematic review

BACKGROUND

The increasing number of physicians that are trained in point-of-care ultrasound (POCUS) warrants critical evaluation and improvement of current training methods. Performing POCUS is a complex task and it is unknown which (neuro)cognitive mechanisms are most important in competence development of this skill. This systematic review was conducted to identify determinants of POCUS competence development that can be used to optimize POCUS training.

METHODS

PubMed, Web of Science, Cochrane Library, Emcare, PsycINFO and ERIC databases were searched for studies measuring ultrasound (US) skills and aptitude. The papers were divided into three categories: "Relevant knowledge", "Psychomotor ability" and 'Visuospatial ability'. The 'Relevant knowledge' category was further subdivided in 'image interpretation', 'technical aspects' and 'general cognitive abilities'. Visuospatial ability was subdivided in visuospatial subcategories based on the Cattell-Horn-Carroll (CHC) Model of Intelligence v2.2, which includes visuospatial manipulation and visuospatial perception. Post-hoc, a meta-analysis was performed to calculate pooled correlations.

RESULTS

26 papers were selected for inclusion in the review. 15 reported on relevant knowledge with a pooled coefficient of determination of 0.26. Four papers reported on psychomotor abilities, one reported a significant relationship with POCUS competence. 13 papers reported on visuospatial abilities, the pooled coefficient of determination was 0.16.

CONCLUSION

There was a lot of heterogeneity in methods to assess possible determinants of POCUS competence and POCUS competence acquisition. This makes it difficult to draw strong conclusions on which determinants should be part of a framework to improve POCUS education. However, we identified two determinants of POCUS competence development: relevant knowledge and visuospatial ability. The content of relevant knowledge could not be retrieved in more depth. For visuospatial ability we used the CHC model as theoretical framework to analyze this skill. We could not point out psychomotor ability as a determinant of POCUS competence.

Adventure Legal Medicine: a free online serious game for supplementary use in undergraduate medical education

Serious games (computer-based learning games) are increasingly used in medical education at various levels, as user access is independent of location and time and promotes non-linear learning. In legal medicine, interactive digital media are still scarce. The freely accessible online serious game "Adventure Legal Medicine" was developed as part of the "Hamburg Open Online University". The goal was to teach the basics of forensic casework in a point-and-click adventure setting consisting of five cases. During development, 40 medical students were asked to evaluate the game anonymously. The System Usability Scale (SUS) resulted in a mean score of 86.7 (SD 8.3), which corresponds to above-average usability. Further specific evaluations revealed a good to very good rating of the game with no differences in terms of gender (p = 0.214), first-year versus advanced students (p = 0.393) and students who never/rarely or sometimes/often played computer games (p = 0.780). Since there are only a few digital media so far that allow curricular integration into undergraduate teaching in legal medicine, this serious game represents a possibility to integrate digital media into both face-to-face teaching and distance learning and to use it as a supplement to the medical school's own teaching offer, encouraging users to actively engage with the subject.

The development of new remote technologies in disaster medicine education: A scoping review

Background

Remote teaching and online learning have significantly changed the responsiveness and accessibility after the COVID-19 pandemic. Disaster medicine (DM) has recently gained prominence as a critical issue due to the high frequency of worldwide disasters, especially in 2021. The new artificial intelligence (AI)-enhanced technologies and concepts have recently progressed in DM education.

Objectives

The aim of this article is to familiarize the reader with the remote technologies that have been developed and used in DM education over the past 20 years.

Literature scoping reviews

Mobile edge computing (MEC), unmanned aerial vehicles (UAVs)/drones, deep learning (DL), and visual reality stimulation, e.g., head-mounted display (HMD), are selected as promising and inspiring designs in DM education.

Methods

We performed a comprehensive review of the literature on the remote technologies applied in DM pedagogy for medical, nursing, and social work, as well as other health discipline students, e.g., paramedics. Databases including PubMed (MEDLINE), ISI Web of Science (WOS), EBSCO (EBSCO Essentials), Embase (EMB), and Scopus were used. The sourced results were recorded in a Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) flowchart and followed in accordance with the PRISMA extension Scoping Review checklist. We included peer-reviewed articles, Epubs (electronic publications such as databases), and proceedings written in English. VOSviewer for related keywords extracted from review articles presented as a tabular summary to demonstrate their occurrence and connections among these DM education articles from 2000 to 2022.

Results

A total of 1,080 research articles on remote technologies in DM were initially reviewed. After exclusion, 64 articles were included in our review. Emergency remote teaching/learning education, remote learning, online learning/teaching, and blended learning are the most frequently used keywords. As new remote technologies used in emergencies become more advanced, DM pedagogy is facing more complex problems.

Discussions

Artificial intelligence-enhanced remote technologies promote learning incentives for medical undergraduate students or graduate professionals, but the efficacy of learning quality remains uncertain. More blended AI-modulating pedagogies in DM education could be increasingly important in the future. More sophisticated evaluation and assessment are needed to implement carefully considered designs for effective DM education.

The Agreement Between Virtual Patient and Unannounced Standardized Patient Assessments in Evaluating Primary Health Care Quality: Multicenter, Cross-sectional Pilot Study in 7 Provinces of China

BACKGROUND

The unannounced standardized patient (USP) is the gold standard for primary health care (PHC) quality assessment but has many restrictions associated with high human and resource costs. Virtual patient (VP) is a valid, low-cost software option for simulating clinical scenarios and is widely used in medical education. It is unclear whether VP can be used to assess the quality of PHC.

OBJECTIVE

This study aimed to examine the agreement between VP and USP assessments of PHC quality and to identify factors influencing the VP-USP agreement.

METHODS

Eleven matched VP and USP case designs were developed based on clinical guidelines and were implemented in a convenience sample of urban PHC facilities in the capital cities of the 7 study provinces. A total of 720 USP visits were conducted, during which on-duty PHC providers who met the inclusion criteria were randomly selected by the USPs. The same providers underwent a VP assessment using the same case condition at least a week later. The VP-USP agreement was measured by the concordance correlation coefficient (CCC) for continuity scores and the weighted κ for diagnoses. Multiple linear regression was used to identify factors influencing the VP-USP agreement.

RESULTS

Only 146 VP scores were matched with the corresponding USP scores. The CCC for medical history was 0.37 (95% CI 0.24-0.49); for physical examination, 0.27 (95% CI 0.12-0.42); for laboratory and imaging tests, -0.03 (95% CI -0.20 to 0.14); and for treatment, 0.22 (95% CI 0.07-0.37). The weighted κ for diagnosis was 0.32 (95% CI 0.13-0.52). The multiple linear regression model indicated that the VP tests were significantly influenced by the different case conditions and the city where the test took place.

CONCLUSIONS

There was low agreement between VPs and USPs in PHC quality assessment. This may reflect the "know-do" gap. VP test results were also influenced by different case conditions, interactive design, and usability. Modifications to VPs and the reasons for the low VP-USP agreement require further study.

The validation of a serious game for teaching ultrasound skills

Background

Point-of-care ultrasound (POCUS) is an important bedside diagnostic tool and is being taught in several specialties. However, mastering the required psychomotor skills takes time and learning curves are different between students. Especially learning to make the right probe movements with the corresponding changes of the ultrasound image on screen, and integrating it into a 3D mental model takes time. This precious bedside-time of trainers and physicians may be reduced using other learning methods for mastering the psychomotor skills, for example the use of serious games. Such a game is under development but it needs to be validated before widespread use can be advised. In this article we describe the development and the first three steps in the validation of a serious game for ultrasound skills.

Results

We have included 18 ultrasound experts and 24 ultrasound novices who played the serious game ‘Underwater” and provided feedback. They concluded that “underwater” is fun to play and that movement of the 3D-printed probe resembled real ultrasound probe movements. Participants highly valued the potential of the game for training eye–hand coordination and stability of probe handling, two very important skills in performing ultrasound in real practice. Although we compared several in-game parameters such as distance and speed, no difference was observed between novices and experts. This means that content- and face validity of the serious game is demonstrated but optimal parameters to measure differences between novices and experts still have to be determined.

Conclusions

Our study shows solid content- and face validity of the serious game “UnderWater” for training ultrasound skills, although construct validity could not be demonstrated yet. The game is appreciated as a promising serious game for training eye–hand coordination and learning ultrasound, which may reduce expensive bed-side teaching.

Supplementary Information

The online version contains supplementary material available at 10.1186/s13089-022-00280-8.

A Novel Approach for Engagement in Team Training in High-Technology Surgery: The Robotic-Assisted Surgery Olympics

INTRODUCTION

There is ongoing interest in the development of technical and nontechnical skills in healthcare to improve safety and efficiency; however, barriers to developing and delivering related training programs make them difficult to implement. Unique approaches to training such as "serious games" may offer ways to motivate teams, reinforce skill acquisition, and promote teamwork. Given increased challenges to teamwork in robotic-assisted surgery (RAS), researchers aimed to develop the "RAS Olympics," a game-based educational competition to improve skills needed to successfully perform RAS.

METHODS

This pilot study was conducted at an academic medical center in Southern California. Robotic-assisted surgery staff were invited to participate in the "RAS Olympics" to develop their skills and identify opportunities to improve processes. Impact of the activity was assessed using surveys and debriefs.

RESULTS

Sixteen operating room team members participated and reacted favorably toward the RAS-Olympics (average score, 4.5/5). They enjoyed the activity, would recommend all staff participate, felt that it was relevant to their work, and believed that they practiced and learned new techniques that would improve their practice. Confidence in skills remained unchanged. Participants preferred the RAS Olympics to traditional training because it provided an interactive learning environment.

CONCLUSIONS

The successful implementation of the RAS Olympics provided insight into new opportunities to engage surgical staff members while also training technical and nontechnical skills. Furthermore, this shared experience allowed surgical staff members to gain a greater appreciation for their teammates and an understanding of the current challenges and methods to improve teamwork and communication while promoting safety and efficiency in RAS.