Teaching point-of-care ultrasound using a serious game: a randomized controlled trial

BACKGROUND

Point-of-care ultrasound (POCUS) is an important diagnostic tool for internists. However, there are important barriers in learning POCUS, including lack of practice time and lack of experts for supervision. Alternative learning tools may assist in overcoming these barriers. A serious game is being developed specifically for teaching ultrasound. In this study, we assessed the use of a serious game in learning POCUS.

METHODS

Ultrasound-native medical students were randomly assigned to the intervention group (N = 27) or the control group (N = 26). Both groups performed a real ultrasound on a volunteer after a brief introduction, but the intervention group played a serious game in advance. The endpoints were the assessments of the videos by experts (scoring quality of the probe movements) and the research team (counting probe movements), and probe movements measured with an accelerometer.

RESULTS

The intervention group completed the exam faster (247 s vs. 347 s, p = 0.006 (95% CI: [30.20;168.80]) and lifted the probe less frequently from the model (0.54 vs. 3.79, p = 0.001 (95% CI: [1.39;5.11]). Also, we found an in-game learning effect between levels, showing a 48% decrease in total playing time (p < 0.001), 36% reduction in attempts per coin (p = 0.007), a 33% reduction in total probe distance (p = 0.002), and a 61% decrease in contact moments (p < 0.001). However, there was no significant difference in expert score between the two groups.

CONCLUSION

The serious game 'Underwater' is a fun and useful addition to traditional bedside ultrasound learning, which also may overcome one of the most important barriers in learning ultrasound: lack of supervised practice time. We show that the game improves real-practice probe handling with faster and more goal-oriented probe movements.

The Big Bang of Deep Learning in Ultrasound-Guided Surgery: A Review

Ultrasound (US) imaging is a paramount modality in many image-guided surgeries and percutaneous interventions, thanks to its high portability, temporal resolution, and cost-efficiency. However, due to its imaging principles, the US is often noisy and difficult to interpret. Appropriate image processing can greatly enhance the applicability of the imaging modality in clinical practice. Compared with the classic iterative optimization and machine learning (ML) approach, deep learning (DL) algorithms have shown great performance in terms of accuracy and efficiency for US processing. In this work, we conduct a comprehensive review on deep-learning algorithms in the applications of US-guided interventions, summarize the current trends, and suggest future directions on the topic.

Relating process and outcome metrics for meaningful and interpretable cannulation skill assessment: A machine learning paradigm

BACKGROUND AND OBJECTIVES

The quality of healthcare delivery depends directly on the skills of clinicians. For patients on hemodialysis, medical errors or injuries caused during cannulation can lead to adverse outcomes, including potential death. To promote objective skill assessment and effective training, we present a machine learning approach, which utilizes a highly-sensorized cannulation simulator and a set of objective process and outcome metrics.

METHODS

In this study, 52 clinicians were recruited to perform a set of pre-defined cannulation tasks on the simulator. Based on data collected by sensors during their task performance, the feature space was then constructed based on force, motion, and infrared sensor data. Following this, three machine learning models- support vector machine (SVM), support vector regression (SVR), and elastic net (EN)- were constructed to relate the feature space to objective outcome metrics. Our models utilize classification based on the conventional skill classification labels as well as a new method that represents skill on a continuum.

RESULTS

With less than 5% of trials misplaced by two classes, the SVM model was effective in predicting skill based on the feature space. In addition, the SVR model effectively places both skill and outcome on a fine-grained continuum (versus discrete divisions) that is representative of reality. As importantly, the elastic net model enabled the identification of a set of process metrics that highly impact outcomes of the cannulation task, including smoothness of motion, needle angles, and pinch forces.

CONCLUSIONS

The proposed cannulation simulator, paired with machine learning assessment, demonstrates definite advantages over current cannulation training practices. The methods presented here can be adopted to drastically increase the effectiveness of skill assessment and training, thereby potentially improving clinical outcomes of hemodialysis treatment.

Gamification of health professions education: a systematic review

Gamification refers to using game attributes in a non-gaming context. Health professions educators increasingly turn to gamification to optimize students' learning outcomes. However, little is known about the concept of gamification and its possible working mechanisms. This review focused on empirical evidence for the effectiveness of gamification approaches and theoretical rationales for applying the chosen game attributes. We systematically searched multiple databases, and included all empirical studies evaluating the use of game attributes in health professions education. Of 5044 articles initially identified, 44 met the inclusion criteria. Negative outcomes for using gamification were not reported. Almost all studies included assessment attributes (n = 40), mostly in combination with conflict/challenge attributes (n = 27). Eight studies revealed that this specific combination had increased the use of the learning material, sometimes leading to improved learning outcomes. A relatively small number of studies was performed to explain mechanisms underlying the use of game attributes (n = 7). Our findings suggest that it is possible to improve learning outcomes in health professions education by using gamification, especially when employing game attributes that improve learning behaviours and attitudes towards learning. However, most studies lacked well-defined control groups and did not apply and/or report theory to understand underlying processes. Future research should clarify mechanisms underlying gamified educational interventions and explore theories that could explain the effects of these interventions on learning outcomes, using well-defined control groups, in a longitudinal way. In doing so, we can build on existing theories and gain a practical and comprehensive understanding of how to select the right game elements for the right educational context and the right type of student.

Are fiducial registration error and target registration error correlated? SciKit-SurgeryFRED for teaching and research

Understanding the relationship between fiducial registration error (FRE) and target registration error (TRE) is important for the correct use of interventional guidance systems. Whilst it is well established that TRE is statistically independent of FRE, system users still struggle against the intuitive assumption that a low FRE indicates a low TRE. We present the SciKit-Surgery Fiducial Registration Educational Demonstrator and describe its use. SciKit-SurgeryFRED was developed to enable remote teaching of key concepts in image registration. SciKit-SurgeryFRED also supports research into user interface design for image registration systems. SciKit-SurgeryFRED can be used to enable remote tutorials covering the statistics relevant to image guided interventions. Students are able to place fiducial markers on pre and intra-operative images and observe the effects of changes in marker geometry, marker count, and fiducial localisation error on TRE and FRE. SciKit-SurgeryFRED also calculates statistical measures for the expected values of TRE and FRE. Because many registrations can be performed quickly the students can then explore potential correlations between the different statistics. SciKit-SurgeryFRED also implements a registration based game, where participants are rewarded for complete treatment of a clinical target, whilst minimising the treatment margin. We used this game to perform a remote study on registration and simulated ablation, measuring how user performance changes depending on what error statistics are made available. The results support the assumption that knowing the exact value of target registration error leads to better treatment. Display of other statistics did not have a significant impact on the treatment performance.

Serious Games for Improving Technical Skills in Medicine: Scoping Review

BACKGROUND

Serious games are being used to train specific technical skills in medicine, and most research has been done for surgical skills. It is not known if these games improve technical skills in real life as most games have not been completely validated.

OBJECTIVE

This scoping review aimed to evaluate the current use of serious games for improving technical skills in medicine and to determine their current validation state using a validation framework specifically designed for serious games.

METHODS

We used the Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews (PRISMA-ScR) guidelines. A multidatabase search strategy was adopted, after which a total of 17 publications were included in this review.

RESULTS

These 17 publications described five different serious games for improving technical skills. We discuss these games in detail and report about their current validation status. Only one game was almost fully validated. We also discuss the different frameworks that can be used for validation of serious games.

CONCLUSIONS

Serious games are not extensively used for improving technical skills in medicine, although they may represent an attractive alternative way of learning. The validation of these games is mostly incomplete. Additionally, several frameworks for validation exist, but it is unknown which one is the best. This review may assist game developers or educators in validating serious games.

A Serious Game on the First-Aid Procedure in Choking Scenarios: Design and Evaluation Study

Background

Choking is one of the causes of unintentional injury death. Gaining the knowledge of the first-aid procedure that has to be applied in case of choking can increase the chances of survival of persons with choking. Serious games can be a good channel for educating people about choking scenarios and the actions to be taken to save the persons with choking.

Objective

The objective of this study is to present and evaluate the effectiveness of a serious game designed to prevent choking and to promote the first-aid procedure that needs to be applied in case of choking.

Methods

In this study, we present a serious game as a set of minigames that reproduces the main steps of the protocol for the first-aid performed in choking. In the proposed game, the player acquires the role of a helper who has to save the person in a choking emergency by applying the main steps of the protocol. Time and score restrictions are imposed to pass each minigame. To test this game, we performed a pilot study with 48 high school students. Different tests were performed to assess the students’ preferences and their knowledge on choking before and after playing the proposed game. The obtained results were analyzed using Mann-Whitney U test when a grade variable was involved and by using Fisher exact test when 2 categorical variables were involved.

Results

The findings of our study showed that the players enjoyed the game. No statistical differences were detected when considering the gender of the player, their preferences for video games, or their previous experience in choking emergencies. By comparing the knowledge of these students before and after playing the game, we found that all the indicators of the knowledge about how to act in case of a choking emergency were improved through this serious game.

Conclusions

The findings of our study show that the proposed game is a good strategy for promoting and teaching first-aid procedures in choking emergencies to nonexperts in this field.

SnappySonic: An Ultrasound Acquisition Replay Simulator

SnappySonic provides an ultrasound acquisition replay simulator designed for public engagement and training. It provides a simple interface to allow users to experience ultrasound acquisition without the need for specialist hardware or acoustically compatible phantoms. The software is implemented in Python, built on top of a set of open source Python modules targeted at surgical innovation. The library has high potential for reuse, most obviously for those who want to simulate ultrasound acquisition, but it could also be used as a user interface for displaying high dimensional images or video data.

An Epiduroscopy Simulator Based on a Serious Game for Spatial Cognitive Training (EpiduroSIM): User-Centered Design Approach

Background

Performing high-level surgeries with endoscopy is challenging, and hence, an efficient surgical training method or system is required. Serious game–based simulators can provide a trainee-centered educational environment unlike traditional teacher-centered education environments since serious games provide a high level of interaction (feedback that induces learning).

Objective

This study aimed to propose an epiduroscopy simulator, EpiduroSIM, based on a serious game for spatial cognitive training.

Methods

EpiduroSIM was designed based on a serious game. For spatial cognitive training, the virtual environment of EpiduroSIM was modeled based on a cognitive map.

Results

EpiduroSIM was developed considering user accessibility to provide various functions. The experiment for the validation of EpiduroSIM focused on psychological fidelity and repetitive training effects. The experiments were conducted by dividing 16 specialists into 2 groups of 8 surgeons. The group was divided into beginner and expert based on their epiduroscopy experience. The psychological fidelity of EpiduroSIM was confirmed through the training results of the expert group rather than the beginner group. In addition, the repetitive training effect of EpiduroSIM was confirmed by improving the training results in the beginner group.

Conclusions

EpiduroSIM may be useful for training beginner surgeons in epiduroscopy.

Serious gaming for orthotopic liver transplant anesthesiology: A randomized control trial

Anesthetic management of orthotopic liver transplantation (OLT) is complex. Given the unequal distributions of liver transplant surgeries performed at different centers, anesthesiology providers receive relatively uneven OLT training and exposure. One well-suited modality for OLT training is the "serious game," an interactive application created for the purpose of imparting knowledge or skills, while leveraging the self-motivating elements of video games. We therefore developed a serious game designed to teach best practices for the anesthetic management of a standard OLT and determined if the game would improve resident performance in a simulated OLT. Forty-four residents on the liver transplant rotation were randomized to either the gaming group (GG) or the control group (CG) prior to their introductory simulation. Both groups were given access to the same educational materials and literature during their rotation, but the GG also had access to the OLT Trainer. Performance on the simulations were recorded on a standardized grading rubric. Both groups experienced an increase in score relative to baseline that was statistically significant at every stage. The improvements in scores were greater for the GG participants than the CG participants. Overall score improvement between the GG and CG (mean [standard deviation]) was statistically significant (GG, 7.95 [3.65]; CG, 4.8 [4.48]; P = 0.02), as were scores for preoperative assessment (GG, 2.67 [2.09]; CG, 1.17 [1.43]; P = 0.01) and anhepatic phase (GG, 1.62 [1.01]; CG, 0.75 [1.28]; P = 0.02). Of the residents with game access, 81% were "very satisfied" or "satisfied" with the game overall. In conclusion, adding a serious game to an existing educational curriculum for liver transplant anesthesia resulted in significant learning gains for rotating anesthesia residents. The intervention was straightforward to implement and cost-effective. Liver Transplantation 23 430-439 2017 AASLD.

A Systematic Review of Serious Games in Training Health Care Professionals

STATEMENT

Serious games are computer-based games designed for training purposes. They are poised to expand their role in medical education. This systematic review, conducted in accordance with PRISMA guidelines, aimed to synthesize current serious gaming trends in health care training, especially those pertaining to developmental methodologies and game evaluation. PubMed, EMBASE, and Cochrane databases were queried for relevant documents published through December 2014. Of the 3737 publications identified, 48 of them, covering 42 serious games, were included. From 2007 to 2014, they demonstrate a growth from 2 games and 2 genres to 42 games and 8 genres. Overall, study design was heterogeneous and methodological quality by MERQSI score averaged 10.5/18, which is modest. Seventy-nine percent of serious games were evaluated for training outcomes. As the number of serious games for health care training continues to grow, having schemas that organize how educators approach their development and evaluation is essential for their success.

Visualization of needle access pathway and a five-DoF evaluation

It is a common practice nowadays to plan needle access pathways to the volumetric organs before performing surgeries. An enormous amount of needle access planning systems has been proposed in recent years. Recent works mainly focus on the system usability or target accessibility. Visualization of the planned access pathways has drawn little attention and its effect on insertion quality is left unattended. We aim to address this problem by introducing an all-round evaluation framework that links up with human motions and computer graphics. Our evaluation framework provides an objective and quantitative analysis of the illustrativeness of the needle access pathway visualization techniques to an extent of five degrees of freedom. Our experimental results show that the visualization method adopted greatly influences insertion accuracy. Based on this finding, we propose a new visualization technique that intuitively conveys placement and orientation information. We also show that our method better conveys pathway orientation and thus enables a higher quality of insertion.

Mobile computing for radiology

The rapid advances in mobile computing technology have the potential to change the way radiology and medicine as a whole are practiced. Several mobile computing advances have not yet found application to the practice of radiology, while others have already been applied to radiology but are not in widespread clinical use. This review addresses several areas where radiology and medicine in general may benefit from adoption of the latest mobile computing technologies and speculates on potential future applications.