Development and evaluation of a simulator-based laparoscopic training program for surgical novices

An interactive augmented reality software for facial reconstructive surgeries

BACKGROUND AND OBJECTIVE

Surgical trainees need a lot of training and practice before being able to operate independently. The current approach of surgical education mainly involves didactic teaching and psychomotor training through physical models or real tissue. Due to the unavailability of physical resources and lack of objective ways of evaluation, there is a demand for developing alternative training methods for surgeons. In this paper, we present an application that provides additional training opportunities to surgical trainees in the field of facial reconstructive surgeries.

METHODS

We built a mobile augmented reality application that helps the user to visualize important concepts and experiment with different surgical plans for facial reconstructive surgeries. The application can overlay relaxed skin tension lines on a live video input or a patient's photo, which serve as bases for aligning a skin flap. A surgical trainee can interactively compare different skin flap design choices with estimated final scars on a photo of a patient. Data collection capability is also added to the application, and we performed a Monte Carlo experiment with simulated users (five classes of 100 users each) as an example of objectively measuring user performance.

RESULTS

The application can overlay relaxed skin tension lines on a patient's face in real time on a modern mobile device. Accurate overlays were achieved in over 91% as well as 84% and 88% out of 263 generated face images, depending on the method. Visual comparisons of the three overlay methods are presented on sample faces from different population groups. From the Monte Carlo experiment, we see that user actions in each class follow a normal distribution with a distinct set of parameters.

CONCLUSIONS

This application can serve as a basis for teaching surgical trainees the fundamentals of different facial reconstructive procedures, especially concepts related to relaxed skin tension lines and skin flaps. It can objectively evaluate the performance of surgical trainees in a course. This setup focuses on illustrating the relationship between the orientation of skin flaps and relaxed skin tension lines, which is a prerequisite of minimizing scarring in patients in addition to good surgical techniques.

Conception and prospective multicentric validation of a Robotic Surgery Training Curriculum (RoSTraC) for surgical residents: from simulation via laboratory training to integration into the operation room

There is a lack of training curricula and educational concepts for robotic-assisted surgery (RAS). It remains unclear how surgical residents can be trained in this new technology and how robotics can be integrated into surgical residency training. The conception of a training curriculum for RAS addressing surgical residents resulted in a three-step training curriculum including multimodal learning contents: basics and simulation training of RAS (step 1), laboratory training on the institutional robotic system (step 2) and structured on-patient training in the operating room (step 3). For all three steps, learning content and video tutorials are provided via cloud-based access to allow self-contained training of the trainees. A prospective multicentric validation study was conducted including seven surgical residents. Transferability of acquired skills to a RAS procedure were analyzed using the GEARS score. All participants successfully completed RoSTraC within 1 year. Transferability of acquired RAS skills could be demonstrated using a RAS gastroenterostomy on a synthetic biological organ model. GEARS scores concerning this procedure improved significantly after completion of RoSTraC (17.1 (±5.8) vs. 23.1 (±4.9), p < 0.001). In step 3 of RoSTraC, all participants performed a median of 12 (range 5-21) RAS procedures on the console in the operation room. RoSTraC provides a highly standardized and comprehensive training curriculum for RAS for surgical residents. We could demonstrate that participating surgical residents acquired fundamental and advanced RAS skills. Finally, we could confirm that all surgical residents were successfully and safely embedded into the local RAS team.

Video-based learning of coping strategies for common errors improves laparoscopy training-a randomized study

AIMS

The aim of this study was to investigate whether shifting the focus to solution orientation and developing coping strategies for common errors could increase the efficiency of laparoscopic training and influence learning motivation. The concept of coping has been particularly defined by the psychologist Richard Lazarus [Lazarus and Folkman in Stress, appraisal, and coping, Springer publishing company, New York, 1984]. Based on this model, we examined the use of observational learning with a coping model for its effectiveness as a basic teaching model in laparoscopic training.

METHODS

55 laparoscopically naive medical students learned a standardized laparoscopic knot tying technique with video-based instructions. The control group was only offered a mastery video that showed the ideal technique and was free from mistakes. The intervention group was instructed on active error analysis and watched freely selectable videos of common errors including solution strategies (coping model) in addition to the mastery videos.

RESULTS

There was no statistically significant difference between the intervention and control groups for number of knot tying attempts until proficiency was reached (18.8 ± 5.5 vs. 21.3 ± 6.5, p = 0.142). However, there was a significantly higher fraction of knots achieving technical proficiency in the intervention group after first use of the coping model (0.7 ± 0.1 vs. 0.6 ± 0.2, p = 0.026). Additionally, the proportion of blinded attempts that met the criteria for technical proficiency was significantly higher for the intervention group at 60.9% vs. 38.0% in control group (p = 0.021). The motivational subscore "interest" of the validated score on current motivation (QCM) was significantly higher for the intervention group (p = 0.032), as well as subjective learning benefit (p = 0.002) and error awareness (p < 0.001).

CONCLUSION

Using video-based learning of coping strategies for common errors improves learning motivation and understanding of the technique with a significant difference in its qualitative implementation in laparoscopy training. The ability to think in a solution-oriented, independent way is necessary in surgery in order to recognize and adequately deal with technical difficulties and complications.

Effectiveness of an inexpensive short-term theoretical-practical course on videosurgery for surgeons in training

BACKGROUND

The rapid development of video surgery and minimally invasive surgical techniques prompted many studies on the methods of teaching these techniques to young surgeons in training. However, the characteristics of a short-term course that is both easily accessible and efficient for this group of surgeons remain controversial. To investigate this issue, a short-term training method was proposed for first year surgery residents, using inexpensive handmade wooden simulation boxes with the students smartphones as cameras. Its effectiveness was evaluated, as well as possible factors that could influence student performance, such as gender and previous experience with video games.

METHODS

Thirty-six first-year General Surgery residents, entering in 2019 and 2020, participated in the study: 21 were males and 15 were females with ages between 22 and 29 years old, (mean 25.47 years). All participants performed a pre-established exercise (placing two simple stitches using a laparoscopic simulator), which was timed and scored. They then participated in a short theoretical-practical course, consisting of an initial lecture followed by 4 exercises on handcrafted wooden laparoscopic video surgery simulators. Afterwards, they were asked to repeat the same exercise from the first step. Finally, they answered a questionnaire that included questions on previous videogame experience. The data were tabulated and submitted to statistical analysis.

RESULTS

In the pre-training exercise, 15 (41.66%) participants were able to perform the two simple stitches in the simulator box within the maximum time limit of 5 minutes. After the short course, 22 (61.11%) of participants were able to perform the complete exercise. Improvement in the time to complete the practical exercise was statistically significant (p = 0.0296) after participating in the theoretical-practical course. A better pre- and post-training performance was demonstrated by the 17 participants with experience with video games (p = 0.0116), and a better post-training performance was demonstrated by female participants (p = 0.0405).

CONCLUSION

This short-term inexpensive theoretical-practical course in laparoscopic training for surgeons in training was effective in reducing the execution time of a laparoscopic stitch in a simulation box. Previous experience with video games and/or female gender appear to be associated with improved performance.

The Fundamentals of Vaginal Surgery pilot study: developing, validating, and setting proficiency scores for a vaginal surgical skills simulation system

BACKGROUND

Surgical training in the simulation lab can develop basic skills that translate to the operating room. Standardized, basic skills programs that are supported by validated assessment measures exist for open, laparoscopic, and endoscopic surgery; however, there is yet to be a nationally recognized and widely implemented basic skills program specifically for vaginal surgery.

OBJECTIVE

Develop a vaginal surgical simulation system; evaluate robust validity evidence for the simulation system and its related performance measures; and establish a proficiency score that discriminates between novice and experienced vaginal surgeon performance.

STUDY DESIGN

In this 3-phased study, we developed the Fundamentals of Vaginal Surgery simulation system consisting of (1) the Fundamentals of Vaginal Surgery Trainer, a task trainer; (2) a validated regimen of tasks to be performed on the trainer; and (3) performance measures to determine proficiency. In Phase I, we developed the task trainer and selected surgical tasks by performing a needs assessment and hierarchical task analyses, with review and consensus from an expert panel. In Phase II, we conducted a national survey of vaginal surgeons to collect validity evidence regarding test content, response process, and internal structure relevant to the simulation system. In Phase III, we compared performance of novice (first and second year residents) and experienced (third and fourth year residents, fellows, and faculty) surgeons on the simulation system to evaluate relevant relationships to other variables and consequences. Performance measures were analyzed to set a proficiency score that would discriminate between novice and expert (faculty) vaginal surgical performance.

RESULTS

A novel task trainer and 6 basic vaginal surgical skills were developed in Phase I. In Phase II, the survey responses of 48 participants (27 faculty surgeons, 6 fellows, and 14 residents) were evaluated on the dimensions of test content, response process, and internal structure. To support evidence of test content, the participants deemed the task trainer and surgical tasks representative of intended surgical field and supportive of typical surgical actions (mean scores, 3.8-4.4/5). For response process, rater-data analysis revealed high rating variability regarding prototype color. This early evidence confirmed the value of a white prototype. For internal structure, there was high agreement among rater groups (obstetricians and gynecologists generalists vs Female Pelvic Medicine and Reconstructive Surgery specialists: interclass correlation coefficient range, 0.59-0.91; learners vs faculty interclass correlation coefficient range, 0.64-1.0). There were no differences in ratings across institution type, surgeon volume, expertise (P>.14). In Phase III, we analyzed performance from 23 participants (15 [65%] obstetricians and gynecologists residents, 3 [13%] fellows, and 5 [22%] Female Pelvic Medicine and Reconstructive Surgery faculty). Experienced surgeons scored significantly higher than novice surgeons (median, 467.5; interquartile range, [402.5-542.5] vs median, 261.5; interquartile range, [211.5-351.0]; P<.001). Based on these data, setting a proficiency score threshold at 400 results in 0% (0/6) novices attaining the score, with 100% (5/5) experts exceeding it.

CONCLUSION

We present validity evidence relevant to all 5 sources which supports the use of this novel simulation system for basic vaginal surgical skills. To complement the system, a proficiency score of 400 was established to discriminate between novices and experts.

Assessment of technical skills based on learning curve analyses in laparoscopic surgery training

BACKGROUND

Objective force- and motion-based assessment is currently lacking in laparoscopic skills curricula. This study aimed to evaluate the added value of parameter-based assessment and feedback during training.

METHODS

Laparoscopy-naïve surgical residents that took part in a 3-week skills training curriculum were included. A box trainer equipped with the ForceSense system was used for assessment of tissue manipulation- (MaxForce) and instrument-handling skills (Path length and Time). Learning curves were established using linear regression tests. Pre- and post-course comparisons indicated the overall progression and were compared to predefined proficiency levels. A post-course survey was carried out to assess face validity.

RESULTS

In total, 4,268 trials, executed by 24 residents, were successfully assessed. Median (interquartile range) MaxForce outcomes improved from 2.7 Newton (interquartile range 1.9-3.8) to 1.8 Newton (interquartile range 1.2-2.4) between pre- and post-course assessment (P ≤ .009). Instrument Path length improved from 7,102.2 mm (interquartile range 5,255.2-9,025.9) to 3,545.3 mm (interquartile range 2,842.9-4,563.2) (P ≤.001). Time to execute the task improved from 159.8 seconds (interquartile range 119.8-219.0) to 60.7 seconds (interquartile range 46.0-79.5) (P ≤ .001). The learning curves revealed during what training phase the proficiency benchmarks were reached for each trainee. In the survey outcomes, trainees indicated that this curriculum should be part of a surgical residency program (mean visual analog scale score of 9.2 ± 0.9 standard deviation).

CONCLUSION

Force-, motion-, and time-parameters can be objectively measured during basic laparoscopic skills curricula and do indicate progression of skills over time. The ForceSense parameters enable curricula to be designed for specific proficiency-based training goals and offer the possibility for objective classification of the levels of expertise.

Efficacy of goal-directed minimally invasive surgery simulation training with the Lübeck Toolbox-Curriculum prior to first operations on patients: Study protocol for a multi-centre randomized controlled validation trial (NOVICE)

•

Laparoscopic surgery (MIS) requires additional psychomotoric skills (basic skills)

•

Acquisition of MIS basic skills by the video box trainer Lübecker Toolbox.

•

Simulation of laparoscopic demands outside the operation room.

•

MIS training outside the operation room prior to first operations on patients.

•

Implementation of MIS training into the surgical residency curriculum.

Background

Minimally invasive surgery (MIS) procedures require special psychomotoric skills. Learning of these MIS basic skills is often performed in the operating room (OR). This is economically inefficient and could be improved in terms of patient safety. Against the background of this problem, various MIS simulators have been developed to train MIS basic skills outside the OR. Aim of this study is to evaluate to what extent MIS training programs and simulators improve the residents’ skills in performing their first MIS procedures on patients.

Method

The current multicentric RCT will be performed with surgical residents without prior active experience in MIS (n = 14). After the participants have completed their first laparoscopic cholecystectomy as baseline evaluation (CHE I), they will be randomized into two groups: 1) The intervention group will perform the Lübeck Toolbox curriculum, whereas 2) the control group will not undergo any MIS training. After 6 weeks, both groups will perform the second laparoscopic CHE (CHE II). Changes or improvements in operative performance (between CHE I and CHE II) will be analyzed and evaluated according to the Global Operative Assessment of Laparoscopic Skill (GOALS) Score (primary endpoint).

Discussion

The multicentric randomized controlled trial will help to determine the value of MIS training outside the operation room. Proof of effectiveness in practice transfer could be of considerable relevance with regard to an integration of MIS training programs into surgical education.

Augmented reality in medical education: a systematic review

INTRODUCTION

The field of augmented reality (AR) is rapidly growing with many new potential applications in medical education. This systematic review investigated the current state of augmented reality applications (ARAs) and developed an analytical model to guide future research in assessing ARAs as teaching tools in medical education.

METHODS

A literature search was conducted using PubMed, Embase, Web of Science, Cochrane Library, and Google Scholar. This review followed PRISMA guidelines and included publications from January 1, 2000 to June 18, 2018. Inclusion criteria were experimental studies evaluating ARAs implemented in healthcare education published in English. Our review evaluated study quality and determined whether studies assessed ARA validity using criteria established by the GRADE Working Group and Gallagher et al., respectively. These findings were used to formulate an analytical model to assess the readiness of ARAs for implementation in medical education.

RESULTS

We identified 100,807 articles in the initial literature search; 36 met inclusion criteria for final review and were categorized into three categories: Surgery (23), Anatomy (9), and Other (4). The overall quality of the studies was poor and no ARA was tested for all five stages of validity. Our analytical model evaluates the importance of research quality, application content, outcomes, and feasibility of an ARA to gauge its readiness for implementation.

CONCLUSION

While AR technology is growing at a rapid rate, the current quality and breadth of AR research in medical training is insufficient to recommend the adoption into educational curricula. We hope our analytical model will help standardize AR assessment methods and define the role of AR technology in medical education.

Systematic review on the effectiveness of augmented reality applications in medical training

Background

Computer-based applications are increasingly used to support the training of medical professionals. Augmented reality applications (ARAs) render an interactive virtual layer on top of reality. The use of ARAs is of real interest to medical education because they blend digital elements with the physical learning environment. This will result in new educational opportunities. The aim of this systematic review is to investigate to which extent augmented reality applications are currently used to validly support medical professionals training.

Methods

PubMed, Embase, INSPEC and PsychInfo were searched using predefined inclusion criteria for relevant articles up to August 2015. All study types were considered eligible. Articles concerning AR applications used to train or educate medical professionals were evaluated.

Results

Twenty-seven studies were found relevant, describing a total of seven augmented reality applications. Applications were assigned to three different categories. The first category is directed toward laparoscopic surgical training, the second category toward mixed reality training of neurosurgical procedures and the third category toward training echocardiography. Statistical pooling of data could not be performed due to heterogeneity of study designs. Face-, construct- and concurrent validity was proven for two applications directed at laparoscopic training, face- and construct validity for neurosurgical procedures and face-, content- and construct validity in echocardiography training. In the literature, none of the ARAs completed a full validation process for the purpose of use.

Conclusion

Augmented reality applications that support blended learning in medical training have gained public and scientific interest. In order to be of value, applications must be able to transfer information to the user. Although promising, the literature to date is lacking to support such evidence.

Competency Testing for Pediatric Cardiology Fellows Learning Transthoracic Echocardiography: Implementation, Fellow Experience, and Lessons Learned

There is currently great interest in measuring trainee competency at all levels of medical education. In 2007, we implemented a system for assessing cardiology fellows' progress in attaining imaging skills. This paradigm could be adapted for use by other cardiology programs.

METHODS

Evaluation consisted of a two-part exercise performed after years 1 and 2 of pediatric cardiology training. Part 1: a directly observed evaluation of technical skills as fellows imaged a normal subject (year 1) and a patient with complex heart disease (year 2). Part 2: fellows interpreted and wrote reports for two echocardiograms illustrating congenital heart disease. These were graded for accuracy and facility with communicating pertinent data. After 5 years of testing, fellows were surveyed about their experience. In 5 years, 40 fellows were tested at least once. Testing identified four fellows who underperformed on the technical portion and four on the interpretive portion. Surveys were completed by 33 fellows (83 %). Most (67 %) felt that intermittent observation by faculty was inadequate for assessing skills and that procedural volume was a poor surrogate for competency (58 %). Posttest feedback was constructive and valuable for 90, and 70 % felt the process helped them set goals for skill improvement. Overall, fellows felt this testing was fair and should continue. Fellow performance and responses identified programmatic issues that were creating barriers to learning. We describe a practical test to assess competency for cardiology fellows learning echocardiography. This paradigm is feasible, has excellent acceptance among trainees, and identifies trainees who need support. Materials developed could be easily adapted to help track upcoming ACGME-mandated metrics.

Augmented reality visualization of deformable tubular structures for surgical simulation

BACKGROUND

Surgical simulation based on augmented reality (AR), mixing the benefits of physical and virtual simulation, represents a step forward in surgical training. However, available systems are unable to update the virtual anatomy following deformations impressed on actual anatomy.

METHODS

A proof-of-concept solution is described providing AR visualization of hidden deformable tubular structures using nitinol tubes sensorized with electromagnetic sensors. This system was tested in vitro on a setup comprised of sensorized cystic, left and right hepatic, and proper hepatic arteries. In the trial session, the surgeon deformed the tubular structures with surgical forceps in 10 positions.

RESULTS

The mean, standard deviation, and maximum misalignment between virtual and real arteries were 0.35, 0.22, and 0.99 mm, respectively.

CONCLUSION

The alignment accuracy obtained demonstrates the feasibility of the approach, which can be adopted in advanced AR simulations, in particular as an aid to the identification and isolation of tubular structures. Copyright © 2015 John Wiley & Sons, Ltd.

Effects of mobile augmented reality learning compared to textbook learning on medical students: randomized controlled pilot study

BACKGROUND

By adding new levels of experience, mobile Augmented Reality (mAR) can significantly increase the attractiveness of mobile learning applications in medical education.

OBJECTIVE

To compare the impact of the heightened realism of a self-developed mAR blended learning environment (mARble) on learners to textbook material, especially for ethically sensitive subjects such as forensic medicine, while taking into account basic psychological aspects (usability and higher level of emotional involvement) as well as learning outcomes (increased learning efficiency).

METHODS

A prestudy was conducted based on a convenience sample of 10 third-year medical students. The initial emotional status was captured using the "Profile of Mood States" questionnaire (POMS, German variation); previous knowledge about forensic medicine was determined using a 10-item single-choice (SC) test. During the 30-minute learning period, the students were randomized into two groups: the first group consisted of pairs of students, each equipped with one iPhone with a preinstalled copy of mARble, while the second group was provided with textbook material. Subsequently, both groups were asked to once again complete the POMS questionnaire and SC test to measure changes in emotional state and knowledge gain. Usability as well as pragmatic and hedonic qualities of the learning material was captured using AttrakDiff2 questionnaires. Data evaluation was conducted anonymously. Descriptive statistics for the score in total and the subgroups were calculated before and after the intervention. The scores of both groups were tested against each other using paired and unpaired signed-rank tests. An item analysis was performed for the SC test to objectify difficulty and selectivity.

RESULTS

Statistically significant, the mARble group (6/10) showed greater knowledge gain than the control group (4/10) (Wilcoxon z=2.232, P=.03). The item analysis of the SC test showed a difficulty of P=0.768 (s=0.09) and a selectivity of RPB=0.2. For mARble, fatigue (z=2.214, P=.03) and numbness (z=2.07, P=.04) decreased with statistical significance when comparing pre- and post-tests. Vigor rose slightly, while irritability did not increase significantly. Changes in the control group were insignificant. Regarding hedonic quality (identification, stimulation, attractiveness), there were significant differences between mARble (mean 1.179, CI -0.440 to 0.440) and the book chapter (mean -0.982, CI -0.959 to 0.959); the pragmatic quality mean only differed slightly.

CONCLUSIONS

The mARble group performed considerably better regarding learning efficiency; there are hints for activating components of the mAR concept that may serve to fascinate the participants and possibly boost interest in the topic for the remainder of the class. While the small sample size reduces our study's conclusiveness, its design seems appropriate for determining the effects of interactive eLearning material with respect to emotions, learning efficiency, and hedonic and pragmatic qualities using a larger group.

TRIAL REGISTRATION

German Clinical Trial Register (DRKS), DRKS-ID: DRKS00004685; https://drks-neu.uniklinik-freiburg.de/drks_web/navigate.do?navigationId=trial.HTML&TRIAL_ID=DRKS00004685.