Simulation-Based Training Platforms for Arthroscopy: A Randomized Comparison of Virtual Reality Learning to Benchtop Learning

Immersive virtual reality in orthopedic surgery as elective subject for medical students : First experiences in curricular teaching

BACKGROUND

Virtual reality (VR) simulators have been introduced for skills training in various medical disciplines to create an approximately realistic environment without the risk of patient harm and have improved to more immersive VR (iVR) simulators at affordable costs. There is evidence that training on VR simulators improves technical skills but its use in orthopedic training programs and especially in curricular teaching sessions for medical students are currently not well established. The aim of this study was to describe the implementation of a VR operating theater as an elective course for undergraduate medical students and to evaluate its effect on student learning.

METHODS

An elective course for 12 students was implemented during the summer semester of 2023. Using Oculus Quest 2 headsets (Reality Labs, Meta Platforms, USA) and controllers and the PrecisionOS platform, they were able to train five different surgical procedures. The courses were accompanied by weekly topic discussions and instructional videos. Students were assigned to two groups: group VR vs. group non-VR. The groups were switched after 5 weeks. User feedback and performance development (theoretical and procedural surgical knowledge) after VR training were assessed using three questionnaires.

RESULTS

The students highly appreciated the implementation of VR training into their curriculum and 91% stated that they would opt for further VR training. All students stated that VR training improved their understanding of surgical procedures and that it should be obligatory in surgical training for undergraduate medical students. After 5 weeks of training, students in the VR group achieved significantly better results (100 out of maximum 180 points) than the non-VR group (70 points, p = 0.0495) in procedural surgical knowledge. After completion of the VR training the VR group achieved 106 points and the non-VR group 104 points (p = 0.8564). The procedural knowledge for non-VR group after 5 weeks significantly improved after VR training from 70 to 106 points (p = 0.0087).

CONCLUSION

The iVR can be easily integrated into the curriculum of medical students and is highly appreciated by the participants. The iVR statistically improves the procedural knowledge of surgical steps compared to conventional teaching methods. Further implementation of iVR training in curricular teaching of medical students should be considered.

Virtual and Augmented Reality Simulators Show Intraoperative, Surgical Training, and Athletic Training Applications: A Scoping Review

PURPOSE

To review published literature to identify and evaluate the effect of virtual reality (complete immersion) and augmented reality (overlay of digital information onto the physical world) simulators on intraoperative use for orthopaedic surgeons, orthopaedic surgical education, and athletic training.

METHODS

A systematic review was performed using the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines to identify studies, published since 2014, that evaluated the role of augmented/virtual reality on intraoperative use for orthopaedic surgeons, orthopaedic surgical education, and athletic training.

RESULTS

Virtual reality (VR) simulators provide 3-dimensional graphical simulation of the physical world, and augmented reality (AR) simulators overlay digital information onto the physical world. Simulators can include interactive features (i.e., replication of intraoperative bleeding), haptic feedback, and unrestricted task repetition, and they can record, compare, and analyze performance while being easily accessible and eliminating the need for the presence of a mentor or coach. Four studies reported on VR for intraoperative use, 47 studies on surgical education, and 10 studies on athletic training. Two studies revealed the advantages of using VR simulation during intraoperative procedures, specifically showcasing its benefits for elbow arthroscopy, while 2 studies demonstrated similar positive outcomes for hip arthroscopy. Seventeen studies demonstrated that a VR simulator could be a beneficial tool to assist in surgical education for the knee, while 12 studies found that VR simulation is a valuable tool for aiding in surgical education of shoulder arthroscopy. Ten studies demonstrated that VR simulation improves skills in the operating room. Three studies revealed that individuals with more experience exhibit superior performance on these simulators compared to those with less experience. In the realm of athletic training, 10 studies showcased the potential of VR simulation to play a significant role in athletic performance and injury rehabilitation.

CONCLUSIONS

VR simulation shows benefits in the operating room, is a valuable tool for surgical education resulting in improved skills, and can be used to enhance athletic performance and injury rehabilitation.

CLINICAL RELEVANCE

Understanding that VR simulators can improve surgical outcomes, surgical skill training, and athletic training and rehabilitation could facilitate development and adoption of this advanced technology.

Resident Perceptions of Virtual Reality Versus Dry Lab Simulation for Advanced Shoulder Arthroscopy Resident Training

INTRODUCTION

Surgical training using simulation can fill gaps in traditional surgical residency learning. We hypothesize that arthroscopy training conducted on a virtual reality simulator will be preferred by orthopaedic surgery residents over a traditional dry lab simulation model.

METHODS

38 orthopaedic surgery residents at a single U.S. residency program were randomized to train for a shoulder arthroscopy procedure using either a virtual reality simulator or a table-top dry lab simulator. Training and learning preferences were then asked of the resident participants.

RESULTS

Junior residents were likely to report training preference for the virtual reality simulator compared to senior residents [15/24 (62.5%) v. 8/14 (57.1%); P = .043]. Simulator preference was not influenced by subspecialty interest, prior arthroscopy experience, or simulator experience. Virtual reality simulation was associated with positive attitude towards arthroscopy and high chance of reporting learning gains on general arthroscopic understanding. Senior residents were 4.7 times more likely than juniors to report learning gains via staff discussion pre- and post-operatively. A majority of residents [34/38 (89.5%)] reported, however, wanting more simulation for training surgical skills.

CONCLUSION

Simulation is a desired and potentially valuable adjunct to training orthopaedic residents in arthroscopy. Training needs do evolve; and junior arthroscopists may benefit more from virtual reality platforms for general skills. Senior residents preferred dry lab simulation, possibly because it allowed for handling of actual instruments and implants.

Virtual reality simulation training improve diagnostic knee arthroscopy and meniscectomy skills: a prospective transfer validity study

PURPOSE

Limited data exist on the actual transfer of skills learned using a virtual reality (VR) simulator for arthroscopy training because studies mainly focused on VR performance improvement and not on transfer to real word (transfer validity). The purpose of this single-blinded, controlled trial was to objectively investigate transfer validity in the context of initial knee arthroscopy training.

METHODS

For this study, 36 junior resident orthopaedic surgeons (postgraduate year one and year two) without prior experience in arthroscopic surgery were enrolled to receive standard knee arthroscopy surgery training (NON-VR group) or standard training plus training on a hybrid virtual reality knee arthroscopy simulator (1 h/month) (VR group). At inclusion, all participants completed a questionnaire on their current arthroscopic technical skills. After 6 months of training, both groups performed three exercises that were evaluated independently by two blinded trainers: i) arthroscopic partial meniscectomy on a bench-top knee simulator; ii) supervised diagnostic knee arthroscopy on a cadaveric knee; and iii) supervised knee partial meniscectomy on a cadaveric knee. Training level was determined with the Arthroscopic Surgical Skill Evaluation Tool (ASSET) score.

RESULTS

Overall, performance (ASSET scores) was better in the VR group than NON-VR group (difference in the global scores: p < 0.001, in bench-top meniscectomy scores: p = 0.03, in diagnostic knee arthroscopy on a cadaveric knee scores: p = 0.04, and in partial meniscectomy on a cadaveric knee scores: p = 0.02). Subgroup analysis by postgraduate year showed that the year-one NON-VR subgroup performed worse than the other subgroups, regardless of the exercise.

CONCLUSION

This study showed the transferability of the technical skills acquired by novice residents on a hybrid virtual reality simulator to the bench-top and cadaveric models. Surgical skill acquired with a VR arthroscopy surgical simulator might safely improve arthroscopy competences in the operating room, also helping to standardise resident training and follow their progress.

LEVEL OF EVIDENCE: 2

Assessment of learning in simulator-based arthroscopy training with the diagnostic arthroscopy skill score (DASS) and neurophysiological measures

PURPOSE

Virtual arthroscopic training has become increasingly popular. However, there is a lack of efficiency-based tracking of the trainee, which may be critical for determining the specifics of training programs and adapting them for the needs of each trainee. This study aims to evaluate and compare the measures obtained with a non-invasive neurophysiological method with The Diagnostic Arthroscopy Skill Score (DASS), a commonly used assessment tool for evaluating arthroscopic skills.

METHODS

The study collected simulator performance scores, consisting of "Triangulation Right Hand", "Triangulation Left Hand", "Catch the Stars" and "Three Rings" and DASS scores from 22 participants (11 novices, 11 experts). These scores were obtained while participants underwent a structured program of exercises for the fundamentals of arthroscopic surgery training (FAST) and knee module using a simulator-based arthroscopy device. During the evaluation, data on oxy-hemoglobin and deoxy-hemoglobin levels in the prefrontal cortex were collected using the Functional Near-Infrared Spectroscopy (fNIRS) imaging system. Performance scores, DASS scores, and fNIRS data were subsequently analyzed to determine any correlation between performance and cortex activity.

RESULTS

The simulator performance scores and the DASSPart2 scores were significantly higher in the expert group compared to the novice group (200.1 ± 28.5 vs 172.5 ± 48.9, p = 0.04 and 9.4 ± 5.6 vs. 5.4 ± 5.6 p = 0.02). In the expert group, fNIRS data showed a significantly lower prefrontal cortex activation during fundamental tasks in the FAST module, indicating significantly more efficient mental resource use.

CONCLUSION

The analysis of cognitive workload changes during simulation-based arthroscopy training revealed a significant correlation between the trainees' DASS scores and fNIRS data. This correlation suggests the potential use of fNIRS data and DASS scores as additional metrics to create adaptive training protocols for each participant. By incorporating these metrics, the training process can be optimized, leading to more efficient arthroscopic training and better preparedness for clinical operations.

LEVEL OF EVIDENCE

III.

Extended reality in surgical education: A systematic review

BACKGROUND

This review aims to evaluate the effectiveness of extended reality-based training in surgical education.

METHODS

This systematic review was conducted in line with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines.

RESULTS

A total of 33 studies were included in the qualitative analysis. Nine studies evaluated the effectiveness of virtual reality-based training against no substitutional training. Seven studies looked at training for laparoscopic surgery, and the results were contradicting. Two studies focused on orthopedics training, and the outcomes were positive. Fourteen studies compared the outcomes of virtual reality-based training to conventional didactic teaching, all demonstrating superior outcomes for virtual reality-based training. Nine studies compared the outcomes of virtual reality simulation training to dry lab simulation training. The inferior outcomes of virtual reality simulation training were demonstrated by 5 studies for laparoscopic surgery, 1 study for arthroscopic procedures, 1 study for robotic surgery, and 1 study for dental procedures. One study found potential benefits of virtual reality simulation training on orthopedics surgeries. One study found virtual reality simulation training to be superior to cadaveric training, and 3 studies found augmented reality and virtual reality-based training to be comparable to supervised operative opportunities.

CONCLUSION

Extended reality-based training is a potentially useful modality to serve as an adjunct to the current physical surgical training.

The role of virtual reality in knee arthroscopic simulation: a systematic review

PURPOSE

Surgical training is crucial for orthopedics residents during their educational careers. Residents who follow classic training courses are less skilled than those trained with simulators. Virtual simulators are reported to be global learning tools for knee arthroscopy. The primary purpose of our study is to evaluate the current state of use of arthroscopic knee simulators and their actual effectiveness in transfer the skills learned in training to the operating theatre. The secondary purpose is to evaluate if the virtual simulators are better than the others in improve arthroscopic skills.

METHODS

Studies involving knee arthroscopy training with virtual reality simulators were included: a search of the literature from 2009 to September 2019 was performed on MEDLINE(PubMed) using PRISMA guidelines. Exclusion criteria were systematic review articles, aims and topics not related to the purpose of the study, single case and technical reports, biomechanical analysis, articles not in the English language, and editorial commentaries.

RESULTS

The literature review selected, nine studies and they included results on 93 residents, three expert surgeons and 189 medical students. All studies report improved arthroscopic skills after training with a simulator. Only four studies evaluated the transfer of arthroscopic skills of knee simulators to the operating theatre.

CONCLUSIONS

Benchtop and Virtual Reality simulators are excellent tools for accelerating and improving arthroscopic training and skills acquisition. The second ones, high-cost, and fidelity simulators, seem to be the best of the two. A greater diffusion of Virtual Reality in universities is to be considered to improve residents' training and patients' clinical outcomes.

The frequency of assessment tools in arthroscopic training: a systematic review

BACKGROUND

Multiple assessment tools are used in arthroscopic training and play an important role in feedback. However, it is not fully recognized as to the standard way to apply these tools. Our study aimed to investigate the use of assessment tools in arthroscopic training and determine whether there is an optimal way to apply various assessment tools in arthroscopic training.

METHODS

A search was performed using PubMed, Embase and Cochrane Library electronic databases for articles published in English from January 2000 to July 2021. Eligible for inclusion were primary research articles related to using assessment tools for the evaluation of arthroscopic skills and training environments. Studies that focussed only on therapeutic cases, did not report outcome measures of technical skills, or did not mention arthroscopic skills training were excluded.

RESULTS

A total of 28 studies were included for review. Multiple assessment tools were used in arthroscopic training. The most common objective metric was completion time, reported in 21 studies. Technical parameters based on simulator or external equipment, such as instrument path length, hand movement, visual parameters and injury, were also widely used. Subjective assessment tools included checklists and global rating scales (GRS). Among these, the most commonly used GRS was the Arthroscopic Surgical Skill Evaluation Tool (ASSET). Most of the studies combined objective metrics and subjective assessment scales in the evaluation of arthroscopic skill training.

CONCLUSIONS

Overall, both subjective and objective assessment tools can be used as feedback for basic arthroscopic skill training, but there are still differences in the frequency of application in different contexts. Despite this, combined use of subjective and objective assessment tools can be applied to more situations and skills and can be the optimal way for assessment.

LEVEL OF EVIDENCE

Level III, systematic review of level I to III studies. Key messagesBoth subjective and objective assessment tools can be used as feedback for basic arthroscopic skill training.Combined use of subjective and objective assessment tools can be applied to more situations and skills and can be the optimal way for assessment.

A virtual surgical prototype system based on gesture recognition for virtual surgical training in maxillofacial surgery

Background

Virtual reality (VR) technology is an ideal alternative of operation training and surgical teaching. However, virtual surgery is usually carried out using the mouse or data gloves, which affects the authenticity of virtual operation. A virtual surgery system with gesture recognition and real-time image feedback was explored to realize more authentic immersion.

Method

Gesture recognition technology proposed with an efficient and real-time algorithm and high fidelity was explored. The recognition of hand contour, palm and fingertip was firstly realized by hand data extraction. Then, an Support Vector Machine classifier was utilized to classify and recognize common gestures after extraction of feature recognition. The algorithm of collision detection adopted Axis Aligned Bounding Box binary tree to build hand and scalpel collision models. What’s more, nominal radius theorem (NRT) and separating axis theorem (SAT) were applied for speeding up collision detection. Based on the maxillofacial virtual surgical system we proposed before, the feasibility of integration of the above technologies in this prototype system was evaluated.

Results

Ten kinds of signal static gestures were designed to test gesture recognition algorithms. The accuracy of gestures recognition is more than 80%, some of which were over 90%. The generation speed of collision detection model met the software requirements with the method of NRT and SAT. The response time of gesture] recognition was less than 40 ms, namely the speed of hand gesture recognition system was greater than 25 Hz. On the condition of integration of hand gesture recognition, typical virtual surgical procedures including grabbing a scalpel, puncture site selection, virtual puncture operation and incision were carried out with realization of real-time image feedback.

Conclusion

Based on the previous maxillofacial virtual surgical system that consisted of VR, triangular mesh collision detection and maxillofacial biomechanical model construction, the integration of hand gesture recognition was a feasible method to improve the interactivity and immersion of virtual surgical operation training.

A novel arthroscopy training program based on a 3D printed simulator

Background

Arthroscopy is the most important and exciting contribution to sports medicine of the last 100 years. One of its main limitations, however, is the steep learning curve it requires, which is not easy to beat given the scarcity and the high price of arthroscopy simulators.

Hypothesis/purpose

To describe and evaluate the effectiveness of an open-access arthroscopy training program based on a 3D-printed simulator.

Methods

A model was designed, which was to be printed on a fused filament fabrication (FFF) 3D printer for home use with polylactic acid (PLA) filaments. Fourteen exercises were prepared, each with its timeframe and conceptual goals, arranged from least difficult to most challenging. Exercises were designed to assist subjects in developing the skills of an experienced arthroscopic surgeon through use of the simulator. Twenty subjects from nine hospitals completed the arthroscopy training program. Performance in each exercise was evaluated according to the Arthroscopic Surgical Skill Evaluation Tool (ASSET), taking into account the number of times a student had to repeat each exercise to complete it successfully.

Results

The mean ASSET score for each exercise was 22 points (IQR 19-25) and the mean number of times students had to repeat each exercise was 16 (95% CI 15.27-17.97). Eighty-five percent of subjects completed the program. The device was printed without difficulty by an independent investigator without prior knowledge of 3D printing. The price of the device was under US$ 12.

Conclusion

Subjects exhibited an improvement in their basic arthroscopic skills on the simulator. The number of times each of them had to repeat each exercise was similar, which is indicative of a smooth progression of difficulty along the program. The device proved easy to print, accessible, economical, and effective. This is the first structured program based on an open-access arthroscopic simulator to obtain satisfactory results.

Contemporary Issues in the Acquisition of Orthopaedic Surgical Skills During Residency: Competency-Based Medical Education and Simulation

➤

Orthopaedic education should produce surgeons who are competent to function independently and can obtain and maintain board certification.

➤

Contemporary orthopaedic training programs exist within a fixed 5-year time frame, which may not be a perfect match for each trainee.

➤

Most modern orthopaedic residencies have not yet fully adopted objective, proficiency-based, surgical skill training methods despite nearly 2 decades of evidence supporting the use of this methodology.

➤

Competency-based medical education backed by surgical simulation rooted in proficiency-based progression has the potential to address surgical skill acquisition challenges in orthopaedic surgery.

Low-Fidelity Arthroscopic Simulation Training in Trauma and Orthopaedic Surgery: A Systematic Review of Experimental Studies

PURPOSE

To identify and appraise evidence assessing the effectiveness of low-fidelity arthroscopic simulation in the acquisition of arthroscopic surgical skills in a novice population.

METHODS

Four databases were electronically searched in accordance with the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) algorithm. Studies from any year that described the use of orthopaedic, low-fidelity arthroscopic training models in novice populations were included. Questionnaires, case studies, and review studies were excluded. Risk of bias assessment was conducted using the Cochrane Collaboration's Risk of Bias Tool or the Cochrane Risk of Bias in Non-Randomised Studies of Interventions (ROBINS-I) checklist.

RESULTS

Sixteen studies were identified. Using the PRISMA algorithm, 6 studies were included with a total of 131 novice participants. Individual studies ranged from 8 to 40 novices and were of Level I to II evidence. Outcome measurements varied between studies (total 16 different outcomes used). Various outcome measures used for assessing arthroscopic surgical skills within all 6 studies demonstrated significant improvement. A cross-study subjective outcome synthesis revealed low-fidelity arthroscopic simulators reduced time to completion outcomes (2 studies, P < .05), increased Arthroscopic Surgical Skill Evaluation Tool scores (2 studies, P < .01), and confirmed face validity (2 studies) and transfer of skills to cadavers (2 studies) or live patients (1 study). Cost data were under-reported in all studies apart from one.

CONCLUSIONS

Arthroscopic training using low-fidelity simulators likely improves the performance of novice participants in completing basic arthroscopic procedures. These simulators may also be more cost effective and thus more implementable than their high-fidelity counterparts.

LEVEL OF EVIDENCE

Level II, systematic review of Level I-II studies.

Virtual and augmented reality for surgical training and simulation in knee arthroplasty

BACKGROUND

Immersive virtual reality (IVR), augmented reality and mixed reality form a spectrum of extended reality technology integration that has gained popularity in orthopaedics recently. This review article examines the role of extended reality technologies in knee arthroplasty.

METHODS

Existing literature on the applications of extended reality technologies in preoperative planning and intraoperative navigation were reviewed. A sample workflow of a novel IVR simulator for improving surgical training was also provided to demonstrate its utility in educating trainees on knee arthroplasty techniques.

RESULTS

Extended reality technologies enable the surgeon to visualise patient-specific anatomy in real-time, enhancing preoperative planning and providing intraoperative guidance. IVR technology has the potential to revolutionise modern surgical training and optimise surgical performance in a cost-efficient manner, with current evidence demonstrating favourable immediate skill acquisition and transfer.

CONCLUSIONS

Extended reality technologies have a myriad of potential applications in orthopaedic surgery. Further research is needed to evaluate the cost-effectiveness of its incorporation into training programmes.

Virtual reality (VR) as a simulation modality for technical skills acquisition

Efforts continue to facilitate surgical skills training and provide accessible and safe training opportunities. Educational technology has played an essential role in minimizing the challenges facing traditional surgical training and providing feasible training opportunities. Simulation and virtual reality (VR) offer an important innovative training approach to enhance and supplement both technical and non-technical skills acquisition and overcome the many training challenges facing surgical training programs. To maximize the effectiveness of simulation modalities, an in-depth understanding of the cognitive learning theory is necessary. Knowing the stages and mental processes of skills acquisition when integrated with simulation applications can help trainees achieve maximal learning outcomes. This article aims to review important literature related to VR effectiveness and discuss the leading theories of technical skills acquisition related to VR simulation technologies.

•

VR simulation offers an innovative training approach to supplement both technical and non-technical skills acquisition.

•

VR simulation with haptic feedback is a promising modality for safe, repetitive, and learner-oriented operative training.

•

VR simulation facilitates deliberate practice with built-in auto feedback to address limited staff resources.

•

To maximize the effectiveness of simulation, an in-depth understanding of the cognitive learning theory is necessary.

Use of a Virtual Reality Simulator for Tendon Repair Training: Randomized Controlled Trial

Background

Virtual reality (VR) simulators have become widespread tools for training medical students and residents in medical schools. Students using VR simulators are provided with a 3D human model to observe the details by using multiple senses and they can participate in an environment that is similar to reality.

Objective

The aim of this study was to promote a new approach consisting of a shared and independent study platform for medical orthopedic students, to compare traditional tendon repair training with VR simulation of tendon repair, and to evaluate future applications of VR simulation in the academic medical field.

Methods

In this study, 121 participants were randomly allocated to VR or control groups. The participants in the VR group studied the tendon repair technique via the VR simulator, while the control group followed traditional tendon repair teaching methods. The final assessment for the medical students involved performing tendon repair with the “Kessler tendon repair with 2 interrupted tendon repair knots” (KS) method and the “Bunnell tendon repair with figure 8 tendon repair” (BS) method on a synthetic model. The operative performance was evaluated using the global rating scale.

Results

Of the 121 participants, 117 participants finished the assessment and 4 participants were lost to follow-up. The overall performance (a total score of 35) of the VR group using the KS method and the BS method was significantly higher (P<.001) than that of the control group. Thus, participants who received VR simulator training had a significantly higher score on the global rating scale than those who received traditional tendon repair training (P<.001).

Conclusions

Our study shows that compared with the traditional tendon repair method, the VR simulator for learning tendon suturing resulted in a significant improvement of the medical students in the time in motion, flow of operation, and knowledge of the procedure. Therefore, VR simulator development in the future would most likely be beneficial for medical education and clinical practice.

Trial Registration

Chinese Clinical Trial Registry ChiCTR2100046648; http://www.chictr.org.cn/hvshowproject.aspx?id=90180

Arthroscopic Simulation: The Future of Surgical Training: A Systematic Review

BACKGROUND

Arthroscopic simulation has rapidly evolved recently with the introduction of higher-fidelity simulation models, such as virtual reality simulators, which provide trainees an environment to practice skills without causing undue harm to patients. Simulation training also offers a uniform approach to learn surgical skills with immediate feedback. The aim of this article is to review the recent research investigating the use of arthroscopy simulators in training and the teaching of surgical skills.

METHODS

A systematic review of the Embase, MEDLINE, and Cochrane Library databases for English-language articles published before December 2019 was conducted. The search terms included arthroscopy or arthroscopic in combination with simulation or simulator.

RESULTS

We identified a total of 44 relevant studies involving benchtop or virtually simulated ankle, knee, shoulder, and hip arthroscopy environments. The majority of these studies demonstrated construct and transfer validity; considerably fewer studies demonstrated content and face validity.

CONCLUSIONS

Our review indicates that there is a considerable evidence base regarding the use of arthroscopy simulators for training purposes. Further work should focus on the development of a more uniform simulator training course that can be compared with current intraoperative training in large-scale trials with long-term follow-up at tertiary centers.

Virtual reality simulation-the future of orthopaedic training? A systematic review and narrative analysis

Background

Virtual reality (VR) simulation provides users with an immersive, 3D experience that can be used to allow surgical trainees to practice skills and operations in a safe yet realistic environment. The field of orthopaedics is yet to include VR in core teaching, despite its advantages as a teaching aid, particularly against current simulation tools. This study aims to conduct a systematic review to investigate the efficacy of VR in orthopaedic training, against current methods.

Methods

A systemic review of databases Medline, Embase and the Cochrane Library for randomized controlled trials focusing on VR training against conventional training in orthopaedic surgery was performed. Data synthesis was performed through narrative analysis due to the heterogeneous nature of the data.

Results

A total of 16 studies from 140 titles were identified, across 6 specialty areas. Four hundred and thirty-one participants were included. Control groups included VR, cadaver and benchtop simulators. Forty-seven outcomes were measured, focusing on skill and proficiency assessment. No outcomes focused on patient safety. Although significance between intervention and control was not always achieved, most studies found that the intervention outperformed the control.

Conclusion

VR provides a modern and immersive teaching tool that can develop skills and give confidence to trainees. This study demonstrates the potential for VR simulation as a training aid in orthopaedics and encourages its use alongside conventional teaching methods. However, long-term analysis of the results of VR training on surgical trainees has yet to be conducted. To provide conclusive justification for its inclusion in surgical training, this study recommends that future research follows trainees using VR into the operating room, to determine that VR teaches skills that are transferable onto actual surgeries, subsequently leading to better patient outcomes.

Efficacy and Validity of Orthopaedic Simulators in Surgical Training: A Systematic Review and Meta-Analysis of Randomized Controlled Trials

INTRODUCTION

The purpose of this study was to perform a systematic review and meta-analysis of the effects of training simulators on surgical skill measures across randomized controlled trials. The authors hypothesized that simulated training would (1) result in objective improvements in skill acquisition and (2) be heterogeneous regarding the outcomes and types of validity assessed.

METHODS

The Cochrane Database of Systematic Reviews, the Central Register of Controlled Trials, PubMed, EMBASE, and MEDLINE databases were queried for Level I studies on training simulators between 2007 and 2019 in accordance with the 2009 Preferred Reporting Items for Systematic Review and Meta-Analysis statement. Exclusion criteria were studies without discrete assessment of skills acquisition after surgical simulator training and level of evidence II to V. The Jadad scale was used to assess the methodological quality of all included articles. Data pertaining to patient demographics, validity measures, simulator types, and study-specific outcome measures were extracted. Meta-analyses adjusted for random effects and heterogeneity analyses (I) were used to compare pooled time-to-completion and performance outcomes among included studies.

RESULTS

A total of 24 studies with 494 participants were identified. The most common simulator type involved knee arthroscopy (11 studies, 45.8%). Eight studies reporting time-to-task completion and performance scores were included in the meta-analysis. Virtual reality training was favored in time-to-task completion (mean difference = -82.25 seconds, P = 0.002) and improvement in objective performance scores (mean difference = 1.24, P = 0.02) relative to traditional training. Sensitivity analysis of time-to-task completion based on the length of training interval revealed a mean difference of -45.24 (P = 0.07) and -137.74 (P < 0.001) seconds for the short-term and immediate posttesting subgroups, respectively.

CONCLUSION

Overall, improved task efficiency and performance were observed with the use of orthopaedic simulators. However, simulator type, training protocols, and outcome measures were heterogeneous. Future studies are warranted to evaluate financial cost and longitudinal training programs and to standardize outcomes regarding the use of simulators in orthopaedic education.

LEVEL OF EVIDENCE

Level I.

Skills in Open Surgery do not Predict Arthroscopic Skills in Medical Students

OBJECTIVE

Teaching of basic open surgical skills like skin closure has been well established in medical schools' surgical curricula. The same cannot be said for basic arthroscopic skills even though the importance of arthroscopic surgery in Orthopaedics has been well documented. The goal of this study was to evaluate the relationship between basic skills in open surgery and basic arthroscopic skills in a cohort of medical students. Our hypothesis was that performance in open surgical skills does not correlate with skills in arthroscopic surgery.

DESIGN

The performance of medical students in basic tasks in open surgery (porcine model: subcutaneous and skin suturing) and arthroscopic surgery (bench top model: arthroscopic triangulation and object transfer) was assessed. For both surgical techniques an introductory course was given followed by a standardized assessment. After 1 week both open and arthroscopic tasks were reassessed. All procedures were recorded and scored by 2 independent observers in a blinded fashion.

SETTING

The study was performed at the skills lab of the Clinic for Orthopaedics and Tumororthopaedics at University Hospital Muenster in Muenster Germany.

PARTICIPANTS

A cohort of 21 medical students (average age 22.2 years) participated in this study. The cohort consisted of 17 female (81%) and 4 male (19%) students. All students were in the clinical part of their study and had not received any prior surgical education.

RESULTS

Interobserver reliability was very high for the arthroscopic tasks and high for the open surgery tasks. No correlation was found between open and arthroscopic skills. For the first assessment the correlation coefficient was r = 0.197 (p = 0.391). For the second assessment the correlation coefficient was r = 0.212 (p = 0.356). Significant improvement from first to second assessment was only found for the arthroscopic tasks (p < 0.0001) while improvement in the open surgery performance failed to reach statistical significance (p = 0.184).

CONCLUSIONS

The results of this study suggest that performance in open surgical skills does not correlate with performance in arthroscopic skills and should be taught independent from each other. Arthroscopic skills can effectively be taught with bench top training systems in a time- and resource efficient manner, with measurable results even in a 1-day-course setup. Arthroscopic skills training may be offered in undergraduate curricula in addition to open surgical skills training to students with an interest in Orthopaedics.

Lessons taught by a knee arthroscopy simulator about participants in a European arthroscopy training programme

BACKGROUND

Arthroscopy simulators offer safe and reproducible training to orthopaedic residents, thereby obviating the need for cadaver specimens. In addition, they collect data that can serve to investigate learning curves and evaluate training programmes with the goal of improving the quality of arthroscopy teaching. In this study, a cohort of surgeons was evaluated before and after a European theoretical and practical training programme that used a knee arthroscopy simulator. The primary objective was to assess whether the overall performance score was improved by the training programme. The secondary objectives were to determine which tasks and skills were improved by the programme, to compare a novice group to an experienced group, and to identify targets for improvement.

HYPOTHESIS

A theoretical and practical training course improves the scores achieved on an arthroscopy simulator task.

METHODS

A prospective comparative study was performed in 34 surgeons during the advanced arthroscopy training course organised by the European Paediatric Orthopaedic Society (EPOS) in January 2018. All participants performed a diagnostic task on the VirtaMed ArthroS™ simulator before and after the programme. The participants were divided into two groups based on number of knee arthroscopies performed each year, i.e.,>20 (experienced group) vs.≤20 (inexperienced group). The following parameters were compared between the two groups: overall score, operative time, percentage of iatrogenic injuries, camera and hook path lengths, and success in identifying anatomical structures.

RESULTS

The overall score on the diagnostic task was 199 before and 203 after the training programme (p=0.02). The operative time decreased significantly, from 185 to 115.9seconds (p<0.01). Camera path length decreased from 85.2 to 49.2cm and hook path length from 65.5 to 15.0cm (p<0.05). The mean proportion of arthroscopies with iatrogenic tibial cartilage injuries diminished from 2.7%±1.7% (range, 0-6.7) to 1.8%±1.8% (range, 0-7) (p=0.03); no change occurred in femoral injuries. When each group was assessed separately, the only significant change found in the experienced group was a decrease in operative time, whereas in the inexperienced group all parameters improved significantly. However, visualisation of anatomical structures was unchanged.

CONCLUSION

Participation in the training programme improved overall performance, and the gains were greatest in the inexperienced group. During the post-training evaluation, some of the major anatomical structures were classified by the simulator as incompletely visualised, raising concern about a risk of underdiagnosis during arthroscopic explorations.

LEVEL OF EVIDENCE

III, prospective comparative study.

Evaluating learning and change in orthopaedics: What is the evidence-base?

Learning and change are key elements of clinical governance and are responsible for the progression of our specialty. Although orthopaedics has been slow to embrace quality improvement, recent years have seen global developments in surgical education, quality improvement, and patient outcome research. This review covers recent advances in the evaluation of learning and change and identifies the most important research questions that remain unanswered. Research into proxies of learning is improving but more work is required to identify the best proxy for a given procedure. Learning curves are becoming commonplace but are poorly integrated into postgraduate training curricula and there is little agreement over the most appropriate method to analyse learning curve data. With various organisations promoting centralisation of care, learning curve analysis is more important than ever before. The use of simulation in orthopaedics is developing but is yet to be formally mapped to resident training worldwide. Patient outcome research is rapidly changing, with an increased focus on quality of life measures. These are key to patients and their care. Cost-utility analysis is increasingly seen in orthopaedic manuscripts and this needs to continue to improve evidence-based care. Large-scale international, multi-centre randomised trials are gaining popularity and updated guidance on sample size estimation needs to become widespread. A global lack of surgeon equipoise will need to be addressed. Quality improvement projects frequently employ interrupted time-series analysis to evaluate change. This technique's limitations must be acknowledged, and more work is required to improve the evaluation of change in a dynamic healthcare environment where multiple interventions frequently occur. Advances in the evaluation of learning and change are needed to drive improved international surgical education and increase the reliability, validity, and importance of the conclusions drawn from orthopaedic research.

Does Arthroscopic Simulation Training Improve Triangulation and Probing Skills? A Randomized Controlled Trial✰

OBJECTIVE

To determine the effectiveness of simulator training on basic arthroscopic skills utilizing a novel, low-cost arthroscopic triangulation training system.

DESIGN

A randomized controlled trial of subjects without prior arthroscopy training was conducted, with participants randomized to receive either a fixed protocol of simulation training on a triangulation simulation model (30 minutes of training for 4 consecutive days), or no training. On Days 1 and 5, all participants were evaluated on 3 simulated arthroscopic tasks by an independent observer. Variables analyzed included how many times portals were changed, the time it took to complete the tasks, and the task completion rate.

SETTING

Arthrex Inc., Naples, FL.

PARTICIPANTS

Thirty-six participants (92% male, average 28 ± 5 years) with no prior arthroscopy training were randomized into 2 groups, with 17 in the training group (T) and 19 in the no-training group (NT).

RESULTS

On Day 1, there was no difference in rate of task completion between the T group and NT groups (41% versus 53%, p = 0.52). On Day 5, significantly more participants in the T group completed all tasks compared to the NT group (100% versus 63%, p = 0.008). Participants in the T group had significantly improved task completion times on Day 5 versus Day 1 (p < 0.05). Participants in the NT group had a significantly improved task completion time for Task 1 on Day 5 versus Day 1 (p = 0.037); no differences were found for Tasks 2 or 3. On Day 5, participants in the T group required significantly fewer portal changes compared to the NT group (2.35 ± 2.29 versus 6.95 ± 8.55, p = 0.039).

CONCLUSIONS

Simulation training on a simple, low-cost arthroscopic triangulation training system resulted in an overall improvement in arthroscopic probing and triangulation skills within 1 week of training, with significantly decreased task completion times and increased efficiency of movement.

Can an Augmented Reality Headset Improve Accuracy of Acetabular Cup Orientation in Simulated THA? A Randomized Trial

BACKGROUND

Accurate implant orientation reduces wear and increases stability in arthroplasty but is a technically demanding skill. Augmented reality (AR) headsets overlay digital information on top of the real world. We have developed an enhanced AR headset capable of tracking bony anatomy in relation to an implant, but it has not yet been assessed for its suitability as a training tool for implant orientation.

QUESTIONS/PURPOSES

(1) In the setting of simulated THA performed by novices, does an AR headset improve the accuracy of acetabular component positioning compared with hands-on training by an expert surgeon? (2) What are trainees' perceptions of the AR headset in terms of realism of the task, acceptability of the technology, and its potential role for surgical training?

METHODS

Twenty-four study participants (medical students in their final year of school, who were applying to surgery residency programs, and who had no prior arthroplasty experience) participated in a randomized simulation trial using an AR headset and a simulated THA. Participants were randomized to two groups completing four once-weekly sessions of baseline assessment, training, and reassessment. One group trained using AR (with live holographic orientation feedback) and the other received one-on-one training from a hip arthroplasty surgeon. Demographics and baseline performance in orienting an acetabular implant to six patient-specific values on the phantom pelvis were collected before training and were comparable. The orientation error in degrees between the planned and achieved orientations was measured and was not different between groups with the numbers available (surgeon group mean error ± SD 16° ± 7° versus AR 14° ± 7°; p = 0.22). Participants trained by AR also completed a validated posttraining questionnaire evaluating their experiences.

RESULTS

During the four training sessions, participants using AR-guidance had smaller mean (± SD) errors in orientation than those receiving guidance from the surgeon: 1° ± 1° versus AR 6° ± 4°, p < 0.001. In the fourth session's assessment, participants in both groups had improved (surgeon group mean improvement 6°, 95% CI, 4-8°; p < 0.001 versus AR group 9°, 95% CI 7-10°; p < 0.001). There was no difference between participants in the surgeon-trained and AR-trained group: mean difference 1.2°, 95% CI, -1.8 to 4.2°; p = 0.281. In posttraining evaluation, 11 of 12 participants would use the AR platform as a training tool for developing visuospatial skills and 10 of 12 for procedure-specific rehearsals. Most participants (11 of 12) stated that a combination of an expert trainer for learning and AR for unsupervised training would be preferred.

CONCLUSIONS

A novel head-mounted AR platform tracked an implant in relation to bony anatomy to a clinically relevant level of accuracy during simulated THA. Learners were equally accurate, whether trained by AR or a surgeon. The platform enabled the use of real instruments and gave live feedback; AR was thus considered a feasible and valuable training tool as an adjunct to expert guidance in the operating room. Although there were no differences in accuracy between the groups trained using AR and those trained by an expert surgeon, we believe the tool may be useful in education because it demonstrates that some motor skills for arthroplasty may be learned in an unsupervised setting. Future studies will evaluate AR-training for arthroplasty skills other than cup orientation and its transfer validity to real surgery.

LEVEL OF EVIDENCE

Level I, therapeutic study.

Efficacy of a Virtual Arthroscopic Simulator for Orthopaedic Surgery Residents by Year in Training

BACKGROUND

Virtual reality arthroscopic simulators are an attractive option for resident training and are increasingly used across training programs. However, no study has analyzed the utility of simulators for trainees based on their level of training/postgraduate year (PGY).

PURPOSE/HYPOTHESIS

The primary aim of this study was to determine the utility of the ArthroS arthroscopic simulator for orthopaedic trainees based on their level of training. We hypothesized that residents at all levels would show similar improvements in performance after completion of the training modules.

STUDY DESIGN

Descriptive laboratory study.

METHODS

Eighteen orthopaedic surgery residents performed diagnostic knee and shoulder tasks on the ArthroS simulator. Participants completed a series of training modules and then repeated the diagnostic tasks. Correlation coefficients (r 2) were calculated for improvements in the mean composite score (based on the Imperial Global Arthroscopy Rating Scale [IGARS]) as a function of PGY.

RESULTS

The mean improvement in the composite score for participants as a whole was 11.2 ± 10.0 points (P = .0003) for the knee simulator and 14.9 ± 10.9 points (P = .0352) for the shoulder simulator. When broken down by PGY, all groups showed improvement, with greater improvements seen for junior-level residents in the knee simulator and greater improvements seen for senior-level residents in the shoulder simulator. Analysis of variance for the score improvement variable among the different PGY groups yielded an f value of 1.640 (P = .2258) for the knee simulator data and an f value of 0.2292 (P = .917) for the shoulder simulator data. The correlation coefficient (r 2) was -0.866 for the knee score improvement and 0.887 for the shoulder score improvement.

CONCLUSION

Residents training on a virtual arthroscopic simulator made significant improvements in both knee and shoulder arthroscopic surgery skills.

CLINICAL RELEVANCE

The current study adds to mounting evidence supporting virtual arthroscopic simulator-based training for orthopaedic residents. Most significantly, this study also provides a baseline for evidence-based targeted use of arthroscopic simulators based on resident training level.

Utility of Modern Arthroscopic Simulator Training Models: A Meta-analysis and Updated Systematic Review

PURPOSE

To determine the utility of modern arthroscopic simulators in transferring skills learned on the model to the operating room.

METHODS

A meta-analysis and systematic review of all English-language studies relevant to validated arthroscopic simulation models using PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-analyses) guidelines from 1999 to 2016 was performed. Data collected included the specific simulator model, the joint used, participant demographic characteristics, participant level of training, training session information, type and number of tasks, pre- and post-training assessments, and overall outcomes of simulator performance. Three independent reviewers analyzed all studies.

RESULTS

Fifty-seven studies with 1,698 participants met the study criteria and were included. Of the studies, 25 (44%) incorporated an arthroscopic training program into the study methods whereas 32 (56%) did not. In 46 studies (81%), the studies' respective simulator models were used to assess arthroscopic performance, whereas 9 studies (16%) used Sawbones models, 8 (14%) used cadaveric models, and 4 (7%) evaluated subject performance on a live patient in the operating room. In 21 studies (37%), simulator performance was compared with experience level, with 20 of these (95%) showing that clinical experience correlated with simulator performance. In 25 studies (44%), task performance was evaluated before and after simulator training, with 24 of these (96%) showing improvement after training. All 4 studies that included live-patient arthroscopy reported improved operating room performance after simulator training compared with the performance of subjects not participating in a training program.

CONCLUSIONS

This review suggests that (1) training on arthroscopic simulators improves performance on arthroscopic simulators and (2) performance on simulators for basic diagnostic arthroscopy correlates with experience level. Limited data suggest that simulator training can improve basic diagnostic arthroscopy skills in vivo.

LEVEL OF EVIDENCE

Level IV, systematic review of Level I through IV studies.

Development of a physical shoulder simulator for the training of basic arthroscopic skills

BACKGROUND

Orthopaedic training programs are incorporating arthroscopic simulations into their residency curricula. There is a need for a physical shoulder simulator that accommodates lateral decubitus and beach chair positions, has realistic anatomy, allows for an objective measure of performance and provides feedback to trainees.

METHODS

A physical shoulder simulator was developed for training basic arthroscopic skills. Sensors were embedded in the simulator to provide a means to assess performance. Subjects of varying skill level were invited to use the simulator and their performance was objectively assessed.

RESULTS

Novice subjects improved their performance after practice with the simulator. A survey completed by experts recognized the simulator as a valuable tool for training basic arthroscopic skills.

CONCLUSIONS

The physical shoulder simulator helps train novices in basic arthroscopic skills and provides objective measures of performance. By using the physical shoulder simulator, residents could improve their basic arthroscopic skills, resulting in improved patient safety.

Editorial Commentary: "A Brush Too Broad" (Validation, Global Rating Scales, and the Like…What Do They Really Mean?)

Surgical simulation will play an increasingly important role in helping to train surgical skills. Tools of varying fidelity including benchtop models and virtual reality computer-generated simulations will be needed to most effectively train for accomplishing specific tasks and techniques. We must search for and identify how best to employ simulation to enable the trainee to master the requisite skills. It is imperative that in our investigation, validation methodologies, rating scales, and statistical tools be rigorously and accurately employed lest we be led astray by acceptance and assumption too freely given. The measure of our effectiveness will be whether or not patients enjoy improved outcomes and experience a reduction in surgical errors and complications.