Virtual reality assessment of technical skill using the Bonedoc DHS simulator

Setting proficiency standards for simulation-based mastery learning of short antegrade femoral nail osteosynthesis: a multicenter study

BACKGROUND AND PURPOSE

Orthopedic trainees frequently perform short antegrade femoral nail osteosynthesis of trochanteric fractures, but virtual reality simulation-based training (SBT) with haptic feedback has been unavailable. We explored a novel simulator, with the aim of gathering validity evidence for an embedded test and setting a credible pass/fail standard allowing trainees to practice to proficiency.

PATIENTS AND METHODS

The research, conducted from May to September 2020 across 3 Danish simulation centers, utilized the Swemac TraumaVision simulator for short antegrade femoral nail osteosynthesis. The validation process adhered to Messick's framework, covering all 5 sources of validity evidence. Participants included novice groups, categorized by training to plateau (n = 14) or to mastery (n = 10), and experts (n = 9), focusing on their performance metrics and training duration.

RESULTS

The novices in the plateau group and experts had hands-on training for 77 (95% confidence interval [CI] 59-95) and 52 (CI 36-69) minutes while the plateau test score, defined as the average of the last 4 scores, was 75% (CI 65-86) and 96% (CI 94-98) respectively. The pass/fail standard was established at the average expert plateau test score of 96%. All novices in the mastery group could meet this standard and interestingly without increased hands-on training time (65 [CI 46-84] minutes).

CONCLUSION

Our study provides supporting validity evidence from all sources of Messick's framework for a simulation-based test in short antegrade nail osteosynthesis of intertrochanteric hip fracture and establishes a defensible pass/fail standard for mastery learning of SBT. Novices who practiced using mastery learning were able to reach the pre-defined pass/fail standard and outperformed novices without a set goal for external motivation.

Application of Virtual Reality Systems in Bone Trauma Procedures

Background and Objectives: Bone fractures contribute significantly to the global disease and disability burden and are associated with a high and escalating incidence and tremendous economic consequences. The increasingly challenging climate of orthopaedic training and practice re-echoes the established potential of leveraging computer-based reality technologies to support patient-specific simulations for procedural teaching and surgical precision. Unfortunately, despite the recognised potential of virtual reality technologies in orthopaedic surgery, its adoption and integration, particularly in fracture procedures, have lagged behind other surgical specialities. We aimed to review the available virtual reality systems adapted for orthopaedic trauma procedures. Materials and Methods: We performed an extensive literature search in Medline (PubMed), Science Direct, SpringerLink, and Google Scholar and presented a narrative synthesis of the state of the art on virtual reality systems for bone trauma procedures. Results: We categorised existing simulation modalities into those for fracture fixation techniques, drilling procedures, and prosthetic design and implantation and described the important technical features, as well as their clinical validity and applications. Conclusions: Over the past decade, an increasing number of high- and low-fidelity virtual reality systems for bone trauma procedures have been introduced, demonstrating important benefits with regard to improving procedural teaching and learning, preoperative planning and rehearsal, intraoperative precision and efficiency, and postoperative outcomes. However, further technical developments in line with industry benchmarks and metrics are needed in addition to more standardised and rigorous clinical validation.

Application of Virtual and Augmented Reality Technology in Hip Surgery: Systematic Review

BACKGROUND

Virtual and augmented reality (VAR) represents a combination of current state-of-the-art computer and imaging technologies and has the potential to be a revolutionary technology in many surgical fields. An increasing number of investigators have developed and applied VAR in hip-related surgery with the aim of using this technology to reduce hip surgery-related complications, improve surgical success rates, and reduce surgical risks. These technologies are beginning to be widely used in hip-related preoperative operation simulation and training, intraoperative navigation tools in the operating room, and postoperative rehabilitation.

OBJECTIVE

With the aim of reviewing the current status of virtual reality (VR) and augmented reality (AR) in hip-related surgery and summarizing its benefits, we discussed and briefly described the applicability, advantages, limitations, and future perspectives of VR and AR techniques in hip-related surgery, such as preoperative operation simulation and training; explored the possible future applications of AR in the operating room; and discussed the bright prospects of VR and AR technologies in postoperative rehabilitation after hip surgery.

METHODS

We searched the PubMed and Web of Science databases using the following key search terms: ("virtual reality" OR "augmented reality") AND ("pelvis" OR "hip"). The literature on basic and clinical research related to the aforementioned key search terms, that is, studies evaluating the key factors, challenges, or problems of using of VAR technology in hip-related surgery, was collected.

RESULTS

A total of 40 studies and reports were included and classified into the following categories: total hip arthroplasty, hip resurfacing, femoral neck fracture, pelvic fracture, acetabular fracture, tumor, arthroscopy, and postoperative rehabilitation. Quality assessment could be performed in 30 studies. Among the clinical studies, there were 16 case series with an average score of 89 out of 100 points (89%) and 1 case report that scored 81 (SD 10.11) out of 100 points (81%) according to the Joanna Briggs Institute Critical Appraisal Checklist. Two cadaveric studies scored 85 of 100 points (85%) and 92 of 100 points (92%) according to the Quality Appraisal for Cadaveric Studies scale.

CONCLUSIONS

VR and AR technologies hold great promise for hip-related surgeries, especially for preoperative operation simulation and training, feasibility applications in the operating room, and postoperative rehabilitation, and have the potential to assist orthopedic surgeons in operating more accurately and safely. More comparative studies are necessary, including studies focusing on clinical outcomes and cost-effectiveness.

Analysis of Tools Used in Assessing Technical Skills and Operative Competence in Trauma and Orthopaedic Surgical Training: A Systematic Review

BACKGROUND

Robust assessment of skills acquisition and surgical performance during training is vital to ensuring operative competence among orthopaedic surgeons. A move to competency-based surgical training requires the use of tools that can assess surgical skills objectively and systematically. The aim of this systematic review was to describe the evidence for the utility of assessment tools used in evaluating operative performance in trauma and orthopaedic surgical training.

METHODS

We performed a comprehensive literature search of MEDLINE, Embase, and Google Scholar databases to June 2019. From eligible studies we abstracted data on study aim, assessment format (live theater or simulated setting), skills assessed, and tools or metrics used to assess surgical performance. The strengths, limitations, and psychometric properties of the assessment tools are reported on the basis of previously defined utility criteria.

RESULTS

One hundred and five studies published between 1990 and 2019 were included. Forty-two studies involved open orthopaedic surgical procedures, and 63 involved arthroscopy. The majority (85%) were used in the simulated environment. There was wide variation in the type of assessment tools in used, the strengths and weaknesses of which are assessor and setting-dependent.

CONCLUSIONS

Current technical skills-assessment tools in trauma and orthopaedic surgery are largely procedure-specific and limited to research use in the simulated environment. An objective technical skills-assessment tool that is suitable for use in the live operative theater requires development and validation, to ensure proper competency-based assessment of surgical performance and readiness for unsupervised clinical practice.

CLINICAL RELEVANCE

Trainers and trainees can gain further insight into the technical skills assessment tools that they use in practice through the utility evidence provided.

A pilot study to evaluate the face & construct validity of an orthopaedic virtual reality simulator

AIMS

This study aimed to identify the face and construct validity of the Precision OS trauma module proximal femoral nail procedure. Secondary outcomes included perceived use of simulation in surgical training, with structured feedback from participants.

METHODS

A comparative interventional study was carried out in a regional orthopaedics trauma unit hospital. Volunteers were stratified into novice, intermediate and expert groups based on self-reported levels of experience. Each participant carried out a simulated proximal femoral nail on an immersive virtual platform following instruction on its use, with objective metrics such as time and x-rays, and novel metrics calculated by the simulation module recorded. Face validity was also assessed.

RESULTS

The proximal femoral nail module demonstrated construct validity. Kruskal Wallis test demonstrated a statistically significant difference across all group's novel performance (p=.018). Intermediate surgeons performed significantly better than novices (P=.022), with shorter procedural times (P=.018) Three of the intermediate group achieved the proficiency level set by the expert group, with no significant difference noted between these two groups (=.06). Time taken to completion for expert surgeons was less than intermediate group, although this did not reach significance (P=.19).

CONCLUSION

The proximal femoral nail module on the Precision OS platform demonstrated good face, and construct validity. Further research evaluating use of virtual platform simulation in surgical trauma training is needed.

A review of participant recruitment transparency for sound validation of hip surgery simulators: a novel umbrella approach

Malposition of implants is associated with complications, higher wear and increased revision rates in total hip replacement (THR) along with surgeon inexperience. Training THR residents to reach expert proficiency is affected by the high cost and resource limitations of traditional training techniques. Research in extended reality (XR) technologies can overcome such barriers. These offer a platform for learning, objective skill-monitoring and, potentially, for automated certification. Prior to their incorporation into curricula however, thorough validation must be undertaken. As validity is heavily dependent on the participants recruited, there is a need to review, scrutinise and define recruitment criteria in the absence of pre-defined standards, for sound simulator validation. A systematic review on PubMed and IEEE databases was conducted. Training simulator validation research in fracture, arthroscopy and arthroplasty relating to the hip was included. 46 validation studies were reviewed. It was observed that there was no uniformity in reporting or recruitment criteria, rendering cross-comparison challenging. This work developed Umbrella categories to help prioritise recruitment, and has formulated a detailed template of fields and guidelines for reporting criteria so that, in future, research may come to a consensus as to recruitment criteria for a hip "expert" or "novice".

Virtual Reality and Augmented Reality-Translating Surgical Training into Surgical Technique

PURPOSE OF REVIEW

As immersive learning outside of the operating room is increasingly recognized as a valuable method of surgical training, virtual reality (VR) and augmented reality (AR) are increasingly utilized in orthopedic surgical training. This article reviews the evolving nature of these training tools and provides examples of their use and efficacy. The practical and ethical implications of incorporating this technology and its impact on both orthopedic surgeons and their patients are also discussed.

RECENT FINDINGS

Head-mounted displays (HMDs) represent a possible adjunct to surgical accuracy and education. While the hardware is advanced, there is still much work to be done in developing software that allows for seamless, reliable, useful integration into clinical practice and training. Surgical training is changing: AR and VR will become mainstays of future training efforts. More evidence is needed to determine which training technology translates to improved clinical performance. Volatility within the HMD industry will likely delay advances in surgical training.

Simulation Training in Fracture Surgery

The current surgical training environment has sparked a paradigm shift toward the use of surgical training simulation. An apprentice-based model has historically been used in surgical education, but current financial and practical constraints have led to a more variable training experience. Surgical simulation has demonstrated efficacy in many facets of orthopaedic training and has most recently been implemented to fine-tune surgical skill in reconstruction of traumatic skeletal injuries. Although some surgical skills learned during residency training are not fully used in later practice, most surgeons require a baseline level of competence in managing skeletal trauma. Fracture surgery is heavily dependent on technical skill. Trainee simulation use in skill acquisition has potential to improve proficiency during actual surgery. Furthermore, in a specialty where the standard axiom has been repetition matters, education augmentation with simulation provides overall benefit. Work remains to maximize the effectiveness of surgical simulation in fracture treatment through improved model integration and access.

Innovation in Orthopaedic Surgery Education: Novel Tools for Modern Times

Orthopaedic residency training has and will continue to evolve with a wide variety of changes. Hands-on surgical simulation "boot camps," computerized simulation of surgical process, and even virtual reality simulators, all can help trainees acquire surgical experience without compromising patient care. Low-cost training modules help remedy the rising costs associated with teaching complex orthopaedic surgery skills. Motion tracking and checklists help refine standardization of assessment. As technology and healthcare systems continue to grow, we encourage training programs to keep pace by considering engagement of these tools.

A review of computer-assisted orthopaedic surgery systems

BACKGROUND

Computer-assisted orthopaedic surgery systems have great potential, but no review has focused on computer-assisted surgery systems for the spine, hip, and knee.

METHODS

A systematic search was performed in Web of Science and PubMed. We searched the literature on computer-assisted orthopaedic surgery systems from 2008 to the present and focused on three aspects of systems: training, planning, and intraoperative navigation.

RESULTS AND DISCUSSION

In this review study, we reviewed 34 surgical training systems, 31 surgical planning systems, and 41 surgical navigation systems. The functions and characteristics of the surgical systems were compared and analysed, and the current concerns about and the impact of the surgical systems on doctors and surgery were clarified.

CONCLUSION

Computer-assisted orthopaedic surgery systems are still in the development stage. Future surgical training systems should include synthetic models with patient anatomy. Surgical planning systems with automatic planning should be developed, and surgical navigation systems with multimodal fusion, robotic assistance and imaging should be developed.

Hip-fracture osteosynthesis training: exploring learning curves and setting proficiency standards

Background and purpose - Orthopedic surgeons must be able to perform internal fixation of proximal femoral fractures early in their career, but inexperienced trainees prolong surgery and cause increased reoperation rates. Simulation-based virtual reality (VR) training has been proposed to overcome the initial steep part of the learning curve but it is unknown how much simulation training is necessary before trainees can progress to supervised surgery on patients. We determined characteristics of learning curves for novices and experts and a pass/fail mastery-learning standard for junior trainees was established. Methods - 38 first-year residents and 8 consultants specialized in orthopedic trauma surgery performed cannulated screws, Hansson pins, and sliding hip screw on the Swemac TraumaVision VR simulator. A previously validated test was used. The participants repeated the procedures until they reached their learning plateau. Results - The novices and the experts reached their learning plateau after an average of 169 minutes (95% CI 152-87) and 143 minutes (CI 109-177), respectively. Highest achieved scores were 92% (CI 91-93) for novices and 96% (CI 94-97) for experts. Plateau score, defined as the average of the 4 last scores, was 85% (CI 82-87) and 92% (CI 89-96) for the novices and the experts, respectively. Interpretation - Training time to reach plateau varied widely and it is paramount that simulation-based training continues to a predefined standard instead of ending after a fixed number of attempts or amount of time. A score of 92% comparable to the experts' plateau score could be used as a mastery learning pass/fail standard.

Teaching basic trauma: validating FluoroSim, a digital fluoroscopic simulator for guide-wire insertion in hip surgery

Background and purpose - Simulation is an adjunct to surgical education. However, nothing can accurately simulate fluoroscopic procedures in orthopedic trauma. Current options for training with fluoroscopy are either intraoperative, which risks radiation, or use of expensive and unrealistic virtual reality simulators. We introduce FluoroSim, an inexpensive digital fluoroscopy simulator without the need for radiation. Patients and methods - This was a multicenter study with 26 surgeons in which everyone completed 1 attempt at inserting a guide-wire into a femoral dry bone using surgical equipment and FluoroSim. 5 objective performance metrics were recorded in real-time to assess construct validity. The surgeons were categorized based on the number of dynamic hip screws (DHS) performed: novices (< 10), intermediates (10-39) and experts (≥ 40). A 7-point Likert scale questionnaire assessed the face and content validity of FluoroSim. Results - Construct validity was present for 2 clinically validated metrics in DHS surgery. Experts and intermediates statistically significantly outperformed novices for tip-apex distance and for cut-out rate. Novices took the least number of radiographs. Face and content validity were also observed. Interpretation - FluoroSim discriminated between novice and intermediate or expert surgeons based on tip-apex distance and cut-out rate while demonstrating face and content validity. FluoroSim provides a useful adjunct to orthopedic training. Our findings concur with results from studies using other simulation modalities. FluoroSim can be implemented for education easily and cheaply away from theater in a safe and controlled environment.

Does virtual reality simulation have a role in training trauma and orthopaedic surgeons?

Aims

The aim of this study was to assess the current evidence relating to the benefits of virtual reality (VR) simulation in orthopaedic surgical training, and to identify areas of future research.

Materials and Methods

A literature search using the MEDLINE, Embase, and Google Scholar databases was performed. The results' titles, abstracts, and references were examined for relevance.

Results

A total of 31 articles published between 2004 and 2016 and relating to the objective validity and efficacy of specific virtual reality orthopaedic surgical simulators were identified. We found 18 studies demonstrating the construct validity of 16 different orthopaedic virtual reality simulators by comparing expert and novice performance. Eight studies have demonstrated skill acquisition on a simulator by showing improvements in performance with repeated use. A further five studies have demonstrated measurable improvements in operating theatre performance following a period of virtual reality simulator training.

Conclusion

The demonstration of 'real-world' benefits from the use of VR simulation in knee and shoulder arthroscopy is promising. However, evidence supporting its utility in other forms of orthopaedic surgery is lacking. Further studies of validity and utility should be combined with robust analyses of the cost efficiency of validated simulators to justify the financial investment required for their use in orthopaedic training. Cite this article: Bone Joint J 2018;100-B:559-65.

Evaluating Internal Fixation Skills Using Surgical Simulation

BACKGROUND

Open reduction and internal fixation (ORIF) is an essential skill for an orthopaedic surgeon, yet teaching its components to surgical residents poses challenges in both complexity and cost. Surgical simulation has demonstrated efficacy and is now a mandated component of residency programs, but the techniques and resources required for effective simulation vary greatly. We hypothesized that simulation of ORIF skills could be accomplished in a cost-effective, quantifiable, and reproducible manner and that this experience coupled with didactic learning would increase skill proficiency and enhance ORIF performance.

METHODS

Sixteen postgraduate-year-1 orthopaedic surgery interns were assessed on performance of ORIF simulation tasks before and after attending a module designed to introduce and practice internal fixation techniques. Simulation tasks addressed drilling accuracy via oblique drilling through polyvinyl chloride (PVC) cylinders and bisecting wooden dowels and plunge control via drilling through layered boards of varying densities. Fracture fixation simulation involved fixing oblique fractures on synthetic ulnae. Task performance was assessed at 3 time points: immediately before the module, 1 week after the module, and 3 months after the module. Fracture fixation was assessed before and after the module via load-to-failure testing. Success rates for the tasks were analyzed using a repeated-measures analysis of variance, and mechanical properties of the fixed ulnar constructs were compared using paired t tests.

RESULTS

In all ORIF simulation tasks, pre-module to post-module improvement in success rates was significant (p < 0.001) and improvements were maintained between the post-module assessment and the 3-month follow-up. The interns also achieved significantly greater strengths in their ulnar fixation constructs, with a mean improvement of 256 N (p = 0.01) after the module.

CONCLUSIONS

These results indicate that the technical and sensorimotor skills relevant to internal fixation (with emphasis on the specific skill of using a drill) can be significantly augmented and retained in the short term in surgical residents after exposure to faculty-led lecture and hands-on skills practice using low-cost materials.

CLINICAL RELEVANCE

This study provides evidence for an effective, accessible method of enhancing and assessing surgical skills in training.

A review of virtual reality based training simulators for orthopaedic surgery

This review presents current virtual reality based training simulators for hip, knee and other orthopaedic surgery, including elective and trauma surgical procedures. There have not been any reviews focussing on hip and knee orthopaedic simulators. A comparison of existing simulator features is provided to identify what is missing and what is required to improve upon current simulators. In total 11 hip replacements pre-operative planning tools were analysed, plus 9 hip trauma fracture training simulators. Additionally 9 knee arthroscopy simulators and 8 other orthopaedic simulators were included for comparison. The findings are that for orthopaedic surgery simulators in general, there is increasing use of patient-specific virtual models which reduce the learning curve. Modelling is also being used for patient-specific implant design and manufacture. Simulators are being increasingly validated for assessment as well as training. There are very few training simulators available for hip replacement, yet more advanced virtual reality is being used for other procedures such as hip trauma and drilling. Training simulators for hip replacement and orthopaedic surgery in general lag behind other surgical procedures for which virtual reality has become more common. Further developments are required to bring hip replacement training simulation up to date with other procedures. This suggests there is a gap in the market for a new high fidelity hip replacement and resurfacing training simulator.

Training effect of a virtual reality haptics-enabled dynamic hip screw simulator

BACKGROUND AND PURPOSE

Virtual reality (VR) simulation offers a safe, controlled, and effective environment to complement training but requires extensive validation before it can be implemented within the curriculum. The main objective was to assess whether VR dynamic hip screw (DHS) simulation has a training effect to improve objective performance metrics.

PATIENTS AND METHODS

52 surgical trainees who were naïve to DHS procedures were randomized to 2 groups: the training group, which had 5 attempts, and the control group, which had only one attempt. After 1 week, both cohorts repeated the same number of attempts. Objective performance metrics included total procedural time (sec), fluoroscopy time (sec), number of radiographs (n), tip-apex distance (TAD; mm), attempts at guide-wire insertion (n), and probability of cut-out (%). Mean scores (with SD) and learning curves were calculated. Significance was set as p < 0.05.

RESULTS

The training group was 68% quicker than the control group, used 75% less fluoroscopy, took 66% fewer radiographs, had 82% less retries at guide-wire insertion, achieved a reduced TAD (by 41%), had lower probability of cut-out (by 85%), and obtained an increased global score (by 63%). All these results were statistically significant (p < 0.001). The participants agreed that the simulator provided a realistic learning environment, they stated that they had enjoyed using the simulator, and they recognized the need for the simulator in formal training.

INTERPRETATION

We found a significant training effect on the VR DHS simulator in improving objective performance metrics of naïve surgical trainees. Patient safety, an important priority, was not compromised.

A Hybrid Reality Radiation-Free Simulator for Teaching Wire Navigation Skills

OBJECTIVES

Surgical simulation is an increasingly important method to facilitate the acquiring of surgical skills. Simulation can be helpful in developing hip fracture fixation skills because it is a common procedure for which performance can be objectively assessed [ie, the tip-apex distance (TAD)]. The procedure requires fluoroscopic guidance to drill a wire along an osseous trajectory to a precise position within bone. The objective of this study was to assess the construct validity for a novel radiation-free simulator designed to teach wire navigation skills in hip fracture fixation.

METHODS

Novices (n = 30) with limited to no surgical experience in hip fracture fixation and experienced surgeons (n = 10) participated. Participants drilled a guide wire in the center-center position of a synthetic femoral head in a hip fracture simulator, using electromagnetic sensors to track the guide-wire position. Sensor data were gathered to generate fluoroscopic-like images of the hip and guide wire. Simulator performance of novice and experienced participants was compared to measure construct validity.

RESULTS

The simulator was able to discriminate the accuracy in guide-wire position between novices and experienced surgeons. Experienced surgeons achieved a more accurate TAD than novices (13 vs. 23 mm, respectively, P = 0.009). The magnitude of improvement on successive simulator attempts was dependent on the level of expertise; TAD improved significantly in the novice group, whereas it was unchanged in the experienced group.

CONCLUSIONS

This hybrid reality, radiation-free hip fracture simulator, which combines real-world objects with computer-generated imagery, demonstrates construct validity by distinguishing the performance of novices and experienced surgeons. There is a differential effect depending on the level of experience, and it could be used as an effective training tool in novice surgeons.

Training safer orthopedic surgeons. Construct validation of a virtual-reality simulator for hip fracture surgery

BACKGROUND AND PURPOSE

Virtual-reality (VR) simulation in orthopedic training is still in its infancy, and much of the work has been focused on arthroscopy. We evaluated the construct validity of a new VR trauma simulator for performing dynamic hip screw (DHS) fixation of a trochanteric femoral fracture.

PATIENTS AND METHODS

30 volunteers were divided into 3 groups according to the number of postgraduate (PG) years and the amount of clinical experience: novice (1-4 PG years; less than 10 DHS procedures); intermediate (5-12 PG years; 10-100 procedures); expert (> 12 PG years; > 100 procedures). Each participant performed a DHS procedure and objective performance metrics were recorded. These data were analyzed with each performance metric taken as the dependent variable in 3 regression models.

RESULTS

There were statistically significant differences in performance between groups for (1) number of attempts at guide-wire insertion, (2) total fluoroscopy time, (3) tip-apex distance, (4) probability of screw cutout, and (5) overall simulator score. The intermediate group performed the procedure most quickly, with the lowest fluoroscopy time, the lowest tip-apex distance, the lowest probability of cutout, and the highest simulator score, which correlated with their frequency of exposure to running the trauma lists for hip fracture surgery.

INTERPRETATION

This study demonstrates the construct validity of a haptic VR trauma simulator with surgeons undertaking the procedure most frequently performing best on the simulator. VR simulation may be a means of addressing restrictions on working hours and allows trainees to practice technical tasks without putting patients at risk. The VR DHS simulator evaluated in this study may provide valid assessment of technical skill.

Surgical skills simulation in trauma and orthopaedic training

Changing patterns of health care delivery and the rapid evolution of orthopaedic surgical techniques have made it increasingly difficult for trainees to develop expertise in their craft. Working hour restrictions and a drive towards senior led care demands that proficiency be gained in a shorter period of time whilst requiring a greater skill set than that in the past. The resulting conflict between service provision and training has necessitated the development of alternative methods in order to compensate for the reduction in ‘hands-on’ experience. Simulation training provides the opportunity to develop surgical skills in a controlled environment whilst minimising risks to patient safety, operating theatre usage and financial expenditure. Many options for simulation exist within orthopaedics from cadaveric or prosthetic models, to arthroscopic simulators, to advanced virtual reality and three-dimensional software tools. There are limitations to this form of training, but it has significant potential for trainees to achieve competence in procedures prior to real-life practice. The evidence for its direct transferability to operating theatre performance is limited but there are clear benefits such as increasing trainee confidence and familiarity with equipment. With progressively improving methods of simulation available, it is likely to become more important in the ongoing and future training and assessment of orthopaedic surgeons.

Virtual-reality simulation to assess performance in hip fracture surgery

BACKGROUND AND PURPOSE

Internal fixation of hip fractures is a common and important procedure that orthopedic surgeons must master early in their career. Virtual-reality training could improve initial skills, and a simulation-based test would make it possible to ensure basic competency of junior surgeons before they proceed to supervised practice on patients. The aim of this study was to develop a reliable and valid test with credible pass/fail standards.

METHODS

20 physicians (10 untrained novices and 10 experienced orthopedic surgeons) each performed 3 internal fixation procedures of an undisplaced femoral neck fracture: 2 hook-pins, 2 screws, and a sliding hip screw. All procedures were preformed on a trauma simulator. Performance scores for each procedure were obtained from the predefined metrics of the simulator. The inter-case reliability of the simulator metrics was explored by calculation of intra-class correlation coefficient. Validity was explored by comparison between novices' and experts' scores using independent-samples t-test. A pass/fail standard was set by the contrasting-groups method and the consequences were explored.

RESULTS

The percentage of maximum combined score (PM score) showed an inter-case reliability of 0.83 (95% CI: 0.65-0.93) between the 3 procedures. The mean PM score was 30% (CI: 7-53) for the novices and 76% (CI: 68-83) for the experienced surgeons. The pass/fail standard was set at 58%, resulting in none of the novices passing the test and a single experienced surgeon failing the test.

INTERPRETATION

The simulation-based test was reliable and valid in our setting, and the pass/fail standard could discriminate between novices and experienced surgeons. Potentially, training and testing of future junior surgeons on a virtual-reality simulator could ensure basic competency before proceeding to supervised practice on patients.

The role of simulation in developing surgical skills

Surgical training has followed the master-apprentice model for centuries but is currently undergoing a paradigm shift. The traditional model is inefficient with no guarantee of case mix, quality, or quantity. There is a growing focus on competency-based medical education in response to restrictions on doctors' working hours and the traditional mantra of "see one, do one, teach one" is being increasingly questioned. The medical profession is subject to more scrutiny than ever before and is facing mounting financial, clinical, and political pressures. Simulation may be a means of addressing these challenges. It provides a way for trainees to practice technical tasks in a protected environment without putting patients at risk and helps to shorten the learning curve. The evidence for simulation-based training in orthopedic surgery using synthetic models, cadavers, and virtual reality simulators is constantly developing, though further work is needed to ensure the transfer of skills to the operating theatre.

Surgical simulators and hip fractures: a role in residency training?

BACKGROUND

Orthopedic surgery residency training requires intellectual and motor skill development. In this study, we utilized a computer-based haptic simulator to examine a potential model for evaluation of resident proficiency and efficiency in the placement of a center guide wire during fixation of an intertrochanteric proximal femur fracture. We hypothesize the junior residents will utilize more fluoroscopy and require more time to complete the task.

METHODS

Postgraduate year (PGY) 1-5 residents completed the same task of placing a single central guide pin into a femoral head for a dynamic hip screw construct utilizing a haptic surgical simulator. Residents were divided into 2 groups (PGY 1-2 and PGY 3-5) and then evaluated based on final tip-apex distance (TAD), fluoroscopy time, time to complete the task, total number of distinct attempts at pin placement for each femur construct, as well as final 3-dimensional location of the pin from the isometric center of the femoral head.

RESULTS

No statistically significant differences were noted between the 2 groups in total time or for tip-apex distance, anterior/posterior medial/lateral position, anterior/posterior superior/inferior, and lateral x-ray medial/lateral positioning measurements. Significant differences between Groups I and II were observed in anterior/posterior final position on the lateral view (p = 0.01), unique attempts (0.77 and 1.5, p = 0.03), and total fluoroscopic time (18.4 seconds and 12.9 seconds, p = 0.05).

CONCLUSIONS

In this study, we displayed that based on our simulator model there was no statistical difference between Group I and II in time to completion, final placement on anterior/posterior (A/P) view, and tip-apex distance. There was a statistically significant difference in the anterior/posterior placement of the wire in lateral view between the 2 groups, fluoroscopy time, and number of attempts per trial. Our findings suggest a computer-based surgical simulator can identify measurable differences in surgical proficiency between junior and senior orthopedic surgery residents and may play an expanding role in resident education.

Assessment of a percutaneous iliosacral screw insertion simulator

BACKGROUND

Navigational simulator use for specialized training purposes is rather uncommon in orthopaedic and trauma surgery. However, it reveals providing a valuable tool to train orthopaedic surgeons and help them to plan complex surgical procedures.

PURPOSE

This work's objective was to assess educational efficiency of a path simulator under fluoroscopic guidance applied to sacroiliac joint percutaneous screw fixation.

MATERIALS AND METHODS

We evaluated 23 surgeons' accuracy inserting a guide-wire in a human cadaver experiment, following a pre-established procedure. These medical trainees were defined in three prospective respects: novice or skilled; with or without theoretical knowledge; with or without surgical procedure familiarity. The screw insertion in the human cadaver was performed in two different settings: either without prior training for a first group (G1) or after simulator guidance in the second group (G2). Analysed criteria for each tested surgeon included the number of intraoperative X-rays taken in order to achieve the surgical procedure as well as an iatrogenic index reflecting the surgeon's ability to detect any hazardous trajectory at the time of performing said procedure.

RESULTS

An average number of 13 X-rays was required for wire implantation by the G1 group. G2 group, assisted by the simulator use, required an average of 10 X-rays. A substantial difference was especially observed within the novice sub-group (N), with an average of 12.75 X-rays for the G1 category and an average of 8.5 X-rays for the G2 category. In the second sub-group of operators devoid of procedural knowledge (P-), a significant difference was found, since 12 X-rays appeared on average required in the G1 group versus six in the G2 group. Finally, within the sub-group of operators with technical knowledge (T+), a significant difference also was found since an average of 16 X-rays was required in the G1 versus an average 10.8 X-rays in the G2 group. As far as the iatrogenic index is concerned, we were unable to observe any significant difference between the groups.

DISCUSSION

Despite some methodological variations, we were able to demonstrate the simulator's efficiency in familiarizing the operator with the use of a 2D imaging system as a first step facilitating the procedure conduct in the real 3D patient environment. Novice surgeons (N) having a good lumbosacral joint anatomy knowledge although devoid of specific surgical technique knowledge were the ones who most benefited from this guiding tool. Analysis of the training data collected during simulator's use helps orientating the prospective surgeon toward possession of not yet acquired learning points. This educational program can easily be extended to any other percutaneous technique requiring fluoroscopic control guidance.

LEVEL OF EVIDENCE

Level III prospective diagnostic study.