Arthroscopic simulation using a knee model can be used to train speed and gaze strategies in knee arthroscopy

Implementation of a Hand Training Curriculum in Junior Resident Education: Experience at a Military Orthopedic Residency Program

Purpose

The American Society for Surgery of the Hand developed the Surgery Training and Educational Platform (STEP) in order to assess essential skills in hand surgery. The American Society for Surgery of the Hand designed modules spanning both osseous and soft tissue skills aimed to be cost effective for the purpose of orthopedic surgical education. The STEP curriculum was adapted and implemented at a single military orthopedic residency program.

Methods

The following six modules were implemented: (1) depth of plunge, (2) scaphoid pinning, (3) phalangeal fracture pinning, (4) microsurgery, (5) full-thickness skin graft harvest, and (6) wrist arthroscopy. Both first- (PGY1) and second-year (PGY2) residents participated. Scores were calculated according to the original STEP curriculum criteria and were compared with historic data from the previous year. All residents responded to an evaluation questionnaire following the performance of the tasks.

Results

The PGY2 cohort outperformed PGY1 cohorts across all modules except for the depth of plunge and scaphoid fixation modules. In the phalangeal pinning module, PGY2s did significantly better when compared with pooled PGY1 performance and their own PGY1 performance (P < .05). In the microsurgery module, PGY2s scored better than pooled PGY1s. In the full-thickness skin grafting module, PGY2s outperformed PGY1s (P < .05). On the post-task evaluation, residents unanimously responded that this was a valuable exercise, but the time required to complete all the modules was significant, similar to that of the previous year survey.

Conclusions

The STEP simulation is a cost effective and reliable program to engage residents in hand surgery-related skills. However, adaptations should be encouraged according to institutional resources to provide the most inclusive training platform possible per institutional constraints. The STEP simulation is interpreted by residents as a valuable exercise but requires a significant time commitment that could be a barrier to implementation and regular use.

Type of study/level of evidence

Therapeutic IV.

Skill decay in surgeons deployed on military operations: a systematic review

INTRODUCTION

Decay of surgical skills due to paucity of opportunity to operate is a potential threat to patients being cared for by the Defence Medical Services while on operational deployment. Our aim was to review the literature regarding skill decay in the trained surgeon in order to understand how it may affect clinical performance and patient outcomes. We also wished to survey the likely causes of such decay and possible means of mitigation.

METHODS

A systematic review of the literature was conducted in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses. Study bias assessment was also undertaken. Content summaries for the papers included study design and methodology, participant level of experience, measures and magnitude of effect, duration of no practice, and study limitations.

RESULTS

Five papers met the selection criteria. There were insufficient quantitative data on the impact of surgical skill decay on patient outcome, surgeon performance or mitigation strategies, and a meaningful quantitative synthesis could not be undertaken.

CONCLUSIONS

This systematic review of the literature found very little specific evidence confirming or refuting surgical skill decay in trained surgeons, with measurement of decay hampered by the lack of an accepted methodology. Studying this in the deployed setting may offer a firmer evidence base from which to generate policy. Potential mitigation strategies are discussed. PROSPERO registration number ID260846.

Eye-tracking in surgery: a systematic review

BACKGROUND

Surgery is constantly evolving with the assistance of rapidly developing novel technology. Eye-tracking devices provide opportunities to monitor the acquisition of surgical skills, gain insight into performance, and enhance surgical practice. The aim of this review was to consolidate the available evidence for the use of eye-tracking in the surgical disciplines.

METHODS

A systematic literature review was conducted in accordance with PRISMA guidelines. A search of OVID Medline, EMBASE, Cochrane library, Scopus, and Science Direct was conducted January 2000 until December 2022. Studies involving eye-tracking in surgical training, assessment and technical innovation were included in the review. Non-surgical procedures, animal studies, and studies not involving surgical participants were excluded from the review.

RESULTS

The search returned a total of 12 054 articles, 80 of which were included in the final analysis and review. Seventeen studies involved eye-tracking in surgical training, 48 surgical assessment, and 20 were focussing on technical aspects of this technology. Twenty-six different eye-tracking devices were used in the included studies. Metrics such as the number of fixations, duration of fixations, dwell time, and cognitive workload were able to differentiate between novice and expert performance. Eight studies demonstrated the effectiveness of gaze-training for improving surgical skill.

CONCLUSION

The current literature shows a broad range of utility for a variety of eye-tracking devices in surgery. There remains a lack of standardization for metric parameters and gaze analysis techniques. Further research is required to validate its use to establish reliability and create uniform practices.

The frequency of assessment tools in arthroscopic training: a systematic review

BACKGROUND

Multiple assessment tools are used in arthroscopic training and play an important role in feedback. However, it is not fully recognized as to the standard way to apply these tools. Our study aimed to investigate the use of assessment tools in arthroscopic training and determine whether there is an optimal way to apply various assessment tools in arthroscopic training.

METHODS

A search was performed using PubMed, Embase and Cochrane Library electronic databases for articles published in English from January 2000 to July 2021. Eligible for inclusion were primary research articles related to using assessment tools for the evaluation of arthroscopic skills and training environments. Studies that focussed only on therapeutic cases, did not report outcome measures of technical skills, or did not mention arthroscopic skills training were excluded.

RESULTS

A total of 28 studies were included for review. Multiple assessment tools were used in arthroscopic training. The most common objective metric was completion time, reported in 21 studies. Technical parameters based on simulator or external equipment, such as instrument path length, hand movement, visual parameters and injury, were also widely used. Subjective assessment tools included checklists and global rating scales (GRS). Among these, the most commonly used GRS was the Arthroscopic Surgical Skill Evaluation Tool (ASSET). Most of the studies combined objective metrics and subjective assessment scales in the evaluation of arthroscopic skill training.

CONCLUSIONS

Overall, both subjective and objective assessment tools can be used as feedback for basic arthroscopic skill training, but there are still differences in the frequency of application in different contexts. Despite this, combined use of subjective and objective assessment tools can be applied to more situations and skills and can be the optimal way for assessment.

LEVEL OF EVIDENCE

Level III, systematic review of level I to III studies. Key messagesBoth subjective and objective assessment tools can be used as feedback for basic arthroscopic skill training.Combined use of subjective and objective assessment tools can be applied to more situations and skills and can be the optimal way for assessment.

Eye Tracking Use in Surgical Research: A Systematic Review

INTRODUCTION

Eye tracking (ET) is a popular tool to study what factors affect the visual behaviour of surgical team members. To our knowledge, there have been no reviews to date that evaluate the broad use of ET in surgical research. This review aims to identify and assess the quality of this evidence, to synthesize how ET can be used to inform surgical practice, and to provide recommendations to improve future ET surgical studies.

METHODS

In line with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines, a systematic literature review was conducted. An electronic search was performed in MEDLINE, Cochrane Central, Embase, and Web of Science databases up to September 2020. Included studies used ET to measure the visual behaviour of members of the surgical team during surgery or surgical tasks. The included studies were assessed by two independent reviewers.

RESULTS

A total of 7614 studies were identified, and 111 were included for data extraction. Eleven applications were identified; the four most common were skill assessment (41%), visual attention assessment (22%), workload measurement (17%), and skills training (10%). A summary was provided of the various ways ET could be used to inform surgical practice, and three areas were identified for the improvement of future ET studies in surgery.

CONCLUSIONS

This review provided a comprehensive summary of the various applications of ET in surgery and how ET could be used to inform surgical practice, including how to use ET to improve surgical education. The information provided in this review can also aid in the design and conduct of future ET surgical studies.

Analysis of Tools Used in Assessing Technical Skills and Operative Competence in Trauma and Orthopaedic Surgical Training: A Systematic Review

BACKGROUND

Robust assessment of skills acquisition and surgical performance during training is vital to ensuring operative competence among orthopaedic surgeons. A move to competency-based surgical training requires the use of tools that can assess surgical skills objectively and systematically. The aim of this systematic review was to describe the evidence for the utility of assessment tools used in evaluating operative performance in trauma and orthopaedic surgical training.

METHODS

We performed a comprehensive literature search of MEDLINE, Embase, and Google Scholar databases to June 2019. From eligible studies we abstracted data on study aim, assessment format (live theater or simulated setting), skills assessed, and tools or metrics used to assess surgical performance. The strengths, limitations, and psychometric properties of the assessment tools are reported on the basis of previously defined utility criteria.

RESULTS

One hundred and five studies published between 1990 and 2019 were included. Forty-two studies involved open orthopaedic surgical procedures, and 63 involved arthroscopy. The majority (85%) were used in the simulated environment. There was wide variation in the type of assessment tools in used, the strengths and weaknesses of which are assessor and setting-dependent.

CONCLUSIONS

Current technical skills-assessment tools in trauma and orthopaedic surgery are largely procedure-specific and limited to research use in the simulated environment. An objective technical skills-assessment tool that is suitable for use in the live operative theater requires development and validation, to ensure proper competency-based assessment of surgical performance and readiness for unsupervised clinical practice.

CLINICAL RELEVANCE

Trainers and trainees can gain further insight into the technical skills assessment tools that they use in practice through the utility evidence provided.

A Novel Kinematic Model of the Tibiofemoral Joint Based on a Parallel Mechanism

This paper presents a complete kinematic model of the tibiofemoral joint (TFJ) based on a RRPP + 4-SPS parallel mechanism, where R, P, and S stand for revolute, prismatic, and spherical joints, respectively. The model accounts for the contact between tibia and femur, and the four major ligaments: anterior cruciate, posterior cruciate, medial collateral, and lateral collateral, with anatomical significance in their length variations. An experimental flexion passive motion task is performed, and the kinematic model is tested to determine its capability to reproduce the workspace of the motion task. In addition, an optimization process is performed to simulate prescribed ligament length variations during the motion task. The proposed kinematic model is capable to reproduce with high accuracy an experimental three-dimensional workspace, and at the same time, to simulate prescribed ligament length variation during the spatial flexion task. Prescribed ligament length variations are achieved through an optimization process of the ligament insertion points. This model can be used to improve the multibody kinematic optimization (MKO) process during gait analysis, and also in the design of rehabilitation devices as well as trajectories to accelerate the recovery of injured ligaments. The model shows potential to predict ligament length variations during different motion tasks, and can serve as a basis to develop complex models for kinetostatic and dynamic analyses without dealing with computationally expensive models.

Arthroscopic Simulation: The Future of Surgical Training: A Systematic Review

BACKGROUND

Arthroscopic simulation has rapidly evolved recently with the introduction of higher-fidelity simulation models, such as virtual reality simulators, which provide trainees an environment to practice skills without causing undue harm to patients. Simulation training also offers a uniform approach to learn surgical skills with immediate feedback. The aim of this article is to review the recent research investigating the use of arthroscopy simulators in training and the teaching of surgical skills.

METHODS

A systematic review of the Embase, MEDLINE, and Cochrane Library databases for English-language articles published before December 2019 was conducted. The search terms included arthroscopy or arthroscopic in combination with simulation or simulator.

RESULTS

We identified a total of 44 relevant studies involving benchtop or virtually simulated ankle, knee, shoulder, and hip arthroscopy environments. The majority of these studies demonstrated construct and transfer validity; considerably fewer studies demonstrated content and face validity.

CONCLUSIONS

Our review indicates that there is a considerable evidence base regarding the use of arthroscopy simulators for training purposes. Further work should focus on the development of a more uniform simulator training course that can be compared with current intraoperative training in large-scale trials with long-term follow-up at tertiary centers.

Innate Arthroscopic & Laparoscopic Surgical Skills: A Systematic Review of Predictive Performance Indicators Within Novice Surgical Trainees

OBJECTIVE

To query the literature for predictive factors for performance on arthroscopic and laparoscopic surgical simulators in novice surgical trainees. These predictive factors may prove a valuable tool in identifying certain innate potential to becoming a future skilled surgeon that could benefit both surgical residency candidates and program directors alike, while also improving patient care.

DESIGN

Systematic Review.

RESULTS

The initial searches yielded 249 articles. After screening titles/abstracts and implementing inclusion and exclusion criteria, 36 studies were included in the final systematic review.

CONCLUSIONS

Current literature suggests that video game experience/frequency, psychomotor and visuospatial aptitude, and perceptual ability are among the most promising predictive indicators of baseline simulator performance. Study limitations include utilization of different standards for characterizing predictive factors. Future studies should aim to utilize standard guidelines for accurate quantification of innate predictive factors. Future research should also focus on utilizing standardized simulator platforms and aptitude tests to allow for more accurate cross-study comparisons and meta-analyses with larger sample sizes.

Predictors of Performance on the Arthrobox Arthroscopy Simulator for Medical Students

Purpose

The purpose of this study was to analyze the effects of past participation in athletics, the playing of musical instruments and video games and other variables on medical students’ performance on an arthroscopic simulator task as well as other assessments of visuospatial ability.

Methods

We assessed 50 medical students by using previously validated tests of manual dexterity and spatial reasoning as well as performance on an arthroscopic surgical simulator. Inclusion criteria were to be 18 years of age or older and to be a student studying in the M.D. program at a single public state university. Exclusion criteria were previous use of an arthroscopic surgery training device or active participation in an actual arthroscopic surgery, defined as participating as a surgeon, resident trainee, physician’s assistant, or other similarly credentialed professional. Students were also assessed by the use of a high-fidelity ultrasound simulator as a marker of visuospatial capacity. Students were then surveyed about lifestyle characteristics and personal attributes hypothesized to predict surgical skill, such as playing sports, instruments or video games.

Results

A total of 49 participants were included in this study. High levels of athletic experience were significantly associated with improved performance on the arthroscopic surgical simulator (P = .008). Participants with higher levels of athletic experience were more likely to achieve competence on the arthroscopic surgical simulator (P = .006). Scores on the arthroscopic simulator task were significantly correlated with both ultrasound simulator shape-identification task scores and masked mirror-tracing task scores, as independent measures of visuospatial ability (P = .015 and P = .013, respectively).

Conclusions

This study provides evidence of a statistically significant correlation between increased experience in athletics and single-use test performance on an arthroscopic surgical simulator. Subjects who reported higher levels of experience in athletics were significantly more likely to achieve competence in the arthroscopic surgical simulator task. Finally, statistically significant correlations were found between subjects’ performance scores on tasks assessed by the surgical simulator, masked mirror-trace assessment and ultrasound simulator.

Clinical Relevance

Simulator-based training and education allow for the development of arthroscopic skills prior to operating on a live patient in a clinical situation. This is an area of great interest in orthopaedic education. Our study evaluates parameters in a trainee that may relate to a higher performance level in technical skills on an arthroscopic surgical simulator.

Lessons taught by a knee arthroscopy simulator about participants in a European arthroscopy training programme

BACKGROUND

Arthroscopy simulators offer safe and reproducible training to orthopaedic residents, thereby obviating the need for cadaver specimens. In addition, they collect data that can serve to investigate learning curves and evaluate training programmes with the goal of improving the quality of arthroscopy teaching. In this study, a cohort of surgeons was evaluated before and after a European theoretical and practical training programme that used a knee arthroscopy simulator. The primary objective was to assess whether the overall performance score was improved by the training programme. The secondary objectives were to determine which tasks and skills were improved by the programme, to compare a novice group to an experienced group, and to identify targets for improvement.

HYPOTHESIS

A theoretical and practical training course improves the scores achieved on an arthroscopy simulator task.

METHODS

A prospective comparative study was performed in 34 surgeons during the advanced arthroscopy training course organised by the European Paediatric Orthopaedic Society (EPOS) in January 2018. All participants performed a diagnostic task on the VirtaMed ArthroS™ simulator before and after the programme. The participants were divided into two groups based on number of knee arthroscopies performed each year, i.e.,>20 (experienced group) vs.≤20 (inexperienced group). The following parameters were compared between the two groups: overall score, operative time, percentage of iatrogenic injuries, camera and hook path lengths, and success in identifying anatomical structures.

RESULTS

The overall score on the diagnostic task was 199 before and 203 after the training programme (p=0.02). The operative time decreased significantly, from 185 to 115.9seconds (p<0.01). Camera path length decreased from 85.2 to 49.2cm and hook path length from 65.5 to 15.0cm (p<0.05). The mean proportion of arthroscopies with iatrogenic tibial cartilage injuries diminished from 2.7%±1.7% (range, 0-6.7) to 1.8%±1.8% (range, 0-7) (p=0.03); no change occurred in femoral injuries. When each group was assessed separately, the only significant change found in the experienced group was a decrease in operative time, whereas in the inexperienced group all parameters improved significantly. However, visualisation of anatomical structures was unchanged.

CONCLUSION

Participation in the training programme improved overall performance, and the gains were greatest in the inexperienced group. During the post-training evaluation, some of the major anatomical structures were classified by the simulator as incompletely visualised, raising concern about a risk of underdiagnosis during arthroscopic explorations.

LEVEL OF EVIDENCE

III, prospective comparative study.