Trauma simulation training: a randomized controlled trial -evaluating the effectiveness of the Imperial Femoral Intramedullary Nailing Cognitive Task Analysis (IFINCTA) tool

How Surgeons Think to Avoid Error: A Case Study of the Neurovascular Bundle Sparing During a Robotic Prostatectomy

OBJECTIVE

To illustrate how experts efficiently navigate a "slowing down moment" to obtain optimal surgical outcomes using the neurovascular bundle sparing during a robotic prostatectomy as a case study.

DESIGN

A series of semistructured interviews with four expert uro-oncologists were completed using a cognitive task analysis methodology. Cognitive task analysis, CTA, refers to the interview and extraction of a general body of knowledge. Each interview participant completed four 1 to 2-hour semistructured CTA interviews. The interview data were then deconstructed, coded, and analyzed using a grounded theory analysis to produce a CTA-grid for a robotic prostatectomy for each surgeon, with headings of: surgical steps, simplification maneuvers, visual cues, error/complication recognition, and error/complication management and avoidance.

SETTING

The study took place at an academic teaching hospital located in an urban center in Canada.

PARTICIPANTS

Four expert uro-oncologists participated in the study.

RESULTS

Visual cues, landmarks, common pitfalls, and technique were identified as the 4 key components of the decision-making happening during a slowing down moment in the neurovascular bundle sparing during a robotic prostatectomy.

CONCLUSION

The data obtained from the CTA is novel information identifying patterns and cues that expert surgeons use to inform their surgical decision-making and avoid errors. This decision-making knowledge of visual cues, landmarks, common pitfalls and techniques is also generalizable for other surgical subspecialties. Surgeon educators, surgical teaching programs and trainees looking to improve their decision-making skills could use these components to guide their educational strategies.

Use of Virtual Reality in the Education of Orthopaedic Procedures: A Randomised Control Study in Early Validation of a Novel Virtual Reality Simulator

Background Virtual reality (VR) simulation is a potential solution to the barriers surgical trainees are facing. There needs to be validation for its implementation within current training. We aimed to compare VR simulation to traditional methods in acquiring surgical skills for a TFN-ADVANCED™ Proximal Femoral Nailing System (TFNA; DePuy Synthes, Auckland, New Zealand) femoral nailing system. Methods Thirty-one surgical trainees were randomised to two groups: traditional-training group (control group) and a VR-training group (intervention group) for insertion of a short cephalomedullary TFNA nail. Both groups then inserted the same TFNA system into saw-bone femurs. Surveys evaluated validity of the relevant activities, perception of simulation, confidence, stress and anxiety. The primary outcomes were tip-apex distance (TAD) and user anxiety/confidence levels. Secondary outcomes included number of screw- and nail-guidewire insertion attempts, the time taken to complete and user validity of the VR system. Results There was no statistical difference in TAD between the intervention and control groups (9mm vs 15mm, p=0.0734). The only TAD at risk of cut-out was in the control group (25mm). There was no statistical difference in time taken (2547.5ss vs 2395ss, p=0.668), nail guide-wire attempts (two for both groups, p=0.355) and screw guide-wire attempts (one for both groups, p=0.702). The control group versus intervention had higher anxiety levels (50% vs 33%) and had lower confidence (61% vs 84%). Interpretation There was no objective difference in performance on a saw-bone model between groups. However, this VR simulator resulted in more confidence and lower anxiety levels whilst performing a simulated TFNA. Whilst further studies with larger sample sizes and exploration of transfer validity to the operating theatre are required, this study does indicate potential benefits of VR within surgical training.

Procedural simulation training in orthopaedics and traumatology: Nationwide survey among surgeon educators and residents in France

BACKGROUND

Simulation is among the tools used in France to train residents specialising in orthopaedic and trauma surgery (OTS). However, implementing simulation-based training (SBT) is complex and poorly reported. The objective of this study was to describe the use of simulation for OTS training in France.

HYPOTHESIS

Nationwide, SBT is not used to its full capacity for teaching OTS in France, and differences in opinions about SBT may exist between surgeon educators and residents.

STUDY DESIGN

Nationwide questionnaire survey in France.

MATERIALS AND METHODS

We built two specific self-questionnaires then e-mailed them between December 2020 and February 2021 to the surgeon educators who were members of the national university council and to the residents specialising in OTS during the current academic year. The questions were about the 2018-2019 academic year, before the COVID-19 pandemic. Two classes of residents who were still medical students during this period were not included, leaving three classes for the analysis.

RESULTS

The participation rates were 57% (67/117) for the educators and 24% (87/369) for the three classes of residents. Of the 67 educators, 47 (70%) reported being involved in SBT and identified the university (70%) and industry (53%) as the main funders of this teaching modality. The educators indicated that the mean number of SBT laboratories in their region was 1.4±0.9 (range, 0-4). The main types of simulators were saw bones (77%); cadavers (85%); and commercial simulators (74%), notably for the knee (87%) and shoulder (78%). The educators estimated that they had achieved a mean of 33%±23% (range, 0%-100%) of the teaching objectives set out in the OTS curriculum and that the main obstacles were insufficient funding (81%) and lack of time (67%). Only 21% of educators reported conducting SBT research. The residents reported that they accessed SBT via the OTS teaching module (28/87, 32%), local university degrees (23/87, 26%), their hospital department (17/87, 18%), or the industry (15/87, 17%); 25/87 (29%) had never received SBT. On a 0-10 scale (0, completely disagrees; 10, completely agrees), the mean score for SBT effectiveness was 8.6±2.1 for residents and 7.1±3.0 for educators (p<0.001); the corresponding values for the quality of SBT integration in the region were 1.5±1.8 and 3.8±2.6, respectively (p<0.001).

CONCLUSION

SBT is not yet used to its full potential for teaching OTS in France. Insufficient funding and lack of time were identified by the educators as the main obstacles to greater use of SBT. Both the residents and the educators felt that SBT mightbe beneficial for training.

LEVEL OF EVIDENCE

IV, nationwide survey.

Building Clinical Skills Teaching Materials: A Study of Cognitive Task Analysis Versus Free Recall Instruction to Teach Canine Indirect Ophthalmoscopy

Ophthalmoscopy is a core component of a complete ophthalmic examination. Due to its complex technical aspects and patients becoming uncooperative if the procedure is prolonged, it can be a difficult skill for a novice to learn and develop proficiency in. Skills instruction is typically provided by subject matter experts (SMEs) through free recall without an agreed-upon instructional framework. This can lead to unintentional omission of essential steps and knowledge required to perform skills correctly. Cognitive task analysis (CTA) allows for construction of standardized instructional protocols that encompass the knowledge and skills experts apply when performing tasks. The objectives of this study were to (a) develop a CTA-based teaching protocol for canine indirect ophthalmoscopy and (b) compare the steps verbalized or demonstrated by SMEs during free recall instruction versus those ultimately identified by CTA. Four SMEs participated in free recall instructional sessions and interviews used for the development of a CTA-based teaching protocol for novice learners. The CTA-based protocol identified 66 steps and sub-steps considered essential for successfully performing canine indirect ophthalmoscopy. During instructional sessions, SMEs on average failed to verbalize 57.1% of clinical knowledge steps, did not verbalize or demonstrate 68.3% and 9.5% of action steps, and did not verbalize or demonstrate 73.2% and 40.4% of decision steps, respectively. This study demonstrates that SMEs teaching indirect ophthalmoscopy by free recall may unintentionally omit important steps, suggesting that compared with free recall, CTA may generate more comprehensive and thus potentially more effective instructional materials for teaching technical skills in veterinary medicine.

Cognitive task analysis-based training in surgery: a meta-analysis

BACKGROUND

Reduced hands-on operating experience has challenged the development of complex decision-making skills for modern surgical trainees. Cognitive task analysis- (CTA-)based training is a methodical solution to extract the intricate cognitive processes of experts and impart this information to novices. Its use has been successful in high-risk industries such as the military and aviation, though its application for learning surgery is more recent. This systematic review aims to synthesize the evidence evaluating the efficacy of CTA-based training to enable surgeons to acquire procedural skills and knowledge.

METHODS

The PRISMA guidelines were followed. Four databases, including MEDLINE, EMBASE, Web of Science and Cochrane CENTRAL, were searched from inception to February 2021. Randomized controlled trials and observational studies evaluating the training effect of CTA-based interventions on novices' procedural knowledge or technical performance were included. Meta-analyses were performed using a random-effects model.

RESULTS

The initial search yielded 2205 articles, with 12 meeting the full inclusion criteria. Seven studies used surgical trainees as study subjects, four used medical students and one study used a combination. Surgical trainees enrolled into CTA-based training groups had enhanced procedural knowledge (standardized mean difference (SMD) 1.36 (95 per cent c.i. 0.67 to 2.05), P < 0.001) and superior technical performance (SMD 2.06 (95 per cent c.i. 1.17 to 2.96), P < 0.001) in comparison with groups that used conventional training methods.

CONCLUSION

CTA-based training is an effective way to learn the cognitive skills of a surgical procedure, making it a useful adjunct to current surgical training.

Evaluating the effectiveness of the Imperial Femoral Intramedullary Nailing Cognitive Task Analysis (IFINCTA) tool in a real-time simulation setting (Distributed Interactive Simulation): a randomized controlled trial

INTRODUCTION

Working time regulations, senior led service delivery and increasing complexity of surgical technology has led to significant strains in surgical training. Additionally, the current COVID-19 pandemic has placed substantial limitations on surgical training worldwide. Contact free, remote, web-based, validated learning tools which are easily accessible and allows repeated, sustained practice are the need of the hour. Cognitive Task Analysis (CTA) have been used extensively to train pilots and military personnel and has shown excellent early results within orthopaedic training. We designed a femoral nailing CTA tool which showed objective benefits in the enhancement of cognitive knowledge in medical students. The aim of this study was to evaluate the effectiveness of this CTA tool to enhance practical skills in orthopaedic trainees in a real time interactive simulation setting (Distributed Interactive Simulation (DIS)).

METHODS

This was a double blinded, randomized controlled trial. 14 junior orthopaedic residents who met the inclusion criteria were recruited in the study. They were randomized into two equal groups. The intervention group were given the CTA learning tool, the control group were given a standard operative technique manual used for antegrade femoral intramedullary nailing. The participants were assessed on a high-fidelity phantom femur model with actual femoral nailing instruments in a simulation mobile operating theatre where the candidate had a simulation patient, an acting anesthetist and a scrub nurse (DIS). They were assessed using the modified Objective Structured Assessment of Technical Skills (OSATS) rating scale which has been validated for orthopaedic trauma.

RESULTS

The median OSATS score in the intervention group was 49 (±4.93, range 39-55) compared to 17 in the control group (±14.98, range 12-51). The median improvement was by 32 points (p = 0.02). The ICC between the two raters was 0.977.

CONCLUSIONS

This study has demonstrated objective benefits of a novel femoral nailing CTA tool in the enhancement of practical skills for junior trainees in the DIS setting. This adds to the growing evidence supporting the use of CTA in orthopaedic training. This tool can be accessed remotely, is contact free and allows repeated sustained practice which is key in simulation training.

Training Surgeons to Perform Arthroscopic All-Inside Meniscal Repair: A Randomized Controlled Trial Evaluating the Effectiveness of a Novel Cognitive Task Analysis Teaching Tool, Imperial College London/University College London Meniscus Repair Cognitive Task Analysis (IUMeRCTA)

BACKGROUND

All-inside meniscal repair is an increasingly common technique for the surgical treatment of meniscal tears. There are currently no standardized techniques for training residents in this procedure. Cognitive task analysis (CTA) is a method of analyzing and standardizing key steps in a procedure that allows training to be conducted in a validated and reproducible manner.

PURPOSE

(1) To design a digital CTA teaching tool for a standardized all-inside meniscal repair. (2) To evaluate whether CTA-trained residents would perform better in a meniscal repair task compared with a control group who underwent traditional apprenticeship methods of training.

STUDY DESIGN

Controlled laboratory study.

METHODS

Three expert knee surgeons were interviewed using a modified Delphi method to generate a consensus among the ideal technical steps, cognitive decision points, and common errors and solutions for an all-inside meniscal repair. This written information was then combined with visual and audio components and integrated onto a digital platform to create the Imperial College London/University College London Meniscus Repair Cognitive Task Analysis (IUMeRCTA) tool. Eighteen novice residents were randomized into an intervention group (digital CTA tool) and control group (equipment instruction manual). Both groups performed an all-inside meniscal repair on high-fidelity, phantom knee models and were assessed by expert surgeons, blinded to the interventions, using a validated global rating scale (GRS). After a power calculation, median GRS scores were compared between groups using the Mann-Whitney U test; significance was set at P < .05.

RESULTS

For the IUMeRCTA tool design, the procedure was divided into 55 steps across 9 phases: (1) preoperative planning, (2) theater and patient setup, (3) portal placement, (4) meniscal examination, (5) tear reduction, (6) suture planning, (7) suture insertion, (8) repair completion, and (9) postoperative care and rehabilitation. For the trial, the intervention group (mean ± SD GRS, 32 ± 2.9) performed significantly better than did the control group (GRS, 24 ± 3.3; P < .001).

CONCLUSION

This is the first CTA tool to demonstrate objective benefits in training novices to perform an arthroscopic all-inside meniscal repair.

CLINICAL RELEVANCE

The IUMeRCTA tool is an easily accessible and effective adjunct to traditional teaching that enhances learning the all-inside meniscal repair for novice surgeons.

Role of Digital Resources in Minimally Invasive Colorectal Surgery Training

Laparoscopic techniques have become the standard for many benign and malignant colorectal pathologies. Recently, the application of robotic-assisted technologies has been, and continues to be, explored. These new technologies require different skill sets and bring novel training challenges, and today's trainees must demonstrate competence in more techniques than ever. Compounding this is the reducing time spent operating in current training programs due to caps on working hours and service pressures. The need for adjunctive training strategies outside the operating room has prompted development of multimedia and digital resources to build the cognitive skills crucial in both nontechnical and technical aspects of surgery. Many are based on principles of cognitive task analysis, breaking down operations, and key decisions into nodal points to be mentally rehearsed. Resources built on this technique have shown improvements in both operative and nonoperative skills, suggesting these resources can advance trainees along the learning curve in minimally invasive surgical techniques. More work to fully elucidate the clinical benefits of such resources is required before their role as a substitute for lost operative training hours can be established. Despite this, alongside other developing technologies such as simulation, they are a promising addition to the armamentarium of the modern-day colorectal trainee.

Cognitive Training in Orthopaedic Surgery

Over the past two decades, various factors have led to fewer opportunities for hands-on learning in the operating room among orthopaedic surgery trainees. Innovative training platforms using anatomic models, cadaveric specimens, and augmented reality have been devised to address this deficiency in surgical training, but such training tools are often costly with limited accessibility. Cognitive training is a low-cost training technique that improves physical performance by refining the way in which information is mentally processed and has long been used by professional athletes and world-class musicians. More recently, cognitive training tools have been developed for several orthopaedic surgery procedures, but the overall utility of cognitive training in orthopaedic surgery remains unknown.

Simulation Training in Fracture Surgery

The current surgical training environment has sparked a paradigm shift toward the use of surgical training simulation. An apprentice-based model has historically been used in surgical education, but current financial and practical constraints have led to a more variable training experience. Surgical simulation has demonstrated efficacy in many facets of orthopaedic training and has most recently been implemented to fine-tune surgical skill in reconstruction of traumatic skeletal injuries. Although some surgical skills learned during residency training are not fully used in later practice, most surgeons require a baseline level of competence in managing skeletal trauma. Fracture surgery is heavily dependent on technical skill. Trainee simulation use in skill acquisition has potential to improve proficiency during actual surgery. Furthermore, in a specialty where the standard axiom has been repetition matters, education augmentation with simulation provides overall benefit. Work remains to maximize the effectiveness of surgical simulation in fracture treatment through improved model integration and access.

Using Cognitive Task Analysis to train Orthopaedic Surgeons - Is it time to think differently? A systematic review

Background

Working time restraints; senior led care; and a reduction in 'out of hours' operating has resulted in less operating time for orthopaedic trainees in the United Kingdom. Therefore, there has been an attempt to overcome these challenges by implementing novel techniques. Cognitive Task Analysis (CTA) focuses on the mental steps required to complete complex procedures. It has been used in training athletes and in general surgery but is new to orthopaedic training.

Aim

To undertake a systematic review to analyse if CTA is beneficial to train novice surgeons in common orthopaedic and trauma procedures.

Materials and methods

A systematic review was performed evaluating CTA in trauma and orthopaedic surgery on MEDLINE and EMBASE. Search terms used were: 'Cognitive task', 'mental rehearsal' and 'Orthop*'']. 33 studies were originally identified. Duplicate studies were excluded (11). Articles not relating to Orthopaedic surgery were excluded (15). The CTA research ranking scale was used to evaluate the impact of the studies included.

Results

7 studies were identified as appropriate for inclusion. 264 participants. 178 M, 86F. All studies showed objective or subjective benefits from CTA in orthopaedic training when compared to traditional methods. The majority of the participants highlighted high subjective satisfaction with the use of the CTA tools and reported that they proved to be excellent adjuncts to the traditional apprenticeship model.

Conclusion

CTA learning tools have demonstrated significant objective and subjective benefits in trauma and orthopaedic training. It is cost effective, easily accessible and allows repeated practice which is key in simulation training.

A Multicenter Randomized Controlled Trial Evaluating the Effectiveness of Cognitive Training for Anterior Approach Total Hip Arthroplasty

BACKGROUND

For total hip arthroplasty (THA), cognitive training prior to performing real surgery may be an effective adjunct alongside simulation to shorten the learning curve. This study sought to create a cognitive training tool (CTT) to perform anterior approach (AA)-THA, which was validated by expert surgeons, and test its use as a training tool compared with conventional material.

METHODS

We employed a modified Delphi method with 4 expert surgeons from 3 international centers of excellence. Surgeons were independently observed performing THA before undergoing semistructured cognitive task analysis (CTA) and before completing successive rounds of surveys until a consensus was reached. Thirty-six surgical residents (postgraduate year [PGY]-1 through PGY-4) were randomized to cognitive training or training with a standard operation manual with surgical videos before performing a simulated AA-THA.

RESULTS

The consensus CTA defined THA in 11 phases, in which were embedded 46 basic steps, 36 decision points, and 42 critical errors and linked strategies. This CTA was mapped onto an open-access web-based CTT. Surgeons who prepared with the CTT performed a simulated THA 35% more quickly (time, mean 28 versus 38 minutes) with 69% fewer errors in instrument selection (mean 29 versus 49 instances), and required 92% fewer prompts (mean 13 versus 25 instances). They were more accurate in acetabular cup orientation (inclination error, mean 8° versus 10°; anteversion error, mean 14° versus 22°).

CONCLUSIONS

This validated CTT for arthroplasty provides structure for competency-based learning. It is more effective at preparing orthopaedic trainees for a complex procedure than conventional materials, as well as for learning sequence, instrumentation utilization, and motor skills.

CLINICAL RELEVANCE

Cognitive training combines education on decision-making, knowledge, and technical skill. It is an inexpensive technique to teach surgeons to perform hip arthroplasty and is more effective than current preparation methods.

Evaluating learning and change in orthopaedics: What is the evidence-base?

Learning and change are key elements of clinical governance and are responsible for the progression of our specialty. Although orthopaedics has been slow to embrace quality improvement, recent years have seen global developments in surgical education, quality improvement, and patient outcome research. This review covers recent advances in the evaluation of learning and change and identifies the most important research questions that remain unanswered. Research into proxies of learning is improving but more work is required to identify the best proxy for a given procedure. Learning curves are becoming commonplace but are poorly integrated into postgraduate training curricula and there is little agreement over the most appropriate method to analyse learning curve data. With various organisations promoting centralisation of care, learning curve analysis is more important than ever before. The use of simulation in orthopaedics is developing but is yet to be formally mapped to resident training worldwide. Patient outcome research is rapidly changing, with an increased focus on quality of life measures. These are key to patients and their care. Cost-utility analysis is increasingly seen in orthopaedic manuscripts and this needs to continue to improve evidence-based care. Large-scale international, multi-centre randomised trials are gaining popularity and updated guidance on sample size estimation needs to become widespread. A global lack of surgeon equipoise will need to be addressed. Quality improvement projects frequently employ interrupted time-series analysis to evaluate change. This technique's limitations must be acknowledged, and more work is required to improve the evaluation of change in a dynamic healthcare environment where multiple interventions frequently occur. Advances in the evaluation of learning and change are needed to drive improved international surgical education and increase the reliability, validity, and importance of the conclusions drawn from orthopaedic research.