An Evaluation of the Impact of High-Fidelity Endovascular Simulation on Surgeon Stress and Technical Performance

Benefits of simulation for ultrasound-guided midline placement training: MC-in-Sim pilot study

INTRODUCTION

Ultrasound-guided placement of Midlines catheters (MCs) is a standard procedure with many benefits for patients. Even if there are some guidelines worldwide, this invasive technique is still taught at the patient's bed and relies on mentoring in many care centers. The performance of this care by novice practitioners raises ethical and quality of care issues mainly because of its risk of complications. This study aimed to propose and assess a simulation-based learning method for the placement of MCs in novice practitioners.

METHODS

A single-center prospective observational study was conducted with anesthesia residents who had no prior experience of Midline placement. Two workshops were planned. The first one consisted of a theoretical training and a simulated practical phase. The second workshop included an assessment of theoretical memorization, a practical exercise and adherence to the training program.

RESULTS

The median score of the theoretical memorization was 14.6 (interquartile range [IQR]: 13.5-15.8). The MCs placement time was significantly higher (Med: 12.23 min; IQR: 12.21-12.80) for novice practitioners who did not successfully complete solo MCs placement in simulation versus novice practitioners who successfully completed solo MCs placement in simulation 6.66 min (IQR: 5.92-8.93) (p = 0.002). The number of attempts was significantly higher (p = 0.034) for the novice practitioners who did not successfully complete solo MCs placement in simulation with 67% having performed three punctures, against 0% for the novice practitioners who successfully completed solo MCs placement in simulation. All novice practitioners found this training model efficient for learning how to place MCs and considered it allows for reproducibility in care situations.

CONCLUSION

This ultrasound-guided MCs training on simulation is an agile and fast alternative to traditional bedside training for anesthesia novice practitioners.

A scoping review of emotions and related constructs in simulation-based education research articles

BACKGROUND

While acknowledgement of emotions' importance in simulation-based education is emerging, there are concerns regarding how education researchers understand the concept of emotions for them to deliberately incorporate emotionally charged scenarios into simulation-based education. This concern is highlighted especially in the context of medical education often lacking strong theoretical integration. To map out how current simulation-based education literature conceptualises emotion, we conducted a scoping review on how emotions and closely related constructs (e.g. stress, and emotional intelligence) are conceptualised in simulation-based education articles that feature medical students, residents, and fellows.

METHODS

The scoping review was based on articles published in the last decade identified through database searches (EMBASE and Medline) and hand-searched articles. Data extraction included the constructs featured in the articles, their definitions, instruments used, and the types of emotions captured. Only empirical articles were included (e.g. no review or opinion articles). Data were charted via descriptive analyses.

RESULTS

A total of 141 articles were reviewed. Stress was featured in 88 of the articles, while emotions and emotional intelligence were highlighted in 45 and 34 articles respectively. Conceptualisations of emotions lacked integration of theory. Measurements of emotions mostly relied on self-reports while stress was often measured via physiological and self-report measurements. Negative emotions such as anxiety were sometimes seen as interchangeable with the term stress. No inferences were made about specific emotions of participants from their emotional intelligence.

CONCLUSIONS

Our scoping review illustrates that learners in simulation-based education are most often anxious and fearful. However, this is partially due to medical education prioritising measuring negative emotions. Further theoretical integration when examining emotions and stress may help broaden the scope towards other kinds of emotions and better conceptualisations of their impact. We call for simulation education researchers to reflect on how they understand emotions, and whether their understanding may neglect any specific aspect of affective experiences their simulation participants may have.

Unpacking the Broad Landscape of Intraoperative Stressors for Clinical Personnel: A Mixed-Methods Systematic Review

Purpose

The main goals of this mixed-methods systematic review are to identify what types of intraoperative stressors for operating room personnel have been reported in collected studies and examine the characteristics of each intraoperative stressor.

Methods

With a systematic literature search, we retrieved empirical studies examining intraoperative stress published between 2010 and 2020. To synthesize findings, we applied two approaches. First, a textual narrative synthesis was employed to summarize key study information of the selected studies by focusing on surgical platforms and study participants. Second, a thematic synthesis was employed to identify and characterize intraoperative stressors and their subtypes.

Results

Ninety-four studies were included in the review. Regarding the surgical platforms, the selected studies mainly focused on minimally invasive surgery and few studies examined issues around robotic surgery. Most studies examined intra-operative stress from surgeons' perspectives but rarely considered other clinical personnel such as nurses and anesthetists. Among seven identified stressors, technical factors were the most frequently examined followed by individual, operating room environmental, interpersonal, temporal, patient, and organizational factors.

Conclusion

By presenting stressors as multifaceted elements affecting collaboration and interaction between multidisciplinary team members in the operating room, we discuss the potential interactions between stressors which should be further investigated to build a safe and efficient environment for operating room personnel.

The role of high-fidelity simulation in the acquisition of endovascular surgical skills: a systematic review

INTRODUCTION

The widespread introduction of minimally invasive endovascular techniques in cardiovascular surgery has necessitated a transition in the psychomotor skillset of trainees and surgeons. Simulation has previously been used in surgical training; however, there is limited high quality evidence regarding the role of simulation-based training on the acquisition of endovascular skills. This systematic review aimed to systematically appraise the currently available evidence regarding endovascular high-fidelity simulation interventions, to describe the overarching strategies used, the learning outcomes addressed, the choice of assessment methodology, and the impact of education on learner performance.

METHODS

A comprehensive literature review was performed in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) statement using relevant keywords to identify studies evaluating simulation in the acquisition of endovascular surgical skills. References of review articles were screened for additional studies.

RESULTS

A total of 1081 studies were identified (474 after removal of duplicates). There was marked heterogeneity in methodologies and reporting of outcomes. Quantitative analysis was deemed inappropriate due to the risk of serious confounding and bias. Instead, a descriptive synthesis was performed, summarising key findings and quality components. Eighteen studies were included in the synthesis (15 observational, 2 case-control and 1 randomised control studies). Most studies measured procedure time, contrast usage, and fluoroscopy time. Other metrics were recorded to a lesser extent. Significant reductions were noted in both procedure and fluoroscopy times with the introduction of simulation-based endovascular training.

CONCLUSION

The evidence regarding the use of high-fidelity simulation in endovascular training is very heterogeneous. The current literature suggests simulation-based training leads to improvements in performance, mostly in terms of procedure and fluoroscopy time. High-quality randomised control trials are needed to establish the clinical benefits of simulation training, sustainability of improvements, transferability of skills and its cost-effectiveness.

Stress in surgical educational environments: a systematic review

BACKGROUND

The effects of stress on surgical residents and how stress management training can prepare residents to effectively manage stressful situations is a relevant topic. This systematic review aimed to analyze the literature regarding (1) the current stress monitoring tools and their use in surgical environments, (2) the current methods in surgical stress management training, and (3) how stress affects surgical performance.

METHODS

A search strategy was implemented to retrieve relevant articles from Web of Science, Scopus, and PubMed. The 787 initially retrieved articles were reviewed for further evaluation according to the inclusion/exclusion criteria (Prospero registration number CRD42021252682).

RESULTS

Sixty-one articles were included in the review. The stress monitoring methods found in the articles showed heart rate analysis as the most used monitoring tool for physiological parameters while the STAI-6 scale was preferred for psychological parameters. The stress management methods found in the articles were mental-, simulation- and feedback-based training, with the mental-based training showing clear positive effects on participants. The studies analyzing the effects of stress on surgical performance showed both negative and positive effects on technical and non-technical performance.

CONCLUSIONS

The impact of stress responses presents an important factor in surgical environments, affecting residents' training and performance. This study identified the main methods used for monitoring stress parameters in surgical educational environments. The applied surgical stress management training methods were diverse and demonstrated positive effects on surgeons' stress levels and performance. There were negative and positive effects of stress on surgical performance, although a collective pattern on their effects was not clear.

A time-dependent offset field approach to simulating realistic interactions between beating hearts and surgical devices in virtual interventional radiology

Endovascular interventional radiology (IR) is a minimally invasive procedure for the treatment of vascular diseases. This procedure requires physicians to be highly skilled at manipulating interventional devices under the guidance of two-dimensional X-ray imaging. By offering a non-error-sensitive and radiation-free environment, a virtual reality-based simulator provides a promising alternative for surgical skills training and surgery planning. Building a realistic and interactive simulator is a challenging task. To achieve better realism, this paper proposes a novel method of simulating the heartbeat for both standard and patient-specific anatomical data. A time-dependent offset field approach is proposed to efficiently and stably simulate the interactive behavior between the dynamic heart mesh and surgical devices. For medical imaging simulation, we propose a GPU-based linear depth subtraction method to approximate fluoroscopic images based on the attenuation of the X-ray. On this basis, a topology-based flow map method is proposed to simulate the propagation of the contrast medium in angiography. Experimental results show that the proposed algorithm can simulate heartbeat stably for meshes with varying geometrical shapes and complexities. In efficiency, the dynamic heart mesh can interact with surgical devices stably at 60 frames/s. Under the simulated fluoroscopic imaging effect, the injected contrast medium can realistically visualize both dynamic and static vessels. In a face validity by medical students and clinicians, the category of effectiveness score 8.35 out of 10 on average, demonstrating that our simulator is useful in surgical skills training and surgery planning.

A Systematic Review of Simulation-Based Training in Vascular Surgery

Introduction

Recent advancements in surgical technology, reduced working hours, and training opportunities exacerbated by the COVID-19 pandemic have led to an increase in simulation-based training. Furthermore, a rise in endovascular procedures has led to a requirement for high-fidelity simulators that offer comprehensive feedback. This review aims to identify vascular surgery simulation models and assess their validity and levels of effectiveness (LoE) for each model in order to successfully implement them into current training curricula.

Methods

PubMed and EMBASE were searched on January 1, 2021, for full-text English studies on vascular surgery simulators. Eligible articles were given validity ratings based on Messick’s modern concept of validity alongside an LoE score according to McGaghie’s translational outcomes.

Results

Overall 76 eligible articles validated 34 vascular surgery simulators and training courses for open and endovascular procedures. High validity ratings were achieved across studies for: content (35), response processes (12), the internal structure (5), relations to other variables (57), and consequences (2). Only seven studies achieved an LoE greater than 3/5. Overall, ANGIO Mentor was the most highly validated and effective simulator and was the only simulator to achieve an LoE of 5/5.

Conclusions

Simulation-based training in vascular surgery is a continuously developing field with exciting future prospects, demonstrated by the vast number of models and training courses. To effectively integrate simulation models into current vascular surgery curricula and assessments, there is a need for studies to look at trainee skill retention over a longer period of time. A more detailed discussion on cost-effectiveness is also needed.

Methods and Measures for Mental Stress Assessment in Surgery: A Systematic Review of 20 Years of Literature

Real-time mental stress monitoring from surgeons and surgical staff in operating rooms may reduce surgical injuries, improve performance and quality of medical care, and accelerate implementation of stress-management strategies. Motivated by the increase in usage of objective and subjective metrics for cognitive monitoring and by the gap in reviews of experimental design setups and data analytics, a systematic review of 71 studies on mental stress and workload measurement in surgical settings, published in 2001-2020, is presented. Almost 61% of selected papers used both objective and subjective measures, followed by 25% that only administered subjective tools - mostly consisting of validated instruments and customized surveys. An overall increase in the total number of publications on intraoperative stress assessment was observed from mid-2010 s along with a momentum in the use of both subjective and real-time objective measures. Cardiac activity, including heart-rate variability metrics, stress hormones, and eye-tracking metrics were the most frequently and electroencephalography (EEG) was the least frequently used objective measures. Around 40% of selected papers collected at least two objective measures, 41% used wearable devices, 23% performed synchronization and annotation, and 76% conducted baseline or multi-point data acquisition. Furthermore, 93% used a variety of statistical techniques, 14% applied regression models, and only one study released a public, anonymized dataset. This review of data modalities, experimental setups, and analysis techniques for intraoperative stress monitoring highlights the initiatives of surgical data science and motivates research on computational techniques for mental and surgical skills assessment and cognition-guided surgery.

Assessment of Chief Resident Practice Readiness in a Porcine Lab: A 4-Year Experience

OBJECTIVE

General surgery training prepares residents for the autonomous practice of surgery; however, assessment for readiness for independent practice presents several challenges. The simulation lab offers a safe and standardized environment for assessing the technical skills of a resident in the absence of numerous confounders of the real operating room. We describe our experience with evaluation and remediation of chief resident assessments in a porcine simulation lab.

DESIGN

Operative skill assessment of surgical residents was conducted using anesthetized porcine models. Procedure's representative of basic and complex operative skill was chosen for the assessment. Faculty assessed the residents using a checklist for the completion of all critical operative steps. A "failing" score or "critical fail" on a given procedure determined mandatory remediation. For remediation, faculty provided immediate post-procedure feedback on all errors, and residents were offered supervised practice. Residents were then retested to demonstrate competency.

SETTING

Large animal research center at Indiana University School of Medicine, Indianapolis, IN PARTICIPANTS: From 2017 to 2020, thirty-seven PGY5 residents participated in the porcine lab over a 4-year period. These general surgery residents were assessed at the beginning of their chief year.

RESULTS

There were a total of 6 residents that failed 1 or more procedures. There were no failures in the cholecystectomy, 3 failures for Nissen, 4 failures for Hand sewn anastomosis, and 1 failure for stapled anastomosis. Two residents failed 2 procedures. All residents received remediation with a faculty member and were subsequently able to perform the procedure competently.

CONCLUSIONS

A formal simulation-based assessment of procedural competence can identify technical performance deficiencies even at the chief resident level. Combined with a formal remediation program, such deficiencies can be addressed well in advance of residency graduation. Determining the relationship of such simulation-based assessments with operative performance is currently underway.

The effect of simulator fidelity on procedure skill training: a literature review

OBJECTIVES

To evaluate the effect of simulator fidelity on procedure skill training through a review of existing studies.

METHODS

MEDLINE, OVID and EMBASE databases were searched between January 1990 and January 2019. Search terms included "simulator fidelity and comparison" and "low fidelity" and "high fidelity" and "comparison" and "simulator". Author classification of low- and high-fidelity was used for non-laparoscopic procedures. Laparoscopic simulators are classified using a proposed schema. All included studies used a randomized methodology with two or more groups and were written in English. Data was abstracted to a standard data sheet and critically appraised from 17 eligible full papers.

RESULTS

Of 17 studies, eight were for laparoscopic and nine for other skill training. Studies employed evaluation methodologies, including subjective and objective measures. The evaluation was conducted once in 13/17 studies and before-after in 4/17. Didactic training only or control groups were used in 5/17 studies, while 10/17 studies included two groups only. Skill acquisition and simulator fidelity were different for the level of training in 1/17 studies. Simulation training was followed by clinical evaluation or a live animal evaluation in 3/17 studies. Low-fidelity training was not inferior to training with a high-fidelity simulator in 15/17 studies.

CONCLUSIONS

Procedure skill after training with low fidelity simulators was not inferior to skill after training with high fidelity simulators in 15/17 studies. Some data suggest that the effectiveness of different fidelity simulators depends on the level of training of participants and requires further study.