Can Haptic Simulators Distinguish Expert Performance? A Case Study in Central Venous Catheterization in Surgical Education

Evaluating the Impact of Assessment Metrics for Simulated Central Venous Catheterization Training

INTRODUCTION

Performance assessment and feedback are critical factors in successful medical simulation-based training. The Dynamic Haptic Robotic Trainer (DHRT) allows residents to practice ultrasound-guided needle insertions during simulated central venous catheterization (CVC) procedures while providing detailed feedback and assessment. A study was performed to examine the effectiveness of the DHRT in training the important skills of needle tip tracking and aspiration and how these skills impact procedural complications in simulated CVC.

METHODS

The DHRT data were collected for 163 residents at 2 hospitals for 6 simulated needle insertions. Users were given automated feedback on 5 performance metrics, which measure aspiration rate, arterial punctures, punctures through and through the vein, loss of access to the vein, and successful access to the vein. Aspiration rates and tip tracking rates were analyzed to determine their significance in preventing CVC complications and improving performance.

RESULTS

Tip tracking rates higher than 40% were 2.3 times more likely to result in successful venous access than rates less than 10%. Similarly, aspiration rates higher than 80% were 2.6 times more likely to result in successful venous access than rates less than 10%. Proper tip tracking and aspiration both reduced mechanical complications. Resident performance improved for all metrics except tip tracking.

CONCLUSIONS

Proper tip tracking and aspiration both reduced complications and increased the likelihood of success. However, the skill of tip tracking was not effectively learned through practice without feedback. Therefore, ultrasound-guided needle-based procedures, including CVC, can be improved by providing specific feedback to users on their ultrasound usage to track needle insertions.

An Innovative Biological Model for Ultrasound-Guided Central Venous Access Simulation

INTRODUCTION

Simulation training is an increasingly used method to train medical students in the use of ultrasound guidance for vascular access positioning. Although very efficient for basic training, commercial simulators for vascular access do not reproduce real-life conditions. We developed a biological training model, using porcine liver, and compared it with an existing commercial model.

METHODS

Whole porcine livers were used by perfusing the portal vein system after inferior vena cava clamping. Thirty-three practitioners accustomed to ultrasound-guided procedure were enrolled to perform an ultrasound-guided vascular procedure on both biological and commercial models. Procedure duration was recorded and 10-point scales were used to compare the 2 models regarding image quality, procedure feeling, and similarity with the real-life procedure.

RESULTS

Participants reported a better image quality with the biological model (8.8 ± 1 vs. 7.7 ± 2, P = 0.007) as well as a significant difference in the procedure feeling (8.0 ± 1 vs. 6.9 ± 1.9, P = 0.002). Real-life likeness was significantly better for the biological model (8.4 ± 1.1 vs. 4.5 ± 6, P < 0.0001). Procedure duration was almost 3 times longer using the biological model than the commercial model (209.6 ± 189.0 vs. 59.8 ± 50.1, P < 0.0001).

CONCLUSIONS

This study validates our biological model of porcine's liver as an interesting training model, allowing closer real-life perception than its commercial counterpart. This model could complement and enhance simulation learning.

Evaluation of tools to assess operative competence in endovascular procedures: a systematic review

BACKGROUND

With an increase in the use of endovascular interventions as an alternative to open surgery and the unique technical skills required, current methods for assessing the competence of vascular surgery trainees may not be optimal, suggesting a need for a shift in assessment modalities. We conducted this systematic review to explore current assessment methods used in vascular surgery training to assess competence specific to endovascular procedures.

METHODS

A comprehensive literature search was performed with a structured search strategy using terms focusing on endovascular procedures and assessment. Inclusion and exclusion criteria were used in order to screen for suitable articles.

RESULTS

We identified 54 articles that satisfied the inclusion criteria. These included a single randomized controlled trial, a single systematic review, a single narrative review and a single literature review, with the vast majority having level 2 evidence. Global rating scales, proficiency assessments and written/oral examinations were described as standard current assessment tools. These modalities lack reproducibility and objectivity, neglecting the needs of assessment of endovascular procedures requiring specialized decision making and finger dexterity. Novel methods such as high fidelity simulation and virtual reality promote reproducible and objective assessment methods in the context of endovascular surgery, and have a promising future.

CONCLUSION

While current assessment methods in vascular surgery are widely supported the changing skills required of a vascular surgery trainee warrants a shift in assessment modalities to better align to these requirements. High fidelity simulations show promise, although they require more extensive research to understand their relative merits.