A Pilot Study on Measuring Tissue Motion During Carotid Surgery Using Video-Based Analyses for the Objective Assessment of Surgical Performance

Deep learning-based video-analysis of instrument motion in microvascular anastomosis training

PURPOSE

Attaining sufficient microsurgical skills is paramount for neurosurgical trainees. Kinematic analysis of surgical instruments using video offers the potential for an objective assessment of microsurgical proficiency, thereby enhancing surgical training and patient safety. The purposes of this study were to develop a deep-learning-based automated instrument tip-detection algorithm, and to validate its performance in microvascular anastomosis training.

METHODS

An automated instrument tip-tracking algorithm was developed and trained using YOLOv2, based on clinical microsurgical videos and microvascular anastomosis practice videos. With this model, we measured motion economy (procedural time and path distance) and motion smoothness (normalized jerk index) during the task of suturing artificial blood vessels for end-to-side anastomosis. These parameters were validated using traditional criteria-based rating scales and were compared across surgeons with varying microsurgical experience (novice, intermediate, and expert). The suturing task was deconstructed into four distinct phases, and parameters within each phase were compared between novice and expert surgeons.

RESULTS

The high accuracy of the developed model was indicated by a mean Dice similarity coefficient of 0.87. Deep learning-based parameters (procedural time, path distance, and normalized jerk index) exhibited correlations with traditional criteria-based rating scales and surgeons' years of experience. Experts completed the suturing task faster than novices. The total path distance for the right (dominant) side instrument movement was shorter for experts compared to novices. However, for the left (non-dominant) side, differences between the two groups were observed only in specific phases. The normalized jerk index for both the right and left sides was significantly lower in the expert than in the novice groups, and receiver operating characteristic analysis showed strong discriminative ability.

CONCLUSION

The deep learning-based kinematic analytic approach for surgical instruments proves beneficial in assessing performance in microvascular anastomosis. Moreover, this methodology can be adapted for use in clinical settings.

Tissue Acceleration as a Novel Metric for Surgical Performance During Carotid Endarterectomy

BACKGROUND AND OBJECTIVES

Gentle tissue handling to avoid excessive motion of affected fragile vessels during surgical dissection is essential for both surgeon proficiency and patient safety during carotid endarterectomy (CEA). However, a void remains in the quantification of these aspects during surgery. The video-based measurement of tissue acceleration is presented as a novel metric for the objective assessment of surgical performance. This study aimed to evaluate whether such metrics correlate with both surgeons' skill proficiency and adverse events during CEA.

METHODS

In a retrospective study including 117 patients who underwent CEA, acceleration of the carotid artery was measured during exposure through a video-based analysis. Tissue acceleration values and threshold violation error frequencies were analyzed and compared among the surgeon groups with different surgical experience (3 groups: novice , intermediate , and expert ). Multiple patient-related variables, surgeon groups, and video-based surgical performance parameters were compared between the patients with and without adverse events during CEA.

RESULTS

Eleven patients (9.4%) experienced adverse events after CEA, and the rate of adverse events significantly correlated with the surgeon group. The mean maximum tissue acceleration and number of errors during surgical tasks significantly decreased from novice, to intermediate, to expert surgeons, and stepwise discriminant analysis showed that the combined use of surgical performance factors could accurately discriminate between surgeon groups. The multivariate logistic regression analysis revealed that the number of errors and vulnerable carotid plaques were associated with adverse events.

CONCLUSION

Tissue acceleration profiles can be a novel metric for the objective assessment of surgical performance and the prediction of adverse events during surgery. Thus, this concept can be introduced into futuristic computer-aided surgeries for both surgical education and patient safety.

Immersive 3-Dimensional Virtual Reality Modeling for Case-Specific Presurgical Discussions in Cerebrovascular Neurosurgery

BACKGROUND

Adequate surgical planning includes a precise understanding of patient-specific anatomy and is a necessity for neurosurgeons. Although the use of virtual reality (VR) technology is emerging in surgical planning and education, few studies have examined the effectiveness of immersive VR during surgical planning using a modern head-mounted display.

OBJECTIVE

To investigate if and how immersive VR aids presurgical discussions of cerebrovascular surgery.

METHODS

A multiuser immersive VR system, BananaVisionTM, was developed and used during presurgical discussions in a prospective patient cohort undergoing cerebrovascular surgery. A questionnaire/interview was administered to multiple surgeons after the surgeries to evaluate the effectiveness of the VR system compared to conventional imaging modalities. An objective assessment of the surgeon's knowledge of patient-specific anatomy was also conducted by rating surgeons' hand-drawn presurgical illustrations.

RESULTS

The VR session effectively enhanced surgeons' understanding of patient-specific anatomy in the majority of cases (83.3%). An objective assessment of surgeons' presurgical illustrations was consistent with this result. The VR session also effectively improved the decision-making process regarding minor surgical techniques in 61.1% of cases and even aided surgeons in making critical surgical decisions about cases involving complex and challenging anatomy. The utility of the VR system was rated significantly higher by trainees than by experts.

CONCLUSION

Although rated as more useful by trainees than by experts, immersive 3D VR modeling increased surgeons' understanding of patient-specific anatomy and improved surgical strategy in certain cases involving challenging anatomy.

Development of a Deep Learning-Based Algorithm to Detect the Distal End of a Surgical Instrument

This work aims to develop an algorithm to detect the distal end of a surgical instrument using object detection with deep learning. We employed nine video recordings of carotid endarterectomies for training and testing. We obtained regions of interest (ROI; 32 × 32 pixels), at the end of the surgical instrument on the video images, as supervised data. We applied data augmentation to these ROIs. We employed a You Only Look Once Version 2 (YOLOv2) -based convolutional neural network as the network model for training. The detectors were validated to evaluate average detection precision. The proposed algorithm used the central coordinates of the bounding boxes predicted by YOLOv2. Using the test data, we calculated the detection rate. The average precision (AP) for the ROIs, without data augmentation, was 0.4272 ± 0.108. The AP with data augmentation, of 0.7718 ± 0.0824, was significantly higher than that without data augmentation. The detection rates, including the calculated coordinates of the center points in the centers of 8 × 8 pixels and 16 × 16 pixels, were 0.6100 ± 0.1014 and 0.9653 ± 0.0177, respectively. We expect that the proposed algorithm will be efficient for the analysis of surgical records.

Surgical coaching to achieve the ABMS vision for the future of continuing board certification

In February 2019, the American Board of Medical Specialties (ABMS) released the final report of the Continuing Board Certification: Vision for the Future initiative, issuing strong recommendations to replace ineffective, traditional mechanisms for physicians' maintenance of certification with meaningful strategies that strengthen professional self-regulation and simultaneously engender public trust. The Vision report charges ABMS Member Boards, including the American Board of Surgery (ABS), to develop and implement a more formative, less summative approach to continuing certification. To realize the ABMS's Vision in surgery, new programs must support the assessment of surgeons' performance in practice, identification of individualized performance gaps, tailored goals to address those gaps, and execution of personalized action plans with accountability and longitudinal support. Peer surgical coaching, especially when paired with video-based assessment, provides a structured approach that can meet this need. Surgical coaching was one of the approaches to continuing professional development that was discussed at an ABS-sponsored retreat in January 2020; this commentary review provides an overview of that discussion. The professional surgical societies, in partnership with the ABS, are uniquely positioned to implement surgical coaching programs to support the continuing certification of their membership. In this article, we provide historical context for board certification in surgery, interpret how the ABMS's Vision applies to surgical performance, and highlight recent developments in video-based assessment and peer surgical coaching. We propose surgical coaching as a foundational strategy for accomplishing the ABMS's Vision for continuing board certification in surgery.