Effects of surgical flow disruptions on surgeons' resources: a pilot study

Surgical Sabermetrics: A Scoping Review of Technology-enhanced Assessment of Nontechnical Skills in the Operating Room

OBJECTIVE

To evaluate the current evidence for surgical sabermetrics: digital methods of assessing surgical nontechnical skills and investigate the implications for enhancing surgical performance.

BACKGROUND

Surgeons need high-quality, objective, and timely feedback to optimize performance and patient safety. Digital tools to assess nontechnical skills have the potential to reduce human bias and aid scalability. However, we do not fully understand which of the myriad of digital metrics of performance assessment have efficacy for surgeons.

METHODS

A systematic review was conducted by searching PubMed, EMBASE, CINAHL, and PSYCINFO databases following PRISMA-ScR guidelines. MeSH terms and keywords included "Assessment," "Surgeons," and "Technology". Eligible studies included a digital assessment of nontechnical skills for surgeons, residents, and/or medical students within an operative context.

RESULTS

From 19,229 articles screened, 81 articles met the inclusion criteria. The studies varied in surgical specialties, settings, and outcome measurements. A total of 122 distinct objective, digital metrics were utilized. Studies digitally measured at least 1 category of surgical nontechnical skill using a single (n=54) or multiple objective measures (n=27). The majority of studies utilized simulation (n=48) over live operative settings (n=32). Surgical Sabermetrics has been demonstrated to be beneficial in measuring cognitive load (n=57), situation awareness (n=24), communication (n=3), teamwork (n=13), and leadership (n=2). No studies measured intraoperative decision-making.

CONCLUSIONS

The literature detailing the intersection between surgical data science and operative nontechnical skills is diverse and growing rapidly. Surgical Sabermetrics may provide a promising modifiable technique to achieve desirable outcomes for both the surgeon and the patient. This study identifies a diverse array of measurements possible with sensor devices and highlights research gaps, including the need for objective assessment of decision-making. Future studies may advance the integration of physiological sensors to provide a holistic assessment of surgical performance.

Wearable Systems for Unveiling Collective Intelligence in Clinical Settings

Nowadays, there is an ever-growing interest in assessing the collective intelligence (CI) of a team in a wide range of scenarios, thanks to its potential in enhancing teamwork and group performance. Recently, special attention has been devoted on the clinical setting, where breakdowns in teamwork, leadership, and communication can lead to adverse events, compromising patient safety. So far, researchers have mostly relied on surveys to study human behavior and group dynamics; however, this method is ineffective. In contrast, a promising solution to monitor behavioral and individual features that are reflective of CI is represented by wearable technologies. To date, the field of CI assessment still appears unstructured; therefore, the aim of this narrative review is to provide a detailed overview of the main group and individual parameters that can be monitored to evaluate CI in clinical settings, together with the wearables either already used to assess them or that have the potential to be applied in this scenario. The working principles, advantages, and disadvantages of each device are introduced in order to try to bring order in this field and provide a guide for future CI investigations in medical contexts.

Associations of flow disruptions with patient, staff, and process outcomes: a prospective observational study of robotic-assisted radical prostatectomies

BACKGROUND

Technological advancements in the operating room (OR) have sparked new challenges for surgical workflow, OR professionals, and patient safety. Disruptive events are frequent across all surgical specialties, but little is known about their effects on patient outcomes and the influence of systemic factors. The aim was to explore the associations of intraoperative flow disruptions (FDs) with patient outcomes, staff workload, and surgery duration.

METHODS

Prospective, single-center, and multi-source study comprising direct and standardized OR observations of urologic surgical procedures, clinical patient outcomes, and staff- and patient-reported outcome data (PROMs; 3-month follow-up). All data were recorded between 01/2020 and 10/2021. FDs were assessed using standardized procedure observations. Linear and logistic regression analyses including multiple system factors were used to explore the effects of FDs on surgical outcomes.

RESULTS

61 robotic-assisted radical prostatectomy procedures were captured (with 61 patients and 243 staff reports). High rates of FDs were observed; however, our analyses did not show significant relationships with patient complication rates. Equipment- and patient-related FDs were associated with increased staff workload. No association was found between higher rates of FDs and procedure duration.

CONCLUSIONS

FDs were not related to inferior patient outcomes. Our findings may inform future OR investigations that scrutinize the complex interplay of human, team, process, and technological components that mitigate the effects of FDs during surgery.

Intraoperative dynamics of workflow disruptions and surgeons' technical performance failures: insights from a simulated operating room

INTRODUCTION

Flow disruptions (FD) in the operating room (OR) have been found to adversely affect the levels of stress and cognitive workload of the surgical team. It has been concluded that frequent disruptions also lead to impaired technical performance and subsequently pose a risk to patient safety. However, respective studies are scarce. We therefore aimed to determine if surgical performance failures increase after disruptive events during a complete surgical intervention.

METHODS

We set up a mixed-reality-based OR simulation study within a full-team scenario. Eleven orthopaedic surgeons performed a vertebroplasty procedure from incision to closure. Simulations were audio- and videotaped and key surgical instrument movements were automatically tracked to determine performance failures, i.e. injury of critical tissue. Flow disruptions were identified through retrospective video observation and evaluated according to duration, severity, source, and initiation. We applied a multilevel binary logistic regression model to determine the relationship between FDs and technical performance failures. For this purpose, we compared FDs in one-minute intervals before performance failures with intervals without subsequent performance failures.

RESULTS

Average simulation duration was 30:02 min (SD = 10:48 min). In 11 simulated cases, 114 flow disruption events were observed with a mean hourly rate of 20.4 (SD = 5.6) and substantial variation across FD sources. Overall, 53 performance failures were recorded. We observed no relationship between FDs and likelihood of immediate performance failures: Adjusted odds ratio = 1.03 (95% CI 0.46-2.30). Likewise, no evidence could be found for different source types of FDs.

CONCLUSION

Our study advances previous methodological approaches through the utilisation of a mixed-reality simulation environment, automated surgical performance assessments, and expert-rated observations of FD events. Our data do not support the common assumption that FDs adversely affect technical performance. Yet, future studies should focus on the determining factors, mechanisms, and dynamics underlying our findings.

Impact of Acoustic and Interactive Disruptive Factors during Robot-Assisted Surgery-A Virtual Surgical Training Model

The use of virtual reality trainers for teaching minimally invasive surgical techniques has been established for a long time in conventional laparoscopy as well as robotic surgery. The aim of the present study was to evaluate the impact of reproducible disruptive factors on the surgeon's work. In a cross-sectional investigation, surgeons were tested with regard to the impact of different disruptive factors when doing exercises on a robotic-surgery simulator (Mimic Flex VR^TM). Additionally, we collected data about the participants' professional experience, gender, age, expertise in playing an instrument, and expertise in playing video games. The data were collected during DRUS 2019 (Symposium of the German Society for Robot-assisted Urology). Forty-two surgeons attending DRUS 2019 were asked to participate in a virtual robotic stress training unit. The surgeons worked in various specialties (visceral surgery, gynecology, and urology) and had different levels of expertise. The time taken to complete the exercise (TTCE), the final score (FSC), and blood loss (BL) were measured. In the basic exercise with an interactive disruption, TTCE was significantly longer (p < 0.01) and FSC significantly lower (p < 0.05). No significant difference in TTCE, FSC, or BL was noted in the advanced exercise with acoustic disruption. Performance during disruption was not dependent on the level of surgical experience, gender, age, expertise in playing an instrument, or playing video games. A positive correlation was registered between self-estimation and surgical experience. Interactive disruptions have a greater impact on the performance of a surgeon than acoustic ones. Disruption affects the performance of experienced as well as inexperienced surgeons. Disruption in daily surgery should be evaluated and minimized in the interest of the patient's safety.