Intraoperative bowel perfusion quantification with hyperspectral imaging: a guidance tool for precision colorectal surgery

Surgical optomics: hyperspectral imaging and deep learning towards precision intraoperative automatic tissue recognition-results from the EX-MACHYNA trial

BACKGROUND

Hyperspectral imaging (HSI), combined with machine learning, can help to identify characteristic tissue signatures enabling automatic tissue recognition during surgery. This study aims to develop the first HSI-based automatic abdominal tissue recognition with human data in a prospective bi-center setting.

METHODS

Data were collected from patients undergoing elective open abdominal surgery at two international tertiary referral hospitals from September 2020 to June 2021. HS images were captured at various time points throughout the surgical procedure. Resulting RGB images were annotated with 13 distinct organ labels. Convolutional Neural Networks (CNNs) were employed for the analysis, with both external and internal validation settings utilized.

RESULTS

A total of 169 patients were included, 73 (43.2%) from Strasbourg and 96 (56.8%) from Verona. The internal validation within centers combined patients from both centers into a single cohort, randomly allocated to the training (127 patients, 75.1%, 585 images) and test sets (42 patients, 24.9%, 181 images). This validation setting showed the best performance. The highest true positive rate was achieved for the skin (100%) and the liver (97%). Misclassifications included tissues with a similar embryological origin (omentum and mesentery: 32%) or with overlaying boundaries (liver and hepatic ligament: 22%). The median DICE score for ten tissue classes exceeded 80%.

CONCLUSION

To improve automatic surgical scene segmentation and to drive clinical translation, multicenter accurate HSI datasets are essential, but further work is needed to quantify the clinical value of HSI. HSI might be included in a new omics science, namely surgical optomics, which uses light to extract quantifiable tissue features during surgery.

Clinical and computational development of a patient-calibrated ICGFA bowel transection recommender

INTRODUCTION

Intraoperative indocyanine green fluorescence angiography (ICGFA) aims to reduce colorectal anastomotic complications. However, signal interpretation is inconsistent and confounded by patient physiology and system behaviours. Here, we demonstrate a proof of concept of a novel clinical and computational method for patient calibrated quantitative ICGFA (QICGFA) bowel transection recommendation.

METHODS

Patients undergoing elective colorectal resection had colonic ICGFA both immediately after operative commencement prior to any dissection and again, as usual, just before anastomotic construction. Video recordings of both ICGFA acquisitions were blindly quantified post hoc across selected colonic regions of interest (ROIs) using tracking-quantification software and computationally compared with satisfactory perfusion assumed in second time-point ROIs, demonstrating 85% agreement with baseline ICGFA. ROI quantification outputs detailing projected perfusion sufficiency-insufficiency zones were compared to the actual surgeon-selected transection/anastomotic construction site for left/right-sided resections, respectively. Anastomotic outcomes were recorded, and tissue lactate was also measured in the devascularised colonic segment in a subgroup of patients. The novel perfusion zone projections were developed as full-screen recommendations via overlay heatmaps.

RESULTS

No patient suffered intra- or early postoperative anastomotic complications. Following computational development (n = 14) the software recommended zone (ROI) contained the expert surgical site of transection in almost all cases (Jaccard similarity index 0.91) of the nine patient validation series. Previously published ICGFA time-series milestone descriptors correlated moderately well, but lactate measurements did not. High resolution augmented reality heatmaps presenting recommendations from all pixels of the bowel ICGFA were generated for all cases.

CONCLUSIONS

By benchmarking to the patient's own baseline perfusion, this novel QICGFA method could allow the deployment of algorithmic personalised NIR bowel transection point recommendation in a way fitting existing clinical workflow.

Alternative intraoperative optical imaging modalities for fluorescence angiography in gastrointestinal surgery: spectral imaging and imaging photoplethysmography

INTRODUCTION

Intraoperative near-infrared fluorescence angiography with indocyanine green (ICG-FA) is a well-established modality in gastrointestinal surgery. Its main drawback is the application of a fluorescent agent with possible side effects for patients. The goal of this review paper is the presentation of alternative, non-invasive optical imaging methods and their comparison with ICG-FA.

MATERIAL AND METHODS

The principles of ICG-FA, spectral imaging, imaging photoplethysmography (iPPG), and their applications in gastrointestinal surgery are described based on selected published works.

RESULTS

The main applications of the three modalities are the evaluation of tissue perfusion, the identification of risk structures, and tissue segmentation or classification. While the ICG-FA images are mainly evaluated visually, leading to subjective interpretations, quantitative physiological parameters and tissue segmentation are provided in spectral imaging and iPPG. The combination of ICG-FA and spectral imaging is a promising method.

CONCLUSIONS

Non-invasive spectral imaging and iPPG have shown promising results in gastrointestinal surgery. They can overcome the main drawbacks of ICG-FA, i.e. the use of contrast agents, the lack of quantitative analysis, repeatability, and a difficult standardization of the acquisition. Further technical improvements and clinical evaluations are necessary to establish them in daily clinical routine.

Intraoperative bowel perfusion assessment methods and their effects on anastomotic leak rates: meta-analysis

BACKGROUND

Anastomotic leak is one of the most feared complications of colorectal surgery, and probably linked to poor blood supply to the anastomotic site. Several technologies have been described for intraoperative assessment of bowel perfusion. This systematic review and meta-analysis aimed to evaluate the most frequently used bowel perfusion assessment modalities in elective colorectal procedures, and to assess their associated risk of anastomotic leak. Technologies included indocyanine green fluorescence angiography, diffuse reflectance spectroscopy, laser speckle contrast imaging, and hyperspectral imaging.

METHODS

The review was preregistered with PROSPERO (CRD42021297299). A comprehensive literature search was performed using Embase, MEDLINE, Cochrane Library, Scopus, and Web of Science. The final search was undertaken on 29 July 2022. Data were extracted by two reviewers and the MINORS criteria were applied to assess the risk of bias.

RESULTS

Some 66 eligible studies involving 11 560 participants were included. Indocyanine green fluorescence angiography was most used with 10 789 participants, followed by diffuse reflectance spectroscopy with 321, hyperspectral imaging with 265, and laser speckle contrast imaging with 185. In the meta-analysis, the total pooled effect of an intervention on anastomotic leak was 0.05 (95 per cent c.i. 0.04 to 0.07) in comparison with 0.10 (0.08 to 0.12) without. Use of indocyanine green fluorescence angiography, hyperspectral imaging, or laser speckle contrast imaging was associated with a significant reduction in anastomotic leak.

CONCLUSION

Bowel perfusion assessment reduced the incidence of anastomotic leak, with intraoperative indocyanine green fluorescence angiography, hyperspectral imaging, and laser speckle contrast imaging all demonstrating comparable results.

Fluorescence-guided surgery: comprehensive review

BACKGROUND

Despite significant improvements in preoperative workup and surgical planning, surgeons often rely on their eyes and hands during surgery. Although this can be sufficient in some patients, intraoperative guidance is highly desirable. Near-infrared fluorescence has been advocated as a potential technique to guide surgeons during surgery.

METHODS

A literature search was conducted to identify relevant articles for fluorescence-guided surgery. The literature search was performed using Medical Subject Headings on PubMed for articles in English until November 2022 and a narrative review undertaken.

RESULTS

The use of invisible light, enabling real-time imaging, superior penetration depth, and the possibility to use targeted imaging agents, makes this optical imaging technique increasingly popular. Four main indications are described in this review: tissue perfusion, lymph node assessment, anatomy of vital structures, and tumour tissue imaging. Furthermore, this review provides an overview of future opportunities in the field of fluorescence-guided surgery.

CONCLUSION

Fluorescence-guided surgery has proven to be a widely innovative technique applicable in many fields of surgery. The potential indications for its use are diverse and can be combined. The big challenge for the future will be in bringing experimental fluorophores and conjugates through trials and into clinical practice, as well as validation of computer visualization with large data sets. This will require collaborative surgical groups focusing on utility, efficacy, and outcomes for these techniques.