Challenges in the interpretation of colorectal indocyanine green fluorescence angiography - A video vignette

Clinical and computational development of a patient-calibrated ICGFA bowel transection recommender

INTRODUCTION

Intraoperative indocyanine green fluorescence angiography (ICGFA) aims to reduce colorectal anastomotic complications. However, signal interpretation is inconsistent and confounded by patient physiology and system behaviours. Here, we demonstrate a proof of concept of a novel clinical and computational method for patient calibrated quantitative ICGFA (QICGFA) bowel transection recommendation.

METHODS

Patients undergoing elective colorectal resection had colonic ICGFA both immediately after operative commencement prior to any dissection and again, as usual, just before anastomotic construction. Video recordings of both ICGFA acquisitions were blindly quantified post hoc across selected colonic regions of interest (ROIs) using tracking-quantification software and computationally compared with satisfactory perfusion assumed in second time-point ROIs, demonstrating 85% agreement with baseline ICGFA. ROI quantification outputs detailing projected perfusion sufficiency-insufficiency zones were compared to the actual surgeon-selected transection/anastomotic construction site for left/right-sided resections, respectively. Anastomotic outcomes were recorded, and tissue lactate was also measured in the devascularised colonic segment in a subgroup of patients. The novel perfusion zone projections were developed as full-screen recommendations via overlay heatmaps.

RESULTS

No patient suffered intra- or early postoperative anastomotic complications. Following computational development (n = 14) the software recommended zone (ROI) contained the expert surgical site of transection in almost all cases (Jaccard similarity index 0.91) of the nine patient validation series. Previously published ICGFA time-series milestone descriptors correlated moderately well, but lactate measurements did not. High resolution augmented reality heatmaps presenting recommendations from all pixels of the bowel ICGFA were generated for all cases.

CONCLUSIONS

By benchmarking to the patient's own baseline perfusion, this novel QICGFA method could allow the deployment of algorithmic personalised NIR bowel transection point recommendation in a way fitting existing clinical workflow.

Impact of standardising indocyanine green fluorescence angiography technique for visual and quantitative interpretation on interuser variability in colorectal surgery

AIM/BACKGROUND

Intra-operative colonic perfusion assessment via indocyanine green fluorescence angiography (ICGFA) aims to address malperfusion-related anastomotic complications; however, its interpretation suffers interuser variability (IUV), especially early in ICGFA experience. This work assesses the impact of a protocol developed for both operator-based judgement and computational development on interpretation consistency, focusing on senior surgeons yet to start using ICGFA.

METHODS

Experienced and junior gastrointestinal surgeons were invited to complete an ICGFA-experience questionnaire. They subsequently interpreted nine operative ICGFA videos regarding perfusion sufficiency of a surgically prepared distal colon during laparoscopic anterior resection by indicating their preferred site of proximal transection using an online annotation platform (mindstamp.com). Six ICGFA videos had been prepared with a clinical standardisation protocol controlling camera and patient positioning of which three each had monochrome near infrared (NIR) and overlay display. Three others were non-standardised controls with synchronous NIR and overlay picture-in-picture display. Differences in transection level between different cohorts were assessed for intraclass correlation coefficient (ICC) via ImageJ and IBM SPSS.

RESULTS

58 clinicians (12 ICGFA experts, 46 ICGFA inexperienced of whom 23 were either finished or within one year of finishing training and 23 were junior trainees) participated as per power calculations. 63% felt that ICGFA should be routinely deployed with 57% believing interpretative competence requires 11-50 cases. Transection level concordance was generally good (ICC = 0.869) across all videos and levels of expertise (0.833-0.915). However, poor agreement was evident with the standardised protocol videos for overlay presentation (0.208-0.345). Similarly, poor agreement was seen for the monochrome display (0.392-0.517), except for those who were trained but ICG inexperienced (0.877) although even here agreement was less than with unstandardised videos (0.943).

CONCLUSION

Colorectal ICGFA acquisition and display standardisation impacts IUV with this specific protocol tending to diminish surgeon interpretation consistency. ICGFA video recording for computational development may require dedicated protocols.

Clinical application of machine learning and computer vision to indocyanine green quantification for dynamic intraoperative tissue characterisation: how to do it

INTRODUCTION

Indocyanine green (ICG) quantification and assessment by machine learning (ML) could discriminate tissue types through perfusion characterisation, including delineation of malignancy. Here, we detail the important challenges overcome before effective clinical validation of such capability in a prospective patient series of quantitative fluorescence angiograms regarding primary and secondary colorectal neoplasia.

METHODS

ICG perfusion videos from 50 patients (37 with benign (13) and malignant (24) rectal tumours and 13 with colorectal liver metastases) of between 2- and 15-min duration following intravenously administered ICG were formally studied (clinicaltrials.gov: NCT04220242). Video quality with respect to interpretative ML reliability was studied observing practical, technical and technological aspects of fluorescence signal acquisition. Investigated parameters included ICG dosing and administration, distance-intensity fluorescent signal variation, tissue and camera movement (including real-time camera tracking) as well as sampling issues with user-selected digital tissue biopsy. Attenuating strategies for the identified problems were developed, applied and evaluated. ML methods to classify extracted data, including datasets with interrupted time-series lengths with inference simulated data were also evaluated.

RESULTS

Definable, remediable challenges arose across both rectal and liver cohorts. Varying ICG dose by tissue type was identified as an important feature of real-time fluorescence quantification. Multi-region sampling within a lesion mitigated representation issues whilst distance-intensity relationships, as well as movement-instability issues, were demonstrated and ameliorated with post-processing techniques including normalisation and smoothing of extracted time-fluorescence curves. ML methods (automated feature extraction and classification) enabled ML algorithms glean excellent pathological categorisation results (AUC-ROC > 0.9, 37 rectal lesions) with imputation proving a robust method of compensation for interrupted time-series data with duration discrepancies.

CONCLUSION

Purposeful clinical and data-processing protocols enable powerful pathological characterisation with existing clinical systems. Video analysis as shown can inform iterative and definitive clinical validation studies on how to close the translation gap between research applications and real-world, real-time clinical utility.

Evaluating clinical near-infrared surgical camera systems with a view to optimizing operator and computational signal analysis

SIGNIFICANCE

As clinical evidence on the colorectal application of indocyanine green (ICG) perfusion angiography accrues, there is also interest in computerizing decision support. However, user interpretation and software development may be impacted by system factors affecting the displayed near-infrared (NIR) signal.

AIM

We aim to assess the impact of camera positioning on the displayed NIR signal across different open and laparoscopic camera systems.

APPROACH

The effects of distance, movement, and target location (center versus periphery) on the displayed fluorescence signal of different systems were measured under electromagnetic stereotactic guidance from an ICG-albumin model and in vivo during surgery.

RESULTS

Systems displayed distinct fluorescence performances with variance apparent with scope optical lens configuration (0 deg versus 30 deg), movement, target positioning, and distance. Laparoscopic system readings fitted inverse square function distance-intensity curves with one device and demonstrated a direction dependent sigmoid curve. Laparoscopic cameras presented central targets as brighter than peripheral ones, and laparoscopes with angled optical lens configurations had a diminished field of view. One handheld open system also showed a distance-intensity relationship, whereas the other maintained a consistent signal despite distance, but both presented peripheral targets brighter than central ones.

CONCLUSIONS

Optimal clinical use and signal computational development requires detailed appreciation of system behaviors.

Deconstructing mastery in colorectal fluorescence angiography interpretation

INTRODUCTION

Indocyanine green fluorescence angiography (ICGFA) is commonly used in colorectal anastomotic practice with limited pre-training. Recent work has shown that there is considerable inconsistency in signal interpretation between surgeons with minimal or no experience versus those consciously invested in mastery of the technique. Here, we deconstruct the fluorescence signal patterns of expert-annotated surgical ICGFA videos to understand better their correlation and combine this with structured interviews to ascertain whether such interpretative capability is conscious or unconscious.

METHODS

For fluorescence signal analysis, expert-annotated ICGFA videos (n = 24) were quantitatively interrogated using a boutique intensity tracker (IBM Research) to generate signal time plots. Such fluorescence intensity data were examined for inter-observer correlation (Intraclass Correlation Coefficients, ICC) at specific curve milestones: the maximum fluorescence signal (Fmax), the times to both achieve this maximum (Tmax), as well as half this maximum (T1/2max) and the ratio between these (T1/2/Tmax). Formal tele-interview with contributing experts (n = 6) was conducted with the narrative transcripts being thematically mapped, plotted, and qualitatively analyzed.

RESULTS

Correlation by mathematical measures was excellent (ICC0.9-1.0) for Fmax, Tmax, and T1/2max (0.95, 0.938, and 0.925, respectively) and moderate (0.5-0.75) for T1/2/Tmax (0.729). While all experts narrated a deliberate viewing strategy, their specific dynamic signal appreciation differed in the manner of description.

CONCLUSION

Expert ICGFA users demonstrate high correlation in mathematical measures of their signal interpretation although do so tacitly. Computational quantification of expert behavior can help develop the necessary lexicon and training sets as well as computer vision methodology to better exploit ICGFA technology.

Evaluation of inter-user variability in indocyanine green fluorescence angiography to assess gastric conduit perfusion in esophageal cancer surgery

Indocyanine Green Fluorescence Angiography (ICGFA) has been deployed to tackle malperfusion-related anastomotic complications. This study assesses variations in operator interpretation of pre-anastomotic ICGFA inflow in the gastric conduit. Utilizing an innovative online interactive multimedia platform (Mindstamp), esophageal surgeons completed a baseline opinion-practice questionnaire and proceeded to interpret, and then digitally assign, a distal transection point on 8 ICGFA videos of esophageal resections (6 Ivor Lewis, 2 McKeown). Annotations regarding gastric conduit transection by ICGFA were compared between expert users versus non-expert participants using ImageJ to delineate longitudinal distances with Shapiro Wilk and t-tests to ascertain significance. Expert versus non-expert correlation was assessed via Intraclass Correlation Coefficients (ICC). Thirty participants (13 consultants, 6 ICGFA experts) completed the study in all aspects. Of these, a high majority (29 participants) stated ICGFA should be used routinely with most (21, including 5/6 experts) stating that 11-50 cases were needed for competency in interpretation. Among users, there were wide variations in dosing (0.05-3 mg/kg) and practice impact. Agreement regarding ICGFA video interpretation concerning transection level among experts was 'moderate' (ICC = 0.717) overall but 'good' (ICC = 0.871) among seven videos with Leave One Out (LOO) exclusion of the video with highest disagreement. Agreement among non-experts was moderate (ICC = 0.641) overall and in every subgroup including among consultants (ICC = 0.626). Experts choose levels that preserved more gastric conduit length versus non-experts in all but one video (P = 0.02). Considerable variability exists with ICGFA interpretation and indeed impact. Even adept users may be challenged in specific cases. Standardized training and/or computerized quantitative fluorescence may help better usage.

The use of fluorescence angiography to assess bowel viability in the acute setting: an international, multi-centre case series

Introduction

Assessing bowel viability can be challenging during acute surgical procedures, especially regarding mesenteric ischaemia. Intraoperative fluorescence angiography (FA) may be a valuable tool for the surgeon to determine whether bowel resection is necessary and to define the most appropriate resection margins. The aim of this study is to report on FA use in the acute setting and to judge its impact on intraoperative decision making.

Materials and methods

This is a multi-centre, retrospective case series of patients undergoing emergency abdominal surgery between February 2016 and 2021 in three general/colorectal units where intraoperative FA was performed to assess bowel viability. Primary endpoint was change of management after the FA assessment.

Results

A total of 93 patients (50 males, 66.6 ± 19.2 years, ASA score ≥ III in 85%) were identified and studied. Initial surgical approach was laparotomy in 66 (71%) patients and laparoscopy in 27 (29% and seven, 26% conversions). The most common aetiologies were mesenteric ischaemia (n = 42, 45%) and adhesional/herniae-related strangulation (n = 41, 44%). In 50 patients a bowel resection was performed. Overall rates of anastomosis after resection, reoperation and 30-day mortality were 48% (n = 24/50, one leak), 12% and 18%, respectively. FA changed management in 27 (29%) patients. In four patients (4% overall), resection was avoided and in 21 (23%) extra bowel length was preserved (median 50 cm of bowel saved, IQR 28–98) although three patients developed further ischaemia. FA prompted extended resection (median of 20 cm, IQR 10–50 extra bowel) in six (6%) patients.

Conclusion

Intraoperative use of FA impacts surgical decisions regarding bowel resection for intestinal ischaemia, potentially enabling bowel preservation in approximately one out of four patients. Prospective studies are needed to optimize the best use of this technology for this indication and to determine standards for the interpretation of FA images and the potential subsequent need for second-look surgeries.

Supplementary Information

The online version contains supplementary material available at 10.1007/s00464-022-09136-7.