Evaluating clinical near-infrared surgical camera systems with a view to optimizing operator and computational signal analysis

Advancing indocyanine green fluorescence flap perfusion assessment via near infrared signal quantification

Introduction

Intraoperative indocyanine green fluorescence angiography (ICGFA) perfusion assessment has been demonstrated to reduce complications in reconstructive surgery. This study sought to advance ICGFA flap perfusion assessment via quantification methodologies.

Method

Patients undergoing pedicled and free flap reconstruction were subjected to intraoperative ICGFA flap perfusion assessment using either an open or endoscopic system. Patient demographics, clinical impact of ICGFA and outcomes were documented. From the ICGFA recordings, fluorescence signal quality, as well as inflow/outflow milestones for the flap and surrounding (control) tissue were computationally quantified post hoc and compared on a region of interest (ROI) level. Further software development intended full flap quantification, metric computation and heatmap generation.

Results

Fifteen patients underwent ICGFA assessment at reconstruction (8 head and neck, 6 breast and 1 perineum) including 10 free and 5 pedicled flaps. Visual ICGFA interpretation altered on-table management in 33.3% of cases, with flap edges trimmed in 4 and a re-anastomosis in 1 patient. One patient suffered post-operative flap dehiscence. Laparoscopic camera use proved feasible but recorded a lower quality signal than the open system.Using established and novel metrics, objective ICGFA signal ROI quantification permitted perfusion comparisons between the flap and surrounding tissue. Full flap assessment feasibility was demonstrated by computing all pixels and subsequent outputs summarisation as heatmaps.

Conclusion

This trial demonstrated the feasibility and potential for ICGFA with operator based and quantitative flap perfusion assessment across several reconstructive applications. Further development and implementation of these computational methods requires technique and device standardisation.

Intraoperative near infrared functional imaging of rectal cancer using artificial intelligence methods - now and near future state of the art

Colorectal cancer remains a major cause of cancer death and morbidity worldwide. Surgery is a major treatment modality for primary and, increasingly, secondary curative therapy. However, with more patients being diagnosed with early stage and premalignant disease manifesting as large polyps, greater accuracy in diagnostic and therapeutic precision is needed right from the time of first endoscopic encounter. Rapid advancements in the field of artificial intelligence (AI), coupled with widespread availability of near infrared imaging (currently based around indocyanine green (ICG)) can enable colonoscopic tissue classification and prognostic stratification for significant polyps, in a similar manner to contemporary dynamic radiological perfusion imaging but with the advantage of being able to do so directly within interventional procedural time frames. It can provide an explainable method for immediate digital biopsies that could guide or even replace traditional forceps biopsies and provide guidance re margins (both areas where current practice is only approximately 80% accurate prior to definitive excision). Here, we discuss the concept and practice of AI enhanced ICG perfusion analysis for rectal cancer surgery while highlighting recent and essential near-future advancements. These include breakthrough developments in computer vision and time series analysis that allow for real-time quantification and classification of fluorescent perfusion signals of rectal cancer tissue intraoperatively that accurately distinguish between normal, benign, and malignant tissues in situ endoscopically, which are now undergoing international prospective validation (the Horizon Europe CLASSICA study). Next stage advancements may include detailed digital characterisation of small rectal malignancy based on intraoperative assessment of specific intratumoral fluorescent signal pattern. This could include T staging and intratumoral molecular process profiling (e.g. regarding angiogenesis, differentiation, inflammatory component, and tumour to stroma ratio) with the potential to accurately predict the microscopic local response to nonsurgical treatment enabling personalised therapy via decision support tools. Such advancements are also applicable to the next generation fluorophores and imaging agents currently emerging from clinical trials. In addition, by providing an understandable, applicable method for detailed tissue characterisation visually, such technology paves the way for acceptance of other AI methodology during surgery including, potentially, deep learning methods based on whole screen/video detailing.

Validation of a semi-quantitative scoring system and workflow for analysis of fluorescence quantification in companion animals

Significance

Many commercially available near-infrared (NIR) fluorescence imaging systems lack algorithms for real-time quantifiable fluorescence data. Creation of a workflow for clinical assessment and post hoc analysis may provide clinical researchers with a method for intraoperative fluorescence quantification to improve objective outcome measures.

Aim

Scoring systems and verified image analysis are employed to determine the amount and intensity of fluorescence within surgical specimens both intra and postoperatively.

Approach

Lymph nodes from canine cancer patients were obtained during lymph node extirpation following peritumoral injection of indocyanine green (ICG). First, a semi-quantitative assessment of surface fluorescence was evaluated. Images obtained with a NIR exoscope were analysed to determine fluorescence thresholds and measure fluorescence amount and intensity.

Results

Post hoc fluorescence quantification (threshold of Hue = 165-180, Intensity = 30-255) displayed strong agreement with semi-quantitative scoring (k = 0.9734, p < 0.0001). Fluorescence intensity with either threshold of 35-255 or 45-255 were significant predictors of fluorescence and had high sensitivity and specificity (p < 0.05). Fluorescence intensity and quantification had a strong association (p < 0.001).

Conclusion

The validation of the semi-quantitative scoring system by image analysis provides a method for objective in situ observation of tissue fluorescence. The utilization of thresholding for ICG fluorescence intensity allows post hoc quantification of fluorescence when not built into the imaging system.

Clinical and computational development of a patient-calibrated ICGFA bowel transection recommender

INTRODUCTION

Intraoperative indocyanine green fluorescence angiography (ICGFA) aims to reduce colorectal anastomotic complications. However, signal interpretation is inconsistent and confounded by patient physiology and system behaviours. Here, we demonstrate a proof of concept of a novel clinical and computational method for patient calibrated quantitative ICGFA (QICGFA) bowel transection recommendation.

METHODS

Patients undergoing elective colorectal resection had colonic ICGFA both immediately after operative commencement prior to any dissection and again, as usual, just before anastomotic construction. Video recordings of both ICGFA acquisitions were blindly quantified post hoc across selected colonic regions of interest (ROIs) using tracking-quantification software and computationally compared with satisfactory perfusion assumed in second time-point ROIs, demonstrating 85% agreement with baseline ICGFA. ROI quantification outputs detailing projected perfusion sufficiency-insufficiency zones were compared to the actual surgeon-selected transection/anastomotic construction site for left/right-sided resections, respectively. Anastomotic outcomes were recorded, and tissue lactate was also measured in the devascularised colonic segment in a subgroup of patients. The novel perfusion zone projections were developed as full-screen recommendations via overlay heatmaps.

RESULTS

No patient suffered intra- or early postoperative anastomotic complications. Following computational development (n = 14) the software recommended zone (ROI) contained the expert surgical site of transection in almost all cases (Jaccard similarity index 0.91) of the nine patient validation series. Previously published ICGFA time-series milestone descriptors correlated moderately well, but lactate measurements did not. High resolution augmented reality heatmaps presenting recommendations from all pixels of the bowel ICGFA were generated for all cases.

CONCLUSIONS

By benchmarking to the patient's own baseline perfusion, this novel QICGFA method could allow the deployment of algorithmic personalised NIR bowel transection point recommendation in a way fitting existing clinical workflow.

A feasibility study assessing quantitative indocyanine green angiographic predictors of reconstructive complications following nipple-sparing mastectomy

Introduction

Immediate post-mastectomy breast reconstruction offers benefits; however, complications can compromise outcomes. Intraoperative indocyanine green fluorescence angiography (ICGFA) may mitigate perfusion-related complications (PRC); however, its interpretation remains subjective. Here, we examine and develop methods for ICGFA quantification, including machine learning (ML) algorithms for predicting complications.

Methods

ICGFA video recordings of flap perfusion from a previous study of patients undergoing nipple-sparing mastectomy (NSM) with either immediate or staged immediate (delayed by a week due to perfusion insufficiency) reconstructions were analysed. Fluorescence intensity time series data were extracted, and perfusion parameters were interrogated for overall/regional associations with postoperative PRC. A naïve Bayes ML model was subsequently trained on a balanced data subset to predict PRC from the extracted meta-data.

Results

The analysable video dataset of 157 ICGFA featured females (average age 48 years) having oncological/risk-reducing NSM with either immediate (n=90) or staged immediate (n=26) reconstruction. For those delayed, peak brightness at initial ICGFA was lower (p<0.001) and significantly improved (both quicker-onset and brighter p=0.001) one week later. The overall PRC rate in reconstructed patients (n=116) was 11.2%, with such patients demonstrating significantly dimmer (overall, p=0.018, centrally, p=0.03, and medially, p=0.04) and slower-onset (p=0.039) fluorescent peaks with shallower slopes (p=0.012) than uncomplicated patients with ICGFA. Importantly, such relevant parameters were converted into a whole field of view heatmap potentially suitable for intraoperative display. ML predicted PRC with 84.6% sensitivity and 76.9% specificity.

Conclusion

Whole breast quantitative ICGFA assessment reveals statistical associations with PRC that are potentially exploitable via ML.

Indocyanine green (ICG) fluorescence technology in pediatric robotic surgery

This study aimed to report our experience in indocyanine green (ICG) fluorescence-guided surgery (FGS) in pediatric robotics. The data of 55 patients (35 boys and 20 girls), who underwent robotic surgery using ICG fluorescence in three institutions over the last 7 years, were retrospectively reviewed. The following robotic procedures were included: pyeloplasty (n = 21), complex Lich-Gregoir ureteral reimplantation (n = 8), varicocelectomy (n = 7), adnexal pathology resection (n = 8), partial nephrectomy (n = 4), nephrectomy (n = 4), renal cyst removal (n = 2), and excision of prostatic utricle (n = 1). The ICG was injected intravenously in all indications except for varicocele where intratesticular injection was done, and prostatic utricle or paraureteral diverticulum where trans-catheter injection was done. The ICG dosage was 0.2-0.3 mg/mL/kg. All the procedures were performed using da Vinci Xi platform. Firefly® allowed to switch form bright light to ICG-NIRF view and vice versa. All the procedures were accomplished in robotics without conversions to laparoscopy or open surgery. No episodes of allergy or anaphylaxis to ICG were recorded. An excellent ICG-NIRF view of target organs was obtained in all procedures. Based on our experience, we believe that application of ICG FGS in pediatric robotics enhances the identification of critical anatomical elements and pathological structures, thereby positively impacting both oncological and functional outcomes. This technique is safe, feasible, and versatile. We advocate the consideration of ICG as the standard of care in certain procedures such as partial nephrectomy, varicocele repair, tumor resection, and ovarian torsion. Nonetheless, further investigations are warranted to explore its potential broader applications in pediatric urology.

Impact of standardising indocyanine green fluorescence angiography technique for visual and quantitative interpretation on interuser variability in colorectal surgery

AIM/BACKGROUND

Intra-operative colonic perfusion assessment via indocyanine green fluorescence angiography (ICGFA) aims to address malperfusion-related anastomotic complications; however, its interpretation suffers interuser variability (IUV), especially early in ICGFA experience. This work assesses the impact of a protocol developed for both operator-based judgement and computational development on interpretation consistency, focusing on senior surgeons yet to start using ICGFA.

METHODS

Experienced and junior gastrointestinal surgeons were invited to complete an ICGFA-experience questionnaire. They subsequently interpreted nine operative ICGFA videos regarding perfusion sufficiency of a surgically prepared distal colon during laparoscopic anterior resection by indicating their preferred site of proximal transection using an online annotation platform (mindstamp.com). Six ICGFA videos had been prepared with a clinical standardisation protocol controlling camera and patient positioning of which three each had monochrome near infrared (NIR) and overlay display. Three others were non-standardised controls with synchronous NIR and overlay picture-in-picture display. Differences in transection level between different cohorts were assessed for intraclass correlation coefficient (ICC) via ImageJ and IBM SPSS.

RESULTS

58 clinicians (12 ICGFA experts, 46 ICGFA inexperienced of whom 23 were either finished or within one year of finishing training and 23 were junior trainees) participated as per power calculations. 63% felt that ICGFA should be routinely deployed with 57% believing interpretative competence requires 11-50 cases. Transection level concordance was generally good (ICC = 0.869) across all videos and levels of expertise (0.833-0.915). However, poor agreement was evident with the standardised protocol videos for overlay presentation (0.208-0.345). Similarly, poor agreement was seen for the monochrome display (0.392-0.517), except for those who were trained but ICG inexperienced (0.877) although even here agreement was less than with unstandardised videos (0.943).

CONCLUSION

Colorectal ICGFA acquisition and display standardisation impacts IUV with this specific protocol tending to diminish surgeon interpretation consistency. ICGFA video recording for computational development may require dedicated protocols.