Evaluation of hyperspectral imaging (HSI) for the measurement of ischemic conditioning effects of the gastric conduit during esophagectomy

Surgical optomics: hyperspectral imaging and deep learning towards precision intraoperative automatic tissue recognition-results from the EX-MACHYNA trial

BACKGROUND

Hyperspectral imaging (HSI), combined with machine learning, can help to identify characteristic tissue signatures enabling automatic tissue recognition during surgery. This study aims to develop the first HSI-based automatic abdominal tissue recognition with human data in a prospective bi-center setting.

METHODS

Data were collected from patients undergoing elective open abdominal surgery at two international tertiary referral hospitals from September 2020 to June 2021. HS images were captured at various time points throughout the surgical procedure. Resulting RGB images were annotated with 13 distinct organ labels. Convolutional Neural Networks (CNNs) were employed for the analysis, with both external and internal validation settings utilized.

RESULTS

A total of 169 patients were included, 73 (43.2%) from Strasbourg and 96 (56.8%) from Verona. The internal validation within centers combined patients from both centers into a single cohort, randomly allocated to the training (127 patients, 75.1%, 585 images) and test sets (42 patients, 24.9%, 181 images). This validation setting showed the best performance. The highest true positive rate was achieved for the skin (100%) and the liver (97%). Misclassifications included tissues with a similar embryological origin (omentum and mesentery: 32%) or with overlaying boundaries (liver and hepatic ligament: 22%). The median DICE score for ten tissue classes exceeded 80%.

CONCLUSION

To improve automatic surgical scene segmentation and to drive clinical translation, multicenter accurate HSI datasets are essential, but further work is needed to quantify the clinical value of HSI. HSI might be included in a new omics science, namely surgical optomics, which uses light to extract quantifiable tissue features during surgery.

Histological Hyperspectral Glioblastoma Dataset (HistologyHSI-GB)

Hyperspectral (HS) imaging (HSI) technology combines the main features of two existing technologies: imaging and spectroscopy. This allows to analyse simultaneously the morphological and chemical attributes of the objects captured by a HS camera. In recent years, the use of HSI provides valuable insights into the interaction between light and biological tissues, and makes it possible to detect patterns, cells, or biomarkers, thus, being able to identify diseases. This work presents the HistologyHSI-GB dataset, which contains 469 HS images from 13 patients diagnosed with brain tumours, specifically glioblastoma. The slides were stained with haematoxylin and eosin (H&E) and captured using a microscope at 20× power magnification. Skilled histopathologists diagnosed the slides and provided image-level annotations. The dataset was acquired using custom HSI instrumentation, consisting of a microscope equipped with an HS camera covering the spectral range from 400 to 1000 nm.

Hyperspectral Imaging Detects Clitoral Vascular Issues in Gender-Affirming Surgery

The aim of this study was to assess the efficacy of hyperspectral imaging (HSI) as an intraoperative perfusion imaging modality during gender affirmation surgery (GAS). The hypothesis posited that HSI could quantify perfusion to the clitoral complex, thereby enabling the prediction of either uneventful wound healing or the occurrence of necrosis. In this non-randomised prospective clinical study, we enrolled 30 patients who underwent GAS in the form of vaginoplasty with the preparation of a clitoral complex from 2020 to 2024 and compared patients' characteristics as well as HSI data regarding clitoris necrosis. Individuals demonstrating uneventful wound healing pertaining to the clitoral complex were designated as Group A. Patients with complete necrosis of the neo-clitoris were assigned to Group B. Patient characteristics were collected and subsequently a comparative analysis carried out. No significant difference in patient characteristics was observed between the two groups. Necrosis occurred when both StO2 and NIR PI parameters fell below 40%. For the simultaneous occurrence of StO2 and NIR PI of 40% or less, a sensitivity of 92% and specificity of 72% was calculated. Intraoperatively, the onset of necrosis in the clitoral complex can be reliably predicted with the assistance of HSI.

The SPECTRAL Perfusion Arm Clamping dAtaset (SPECTRALPACA) for video-rate functional imaging of the skin

Spectral imaging has the potential to become a key technique in interventional medicine as it unveils much richer optical information compared to conventional RBG (red, green, and blue)-based imaging. Thus allowing for high-resolution functional tissue analysis in real time. Its higher information density particularly shows promise for the development of powerful perfusion monitoring methods for clinical use. However, even though in vivo validation of such methods is crucial for their clinical translation, the biomedical field suffers from a lack of publicly available datasets for this purpose. Closing this gap, we generated the SPECTRAL Perfusion Arm Clamping dAtaset (SPECTRALPACA). It comprises ten spectral videos (∼20 Hz, approx. 20,000 frames each) systematically recorded of the hands of ten healthy human participants in different functional states. We paired each spectral video with concisely tracked regions of interest, and corresponding diffuse reflectance measurements recorded with a spectrometer. Providing the first openly accessible in human spectral video dataset for perfusion monitoring, our work facilitates the development and validation of new functional imaging methods.

Short-term Outcomes of Different Techniques for Gastric Ischemic Preconditioning Before Esophagectomy: A Network Meta-analysis

BACKGROUND

Ischemia at the anastomotic site plays a critical role determinant in the development of anastomosis-related complications after esophagectomy. Gastric ischemic conditioning (GIC) before esophagectomy has been described to improve the vascular perfusion at the tip of the gastric conduit with a potential effect on anastomotic leak (AL) and stenosis (AS) risk minimization. Laparoscopic (LapGIC) and angioembolization (AngioGIC) techniques have been reported.

PURPOSE

Compare short-term outcomes among different GIC techniques.

MATERIALS AND METHODS

Systematic review and network meta-analysis. One-step esophagectomy (noGIC), LapGIC, and AngioGIC were compared. Primary outcomes were AL, AS, and gastric conduit necrosis (GCN). Risk ratio (RR) and weighted mean difference (WMD) were used as pooled effect size measures, whereas 95% credible intervals (CrIs) were used to assess relative inference.

RESULTS

Overall, 1760 patients (14 studies) were included. Of those, 1028 patients (58.4%) underwent noGIC, 593 (33.6%) LapGIC, and 139 (8%) AngioGIC. AL was reduced for LapGIC versus noGIC (RR=0.68; 95% CrI 0.47-0.98) and AngioGIC versus noGIC (RR=0.52; 95% CrI 0.31-0.93). Similarly, AS was reduced for LapGIC versus noGIC (RR=0.32; 95% CrI 0.12-0.68) and AngioGIC versus noGIC (RR=1.30; 95% CrI 0.65-2.46). The indirect comparison, assessed with the network methodology, did not show any differences for LapGIC versus AngioGIC in terms of postoperative AL and AS risk. No differences were found for GCN, pulmonary complications, overall complications, hospital length of stay, and 30-day mortality among different treatments.

CONCLUSIONS

Compared to noGIC, both LapGIC and AngioGIC before esophagectomy seem equivalent and associated with a reduced risk for postoperative AL and AS.

Intraoperative Laparoscopic Hyperspectral Imaging during Esophagectomy-A Pilot Study Evaluating Esophagogastric Perfusion at the Anastomotic Sites

Hyperspectral imaging (HSI) is a non-invasive and contactless technique that enables the real-time acquisition of comprehensive information on tissue within the surgical field. In this pilot study, we investigated whether a new HSI system for minimally-invasive surgery, TIVITA® Mini (HSI-MIS), provides reliable insights into tissue perfusion of the proximal and distal esophagogastric anastomotic sites during 21 laparoscopic/thoracoscopic or robotic Ivor Lewis esophagectomies of patients with cancer to minimize the risk of dreaded anastomotic insufficiency. In this pioneering investigation, physiological tissue parameters were derived from HSI measurements of the proximal site of the anastomosis (esophageal stump) and the distal site of the anastomosis (tip of the gastric conduit) during the thoracic phase of the procedure. Tissue oxygenation (StO2), Near Infrared Perfusion Index (NIR-PI), and Tissue Water Index (TWI) showed similar median values at both anastomotic sites. Significant differences were observed only for NIR-PI (median: 76.5 vs. 63.9; p = 0.012) at the distal site (gastric conduit) compared to our previous study using an HSI system for open surgery. For all 21 patients, reliable and informative measurements were attainable, confirming the feasibility of HSI-MIS to assess anastomotic viability. Further studies on the added benefit of this new technique aiming to reduce anastomotic insufficiency are warranted.

Reducing Conduit Ischemia and Anastomotic Leaks in Transhiatal Esophagectomy: Six Principles

BACKGROUND

Transhiatal esophagectomy (THE) is an accepted approach for distal esophageal (DE) and gastroesophageal junction (GEJ) cancers. Its reported weaknesses are limited loco-regional resection and high anastomotic leak rates. We have used laparoscopic assistance to perform a THE (LapTHE) as our preferred method of resection for GEJ and DE cancers for over 20 years. Our unique approach and experience may provide technical insights and perhaps superior outcomes.

METHODS

We reviewed all patients who underwent LapTHE for DE and GEJ malignancy over 10 years (2011-2020). We included 6 principles in our approach: (1) minimize dissection trauma using laparoscopy; (2) routine Kocher maneuver; (3) division of lesser sac adhesions exposing the entire gastroepiploic arcade; (4) gaining excess conduit mobility, allowing resection of proximal stomach, and performing the anastomosis with a well perfused stomach; (5) stapled side-to-side anastomosis; and (6) routine feeding jejunostomy and early oral diet.

RESULTS

One hundred and forty-seven patients were included in the analysis. The median number of lymph nodes procured was 19 (range 5-49). Negative margins were achieved in all cases (95% confidence interval [CI] 98-100%). Median hospital stay was 7 days. Overall major complication rate was 24% (17-32%), 90-day mortality was 2.0% (0.4-5.8%), and reoperation was 5.4% (2.4-10%). Three patients (2.0%, 0.4-5.8%) developed anastomotic leaks. Median follow-up was 901 days (range 52-5240). Nine patients (6.1%, 2.8-11%) developed anastomotic strictures.

CONCLUSIONS

Routine use of LapTHE for DE and GEJ cancers and inclusion of these six operative principles allow for a low rate of anastomotic complications relative to national benchmarks.

Alternative intraoperative optical imaging modalities for fluorescence angiography in gastrointestinal surgery: spectral imaging and imaging photoplethysmography

INTRODUCTION

Intraoperative near-infrared fluorescence angiography with indocyanine green (ICG-FA) is a well-established modality in gastrointestinal surgery. Its main drawback is the application of a fluorescent agent with possible side effects for patients. The goal of this review paper is the presentation of alternative, non-invasive optical imaging methods and their comparison with ICG-FA.

MATERIAL AND METHODS

The principles of ICG-FA, spectral imaging, imaging photoplethysmography (iPPG), and their applications in gastrointestinal surgery are described based on selected published works.

RESULTS

The main applications of the three modalities are the evaluation of tissue perfusion, the identification of risk structures, and tissue segmentation or classification. While the ICG-FA images are mainly evaluated visually, leading to subjective interpretations, quantitative physiological parameters and tissue segmentation are provided in spectral imaging and iPPG. The combination of ICG-FA and spectral imaging is a promising method.

CONCLUSIONS

Non-invasive spectral imaging and iPPG have shown promising results in gastrointestinal surgery. They can overcome the main drawbacks of ICG-FA, i.e. the use of contrast agents, the lack of quantitative analysis, repeatability, and a difficult standardization of the acquisition. Further technical improvements and clinical evaluations are necessary to establish them in daily clinical routine.

Effect of gastric ischemic conditioning prior to esophagectomy: systematic review and meta-analysis

Ischemia at the anastomotic site is thought to be a protagonist in the development of anastomosis-related complications while different strategies to overcome this problem have been reported. Gastric ischemic conditioning (GIC) prior to esophagectomy has been described with this intent. Evaluate the effect of GIC on anastomotic complications after esophagectomy. Scopus, Web of Science, MEDLINE, and PubMed were investigated up to March 31st, 2023. We considered articles that appraised short-term outcomes after GIC vs. no GIC in patients undergoing esophagectomy. Anastomotic leak (AL), anastomotic stricture (AS), and gastric conduit necrosis (GCN) were primary outcomes. Risk ratio (RR) and standardized mean difference (SMD) were used as pooled effect size measures, whereas 95% confidence intervals (95% CIs) were used to calculate related inference. Fourteen studies (1760 patients) were included. Of those, 732 (41.6%) underwent GIC, while 1028 (58.4%) underwent one-step esophagectomy. Compared with no GIC, GIC was related to a reduced RR for AL (R RR = 0.63; 95% CI 0.47-0.86; p < 0.01) and AS (RR = 0.51; 95% CI 0.29-0.91; p = 0.02), whereas no differences were found for GCN (RR = 0.56; 95% CI 0.19-1.61; p = 0.28). Postoperative pneumonia (RR = 1.09; p = 0.99), overall complications (RR = 0.87; p = 0.19), operative time (SMD - 0.58; p = 0.07), hospital stay (SMD 0.66; p = 0.09), and 30-day mortality (RR = 0.69; p = 0.22) were comparable. GIC prior to esophagectomy seems associated with a reduced risk for AL and AS. Further studies are necessary to identify the subset of patients who can benefit from this procedure, the optimal technique, and the timing of GIC prior to esophagectomy.

HeiPorSPECTRAL - the Heidelberg Porcine HyperSPECTRAL Imaging Dataset of 20 Physiological Organs

Hyperspectral Imaging (HSI) is a relatively new medical imaging modality that exploits an area of diagnostic potential formerly untouched. Although exploratory translational and clinical studies exist, no surgical HSI datasets are openly accessible to the general scientific community. To address this bottleneck, this publication releases HeiPorSPECTRAL ( https://www.heiporspectral.org ; https://doi.org/10.5281/zenodo.7737674 ), the first annotated high-quality standardized surgical HSI dataset. It comprises 5,758 spectral images acquired with the TIVITA® Tissue and annotated with 20 physiological porcine organs from 8 pigs per organ distributed over a total number of 11 pigs. Each HSI image features a resolution of 480 × 640 pixels acquired over the 500-1000 nm wavelength range. The acquisition protocol has been designed such that the variability of organ spectra as a function of several parameters including the camera angle and the individual can be assessed. A comprehensive technical validation confirmed both the quality of the raw data and the annotations. We envision potential reuse within this dataset, but also its reuse as baseline data for future research questions outside this dataset. Measurement(s) Spectral Reflectance Technology Type(s) Hyperspectral Imaging Sample Characteristic - Organism Sus scrofa.

Optimization of anastomotic technique and gastric conduit perfusion with hyperspectral imaging and machine learning in an experimental model for minimally invasive esophagectomy

INTRODUCTION

Esophagectomy is the mainstay of esophageal cancer treatment, but anastomotic insufficiency related morbidity and mortality remain challenging for patient outcome. Therefore, the objective of this work was to optimize anastomotic technique and gastric conduit perfusion with hyperspectral imaging (HSI) for total minimally invasive esophagectomy (MIE) with linear stapled anastomosis.

MATERIAL AND METHODS

A live porcine model (n = 58) for MIE was used with gastric conduit formation and simulation of linear stapled side-to-side esophagogastrostomy. Four main experimental groups differed in stapling length (3 vs. 6 cm) and simulation of anastomotic position on the conduit (cranial vs. caudal). Tissue oxygenation around the anastomotic simulation site was evaluated using HSI and was validated with histopathology.

RESULTS

The tissue oxygenation (ΔStO₂) after the anastomotic simulation remained constant only for the short stapler in caudal position (-0.4 ± 4.4%, n.s.) while it was impaired markedly in the other groups (short-cranial: -15.6 ± 11.5%, p = 0.0002; long-cranial: -20.4 ± 7.6%, p = 0.0126; long-caudal: -16.1 ± 9.4%, p < 0.0001). Tissue samples from avascular stomach as measured by HSI showed correspondent eosinophilic pre-necrotic changes in 35.7 ± 9.7% of the surface area.

CONCLUSION

Tissue oxygenation at the site of anastomotic simulation of the gastric conduit during MIE is influenced by stapling technique. Optimal oxygenation was achieved with a short stapler (3 cm) and sufficient distance of the simulated anastomosis to the cranial end of the gastric conduit. HSI tissue deoxygenation corresponded to histopathologic necrotic tissue changes. The experimental model with HSI and ML allow for systematic optimization of gastric conduit perfusion and anastomotic technique while clinical translation will have to be proven.

The role of intraoperative hyperspectral imaging (HSI) in colon interposition after esophagectomy

BACKGROUND

Colon conduit is an alternative approach to reconstructing the alimentary tract after esophagectomy. Hyperspectral imaging (HSI) has been demonstrated to be effective for evaluating the perfusion of gastric conduits, but not colon conduits. This is the first study to describe this new tool addressing image-guided surgery and supporting esophageal surgeons to select the optimal colon segment for the conduit and anastomotic site intraoperatively.

PATIENTS AND METHODS

Of 10 patients, eight who underwent reconstruction with a long-segment colon conduit after esophagectomy between 01/05/2018 and 01/04/2022 were included in this study. HSI was recorded at the root and tip of the colon conduit after clamping the middle colic vessels, allowing us to evaluate the perfusion and appropriate part of the colon segment.

RESULTS

Anastomotic leak (AL) was detected in only one (12.5%) of all the enrolled patients (n = 8). None of the patients developed conduit necrosis. Only one patient required re-anastomosis on postoperative day 4. No patient needed conduit removal, esophageal diversion, or stent placement. There was a change in the anastomosis site to proximal in two patients intraoperatively. There was no need to change the side of colon conduit intraoperatively in any patient.

CONCLUSION

HSI is a promising and novel intraoperative imaging tool to objectively assess the perfusion of the colon conduit. It helps the surgeon to define the best perfused anastomosis site and the side of colon conduit in this type of operation.

Quantification of bowel ischaemia using real-time multispectral Single Snapshot Imaging of Optical Properties (SSOP)

BACKGROUND

Single snapshot imaging of optical properties (SSOP) is a relatively new non-invasive, real-time, contrast-free optical imaging technology, which allows for the real-time quantitative assessment of physiological properties, including tissue oxygenation (StO2). This study evaluates the accuracy of multispectral SSOP in quantifying bowel ischaemia in a preclinical experimental model.

METHODS

In six pigs, an ischaemic bowel segment was created by dividing the arcade branches. Five regions of interest (ROIs) were identified on the bowel loop, as follows: ROI 1: central ischaemic; ROI 2: left marginal; ROI 3: left vascularised; ROI 4: right marginal; and ROI 5: right vascularised. The Trident imaging system, specifically developed for real-time tissue oxygenation imaging using SSOP, was used to image before (T0) and after ischaemia induction. Capillary and systemic lactates were measured at each time point (T0, T15, T30, T45, T60), as well as StO2 values acquired by means of SSOP (SSOP-StO2).

RESULTS

The mean value of SSOP-StO2 in ROI 1 was 30.08 ± 6.963 and was significantly lower when compared to marginal ROIs (ROI 2 + ROI 4: 45.67 ± 10.02 p =  < 0.0001), and to vascularised ROIs (ROI 3 + ROI 5: 48.08 ± 7.083 p =  < 0.0001). SSOP-StO2 was significantly correlated with normalised lactates r = - 0.5892 p < 0.0001 and with histology r =- 0.6251 p = 0.0002.

CONCLUSION

Multispectral SSOP allows for a contrast-free accurate assessment of small bowel perfusion identifying physiological tissue oxygenation as confirmed with perfusion biomarkers.

In vivo evaluation of a hyperspectral imaging system for minimally invasive surgery (HSI-MIS)

BACKGROUND

Hyperspectral Imaging (HSI) is a reliable and safe imaging method for taking intraoperative perfusion measurements. This is the first study translating intraoperative HSI to an in vivo laparoscopic setting using a CE-certified HSI-system for minimally invasive surgery (HSI-MIS). We aim to compare it to an established HSI-system for open surgery (HSI-Open).

METHODS

Intraoperative HSI was done using the HSI-MIS and HSI-Open at the Region of Interest (ROI). 19 patients undergoing gastrointestinal resections were analyzed in this study. The HSI-MIS-acquired images were aligned with those from the HSI-Open, and spectra and parameter images were compared pixel-wise. We calculated the Mean Absolute Error (MAE) for Tissue Oxygen Saturation (StO₂), Near-Infrared Perfusion Index (NIR-PI), Tissue Water Index (TWI), and Organ Hemoglobin Index (OHI), as well as the Root Mean Squared Error (RMSE) over the whole spectrum. Our analysis of parameters was optimized using partial least squares (PLS) regression. Two experienced surgeons carried out an additional color-change analysis, comparing the ROI images and deciding whether they provided the same (acceptable) or different visual information (rejected).

RESULTS

HSI and subsequent image registration was possible in 19 patients. MAE results for the original calculation were StO_{2 orig.} 17.2% (± 7.7%)_, NIR-PI_orig. 16.0 (± 9.5), TWI_orig. 18.1 (± 7.9), OHI_orig. 14.4 (± 4.5). For the PLS calculation, they were StO_{2 PLS} 12.6% (± 5.2%), NIR-PI_PLS 10.3 (± 6.0), TWI_PLS 10.6 (± 5.1), and OHI_PLS 11.6 (± 3.0). The RMSE between both systems was 0.14 (± 0.06). In the color-change analysis; both surgeons accepted more images generated using the PLS method.

CONCLUSION

Intraoperative HSI-MIS is a new technology and holds great potential for future applications in surgery. Parameter deviations are attributable to technical differences and can be reduced by applying improved calculation methods. This study is an important step toward the clinical implementation of HSI for minimally invasive surgery.

Imaging perfusion changes in oncological clinical applications by hyperspectral imaging: a literature review

BACKGROUND

Hyperspectral imaging (HSI) is a promising imaging modality that uses visible light to obtain information about blood flow. It has the distinct advantage of being noncontact, nonionizing, and noninvasive without the need for a contrast agent. Among the many applications of HSI in the medical field are the detection of various types of tumors and the evaluation of their blood flow, as well as the healing processes of grafts and wounds. Since tumor perfusion is one of the critical factors in oncology, we assessed the value of HSI in quantifying perfusion changes during interventions in clinical oncology through a systematic review of the literature.

MATERIALS AND METHODS

The PubMed and Web of Science electronic databases were searched using the terms "hyperspectral imaging perfusion cancer" and "hyperspectral imaging resection cancer". The inclusion criterion was the use of HSI in clinical oncology, meaning that all animal, phantom, ex vivo, experimental, research and development, and purely methodological studies were excluded.

RESULTS

Twenty articles met the inclusion criteria. The anatomic locations of the neoplasms in the selected articles were as follows: kidneys (1 article), breasts (2 articles), eye (1 article), brain (4 articles), entire gastrointestinal (GI) tract (1 article), upper GI tract (5 articles), and lower GI tract (6 articles).

CONCLUSIONS

HSI is a potentially attractive imaging modality for clinical application in oncology, with assessment of mastectomy skin flap perfusion after reconstructive breast surgery and anastomotic perfusion during reconstruction of gastrointenstinal conduit as the most promising at present.

Hyperspectral Imaging for Viability Assessment of Human Liver Allografts During Normothermic Machine Perfusion

Normothermic machine perfusion (NMP) is nowadays frequently utilized in liver transplantation. Despite commonly accepted viability assessment criteria, such as perfusate lactate and perfusate pH, there is a lack of predictive organ evaluation strategies to ensure graft viability. Hyperspectral imaging (HSI)-as an optical imaging modality increasingly applied in the biomedical field-might provide additional useful data regarding allograft viability and performance of liver grafts during NMP.

METHODS

Twenty-five deceased donor liver allografts were included in the study. During NMP, graft viability was assessed conventionally and by means of HSI. Images of liver parenchyma were acquired at 1, 2, and 4 h of NMP, and subsequently analyzed using a specialized HSI acquisition software to compute oxygen saturation, tissue hemoglobin index, near-infrared perfusion index, and tissue water index. To analyze the association between HSI parameters and perfusate lactate as well as perfusate pH, we performed simple linear regression analysis.

RESULTS

Perfusate lactate at 1, 2, and 4 h NMP was 1.5 [0.3-8.1], 0.9 [0.3-2.8], and 0.9 [0.1-2.2] mmol/L. Perfusate pH at 1, 2, and 4 h NMP was 7.329 [7.013-7.510], 7.318 [7.081-7.472], and 7.265 [6.967-7.462], respectively. Oxygen saturation predicted perfusate lactate at 1 and 2 h NMP (R² = 0.1577, P = 0.0493; R² = 0.1831, P = 0.0329; respectively). Tissue hemoglobin index predicted perfusate lactate at 1, 2, and 4 h NMP (R² = 0.1916, P = 0.0286; R² = 0.2900, P = 0.0055; R² = 0.2453, P = 0.0139; respectively).

CONCLUSIONS

HSI may serve as a noninvasive tool for viability assessment during NMP. Further evaluation and validation of HSI parameters are warranted in larger sample sizes.

Intraoperative bowel perfusion quantification with hyperspectral imaging: a guidance tool for precision colorectal surgery

BACKGROUND

Poor anastomotic perfusion can cause anastomotic leaks (AL). Hyperspectral imaging (HSI), previously validated experimentally, provides accurate, real-time, contrast-free intestinal perfusion quantification. Clinical experience with HSI is limited. In this study, HSI was used to evaluate bowel perfusion intraoperatively.

METHODS

Fifty-two patients undergoing elective colorectal surgeries for neoplasia (n = 40) or diverticular disease (n = 12), were enrolled. Intestinal perfusion was assessed with HSI (TIVITA®, Diaspective Vision, Am Salzhaff, Germany). This device generates a perfusion heat map reflecting the tissue oxygen saturation (StO2) amount. Prior to anastomose creation, the clinical transection line (CTL) was highlighted on the proximal bowel and imaged with HSI. Upon StO2 heat map evaluation, the hyperspectral transection line (HTL) was identified. In case of CTL/HTL discrepancy > 5 mm, the bowel was always resected at the HTL. HSI outcomes were compared to the clinical ones.

RESULTS

AL occurred in one patient who underwent neoadjuvant radiochemotherapy and ultralow anterior resection for rectal cancer. HSI assessment was feasible in all patients, and StO2-values were significantly higher at proximal segments than distal ones. Twenty-six patients showed CTL/HTL discrepancy, and these patients had a lower mean StO2 (54.55 ± 21.30%) than patients without discrepancy (65.10 ± 21.30%, p = 0.000). Patients undergoing neoadjuvant radiochemotherapy showed a lower StO2 (51.41 ± 23.41%) than non-neoadjuvated patients (60.51 ± 24.98%, p = 0.010).

CONCLUSION

HSI is useful in detecting intraoperatively marginally perfused segments, for which the clinical appreciation is unreliable. Intestinal vascular supply is lower in patients undergoing neoadjuvant radiochemotherapy, and this novel finding together with the clinical impact of HSI perfusion quantification deserves further investigation in larger trials.

A pilot randomized controlled trial on the utility of gastric conditioning in the prevention of esophagogastric anastomotic leak after Ivor Lewis esophagectomy. The APIL_2013 Trial

BACKGROUND

Anastomotic leakage (AL) after Ivor Lewis esophagectomy is associated with high morbidity and mortality. Preoperative gastric conditioning (GC) improves blood perfusion of the gastroplasty, one of the most important factors for anastomotic viability. This pilot randomized controlled trial aimed to evaluate the feasibility of GC before oesophageal surgery in patients with oesophageal cancer or Siewert I-II esophagogastric junction cancer, who required an Ivor Lewis esophagectomy.

MATERIALS AND METHODS

This was a randomized (1:1), open-label, single-centre, controlled, parallel-group, pilot clinical trial. Two study groups: 1) GC-group: patients who underwent an Ivor Lewis esophagectomy and GC before surgery; 2) Surgery alone (SA)-group: patients who underwent only Ivor Lewis esophagectomy. Feasibility was assessed by means of the number of patients in whom a GC was performed, and the cumulative incidence of postoperative AL. Secondary endpoints were conduit necrosis (CN), hospital stay, morbidity, mortality, and anastomotic stricture.

RESULTS

Between 2015 and 2018, 38 patients were randomized and analysed: 20 to GC-group and 18 to SA-group. 17 GCs (85%) were successfully performed, right gastric artery occlusion failed in three patients. Morbidity after GC occurred in 5/22 patients (all Clavien-Dindo ≤ IIIa). The cumulative incidence of AL was 15.0% (3/20, 95%CI: 5.2-36.0%) in GC-group and 33.3% (6/18, 95%CI: 16.3-56.3%) in SA-group, p-value: 0.184. CN: 0/20 vs. 1/18 (p-value: 0.474); surgical morbidity (Clavien-Dindo III-V): 7/20 vs. 12/18 (p-value: 0.070); hospital stay (median [range] days): 12 [9-45] vs. 27.5 [10-166] (p-value: 0.067). When only successful GCs (three arteries) were included for analysis, ischemia-related gastric conduit failure (AL and CN) was lower in the GC group (p-value: 0.041).

CONCLUSIONS

Preoperative arteriographic GC before Ivor Lewis esophagectomy is a feasible and safe procedure and seems it may reduce AL in patients with oesophageal cancer or Siewert I-II esophagogastric junction cancer.

Computer-Assisted Differentiation between Colon-Mesocolon and Retroperitoneum Using Hyperspectral Imaging (HSI) Technology

Complete mesocolic excision (CME), which involves the adequate resection of the tumor-bearing colonic segment with “en bloc” removal of its mesocolon along embryological fascial planes is associated with superior oncological outcomes. However, CME presents a higher complication rate compared to non-CME resections due to a higher risk of vascular injury. Hyperspectral imaging (HSI) is a contrast-free optical imaging technology, which facilitates the quantitative imaging of physiological tissue parameters and the visualization of anatomical structures. This study evaluates the accuracy of HSI combined with deep learning (DL) to differentiate the colon and its mesenteric tissue from retroperitoneal tissue. In an animal study including 20 pig models, intraoperative hyperspectral images of the sigmoid colon, sigmoid mesentery, and retroperitoneum were recorded. A convolutional neural network (CNN) was trained to distinguish the two tissue classes using HSI data, validated with a leave-one-out cross-validation process. The overall recognition sensitivity of the tissues to be preserved (retroperitoneum) and the tissues to be resected (colon and mesentery) was 79.0 ± 21.0% and 86.0 ± 16.0%, respectively. Automatic classification based on HSI and CNNs is a promising tool to automatically, non-invasively, and objectively differentiate the colon and its mesentery from retroperitoneal tissue.

Hyperspectral Imaging (HSI) of Human Kidney Allografts

OBJECTIVE

Aim of our study was to test a noninvasive HSI technique as an intraoperative real time assessment tool for deceased donor kidney quality and function in human kidney allotransplantation.

SUMMARY OF BACKGROUND DATA

HSI is capable to deliver quantitative diagnostic information about tissue pathology, morphology, and composition, based on the spectral characteristics of the investigated tissue. Because tools for objective intraoperative graft viability and performance assessment are lacking, we applied this novel technique to human kidney transplantation.

METHODS

Hyperspectral images of distinct components of kidney allografts (parenchyma, ureter) were acquired 15 and 45 minutes after reperfusion and subsequently analyzed using specialized HSI acquisition software capable to compute oxygen saturation levels (StO2), near infrared perfusion indices (NIR), organ hemoglobin indices, and tissue water indices of explored tissues.

RESULTS

Seventeen kidney transplants were analyzed. Median recipient and donor age were 55 years. Cold ischemia time was 10.8 ± 4.1 hours and anastomosis time was 35 ± 7 minutes (mean ± standard deviation). Two patients (11.8%) developed delayed graft function (DGF). cold ischemia time was significantly longer (18.6 ± 1.6) in patients with DGF (P < 0.01). Kidneys with DGF furthermore displayed significant lower StO2 (P = 0.02) and NIR perfusion indices, 15 minutes after reperfusion (P < 0.01). Transplant ureters displayed a significant decrease of NIR perfusion with increased distance to the renal pelvis, identifying well and poor perfused segments.

CONCLUSION

Intraoperative HSI is feasible and meaningful to predict DGF in renal allografts. Furthermore, it can be utilized for image guided surgery, providing information about tissue oxygenation, perfusion, hemoglobin concentration, and water concentration, hence allowing intraoperative viability assessment of the kidney parenchyma and the ureter.

Spectral organ fingerprints for machine learning-based intraoperative tissue classification with hyperspectral imaging in a porcine model

Visual discrimination of tissue during surgery can be challenging since different tissues appear similar to the human eye. Hyperspectral imaging (HSI) removes this limitation by associating each pixel with high-dimensional spectral information. While previous work has shown its general potential to discriminate tissue, clinical translation has been limited due to the method's current lack of robustness and generalizability. Specifically, the scientific community is lacking a comprehensive spectral tissue atlas, and it is unknown whether variability in spectral reflectance is primarily explained by tissue type rather than the recorded individual or specific acquisition conditions. The contribution of this work is threefold: (1) Based on an annotated medical HSI data set (9059 images from 46 pigs), we present a tissue atlas featuring spectral fingerprints of 20 different porcine organs and tissue types. (2) Using the principle of mixed model analysis, we show that the greatest source of variability related to HSI images is the organ under observation. (3) We show that HSI-based fully-automatic tissue differentiation of 20 organ classes with deep neural networks is possible with high accuracy (> 95%). We conclude from our study that automatic tissue discrimination based on HSI data is feasible and could thus aid in intraoperative decisionmaking and pave the way for context-aware computer-assisted surgery systems and autonomous robotics.

Hyperspectral imaging detects perfusion and oxygenation differences between stapled and hand-sewn intestinal anastomoses

OBJECTIVES

Hand-sewn and stapled intestinal anastomoses are both daily performed routine procedures by surgeons. Yet, differences in micro perfusion of these two surgical techniques and their impact on surgical outcomes are still insufficiently understood. Only recently, hyperspectral imaging (HSI) has been established as a non-invasive, contact-free, real-time assessment tool for tissue oxygenation and micro-perfusion. Hence, objective of this study was HSI assessment of different intestinal anastomotic techniques and analysis of patients' clinical outcome.

METHODS

Forty-six consecutive patients with an ileal-ileal anastomoses were included in our study; 21 side-to-side stapled and 25 end-to-end hand-sewn. Based on adsorption and reflectance of the analyzed tissue, chemical color imaging indicates oxygen saturation (StO2), tissue perfusion (near-infrared perfusion index [NIR]), organ hemoglobin index (OHI), and tissue water index (TWI).

RESULTS

StO2 as well as NIR of the region of interest (ROI) was significantly higher in stapled anastomoses as compared to hand-sewn ileal-ileal anastomoses (StO2 0.79 (0.74-0.81) vs. 0.66 (0.62-0.70); p<0.001 NIR 0.83 (0.70-0.86) vs. 0.70 (0.63-0.76); p=0.01). In both groups, neither anastomotic leakage nor abdominal septic complications nor patient death did occur.

CONCLUSIONS

Intraoperative HSI assessment is able to detect significant differences in tissue oxygenation and NIR of hand-sewn and stapled intestinal anastomoses. Long-term clinical consequences resulting from the reduced tissue oxygenation and tissue perfusion in hand-sewn anastomoses need to be evaluated in larger clinical trials, as patients may benefit from further refined surgical techniques.

Video: Clinical evaluation of a laparoscopic hyperspectral imaging system

Background

Hyperspectral imaging (HSI) during surgical procedures is a new method for perfusion quantification and tissue discrimination. Its use has been limited to open surgery due to large camera sizes, missing color video, or long acquisition times. A hand-held, laparoscopic hyperspectral camera has been developed now to overcome those disadvantages and evaluated clinically for the first time.

Methods

In a clinical evaluation study, gastrointestinal resectates of ten cancer patients were investigated using the laparoscopic hyperspectral camera. Reference data from corresponding anatomical regions were acquired with a clinically approved HSI system. An image registration process was executed that allowed for pixel-wise comparisons of spectral data and parameter images (StO₂: oxygen saturation of tissue, NIR PI: near-infrared perfusion index, OHI: organ hemoglobin index, TWI: tissue water index) provided by both camera systems. The mean absolute error (MAE) and root mean square error (RMSE) served for the quantitative evaluations. Spearman’s rank correlation between factors related to the study design like the time of spectral white balancing and MAE, respectively RMSE, was calculated.

Results

The obtained mean MAEs between the TIVITA® Tissue and the laparoscopic hyperspectral system resulted in StO₂: 11% ± 7%, NIR PI: 14±3, OHI: 14± 5, and TWI: 10 ± 2. The mean RMSE between both systems was 0.1±0.03 from 500 to 750 nm and 0.15 ±0.06 from 750 to 1000 nm. Spearman’s rank correlation coefficients showed no significant correlation between MAE or RMSE and influencing factors related to the study design.

Conclusion

Qualitatively, parameter images of the laparoscopic system corresponded to those of the system for open surgery. Quantitative deviations were attributed to technical differences rather than the study design. Limitations of the presented study are addressed in current large-scale in vivo trials.

Supplementary Information

The online version contains supplementary material available at 10.1007/s00464-022-09282-y.

Hyperspectral Imaging for Assessment of Initial Graft Function in Human Kidney Transplantation

The aim of our study was to evaluate hyperspectral imaging (HSI) as a rapid, non-ionizing technique for the assessment of organ quality and the prediction of delayed graft function (DGF) in kidney transplantation after static cold storage (SCS, n = 20), as well as hypothermic machine perfusion (HMP, n = 18). HSI assessment of the kidney parenchyma was performed during organ preservation and at 10 and 30 min after reperfusion using the TIVITA^® Tissue System (Diaspective Vision GmbH, Am Salzhaff, Germany), calculating oxygen saturation (StO₂), near-infrared perfusion index (NIR), tissue haemoglobin index (THI), and tissue water index (TWI). Recipient and donor characteristics were comparable between organ preservation groups. Cold ischemic time was significantly longer in the HMP group (14.1 h [3.6–23.1] vs. 8.7h [2.2–17.0], p = 0.002). The overall presence of DGF was comparable between groups (HMP group n = 10 (55.6%), SCS group n = 10 (50.0%)). Prediction of DGF was possible in SCS and HMP kidneys; StO₂ at 10 (50.00 [17.75–76.25] vs. 63.17 [27.00–77.75]%, p = 0.0467) and 30 min (57.63 [18.25–78.25] vs. 65.38 [21.25–83.33]%, p = 0.0323) after reperfusion, as well as NIR at 10 (41.75 [1.0–58.00] vs. 48.63 [12.25–69.50], p = 0.0137) and 30 min (49.63 [8.50–66.75] vs. 55.80 [14.75–73.25], p = 0.0261) after reperfusion were significantly lower in DGF kidneys, independent of the organ preservation method. In conclusion, HSI is a reliable method for intraoperative assessment of renal microperfusion, applicable after organ preservation through SCS and HMP, and predicts the development of DGF.

Optimized spectral filter design enables more accurate estimation of oxygen saturation in spectral imaging

Oxygen saturation (SO₂) in tissue is a crucially important physiological parameter with ubiquitous clinical utility in diagnosis, treatment, and monitoring, as well as widespread use as an invaluable preclinical research tool. Multispectral imaging can be used to visualize SO₂ non-invasively, non-destructively and without contact in real-time using narrow spectral filter sets, but typically, these spectral filter sets are poorly suited to a specific clinical task, application, or tissue type. In this work, we demonstrate the merit of optimizing spectral filter sets for more accurate estimation of SO₂. Using tissue modelling and simulated multispectral imaging, we demonstrate filter optimization reduces the root-mean-square-error (RMSE) in estimating SO₂ by up to 37% compared with evenly spaced filters. Moreover, we demonstrate up to a 79% decrease in RMSE for optimized filter sets compared with filter sets chosen to minimize mutual information. Wider adoption of this approach will result in more effective multispectral imaging systems that can address specific clinical needs and consequently, more widespread adoption of multispectral imaging technologies in disease diagnosis and treatment.

Near-infrared fluorescence imaging with indocyanine green to assess the blood supply of the reconstructed gastric conduit to reduce anastomotic leakage after esophagectomy: a literature review

The blood supply of the right gastroepiploic artery after esophagectomy with gastric tube reconstruction is essential for avoiding anastomotic leakage. Near-infrared fluorescence (NIRF) imaging with indocyanine green is widely used to assess the blood supply because it can visualize it in real-time during navigation surgery. However, there is no established protocol for this modality. One reason for this lack of protocol is that NIRF provides subjective information. This study aimed to evaluate NIRF quantification. We conducted a literature review of risk factors for anastomotic leakage after esophagectomy, NIRF procedures, NIRF quantification, and new methods to compensate for NIRF limitations. Major methods for the quantification of NIRF include measuring the blood flow speed, visualization time, and fluorescence intensity. The cutoff value for the blood flow speed is 2.07 cm/s, and that for the visualization time is 30-90 s. Although the time-intensity curve provided patterns of change in the blood flow, it did not show an association with anastomotic leakage. However, to compensate for the limitations of NIRF, new devices have been reported that can assess tissue oxygenation perfusion, organ hemoglobin concentration, and microcirculation.

New Intraoperative Imaging Tools and Image-Guided Surgery in Gastric Cancer Surgery

Innovations and new advancements in intraoperative real-time imaging have gained significant importance in the field of gastric cancer surgery in the recent past. Currently, the most promising procedures include indocyanine green fluorescence imaging (ICG-FI) and hyperspectral imaging or multispectral imaging (HSI, MSI). ICG-FI is utilized in a broad range of clinical applications, e.g., assessment of perfusion or lymphatic drainage, and additional implementations are currently investigated. HSI is still in the experimental phase and its value and clinical relevance require further evaluation, but initial studies have shown a successful application in perfusion assessment, and prospects concerning non-invasive tissue and tumor classification are promising. The application of machine learning and artificial intelligence technologies might enable an automatic evaluation of the acquired image data in the future. Both methods facilitate the accurate visualization of tissue characteristics that are initially indistinguishable for the human eye. By aiding surgeons in optimizing the surgical procedure, image-guided surgery can contribute to the oncologic safety and reduction of complications in gastric cancer surgery and recent advances hold promise for the application of HSI in intraoperative tissue diagnostics.

Perioperative Hyperspectral Imaging to Assess Mastectomy Skin Flap and DIEP Flap Perfusion in Immediate Autologous Breast Reconstruction: A Pilot Study

Mastectomy skin flap necrosis (MSFN) and partial DIEP (deep inferior epigastric artery perforator) flap loss represent two frequently reported complications in immediate autologous breast reconstruction. These complications could be prevented when areas of insufficient tissue perfusion are detected intraoperatively. Hyperspectral imaging (HSI) is a relatively novel, non-invasive imaging technique, which could be used to objectively assess tissue perfusion through analysis of tissue oxygenation patterns (StO₂%), near-infrared (NIR%), tissue hemoglobin (THI%), and tissue water (TWI%) perfusion indices. This prospective clinical pilot study aimed to evaluate the efficacy of HSI for tissue perfusion assessment and to identify a cut-off value for flap necrosis. Ten patients with a mean age of 55.4 years underwent immediate unilateral autologous breast reconstruction. Prior, during and up to 72 h after surgery, a total of 19 hyperspectral images per patient were acquired. MSFN was observed in 3 out of 10 patients. No DIEP flap necrosis was observed. In all MSFN cases, an increased THI% and decreased StO₂%, NIR%, and TWI% were observed when compared to the vital group. StO₂% was found to be the most sensitive parameter to detect MSFN with a statistically significant lower mean StO₂% (51% in the vital group versus 32% in the necrosis group, p < 0.0001) and a cut-off value of 36.29% for flap necrosis. HSI has the potential to accurately assess mastectomy skin flap perfusion and discriminate between vital and necrotic skin flap during the early postoperative period prior to clinical observation. Although the results should be confirmed in future studies, including DIEP flap necrosis specifically, these findings suggest that HSI can aid clinicians in postoperative mastectomy skin flap and DIEP flap monitoring.

Hyperspectral Imaging for Clinical Applications

Measuring morphological and biochemical features of tissue is crucial for disease diagnosis and surgical guidance, providing clinically significant information related to pathophysiology. Hyperspectral imaging (HSI) techniques obtain both spatial and spectral features of tissue without labeling molecules such as fluorescent dyes, which provides rich information for improved disease diagnosis and treatment. Recent advances in HSI systems have demonstrated its potential for clinical applications, especially in disease diagnosis and image-guided surgery. This review summarizes the basic principle of HSI and optical systems, deep-learning-based image analysis, and clinical applications of HSI to provide insight into this rapidly growing field of research. In addition, the challenges facing the clinical implementation of HSI techniques are discussed.

Novel Intraoperative Imaging of Gastric Tube Perfusion during Oncologic Esophagectomy—A Pilot Study Comparing Hyperspectral Imaging (HSI) and Fluorescence Imaging (FI) with Indocyanine Green (ICG)

Background: Novel intraoperative imaging techniques, namely, hyperspectral (HSI) and fluorescence imaging (FI), are promising with respect to reducing severe postoperative complications, thus increasing patient safety. Both tools have already been used to evaluate perfusion of the gastric conduit after esophagectomy and before anastomosis. To our knowledge, this is the first study evaluating both modalities simultaneously during esophagectomy. Methods: In our pilot study, 13 patients, who underwent Ivor Lewis esophagectomy and gastric conduit reconstruction, were analyzed prospectively. HSI and FI were recorded before establishing the anastomosis in order to determine its optimum position. Results: No anastomotic leak occurred during this pilot study. In five patients, the imaging methods resulted in a more peripheral adaptation of the anastomosis. There were no significant differences between the two imaging tools, and no adverse events due to the imaging methods or indocyanine green (ICG) injection occurred. Conclusions: Simultaneous intraoperative application of both modalities was feasible and not time consuming. They are complementary with regard to the ideal anastomotic position and may contribute to better surgical outcomes. The impact of their simultaneous application will be proven in consecutive prospective trials with a large patient cohort.

Gastric ischemic conditioning prior to esophagectomy reduces anastomotic leaks and strictures: a systematic review and meta-analysis

BACKGROUND

Gastric ischemic conditioning (GIC) is a strategy to promote neovascularization of the gastric conduit to reduce the risk of anastomotic complications following esophagectomy. Despite a number of studies and reviews published on the concept of ischemic conditioning, there remains no clear consensus regarding its utility. We performed an updated systematic review and meta-analysis to determine the impact of GIC, particularly on anastomotic leaks, conduit ischemia, and strictures.

METHODS

A systematic search of MEDLINE, EMBASE, Scopus, Web of Science, and Cochrane Library was performed on February 5th, 2020 by a university librarian after selection of key search terms with the research team. Inclusion criteria included human participants undergoing esophagectomy with gastric conduit reconstruction, age ≥ 18, N ≥ 5, and GIC performed prior to esophagectomy. Our primary outcome of interest was anastomotic leaks. Our secondary outcome was gastric conduit ischemia, anastomotic strictures, and overall survival. Meta-analysis was performed with RevMan 5.4.1 using a Mantel-Haenszel fixed-effects model.

RESULTS

A total of 1712 preliminary studies were identified and 23 studies included for final review. GIC was performed in 1178 (53.5%) patients. Meta-analysis revealed reduced odds of anastomotic leaks (OR 0.67; 95% CI 0.46-0.97; I² = 5%; p = 0.03) and anastomotic strictures (OR 0.48; 95% CI 0.29-0.80; I² = 65%; p = 0.005). Meta-analysis revealed no difference in odds of conduit ischemia (OR 0.40; 95% CI 0.13-1.23; I² = 0%; p = 0.11) and no difference in odds of overall survival (OR 0.54; 95% CI 0.29-1.02; I² = 22%; p = 0.06).

CONCLUSION

GIC is associated with reduced odds of anastomotic leaks and anastomotic strictures and may decrease morbidity in patients undergoing esophagectomy. Further prospective randomized trials are needed to better identify the optimal patient population, timing, and techniques used to best achieve GIC.

Intraoperative Guidance Using Hyperspectral Imaging: A Review for Surgeons

Hyperspectral imaging (HSI) is a novel optical imaging modality, which has recently found diverse applications in the medical field. HSI is a hybrid imaging modality, combining a digital photographic camera with a spectrographic unit, and it allows for a contactless and non-destructive biochemical analysis of living tissue. HSI provides quantitative and qualitative information of the tissue composition at molecular level in a contrast-free manner, hence making it possible to objectively discriminate between different tissue types and between healthy and pathological tissue. Over the last two decades, HSI has been increasingly used in the medical field, and only recently it has found an application in the operating room. In the last few years, several research groups have used this imaging modality as an intraoperative guidance tool within different surgical disciplines. Despite its great potential, HSI still remains far from being routinely used in the daily surgical practice, since it is still largely unknown to most of the surgical community. The aim of this study is to provide clinical surgeons with an overview of the capabilities, current limitations, and future directions of HSI for intraoperative guidance.

Hyperspectral Imaging: A New Intraoperative Tool for Pouch Assessment in Patients Undergoing Restorative Proctocolectomy

Introduction

Restorative proctocolectomy with ileal pouch-anal anastomosis (IPAA) is a challenging operation. Especially the mobilization of the pouch into the pelvis can be complex. Adequate perfusion of the pouch is required for optimal healing and functioning.

Methods

With hyperspectral imaging (HSI) wavelengths between 500 and 1,000 nm can be analyzed in addition to visible light and by reflecting patterns. This intraoperative procedure is non-invasive, contact-free, and no contrast medium is needed. Fifteen patients undergoing IPAA were examined prospectively, and the pouch was evaluated by HSI intraoperatively. HSI was measured in standardized fashion at 4 defined locations of the J-pouch. Each measurement took about 10 s. The clinical postoperative course was assessed in all patients and correlated to the intraoperative HSI findings.

Results

Mean near-infrared perfusion and oxygenation of patients showed values ≥74% for all defined pouch areas, revealing good blood supply. Three minor anastomotic leaks were detected by standard pouchoscopy in the postoperative course, which could be treated conservatively with endosponge therapy.

Conclusion

HSI values of perfusion and oxygenation of the IPAA were high. The leak rate is associated with redo procedures. This is reflected by the current literature and most likely related to the higher complexity of the revisional pouch operation. HSI has proved itself as a quick and effective new intraoperative tool to evaluate pouch perfusion objectively and quantitatively.

Deep Learning Analysis of In Vivo Hyperspectral Images for Automated Intraoperative Nerve Detection

Nerves are critical structures that may be difficult to recognize during surgery. Inadvertent nerve injuries can have catastrophic consequences for the patient and lead to life-long pain and a reduced quality of life. Hyperspectral imaging (HSI) is a non-invasive technique combining photography with spectroscopy, allowing non-invasive intraoperative biological tissue property quantification. We show, for the first time, that HSI combined with deep learning allows nerves and other tissue types to be automatically recognized in in vivo hyperspectral images. An animal model was used, and eight anesthetized pigs underwent neck midline incisions, exposing several structures (nerve, artery, vein, muscle, fat, skin). State-of-the-art machine learning models were trained to recognize these tissue types in HSI data. The best model was a convolutional neural network (CNN), achieving an overall average sensitivity of 0.91 and a specificity of 1.0, validated with leave-one-patient-out cross-validation. For the nerve, the CNN achieved an average sensitivity of 0.76 and a specificity of 0.99. In conclusion, HSI combined with a CNN model is suitable for in vivo nerve recognition.

[New intraoperative fluorescence-based and spectroscopic imaging techniques in visceral medicine - precision surgery in the "high tech"-operating room]

INTRODUCTION

Fluorescence angiography (FA) with indocyanine green (ICG) and hyperspectral imaging (HSI) are novel intraoperative visualization techniques in abdominal, vascular and transplant surgery. With the purpose of precision surgery, and in order to increase patient's safety, these new tools aim at reducing postoperative morbidity and mortality. This review discusses and highlights recent developments and the future potential of real-time imaging modalities.

METHODS

The underlying mechanisms of the novel imaging methods and their clinical impact are displayed in the context of avoiding anastomotic leaks, the most momentous complications in gastrointestinal surgery after oncologic resections.

RESULTS

While FA is associated with the admission of a fluorescence agent, HSI is contact-free and non-invasive. Both methods are able to record physiological tissue properties in real-time. Additionally, FA also measures dynamic phenomena. The techniques take a few seconds only and do not hamper the operative workflow considerably. With regard to a potential change of the surgical strategy, FA and HSI have an equal significance. Our own advancements reflect, in particular, the topics of data visualization and automated data analyses together with the implementation of artificial intelligence (AI) and minimalization of the current devices to install them into endoscopes, minimal-invasive and robot-guided surgery.

CONCLUSION

There are a limited number of studies in the field of intraoperative imaging techniques. Whether precision surgery in the "high-tech" OR together with FA, HSI and robotics will result in more secure operative procedures to minimize the postoperative morbidity and mortality will have to be evaluated in future multicenter trials.

Hyperspectral Imaging (HSI)-A New Tool to Estimate the Perfusion of Upper Abdominal Organs during Pancreatoduodenectomy

Simple Summary

Novel intraoperative imaging systems may have a critical impact on intraoperative decision-making. Hyperspectral imaging (HSI) is one of the leading new imaging systems, providing color pictures of tissue characterization, such as oxygen saturation (StO₂) and Near-Infrared Perfusion Index (NIR-PI). Several surgical disciplines have already used HSI in detecting tissue perfusion with a proven record of success. To the best of our knowledge, HSI has not been used in the field of pancreatic surgery yet.

Abstract

Hyperspectral imaging (HSI) in abdominal surgery is a new non-invasive tool for the assessment of the perfusion and oxygenation of various tissues and organs. Its benefit in pancreatic surgery is still unknown. The aim of this study was to evaluate the key impact of using HSI during pancreatoduodenectomy (PD). In total, 20 consecutive patients were included. HSI was recorded during surgery as part of a pilot study approved by the local Ethics Committee. Data were collected prospectively with the TIVITA^® Tissue System. Intraoperative HS images were recorded before and after gastroduodenal artery (GDA) clamping. We detected four patients with celiac artery stenosis (CAS) caused by a median arcuate ligament (MAL). In two of these patients, a reduction in liver oxygenation (StO₂) was discovered 15 and 30 min after GDA clamping. The MAL was divided in these patients. HSI showed an improvement of liver StO₂ after MAL division (from 61% to 73%) in one of these two patients. There was no obvious decrease in liver StO₂ in the other two patients with CAS. HSI, as a non-invasive procedure, could be helpful in evaluating liver and gastric perfusion during PD, which might assist surgeons in choosing the best surgical approach and in improving patients’ outcomes.

Hyperspectral Imaging (HSI) as a new diagnostic tool in free flap monitoring for soft tissue reconstruction: a proof of concept study

OBJECTIVES

Free flap surgery is an essential procedure in soft tissue reconstruction. Complications due to vascular compromise often require revision surgery or flap removal. We present hyperspectral imaging (HSI) as a new tool in flap monitoring to improve sensitivity compared to established monitoring tools.

METHODS

We performed a prospective observational cohort study including 22 patients. Flap perfusion was assessed by standard clinical parameters, Doppler ultrasound, and HSI on t0 (0 h), t1 (16-28 h postoperatively), and t2 (39-77 h postoperatively). HSI records light spectra from 500 to 1000 nm and provides information on tissue morphology, composition, and physiology. These parameters contain tissue oxygenation (StO2), near-infrared perfusion- (NIR PI), tissue hemoglobin- (THI), and tissue water index (TWI).

RESULTS

Total flap loss was seen in n = 4 and partial loss in n = 2 cases. Every patient with StO2 or NIR PI below 40 at t1 had to be revised. No single patient with StO2 or NIR PI above 40 at t1 had to be revised. Significant differences between feasable (StO2 = 49; NIR PI = 45; THI = 16; TWI = 56) and flaps with revision surgery [StO2 = 28 (p < 0.001); NIR PI = 26 (p = 0.002); THI = 56 (p = 0.002); TWI = 47 (p = 0.045)] were present in all HSI parameters at t1 and even more significant at t2 (p < 0.0001).

CONCLUSION

HSI provides valuable data in free flap monitoring. The technique seems to be superior to the gold standard of flap monitoring. StO2 and NIR PI deliver the most valuable data and 40 could be used as a future threshold in surgical decision making. Clinical Trial Register This study is registered at the German Clinical Trials Register (DRKS) under the registration number DRKS00020926.

Hyperspectral analysis for perioperative perfusion monitoring-a clinical feasibility study on free and pedicled flaps

OBJECTIVES

In reconstructive surgery, flap monitoring is crucial for early identification of perfusion problems. Using hyperspectral imaging (HSI), this clinical study aimed to develop a non-invasive, objective approach for perfusion monitoring of free and pedicled flaps.

MATERIAL AND METHODS

HSI of 22 free (FF) and 8 pedicled flaps (PF) in 30 patients was recorded over time. Parameters assessed were tissue oxygenation/superficial perfusion (0-1 mm) (StO2 (0-100%)), near-infrared perfusion/deep perfusion (0-4 mm) (NIR (0-100)), distribution of haemoglobin (THI (0-100)), and water (TWI (0-100)). Measurements up to 72 h were correlated to clinical assessment.

RESULTS

Directly after flap inset, mean StO2 was significantly higher in FF (70.3 ± 13.6%) compared with PF 56.2 ± 14.2% (p = 0.05), whereas NIR, THI, and TWI were similar (NIR_p = 0.82, THI_p = 0.97, TWI_p = 0.27). After 24 h, StO2, NIR, THI, and TWI did not differ between FF and PF. After 48 h, StO2, NIR, and TWI did not differ between FF and PF whereas THI was significantly increased in FF compared with PF(p = 0.001). In three FF, perfusion decreased clinically and in HSI, 36(1), 40(2), 5(3), and 61(3) h after flap inset which was followed by prompt intervention.

CONCLUSIONS

StO2 < 40%, NIR < 25/100, and THI < 40/100 indicated arterial occlusion, whereas venous problems revealed an increase of THI. In comparison with FF, perfusion parameters of PF were decreased after flap transfer but remained similar to FF later on.

CLINICAL RELEVANCE

HSI provides objective and non-invasive perfusion monitoring after flap transplantation in accordance to the clinical situation. With HSI, signs of deterioration can be detected hours before clinical diagnosis.

Feedforward Artificial Neural Network-Based Colorectal Cancer Detection Using Hyperspectral Imaging: A Step towards Automatic Optical Biopsy

Simple Summary

Detection of colorectal carcinoma is performed visually by investigators and is confirmed pathologically. With hyperspectral imaging, an expanded spectral range of optical information is now available for analysis. The acquired recordings were analyzed with a neural network, and it was possible to differentiate tumor from healthy mucosa in colorectal carcinoma by automatic classification with high reliability. Classification and visualization were performed based on a four-layer perceptron neural network. Based on a neural network, the classification of CA or AD resulted in a sensitivity of 86% and a specificity of 95%, by means of leave-one-patient-out cross-validation. Additionally, significant differences in terms of perfusion parameters (e.g., oxygen saturation) related to tumor staging and neoadjuvant therapy were observed. This is a step towards optical biopsy.

Abstract

Currently, colorectal cancer (CRC) is mainly identified via a visual assessment during colonoscopy, increasingly used artificial intelligence algorithms, or surgery. Subsequently, CRC is confirmed through a histopathological examination by a pathologist. Hyperspectral imaging (HSI), a non-invasive optical imaging technology, has shown promising results in the medical field. In the current study, we combined HSI with several artificial intelligence algorithms to discriminate CRC. Between July 2019 and May 2020, 54 consecutive patients undergoing colorectal resections for CRC were included. The tumor was imaged from the mucosal side with a hyperspectral camera. The image annotations were classified into three groups (cancer, CA; adenomatous margin around the central tumor, AD; and healthy mucosa, HM). Classification and visualization were performed based on a four-layer perceptron neural network. Based on a neural network, the classification of CA or AD resulted in a sensitivity of 86% and a specificity of 95%, by means of leave-one-patient-out cross-validation. Additionally, significant differences in terms of perfusion parameters (e.g., oxygen saturation) related to tumor staging and neoadjuvant therapy were observed. Hyperspectral imaging combined with automatic classification can be used to differentiate between CRC and healthy mucosa. Additionally, the biological changes induced by chemotherapy to the tissue are detectable with HSI.

Intraoperative Perfusion Assessment in Enhanced Reality Using Quantitative Optical Imaging: An Experimental Study in a Pancreatic Partial Ischemia Model

To reduce the risk of pancreatic fistula after pancreatectomy, a satisfactory blood flow at the pancreatic stump is considered crucial. Our group has developed and validated a real-time computational imaging analysis of tissue perfusion, using fluorescence imaging, the fluorescence-based enhanced reality (FLER). Hyperspectral imaging (HSI) is another emerging technology, which provides tissue-specific spectral signatures, allowing for perfusion quantification. Both imaging modalities were employed to estimate perfusion in a porcine model of partial pancreatic ischemia. Perfusion quantification was assessed using the metrics of both imaging modalities (slope of the time to reach maximum fluorescence intensity and tissue oxygen saturation (StO2), for FLER and HSI, respectively). We found that the HSI-StO2 and the FLER slope were statistically correlated using the Spearman analysis (R = 0.697; p = 0.013). Local capillary lactate values were statistically correlated to the HSI-StO2 and to the FLER slope (R = −0.88; p < 0.001 and R = −0.608; p = 0.0074). HSI-based and FLER-based lactate prediction models had statistically similar predictive abilities (p = 0.112). Both modalities are promising to assess real-time pancreatic perfusion. Clinical translation in human pancreatic surgery is currently underway.

Algorithm for Mapping Kidney Tissue Water Content during Normothermic Machine Perfusion Using Hyperspectral Imaging

The preservation of kidneys using normothermic machine perfusion (NMP) prior to transplantation has the potential for predictive evaluation of organ quality. Investigations concerning the quantitative assessment of physiological tissue parameters and their dependence on organ function lack in this context. In this study, hyperspectral imaging (HSI) in the wavelength range of 500–995 nm was conducted for the determination of tissue water content (TWC) in kidneys. The quantitative relationship between spectral data and the reference TWC values was established by partial least squares regression (PLSR). Different preprocessing methods were applied to investigate their influence on predicting the TWC of kidneys. In the full wavelength range, the best models for absorbance and reflectance spectra provided Rp2 values of 0.968 and 0.963, as well as root-mean-square error of prediction (RMSEP) values of 2.016 and 2.155, respectively. Considering an optimal wavelength range (800–980 nm), the best model based on reflectance spectra (Rp2 value of 0.941, RMSEP value of 3.202). Finally, the visualization of TWC distribution in all pixels of kidneys’ HSI image was implemented. The results show the feasibility of HSI for a non-invasively and accurate TWC prediction in kidneys, which could be used in the future to assess the quality of kidneys during the preservation period.

A Novel Technique to Improve Anastomotic Perfusion Prior to Esophageal Surgery: Hybrid Ischemic Preconditioning of the Stomach. Preclinical Efficacy Proof in a Porcine Survival Model

Simple Summary

Esophagectomy has a high rate of anastomotic complications thought to be caused by poor perfusion of the gastric graft, which is used to restore the continuity of the gastrointestinal tract. Ischemic gastric preconditioning (IGP), performed by partially destroying preoperatively the gastric vessels either by means of interventional radiology or surgically, might improve the gastric conduit perfusion. Both approaches have downsides. The timing, extent and mechanism of IGP remain unclear. A novel hybrid IGP method combining the advantages of the endovascular and surgical approach was introduced in this study. IGP improves unequivocally the mucosal and serosal blood-flow at the gastric conduit fundus by triggering new vessels formation. The proposed timing and extent of IGP were efficacious and might be easily applied to humans. This novel minimally invasive IGP technique might reduce the anastomotic leak rate of patients undergoing esophagectomy, thus improving their overall oncological outcome.

Abstract

Esophagectomy often presents anastomotic leaks (AL), due to tenuous perfusion of gastric conduit fundus (GCF). Hybrid (endovascular/surgical) ischemic gastric preconditioning (IGP), might improve GCF perfusion. Sixteen pigs undergoing IGP were randomized: (1) Max-IGP (n = 6): embolization of left gastric artery (LGA), right gastric artery (RGA), left gastroepiploic artery (LGEA), and laparoscopic division (LapD) of short gastric arteries (SGA); (2) Min-IGP (n = 5): LGA-embolization, SGA-LapD; (3) Sham (n = 5): angiography, laparoscopy. At day 21 gastric tubulation occurred and GCF perfusion was assessed as: (A) Serosal-tissue-oxygenation (StO₂) by hyperspectral-imaging; (B) Serosal time-to-peak (TTP) by fluorescence-imaging; (C) Mucosal functional-capillary-density-area (FCD-A) index by confocal-laser-endomicroscopy. Local capillary lactates (LCL) were sampled. Neovascularization was assessed (histology/immunohistochemistry). Sham presented lower StO₂ and FCD-A index (41 ± 10.6%; 0.03 ± 0.03 respectively) than min-IGP (66.2 ± 10.2%, p-value = 0.004; 0.22 ± 0.02, p-value < 0.0001 respectively) and max-IGP (63.8 ± 9.4%, p-value = 0.006; 0.2 ± 0.02, p-value < 0.0001 respectively). Sham had higher LCL (9.6 ± 4.8 mL/mol) than min-IGP (4 ± 3.1, p-value = 0.04) and max-IGP (3.4 ± 1.5, p-value = 0.02). For StO₂, FCD-A, LCL, max- and min-IGP did not differ. Sham had higher TTP (24.4 ± 4.9 s) than max-IGP (10 ± 1.5 s, p-value = 0.0008) and min-IGP (14 ± 1.7 s, non-significant). Max- and min-IGP did not differ. Neovascularization was confirmed in both IGP groups. Hybrid IGP improves GCF perfusion, potentially reducing post-esophagectomy AL.

Quantitative serosal and mucosal optical imaging perfusion assessment in gastric conduits for esophageal surgery: an experimental study in enhanced reality

Introduction/objective

Gastric conduit (GC) is used for reconstruction after esophagectomy. Anastomotic leakage (AL) incidence remains high, given the extensive disruption of the gastric circulation. Currently, there is no reliable method to intraoperatively quantify gastric perfusion. Hyperspectral imaging (HSI) has shown its potential to quantify serosal StO2. Confocal laser endomicroscopy (CLE) allows for automatic mucosal microcirculation quantification as functional capillary density area (FCD-A). The aim of this study was to quantify serosal and mucosal GC’s microperfusion using HSI and CLE. Local capillary lactate (LCL) served as biomarker.

Methods

GC was formed in 5 pigs and serosal StO2% was quantified at 3 regions of interest (ROI) using HSI: fundus (ROI-F), greater curvature (ROI-C), and pylorus (ROI-P). After intravenous injection of sodium-fluorescein (0.5 g), CLE-based mucosal microperfusion was assessed at the corresponding ROIs, and LCLs were quantified via a lactate analyzer.

Results

StO2 and FCD-A at ROI-F (41 ± 10.6%, 3.3 ± 3.8, respectively) were significantly lower than ROI-C (68.2 ± 6.7%, p value: 0.005; 18.4 ± 7, p value: 0.01, respectively) and ROI-P (72 ± 10.4%, p value: 0.005; 15.7 ± 3.2 p value: 0.001). LCL value at ROI-F (9.6 ± 4.7 mmol/L) was significantly higher than at ROI-C (2.6 ± 1.2 mmol/L, p value: 0.04) and ROI-P (2.6 ± 1.3 mmol/L, p value: 0.04). No statistically significant difference was found in all metrics between ROI-C and ROI-P. StO2 correlated with FCD-A (Pearson’s r = 0.67). The LCL correlated negatively with both FCD-A (Spearman’s r =  − 0.74) and StO2 (Spearman’s r =  −  0.54).

Conclusions

GC formation causes a drop in serosal and mucosal fundic perfusion. HSI and CLE correlate well and might become useful intraoperative tools.

Demarcation Line Assessment in Anatomical Liver Resection: An Overview

Anatomical liver resection (ALR) is the preferred oncological approach for the treatment of primary liver malignancies, such as hepatocellular carcinoma and intrahepatic cholangiocarcinoma. The demarcation line (DL) is formed by means of selective vascular occlusion and is used by surgeons to guide ALR. Emerging intraoperative technologies are playing a major role to enhance the surgeon’s vision and ensure a precise oncologic surgery. In this article, a brief overview of modalities to assess the DL during ALRs is presented, from the established conventional techniques to future perspectives.

Comparison of spectral characteristics in human and pig biliary system with hyperspectral imaging (HSI)

Injuries to the biliary tree during surgical, endoscopic or invasive radiological diagnostic or therapeutic procedures involving the pancreas, liver or organs of the upper gastrointestinal tract give rise to the need to develop a method for clear discrimination of biliary anatomy from surrounding tissue. Hyperspectral imaging (HSI) is an emerging optical technique in disease diagnosis and image-guided surgery with inherent advantages of being a non-contact, non-invasive, and non-ionizing technique. HSI can produce quantitative diagnostic information about tissue pathology, morphology, and chemical composition. HSI was applied in human liver transplantation and compared to porcine model operations to assess the capability of discriminating biliary anatomy from surrounding biological tissue. Absorbance spectra measured from bile ducts, gall bladder, and liver show a dependence on tissue composition and bile concentration, with agreement between human and porcine datasets. The bile pigment biliverdin and structural proteins collagen and elastin were identified as contributors to the bile duct and gall bladder absorbance spectra.

Intraoperative Assessment of Gastric Sleeve Oxygenation Using Hyperspectral Imaging in Esophageal Resection: A Feasibility Study

Introduction

Sufficient tissue oxygenation is essential for anastomotic healing in visceral surgery. Hyperspectral imaging (HSI) is a noncontact, noninvasive technique for clinical assessment of tissue oxygenation in real time.

Methods

In this case series, HSI was used in 4 patients who were admitted for either esophageal cancer or cardiac carcinoma (AEG type I or II). Thoraco-abdominal surgical esophageal resection was performed after staging and neoadjuvant therapy. Intraoperative oxygenation of superficial (StO₂) and underlying tissue (NIR perfusion index) of the gastric sleeve were studied intrathoracic by means of the TIVITA® Tissue HSI camera. This was performed prior to esophagogastric anastomosis. The postoperative course, especially in view of surgical complications, was recorded.

Results

Assessment of StO₂ and NIR perfusion index was performed in 4 regions of interest per gastric sleeve, aboral and oral of the clinically determined resection line. It allowed the fast quantification of gastric oxygenation prior gastroesophageal anastomosis. Median StO₂ aboral of the determined resection line was 69%, while median StO₂ in the oral part of the gastric sleeve was found at 53%. In contrast, the median NIR perfusion index was similar aboral (80) and oral (82) of the resection line. In none of the 4 studied patients, an anastomotic failure appeared.

Discussion/Conclusion

This report suggests that HSI is a feasible technique for intraoperative assessment of tissue oxygenation before gastroesophageal anastomosis and might reduce the incidence of anastomotic failure in the gastrointestinal tract.

Surgical spectral imaging

Recent technological developments have resulted in the availability of miniaturised spectral imaging sensors capable of operating in the multi- (MSI) and hyperspectral imaging (HSI) regimes. Simultaneous advances in image-processing techniques and artificial intelligence (AI), especially in machine learning and deep learning, have made these data-rich modalities highly attractive as a means of extracting biological information non-destructively. Surgery in particular is poised to benefit from this, as spectrally-resolved tissue optical properties can offer enhanced contrast as well as diagnostic and guidance information during interventions. This is particularly relevant for procedures where inherent contrast is low under standard white light visualisation. This review summarises recent work in surgical spectral imaging (SSI) techniques, taken from Pubmed, Google Scholar and arXiv searches spanning the period 2013-2019. New hardware, optimised for use in both open and minimally-invasive surgery (MIS), is described, and recent commercial activity is summarised. Computational approaches to extract spectral information from conventional colour images are reviewed, as tip-mounted cameras become more commonplace in MIS. Model-based and machine learning methods of data analysis are discussed in addition to simulation, phantom and clinical validation experiments. A wide variety of surgical pilot studies are reported but it is apparent that further work is needed to quantify the clinical value of MSI/HSI. The current trend toward data-driven analysis emphasises the importance of widely-available, standardised spectral imaging datasets, which will aid understanding of variability across organs and patients, and drive clinical translation.