Spectral characterization of intraoperative renal perfusion using hyperspectral imaging and artificial intelligence

Accurate intraoperative assessment of organ perfusion is a pivotal determinant in preserving organ function e.g. during kidney surgery including partial nephrectomy or kidney transplantation. Hyperspectral imaging (HSI) has great potential to objectively describe and quantify this perfusion as opposed to conventional surrogate techniques such as ultrasound flowmeter, indocyanine green or the subjective eye of the surgeon. An established live porcine model under general anesthesia received median laparotomy and renal mobilization. Different scenarios that were measured using HSI were (1) complete, (2) gradual and (3) partial malperfusion. The differences in spectral reflectance as well as HSI oxygenation (StO2) between different perfusion states were compelling and as high as 56.9% with 70.3% (± 11.0%) for "physiological" vs. 13.4% (± 3.1%) for "venous congestion". A machine learning (ML) algorithm was able to distinguish between these perfusion states with a balanced prediction accuracy of 97.8%. Data from this porcine study including 1300 recordings across 57 individuals was compared to a human dataset of 104 recordings across 17 individuals suggesting clinical transferability. Therefore, HSI is a highly promising tool for intraoperative microvascular evaluation of perfusion states with great advantages over existing surrogate techniques. Clinical trials are required to prove patient benefit.

A proof of concept for microcirculation monitoring using machine learning based hyperspectral imaging in critically ill patients: a monocentric observational study

BACKGROUND

Impaired microcirculation is a cornerstone of sepsis development and leads to reduced tissue oxygenation, influenced by fluid and catecholamine administration during treatment. Hyperspectral imaging (HSI) is a non-invasive bedside technology for visualizing physicochemical tissue characteristics. Machine learning (ML) for skin HSI might offer an automated approach for bedside microcirculation assessment, providing an individualized tissue fingerprint of critically ill patients in intensive care. The study aimed to determine if machine learning could be utilized to automatically identify regions of interest (ROIs) in the hand, thereby distinguishing between healthy individuals and critically ill patients with sepsis using HSI.

METHODS

HSI raw data from 75 critically ill sepsis patients and from 30 healthy controls were recorded using TIVITA® Tissue System and analyzed using an automated ML approach. Additionally, patients were divided into two groups based on their SOFA scores for further subanalysis: less severely ill (SOFA ≤ 5) and severely ill (SOFA > 5). The analysis of the HSI raw data was fully-automated using MediaPipe for ROI detection (palm and fingertips) and feature extraction. HSI Features were statistically analyzed to highlight relevant wavelength combinations using Mann-Whitney-U test and Benjamini, Krieger, and Yekutieli (BKY) correction. In addition, Random Forest models were trained using bootstrapping, and feature importances were determined to gain insights regarding the wavelength importance for a model decision.

RESULTS

An automated pipeline for generating ROIs and HSI feature extraction was successfully established. HSI raw data analysis accurately distinguished healthy controls from sepsis patients. Wavelengths at the fingertips differed in the ranges of 575-695 nm and 840-1000 nm. For the palm, significant differences were observed in the range of 925-1000 nm. Feature importance plots indicated relevant information in the same wavelength ranges. Combining palm and fingertip analysis provided the highest reliability, with an AUC of 0.92 to distinguish between sepsis patients and healthy controls.

CONCLUSION

Based on this proof of concept, the integration of automated and standardized ROIs along with automated skin HSI analyzes, was able to differentiate between healthy individuals and patients with sepsis. This approach offers a reliable and objective assessment of skin microcirculation, facilitating the rapid identification of critically ill patients.

Hyperspectral imaging combined with blood oxygen saturation for in vivo analysis of small intestinal necrosis tissue

Acute mesenteric ischemia (AMI) is a clinically significant vascular and gastrointestinal condition, which is closely related to the blood supply of the small intestine. Unfortunately, it is still challenging to properly discriminate small intestinal tissues with different degrees of ischemia. In this study, hyperspectral imaging (HSI) was used to construct pseudo-color images of oxygen saturation about small intestinal tissues and to discriminate different degrees of ischemia. First, several small intestine tissue models of New Zealand white rabbits were prepared and collected their hyperspectral data. Then, a set of isosbestic points were used to linearly transform the measurement data twice to match the reference spectra of oxyhemoglobin and deoxyhemoglobin, respectively. The oxygen saturation was measured at the characteristic peak band of oxyhemoglobin (560 nm). Ultimately, using the oxygenated hemoglobin reflectance spectrum as the benchmark, we obtained the relative amount of median oxygen saturation in normal tissues was 70.0 %, the IQR was 10.1 %, the relative amount of median oxygen saturation in ischemic tissues was 49.6 %, and the IQR was 14.6 %. The results demonstrate that HSI combined with the oxygen saturation computation method can efficiently differentiate between normal and ischemic regions of the small intestinal tissues. This technique provides a powerful support for internist to discriminate small bowel tissues with different degrees of ischemia, and also provides a new way of thinking for the diagnosis of AMI.

Investigation on the influence of the skin tone on hyperspectral imaging for free flap surgery

Hyperspectral imaging (HSI) is a new emerging modality useful for the noncontact assessment of free flap perfusion. This measurement technique relies on the optical properties within the tissue. Since the optical properties of hemoglobin (Hb) and melanin overlap, the results of the perfusion assessment and other tissue-specific parameters are likely to be distorted by the melanin, especially at higher melanin concentrations. Many spectroscopic devices have been shown to struggle with a melanin related bias, which results in a clinical need to improve non-invasive perfusion assessment, especially for a more pigmented population. This study investigated the influence of skin tones on tissue indices measurements using HSI. In addition, other factors that might affect HSI, such as age, body mass index (BMI), sex or smoking habits, were also considered. Therefore, a prospective feasibility study was conducted, including 101 volunteers from whom tissue indices measurements were performed on 16 different body sites. Skin tone classification was performed using the Fitzpatrick skin type classification questionnaire, and the individual typology angle (ITA) acquired from the RGB images was calculated simultaneously with the measurements. Tissue indices provided by the used HSI-device were correlated to the possible influencing factors. The results show that a dark skin tone and, therefore, higher levels of pigmentation influence the HSI-derived tissue indices. In addition, possible physiological factors influencing the HSI-measurements were found. In conclusion, the HSI-based tissue indices can be used for perfusion assessment for people with lighter skin tone levels but show limitations in people with darker skin tones. Furthermore, it could be used for a more individual perfusion assessment if different physiological influencing factors are respected.

Hyperspectral Imaging Detects Clitoral Vascular Issues in Gender-Affirming Surgery

The aim of this study was to assess the efficacy of hyperspectral imaging (HSI) as an intraoperative perfusion imaging modality during gender affirmation surgery (GAS). The hypothesis posited that HSI could quantify perfusion to the clitoral complex, thereby enabling the prediction of either uneventful wound healing or the occurrence of necrosis. In this non-randomised prospective clinical study, we enrolled 30 patients who underwent GAS in the form of vaginoplasty with the preparation of a clitoral complex from 2020 to 2024 and compared patients' characteristics as well as HSI data regarding clitoris necrosis. Individuals demonstrating uneventful wound healing pertaining to the clitoral complex were designated as Group A. Patients with complete necrosis of the neo-clitoris were assigned to Group B. Patient characteristics were collected and subsequently a comparative analysis carried out. No significant difference in patient characteristics was observed between the two groups. Necrosis occurred when both StO2 and NIR PI parameters fell below 40%. For the simultaneous occurrence of StO2 and NIR PI of 40% or less, a sensitivity of 92% and specificity of 72% was calculated. Intraoperatively, the onset of necrosis in the clitoral complex can be reliably predicted with the assistance of HSI.

Test-time augmentation with synthetic data addresses distribution shifts in spectral imaging

PURPOSE

Surgical scene segmentation is crucial for providing context-aware surgical assistance. Recent studies highlight the significant advantages of hyperspectral imaging (HSI) over traditional RGB data in enhancing segmentation performance. Nevertheless, the current hyperspectral imaging (HSI) datasets remain limited and do not capture the full range of tissue variations encountered clinically.

METHODS

Based on a total of 615 hyperspectral images from a total of 16 pigs, featuring porcine organs in different perfusion states, we carry out an exploration of distribution shifts in spectral imaging caused by perfusion alterations. We further introduce a novel strategy to mitigate such distribution shifts, utilizing synthetic data for test-time augmentation.

RESULTS

The effect of perfusion changes on state-of-the-art (SOA) segmentation networks depended on the organ and the specific perfusion alteration induced. In the case of the kidney, we observed a performance decline of up to 93% when applying a state-of-the-art (SOA) network under ischemic conditions. Our method improved on the state-of-the-art (SOA) by up to 4.6 times.

CONCLUSION

Given its potential wide-ranging relevance to diverse pathologies, our approach may serve as a pivotal tool to enhance neural network generalization within the realm of spectral imaging.

The SPECTRAL Perfusion Arm Clamping dAtaset (SPECTRALPACA) for video-rate functional imaging of the skin

Spectral imaging has the potential to become a key technique in interventional medicine as it unveils much richer optical information compared to conventional RBG (red, green, and blue)-based imaging. Thus allowing for high-resolution functional tissue analysis in real time. Its higher information density particularly shows promise for the development of powerful perfusion monitoring methods for clinical use. However, even though in vivo validation of such methods is crucial for their clinical translation, the biomedical field suffers from a lack of publicly available datasets for this purpose. Closing this gap, we generated the SPECTRAL Perfusion Arm Clamping dAtaset (SPECTRALPACA). It comprises ten spectral videos (∼20 Hz, approx. 20,000 frames each) systematically recorded of the hands of ten healthy human participants in different functional states. We paired each spectral video with concisely tracked regions of interest, and corresponding diffuse reflectance measurements recorded with a spectrometer. Providing the first openly accessible in human spectral video dataset for perfusion monitoring, our work facilitates the development and validation of new functional imaging methods.

[Indications and surgical strategy for bowel resection in mesenteric ischemia : Resection margins considering current guidelines and literature as well as the influence of new technical possibilities]

Acute mesenteric ischemia (AMI) is still a time-critical and life-threatening clinical picture. If exploration of the abdominal cavity is necessary during treatment, an intraoperative assessment of which segments of the intestines have a sufficient potential for recovery must be made. These decisions are mostly based on purely clinical parameters, which are subject to high level of uncertainty. This review article provides an overview of how this decision-making process and the determination of resection margins can be improved using technical aids, such as laser Doppler flowmetry (LDF), indocyanine green (ICG) fluorescence angiography or hyperspectral imaging (HSI). Furthermore, this article compiles guideline recommendations on the role of laparoscopy and the value of a planned second-look laparotomy. In addition, an overview of strategies for preventing short bowel syndrome is given and other aspects, such as the timing and technical aspects of placement of a preternatural anus and an anastomosis are highlighted.

Optimizing clinical O2 saturation mapping using hyperspectral imaging and diffuse reflectance spectroscopy in the context of epinephrine injection

Clinical determination of oxygen saturation (sO2) in patients is commonly performed via non-invasive optical techniques. However, reliance on a few wavelengths and some form of pre-determined calibration introduces limits to how these methods can be used. One example involves the assessment of sO2 after injection of local anesthetic using epinephrine, where some controversy exists around the time it takes for the epinephrine to have an effect. This is likely caused by a change in the tissue environment not accounted for by standard calibrated instruments and conventional analysis techniques. The present study aims to account for this changing environment by acquiring absorption spectra using hyperspectral imaging (HSI) and diffuse reflectance spectroscopy (DRS) before, during, and after the injection of local anesthesia containing epinephrine in human volunteers. We demonstrate the need to account for multiple absorbing species when applying linear spectral unmixing in order to obtain more clinically relevant sO2 values. In particular, we demonstrate how the inclusion of water absorption greatly affects the rate at which sO2 seemingly drops, which in turn sheds light on the current debate regarding the time required for local anesthesia with epinephrine to have an effect. In general, this work provides important insight into how spectral analysis methods need to be adapted to specific clinical scenarios to more accurately assess sO2.

Handheld hyperspectral imaging as a tool for the post-mortem interval estimation of human skeletal remains

In forensic medicine, estimating human skeletal remains' post-mortem interval (PMI) can be challenging. Following death, bones undergo a series of chemical and physical transformations due to their interactions with the surrounding environment. Post-mortem changes have been assessed using various methods, but estimating the PMI of skeletal remains could still be improved. We propose a new methodology with handheld hyperspectral imaging (HSI) system based on the first results from 104 human skeletal remains with PMIs ranging between 1 day and 2000 years. To differentiate between forensic and archaeological bone material, the Convolutional Neural Network analyzed 65.000 distinct diagnostic spectra: the classification accuracy was 0.58, 0.62, 0.73, 0.81, and 0.98 for PMIs of 0 week-2 weeks, 2 weeks-6 months, 6 months-1 year, 1 year-10 years, and >100 years, respectively. In conclusion, HSI can be used in forensic medicine to distinguish bone materials >100 years old from those <10 years old with an accuracy of 98%. The model has adequate predictive performance, and handheld HSI could serve as a novel approach to objectively and accurately determine the PMI of human skeletal remains.

Dual-camera laparoscopic imaging with super-resolution reconstruction for intraoperative hyperspectral image guidance

Laparoscopic and robotic surgery, as one type of minimally invasive surgery (MIS), has gained popularity due to the improved surgeon ergonomics, instrument precision, operative time, and postoperative recovery. Hyperspectral imaging (HSI) is an emerging medical imaging modality, which has proved useful for intraoperative image guidance. Snapshot hyperspectral cameras are ideal for intraoperative laparoscopic imaging because of their compact size and light weight, but low spatial resolution can be a limitation. In this work, we developed a dual-camera laparoscopic imaging system that consists of a high-resolution color camera and a snapshot hyperspectral camera, and we employed super-resolution reconstruction to fuse the images from both cameras to generate high-resolution hyperspectral images. The experimental results show that our method can significantly improve the resolution of hyperspectral images without compromising the image quality or spectral signatures. The proposed super-resolution reconstruction method is promising to promote the employment of high-speed hyperspectral imaging in laparoscopic surgery.

Hyperspectral imaging for monitoring of free flaps of the oral cavity: A feasibility study

OBJECTIVES

Hyperspectral imaging (HSI) provides spectral information about hemoglobin, water and oxygen supply and has thus great potential in perfusion monitoring. The aim of the present study was to investigate the feasibility of HSI in the postoperative monitoring of intraoral free flaps.

METHODS

The 14 patients receiving reconstructive head and neck surgery with a radial forearm free flap were included. HSI was performed intraoperatively (t0), on Day 1 (t1), 2 (t2), 3-6 (t3), 7-9 (t4), 10-11 (t5) and 12-15 (t6) postoperatively. Flap tissue perfusion was assessed on defined regions of interest by calculating the perfusion indices Tissue Hemoglobin Index (THI), hemoglobin oxygenation (StO2 ), Near Infrared Perfusion Index (NIR Perfusion Index) and Tissue Water Index (TWI).

RESULTS

Image quality varied depending on location of the flap and time of measurement. StO2 was >50 intraoperatively and >40 on t1 for all patients. A significant difference was found solely for TWI between t0 and t2 and t0 and t4. No flap loss occurred.

CONCLUSIONS

The use of HSI in the monitoring of intraoral flaps is feasible and might become a valuable addition to the current clinical examination of free flaps.

Multispectral indices for real-time and non-invasive tissue ischemia monitoring using snapshot cameras

An adequate supply of oxygen-rich blood is vital to maintain cell homeostasis, cellular metabolism, and overall tissue health. While classical methods of measuring tissue ischemia are often invasive, localized and require skin contact or contrast agents, spectral imaging shows promise as a non-invasive, wide field, and contrast-free approach. We evaluate three novel reflectance-based spectral indices from the 460 - 840 nm spectral range. With the aim of enabling real time visualization of tissue ischemia, information is extracted from only 2-3 spectral bands. Video-rate spectral data was acquired from arm occlusion experiments in 27 healthy volunteers. The performance of the indices was evaluated against binary Support Vector Machine (SVM) classification of healthy versus ischemic skin tissue, two other indices from literature, and tissue oxygenation estimated using spectral unmixing. Robustness was tested by evaluating these under various lighting conditions and on both the dorsal and palmar sides of the hand. A novel index with real-time capabilities using reflectance information only from 547 nm and 556 nm achieves an average classification accuracy of 88.48, compared to 92.65 using an SVM trained on all available wavelengths. Furthermore, the index has a higher accuracy compared to reference methods and its time dynamics compare well against the expected clinical responses. This holds promise for robust real-time detection of tissue ischemia, possibly contributing to improved patient care and clinical outcomes.

A dual-camera hyperspectral laparoscopic imaging system

Minimally invasive surgery (MIS) has expanded broadly in the field of abdominal and pelvic surgery. However, there are still prevalent issues surrounding intracorporeal surgery, such as iatrogenic injury, anastomotic leakage, or the presence of positive tumor margins after resection. Current approaches to address these issues and advance laparoscopic imaging techniques often involve fluorescence imaging agents, such as indocyanine green (ICG), to improve visualization, but these have drawbacks. Hyperspectral imaging (HSI) is an emerging optical imaging modality that takes advantage of spectral characteristics of different tissues. Various applications include tissue classification and digital pathology. In this study, we developed a dual-camera system for high-speed hyperspectral imaging. This includes the development of a custom application interface and corresponding hardware setup. Characterization of the system was performed, including spectral accuracy and spatial resolution, showing little sacrifice in speed for the approximate doubling of the covered spectral range, with our system acquiring 29 spectral images from 460-850 nm. Reference color tiles with various reflectance profiles were imaged and a RMSE of 3.56 ± 1.36% was achieved. Sub-millimeter resolution was shown at 7 cm working distance for both hyperspectral cameras. Finally, we image ex vivo tissues, including porcine stomach, liver, intestine, and kidney with our system and use a high-resolution, radiometrically calibrated spectrometer for comparison and evaluation of spectral fidelity. The dual-camera hyperspectral laparoscopic imaging system can have immediate applications in various surgeries.

[Status Quo of Surgical Navigation]

Surgical navigation, also referred to as computer-assisted or image-guided surgery, is a technique that employs a variety of methods - such as 3D imaging, tracking systems, specialised software, and robotics to support surgeons during surgical interventions. These emerging technologies aim not only to enhance the accuracy and precision of surgical procedures, but also to enable less invasive approaches, with the objective of reducing complications and improving operative outcomes for patients. By harnessing the integration of emerging digital technologies, surgical navigation holds the promise of assisting complex procedures across various medical disciplines. In recent years, the field of surgical navigation has witnessed significant advances. Abdominal surgical navigation, particularly endoscopy, laparoscopic, and robot-assisted surgery, is currently undergoing a phase of rapid evolution. Emphases include image-guided navigation, instrument tracking, and the potential integration of augmented and mixed reality (AR, MR). This article will comprehensively delve into the latest developments in surgical navigation, spanning state-of-the-art intraoperative technologies like hyperspectral and fluorescent imaging, to the integration of preoperative radiological imaging within the intraoperative setting.

ICG-augmented hyperspectral imaging for visualization of intestinal perfusion compared to conventional ICG fluorescence imaging: an experimental study

BACKGROUND

Small bowel malperfusion (SBM) can cause high morbidity and severe surgical consequences. However, there is no standardized objective measuring tool for the quantification of SBM. Indocyanine green (ICG) imaging can be used for visualization, but lacks standardization and objectivity. Hyperspectral imaging (HSI) as a newly emerging technology in medicine might present advantages over conventional ICG fluorescence or in combination with it.

METHODS

HSI baseline data from physiological small bowel, avascular small bowel and small bowel after intravenous application of ICG was recorded in a total number of 54 in-vivo pig models. Visualizations of avascular small bowel after mesotomy were compared between HSI only (1), ICG-augmented HSI (IA-HSI) (2), clinical evaluation through the eyes of the surgeon (3) and conventional ICG imaging (4). The primary research focus was the localization of resection borders as suggested by each of the four methods. Distances between these borders were measured and histological samples were obtained from the regions in between in order to quantify necrotic changes 6 h after mesotomy for every region.

RESULTS

StO2 images (1) were capable of visualizing areas of physiological perfusion and areas of clearly impaired perfusion. However, exact borders where physiological perfusion started to decrease could not be clearly identified. Instead, IA-HSI (2) suggested a sharp-resection line where StO2 values started to decrease. Clinical evaluation (3) suggested a resection line 23 mm (±7 mm) and conventional ICG imaging (4) even suggested a resection line 53 mm (±13 mm) closer towards the malperfused region. Histopathological evaluation of the region that was sufficiently perfused only according to conventional ICG (R3) already revealed a significant increase in pre-necrotic changes in 27% (±9%) of surface area. Therefore, conventional ICG seems less sensitive than IA-HSI with regards to detection of insufficient tissue perfusion.

CONCLUSIONS

In this experimental animal study, IA-HSI (2) was superior for the visualization of segmental SBM compared to conventional HSI imaging (1), clinical evaluation (3) or conventional ICG imaging (4) regarding histopathological safety. ICG application caused visual artifacts in the StO2 values of the HSI camera as values significantly increase. This is caused by optical properties of systemic ICG and does not resemble a true increase in oxygenation levels. However, this empirical finding can be used to visualize segmental SBM utilizing ICG as contrast agent in an approach for IA-HSI. Clinical applicability and relevance will have to be explored in clinical trials.

LEVEL OF EVIDENCE

Not applicable. Translational animal science. Original article.

Bedside Hyperspectral Imaging and Organ Dysfunction Severity in Critically Ill COVID-19 Patients-A Prospective, Monocentric Observational Study

Hyperspectral imaging (HSI) is a non-invasive technology that provides information on biochemical tissue properties, including skin oxygenation and perfusion quality. Microcirculatory alterations are associated with organ dysfunction in septic COVID-19 patients. This prospective observational study investigated associations between skin HSI and organ dysfunction severity in critically ill COVID-19 patients. During the first seven days in the ICU, palmar HSI measurements were carried out with the TIVITA® tissue system. We report data from 52 critically ill COVID-19 patients, of whom 40 required extracorporeal membrane oxygenation (ECMO). HSI parameters for superficial tissue oxygenation (StO2) and oxygenation and perfusion quality (NPI) were persistently decreased. Hemoglobin tissue content (THI) increased, and tissue water content (TWI) was persistently elevated. Regression analysis showed strong indications for an association of NPI and weaker indications for associations of StO2, THI, and TWI with sequential organ failure assessment (SOFA) scoring. StO2 and NPI demonstrated negative associations with vasopressor support and lactate levels as well as positive associations with arterial oxygen saturation. These results suggest that skin HSI provides clinically relevant information, opening new perspectives for microcirculatory monitoring in critical care.

Intraoperative bowel perfusion assessment methods and their effects on anastomotic leak rates: meta-analysis

BACKGROUND

Anastomotic leak is one of the most feared complications of colorectal surgery, and probably linked to poor blood supply to the anastomotic site. Several technologies have been described for intraoperative assessment of bowel perfusion. This systematic review and meta-analysis aimed to evaluate the most frequently used bowel perfusion assessment modalities in elective colorectal procedures, and to assess their associated risk of anastomotic leak. Technologies included indocyanine green fluorescence angiography, diffuse reflectance spectroscopy, laser speckle contrast imaging, and hyperspectral imaging.

METHODS

The review was preregistered with PROSPERO (CRD42021297299). A comprehensive literature search was performed using Embase, MEDLINE, Cochrane Library, Scopus, and Web of Science. The final search was undertaken on 29 July 2022. Data were extracted by two reviewers and the MINORS criteria were applied to assess the risk of bias.

RESULTS

Some 66 eligible studies involving 11 560 participants were included. Indocyanine green fluorescence angiography was most used with 10 789 participants, followed by diffuse reflectance spectroscopy with 321, hyperspectral imaging with 265, and laser speckle contrast imaging with 185. In the meta-analysis, the total pooled effect of an intervention on anastomotic leak was 0.05 (95 per cent c.i. 0.04 to 0.07) in comparison with 0.10 (0.08 to 0.12) without. Use of indocyanine green fluorescence angiography, hyperspectral imaging, or laser speckle contrast imaging was associated with a significant reduction in anastomotic leak.

CONCLUSION

Bowel perfusion assessment reduced the incidence of anastomotic leak, with intraoperative indocyanine green fluorescence angiography, hyperspectral imaging, and laser speckle contrast imaging all demonstrating comparable results.

The Application of Machine Perfusion as an Enhanced ex vivo Model for Optical Imaging

Optical imaging techniques such as spectral imaging show promise for the assessment of tissue health during surgery; however, the validation and translation of such techniques into clinical practise is limited by the lack of representative tissue models. In this paper, we demonstrate the application of an organ perfusion machine as an ex vivo tissue model for optical imaging. Three porcine livers are perfused at stepped blood oxygen saturations. Over the duration of each perfusion, spectral data of the tissue are captured via diffuse optical spectroscopy and multispectral imaging. These data are synchronised with blood oxygen saturation measurements recorded by the perfusion machine. Shifts in the optical properties of the tissue are demonstrated over the duration of the each perfusion, as the tissue becomes reperfused and as the oxygen saturation is varied.

Optimal Hyperspectral Band Selection for Tissue Oxygenation Mapping with Generative Adversarial Network

Tissue oxygenation assessment using hyperspectral imaging is an emerging technique for the diagnosis and pre- and post-treatment monitoring of ischemic patients. However, the high spectral resolution of hyperspectral imaging leads to large data sizes and a long imaging time. In this study, we propose a method that utilizes multi-objective evolutionary algorithms to determine the optimal hyperspectral band combination when developing a deep learning model for predicting tissue oxygenation from hyperspectral images. Our results confirm that the deep learning model effectively predicts tissue oxygenation images for various oxygenation states. Moreover, we demonstrate that a high-performance prediction model can be developed using only a small number of spectral bands, indicating the potential for more efficient non-contact tissue oxygenation mapping with the proposed method.Clinical Relevance- The proposed method allows for the non-contact and efficient acquisition of two-dimensional tissue oxygenation information in various oxygenation states.

HeiPorSPECTRAL - the Heidelberg Porcine HyperSPECTRAL Imaging Dataset of 20 Physiological Organs

Hyperspectral Imaging (HSI) is a relatively new medical imaging modality that exploits an area of diagnostic potential formerly untouched. Although exploratory translational and clinical studies exist, no surgical HSI datasets are openly accessible to the general scientific community. To address this bottleneck, this publication releases HeiPorSPECTRAL ( https://www.heiporspectral.org ; https://doi.org/10.5281/zenodo.7737674 ), the first annotated high-quality standardized surgical HSI dataset. It comprises 5,758 spectral images acquired with the TIVITA® Tissue and annotated with 20 physiological porcine organs from 8 pigs per organ distributed over a total number of 11 pigs. Each HSI image features a resolution of 480 × 640 pixels acquired over the 500-1000 nm wavelength range. The acquisition protocol has been designed such that the variability of organ spectra as a function of several parameters including the camera angle and the individual can be assessed. A comprehensive technical validation confirmed both the quality of the raw data and the annotations. We envision potential reuse within this dataset, but also its reuse as baseline data for future research questions outside this dataset. Measurement(s) Spectral Reflectance Technology Type(s) Hyperspectral Imaging Sample Characteristic - Organism Sus scrofa.

Concurrent Optical- and Magnetic-Stimulation-Induced Changes on Wound Healing Parameters, Analyzed by Hyperspectral Imaging: An Exploratory Case Series

The effects of concurrent optical and magnetic stimulation (COMS) therapy on wound-healing-related parameters, such as tissue oxygenation and water index, were analyzed by hyperspectral imaging: an exploratory case series. Background: Oedema and inadequate perfusion have been identified as key factors in delayed wound healing and have been linked to reduced mitochondrial respiration. Targeting mitochondrial dysfunction is a promising approach in the treatment of therapy refractory wounds. This sub-study aimed to investigate the effects of concurrent optical and magnetic stimulation (COMS) on oedema and perfusion through measuring tissue oxygenation and water index, using hyperspectral imaging. Patients and methods: In a multi-center, prospective, comparative clinical trial, eleven patients with chronic leg and foot ulcers were treated with COMS additively to Standard of Care (SOC). Hyperspectral images were collected during patient visits before and after treatment to assess short- and long-term hemodynamic and immunomodulatory effects through changes in tissue oxygenation and water index. Results: The average time for wound onset in the eleven patients analyzed was 183 days, with 64% of them being considered unresponsive to SOC. At week 12, the rate of near-complete and complete wound closure was 64% and 45%, respectively. COMS therapy with SOC resulted in an increased short-term tissue oxygenation over the 8-week treatment phase, with oxygen levels decreasing in-between patient visits. The study further found a decrease in tissue water content after the therapy, with a general accumulation of water levels in-between patient visits. This study's long-term analysis was hindered by the lack of absolute values in hyperspectral imaging and the dynamic nature of patient parameters during visits, resulting in high interpatient and intervisit variability. Conclusions: This study showed that COMS therapy as an adjunct to SOC had a positive short-term effect on inflammation and tissue oxygenation in chronic wounds of various etiologies. These results further supported the body of evidence for safety and effectiveness of COMS therapy as a treatment option, especially for stagnant wounds that tended to stay in the inflammatory phase and required efficient phase transition towards healing.

Partial Hepatic Vein Occlusion and Venous Congestion in Liver Exploration Using a Hyperspectral Camera: A Proposal for Monitoring Intraoperative Liver Perfusion

INTRODUCTION

The changes occurring in the liver in cases of outflow deprivation have rarely been investigated, and no measurements of this phenomenon are available. This investigation explored outflow occlusion in a pig model using a hyperspectral camera.

METHODS

Six pigs were enrolled. The right hepatic vein was clamped for 30 min. The oxygen saturation (StO₂%), deoxygenated hemoglobin level (de-Hb), near-infrared perfusion (NIR), and total hemoglobin index (THI) were investigated at different time points in four perfused lobes using a hyperspectral camera measuring light absorbance between 500 nm and 995 nm. Differences among lobes at different time points were estimated by mixed-effect linear regression.

RESULTS

StO₂% decreased over time in the right lateral lobe (RLL, totally occluded) when compared to the left lateral (LLL, outflow preserved) and the right medial (RML, partially occluded) lobes (p < 0.05). De-Hb significantly increased after clamping in RLL when compared to RML and LLL (p < 0.05). RML was further analyzed considering the right portion (totally occluded) and the left portion of the lobe (with an autonomous draining vein). StO₂% decreased and de-Hb increased more smoothly when compared to the totally occluded RLL (p < 0.05).

CONCLUSIONS

The variations of StO₂% and deoxy-Hb could be considered good markers of venous liver congestion.

Optimization of anastomotic technique and gastric conduit perfusion with hyperspectral imaging and machine learning in an experimental model for minimally invasive esophagectomy

INTRODUCTION

Esophagectomy is the mainstay of esophageal cancer treatment, but anastomotic insufficiency related morbidity and mortality remain challenging for patient outcome. Therefore, the objective of this work was to optimize anastomotic technique and gastric conduit perfusion with hyperspectral imaging (HSI) for total minimally invasive esophagectomy (MIE) with linear stapled anastomosis.

MATERIAL AND METHODS

A live porcine model (n = 58) for MIE was used with gastric conduit formation and simulation of linear stapled side-to-side esophagogastrostomy. Four main experimental groups differed in stapling length (3 vs. 6 cm) and simulation of anastomotic position on the conduit (cranial vs. caudal). Tissue oxygenation around the anastomotic simulation site was evaluated using HSI and was validated with histopathology.

RESULTS

The tissue oxygenation (ΔStO₂) after the anastomotic simulation remained constant only for the short stapler in caudal position (-0.4 ± 4.4%, n.s.) while it was impaired markedly in the other groups (short-cranial: -15.6 ± 11.5%, p = 0.0002; long-cranial: -20.4 ± 7.6%, p = 0.0126; long-caudal: -16.1 ± 9.4%, p < 0.0001). Tissue samples from avascular stomach as measured by HSI showed correspondent eosinophilic pre-necrotic changes in 35.7 ± 9.7% of the surface area.

CONCLUSION

Tissue oxygenation at the site of anastomotic simulation of the gastric conduit during MIE is influenced by stapling technique. Optimal oxygenation was achieved with a short stapler (3 cm) and sufficient distance of the simulated anastomosis to the cranial end of the gastric conduit. HSI tissue deoxygenation corresponded to histopathologic necrotic tissue changes. The experimental model with HSI and ML allow for systematic optimization of gastric conduit perfusion and anastomotic technique while clinical translation will have to be proven.

Compact and ultracompact spectral imagers: technology and applications in biomedical imaging

Significance

Spectral imaging, which includes hyperspectral and multispectral imaging, can provide images in numerous wavelength bands within and beyond the visible light spectrum. Emerging technologies that enable compact, portable spectral imaging cameras can facilitate new applications in biomedical imaging.

Aim

With this review paper, researchers will (1) understand the technological trends of upcoming spectral cameras, (2) understand new specific applications that portable spectral imaging unlocked, and (3) evaluate proper spectral imaging systems for their specific applications.

Approach

We performed a comprehensive literature review in three databases (Scopus, PubMed, and Web of Science). We included only fully realized systems with definable dimensions. To best accommodate many different definitions of "compact," we included a table of dimensions and weights for systems that met our definition.

Results

There is a wide variety of contributions from industry, academic, and hobbyist spaces. A variety of new engineering approaches, such as Fabry-Perot interferometers, spectrally resolved detector array (mosaic array), microelectro-mechanical systems, 3D printing, light-emitting diodes, and smartphones, were used in the construction of compact spectral imaging cameras. In bioimaging applications, these compact devices were used for in vivo and ex vivo diagnosis and surgical settings.

Conclusions

Compact and ultracompact spectral imagers are the future of spectral imaging systems. Researchers in the bioimaging fields are building systems that are low-cost, fast in acquisition time, and mobile enough to be handheld.

Spatial gradient consistency for unsupervised learning of hyperspectral demosaicking: application to surgical imaging

PURPOSE

Hyperspectral imaging has the potential to improve intraoperative decision making if tissue characterisation is performed in real-time and with high-resolution. Hyperspectral snapshot mosaic sensors offer a promising approach due to their fast acquisition speed and compact size. However, a demosaicking algorithm is required to fully recover the spatial and spectral information of the snapshot images. Most state-of-the-art demosaicking algorithms require ground-truth training data with paired snapshot and high-resolution hyperspectral images, but such imagery pairs with the exact same scene are physically impossible to acquire in intraoperative settings. In this work, we present a fully unsupervised hyperspectral image demosaicking algorithm which only requires exemplar snapshot images for training purposes.

METHODS

We regard hyperspectral demosaicking as an ill-posed linear inverse problem which we solve using a deep neural network. We take advantage of the spectral correlation occurring in natural scenes to design a novel inter spectral band regularisation term based on spatial gradient consistency. By combining our proposed term with standard regularisation techniques and exploiting a standard data fidelity term, we obtain an unsupervised loss function for training deep neural networks, which allows us to achieve real-time hyperspectral image demosaicking.

RESULTS

Quantitative results on hyperspetral image datasets show that our unsupervised demosaicking approach can achieve similar performance to its supervised counter-part, and significantly outperform linear demosaicking. A qualitative user study on real snapshot hyperspectral surgical images confirms the results from the quantitative analysis.

CONCLUSION

Our results suggest that the proposed unsupervised algorithm can achieve promising hyperspectral demosaicking in real-time thus advancing the suitability of the modality for intraoperative use.

Hyperspectral imaging enables the differentiation of differentially inflated and perfused pulmonary tissue: a proof-of-concept study in pulmonary lobectomies for intersegmental plane mapping

OBJECTIVES

The identification of the intersegmental plane is a major interoperative challenges during pulmonary segmentectomies. The objective of this pilot study is to test the feasibility of lung perfusion assessment by Hyperspectral Imaging for identification of the intersegmental plane.

METHODS

A pilot study (clinicaltrials.org: NCT04784884) was conducted in patients with lung cancer. Measuring tissue oxygenation (StO₂; upper tissue perfusion), organ hemoglobin index (OHI), near-infrared index (NIR; deeper tissue perfusion) and tissue water index (TWI), the Hyperspectral Imaging measurements were carried out in inflated (P_vent) and deflated pulmonary lobes (P_nV) as well as in deflated pulmonary lobes with divided circulation (P_nVC) before dissection of the lobar bronchus.

RESULTS

A total of 341 measuring points were evaluated during pulmonary lobectomies. Pulmonary lobes showed a reduced StO2 (P_vent: 84.56% ± 3.92 vs. P_nV: 63.62% ± 11.62 vs. P_nVC: 39.20% ± 23.57; p<0.05) and NIR-perfusion (P_vent: 50.55 ± 5.62 vs. P_nV: 47.55 ± 3.38 vs. P_nVC: 27.60 ± 9.33; p<0.05). There were no differences of OHI and TWI between the three groups.

CONCLUSIONS

This pilot study demonstrates that HSI enables differentiation between different ventilated and perfused pulmonary tissue as a precondition for HSI segment mapping.

In Vitro Antibody Quantification with Hyperspectral Imaging in a Large Field of View for Clinical Applications

Hyperspectral imaging (HSI) is a non-invasive, contrast-free optical-based tool that has recently been applied in medical and basic research fields. The opportunity to use HSI to identify exogenous tumor markers in a large field of view (LFOV) could increase precision in oncological diagnosis and surgical treatment. In this study, the anti-high mobility group B1 (HMGB1) labeled with Alexa fluorophore (647 nm) was used as the target molecule. This is the proof-of-concept of HSI’s ability to quantify antibodies via an in vitro setting. A first test was performed to understand whether the relative absorbance provided by the HSI camera was dependent on volume at a 1:1 concentration. A serial dilution of 1:1, 10, 100, 1000, and 10,000 with phosphatase-buffered saline (PBS) was then used to test the sensitivity of the camera at the minimum and maximum volumes. For the analysis, images at 640 nm were extracted from the hypercubes according to peak signals matching the specificities of the antibody manufacturer. The results showed a positive correlation between relative absorbance and volume (r = 0.9709, p = 0.0013). The correlation between concentration and relative absorbance at min (1 µL) and max (20 µL) volume showed r = 0.9925, p < 0.0001, and r = 0.9992, p < 0.0001, respectively. These results demonstrate the HSI potential in quantifying HMGB1, hence deserving further studies in ex vivo and in vivo settings.

Spectral imaging enables contrast agent-free real-time ischemia monitoring in laparoscopic surgery

Laparoscopic surgery has evolved as a key technique for cancer diagnosis and therapy. While characterization of the tissue perfusion is crucial in various procedures, such as partial nephrectomy, doing so by means of visual inspection remains highly challenging. We developed a laparoscopic real-time multispectral imaging system featuring a compact and lightweight multispectral camera and the possibility to complement the conventional surgical view of the patient with functional information at a video rate of 25 Hz. To enable contrast agent-free ischemia monitoring during laparoscopic partial nephrectomy, we phrase the problem of ischemia detection as an out-of-distribution detection problem that does not rely on data from any other patient and uses an ensemble of invertible neural networks at its core. An in-human trial demonstrates the feasibility of our approach and highlights the potential of spectral imaging combined with advanced deep learning-based analysis tools for fast, efficient, reliable, and safe functional laparoscopic imaging.

The role of intraoperative hyperspectral imaging (HSI) in colon interposition after esophagectomy

BACKGROUND

Colon conduit is an alternative approach to reconstructing the alimentary tract after esophagectomy. Hyperspectral imaging (HSI) has been demonstrated to be effective for evaluating the perfusion of gastric conduits, but not colon conduits. This is the first study to describe this new tool addressing image-guided surgery and supporting esophageal surgeons to select the optimal colon segment for the conduit and anastomotic site intraoperatively.

PATIENTS AND METHODS

Of 10 patients, eight who underwent reconstruction with a long-segment colon conduit after esophagectomy between 01/05/2018 and 01/04/2022 were included in this study. HSI was recorded at the root and tip of the colon conduit after clamping the middle colic vessels, allowing us to evaluate the perfusion and appropriate part of the colon segment.

RESULTS

Anastomotic leak (AL) was detected in only one (12.5%) of all the enrolled patients (n = 8). None of the patients developed conduit necrosis. Only one patient required re-anastomosis on postoperative day 4. No patient needed conduit removal, esophageal diversion, or stent placement. There was a change in the anastomosis site to proximal in two patients intraoperatively. There was no need to change the side of colon conduit intraoperatively in any patient.

CONCLUSION

HSI is a promising and novel intraoperative imaging tool to objectively assess the perfusion of the colon conduit. It helps the surgeon to define the best perfused anastomosis site and the side of colon conduit in this type of operation.

Real-time quantification of intestinal perfusion and arterial versus venous occlusion using laser speckle contrast imaging in porcine model

PURPOSE

Real-time intraoperative perfusion assessment may reduce anastomotic leaks. Laser speckle contrast imaging (LSCI) provides dye-free visualization of perfusion by capturing coherent laser light scatter from red blood cells and displays perfusion as a colormap. Herein, we report a novel method to precisely quantify intestinal perfusion using LSCI.

METHODS

ActivSight™ is an FDA-cleared multi-modal visualization system that can detect and display perfusion via both indocyanine green imaging (ICG) and LSCI in minimally invasive surgery. An experimental prototype LSCI perfusion quantification algorithm was evaluated in porcine models. Porcine small bowel was selectively devascularized to create regions of perfused/watershed/ischemic bowel, and progressive aortic inflow/portal vein outflow clamping was performed to study arterial vs. venous ischemia. Continuous arterial pressure was monitored via femoral line.

RESULTS

LSCI perfusion colormaps and quantification distinguished between perfused, watershed, and ischemic bowel in all vascular control settings: no vascular occlusion (p < 0.001), aortic occlusion (p < 0.001), and portal venous occlusion (p < 0.001). LSCI quantification demonstrated similar levels of ischemia induced both by states of arterial inflow and venous outflow occlusion. LSCI-quantified perfusion values correlated positively with higher mean arterial pressure and with increasing distance from ischemic bowel.

CONCLUSION

LSCI relative perfusion quantification may provide more objective real-time assessment of intestinal perfusion compared to conventional naked eye assessment by quantifying currently subjective gradients of bowel ischemia and identifying both arterial/venous etiologies of ischemia.

New Methodology of Human Health Express Diagnostics Based on Pulse Wave Measurements and Occlusion Test

Nowadays, with the increase in the rhythm of life, the relevance of using express diagnostics methods for human health state estimation has significantly increased. We present a new express diagnostics method based on non-invasive measurements (the pulse wave shape, heart rate, blood pressure, and oxygen saturation of blood vessels and tissues). A feature of these measurements is that they can be carried out both in the hospital and at home. The new compact and portable optical hardware–software complex has been developed to measure tissue oxygen saturation. This complex makes it possible to reduce the measurement time from 60 min to 7–8 min, which reduces the likelihood of artifacts in the measurement process and increases its reliability. A new technique has been developed to carry out these measurements. A new optical sensor based on a line of charge-coupled devices has been developed to register a pulse wave in the far peripheral zone. The developed new technique for processing the pulse waveform and data on the oxygen saturation of hemoglobin in the blood and tissues allows a person to obtain additional information about their state of health independently. It will help to make conclusions about taking the necessary measures. This additional information allows the attending physician to provide more effective control over the course of treatment of the patient at any time since the methods of express diagnostics proposed by us have no restrictions on the number of applications. The functional state of more than 300 patients was studied. The results of various measurements are presented.

Intraoperative Determination of Bronchus Stump and Anastomosis Perfusion with Hyperspectral Imaging

BACKGROUND

The intraoperative evaluation of bronchus perfusion is limited. Hyperspectral Imaging (HSI) is a newly established intraoperative imaging technique that enables a non-invasive, real-time perfusion analysis. Therefore, the purpose of this study was to determine the intraoperative perfusion of bronchus stump and anastomosis during pulmonary resections with HSI.

METHODS

In this prospective, IDEAL Stage 2a study (Clinicaltrials.gov: NCT04784884) HSI measurements were carried out before bronchial dissection and after bronchial stump formation or bronchial anastomosis, respectively. Tissue oxygenation (StO₂; upper tissue perfusion), organ hemoglobin index (OHI), near-infrared index (NIR; deeper tissue perfusion) and tissue water index (TWI) were calculated.

RESULTS

Bronchus stumps showed a reduced NIR (77.82 ± 10.27 vs 68.01 ± 8.95; P = 0,02158) and OHI (48.60 ± 1.39 vs 38.15 ± 9.74; P = <.0001), although the perfusion of the upper tissue layers was equivalent before and after resection (67.42% ± 12.53 vs 65.91% ± 10.40). In the sleeve resection group, we found both a significant decrease in StO 2 and NIR between central bronchus and anastomosis region (StO₂: 65.09% ± 12.57 vs 49.45 ± 9.94; P = .044; NIR: 83.73 ± 10.92 vs 58.62 ± 3.01; P = .0063). Additionally, NIR was decreased in the re-anastomosed bronchus compared to central bronchus region (83.73 ± 10.92 vs 55.15 ± 17.56; P = .0029).

CONCLUSIONS

Although both bronchus stumps and anastomosis show an intraoperative reduction of tissue perfusion, there is no difference of tissue hemoglobin level in bronchus anastomosis.

Microcirculatory tissue oxygenation correlates with kidney function after transcatheter aortic valve implantation-Results from a prospective observational study

Introduction

Kidney dysfunction is common in patients with aortic stenosis (AS) and correction of the aortic valve by transcatheter aortic valve implantation (TAVI) often affects kidney function. This may be due to microcirculatory changes.

Methods

We evaluated skin microcirculation with a hyperspectral imaging (HSI) system, and compared tissue oxygenation (StO₂), near-infrared perfusion index (NIR), tissue hemoglobin index (THI) and tissue water index (TWI) in 40 patients undergoing TAVI versus 20 control patients. HSI parameters were measured before TAVI (t1), directly after TAVI (t2), and on postinterventional day 3 (t3). The primary outcome was the correlation of tissue oxygenation (StO₂) to the creatinine level after TAVI.

Results

We performed 116 HSI image recordings in patients undergoing TAVI for the treatment of severe aortic stenosis and 20 HSI image recordings in control patients. Patients with AS had a lower THI at the palm (p = 0.034) and a higher TWI at the fingertips (p = 0.003) in comparison to control patients. TAVI led to an increase of TWI, but had no uniform enduring effect on StO₂ and THI. Tissue oxygenation StO₂ at both measurement sites correlated negatively with creatinine levels after TAVI at t2 (palm: ρ = -0.415; p = 0.009; fingertip: ρ = -0.519; p < 0.001) and t3 (palm: ρ = -0.427; p = 0.008; fingertip: ρ = -0.398; p = 0.013). Patients with higher THI at t3 reported higher physical capacity and general health scores 120 days after TAVI.

Conclusion

HSI is a promising technique for periinterventional monitoring of tissue oxygenation and microcirculatory perfusion quality, which are related to kidney function, physical capacity, and clinical outcomes after TAVI.

Clinical trial registration

https://drks.de/search/de/trial, identifier DRKS00024765.

In vivo evaluation of a hyperspectral imaging system for minimally invasive surgery (HSI-MIS)

BACKGROUND

Hyperspectral Imaging (HSI) is a reliable and safe imaging method for taking intraoperative perfusion measurements. This is the first study translating intraoperative HSI to an in vivo laparoscopic setting using a CE-certified HSI-system for minimally invasive surgery (HSI-MIS). We aim to compare it to an established HSI-system for open surgery (HSI-Open).

METHODS

Intraoperative HSI was done using the HSI-MIS and HSI-Open at the Region of Interest (ROI). 19 patients undergoing gastrointestinal resections were analyzed in this study. The HSI-MIS-acquired images were aligned with those from the HSI-Open, and spectra and parameter images were compared pixel-wise. We calculated the Mean Absolute Error (MAE) for Tissue Oxygen Saturation (StO₂), Near-Infrared Perfusion Index (NIR-PI), Tissue Water Index (TWI), and Organ Hemoglobin Index (OHI), as well as the Root Mean Squared Error (RMSE) over the whole spectrum. Our analysis of parameters was optimized using partial least squares (PLS) regression. Two experienced surgeons carried out an additional color-change analysis, comparing the ROI images and deciding whether they provided the same (acceptable) or different visual information (rejected).

RESULTS

HSI and subsequent image registration was possible in 19 patients. MAE results for the original calculation were StO_{2 orig.} 17.2% (± 7.7%)_, NIR-PI_orig. 16.0 (± 9.5), TWI_orig. 18.1 (± 7.9), OHI_orig. 14.4 (± 4.5). For the PLS calculation, they were StO_{2 PLS} 12.6% (± 5.2%), NIR-PI_PLS 10.3 (± 6.0), TWI_PLS 10.6 (± 5.1), and OHI_PLS 11.6 (± 3.0). The RMSE between both systems was 0.14 (± 0.06). In the color-change analysis; both surgeons accepted more images generated using the PLS method.

CONCLUSION

Intraoperative HSI-MIS is a new technology and holds great potential for future applications in surgery. Parameter deviations are attributable to technical differences and can be reduced by applying improved calculation methods. This study is an important step toward the clinical implementation of HSI for minimally invasive surgery.

Spectral Similarity Measures for In Vivo Human Tissue Discrimination Based on Hyperspectral Imaging

PROBLEM

Similarity measures are widely used as an approved method for spectral discrimination or identification with their applications in different areas of scientific research. Even though a range of works have been presented, only a few showed slightly promising results for human tissue, and these were mostly focused on pathological and non-pathological tissue classification.

METHODS

In this work, several spectral similarity measures on hyperspectral (HS) images of in vivo human tissue were evaluated for tissue discrimination purposes. Moreover, we introduced two new hybrid spectral measures, called SID-JM-TAN(SAM) and SID-JM-TAN(SCA). We analyzed spectral signatures obtained from 13 different human tissue types and two different materials (gauze, instruments), collected from HS images of 100 patients during surgeries.

RESULTS

The quantitative results showed the reliable performance of the different similarity measures and the proposed hybrid measures for tissue discrimination purposes. The latter produced higher discrimination values, up to 6.7 times more than the classical spectral similarity measures. Moreover, an application of the similarity measures was presented to support the annotations of the HS images. We showed that the automatic checking of tissue-annotated thyroid and colon tissues was successful in 73% and 60% of the total spectra, respectively. The hybrid measures showed the highest performance. Furthermore, the automatic labeling of wrongly annotated tissues was similar for all measures, with an accuracy of up to 90%.

CONCLUSION

In future work, the proposed spectral similarity measures will be integrated with tools to support physicians in annotations and tissue labeling of HS images.

Experimental Validation of Shifted Position-Diffuse Reflectance Imaging (SP-DRI) on Optical Phantoms

Numerous diseases such as hemorrhage, sepsis or cardiogenic shock induce a heterogeneous perfusion of the capillaries. To detect such alterations in the human blood flow pattern, diagnostic devices must provide an appropriately high spatial resolution. Shifted position-diffuse reflectance imaging (SP-DRI) has the potential to do so; it is an all-optical diagnostic technique. So far, SP-DRI has mainly been developed using Monte Carlo simulations. The present study is therefore validating this algorithm experimentally on realistic optical phantoms with thread structures down to 10 μm in diameter; a SP-DRI sensor prototype was developed and realized by means of additive manufacturing. SP-DRI turned out to be functional within this experimental framework. The position of the structures within the optical phantoms become clearly visible using SP-DRI, and the structure thickness is reflected as modulation in the SP-DRI signal amplitude; this performed well for a shift along the x axis as well as along the y axis. Moreover, SP-DRI successfully masked the pronounced influence of the illumination cone on the data. The algorithm showed significantly superior to a mere raw data inspection. Within the scope of the study, the constructive design of the SP-DRI sensor prototype is discussed and potential for improvement is explored.

Deep Learning in Medical Hyperspectral Images: A Review

With the continuous progress of development, deep learning has made good progress in the analysis and recognition of images, which has also triggered some researchers to explore the area of combining deep learning with hyperspectral medical images and achieve some progress. This paper introduces the principles and techniques of hyperspectral imaging systems, summarizes the common medical hyperspectral imaging systems, and summarizes the progress of some emerging spectral imaging systems through analyzing the literature. In particular, this article introduces the more frequently used medical hyperspectral images and the pre-processing techniques of the spectra, and in other sections, it discusses the main developments of medical hyperspectral combined with deep learning for disease diagnosis. On the basis of the previous review, tne limited factors in the study on the application of deep learning to hyperspectral medical images are outlined, promising research directions are summarized, and the future research prospects are provided for subsequent scholars.

Hyperspectral Imaging for Viability Assessment of Human Liver Allografts During Normothermic Machine Perfusion

Normothermic machine perfusion (NMP) is nowadays frequently utilized in liver transplantation. Despite commonly accepted viability assessment criteria, such as perfusate lactate and perfusate pH, there is a lack of predictive organ evaluation strategies to ensure graft viability. Hyperspectral imaging (HSI)-as an optical imaging modality increasingly applied in the biomedical field-might provide additional useful data regarding allograft viability and performance of liver grafts during NMP.

METHODS

Twenty-five deceased donor liver allografts were included in the study. During NMP, graft viability was assessed conventionally and by means of HSI. Images of liver parenchyma were acquired at 1, 2, and 4 h of NMP, and subsequently analyzed using a specialized HSI acquisition software to compute oxygen saturation, tissue hemoglobin index, near-infrared perfusion index, and tissue water index. To analyze the association between HSI parameters and perfusate lactate as well as perfusate pH, we performed simple linear regression analysis.

RESULTS

Perfusate lactate at 1, 2, and 4 h NMP was 1.5 [0.3-8.1], 0.9 [0.3-2.8], and 0.9 [0.1-2.2] mmol/L. Perfusate pH at 1, 2, and 4 h NMP was 7.329 [7.013-7.510], 7.318 [7.081-7.472], and 7.265 [6.967-7.462], respectively. Oxygen saturation predicted perfusate lactate at 1 and 2 h NMP (R² = 0.1577, P = 0.0493; R² = 0.1831, P = 0.0329; respectively). Tissue hemoglobin index predicted perfusate lactate at 1, 2, and 4 h NMP (R² = 0.1916, P = 0.0286; R² = 0.2900, P = 0.0055; R² = 0.2453, P = 0.0139; respectively).

CONCLUSIONS

HSI may serve as a noninvasive tool for viability assessment during NMP. Further evaluation and validation of HSI parameters are warranted in larger sample sizes.

Hyperspectral Imaging in Major Hepatectomies: Preliminary Results from the Ex-Machyna Trial

Ischemia-reperfusion injury during major hepatic resections is associated with high rates of post-operative complications and liver failure. Real-time intra-operative detection of liver dysfunction could provide great insight into clinical outcomes. In the present study, we demonstrate the intra-operative application of a novel optical technology, hyperspectral imaging (HSI), to predict short-term post-operative outcomes after major hepatectomy. We considered fifteen consecutive patients undergoing major hepatic resection for malignant liver lesions from January 2020 to June 2021. HSI measures included tissue water index (TWI), organ hemoglobin index (OHI), tissue oxygenation (StO₂%), and near infrared (NIR). Pre-operative, intra-operative, and post-operative serum and clinical outcomes were collected. NIR values were higher in unhealthy liver tissue (p = 0.003). StO₂% negatively correlated with post-operative serum ALT values (r = -0.602), while ΔStO₂% positively correlated with ALP (r = 0.594). TWI significantly correlated with post-operative reintervention and OHI with post-operative sepsis and liver failure. In conclusion, the HSI imaging system is accurate and precise in translating from pre-clinical to human studies in this first clinical trial. HSI indices are related to serum and outcome metrics. Further experimental and clinical studies are necessary to determine clinical value of this technology.

Hyperspectral Imaging Allows Evaluation of Free Flaps in Craniomaxillofacial Reconstruction

INTRODUCTION

Treatment of extended defects after tumor resection in oral, maxillofacial, and facial surgery (craniomaxillofacial) is usually performed by free microvascular flaps. Evaluation of flap survival is crucial, especially in the first hours after insertion and connection. For flap evaluation various invasive and noninvasive methods have been developed. This retrospective clinical study examined the ability of a hyperspectral imaging (HSI) camera (Tivita, Diaspective Vision, Germany) to assess postoperative flap properties in comparison to established clinical parameters.

MATERIALS AND METHODS

Thirteen patients with tumor resection and free flap reconstruction were included for camera analysis and another 10 patients as control group. For this purpose, at defined time intervals and under standardized conditions, recordings of transplants 3 to 100 hours postoperatively were performed. Images were used to examine oxygenation (StO2%), tissue hemoglobin index, tissue water index, near infrared range perfusion index of free flaps quantitatively and qualitatively.

RESULTS

HSI provides values differing between patients observed with no intraindividual significant difference. After 24 hours a mean reduction of 16.77% for StO2%, 9.16% for tissue hemoglobin index and 8.46% was observed, going in line with no loss of flap was noted in the observation period.

CONCLUSION

HSI is suitable as a noninvasive measure for the evaluation of free flaps in craniomaxillofacial surgery in case of stable imaging conditions with respect to light, surrounding and position of the camera. However, clinical measurements are still the method of choice.

Does indocyanine green fluorescence angiography impact the intraoperative choice of procedure in free vascularized medial femoral condyle grafting for scaphoid nonunions?

Background

Free vascularized medial femoral condyle (MFC) bone grafts can lead to increased vascularity of the proximal pole and restore scaphoid architecture in scaphoid nonunions. The intraoperative perfusion assessment of the bone graft is challenging because the conventional clinical examination is difficult. Indocyanine green (ICG) angiography has previously been shown to provide a real-time intraoperative evaluation of soft tissue perfusion in reconstructive surgery. The present study investigated the utility of ICG angiography in patients treated with a free medial femoral condyle graft for scaphoid nonunions.

Methods

We performed a retrospective analysis of patients with scaphoid nonunions, in which ICG angiography was used intraoperatively for perfusion assessment. The medical records, radiographs, intraoperative imaging, and operative reports of all patients were reviewed. Intraoperative ICG dye was administered intravenously, and laser angiography was performed to assess bone perfusion. The scaphoid union was examined using postoperative CT scans.

Results

Two patients had documented osteonecrosis of the proximal pole at the time of surgery. Four patients received a nonvascularized prior bone graft procedure, and a prior spongiosa graft procedure was performed in one patient. The mean time from injury to the MFC bone graft surgery was 52.7 months, and the mean time from prior failed surgery was 10.4 months. Perfusion of the vascular pedicle of the MFC and the periosteum could be detected in all patients. In two patients, even perfusion of the cancellous bone could be demonstrated by ICG angiography. Following transplantation of the bone graft, patency of the vascular anastomosis and perfusion of the periost were confirmed by ICG angiography in the assessed cases. No additional surgery regarding a salvage procedure for a scaphoid nonunion advanced collapse was necessary for the further course.

Conclusion

ICG-angiography has shown to be a promising tool in the treatment of scaphoid nonunion with medial femoral condyle bone grafts. It enables intraoperative decision making by assessment of the microvascular blood supply of the periosteum and the vascular pedicle of the MFC bone graft. Further studies need to evaluate the impact on union rates in a long-term follow-up.

Burn depth assessment using hyperspectral imaging in a prospective single center study

BACKGROUND

The assessment of thermal burn depth remains challenging. Over the last decades, several optical systems were developed to determine burn depth. So far, only laser doppler imaging (LDI) has been shown to be reliable while others such as infrared thermography or spectrophotometric intracutaneous analysis have been less accurate. The aim of our study is to evaluate hyperspectral imaging (HSI) as a new optical device.

METHODS

Patients suffering thermal trauma treated in a burn unit in Germany between November 2019 and September 2020 were included. Inclusion criteria were age ≥18 years, 2^nd or 3^rd degree thermal burns, written informed consent and presentation within 24 h after injury. Clinical assessment and hyperspectral imaging were performed 24, 48 and 72 h after the injury. Patients in whom secondary wound closure was complete within 21 days (group A) were compared to patients in whom secondary wound closure took more than 21 days or where skin grafting was indicated (group B). Demographic data and the primary parameters generated by HSI were documented. A Mann Whitney-U test was performed to compare the groups. A p-value below 0.05 was considered to be statistically significant. The data generated using HSI were combined to create the HSI burn index (BI). Using a logistic regression and receiver operating characteristics curve (ROC) sensitivity and specificity of the BI were calculated. The trial was officially registered on DRKS (registration number: DRKS00022843).

RESULTS

Overall, 59 patients with burn wounds were eligible for inclusion. Ten patients were excluded because of a poor data quality. Group A comprised 36 patients with a mean age of 41.5 years and a mean burnt body surface area of 2.7%. In comparison, 13 patients were allocated to group B because of the need for a skin graft (n = 10) or protracted secondary wound closure lasting more than 21 days. The mean age of these patients was 46.8 years. They had a mean affected body surface area of 4.0%. 24, 48, and 72 h after trauma the BI was 1.0 ± 0.28, 1.2 ± 0.29 and 1.55 ± 0.27 in group A and 0.78 ± 0.14, 1.05 ± 0.23 and 1.23 ± 0.27 in group B. At every time point significant differences were demonstrated between the groups. At 24 h, ROC analysis demonstrated BI threshold of 0.95 (sensitivity 0.61/specificity 1.0), on the second day of 1.17 (sensitivity 0.51/specificity 0.81) and on the third day of 1.27 (sensitivity 0.92/specificity 0.71).

CONCLUSION

Changes in microcirculation within the first 72 h after thermal trauma were reflected by an increasing BI in both groups. After 72 h, the BI is able to predict the need for a skin graft with a sensitivity of 92% and a specificity of 71%.

Comparison of Hyperspectral Imaging and Microvascular Doppler for Perfusion Monitoring of Free Flaps in an In Vivo Rodent Model

To reduce microvascular free flap failure (MFF), monitoring is crucial for the early detection of malperfusion and allows timely salvage. Therefore, the aim of this study was to evaluate hyperspectral imaging (HSI) in comparison to micro-Doppler sonography (MDS) to monitor MFF perfusion in an in vivo rodent model. Bilateral groin flaps were raised on 20 Sprague−Dawley rats. The femoral artery was transected on the trial side and re-anastomosed. Flaps and anastomoses were assessed before, during, and after the period of ischemia every ten minutes for overall 60 min using HSI and MDS. The contralateral sides’ flaps served as controls. Tissue-oxygenation saturation (StO2), near-infrared perfusion index (NPI), hemoglobin (THI), and water distribution (TWI) were assessed by HSI, while blood flow was assessed by MDS. HSI correlates with the MDS signal in the case of sufficient and completely interrupted perfusion. HSI was able to validly and reproducibly detect tissue perfusion status using StO2 and NPI. After 40 min, flap perfusion decreased due to the general aggravation of hemodynamic circulatory situation, which resulted in a significant drop of StO2 (p < 0.005) and NPI (p < 0.005), whereas the Doppler signal remained unchanged. In accordance, HSI might be suitable to detect MFF general complications in an early stage and further decrease MFF failure rates, whereas MDS may only be used for direct complications at the anastomose site.

[Artificial intelligence and hyperspectral imaging for image-guided assistance in minimally invasive surgery]

BACKGROUND

Intraoperative imaging assists surgeons during minimally invasive procedures. Hyperspectral imaging (HSI) is a noninvasive and noncontact optical technique with great diagnostic potential in medicine. The combination with artificial intelligence (AI) approaches to analyze HSI data is called intelligent HSI in this article.

OBJECTIVE

What are the medical applications and advantages of intelligent HSI for minimally invasive visceral surgery?

MATERIAL AND METHODS

Within various clinical studies HSI data from multiple in vivo tissue types and oncological resections were acquired using an HSI camera system. Different AI algorithms were evaluated for detection and discrimination of organs, risk structures and tumors.

RESULTS

In an experimental animal study 20 different organs could be differentiated with high precision (> 95%) using AI. In vivo, the parathyroid glands could be discriminated from surrounding tissue with an F1 score of 47% and sensitivity of 75%, and the bile duct with an F1 score of 79% and sensitivity of 90%. Furthermore, ex vivo tumor tissue could be successfully detected with an area under the receiver operating characteristic (ROC) curve (AUC) larger than 0.91.

DISCUSSION

This study demonstrates that intelligent HSI can automatically and accurately detect different tissue types. Despite great progress in the last decade intelligent HSI still has limitations. Thus, accurate AI algorithms that are easier to understand for the user and an extensive standardized and continuously growing database are needed. Further clinical studies should support the various medical applications and lead to the adoption of intelligent HSI in the clinical routine practice.

Hyperspectral Imaging (HSI) of Human Kidney Allografts

OBJECTIVE

Aim of our study was to test a noninvasive HSI technique as an intraoperative real time assessment tool for deceased donor kidney quality and function in human kidney allotransplantation.

SUMMARY OF BACKGROUND DATA

HSI is capable to deliver quantitative diagnostic information about tissue pathology, morphology, and composition, based on the spectral characteristics of the investigated tissue. Because tools for objective intraoperative graft viability and performance assessment are lacking, we applied this novel technique to human kidney transplantation.

METHODS

Hyperspectral images of distinct components of kidney allografts (parenchyma, ureter) were acquired 15 and 45 minutes after reperfusion and subsequently analyzed using specialized HSI acquisition software capable to compute oxygen saturation levels (StO2), near infrared perfusion indices (NIR), organ hemoglobin indices, and tissue water indices of explored tissues.

RESULTS

Seventeen kidney transplants were analyzed. Median recipient and donor age were 55 years. Cold ischemia time was 10.8 ± 4.1 hours and anastomosis time was 35 ± 7 minutes (mean ± standard deviation). Two patients (11.8%) developed delayed graft function (DGF). cold ischemia time was significantly longer (18.6 ± 1.6) in patients with DGF (P < 0.01). Kidneys with DGF furthermore displayed significant lower StO2 (P = 0.02) and NIR perfusion indices, 15 minutes after reperfusion (P < 0.01). Transplant ureters displayed a significant decrease of NIR perfusion with increased distance to the renal pelvis, identifying well and poor perfused segments.

CONCLUSION

Intraoperative HSI is feasible and meaningful to predict DGF in renal allografts. Furthermore, it can be utilized for image guided surgery, providing information about tissue oxygenation, perfusion, hemoglobin concentration, and water concentration, hence allowing intraoperative viability assessment of the kidney parenchyma and the ureter.

Band selection for mapping chromophores of skin tissue

A numerical approach has been proposed to identify bands for optimally estimating the concentration of three types of viable chromophores within biological tissue. The bands are determined according to the condition number of absorption matrix associated with the attenuation coefficients of chromophores. The effectiveness of different sets of selected band combination was verified by using the spectral reflectance images of skin tissue acquired from standard forearm vascular occlusion tests via a spectroradiometer. Experimental results demonstrated that the concentration of chromophores within skin tissue could be estimated correctly and robustly only when the bands were deliberately selected.

Long-Term Donor Site Morbidity and Flap Perfusion Following Radial versus Ulnar Forearm Free Flap—A Randomized Controlled Prospective Clinical Trial

This clinical prospective randomized controlled study aimed to investigate the differences between Radial (RFFF) and Ulnar (UFFF) Forearm Free Flap in terms of success, performance, and donor site morbidity. Thirty patients with reconstruction of the head and neck region were included. For the first time, this study assessed flap-perfusion characteristics, donor-site-wound-healing dynamics and hand perfusion using hyperspectral imaging. Further, subjective (Likert-scale, DASH-score) and objective (grip/pinch-strength) parameters of donor site morbidity were analysed. Postoperative follow-up was performed until 6 months after index surgery. With 100% of patients, RFFF and UFFF were equally successful. Compared to surrounding reference, UFFF revealed significant lower tissue oxygenation saturation (StO2) than RFFF. Compared with UFFF, blood flow in both the thenar and hypothenar region were significantly reduced 6 months following RFFF transfer. After four weeks, 27% more patients demonstrated impaired wound healing following RFFF transfer. After 6 months, epithelial-surface continuity was restored in all patients of both groups. After 6 months, overall rates of both subjective and objective donor site morbidity were comparable between RFFF and UFFF. RFFF and UFFF both demonstrate similar success rates and HSI-perfusion dynamics following transfer. After 4 weeks, wound-healing disorder appeared significantly more often in RFFF than in UFFF; however, they became equal after 6 months. RFFF and UFFF can be considered as mutual alternatives.

Hyperspectral Evaluation of the Human Liver During Major Resection

Objective

This study investigates the effects of PVE and vascular inflow control (VIC) on liver microperfusion and tissue oxygenation using hyperspectral imaging (HSI) technology.

Background

Mechanisms triggering future liver remnant (FLR) augmentation introduced by PVE have not been sufficiently studied in humans. Particularly, the arterial buffer response (ABR) of the liver might play a vital role.

Methods

Hyperspectral datacubes (TIVITA) acquired during 58 major liver resections were qualitatively and quantitatively analyzed for tissue oxygenation (StO2%), near-infrared (NIR) perfusion, organ-hemoglobin indices (OHI), and tissue-water indices (TWI). The primary study endpoint was measurement of hyperspectral differences in liver parenchyma subject to PVE and VIC before resection.

Results

HSI revealed parenchyma specific differences in StO2% with regard to the underlying disease (P < 0.001). Preoperative PVE (n = 23, 40%) lead to arterial hyperoxygenation and hyperperfusion of corresponding liver segments (StO2: 77.23% ± 11.93%, NIR: 0.46 ± 0.20[I]) when compared with the FLR (StO2: 66.13% ± 9.96%, NIR: 0.23 ± 0.12[I]; P < 0.001). In a case of insufficient PVE and the absence of FLR augmentation hyperspectral StO2 and NIR differences were absent. The hyperspectral assessment demonstrated increased liver tissue-oxygenation and perfusion in PVE-segments (n = 23 cases) and decreased total VIC in nonembolized FLR hemilivers (n = 35 cases; P < 0.001). Intraoperative HSI analysis of tumor tissue revealed marked tumor specific differences in StO2, NIR, OHI, and TWI (P < 0.001).

Conclusions

HSI allows intraoperative quantitative and qualitative assessment of microperfusion and StO2% of liver tissue. PVE lead to ABR-triggered tissue hyperoxygenation and cross-talk FLR augmentation. HSI furthermore facilitates intraoperative tumor tissue identification and enables image-guided liver surgery following VIC.

Hyperspectral Imaging as a Tool for Viability Assessment During Normothermic Machine Perfusion of Human Livers: A Proof of Concept Pilot Study

Normothermic machine perfusion (NMP) allows for ex vivo viability and functional assessment prior to liver transplantation (LT). Hyperspectral imaging represents a suitable, non-invasive method to evaluate tissue morphology and organ perfusion during NMP. Liver allografts were subjected to NMP prior to LT. Serial image acquisition of oxygen saturation levels (StO2), organ hemoglobin (THI), near-infrared perfusion (NIR) and tissue water indices (TWI) through hyperspectral imaging was performed during static cold storage, at 1h, 6h, 12h and at the end of NMP. The readouts were correlated with perfusate parameters at equivalent time points. Twenty-one deceased donor livers were included in the study. Seven (33.0%) were discarded due to poor organ function during NMP. StO2 (p < 0.001), THI (p < 0.001) and NIR (p = 0.002) significantly augmented, from static cold storage (pre-NMP) to NMP end, while TWI dropped (p = 0.005) during the observational period. At 12-24h, a significantly higher hemoglobin concentration (THI) in the superficial tissue layers was seen in discarded, compared to transplanted livers (p = 0.036). Lactate values at 12h NMP correlated negatively with NIR perfusion index between 12 and 24h NMP and with the delta NIR perfusion index between 1 and 24h (rs = -0.883, p = 0.008 for both). Furthermore, NIR and TWI correlated with lactate clearance and pH. This study provides first evidence of feasibility of hyperspectral imaging as a potentially helpful contact-free organ viability assessment tool during liver NMP.