Optical imaging of hemoglobin oxygen saturation using a small number of spectral images for endoscopic application

Development of a new endoscopy system to visualize bilirubin for the diagnosis of duodenogastroesophageal reflux

OBJECTIVES

Reflux hypersensitivity (RH) is a form of refractory gastroesophageal reflux disease in which duodenogastroesophageal reflux (DGER) plays a role. This study aimed to determine the usefulness of an endoscopy system equipped with image-enhanced technology for evaluating DGER and RH.

METHODS

The image enhancement mode for detecting bilirubin and calculated values were defined as the Bil mode and Bil value, respectively. First, the visibility of the Bil mode was validated for a bilirubin solution and bile concentrations ranging from 0.01% to 100% (0.002-20 mg/dL). Second, visibility scores of the Bil mode, when applied to the porcine esophagus sprayed with a bilirubin solution, were compared to those of the blue laser imaging (BLI) and white light imaging (WLI) modes. Third, a clinical study was conducted to determine the correlations between esophageal Bil values and the number of nonacid reflux events (NNRE) during multichannel intraluminal impedance-pH monitoring as well as the utility of esophageal Bil values for the differential diagnosis of RH.

RESULTS

Bilirubin solution and bile concentrations higher than 1% were visualized in red using the Bil mode. The visibility score was significantly higher with the Bil mode than with the BLI and WLI modes for 1% to 6% bilirubin solutions (P < 0.05). The esophageal Bil value and NNRE were significantly positively correlated (P = 0.031). The area under the receiver operating characteristic curve for the differential diagnosis of RH was 0.817.

CONCLUSION

The Bil mode can detect bilirubin with high accuracy and could be used to evaluate DGER in clinical practice.

Clinical usefulness of hypoxia imaging colonoscopy for the objective measurement of ulcerative colitis disease activity

BACKGROUND AND AIMS

Colonic mucosal hypoxia is associated with mucosal inflammation in ulcerative colitis (UC). We aimed to assess the clinical usefulness of hypoxia imaging colonoscopy for the evaluation of clinical, endoscopic, and histologic disease activities of UC.

METHODS

This retrospective cohort study comprised 100 consecutive patients with UC who underwent hypoxia imaging colonoscopy between September 2022 and September 2023 at the University of Tsukuba Hospital. Colonic tissue oxygen saturation (StO2) was measured at the biopsy sites, and StO2 values between different disease activities were compared. Receiver-operating characteristic (ROC) analysis was used to calculate the area under the ROC curve (AUROC).

RESULTS

A significant correlation was identified between rectal StO2 and the Simple Clinical Colitis Activity Index, with moderate accuracy to predict bowel urgency at a 40.5% cutoff (AUROC, .74; 95% confidence interval [CI], .62-.87). Our analysis of 490 images showed median StO2 values for Mayo endoscopic subscores 0, 1, 2, and 3 as 52% (interquartile range [IQR], 48%-56%), 47% (IQR, 43%-52%), 42% (IQR, 38.8%-47%), and 39.5% (IQR, 37.3%-41.8%), respectively. Differences for all pairs were significant. Median StO2 was 49% (IQR, 44%-54%) for Geboes scores 0 to 2, significantly higher than histologically active disease (Geboes score ≥3). At a colonic StO2 cutoff of 45.5%, AUROCs for endoscopically and histologically active diseases were .79 (95% CI, .74-.84) and .72 (95% CI, .66-.77).

CONCLUSIONS

StO2 obtained by hypoxia imaging colonoscopy is useful for assessing clinical, endoscopic, and histologic activities of UC, suggesting that StO2 may be a novel and objective endoscopic measurement.

Targeted multispectral filter array design for the optimization of endoscopic cancer detection in the gastrointestinal tract

Significance

Color differences between healthy and diseased tissue in the gastrointestinal (GI) tract are detected visually by clinicians during white light endoscopy; however, the earliest signs of cancer are often just a slightly different shade of pink compared to healthy tissue making it hard to detect. Improving contrast in endoscopy is important for early detection of disease in the GI tract during routine screening and surveillance.

Aim

We aim to target alternative colors for imaging to improve contrast using custom multispectral filter arrays (MSFAs) that could be deployed in an endoscopic "chip-on-tip" configuration.

Approach

Using an open-source toolbox, Opti-MSFA, we examined the optimal design of MSFAs for early cancer detection in the GI tract. The toolbox was first extended to use additional classification models (k -nearest neighbor, support vector machine, and spectral angle mapper). Using input spectral data from published clinical trials examining the esophagus and colon, we optimized the design of MSFAs with three to nine different bands.

Results

We examined the variation of the spectral and spatial classification accuracies as a function of the number of bands. The MSFA configurations tested showed good classification accuracies when compared to the full hyperspectral data available from the clinical spectra used in these studies.

Conclusion

The ability to retain good classification accuracies with a reduced number of spectral bands could enable the future deployment of multispectral imaging in an endoscopic chip-on-tip configuration using simplified MSFA hardware. Further studies using an expanded clinical dataset are needed to confirm these findings.

A novel imaging technology to assess tissue oxygen saturation and its correlation with indocyanine green in the gastric conduit during thoracic esophagectomy

BACKGROUND

Anastomotic leakage in esophagectomy is a serious complication, and assessing blood perfusion in the conduit can help minimize this risk. Indocyanine green is the most widely used method to assess tissue blood flow; however, this technique has disadvantages. Evaluating tissue oxygen saturation in the gastric conduit during thoracic esophagectomy compared with indocyanine green blood perfusion assessment addresses these disadvantages and can be performed easily and repeatedly.

METHODS

This was a prospective study of patients with esophageal cancer who underwent thoracic esophagectomy. Intraoperative tissue oxygen saturation and indocyanine green measurements were obtained to determine the anastomotic site and to compare the correlation between the 2 methods. Tissue oxygen saturation and indocyanine green values were obtained at the tip of the gastric conduit, the demarcation line indicating visible perfusion, and the end of the right gastroepiploic artery.

RESULTS

Fifty-seven patients were enrolled in this study; 3 developed anastomotic leakage, and all 3 underwent robotic thoracic surgery. The tissue oxygen saturation value decreased gradually toward the tip of the conduit, as did congestion, and was significantly decreased at the tip compared with the value at the demarcation line (P = .001). Mean tissue oxygen saturation differed significantly between the leakage and no-leakage groups at the anastomosis site (P = .04). We found a negative correlation between tissue oxygen saturation and indocyanine green values at the end of the right gastroepiploic artery (r = -0.361; P = .03).

CONCLUSION

Tissue oxygen saturation imaging was useful in determining the anastomotic site and addressed the disadvantages associated with indocyanine green.

Noninvasive Monitoring to Demonstrate Postoperative Differences in Regional Hemodynamics in Newborn Infants With d-Transposition of the Great Arteries and Hypoplastic Left Heart Syndrome

BACKGROUND

The adequacy of tissue O₂ delivery in infants receiving intensive care is difficult to measure directly. Regional O₂ (rSO₂) and fractional tissue O₂ extraction (FTOE), the ratio of O₂ consumption to O₂ delivery, obtained from newer noninvasive tools, such as near-infrared spectroscopy (INVOS) and microvascular tissue oximetry (T-Stat) can provide important information on the adequacy of tissue oxygenation and aid in managing critically ill infants.

METHODS

We prospectively evaluated differences in rSO₂ and FTOE in 26 infants with hypoplastic left heart syndrome (HLHS) (n = 12) or d-transposition of the great arteries (d-TGA) (n = 14). Continuous noninvasive monitoring of SpO₂, heart rate, and perfusion index with pulse oximetry, cerebral-rSO₂ and renal-rSO₂ with INVOS, and buccal tissue oxygenation using T-Stat were performed during immediate postoperative period for 24 hours.

RESULTS

The SpO₂ and rSO₂ in infants with d-TGA were higher compared with the infants with HLHS at all measured sites (buccal mucosa, cerebral, and renal). Significant regional differences were also observed in FTOE across all infants with the highest at the buccal mucosa tissue level, followed by cerebral and renal measurement sites. As compared with infants with d-TGA, infants with HLHS had higher regional FTOE and heart rate, with a lower arterial O₂ content and perfusion index.

CONCLUSIONS

Our study demonstrates the utility of noninvasive hemodynamic monitoring to assess regional oxygenation and perfusion, as evidenced by significant differences in infants with HLHS and d-TGA, conditions with different circulation physiologies. Such comprehensive monitoring can potentially aid in evaluating treatment strategies aimed at preventing organ damage from O₂ insufficiency.

Multispectral imaging of nailfold capillaries using light-emitting diode illumination

SIGNIFICANCE

The capillaries are the smallest blood vessels in the body, typically imaged using video capillaroscopy to aid diagnosis of connective tissue diseases, such as systemic sclerosis. Video capillaroscopy allows visualization of morphological changes in the nailfold capillaries but does not provide any physiological information about the blood contained within the capillary network. Extracting parameters such as hemoglobin oxygenation could increase sensitivity for diagnosis and measurement of microvascular disease progression.

AIM

To design, construct, and test a low-cost multispectral imaging (MSI) system using light-emitting diode (LED) illumination to assess relative hemoglobin oxygenation in the nailfold capillaries.

APPROACH

An LED ring light was first designed and modeled. The ring light was fabricated using four commercially available LED colors and a custom-designed printed circuit board. The experimental system was characterized and results compared with the illumination model. A blood phantom with variable oxygenation was used to determine the feasibility of using the illumination-based MSI system for oximetry. Nailfold capillaries were then imaged in a healthy subject.

RESULTS

The illumination modeling results were in close agreement with the constructed system. Imaging of the blood phantom demonstrated sensitivity to changing hemoglobin oxygenation, which was in line with the spectral modeling of reflection. The morphological properties of the volunteer capillaries were comparable to those measured in current gold standard systems.

CONCLUSIONS

LED-based illumination could be used as a low-cost approach to enable MSI of the nailfold capillaries to provide insight into the oxygenation of the blood contained within the capillary network.

Noninvasive hemoglobin sensing and imaging: optical tools for disease diagnosis

SIGNIFICANCE

Measurement and imaging of hemoglobin oxygenation are used extensively in the detection and diagnosis of disease; however, the applied instruments vary widely in their depth of imaging, spatiotemporal resolution, sensitivity, accuracy, complexity, physical size, and cost. The wide variation in available instrumentation can make it challenging for end users to select the appropriate tools for their application and to understand the relative limitations of different methods.

AIM

We aim to provide a systematic overview of the field of hemoglobin imaging and sensing.

APPROACH

We reviewed the sensing and imaging methods used to analyze hemoglobin oxygenation, including pulse oximetry, spectral reflectance imaging, diffuse optical imaging, spectroscopic optical coherence tomography, photoacoustic imaging, and diffuse correlation spectroscopy.

RESULTS

We compared and contrasted the ability of different methods to determine hemoglobin biomarkers such as oxygenation while considering factors that influence their practical application.

CONCLUSIONS

We highlight key limitations in the current state-of-the-art and make suggestions for routes to advance the clinical use and interpretation of hemoglobin oxygenation information.

A novel imaging technology to assess oxygen saturation of the gastric conduit in thoracic esophagectomy

BACKGROUND

Real-time evaluation of blood perfusion is important when selecting the site of anastomosis during thoracic esophagectomy. This study investigated a novel imaging technology that assesses tissue oxygen saturation (StO2) in the gastric conduit and examined its efficacy.

METHODS

Fifty-one patients undergoing thoracic esophagectomy for esophageal cancer who underwent intraoperative StO2 endoscopic imaging to assess the gastric conduit for the optimal site of anastomosis were examined. Efficacy of oxygen saturation imaging and patient outcomes were analyzed.

RESULTS

All 51 patients underwent esophagectomy without intraoperative problems. Mean StO2 in the gastric tube was highest at the pre-pylorus area and then gradually decreased proceeding toward the tip. StO2 was well preserved in areas supplied by the right gastroepiploic artery but low in other areas. Anastomotic sites were selected based on StO2 imaging and tension considerations; most were located within 3 cm of the end of the right gastroepiploic artery. Three patients developed postoperative anastomotic leakage (5.8%). Mean StO2 at the point of anastomosis was significantly lower in the patients who experienced leakage than in those who did not (P = 0.04).

CONCLUSION

Intraoperative endoscopic StO2 imaging is useful in esophageal cancer patients undergoing thoracic esophagectomy to determine the optimal site for anastomosis to minimize the risk of anastomotic leakage.

First-in-human pilot study of snapshot multispectral endoscopy for early detection of Barrett's-related neoplasia

SIGNIFICANCE

The early detection of dysplasia in patients with Barrett's esophagus could improve outcomes by enabling curative intervention; however, dysplasia is often inconspicuous using conventional white-light endoscopy.

AIM

We sought to determine whether multispectral imaging (MSI) could be applied in endoscopy to improve detection of dysplasia in the upper gastrointestinal (GI) tract.

APPROACH

We used a commercial fiberscope to relay imaging data from within the upper GI tract to a snapshot MSI camera capable of collecting data from nine spectral bands. The system was deployed in a pilot clinical study of 20 patients (ClinicalTrials.gov NCT03388047) to capture 727 in vivo image cubes matched with gold-standard diagnosis from histopathology. We compared the performance of seven learning-based methods for data classification, including linear discriminant analysis, k-nearest neighbor classification, and a neural network.

RESULTS

Validation of our approach using a Macbeth color chart achieved an image-based classification accuracy of 96.5%. Although our patient cohort showed significant intra- and interpatient variance, we were able to resolve disease-specific contributions to the recorded MSI data. In classification, a combined principal component analysis and k-nearest-neighbor approach performed best, achieving accuracies of 95.8%, 90.7%, and 76.1%, respectively, for squamous, non-dysplastic Barrett's esophagus and neoplasia based on majority decisions per-image.

CONCLUSIONS

MSI shows promise for disease classification in Barrett's esophagus and merits further investigation as a tool in high-definition "chip-on-tip" endoscopes.

Novel oxygen saturation imaging endoscopy to assess anastomotic integrity in a porcine ischemia model

Background

Establishing anastomotic integrity is crucial for avoiding anastomotic complications in colorectal surgery. This study aimed to evaluate the safety and feasibility of assessing anastomotic integrity using novel oxygen saturation imaging endoscopy in a porcine ischemia model.

Methods

In three pigs, a new endoscope system was used to check the mechanical completeness of the anastomosis and capture the tissue oxygen saturation (StO₂) images. This technology can derive the StO₂ images from the differences in the absorption coefficient in the visible light region between oxy- and deoxy-hemoglobin. Bowel perfusion at the proximal rectum was assessed before and after the anastomosis, and 1 min and 30 min after the ligation of the cranial rectal artery (CRA).

Results

The completeness of the anastomoses was confirmed by the absence of air leakage. Intraluminal oxygen saturation imaging was successfully performed in all animals. There was no significant difference in the StO₂ level before and after the anastomosis (52.6 ± 2.0 vs. 52.0 ± 2.6; p = 0.76, respectively). The StO₂ level of the intestine on the oral side of the anastomosis one minute after the CRA ligation was significantly lower than immediately after the anastomosis (15.9 ± 6.0 vs. 52.0 ± 2.6; p = 0.006, respectively). There was no significant difference in the StO₂ level between 1 min after and 30 min after the CRA ligation (15.9 ± 6.0 vs. 12.1 ± 5.3; p = 0.41, respectively).

Conclusion

Novel oxygen saturation imaging endoscopy was safe and feasible to assess the anastomotic integrity in the experimental model.

Surgical spectral imaging

Recent technological developments have resulted in the availability of miniaturised spectral imaging sensors capable of operating in the multi- (MSI) and hyperspectral imaging (HSI) regimes. Simultaneous advances in image-processing techniques and artificial intelligence (AI), especially in machine learning and deep learning, have made these data-rich modalities highly attractive as a means of extracting biological information non-destructively. Surgery in particular is poised to benefit from this, as spectrally-resolved tissue optical properties can offer enhanced contrast as well as diagnostic and guidance information during interventions. This is particularly relevant for procedures where inherent contrast is low under standard white light visualisation. This review summarises recent work in surgical spectral imaging (SSI) techniques, taken from Pubmed, Google Scholar and arXiv searches spanning the period 2013-2019. New hardware, optimised for use in both open and minimally-invasive surgery (MIS), is described, and recent commercial activity is summarised. Computational approaches to extract spectral information from conventional colour images are reviewed, as tip-mounted cameras become more commonplace in MIS. Model-based and machine learning methods of data analysis are discussed in addition to simulation, phantom and clinical validation experiments. A wide variety of surgical pilot studies are reported but it is apparent that further work is needed to quantify the clinical value of MSI/HSI. The current trend toward data-driven analysis emphasises the importance of widely-available, standardised spectral imaging datasets, which will aid understanding of variability across organs and patients, and drive clinical translation.

The future of endoscopy: Advances in endoscopic image innovations

The latest state of the art technological innovations have led to a palpable progression in endoscopic imaging and may facilitate standardisation of practice. One of the most rapidly evolving modalities is artificial intelligence with recent studies providing real-time diagnoses and encouraging results in the first randomised trials to conventional endoscopic imaging. Advances in functional hypoxia imaging offer novel opportunities to be used to detect neoplasia and the assessment of colitis. Three-dimensional volumetric imaging provides spatial information and has shown promise in the increased detection of small polyps. Studies to date of self-propelling colonoscopes demonstrate an increased caecal intubation rate and possibly offer patients a more comfortable procedure. Further development in robotic technology has introduced ex vivo automated locomotor upper gastrointestinal and small bowel capsule devices. Eye-tracking has the potential to revolutionise endoscopic training through the identification of differences in experts and non-expert endoscopist as trainable parameters. In this review, we discuss the latest innovations of all these technologies and provide perspective into the exciting future of diagnostic luminal endoscopy.

Quantitative evaluation of comb-structure correction methods for multispectral fibrescopic imaging

Removing the comb artifact introduced by imaging fibre bundles, or 'fibrescopes', for example in medical endoscopy, is essential to provide high quality images to the observer. Multispectral imaging (MSI) is an emerging method that combines morphological (spatial) and chemical (spectral) information in a single data 'cube'. When a fibrescope is coupled to a spectrally resolved detector array (SRDA) to perform MSI, comb removal is complicated by the demosaicking step required to reconstruct the multispectral data cube. To understand the potential for using SRDAs as multispectral imaging sensors in medical endoscopy, we assessed five comb correction methods with respect to five performance metrics relevant to biomedical imaging applications: processing time, resolution, smoothness, signal and the accuracy of spectral reconstruction. By assigning weights to each metric, which are determined by the particular imaging application, our results can be used to select the correction method to achieve best overall performance. In most cases, interpolation gave the best compromise between the different performance metrics when imaging using an SRDA.