Preliminary investigation of multispectral retinal tissue oximetry mapping using a hyperspectral retinal camera

Hyperspectral retinal imaging biomarkers of ocular and systemic diseases

Hyperspectral imaging is a frontier in the field of medical imaging technology. It enables the simultaneous collection of spectroscopic and spatial data. Structural and physiological information encoded in these data can be used to identify and localise typically elusive biomarkers. Studies of retinal hyperspectral imaging have provided novel insights into disease pathophysiology and new ways of non-invasive diagnosis and monitoring of retinal and systemic diseases. This review provides a concise overview of recent advances in retinal hyperspectral imaging.

Targeted spectroscopy in the eye fundus

Significance

The assessment of biomarkers in the eye is rapidly gaining traction for the screening, diagnosis, and monitoring of ocular and neurological diseases. Targeted ocular spectroscopy is a technology that enables concurrent imaging of the eye fundus and analysis of high-quality spectra from a targeted region within the imaged area. This provides structural, compositional, and functional information of specific regions of the eye fundus from a non-invasive approach to ocular biomarker detection.

Aim

The aim of our study was to demonstrate the multimodal functionality and validation of targeted ocular spectroscopy. This was done in vitro, using a reference target and a model eye, and in vivo.

Approach

Images and spectra from different regions of a reference target and a model eye were acquired and analyzed to validate the system. Targeted ocular fluorescence spectroscopy was also demonstrated with the same model. Subsequently, in vivo imaging and diffuse reflectance spectra were acquired to assess blood oxygen saturation in the optic nerve head and the parafovea of healthy subjects.

Results

Tests conducted with the reference target showed accurate spectral analysis within specific areas of the imaging space. In the model eye, distinct spectral signatures were observed for the optic disc, blood vessels, the retina, and the macula, consistent with the variations in tissue composition and functions between these regions. An ocular oximetry algorithm was applied to in vivo spectra from the optic nerve head and parafovea of healthy patients, showing significant differences in blood oxygen saturation. Finally, targeted fluorescence spectral analysis was performed in vitro.

Conclusions

Diffuse reflectance and fluorescence spectroscopy in specific regions of the eye fundus open the door to a whole new range of monitoring and diagnostic capabilities, from assessment of oxygenation in glaucoma and diabetic retinopathy to photo-oxidation and photodegradation in age-related macular degeneration.

Sensitivity of visible range multi-wavelength algorithms for retinal tissue oximetry to acquisition parameters

This study examined the sensitivity of broadband spectroscopy algorithms for retinal tissue oximetry to spectral acquisition parameters. Monte Carlo simulations were conducted on a 4-layer retinal model to assess the impact of various parameters. The optimal spectral range for accurate measurements was determined to be 530 nm to 585 nm. Decreased spectral resolution below 4 nm significantly reduced accuracy. Using an acquisition area larger than the blood vessel resulted in an underestimation of oxygen saturation, especially for high values. A threshold was observed where increased light intensity had no significant impact on measurement variability. The study highlights the importance of informed parameter selection for accurately assessing retinal microcapillary oxygenation and studying local hemodynamics.

Multispectral retinal video-ophthalmoscope with fiber optic illumination

Multispectral imaging is used in various applications including astronomy, industry and agriculture. In retinal imaging, the single-shot multispectral image stack is typically acquired and analyzed. This multispectral analysis can provide information on various structural or metabolic properties. This paper describes the multispectral improvement of a video-ophthalmoscope, which can acquire retinal video sequences of the optic nerve head and peripapillary area using various spectral light illumination. The description of the multispectral video imaging is provided and several applications are described. These applications include multispectral retinal photoplethysmography, visualization of spontaneous vein pulsation and multispectral RGB image generation.

Monte-Carlo simulation and tissue-phantom model for validation of ocular oximetry

Ocular oximetry, in which blood oxygen saturation is evaluated in retinal tissues, is a promising technique for the prevention, diagnosis and management of many diseases and conditions. However, the development of new tools for evaluating oxygen saturation in the eye fundus has often been limited by the lack of reference tools or techniques for such measurements. In this study, we describe a two-step validation method. The impact of scattering, blood volume fraction and lens yellowing on the oximetry model is investigated using a tissue phantom, while a Monte Carlo model of the light propagation in the eye fundus is used to study the effect of the fundus layered-structure. With this method, we were able to assess the performance of an ocular oximetry technique in the presence of confounding factors and to quantify the impact of the choroidal circulation on the accuracy of the measurements. The presented strategy will be useful to anyone involved in studies based on the eye fundus diffuse reflectance.

Intraoperative hyperspectral label-free imaging: from system design to first-in-patient translation

Despite advances in intraoperative surgical imaging, reliable discrimination of critical tissue during surgery remains challenging. As a result, decisions with potentially life-changing consequences for patients are still based on the surgeon's subjective visual assessment. Hyperspectral imaging (HSI) provides a promising solution for objective intraoperative tissue characterisation, with the advantages of being non-contact, non-ionising and non-invasive. However, while its potential to aid surgical decision-making has been investigated for a range of applications, to date no real-time intraoperative HSI (iHSI) system has been presented that follows critical design considerations to ensure a satisfactory integration into the surgical workflow. By establishing functional and technical requirements of an intraoperative system for surgery, we present an iHSI system design that allows for real-time wide-field HSI and responsive surgical guidance in a highly constrained operating theatre. Two systems exploiting state-of-the-art industrial HSI cameras, respectively using linescan and snapshot imaging technology, were designed and investigated by performing assessments against established design criteria and ex vivo tissue experiments. Finally, we report the use of our real-time iHSI system in a clinical feasibility case study as part of a spinal fusion surgery. Our results demonstrate seamless integration into existing surgical workflows.

Advances in Retinal Oximetry

Similar to other organs, the retina relies on tightly regulated perfusion and oxygenation. Previous studies have demonstrated that retinal blood flow is affected in a variety of eye and systemic diseases, including diabetic retinopathy, age-related macular degeneration, and glaucoma. Although measurement of peripheral oxygen saturation has become a standard clinical measurement through the development of pulse oximetry, developing a noninvasive technique to measure retinal oxygen saturation has proven challenging, and retinal oximetry technology currently remains inadequate for reliable clinical use. Here, we review current strategies and approaches, as well as several newer technologies in development, and discuss the future of retinal oximetry.

Hyperspectral imaging in wound care: A systematic review

Multispectral and hyperspectral imaging (HSI) are emerging imaging techniques with the potential to transform the way patients with wounds are cared for, but it is not clear whether current systems are capable of delivering real-time tissue characterisation and treatment guidance. We conducted a systematic review of HSI systems that have been assessed in patients, published over the past 32 years. We analysed 140 studies, including 10 different HSI systems. Current in vivo HSI systems generate a tissue oxygenation map. Tissue oxygenation measurements may help to predict those patients at risk of wound formation or delayed healing. No safety concerns were reported in any studies. A small number of studies have demonstrated the capabilities of in vivo label-free HSI, but further work is needed to fully integrate it into the current clinical workflow for different wound aetiologies. As an emerging imaging modality for medical applications, HSI offers great potential for non-invasive disease diagnosis and guidance when treating patients with both acute and chronic wounds.

Retinal oximetry in glaucoma: investigations and findings reviewed

Abnormalities of the retinal blood supply have been widely implicated in primary open-angle glaucoma (POAG). Impaired blood supply to the retina and optic nerve head (ONH) may be a primary pathophysiologic mechanism contributing to POAG ('vascular hypothesis'). However, the decreased metabolic activity of atrophic tissue is itself known to induce both vascular changes and decreased blood flow due to reduced oxygen demand. Therefore, primary nonvascular factors could potentially induce glaucomatous atrophy, with subsequent secondary vascular pathology ('mechanical hypothesis'). Retinal oximetry holds great promise in the investigation of glaucoma pathogenesis, as it can provide useful data on retinal metabolic oxygen demand, especially when combined with measurements of retinal blood flow. This review surveys the research on retinal metabolism in POAG using spectroscopic retinal oximetry. The use of mathematical models in combination with oximetric data to investigate the role of retinal metabolism and oxygen supply in POAG is also discussed.

Hyperspectral imaging in wound care: A systematic review

Multispectral and hyperspectral imaging (HSI) are emerging imaging techniques with the potential to transform the way patients with wounds are cared for, but it is not clear whether current systems are capable of delivering real-time tissue characterisation and treatment guidance. We conducted a systematic review of HSI systems that have been assessed in patients, published over the past 32 years. We analysed 140 studies, including 10 different HSI systems. Current in vivo HSI systems generate a tissue oxygenation map. Tissue oxygenation measurements may help to predict those patients at risk of wound formation or delayed healing. No safety concerns were reported in any studies. A small number of studies have demonstrated the capabilities of in vivo label-free HSI, but further work is needed to fully integrate it into the current clinical workflow for different wound aetiologies. As an emerging imaging modality for medical applications, HSI offers great potential for non-invasive disease diagnosis and guidance when treating patients with both acute and chronic wounds.

Hyperspectral Imaging and the Retina: Worth the Wave?

Purpose

Hyperspectral imaging is gaining attention in the biomedical field because it generates additional spectral information to study physiological and clinical processes. Several technologies have been described; however an independent, systematic literature overview is lacking, especially in the field of ophthalmology. This investigation is the first to systematically overview scientific literature specifically regarding retinal hyperspectral imaging.

Methods

A systematic literature review was conducted, in accordance with PRISMA Statement 2009 criteria, in four bibliographic databases: Medline, Embase, Cochrane Database of Systematic Reviews, and Web of Science.

Results

Fifty-six articles were found that meet the review criteria. A range of techniques was reported: Fourier analysis, liquid crystal tunable filters, tunable laser sources, dual-slit monochromators, dispersive prisms and gratings, computed tomography, fiber optics, and Fabry-Perrot cavity filter covered complementary metal oxide semiconductor. We present a narrative synthesis and summary tables of findings of the included articles, because methodologic heterogeneity and diverse research topics prevented a meta-analysis being conducted.

Conclusions

Application in ophthalmology is still in its infancy. Most previous experiments have been performed in the field of retinal oximetry, providing valuable information in the diagnosis and monitoring of various ocular diseases. To date, none of these applications have graduated to clinical practice owing to the lack of sufficiently large validation studies.

Translational Relevance

Given the promising results that smaller studies show for hyperspectral imaging (e.g., in Alzheimer's disease), advanced research in larger validation studies is warranted to determine its true clinical potential.

Vascular retinal biomarkers improves the detection of the likely cerebral amyloid status from hyperspectral retinal images

Introduction

This study investigates the relationship between retinal image features and β-amyloid (Aβ) burden in the brain with the aim of developing a noninvasive method to predict the deposition of Aβ in the brain of patients with Alzheimer's disease.

Methods

Retinal images from 20 cognitively impaired and 26 cognitively unimpaired cases were acquired (3 images per subject) using a hyperspectral retinal camera. The cerebral amyloid status was determined from binary reads by a panel of 3 expert raters on ¹⁸F-florbetaben positron-emission tomography (PET) studies. Image features from the hyperspectral retinal images were calculated, including vessels tortuosity and diameter and spatial-spectral texture measures in different retinal anatomical regions.

Results

Retinal venules of amyloid-positive subjects (Aβ+) showed a higher mean tortuosity compared with the amyloid-negative (Aβ−) subjects. Arteriolar diameter of Aβ+ subjects was found to be higher than the Aβ− subjects in a zone adjacent to the optical nerve head. Furthermore, a significant difference between texture measures built over retinal arterioles and their adjacent regions were observed in Aβ+ subjects when compared with the Aβ−. A classifier was trained to automatically discriminate subjects combining the extracted features. The classifier could discern Aβ+ subjects from Aβ− subjects with an accuracy of 85%.

Discussion

Significant differences in texture measures were observed in the spectral range 450 to 550 nm which is known as the spectral region known to be affected by scattering from amyloid aggregates in the retina. This study suggests that the inclusion of metrics related to the retinal vasculature and tissue-related textures extracted from vessels and surrounding regions could improve the discrimination performance of the cerebral amyloid status.

Intraoperative multispectral and hyperspectral label-free imaging: A systematic review of in vivo clinical studies

Multispectral and hyperspectral imaging (HSI) are emerging optical imaging techniques with the potential to transform the way surgery is performed but it is not clear whether current systems are capable of delivering real-time tissue characterization and surgical guidance. We conducted a systematic review of surgical in vivo label-free multispectral and HSI systems that have been assessed intraoperatively in adult patients, published over a 10-year period to May 2018. We analysed 14 studies including 8 different HSI systems. Current in-vivo HSI systems generate an intraoperative tissue oxygenation map or enable tumour detection. Intraoperative tissue oxygenation measurements may help to predict those patients at risk of postoperative complications and in-vivo intraoperative tissue characterization may be performed with high specificity and sensitivity. All systems utilized a line-scanning or wavelength-scanning method but the spectral range and number of spectral bands employed varied significantly between studies and according to the system's clinical aim. The time to acquire a hyperspectral cube dataset ranged between 5 and 30 seconds. No safety concerns were reported in any studies. A small number of studies have demonstrated the capabilities of intraoperative in-vivo label-free HSI but further work is needed to fully integrate it into the current surgical workflow.

Convolutional Neural Networks for Spectroscopic Analysis in Retinal Oximetry

Retinal oximetry is a non-invasive technique to investigate the hemodynamics, vasculature and health of the eye. Current techniques for retinal oximetry have been plagued by quantitatively inconsistent measurements and this has greatly limited their adoption in clinical environments. To become clinically relevant oximetry measurements must become reliable and reproducible across studies and locations. To this end, we have developed a convolutional neural network algorithm for multi-wavelength oximetry, showing a greatly improved calculation performance in comparison to previously reported techniques. The algorithm is calibration free, performs sensing of the four main hemoglobin conformations with no prior knowledge of their characteristic absorption spectra and, due to the convolution-based calculation, is invariable to spectral shifting. We show, herein, the dramatic performance improvements in using this algorithm to deduce effective oxygenation (SO₂), as well as the added functionality to accurately measure fractional oxygenation (\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$${{\bf{SO}}}_{{\bf{2}}}^{{\boldsymbol{f}}{\boldsymbol{r}}}$$\end{document}SO2fr). Furthermore, this report compares, for the first time, the relative performance of several previously reported multi-wavelength oximetry algorithms in the face of controlled spectral variations. The improved ability of the algorithm to accurately and independently measure hemoglobin concentrations offers a high potential tool for disease diagnosis and monitoring when applied to retinal spectroscopy.

A Dye-Free Analog to Retinal Angiography Using Hyperspectral Unmixing to Retrieve Oxyhemoglobin Abundance

Purpose

Retinal angiography evaluates retinal and choroidal perfusion and vascular integrity and is used to manage many ophthalmic diseases, such as age-related macular degeneration. The most common method, fluorescein angiography (FA), is invasive and can lead to untoward effects. As an emerging replacement, noninvasive OCT angiography (OCTA) is used regularly as a dye-free substitute with superior resolution and additional depth-sectioning abilities; however, general trends in FA as signified by varying intensity in images are not always reproducible in the fine structural detail in an OCTA image stack because of the source of their respective signals, OCT speckle decorrelation versus fluorescein emission.

Methods

We present a noninvasive/dye-free analog to angiography imaging using retinal hyperspectral imaging with a nonscanning spectral imager, the image mapping spectrometer (IMS), to reproduce perfusion-related data based on the abundance of oxyhemoglobin (HbO₂) in the retina. With a new unmixing procedure of the IMS-acquired spectral data cubes (350 × 350 × 43), we produced noninvasive HbO₂ maps unmixed from reflectance spectra.

Results

Here, we present 15 HbO₂ maps from seven healthy and eight diseased retinas and compare these maps with corresponding FA and OCTA results with a discussion of each technique.

Conclusions

Our maps showed visual agreement with hypo- and hyperfluorescence trends in venous phase FA images, suggesting that our method provides a new use for hyperspectral imaging as a noninvasive angiography-analog technique and as a complementary technique to OCTA.

Translational Relevance

The application of hyperspectral imaging and spectral analysis can potentially improve/broaden retinal disease screening and enable a noninvasive technique, which complements OCTA.

Detecting Happiness Using Hyperspectral Imaging Technology

Hyperspectral imaging (HSI) technology can be used to detect human emotions based on the power of material discrimination from their faces. In this paper, HSI is used to remotely sense and distinguish blood chromophores in facial tissues and acquire an evaluation indicator (tissue oxygen saturation, StO₂) using an optical absorption model. This study explored facial analysis while people were showing spontaneous expressions of happiness during social interaction. Happiness, as a psychological emotion, has been shown to be strongly linked to other activities such as physiological reaction and facial expression. Moreover, facial expression as a communicative motor behavior likely arises from musculoskeletal anatomy, neuromuscular activity, and individual personality. This paper quantified the neuromotor movements of tissues surrounding some regions of interest (ROIs) on smiling happily. Next, we selected six regions—the forehead, eye, nose, cheek, mouth, and chin—according to a facial action coding system (FACS). Nineteen segments were subsequently partitioned from the above ROIs. The affective data (StO₂) of 23 young adults were acquired by HSI while the participants expressed emotions (calm or happy), and these were used to compare the significant differences in the variations of StO₂ between the different ROIs through repeated measures analysis of variance. Results demonstrate that happiness causes different distributions in the variations of StO₂ for the above ROIs; these are explained in depth in the article. This study establishes that facial tissue oxygen saturation is a valid and reliable physiological indicator of happiness and merits further research.

Glaucoma related retinal oximetry: a technology update

There are two long-standing theories about the pathogenesis of glaucoma – barotrauma and the effect of vascular hypoxia. Currently, it is still unknown whether diminished blood flow is the cause or result of glaucomatous atrophy of ganglion cells and the optic nerve. Though many other imaging techniques used to directly assess ocular blood flow have been well studied, they are limited by their inability to directly assess metabolism in the ocular tissues or measure the oxygen carrying capacity in the vessels. Retinal oximetry is a relatively novel, noninvasive imaging technique that reliably measures oxygen saturation levels in the retinal vessels, offering surrogate markers for the metabolic demands of the eye. The clinical significance of these measurements has not been well established. Thus, this review gives an overview of ocular imaging and current retinal oximetry techniques, while contextualizing the important oximetry studies that have investigated the vascular theory behind glaucoma.

Retinal oxygen: from animals to humans

This article discusses retinal oxygenation and retinal metabolism by focusing on measurements made with two of the principal methods used to study O₂ in the retina: measurements of PO₂ with oxygen-sensitive microelectrodes in vivo in animals with a retinal circulation similar to that of humans, and oximetry, which can be used non-invasively in both animals and humans to measure O₂ concentration in retinal vessels. Microelectrodes uniquely have high spatial resolution, allowing the mapping of PO₂ in detail, and when combined with mathematical models of diffusion and consumption, they provide information about retinal metabolism. Mathematical models, grounded in experiments, can also be used to simulate situations that are not amenable to experimental study. New methods of oximetry, particularly photoacoustic ophthalmoscopy and visible light optical coherence tomography, provide depth-resolved methods that can separate signals from blood vessels and surrounding tissues, and can be combined with blood flow measures to determine metabolic rate. We discuss the effects on retinal oxygenation of illumination, hypoxia and hyperoxia, and describe retinal oxygenation in diabetes, retinal detachment, arterial occlusion, and macular degeneration. We explain how the metabolic measurements obtained from microelectrodes and imaging are different, and how they need to be brought together in the future. Finally, we argue for revisiting the clinical use of hyperoxia in ophthalmology, particularly in retinal arterial occlusions and retinal detachment, based on animal research and diffusion theory.