A hyperspectral imaging system for mapping haemoglobin and cytochrome-c-oxidase concentration changes in the exposed cerebral cortex

Hyperspectral imaging in neurosurgery: a review of systems, computational methods, and clinical applications

Significance

Accurate identification between pathologic (e.g., tumors) and healthy brain tissue is a critical need in neurosurgery. However, conventional surgical adjuncts have significant limitations toward achieving this goal (e.g., image guidance based on pre-operative imaging becomes inaccurate up to 3 cm as surgery proceeds). Hyperspectral imaging (HSI) has emerged as a potential powerful surgical adjunct to enable surgeons to accurately distinguish pathologic from normal tissues.

Aim

We review HSI techniques in neurosurgery; categorize, explain, and summarize their technical and clinical details; and present some promising directions for future work.

Approach

We performed a literature search on HSI methods in neurosurgery focusing on their hardware and implementation details; classification, estimation, and band selection methods; publicly available labeled and unlabeled data; image processing and augmented reality visualization systems; and clinical study conclusions.

Results

We present a detailed review of HSI results in neurosurgery with a discussion of over 25 imaging systems, 45 clinical studies, and 60 computational methods. We first provide a short overview of HSI and the main branches of neurosurgery. Then, we describe in detail the imaging systems, computational methods, and clinical results for HSI using reflectance or fluorescence. Clinical implementations of HSI yield promising results in estimating perfusion and mapping brain function, classifying tumors and healthy tissues (e.g., in fluorescence-guided tumor surgery, detecting infiltrating margins not visible with conventional systems), and detecting epileptogenic regions. Finally, we discuss the advantages and disadvantages of HSI approaches and interesting research directions as a means to encourage future development.

Conclusions

We describe a number of HSI applications across every major branch of neurosurgery. We believe these results demonstrate the potential of HSI as a powerful neurosurgical adjunct as more work continues to enable rapid acquisition with smaller footprints, greater spectral and spatial resolutions, and improved detection.

Transportable hyperspectral imaging setup based on fast, high-density spectral scanning for in situ quantitative biochemical mapping of fresh tissue biopsies

Significance

Histopathological examination of surgical biopsies, such as in glioma and glioblastoma resection, is hindered in current clinical practice by the long time required for the laboratory analysis and pathological screening, typically taking several days or even weeks to be completed.

Aim

We propose here a transportable, high-density, spectral scanning-based hyperspectral imaging (HSI) setup, named HyperProbe1, that can provide in situ, fast biochemical analysis, and mapping of fresh surgical tissue samples, right after excision, and without the need for fixing, staining nor compromising the integrity of the tissue properties.

Approach

HyperProbe1 is based on spectral scanning via supercontinuum laser illumination filtered with acousto-optic tunable filters. Such methodology allows the user to select any number and type of wavelength bands in the visible and near-infrared range between 510 and 900 nm (up to a maximum of 79) and to reconstruct 3D hypercubes composed of high-resolution (4 to 5    μ m ), widefield images ( 0.9 × 0.9    mm 2 ) of the surgical samples, where each pixel is associated with a complete spectrum.

Results

The HyperProbe1 setup is here presented and characterized. The system is applied to 11 fresh surgical biopsies of glioma from routine patients, including different grades of tumor classification. Quantitative analysis of the composition of the tissue is performed via fast spectral unmixing to reconstruct the mapping of major biomarkers, such as oxy-(HbO 2 ) and deoxyhemoglobin (HHb), as well as cytochrome-c-oxidase (CCO). We also provided a preliminary attempt to infer tumor classification based on differences in composition in the samples, suggesting the possibility of using lipid content and differential CCO concentrations to distinguish between lower and higher-grade gliomas.

Conclusions

A proof of concept of the performances of HyperProbe1 for quantitative, biochemical mapping of surgical biopsies is demonstrated, paving the way for improving current post-surgical, histopathological practice via non-destructive, in situ streamlined screening of fresh tissue samples in a matter of minutes after excision.

Window into the mind: Advanced handheld spectroscopic eye-safe technology for point-of-care neurodiagnostic

Traumatic brain injury (TBI), a major cause of morbidity and mortality worldwide, is hard to diagnose at the point of care with patients often exhibiting no clinical symptoms. There is an urgent need for rapid point-of-care diagnostics to enable timely intervention. We have developed a technology for rapid acquisition of molecular fingerprints of TBI biochemistry to safely measure proxies for cerebral injury through the eye, providing a path toward noninvasive point-of-care neurodiagnostics using simultaneous Raman spectroscopy and fundus imaging of the neuroretina. Detection of endogenous neuromarkers in porcine eyes' posterior revealed enhancement of high-wave number bands, clearly distinguishing TBI and healthy cohorts, classified via artificial neural network algorithm for automated data interpretation. Clinically, translating into reduced specialist support, this markedly improves the speed of diagnosis. Designed as a hand-held cost-effective technology, it can allow clinicians to rapidly assess TBI at the point of care and identify long-term changes in brain biochemistry in acute or chronic neurodiseases.

Synthetic white balancing for intra-operative hyperspectral imaging

Purpose

Hyperspectral imaging shows promise for surgical applications to non-invasively provide spatially resolved, spectral information. For calibration purposes, a white reference image of a highly reflective Lambertian surface should be obtained under the same imaging conditions. Standard white references are not sterilizable and so are unsuitable for surgical environments. We demonstrate the necessity for in situ white references and address this by proposing a novel, sterile, synthetic reference construction algorithm.

Approach

The use of references obtained at different distances and lighting conditions to the subject were examined. Spectral and color reconstructions were compared with standard measurements qualitatively and quantitatively, using Δ E and normalized RMSE, respectively. The algorithm forms a composite image from a video of a standard sterile ruler, whose imperfect reflectivity is compensated for. The reference is modeled as the product of independent spatial and spectral components, and a scalar factor accounting for gain, exposure, and light intensity. Evaluation of synthetic references against ideal but non-sterile references is performed using the same metrics alongside pixel-by-pixel errors. Finally, intraoperative integration is assessed though cadaveric experiments.

Results

Improper white balancing leads to increases in all quantitative and qualitative errors. Synthetic references achieve median pixel-by-pixel errors lower than 6.5% and produce similar reconstructions and errors to an ideal reference. The algorithm integrated well into surgical workflow, achieving median pixel-by-pixel errors of 4.77% while maintaining good spectral and color reconstruction.

Conclusions

We demonstrate the importance of in situ white referencing and present a novel synthetic referencing algorithm. This algorithm is suitable for surgery while maintaining the quality of classical data reconstruction.

Measuring changes in blood volume fraction during induced gingivitis of healthy and unhealthy populations using hyperspectral spatial frequency domain imaging: a clinical study

This investigation aimed to quantitatively measure the changes in inflammation of subjects with healthy and unhealthy gums during a period of induced gingivitis. A total of 30 subjects (15 healthy, 15 with gum inflammation) were enlisted and given oral exams by a dental hygienist. Baseline measurements were acquired before a 3-week period of oral hygiene abstinence. The lobene modified gingival index scoring was used for inflammation scoring and hyperspectral spatial frequency domain imaging was used to quantitatively measure oxy- and deoxygenated blood volume fraction at two time points: at Baseline and after 3 weeks of oral hygiene abstinence. We found that abstaining from oral hygiene causes a near proportional increase in oxygenated and deoxygenated blood volume fraction for healthy individuals. For individuals who started the study with mild to moderate gingivitis, increases in blood volume were mainly due to deoxygenated blood.

Lawrence K, Tachtsidis I, Tong Y, Torricelli A, Urner T, Wabnitz H, Wolf M, Wolf U, Xu S, Yang C, Yodh AG, Yücel MA, Zhou W. Optical imaging and spectroscopy for the study of the human brain: status report

This report is the second part of a comprehensive two-part series aimed at reviewing an extensive and diverse toolkit of novel methods to explore brain health and function. While the first report focused on neurophotonic tools mostly applicable to animal studies, here, we highlight optical spectroscopy and imaging methods relevant to noninvasive human brain studies. We outline current state-of-the-art technologies and software advances, explore the most recent impact of these technologies on neuroscience and clinical applications, identify the areas where innovation is needed, and provide an outlook for the future directions.

Microscopy is better in color: development of a streamlined spectral light path for real-time multiplex fluorescence microscopy

Spectroscopic image data has provided molecular discrimination for numerous fields including: remote sensing, food safety and biomedical imaging. Despite the various technologies for acquiring spectral data, there remains a trade-off when acquiring data. Typically, spectral imaging either requires long acquisition times to collect an image stack with high spectral specificity or acquisition times are shortened at the expense of fewer spectral bands or reduced spatial sampling. Hence, new spectral imaging microscope platforms are needed to help mitigate these limitations. Fluorescence excitation-scanning spectral imaging is one such new technology, which allows more of the emitted signal to be detected than comparable emission-scanning spectral imaging systems. Here, we have developed a new optical geometry that provides spectral illumination for use in excitation-scanning spectral imaging microscope systems. This was accomplished using a wavelength-specific LED array to acquire spectral image data. Feasibility of the LED-based spectral illuminator was evaluated through simulation and benchtop testing and assessment of imaging performance when integrated with a widefield fluorescence microscope. Ray tracing simulations (TracePro) were used to determine optimal optical component selection and geometry. Spectral imaging feasibility was evaluated using a series of 6-label fluorescent slides. The LED-based system response was compared to a previously tested thin-film tunable filter (TFTF)-based system. Spectral unmixing successfully discriminated all fluorescent components in spectral image data acquired from both the LED and TFTF systems. Therefore, the LED-based spectral illuminator provided spectral image data sets with comparable information content so as to allow identification of each fluorescent component. These results provide proof-of-principle demonstration of the ability to combine output from many discrete wavelength LED sources using a double-mirror (Cassegrain style) optical configuration that can be further modified to allow for high speed, video-rate spectral image acquisition. Real-time spectral fluorescence microscopy would allow monitoring of rapid cell signaling processes (i.e., Ca²⁺ and other second messenger signaling) and has potential to be translated to clinical imaging platforms.

Review on the Application of Hyperspectral Imaging Technology of the Exposed Cortex in Cerebral Surgery

The study of brain science is vital to human health. The application of hyperspectral imaging in biomedical fields has grown dramatically in recent years due to their unique optical imaging method and multidimensional information acquisition. Hyperspectral imaging technology can acquire two-dimensional spatial information and one-dimensional spectral information of biological samples simultaneously, covering the ultraviolet, visible and infrared spectral ranges with high spectral resolution, which can provide diagnostic information about the physiological, morphological and biochemical components of tissues and organs. This technology also presents finer spectral features for brain imaging studies, and further provides more auxiliary information for cerebral disease research. This paper reviews the recent advance of hyperspectral imaging in cerebral diagnosis. Firstly, the experimental setup, image acquisition and pre-processing, and analysis methods of hyperspectral technology were introduced. Secondly, the latest research progress and applications of hyperspectral imaging in brain tissue metabolism, hemodynamics, and brain cancer diagnosis in recent years were summarized briefly. Finally, the limitations of the application of hyperspectral imaging in cerebral disease diagnosis field were analyzed, and the future development direction was proposed.

Broadband, Enhanced, and Antithermally Quenched Near-Infrared Phosphors via a Cosubstitution Approach

Wearable biosensing and food safety inspection devices with high thermal stability, high brightness, and broad near-infrared (NIR) phosphor-converted light-emitting diodes (pc-LEDs) could accelerate the next-generation NIR light applications. In this work, NIR La_3-xGd_xGa₅GeO₁₄:Cr³⁺ (x = 0 to 1.5) phosphors were successfully fabricated by a high-temperature solid-state method. Here, by doping Gd³⁺ ions into the La³⁺ sites in the La₃Ga₅GeO₁₄ matrix, a 7.9-fold increase in the photoluminescence (PL) intensity of the Cr³⁺ ions, as well as a remarkably broadened full width at half-maximum (FWHM) of the corresponding PL spectra, is achieved. The enhancements in the PL, PLE intensity, and FWHM are attributed to the suppression of the nonradiative transition process of Cr³⁺ when Gd³⁺ ions are doped into the host, which can be demonstrated by the decay curves. Moreover, the La_1.5Gd_1.5Ga₅GeO₁₄:Cr³⁺ phosphor displays an abnormally negative thermal phenomenon that the integral PL intensity reaches 131% of the initial intensity when the ambient temperature increases to 160 °C. Finally, the broadband NIR pc-LED was fabricated based on the as-explored La_1.5Gd_1.5Ga₅GeO₁₄:Cr³⁺ phosphors combined with a 460 nm chip, and the potential applications for the broadband NIR pc-LEDs were discussed in detail.

The Use of Supercontinuum Laser Sources in Biomedical Diffuse Optics: Unlocking the Power of Multispectral Imaging

Optical techniques based on diffuse optics have been around for decades now and are making their way into the day-to-day medical applications. Even though the physics foundations of these techniques have been known for many years, practical implementation of these technique were hindered by technological limitations, mainly from the light sources and/or detection electronics. In the past 20 years, the developments of supercontinuum laser (SCL) enabled to unlock some of these limitations, enabling the development of system and methodologies relevant for medical use, notably in terms of spectral monitoring. In this review, we focus on the use of SCL in biomedical diffuse optics, from instrumentation and methods developments to their use for medical applications. A total of 95 publications were identified, from 1993 to 2021. We discuss the advantages of the SCL to cover a large spectral bandwidth with a high spectral power and fast switching against the disadvantages of cost, bulkiness, and long warm up times. Finally, we summarize the utility of using such light sources in the development and application of diffuse optics in biomedical sciences and clinical applications.