Challenges in, and recommendations for, hyperspectral imaging in ex vivo malignant glioma biopsy measurements

Fluorescence guidance in skull base surgery: Applications and limitations - A systematic review

Introduction

Intraoperative fluorescence guidance is a well-established surgical adjunct in high-grade glioma surgery. In contrast, the clinical use of such dyes and technology has been scarcely reported in skull base surgery.

Research question

We aimed to systematically review the clinical applications of different fluorophores in both open and endonasal skull base surgery.

Material and methods

We performed a systematic review and discussed the current literature on fluorescence guidance in skull base surgery.

Results

After a comprehensive literature search, 77 articles on skull base fluorescence guidance were evaluated. A qualitative analysis of the articles is presented, discussing clinical indications and current controversies. The use of intrathecal fluorescein was the most frequently reported in the literature. Beyond that, 5-ALA and ICG were two other fluorescent dyes most extensively discussed, with some experimental fluorophore applications in skull base surgery.

Discussion and conclusion

Intraoperative fluorescence imaging can serve as an adjunct technology in skull base surgery. The scope of initial indications of these fluorophores has expanded beyond malignant glioma resection alone. We discuss current use and controversies and present an extensive overview of additional indications for fluorescence imaging in skull base pathologies. Further quantitative studies will be needed in the future, focusing on tissue selectivity and time-dependency of the different fluorophores currently commercially available, as well as the development of new compounds to expand applications and facilitate skull base surgeries.

Spectral library and method for sparse unmixing of hyperspectral images in fluorescence guided resection of brain tumors

Through spectral unmixing, hyperspectral imaging (HSI) in fluorescence-guided brain tumor surgery has enabled the detection and classification of tumor regions invisible to the human eye. Prior unmixing work has focused on determining a minimal set of viable fluorophore spectra known to be present in the brain and effectively reconstructing human data without overfitting. With these endmembers, non-negative least squares regression (NNLS) was commonly used to compute the abundances. However, HSI images are heterogeneous, so one small set of endmember spectra may not fit all pixels well. Additionally, NNLS is the maximum likelihood estimator only if the measurement is normally distributed, and it does not enforce sparsity, which leads to overfitting and unphysical results. In this paper, we analyzed 555666 HSI fluorescence spectra from 891 ex vivo measurements of patients with various brain tumors to show that a Poisson distribution indeed models the measured data 82% better than a Gaussian in terms of the Kullback-Leibler divergence, and that the endmember abundance vectors are sparse. With this knowledge, we introduce (1) a library of 9 endmember spectra, including PpIX (620 nm and 634 nm photostates), NADH, FAD, flavins, lipofuscin, melanin, elastin, and collagen, (2) a sparse, non-negative Poisson regression algorithm to perform physics-informed unmixing with this library without overfitting, and (3) a highly realistic spectral measurement simulation with known endmember abundances. The new unmixing method was then tested on the human and simulated data and compared to four other candidate methods. It outperforms previous methods with 25% lower error in the computed abundances on the simulated data than NNLS, lower reconstruction error on human data, better sparsity, and 31 times faster runtime than state-of-the-art Poisson regression. This method and library of endmember spectra can enable more accurate spectral unmixing to aid the surgeon better during brain tumor resection.

Towards machine learning-based quantitative hyperspectral image guidance for brain tumor resection

BACKGROUND

Complete resection of malignant gliomas is hampered by the difficulty in distinguishing tumor cells at the infiltration zone. Fluorescence guidance with 5-ALA assists in reaching this goal. Using hyperspectral imaging, previous work characterized five fluorophores' emission spectra in most human brain tumors.

METHODS

In this paper, the effectiveness of these five spectra was explored for different tumor and tissue classification tasks in 184 patients (891 hyperspectral measurements) harboring low- (n = 30) and high-grade gliomas (n = 115), non-glial primary brain tumors (n = 19), radiation necrosis (n = 2), miscellaneous (n = 10) and metastases (n = 8). Four machine-learning models were trained to classify tumor type, grade, glioma margins, and IDH mutation.

RESULTS

Using random forests and multilayer perceptrons, the classifiers achieve average test accuracies of 84-87%, 96.1%, 86%, and 91% respectively. All five fluorophore abundances vary between tumor margin types and tumor grades (p < 0.01). For tissue type, at least four of the five fluorophore abundances are significantly different (p < 0.01) between all classes.

CONCLUSIONS

These results demonstrate the fluorophores' differing abundances in different tissue classes and the value of the five fluorophores as potential optical biomarkers, opening new opportunities for intraoperative classification systems in fluorescence-guided neurosurgery.

5-ALA induced PpIX fluorescence spectroscopy in neurosurgery: a review

The review begins with an overview of the fundamental principles/physics underlying light, fluorescence, and other light-matter interactions in biological tissues. It then focuses on 5-aminolevulinic acid (5-ALA)-induced protoporphyrin IX (PpIX) fluorescence spectroscopy methods used in neurosurgery (e.g., intensity, time-resolved) and in so doing, describe their specific features (e.g., hardware requirements, main processing methods) as well as their strengths and limitations. Finally, we review current clinical applications and future directions of 5-ALA-induced protoporphyrin IX (PpIX) fluorescence spectroscopy in neurosurgery.

A Wearable Fluorescence Imaging Device for Intraoperative Identification of Human Brain Tumors

Malignant glioma (MG) is the most common type of primary malignant brain tumors. Surgical resection of MG remains the cornerstone of therapy and the extent of resection correlates with patient survival. A limiting factor for resection, however, is the difficulty in differentiating the tumor from normal tissue during surgery. Fluorescence imaging is an emerging technique for real-time intraoperative visualization of MGs and their boundaries. However, most clinical grade neurosurgical operative microscopes with fluorescence imaging ability are hampered by low adoption rates due to high cost, limited portability, limited operation flexibility, and lack of skilled professionals with technical knowledge. To overcome the limitations, we innovatively integrated miniaturized light sources, flippable filters, and a recording camera to the surgical eye loupes to generate a wearable fluorescence eye loupe (FLoupe) device for intraoperative imaging of fluorescent MGs. Two FLoupe prototypes were constructed for imaging of Fluorescein and 5-aminolevulinic acid (5-ALA), respectively. The wearable FLoupe devices were tested on tumor-simulating phantoms and patients with MGs. Comparable results were observed against the standard neurosurgical operative microscope (PENTERO® 900) with fluorescence kits. The affordable and wearable FLoupe devices enable visualization of both color and fluorescence images with the same quality as the large and expensive stationary operative microscopes. The wearable FLoupe device allows for a greater range of movement, less obstruction, and faster/easier operation. Thus, it reduces surgery time and is more easily adapted to the surgical environment than unwieldy neurosurgical operative microscopes. Clinical and Translational Impact Statement-The affordable and wearable fluorescence imaging device developed in this study enables neurosurgeons to observe brain tumors with the same clarity and greater flexibility compared to bulky and costly operative microscopes.

Unraveling the blue shift in porphyrin fluorescence in glioma: The 620 nm peak and its potential significance in tumor biology

In glioma surgery, the low-density infiltration zone of tumors is difficult to detect by any means. While, for instance, 5-aminolevulinic acid (5-ALA)-induced fluorescence is a well-established surgical procedure for maximizing resection of malignant gliomas, a cell density in tumor tissue of 20-30% is needed to observe visual fluorescence. Hyperspectral imaging is a powerful technique for the optical characterization of brain tissue, which accommodates the complex spectral properties of gliomas. Thereby, knowledge about the signal source is essential to generate specific separation (unmixing) procedures for the different spectral characteristics of analytes and estimate compound abundances. It was stated that protoporphyrin IX (PpIX) fluorescence consists mainly of emission peaks at 634 nm (PpIX634) and 620 nm (PpIX620). However, other members of the substance group of porphyrins fluoresce similarly to PpIX due to their common tetrapyrrole core structure. While the PpIX634 signal has reliably been assigned to PpIX, it has not yet been analyzed if PpIX620 might result from a different porphyrin rather than being a second photo state of PpIX. We thus reviewed more than 200,000 spectra from various tumors measured in almost 600 biopsies of 130 patients. Insufficient consideration of autofluorescence led to artificial inflation of the PpIX620 peak in the past. Recently, five basis spectra (PpIX634, PpIX620, flavin, lipofuscin, and NADH) were described and incorporated into the analysis algorithm, which allowed more accurate unmixing of spectral abundances. We used the improved algorithm to investigate the PpIX620 signal more precisely and investigated coproporphyrin III (CpIII) fluorescence phantoms for spectral unmixing. Our findings show that the PpIX634 peak was the primary source of the 5-ALA-induced fluorescence. CpIII had a similar spectral characteristic to PpIX620. The supplementation of 5-ALA may trigger the increased production of porphyrins other than PpIX within the heme biosynthesis pathway, including that of CpIII. It is essential to correctly separate autofluorescence from the main PpIX634 peak to analyze the fluorescence signal. This article highlights the need for a comprehensive understanding of the spectral complexity in gliomas and suggests less significance of the 620 nm fluorescence peak for PpIX analysis and visualization.

Lightfield hyperspectral imaging in neuro-oncology surgery: an IDEAL 0 and 1 study

Introduction

Hyperspectral imaging (HSI) has shown promise in the field of intra-operative imaging and tissue differentiation as it carries the capability to provide real-time information invisible to the naked eye whilst remaining label free. Previous iterations of intra-operative HSI systems have shown limitations, either due to carrying a large footprint limiting ease of use within the confines of a neurosurgical theater environment, having a slow image acquisition time, or by compromising spatial/spectral resolution in favor of improvements to the surgical workflow. Lightfield hyperspectral imaging is a novel technique that has the potential to facilitate video rate image acquisition whilst maintaining a high spectral resolution. Our pre-clinical and first-in-human studies (IDEAL 0 and 1, respectively) demonstrate the necessary steps leading to the first in-vivo use of a real-time lightfield hyperspectral system in neuro-oncology surgery.

Methods

A lightfield hyperspectral camera (Cubert Ultris ×50) was integrated in a bespoke imaging system setup so that it could be safely adopted into the open neurosurgical workflow whilst maintaining sterility. Our system allowed the surgeon to capture in-vivo hyperspectral data (155 bands, 350-1,000 nm) at 1.5 Hz. Following successful implementation in a pre-clinical setup (IDEAL 0), our system was evaluated during brain tumor surgery in a single patient to remove a posterior fossa meningioma (IDEAL 1). Feedback from the theater team was analyzed and incorporated in a follow-up design aimed at implementing an IDEAL 2a study.

Results

Focusing on our IDEAL 1 study results, hyperspectral information was acquired from the cerebellum and associated meningioma with minimal disruption to the neurosurgical workflow. To the best of our knowledge, this is the first demonstration of HSI acquisition with 100+ spectral bands at a frame rate over 1Hz in surgery.

Discussion

This work demonstrated that a lightfield hyperspectral imaging system not only meets the design criteria and specifications outlined in an IDEAL-0 (pre-clinical) study, but also that it can translate into clinical practice as illustrated by a successful first in human study (IDEAL 1). This opens doors for further development and optimisation, given the increasing evidence that hyperspectral imaging can provide live, wide-field, and label-free intra-operative imaging and tissue differentiation.