Identification of distinctive features in human intracranial tumors by label-free nonlinear multimodal microscopy

Toward cancer detection by label-free microscopic imaging in oncological surgery: Techniques, instrumentation and applications

This review examines the clinical application of label-free microscopy and spectroscopy, which are based on optical signals emitted by tissue components. Over the past three decades, a variety of techniques have been investigated with the aim of developing an in situ histopathology method that can rapidly and accurately identify tumor margins during surgical procedures. These techniques can be divided into two groups. One group encompasses techniques exploiting linear optical signals, and includes infrared and Raman microspectroscopy, and autofluorescence microscopy. The second group includes techniques based on nonlinear optical signals, including harmonic generation, coherent Raman scattering, and multiphoton autofluorescence microscopy. Some of these methods provide comparable information, while others are complementary. However, all of them have distinct advantages and disadvantages due to their inherent nature. The first part of the review provides an explanation of the underlying physics of the excitation mechanisms and a description of the instrumentation. It also covers endomicroscopy and data analysis, which are important for understanding the current limitations in implementing label-free techniques in clinical settings. The second part of the review describes the application of label-free microscopy imaging to improve oncological surgery with focus on brain tumors and selected gastrointestinal cancers, and provides a critical assessment of the current state of translation of these methods into clinical practice. Finally, the potential of confocal laser endomicroscopy for the acquisition of autofluorescence is discussed in the context of immediate clinical applications.

Clinical confocal laser endomicroscopy for imaging of autofluorescence signals of human brain tumors and non-tumor brain

PURPOSE

Analysis of autofluorescence holds promise for brain tumor delineation and diagnosis. Therefore, we investigated the potential of a commercial confocal laser scanning endomicroscopy (CLE) system for clinical imaging of brain tumors.

METHODS

A clinical CLE system with fiber probe and 488 nm laser excitation was used to acquire images of tissue autofluorescence. Fresh samples were obtained from routine surgeries (glioblastoma n = 6, meningioma n = 6, brain metastases n = 10, pituitary adenoma n = 2, non-tumor from surgery for the treatment of pharmacoresistant epilepsy n = 2). Additionally, in situ intraoperative label-free CLE was performed in three cases. The autofluorescence images were visually inspected for feature identification and quantification. For reference, tissue cryosections were prepared and further analyzed by label-free multiphoton microscopy and HE histology.

RESULTS

Label-free CLE enabled the acquisition of autofluorescence images for all cases. Autofluorescent structures were assigned to the cytoplasmic compartment of cells, elastin fibers, psammoma bodies and blood vessels by comparison to references. Sparse punctuated autofluorescence was identified in most images across all cases, while dense punctuated autofluorescence was most frequent in glioblastomas. Autofluorescent cells were observed in higher abundancies in images of non-tumor samples. Diffuse autofluorescence, fibers and round fluorescent structures were predominantly found in tumor tissues.

CONCLUSION

Label-free CLE imaging through an approved clinical device was able to visualize the characteristic autofluorescence patterns of human brain tumors and non-tumor brain tissue ex vivo and in situ. Therefore, this approach offers the possibility to obtain intraoperative diagnostic information before resection, importantly independent of any kind of marker or label.

Rapid, label-free classification of glioblastoma differentiation status combining confocal Raman spectroscopy and machine learning

Label-free identification of tumor cells using spectroscopic assays has emerged as a technological innovation with a proven ability for rapid implementation in clinical care. Machine learning facilitates the optimization of processing and interpretation of extensive data, such as various spectroscopy data obtained from surgical samples. The here-described preclinical work investigates the potential of machine learning algorithms combining confocal Raman spectroscopy to distinguish non-differentiated glioblastoma cells and their respective isogenic differentiated phenotype by means of confocal ultra-rapid measurements. For this purpose, we measured and correlated modalities of 1146 intracellular single-point measurements and sustainingly clustered cell components to predict tumor stem cell existence. By further narrowing a few selected peaks, we found indicative evidence that using our computational imaging technology is a powerful approach to detect tumor stem cells in vitro with an accuracy of 91.7% in distinct cell compartments, mainly because of greater lipid content and putative different protein structures. We also demonstrate that the presented technology can overcome intra- and intertumoral cellular heterogeneity of our disease models, verifying the elevated physiological relevance of our applied disease modeling technology despite intracellular noise limitations for future translational evaluation.

Learned end-to-end high-resolution lensless fiber imaging towards real-time cancer diagnosis

Recent advances in label-free histology promise a new era for real-time diagnosis in neurosurgery. Deep learning using autofluorescence is promising for tumor classification without histochemical staining process. The high image resolution and minimally invasive diagnostics with negligible tissue damage is of great importance. The state of the art is raster scanning endoscopes, but the distal lens optics limits the size. Lensless fiber bundle endoscopy offers both small diameters of a few 100 microns and the suitability as single-use probes, which is beneficial in sterilization. The problem is the inherent honeycomb artifacts of coherent fiber bundles (CFB). For the first time, we demonstrate an end-to-end lensless fiber imaging with exploiting the near-field. The framework includes resolution enhancement and classification networks that use single-shot CFB images to provide both high-resolution imaging and tumor diagnosis. The well-trained resolution enhancement network not only recovers high-resolution features beyond the physical limitations of CFB, but also helps improving tumor recognition rate. Especially for glioblastoma, the resolution enhancement network helps increasing the classification accuracy from 90.8 to 95.6%. The novel technique enables histological real-time imaging with lensless fiber endoscopy and is promising for a quick and minimally invasive intraoperative treatment and cancer diagnosis in neurosurgery.

Super-Multiplex Nonlinear Optical Imaging Unscrambles the Statistical Complexity of Cancer Subtypes and Tumor Microenvironment

Label-free nonlinear optical imaging (NLOI) has made tremendous inroads toward unscrambling the microcosmic complexity of cancers. However, harmonic and Raman microscopy offers throughput without redox information to reveal metabolic differentiation, and fluorescence lifetime microscopy lacks the vibrational response of molecules to visualize specific molecular constituents such as lipid. Here, a flexible, robust simultaneous multi-nonlinear imaging and cross-modality system that combines complementary imaging contrast mechanisms is demonstrated. This system, utilizing multiplexed ultrashort pulses, ingeniously integrates typical nonlinear processes, and high-dimension lifetime extension in a single setup to enhance the imaging dimensions and quality. Using this system, the authors perform label-free comprehensive evaluation of clinicopathological tissues of ovarian carcinoma due to its statistical complexity. The results show that the technology provides statistically rich, insightful information with high accuracy, sensitivity, and specificity, in contrast to standard histopathology, and can potentially be a powerful tool for fundamental cancer research and clinical applications.

Quantitative label-free imaging of iron-bound transferrin in breast cancer cells and tumors

Transferrin (Tf) is an essential serum protein which delivers iron throughout the body via transferrin-receptor (TfR)-mediated uptake and iron release in early endosomes. Currently, there is no robust method to assay the population of iron-bound Tf in intact cells and tissues. Raman hyperspectral imaging detected spectral peaks that correlated with iron-bound Tf in intact cells and tumor xenografts sections (~1270-1300 cm-1). Iron-bound (holo) and iron-free (apo) human Tf forms were endocytosed by MDAMB231 and T47D human breast cancer cells. The Raman iron-bound Tf peak was identified in cells treated with holo-Tf, but not in cells incubated with apo-Tf. A reduction in the Raman peak intensity between 5 and 30 min of Tf internalization was observed in T47D, but not in MDAMB231, suggesting that T47D can release iron from Tf more efficiently than MDAMB231. MDAMB231 may display a disrupted iron homeostasis due to iron release delays caused by alterations in the pH or ionic milieu of the early endosomes. In summary, we have demonstrated that Raman hyperspectral imaging can be used to identify iron-bound Tf in cell cultures and tumor xenografts and detect iron release behavior of Tf in breast cancer cells.

Deep learning as phase retrieval tool for CARS spectra

Finding efficient and reliable methods for the extraction of the phase in optical measurements is challenging and has been widely investigated. Although sophisticated optical settings, e.g. holography, measure directly the phase, the use of algorithmic methods has gained attention due to its efficiency, fast calculation and easy setup requirements. We investigated three phase retrieval methods: the maximum entropy technique (MEM), the Kramers-Kronig relation (KK), and for the first time deep learning using the Long Short-Term Memory network (LSTM). LSTM shows superior results for the phase retrieval problem of coherent anti-Stokes Raman spectra in comparison to MEM and KK.

Rise of Raman spectroscopy in neurosurgery: a review

SIGNIFICANCE

Although the clinical potential for Raman spectroscopy (RS) has been anticipated for decades, it has only recently been used in neurosurgery. Still, few devices have succeeded in making their way into the operating room. With recent technological advancements, however, vibrational sensing is poised to be a revolutionary tool for neurosurgeons.

AIM

We give a summary of neurosurgical workflows and key translational milestones of RS in clinical use and provide the optics and data science background required to implement such devices.

APPROACH

We performed an extensive review of the literature, with a specific emphasis on research that aims to build Raman systems suited for a neurosurgical setting.

RESULTS

The main translatable interest in Raman sensing rests in its capacity to yield label-free molecular information from tissue intraoperatively. Systems that have proven usable in the clinical setting are ergonomic, have a short integration time, and can acquire high-quality signal even in suboptimal conditions. Moreover, because of the complex microenvironment of brain tissue, data analysis is now recognized as a critical step in achieving high performance Raman-based sensing.

CONCLUSIONS

The next generation of Raman-based devices are making their way into operating rooms and their clinical translation requires close collaboration between physicians, engineers, and data scientists.

Label-free multiphoton imaging allows brain tumor recognition based on texture analysis-a study of 382 tumor patients

Background

Label-free multiphoton microscopy has been suggested for intraoperative recognition and delineation of brain tumors. For any future clinical application, appropriate approaches for image acquisition and analysis have to be developed. Moreover, an evaluation of the reliability of the approach, taking into account inter- and intrapatient variability, is needed.

Methods

Coherent anti-Stokes Raman scattering (CARS), two-photon excited fluorescence (TPEF), and second-harmonic generation were acquired on cryosections of brain tumors of 382 patients and 28 human nontumor brain samples. Texture parameters of those images were calculated and used as input for linear discriminant analysis.

Results

The combined analysis of texture parameters of the CARS and TPEF signal proved to be most suited for the discrimination of nontumor brain versus brain tumors (low- and high-grade astrocytoma, oligodendroglioma, glioblastoma, recurrent glioblastoma, brain metastases of lung, colon, renal, and breast cancer and of malignant melanoma) leading to a correct rate of 96% (sensitivity: 96%, specificity: 100%). To approximate the clinical setting, the results were validated on 42 fresh, unfixed tumor biopsies. 82% of the tumors and, most important, all of the nontumor samples were correctly recognized. An image resolution of 1 µm was sufficient to distinguish brain tumors and nontumor brain. Moreover, the vast majority of single fields of view of each patient’s sample were correctly classified with high probabilities, which is important for clinical translation.

Conclusion

Label-free multiphoton imaging might allow fast and accurate intraoperative delineation of primary and secondary brain tumors in combination with endoscopic systems.