Hyperspectral imaging in highly scattering media by the spectral phasor approach using two filters

Label-Free Optical Metabolic Imaging in Cells and Tissues

Over the last half century, the autofluorescence of the metabolic cofactors NADH (reduced nicotinamide adenine dinucleotide) and FAD (flavin adenine dinucleotide) has been quantified in a variety of cell types and disease states. With the spread of nonlinear optical microscopy techniques in biomedical research, NADH and FAD imaging has offered an attractive solution to noninvasively monitor cell and tissue status and elucidate dynamic changes in cell or tissue metabolism. Various tools and methods to measure the temporal, spectral, and spatial properties of NADH and FAD autofluorescence have been developed. Specifically, an optical redox ratio of cofactor fluorescence intensities and NADH fluorescence lifetime parameters have been used in numerous applications, but significant work remains to mature this technology for understanding dynamic changes in metabolism. This article describes the current understanding of our optical sensitivity to different metabolic pathways and highlights current challenges in the field. Recent progress in addressing these challenges and acquiring more quantitative information in faster and more metabolically relevant formats is also discussed.

A single-shot hyperspectral phasor camera for fast, multi-color fluorescence microscopy

Hyperspectral fluorescence imaging improves multiplexed observations of biological samples by utilizing multiple color channels across the spectral range to compensate for spectral overlap between labels. Typically, spectral resolution comes at a cost of decreased detection efficiency, which both hampers imaging speed and increases photo-toxicity to the samples. Here, we present a high-speed, high-efficiency snapshot spectral acquisition method, based on optical compression of the fluorescence spectra via Fourier transform, that overcomes the challenges of discrete spectral sampling: single-shot hyperspectral phasor camera (SHy-Cam). SHy-Cam captures fluorescence spatial and spectral information in a single exposure with a standard scientific CMOS camera, with photon efficiency of over 80%, easily and with acquisition rates exceeding 30 datasets per second, making it a powerful tool for multi-color in vivo imaging. Its simple design, using readily available optical components, and its easy integration provide a low-cost solution for multi-color fluorescence imaging with increased efficiency and speed.

Ultrahigh-Throughput Single-Particle Hyperspectral Imaging of Gold Nanoparticles

Gold nanoparticles (AuNPs) have become increasingly useful in recent years for their roles in nanomedicine, cellular biology, energy storage and conversion, photocatalysis, and more. At the single-particle level, AuNPs have heterogeneous physical and chemical properties which are not resolvable in ensemble measurements. In the present study, we developed an ultrahigh-throughput spectroscopy and microscopy imaging system for characterization of AuNPs at the single-particle level using phasor analysis. The developed method enables quantification of spectra and spatial information on large numbers of AuNPs with a single snapshot of an image (1024 × 1024 pixels) at high temporal resolution (26 fps) and localization precision (sub-5 nm). We characterized the localized surface plasmonic resonance (SPR) scattering spectra of gold nanospheres (AuNSs) of four different sizes (40-100 nm). Comparing to the conventional optical grating method which suffers low efficiency in characterization due to spectral interference caused by nearby nanoparticles, the phasor approach enables high-throughput analysis of single-particle SPR properties in high particle density. Up to 10-fold greater efficiency of single-particle spectro-microscopy analysis using the spectra phasor approach when compared to a conventional optical grating method was demonstrated.

Advanced Fluorescence Microscopy Methods to Study Dynamics of Fluorescent Proteins In Vivo

Fluorescent proteins are standard tools for addressing biological questions in a cell biology laboratory. The genetic tagging of protein of interest with fluorescent proteins opens the opportunity to follow them in vivo and to understand their interactions and dynamics. In addition, the latest advances in optical microscopy image acquisition and processing allow us to study many cellular processes in vivo. Techniques such as fluorescence lifetime microscopy and hyperspectral imaging provide valuable tools for understanding fluorescent protein interactions and their photophysics. Finally, fluorescence fluctuation analysis opens the possibility to address questions of molecular diffusion, protein-protein interactions, and oligomerization, among others, yielding quantitative information on the subject of study. This chapter will cover some of the more important advances in cutting-edge technologies and methods that, combined with fluorescent proteins, open new frontiers for biological studies.

Multiplexed bioluminescence microscopy via phasor analysis

Bioluminescence imaging with luciferase-luciferin pairs is a well-established technique for visualizing biological processes across tissues and whole organisms. Applications at the microscale, by contrast, have been hindered by a lack of detection platforms and easily resolved probes. We addressed this limitation by combining bioluminescence with phasor analysis, a method commonly used to distinguish spectrally similar fluorophores. We built a camera-based microscope equipped with special optical filters to directly assign phasor locations to unique luciferase-luciferin pairs. Six bioluminescent reporters were easily resolved in live cells, and the readouts were quantitative and instantaneous. Multiplexed imaging was also performed over extended time periods. Bioluminescent phasor further provided direct measures of resonance energy transfer in single cells, setting the stage for dynamic measures of cellular and molecular features. The merger of bioluminescence with phasor analysis fills a long-standing void in imaging capabilities, and will bolster future efforts to visualize biological events in real time and over multiple length scales.

Application of Microspectral Imaging in Motor and Sensory Nerve Classification

Objective

It aimed to explore the application of the microscopic hyperspectral technique in motor and sensory nerve classification.

Methods

The self-developed microscopic hyperspectral acquisition system was applied to collect the data of anterior and posterior spinal cord sections of white rabbits. The joint correction algorithm was employed to preprocess the collected data, such as noise reduction. On the basis of pure linear light source index, a new pixel purification algorithm based on cross contrast was proposed to extract more regions of interest, which was used for feature extraction of motor and sensory nerves. Besides, the ML algorithm was employed to classify motor and sensory nerves based on feature extraction results.

Results

The joint correction algorithm was adopted to preprocess the data collected by the microscopic hyperspectral technique, so as to eliminate the influence of the incident light source and the system and improve the classification accuracy. The axon and myelin spectrum curves of the two kinds of nerves in the stained specimens had the same trend, but the values of all kinds of spectrum of sensory nerves were higher than those of motor nerves. However, the myelin sheath spectrum curves of motor nerves in the unstained specimens were greatly different from the curves of sensory nerves. The axon spectrum curves had the same trend, but the axon spectrum values of sensory nerves were higher than those of motor nerves. The ML algorithm had high accuracy and fast speed in motor and sensory nerve classification, and the classification effect of stained specimens was better than that of unstained specimens.

Conclusion

The microscopic hyperspectral technique had high feasibility in sensory and motor nerve classification and was worthy of further research and promotion.

Method of transmission filters to measure emission spectra in strongly scattering media

We describe a method based on a pair of transmission filters placed in the emission path of a microscope to resolve the emission wavelength of every point in an image. The method can be applied to any type of imaging device that provides the light in the wavelength transmission range of the filters. Unique characteristics of the filter approach are that the light does not need to be collimated and the wavelength response does not depend on the scattering of the sample or tissue. The pair of filters are used to produce the spectral phasor of the transmitted light, which is sufficient to perform spectral deconvolution over a broad wavelength range. The method is sensitive enough to distinguish free and protein-bound NADH and can be used in metabolic studies.

Phasor-based hyperspectral snapshot microscopy allows fast imaging of live, three-dimensional tissues for biomedical applications

Hyperspectral imaging is highly sought after in many fields including mineralogy and geology, environment and agriculture, astronomy and, importantly, biomedical imaging and biological fluorescence. We developed ultrafast phasor-based hyperspectral snapshot microscopy based on sine/cosine interference filters for biomedical imaging not feasible with conventional hyperspectral detection methods. Current approaches rely on slow spatial or spectral scanning limiting their application in living biological tissues, while faster snapshot methods such as image mapping spectrometry and multispectral interferometry are limited in spatial and/or spectral resolution, are computationally demanding, and imaging devices are very expensive to manufacture. Leveraging light sheet microscopy, phasor-based hyperspectral snapshot microscopy improved imaging speed 10-100 fold which, combined with minimal light exposure and high detection efficiency, enabled hyperspectral metabolic imaging of live, three-dimensional mouse tissues not feasible with other methods. As a fit-free method that does not require any a priori information often unavailable in complex and evolving biological systems, the rule of linear combinations of the phasor could spectrally resolve subtle differences between cell types in the developing zebrafish retina and spectrally separate and track multiple organelles in 3D cultured cells over time. The sine/cosine snapshot method is adaptable to any microscope or imaging device thus making hyperspectral imaging and fit-free analysis based on linear combinations broadly available to researchers and the public.

The Phasor Plot: A Universal Circle to Advance Fluorescence Lifetime Analysis and Interpretation

The phasor approach to fluorescence lifetime imaging has become a common method to analyze complicated fluorescence signals from biological samples. The appeal of the phasor representation of complex fluorescence decays in biological systems is that a visual representation of the decay of entire cells or tissues can be used to easily interpret fundamental biological states related to metabolism and oxidative stress. Phenotyping based on autofluorescence provides new avenues for disease characterization and diagnostics. The phasor approach is a transformation of complex fluorescence decays that does not use fits to model decays and therefore has the same information content as the original data. The phasor plot is unique for a given system, is highly reproducible, and provides a robust method to evaluate the existence of molecular interactions such as Förster resonance energy transfer or the response of ion indicators. Recent advances permitquantification of multiple components from phasor plots in fluorescence lifetime imaging microscopy, which is not presently possible using data fitting methods, especially in biological systems.

Resolution of 4 components in the same pixel in FLIM images using the phasor approach

In several cellular systems, the phasor FLIM approach has shown the existence of more than 2 components in the same pixel, a typical example being free and bound NADH. In order to properly quantify the concentrations and the spatial distributions of fluorescence components associated with different molecular species we developed a general method to resolve 3 and 4 components in the same pixel using the phasor approach. The method is based on the law of linear combination of components valid after transformation of the decay curves to phasors for each pixel in the image. In principle, the linear combination rule is valid for an arbitrary number of components. For 3 components we use only the phasor position for the first harmonic, which has a small error, while for 4 components we need the phasor location at higher harmonics that have intrinsically more noise. As a result of the noise in the higher harmonics, caused by limited photon statistics, we are able to use linear algebra to resolve 4 components given the position of the phasors of 4 independent components in mixtures of dyes and 3 components for dyes in cellular systems.

The DIVER Microscope for Imaging in Scattering Media

We describe an advanced DIVER (Deep Imaging Via Emission Recovery) detection system for two-photon fluorescence microscopy that allows imaging in multiple scattering media, including biological tissues, up to a depth of a few mm with micron resolution. This detection system is more sensitive to low level light signals than conventional epi-detection used in two-photon fluorescence microscopes. The DIVER detector efficiently collects scattered emission photons from a wide area of turbid samples at almost any entrance angle in a 2π spherical angle. Using an epi-detection scheme only photons coming from a relatively small area of a sample and at narrow acceptance angle can be detected. The transmission geometry of the DIVER imaging system makes it exceptionally suitable for Second and Third Harmonic Generation (SHG, THG) signal detection. It also has in-depth fluorescence lifetime imaging (FLIM) capability. Using special optical filters with sin-cos spectral response, hyperspectral analysis of images acquired in-depth in scattering media can be performed. The system was successfully employed in imaging of various biological tissues. The DIVER detector can be plugged into a standard microscope stage and used as an external detector with upright commercial two-photon microscopes.

A metabolic interpretation for the response of cellular autofluorescence to chemical perturbations assessed using spectral phasor analysis

Analytical approaches for sensing cellular NADH conformation from autofluorescence signals have significance because NADH is a metabolic indicator and endogenous biomarker. Recently, spectral detection of multiple cellular NADH forms during chemically-induced metabolic response was reported, however because NADH is solvatochromic and the spectral change is small, the possibility of a non-metabolic interpretation needs to be considered. Here we investigate the response of UV-excited autofluorescence to a range of well-known chemicals affecting fermentation, respiration, and oxidative-stress pathways in Saccharomyces cerevisiae. The two-component nature of the spectral response is assessed using phasor analysis. By considering a series of physically similar and dissimilar chemicals acting on multiple pathways, we show how the two-component nature of a spectral response is of metabolic origin, indicative of whether a single or several pathways have been affected.

The two-component nature of the autofluorescence response is indicative of whether a single or several pathways are affected.