Spectral Phasor approach for fingerprinting of photo-activatable fluorescent proteins Dronpa, Kaede and KikGR

Spectral Analysis of Human Retinal Pigment Epithelium Cells in Healthy and AMD Eyes

Purpose

Retinal pigment epithelium (RPE) cells show strong autofluorescence (AF). Here, we characterize the AF spectra of individual RPE cells in healthy eyes and those affected by age-related macular degeneration (AMD) and investigate associations between AF spectral response and the number of intracellular AF granules per cell.

Methods

RPE-Bruch's membrane flatmounts of 22 human donor eyes, including seven AMD-affected eyes (early AMD, three; geographic atrophy, one; neovascular, three) and 15 unaffected macula (<51 years, eight; >80 years, seven), were imaged at the fovea, perifovea, and near-periphery using confocal AF microscopy (excitation 488 nm), and emission spectra were recorded (500-710 nm). RPE cells were manually segmented with computer assistance and stratified by disease status, and emission spectra were analyzed using cubic spline transforms. Intracellular granules were manually counted and classified. Linear mixed models were used to investigate associations between spectra and the number of intracellular granules.

Results

Spectra of 5549 RPE cells were recorded. The spectra of RPE cells in healthy eyes showed similar emission curves that peaked at 580 nm for fovea and perifovea and at 575 and 580 nm for near-periphery. RPE spectral curves in AMD eyes differed significantly, being blue shifted by 10 nm toward shorter wavelengths. No significant association coefficients were found between wavelengths and granule counts.

Conclusions

This large series of RPE cell emission spectra at precisely predefined retinal locations showed a hypsochromic spectral shift in AMD. Combining different microscopy techniques, our work has identified cellular RPE spectral AF and subcellular granule properties that will inform future in vivo investigations using single-cell imaging.

Blue-shift photoconversion of near-infrared fluorescent proteins for labeling and tracking in living cells and organisms

Photolabeling of intracellular molecules is an invaluable approach to studying various dynamic processes in living cells with high spatiotemporal precision. Among fluorescent proteins, photoconvertible mechanisms and their products are in the visible spectrum (400-650 nm), limiting their in vivo and multiplexed applications. Here we report the phenomenon of near-infrared to far-red photoconversion in the miRFP family of near infrared fluorescent proteins engineered from bacterial phytochromes. This photoconversion is induced by near-infrared light through a non-linear process, further allowing optical sectioning. Photoconverted miRFP species emit fluorescence at 650 nm enabling photolabeling entirely performed in the near-infrared range. We use miRFPs as photoconvertible fluorescent probes to track organelles in live cells and in vivo, both with conventional and super-resolution microscopy. The spectral properties of miRFPs complement those of GFP-like photoconvertible proteins, allowing strategies for photoconversion and spectral multiplexed applications.

A single-shot hyperspectral phasor camera for fast, multi-color fluorescence microscopy

Hyperspectral fluorescence imaging improves multiplexed observations of biological samples by utilizing multiple color channels across the spectral range to compensate for spectral overlap between labels. Typically, spectral resolution comes at a cost of decreased detection efficiency, which both hampers imaging speed and increases photo-toxicity to the samples. Here, we present a high-speed, high-efficiency snapshot spectral acquisition method, based on optical compression of the fluorescence spectra via Fourier transform, that overcomes the challenges of discrete spectral sampling: single-shot hyperspectral phasor camera (SHy-Cam). SHy-Cam captures fluorescence spatial and spectral information in a single exposure with a standard scientific CMOS camera, with photon efficiency of over 80%, easily and with acquisition rates exceeding 30 datasets per second, making it a powerful tool for multi-color in vivo imaging. Its simple design, using readily available optical components, and its easy integration provide a low-cost solution for multi-color fluorescence imaging with increased efficiency and speed.

HyU: Hybrid Unmixing for longitudinal in vivo imaging of low signal-to-noise fluorescence

The expansion of fluorescence bioimaging toward more complex systems and geometries requires analytical tools capable of spanning widely varying timescales and length scales, cleanly separating multiple fluorescent labels and distinguishing these labels from background autofluorescence. Here we meet these challenging objectives for multispectral fluorescence microscopy, combining hyperspectral phasors and linear unmixing to create Hybrid Unmixing (HyU). HyU is efficient and robust, capable of quantitative signal separation even at low illumination levels. In dynamic imaging of developing zebrafish embryos and in mouse tissue, HyU was able to cleanly and efficiently unmix multiple fluorescent labels, even in demanding volumetric timelapse imaging settings. HyU permits high dynamic range imaging, allowing simultaneous imaging of bright exogenous labels and dim endogenous labels. This enables coincident studies of tagged components, cellular behaviors and cellular metabolism within the same specimen, providing more accurate insights into the orchestrated complexity of biological systems.

Advanced Fluorescence Microscopy Methods to Study Dynamics of Fluorescent Proteins In Vivo

Fluorescent proteins are standard tools for addressing biological questions in a cell biology laboratory. The genetic tagging of protein of interest with fluorescent proteins opens the opportunity to follow them in vivo and to understand their interactions and dynamics. In addition, the latest advances in optical microscopy image acquisition and processing allow us to study many cellular processes in vivo. Techniques such as fluorescence lifetime microscopy and hyperspectral imaging provide valuable tools for understanding fluorescent protein interactions and their photophysics. Finally, fluorescence fluctuation analysis opens the possibility to address questions of molecular diffusion, protein-protein interactions, and oligomerization, among others, yielding quantitative information on the subject of study. This chapter will cover some of the more important advances in cutting-edge technologies and methods that, combined with fluorescent proteins, open new frontiers for biological studies.

Retinal Organoids Long-Term Functional Characterization Using Two-Photon Fluorescence Lifetime and Hyperspectral Microscopy

Pluripotent stem cell-derived organoid technologies have opened avenues to preclinical basic science research, drug discovery, and transplantation therapy in organ systems. Stem cell-derived organoids follow a time course similar to species-specific organ gestation in vivo. However, heterogeneous tissue yields, and subjective tissue selection reduce the repeatability of organoid-based scientific experiments and clinical studies. To improve the quality control of organoids, we introduced a live imaging technique based on two-photon microscopy to non-invasively monitor and characterize retinal organoids’ (RtOgs’) long-term development. Fluorescence lifetime imaging microscopy (FLIM) was used to monitor the metabolic trajectory, and hyperspectral imaging was applied to characterize structural and molecular changes. We further validated the live imaging experimental results with endpoint biological tests, including quantitative polymerase chain reaction (qPCR), single-cell RNA sequencing, and immunohistochemistry. With FLIM results, we analyzed the free/bound nicotinamide adenine dinucleotide (f/b NADH) ratio of the imaged regions and found that there was a metabolic shift from glycolysis to oxidative phosphorylation. This shift occurred between the second and third months of differentiation. The total metabolic activity shifted slightly back toward glycolysis between the third and fourth months and stayed relatively stable between the fourth and sixth months. Consistency in organoid development among cell lines and production lots was examined. Molecular analysis showed that retinal progenitor genes were expressed in all groups between days 51 and 159. Photoreceptor gene expression emerged around the second month of differentiation, which corresponded to the shift in the f/b NADH ratio. RtOgs between 3 and 6 months of differentiation exhibited photoreceptor gene expression levels that were between the native human fetal and adult retina gene expression levels. The occurrence of cone opsin expression (OPN1 SW and OPN1 LW) indicated the maturation of photoreceptors in the fourth month of differentiation, which was consistent with the stabilized level of f/b NADH ratio starting from 4 months. Endpoint single-cell RNA and immunohistology data showed that the cellular compositions and lamination of RtOgs at different developmental stages followed those in vivo.

The Phasor Plot: A Universal Circle to Advance Fluorescence Lifetime Analysis and Interpretation

The phasor approach to fluorescence lifetime imaging has become a common method to analyze complicated fluorescence signals from biological samples. The appeal of the phasor representation of complex fluorescence decays in biological systems is that a visual representation of the decay of entire cells or tissues can be used to easily interpret fundamental biological states related to metabolism and oxidative stress. Phenotyping based on autofluorescence provides new avenues for disease characterization and diagnostics. The phasor approach is a transformation of complex fluorescence decays that does not use fits to model decays and therefore has the same information content as the original data. The phasor plot is unique for a given system, is highly reproducible, and provides a robust method to evaluate the existence of molecular interactions such as Förster resonance energy transfer or the response of ion indicators. Recent advances permitquantification of multiple components from phasor plots in fluorescence lifetime imaging microscopy, which is not presently possible using data fitting methods, especially in biological systems.

Phasor S-FLIM: a new paradigm for fast and robust spectral fluorescence lifetime imaging

Fluorescence lifetime imaging microscopy (FLIM) and spectral imaging are two broadly applied methods for increasing dimensionality in microscopy. However, their combination is typically inefficient and slow in terms of acquisition and processing. By integrating technological and computational advances, we developed a robust and unbiased spectral FLIM (S-FLIM) system. Our method, Phasor S-FLIM, combines true parallel multichannel digital frequency domain electronics with a multidimensional phasor approach to extract detailed and precise information about the photophysics of fluorescent specimens at optical resolution. To show the flexibility of the Phasor S-FLIM technology and its applications to the biological and biomedical field, we address four common, yet challenging, problems: the blind unmixing of spectral and lifetime signatures from multiple unknown species, the unbiased bleedthrough- and background-free Förster resonance energy transfer analysis of biosensors, the photophysical characterization of environment-sensitive probes in living cells and parallel four-color FLIM imaging in tumor spheroids.

Full-Harmonics Phasor Analysis: Unravelling Multiexponential Trends in Magnetic Resonance Imaging Data

Phasor analysis is a robust, nonfitting, method for the study of multiexponential decays in lifetime imaging data, routinely used in Fluorescence Lifetime Imaging Microscopy (FLIM) and only recently validated for Magnetic Resonance Imaging (MRI). In the established phasor approach, typically only the first Fourier harmonic is used to unravel time-domain exponential trends and their intercorrelations across image voxels. Here, we demonstrate the potential of full-harmonics (FH) phasor analysis by using all frequency-domain data points in simulations and quantitative MRI (qMRI) T₂ measurements of phantoms with bulk liquids or liquid-filled porous particles and of a human brain. We show that FH analysis, while of limited advantage in FLIM due to the correlated nature of shot noise, in MRI outperforms single-harmonic phasor in unravelling multiple physical environments and partial-volume effects otherwise undiscernible. We foresee application of FH phasor to, e.g., big-data analysis in qMRI of biological or other multiphase systems, where multiparameter fitting is unfeasible.

Pre-processing visualization of hyperspectral fluorescent data with Spectrally Encoded Enhanced Representations

Hyperspectral fluorescence imaging is gaining popularity for it enables multiplexing of spatio-temporal dynamics across scales for molecules, cells and tissues with multiple fluorescent labels. This is made possible by adding the dimension of wavelength to the dataset. The resulting datasets are high in information density and often require lengthy analyses to separate the overlapping fluorescent spectra. Understanding and visualizing these large multi-dimensional datasets during acquisition and pre-processing can be challenging. Here we present Spectrally Encoded Enhanced Representations (SEER), an approach for improved and computationally efficient simultaneous color visualization of multiple spectral components of hyperspectral fluorescence images. Exploiting the mathematical properties of the phasor method, we transform the wavelength space into information-rich color maps for RGB display visualization. We present multiple biological fluorescent samples and highlight SEER’s enhancement of specific and subtle spectral differences, providing a fast, intuitive and mathematical way to interpret hyperspectral images during collection, pre-processing and analysis.

Spectral phasor analysis allows unmixing fluorescence microscopy images, but it requires user involvement and has a limited number of labels that can be analyzed and displayed. Here the authors present a semi-automated solution to visualise multiple spectral components of hyperspectral fluorescence images, simultaneously.

Imaging, Visualization, and Computation in Developmental Biology

Embryonic development is highly complex and dynamic, requiring the coordination of numerous molecular and cellular events at precise times and places. Advances in imaging technology have made it possible to follow developmental processes at cellular, tissue, and organ levels over time as they take place in the intact embryo. Parallel innovations of in vivo probes permit imaging to report on molecular, physiological, and anatomical events of embryogenesis, but the resulting multidimensional data sets pose significant challenges for extracting knowledge. In this review, we discuss recent and emerging advances in imaging technologies, in vivo labeling, and data processing that offer the greatest potential for jointly deciphering the intricate cellular dynamics and the underlying molecular mechanisms. Our discussion of the emerging area of “image-omics” highlights both the challenges of data analysis and the promise of more fully embracing computation and data science for rapidly advancing our understanding of biology.

Application of Spectral Phasor analysis to sodium microenvironments in myoblast progenitor cells

Sodium ions (Na+) are key regulators of molecular events in many cellular processes, yet the dynamics of this ion remain poorly defined. Developing approaches to identify and characterise Na+ microenvironments will enable more detailed elucidation of the mechanisms of signal transduction. Here we report the application of Spectral Phasor analysis to the Na+ fluorophore, CoroNa Green, to identify and spatially map spectral emissions that report Na+ microenvironments. We use differentiating stem cells where Na+ fluxes were reported as an antecedent. Myoblast stem cells were induced to differentiate by serum starvation and then fixed at intervals between 0 and 40-minutes of differentiation prior to addition of CoroNa Green. The fluorescent intensity was insufficient to identify discrete Na+ microenvironments. However, using Spectral Phasor analysis we identified spectral shifts in CoroNa Green fluorescence which is related to the Na+ microenvironment. Further, spectral-heterogeneity appears to be contingent on the distance of Na+ from the nucleus in the early stages of differentiation. Spectral Phasor analysis of CoroNa Green in fixed stem cells demonstrates for the first time that CoroNa Green has unique spectral emissions depending on the nature of the Na+ environment in differentiating stem cells. Applying Spectral Phasor analysis to CoroNa Green in live stem cells is likely to further elucidate the role of Na+ microenvironments in the differentiation process.

Hyperspectral imaging in highly scattering media by the spectral phasor approach using two filters

Hyperspectral imaging is a common technique in fluorescence microscopy to obtain the emission spectrum at each pixel of an image. However, methods to obtain spectral resolution based on diffraction gratings or integrated prisms work poorly when the sample is strongly scattering. We developed a microscope named the DIVER that collects the fluorescence emission over a very large angle. Since the fluorescence light after passing through the multiple scattering sample is not collimated, the use of grating or prisms strongly limits the amount of light that can be used with available hyperspectral devices. Here we show that 2 filters that accept uncollimated light over a large aperture are sufficient to calculate the spectral phasor rather than displaying the entire spectrum. Using the properties of the spectral phasors, we can resolve spectral components and perform the type of data analyses that are usually performed in hyperspectral image analysis.

Multispectral analysis tools can increase utility of RGB color images in histology

Multispectral imaging (MSI) is increasingly finding application in the study and characterization of biological specimens. However, the methods typically used come with challenges on both the acquisition and the analysis front. MSI can be slow and photon-inefficient, leading to long imaging times and possible phototoxicity and photobleaching. The resulting datasets can be large and complex, prompting the development of a number of mathematical approaches for segmentation and signal unmixing. We show that under certain circumstances, just three spectral channels provided by standard color cameras, coupled with multispectral analysis tools, including a more recent spectral phasor approach, can efficiently provide useful insights. These findings are supported with a mathematical model relating spectral bandwidth and spectral channel number to achievable spectral accuracy. The utility of 3-band RGB and MSI analysis tools are demonstrated on images acquired using brightfield and fluorescence techniques, as well as a novel microscopy approach employing UV-surface excitation. Supervised linear unmixing, automated non-negative matrix factorization and phasor analysis tools all provide useful results, with phasors generating particularly helpful spectral display plots for sample exploration.

Structural and Functional Characterization of Human Stem-Cell-Derived Retinal Organoids by Live Imaging

Purpose

Human pluripotent stem cell (hPSC)-derived retinal organoids are a platform for investigating retinal development, pathophysiology, and cellular therapies. In contrast to histologic analysis in which multiple specimens fixed at different times are used to reconstruct developmental processes, repeated analysis of the same living organoids provides a more direct means to characterize changes. New live imaging modalities can provide insights into retinal organoid structure and metabolic function during in vitro growth. This study employed live tissue imaging to characterize retinal organoid development, including metabolic changes accompanying photoreceptor differentiation.

Methods

Live hPSC-derived retinal organoids at different developmental stages were examined for microanatomic organization and metabolic function by phase contrast microscopy, optical coherence tomography (OCT), fluorescence lifetime imaging microscopy (FLIM), and hyperspectral imaging (HSpec). Features were compared to those revealed by histologic staining, immunostaining, and microcomputed tomography (micro-CT) of fixed organoid tissue.

Results

We used FLIM and HSpec to detect changes in metabolic activity as organoids differentiated into organized lamellae. FLIM detected increased glycolytic activity and HSpec detected retinol and retinoic acid accumulation in the organoid outer layer, coinciding with photoreceptor genesis. OCT enabled imaging of lamellae formed during organoid maturation. Micro-CT revealed three-dimensional structure, but failed to detect lamellae.

Conclusions

Live imaging modalities facilitate real-time and nondestructive imaging of retinal organoids as they organize into lamellar structures. FLIM and HSpec enable rapid detection of lamellar structure and photoreceptor metabolism. Live imaging techniques may aid in the continuous evaluation of retinal organoid development in diverse experimental and cell therapy settings.

Phasor Analysis of Local ICS Detects Heterogeneity in Size and Number of Intracellular Vesicles

Organelles represent the scale of organization immediately below that of the cell itself, and their composition, size, and number are tailored to their function. Monitoring the size and number of organelles in live cells is relevant for many applications but can be challenging due to their highly heterogeneous properties. Image correlation spectroscopy is a well-established analysis method capable of extracting the average size and number of particles in images. However, when image correlation spectroscopy is applied to a highly heterogeneous system, it can fail to retrieve, from a single correlation function, the characteristic size and the relative amount associated to each subspecies. Here, we describe a fast, unbiased, and fit-free algorithm based on the phasor analysis of multiple local image correlation functions, capable of mapping the sizes of elements contained in a heterogeneous system. The method correctly provides the size and number of separate subspecies, which otherwise would be hidden in the average properties of a single correlation function. We apply the method to quantify the spatial and temporal heterogeneity in the size and number of intracellular vesicles formed after endocytosis in live cells.

Hyperspectral phasor analysis enables multiplexed 5D in vivo imaging

Time-lapse imaging of multiple labels is challenging for biological imaging as noise, photobleaching and phototoxicity compromise signal quality, while throughput can be limited by processing time. Here, we report software called Hyper-Spectral Phasors (HySP) for denoising and unmixing multiple spectrally overlapping fluorophores in a low signal-to-noise regime with fast analysis. We show that HySP enables unmixing of seven signals in time-lapse imaging of living zebrafish embryos.

Phasor plotting with frequency-domain flow cytometry

Interest in time resolved flow cytometry is growing. In this paper, we collect time-resolved flow cytometry data and use it to create polar plots showing distributions that are a function of measured fluorescence decay rates from individual fluorescently-labeled cells and fluorescent microspheres. Phasor, or polar, graphics are commonly used in fluorescence lifetime imaging microscopy (FLIM). In FLIM measurements, the plotted points on a phasor graph represent the phase-shift and demodulation of the frequency-domain fluorescence signal collected by the imaging system for each image pixel. Here, we take a flow cytometry cell counting system, introduce into it frequency-domain optoelectronics, and process the data so that each point on a phasor plot represents the phase shift and demodulation of an individual cell or particle. In order to demonstrate the value of this technique, we show that phasor graphs can be used to discriminate among populations of (i) fluorescent microspheres, which are labeled with one fluorophore type; (ii) Chinese hamster ovary (CHO) cells labeled with one and two different fluorophore types; and (iii) Saccharomyces cerevisiae cells that express combinations of fluorescent proteins with different fluorescence lifetimes. The resulting phasor plots reveal differences in the fluorescence lifetimes within each sample and provide a distribution from which we can infer the number of cells expressing unique single or dual fluorescence lifetimes. These methods should facilitate analysis time resolved flow cytometry data to reveal complex fluorescence decay kinetics.

Sorting of Single Biomolecules based on Fourier Polar Representation of Surface Enhanced Raman Spectra

Surface enhanced Raman scattering (SERS) spectroscopy becomes increasingly used in biosensors for its capacity to detect and identify single molecules. In practice, a large number of SERS spectra are acquired and reliable ranking methods are thus essential for analysing all these data. Supervised classification strategies, which are the most effective methods, are usually applied but they require pre-determined models or classes. In this work, we propose to sort SERS spectra in unknown groups with an alternative strategy called Fourier polar representation. This non-fitting method based on simple Fourier sine and cosine transforms produces a fast and graphical representation for sorting SERS spectra with quantitative information. The reliability of this method was first investigated theoretically and numerically. Then, its performances were tested on two concrete biological examples: first with single amino-acid molecule (cysteine) and then with a mixture of three distinct odorous molecules. The benefits of this Fourier polar representation were highlighted and compared to the well-established statistical principal component analysis method.

Imaging the Cell and Molecular Dynamics of Craniofacial Development: Challenges and New Opportunities in Imaging Developmental Tissue Patterning

The development of the vertebrate head requires cell-cell and tissue-tissue interactions between derivatives of the three germ layers to coordinate morphogenetic movements in four dimensions (4D: x, y, z, t). The high spatial and temporal resolution offered by optical microscopy has made it the main imaging modularity for capturing the molecular and cellular dynamics of developmental processes. In this chapter, we highlight the challenges and new opportunities provided by emerging technologies that enable dynamic, high-information-content imaging of craniofacial development. We discuss the challenges of varying spatial and temporal scales encountered from the biological and technological perspectives. We identify molecular and fluorescence imaging technology that can provide solutions to some of the challenges. Application of the techniques described within this chapter combined with considerations of the biological and technical challenges will aid in formulating the best image-based studies to extend our understanding of the genetic and environmental influences underlying craniofacial anomalies.

Spectral properties and dynamics of gold nanorods revealed by EMCCD-based spectral phasor method

Gold nanorods (NRs) with tunable plasmon-resonant absorption in the near-infrared region have considerable advantages over organic fluorophores as imaging agents due to their brightness and lack of photobleaching. However, the luminescence spectral properties of NRs have not been fully characterized at the single particle level due to lack of proper analytic tools. Here, we present a spectral phasor analysis method that allows investigations of NRs' spectra at single particle level showing the spectral variance and providing spatial information during imaging. The broad phasor distribution obtained by the spectral phasor analysis indicates that spectra of NRs are different from particle to particle. NRs with different spectra can be identified in images with high spectral resolution. The spectral behaviors of NRs under different imaging conditions, for example, different excitation powers and wavelengths, were revealed by our laser-scanning multiphoton microscope using a high-resolution spectrograph with imaging capability. Our results prove that the spectral phasor method is an easy and efficient tool in hyper-spectral imaging analysis to unravel subtle changes of the emission spectrum. We applied this method to study the spectral dynamics of NRs during direct optical trapping and by optothermal trapping. Interestingly, different spectral shifts were observed in both trapping phenomena.