Restoration of metabolic functional metrics from label-free, two-photon human tissue images using multiscale deep-learning-based denoising algorithms

Significance

Label-free, two-photon excited fluorescence (TPEF) imaging captures morphological and functional metabolic tissue changes and enables enhanced understanding of numerous diseases. However, noise and other artifacts present in these images severely complicate the extraction of biologically useful information.

Aim

We aim to employ deep neural architectures in the synthesis of a multiscale denoising algorithm optimized for restoring metrics of metabolic activity from low-signal-to-noise ratio (SNR), TPEF images.

Approach

TPEF images of reduced nicotinamide adenine dinucleotide (phosphate) (NAD(P)H) and flavoproteins (FAD) from freshly excised human cervical tissues are used to assess the impact of various denoising models, preprocessing methods, and data on metrics of image quality and the recovery of six metrics of metabolic function from the images relative to ground truth images.

Results

Optimized recovery of the redox ratio and mitochondrial organization is achieved using a novel algorithm based on deep denoising in the wavelet transform domain. This algorithm also leads to significant improvements in peak-SNR (PSNR) and structural similarity index measure (SSIM) for all images. Interestingly, other models yield even higher PSNR and SSIM improvements, but they are not optimal for recovery of metabolic function metrics.

Conclusions

Denoising algorithms can recover diagnostically useful information from low SNR label-free TPEF images and will be useful for the clinical translation of such imaging.

Quantitative Assessment of Hepatic Steatosis Using Label-Free Multiphoton Imaging and Customized Image Processing Program

Nonalcoholic fatty liver disease is rapidly becoming one of the most common causes of chronic liver disease worldwide and is the leading cause of liver-related morbidity and mortality. A quantitative assessment of the degree of steatosis would be more advantageous for diagnostic evaluation and exploring the patterns of disease progression. Here, multiphoton microscopy, based on the second harmonic generation and 2-photon excited fluorescence, was used to label-free image the samples of nonalcoholic fatty liver. Imaging results confirm that multiphoton microscopy is capable of directly visualizing important pathologic features such as normal hepatocytes, hepatic steatosis, Mallory bodies, necrosis, inflammation, collagen deposition, microvessel, and so on and is a reliable auxiliary tool for the diagnosis of nonalcoholic fatty liver disease. Furthermore, we developed an image segmentation algorithm to simultaneously assess hepatic steatosis and fibrotic changes, and quantitative results reveal that there is a correlation between the degree of steatosis and collagen content. We also developed a feature extraction program to precisely display the spatial distribution of hepatocyte steatosis in tissues. These studies may be beneficial for a better clinical understanding of the process of steatosis as well as for exploring possible therapeutic targets.

Strongly Emitting Folic Acid-Derived Carbon Nanodots for One- and Two-Photon Imaging of Lyotropic Myelin Figures

Non-invasive imaging of morphological changes in biologically relevant lipidic mesophases is essential for the understanding of membrane-mediated processes. However, its methodological aspects need to be further explored, with particular attention paid to the design of new excellent fluorescent probes. Here, we have demonstrated that bright and biocompatible folic acid-derived carbon nanodots (FA CNDs) may be successfully applied as fluorescent markers in one- and two-photon imaging of bioinspired myelin figures (MFs). Structural and optical properties of these new FA CNDs were first extensively characterized; they revealed remarkable fluorescence performance in linear and non-linear excitation regimes, justifying further applications. Then, confocal fluorescence microscopy and two-photon excited fluorescence microscopy were used to investigate a three-dimensional distribution of FA CNDs within the phospholipid-based MFs. Our results showed that FA CNDs are effective markers for imaging various forms and parts of multilamellar microstructures.

Label-Free Optical Metabolic Imaging in Cells and Tissues

Over the last half century, the autofluorescence of the metabolic cofactors NADH (reduced nicotinamide adenine dinucleotide) and FAD (flavin adenine dinucleotide) has been quantified in a variety of cell types and disease states. With the spread of nonlinear optical microscopy techniques in biomedical research, NADH and FAD imaging has offered an attractive solution to noninvasively monitor cell and tissue status and elucidate dynamic changes in cell or tissue metabolism. Various tools and methods to measure the temporal, spectral, and spatial properties of NADH and FAD autofluorescence have been developed. Specifically, an optical redox ratio of cofactor fluorescence intensities and NADH fluorescence lifetime parameters have been used in numerous applications, but significant work remains to mature this technology for understanding dynamic changes in metabolism. This article describes the current understanding of our optical sensitivity to different metabolic pathways and highlights current challenges in the field. Recent progress in addressing these challenges and acquiring more quantitative information in faster and more metabolically relevant formats is also discussed.

Quantitative characterization of duodenal gastrinoma autofluorescence using multiphoton microscopy

BACKGROUND

Duodenal gastrinomas (DGASTs) are neuroendocrine tumors that develop in the submucosa of the duodenum and produce the hormone gastrin. Surgical resection of DGASTs is complicated by the small size of these tumors and the tendency for them to develop diffusely in the duodenum. Endoscopic mucosal resection of DGASTs is an increasingly popular method for treating this disease due to its low complication rate but suffers from poor rates of pathologically negative margins. Multiphoton microscopy can capture high-resolution images of biological tissue with contrast generated from endogenous fluorescence (autofluorescence [AF]) through two-photon excited fluorescence (2PEF). Second harmonic generation is another popular method of generating image contrast with multiphoton microscopy (MPM) and is a light-scattering phenomenon that occurs predominantly from structures such as collagen in biological samples. Some molecules that contribute to AF change in abundance from processes related to the cancer disease process (e.g., metabolic changes, oxidative stress, and angiogenesis).

STUDY DESIGN/MATERIALS AND METHODS

MPM was used to image 12 separate patient samples of formalin-fixed and paraffin-embedded duodenal gastrinoma slides with a second-harmonic generation (SHG) channel and four 2PEF channels. The excitation and emission profiles of each 2PEF channel were tuned to capture signal dominated by distinct fluorophores with well-characterized fluorescent spectra and known connections to the physiologic changes that arise in cancerous tissue.

RESULTS

We found that there was a significant difference in the relative abundance of signal generated in the 2PEF channels for regions of DGASTs in comparison to the neighboring tissues of the duodenum. Data generated from texture feature extraction of the MPM images were used in linear discriminant analysis models to create classifiers for tumor versus all other tissue types before and after principal component analysis (PCA). PCA improved the classifier accuracy and reduced the number of features required to achieve maximum accuracy. The linear discriminant classifier after PCA distinguished between tumor and other tissue types with an accuracy of 90.6%-93.8%.

CONCLUSIONS

These results suggest that multiphoton microscopy 2PEF and SHG imaging is a promising label-free method for discriminating between DGASTs and normal duodenal tissue which has implications for future applications of in vivo assessment of resection margins with endoscopic MPM.

Super-resolution re-scan second harmonic generation microscopy

Second harmonic generation microscopy (SHG) is generally acknowledged as a powerful tool for the label-free three-dimensional visualization of tissues and advanced materials, with one of its most popular applications being collagen imaging. Despite the great need, progress in super-resolved SHG imaging lags behind the developments reported over the past years in fluorescence-based optical nanoscopy. In this work, we demonstrate super-resolved re-scan SHG, qualitatively and quantitatively showing on collagenous tissues the available resolution advantage over the diffraction limit. We introduce as well super-resolved re-scan two-photon excited fluorescence microscopy, an imaging modality not explored to date.

Non-toxic Polymeric Dots with the Strong Protein-Driven Enhancement of One- and Two-Photon Excited Emission for Sensitive and Non-destructive Albumin Sensing

The need for efficient probing, sensing, and control of the bioactivity of biomolecules (e.g., albumins) has led to the engineering of new fluorescent albumins' markers fulfilling very specific chemical, physical, and biological requirements. Here, we explore acetone-derived polymer dots (PDs) as promising candidates for albumin probes, with special attention paid to their cytocompatibility, two-photon absorption properties, and strong ability to non-destructively interact with serum albumins. The PDs show no cytotoxicity and exhibit high photostability. Their pronounced green fluorescence is observed upon both one-photon excitation (OPE) and two-photon excitation (TPE). Our studies show that both OPE and TPE emission responses of PDs are proteinaceous environment-sensitive. The proteins appear to constitute a matrix for the dispersion of fluorescent PDs, limiting both their aggregation and interactions with the aqueous environment. It results in a large enhancement of PD fluorescence. Meanwhile, the PDs do not interfere with the secondary protein structures of albumins, nor do they induce their aggregation, enabling the PD candidates to be good nanomarkers for non-destructive probing and sensing of albumins.

In-vivo two-photon visualization and quantitative detection of redox state of cancer

Glutathione (GSH), the most common and abundant antioxidant in the body, is particularly concentrated in cancer cells (2-10 mM). This concentration is approximately 1000 times that of normal cells, making GSH a specific tumor marker. Overexpression of GSH is critical for mapping the redox state of cancer cells. However, there are few probes and detection methods responsive to GSH that can quantitatively visualize GSH in vivo in two-photon excitation fluorescence (TPEF) imaging mode. The experimental results show that TPEF-GSH could not only target GSH in tumors, but also establish the quantitative relationship between TPEF signal and GSH concentration. We explored the optimal two-photon excitation wavelength of TPEF-GSH, the optimal cell incubation duration with TPEF-GSH, the best imaging time point for GSH in cells, and the quantitative relationship between the TPEF signal and the changes in GSH concentrations. In zebrafish embryo and zebrafish experiments, the ratiometric value of TPEF-GSH increased with the decrease of GSH concentration. Microinjection and co-incubation were used to verify whether the ratiometric value could quantify endogenous GSH in tumor-bearing zebrafish, and the obtained GSH levels were 4.66 mM and 5.16 mM, respectively. The ratio TPEF probe could accurately visualize and quantify GSH in vivo, reflecting the redox status of the tumor. The design of the ratiometric molecular probe provides a reliable strategy for the development of TPEF nanoprobe in vivo. In this article, a new GSH sensitive molecular probe, TPEF-GSH, has been developed with good specificity and sensitivity. TPEF-GSH was successfully used to image cancer cells in vitro and tumor-bearing zebrafish in vivo, and to further detect GSH levels.

Assessment of Extramammary Paget Disease by Two-Photon Microscopy

Two-photon microscopy techniques are non-linear optical imaging methods which are gaining momentum in the investigation of fixed tissue sections, fresh tissue or even for in vivo experiments. Two-photon excited fluorescence and second harmonic generation are two non-linear optical contrast mechanisms which can be simultaneously used for offering complementary information on the tissue architecture. While the former can originate from endogenous autofluorescence sources (e.g., NADH, FAD, elastin, keratin, lipofuscins, or melanin), or exogenous eosin, the latter is generated in fibrillar structures within living organisms (e.g., collagen and myosin). Here we test the ability of both these contrast mechanisms to highlight features of the extramammary Paget disease on fixed tissue sections prepared for standard histological examination using immunohistochemical markers and hematoxylin and eosin staining. We also demonstrate the label-free abilities of both imaging techniques to highlight histological features on unstained fixed tissue sections. The study demonstrated that two-photon microscopy can detect specific cellular features of the extramammary Paget disease in good correlation with histopathological results.

Multipolar Porphyrin-Triazatruxene Arrays for Two-Photon Fluorescence Cell Imaging

Two-photon excited fluorescent (TPEF) materials are highly desirable for bioimaging applications owing to their unique characteristics of deep-tissue penetration and high spatiotemporal resolution. Herein, by connecting one, two, or three electron-deficient zinc porphyrin units to an electron-rich triazatruxene core via ethynyl π-bridges, conjugated multipolar molecules TAT-(ZnP)_n (n=1-3) were developed as TPEF materials for cell imaging. The three new dyes present high fluorescence quantum yields (0.40-0.47) and rationally improved two-photon absorption (TPA) properties. In particular, the peak TPA cross section of TAT-ZnP (436 GM) is significantly larger than that of the ZnP reference (59 GM). The δ_TPA values of TAT-(ZnP)₂ and TAT-(ZnP)₃ further increase to 1031 and up to 1496 GM, respectively, indicating the effect of incorporated ZnP units on the TPA properties. The substantial improvement of the TPEF properties is attributed to the formation of π-conjugated quadrapole/octupole molecules and the extension of D-π-A-D systems, which has been rationalized by density function theory (DFT) calculations. Moreover, all of the three new dyes display good biocompatibility and preferential targeting ability toward cytomembrane, thus can be superior candidates for TPEF imaging of living cells. Overall, this work demonstrated a promising strategy for the development of porphyrin-based TPEF materials by the construction and extension of D-π-A-D multipolar array.

In vivo multiphoton imaging for non-invasive time course assessment of retinoids effects on human skin

Background

In vivo multiphoton imaging and automatic 3D image processing tools provide quantitative information on human skin constituents. These multiphoton‐based tools allowed evidencing retinoids epidermal effects in the occlusive patch test protocol developed for antiaging products screening. This study aimed at investigating their relevance for non‐invasive, time course assessment of retinoids cutaneous effects under real‐life conditions for one year.

Materials and Methods

Thirty women, 55‐65 y, applied either retinol (RO 0.3%) or retinoic acid (RA 0.025%) on one forearm dorsal side versus a control product on the other forearm once a day for 1 year. In vivo multiphoton imaging was performed every three months, and biopsies were taken after 1 year. Epidermal thickness and dermal‐epidermal junction undulation were estimated in 3D with multiphoton and in 2D with histology, whereas global melanin density and its z‐epidermal distribution were estimated using 3D multiphoton image processing tools.

Results

Main results after one year were as follows: a) epidermal thickening with RO (+30%); b) slight increase in dermal‐epidermal junction undulation with RO; c) slight decrease in 3D melanin density with RA; d) limitation of the melanin ascent observed with seasonality and time within supra‐basal layers with both retinoids, using multiphoton 3D‐melanin z‐epidermal profile.

Conclusions

With a novel 3D descriptor of melanin z‐epidermal distribution, in vivo multiphoton imaging allows demonstrating that daily usage of retinoids counteracts aging by acting not only on epidermal morphology, but also on melanin that is shown to accumulate in the supra‐basal layers with time.

Nonlinear Optical Pigments. Two-Photon Absorption in Crosslinked Conjugated Polymers and Prospects for Remote Nonlinear Optical Thermometry

Nonlinear optical (NLO) pigments are compounds insoluble in solvents that exhibit phenomena related to nonlinear optical susceptibilities (χ(n) where n = 2,3,...), e.g., two-photon absorption (2PA) which is related to the imaginary part of χ(3). Determination of spectrally-resolved 2PA properties for NLO pigments of macromolecular nature, such as coordination polymers or crosslinked polymers, has long been a challenging issue due to their particulate form, precluding characterizations with standard techniques such as Z-scan. In this contribution, we investigate thus far unknown spectrally-resolved 2PA properties of a new subclass of NLO pigments-crosslinked conjugated polymers. The studied compounds are built up from electron-donating (triphenylamine) and electron-withdrawing (2,2'-bipyridine) structural fragments joined by vinylene (Pol1) or vinyl(4-ethynylphenyl) (Pol2) aromatic bridges. 2PA properties of these polymers have been characterized in broad spectral range by specially modified two-photon excited fluorescence (TPEF) techniques: solid state TPEF (SSTPEF) and internal standard TPEF (ISTPEF). The impact of self-aggregation of aromatic backbones on the 2PA properties of the polymers has been evaluated through extended comparisons of NLO parameters, i.e., 2PA cross sections (σ2) and molar-mass normalized 2PA merit factors (σ2/M) with those of small-molecular model compounds: Mod1 and Mod2. By doing this, we found that the 2PA response of Pol1 and Pol2 is improved 2-3 times versus respective model compounds in the solid state form. Further comparisons with 2PA results collected for diluted solutions of Mod1 and Mod2 supports the notion that self-aggregated structure contributes to the observed enhancement of 2PA response. On the other hand, it is clear that Pol1 and Pol2 suffer from aggregation-caused quenching phenomenon, well reflected in time-resolved fluorescence properties as well as in relatively low values of quantum yield of fluorescence. Accordingly, despite improved intrinsic 2PA response, the effective intensity of two-photon excited emission for Pol1 and Pol2 is slightly lower relative to Mod1 and Mod2. Finally, we explore temperature-resolved luminescence properties under one- (377 nm), two- (820 nm), and three-photon excitation (1020 nm) conditions of postsynthetically Eu3+-functionalized material, Pol1-Eu, and discuss its suitability for temperature sensing applications.

Optical changes in THP-1 macrophage metabolism in response to pro- and anti-inflammatory stimuli reported by label-free two-photon imaging

Temporal changes in macrophage metabolism are likely crucial to their role in inflammatory diseases. Label-free two-photon excited fluorescence (TPEF) and fluorescence lifetime imaging microscopy are well suited to track dynamic changes in macrophage metabolism. We performed TPEF imaging of human macrophages following either pro- or an anti-inflammatory stimulation. Two endogenous fluorophores, NAD(P)H and FAD, coenzymes involved in key metabolic pathways, provided contrast. We used the corresponding intensity images to determine the optical redox ratio of FAD to FAD + NAD(P)H. We also analyzed the intensity fluctuation patterns within NAD(P)H TPEF images to determine mitochondrial clustering patterns. Finally, we acquired NAD(P)H TPEF lifetime images to assess the relative levels of bound NAD(P)H. Our studies indicate that the redox ratio increases, whereas mitochondrial clustering decreases in response to both pro- and anti-inflammatory stimuli; however, these changes are enhanced in pro-inflammatory macrophages. Interestingly, we did not detect any significant changes in the corresponding NAD(P)H bound fraction. A combination of optical metabolic metrics could be used to classify pro- and anti-inflammatory macrophages with high accuracy. Contributions from alterations in different metabolic pathways may explain our findings, which highlight the potential of label-free two-photon imaging to assess nondestructively macrophage functional state.

Automated label-free detection of injured neuron with deep learning by two-photon microscopy

Stroke is a significant cause of morbidity and long-term disability globally. Detection of injured neuron is a prerequisite for defining the degree of focal ischemic brain injury, which can be used to guide further therapy. Here, we demonstrate the capability of two-photon microscopy (TPM) to label-freely identify injured neurons on unstained thin section and fresh tissue of rat cerebral ischemia-reperfusion model, revealing definite diagnostic features compared with conventional staining images. Moreover, a deep learning model based on convolutional neural network is developed to automatically detect the location of injured neurons on TPM images. We then apply deep learning-assisted TPM to evaluate the ischemic regions based on tissue edema, two-photon excited fluorescence signal intensity, as well as neuronal injury, presenting a novel manner for identifying the infarct core, peri-infarct area, and remote area. These results propose an automated and label-free method that could provide supplementary information to augment the diagnostic accuracy, as well as hold the potential to be used as an intravital diagnostic tool for evaluating the effectiveness of drug interventions and predicting potential therapeutics.

The Effect of Branching on the One- and Two-Photon Absorption, Cell Viability, and Localization of Cationic Triarylborane Chromophores with Dipolar versus Octupolar Charge Distributions for Cellular Imaging

Two different chromophores, namely a dipolar and an octupolar system, were prepared and their linear and nonlinear optical properties as well as their bioimaging capabilities were compared. Both contain triphenylamine as the donor and a triarylborane as the acceptor, the latter modified with cationic trimethylammonio groups to provide solubility in aqueous media. The octupolar system exhibits a much higher two-photon brightness, and also better cell viability and enhanced selectivity for lysosomes compared with the dipolar chromophore. Furthermore, both dyes were applied in two-photon excited fluorescence (TPEF) live-cell imaging.

Rapid, label-free detection of intracranial germinoma using multiphoton microscopy

Accurate histopathological diagnosis is essential for facilitating the optimal surgical management of intracranial germinoma. Current intraoperative histological methods are time- and labor-intensive and often produce artifacts. Multiphoton microscopy (MPM) is a label-free imaging technique that can produce intraoperative histological images of fresh, unprocessed surgical specimens. We employ an MPM based on second-harmonic generation and two-photon excited fluorescence microscopy to image fresh, unfixed, and unstained human germinoma specimens. We show that label-free MPM is not only capable of identifying various cells in human germinoma tissue but also capable of revealing the characteristics of germinoma such as granuloma, stromal fibrosis, calcification, as well as the abnormal and uneven structures of blood vessels. In conjunction with custom-developed image-processing algorithms, MPM can further quantify and characterize the extent of stromal fibrosis and calcification. Our results provide insight into how MPM can deliver rapid diagnostic histological data that could inform the surgical management of intracranial germinoma.

Fractal dimension and directional analysis of elastic and collagen fiber arrangement in unsectioned arterial tissues affected by atherosclerosis and aging

Structural proteins like collagen and elastin are major constituents of the extracellular matrix (ECM). ECM degradation and remodeling in diseases significantly impact the microorganization of these structural proteins. Therefore, tracking the changes of collagen and elastin fiber morphological features within ECM impacted by disease progression could provide valuable insight into pathological processes such as tissue fibrosis and atherosclerosis. Benefiting from its intrinsic high-resolution imaging power and superior biochemical specificity, nonlinear optical microscopy (NLOM) is capable of providing information critical to the understanding of ECM remodeling. In this study, alterations of structural fibrillar proteins such as collagen and elastin in arteries excised from atherosclerotic rabbits were assessed by the combination of NLOM images and textural analysis methods such as fractal dimension (FD) and directional analysis (DA). FD and DA were tested for their performance in tracking the changes of extracellular elastin and fibrillar collagen remodeling resulting from atherosclerosis progression/aging. Although other methods of image analysis to study the organization of elastin and collagen structures have been reported, the simplified calculations of FD and DA presented in this work prove that they are viable strategies for extracting and analyzing fiber-related morphology from disease-impacted tissues. Furthermore, this study also demonstrates the potential utility of FD and DA in studying ECM remodeling caused by other pathological processes such as respiratory diseases, several skin conditions, or even cancer. NEW & NOTEWORTHY Textural analyses such as fractal dimension (FD) and directional analysis (DA) are straightforward and computationally viable strategies to extract fiber-related morphological data from optical images. Therefore, objective, quantitative, and automated characterization of protein fiber morphology in extracellular matrix can be realized by using these methods in combination with digital imaging techniques such as nonlinear optical microscopy (NLOM), a highly effective visualization tool for fibrillar collagen and elastic network. Combining FD and DA with NLOM is an innovative approach to track alterations of structural fibrillar proteins. The results illustrated in this study not only prove the effectiveness of FD and DA methods in extracellular protein characterization but also demonstrate their potential value in clinical and basic biomedical research where protein microstructure characterization is critical.

Fully convolutional networks in multimodal nonlinear microscopy images for automated detection of head and neck carcinoma: Pilot study

BACKGROUND

A fully convolutional neural networks (FCN)-based automated image analysis algorithm to discriminate between head and neck cancer and noncancerous epithelium based on nonlinear microscopic images was developed.

METHODS

Head and neck cancer sections were used for standard histopathology and co-registered with multimodal images from the same sections using the combination of coherent anti-Stokes Raman scattering, two-photon excited fluorescence, and second harmonic generation microscopy. The images analyzed with semantic segmentation using a FCN for four classes: cancer, normal epithelium, background, and other tissue types.

RESULTS

A total of 114 images of 12 patients were analyzed. Using a patch score aggregation, the average recognition rate and an overall recognition rate or the four classes were 88.9% and 86.7%, respectively. A total of 113 seconds were needed to process a whole-slice image in the dataset.

CONCLUSION

Multimodal nonlinear microscopy in combination with automated image analysis using FCN seems to be a promising technique for objective differentiation between head and neck cancer and noncancerous epithelium.

Metrology of Multiphoton Microscopes Using Second Harmonic Generation Nanoprobes

In multiphoton microscopy, the ongoing trend toward the use of excitation wavelengths spanning the entire near-infrared range calls for new standards in order to quantify and compare the performances of microscopes. This article describes a new method for characterizing the imaging properties of multiphoton microscopes over a broad range of excitation wavelengths in a straightforward and efficient manner. It demonstrates how second harmonic generation (SHG) nanoprobes can be used to map the spatial resolution, field curvature, and chromatic aberrations across the microscope field of view with a precision below the diffraction limit and with unique advantages over methods based on fluorescence. KTiOPO4 nanocrystals are used as SHG nanoprobes to measure and compare the performances over the 850-1100 nm wavelength range of several microscope objectives designed for multiphoton microscopy. Finally, this approach is extended to the post-acquisition correction of chromatic aberrations in multicolor multiphoton imaging. Overall, the use of SHG nanoprobes appears as a uniquely suited method to standardize the metrology of multiphoton microscopes.

A New Class of Lasing Materials: Intrinsic Stimulated Emission from Nonlinear Optically Active Metal-Organic Frameworks

Blue-color stimulated emission with low threshold power is observed from In- and Zn-MOFs, which feature a highly fluorescent chromophore densely packed and rigidly linked to the metal-ion centers in the solid state. The density-of-states and transition dipole moments are calculated and the stimulated emission phenomenon is correlated with these properties.

Label-free identification of the microstructure of rat spinal cords based on nonlinear optical microscopy

The spinal cord is a vital link between the brain and the body and mainly comprises neurons, glial cells and nerve fibres. In this work, nonlinear optical (NLO) microscopy based on intrinsic tissue properties was employed to label-freely analyze the cells and matrix in spinal cords at a molecular level. The high-resolution and high-contrast NLO images of unstained spinal cords demonstrate that NLO microscopy has the ability to show the microstructure of white and grey matter including ventral horn, intermediate area, dorsal horns, ventral column, lateral column and dorsal column. Neurons with various sizes were identified in grey matter by dark spots of nonfluorescent nuclei encircled by cytoplasm-emitting two-photon excited fluorescence signals. Nerve fibres and neuroglias were observed in white matter. Besides, the spinal arteries were clearly presented by NLO microscopy. Using spectral and morphological information, this technique was proved to be an effective tool for label-freely imaging spinal cord tissues, based on endogenous signals in biological tissue. With future development, we foresee promising applications of the NLO technique for in vivo, real-time assessment of spinal cord diseases or injures.

Ruthenium(II) Complex Incorporated UiO-67 Metal-Organic Framework Nanoparticles for Enhanced Two-Photon Fluorescence Imaging and Photodynamic Cancer Therapy

Ruthenium(II) tris(bipyridyl) cationic complex (Ru(bpy)₃²⁺) incorporated UiO-67 (Universitetet i Oslo) nanoscale metal-organic frameworks (NMOFs) with an average diameter of ∼92 nm were developed as theranostic nanoplatform for in vitro two-photon fluorescence imaging and photodynamic therapy. After incorporation into porous UiO-67 nanoparticles, the quantum yield, luminescence lifetime, and two-photon fluorescence intensity of Ru(bpy)₃²⁺ guest molecules were much improved owing to the steric confinement effect of MOF pores. Benefiting from these merits, the as-synthesized nanoparticles managed to be internalized by A549 cells while providing excellent red fluorescence in cytoplasm upon excitation with 880 nm irradiation. Photodynamic therapeutic application of the Ru(bpy)₃²⁺-incorporated UiO-67 NMOFs was investigated in vitro. The Ru(bpy)₃²⁺-incorporated UiO-67 NMOFs exhibited good biocompatibility without irradiation while having good cell-killing rates upon irradiation. In view of these facts, the developed Ru(bpy)₃²⁺-incorporated NMOFs give a new potential pathway to achieve enhanced two-photon fluorescence imaging and photodynamic therapy.

Label-free detection of fibrillar collagen deposition associated with vascular elements in glioblastoma multiforme by using multiphoton microscopy

Glioblastoma multiforme (GBM-WHO grade IV) is the most common and the most aggressive form of brain tumors in adults with the median survival of 10-12 months. The diagnostic detection of extracellular matrix (ECM) component in the tumour microenvironment is of prognostic value. In this paper, the fibrillar collagen deposition associated with vascular elements in GBM were investigated in the fresh specimens and unstained histological slices by using multiphoton microscopy (MPM) based on two-photon excited fluorescence (TPEF) and second harmonic generation (SHG). Our study revealed the existence of fibrillar collagen deposition in the adventitia of remodelled large blood vessels and in glomeruloid vascular structures in GBM. The degree of fibrillar collagen deposition can be quantitatively evaluated by measuring the adventitial thickness of blood vessels or calculating the ratio of SHG pixel to the whole pixel of glomeruloid vascular structure in MPM images. These results indicated that MPM can not only be employed to perform a retrospective study in unstained histological slices but also has the potential to apply for in vivo brain imaging to understand correlations between malignancy of gliomas and fibrillar collagen deposition.

Correlating two-photon excited fluorescence imaging of breast cancer cellular redox state with seahorse flux analysis of normalized cellular oxygen consumption

Two-photon excited fluorescence (TPEF) imaging of the cellular cofactors nicotinamide adenine dinucleotide and oxidized flavin adenine dinucleotide is widely used to measure cellular metabolism, both in normal and pathological cells and tissues. When dual-wavelength excitation is used, ratiometric TPEF imaging of the intrinsic cofactor fluorescence provides a metabolic index of cells—the “optical redox ratio” (ORR). With increased interest in understanding and controlling cellular metabolism in cancer, there is a need to evaluate the performance of ORR in malignant cells. We compare TPEF metabolic imaging with seahorse flux analysis of cellular oxygen consumption in two different breast cancer cell lines (MCF-7 and MDA-MB-231). We monitor metabolic index in living cells under both normal culture conditions and, for MCF-7, in response to cell respiration inhibitors and uncouplers. We observe a significant correlation between the TPEF-derived ORR and the flux analyzer measurements (R=0.7901, p<0.001). Our results confirm that the ORR is a valid dynamic index of cell metabolism under a range of oxygen consumption conditions relevant for cancer imaging.

Differentiating the extent of cartilage repair in rabbit ears using nonlinear optical microscopy

Nonlinear optical microscopy (NLOM) was used as a noninvasive and label-free tool to detect and quantify the extent of the cartilage recovery. Two cartilage injury models were established in the outer ears of rabbits that created a different extent of cartilage recovery based on the presence or absence of the perichondrium. High-resolution NLOM images were used to measure cartilage repair, specifically through spectral analysis and image texture. In contrast to a wound lacking a perichondrium, wounds with intact perichondria demonstrated significantly larger TPEF signals from cells and matrix, coarser texture indicating the more deposition of type I collagen. Spectral analysis of cells and matrix can reveal the matrix properties and cell growth. In addition, texture analysis of NLOM images showed significant differences in the distribution of cells and matrix of repaired tissues with or without perichondrium. Specifically, the decay length of autocorrelation coefficient based on TPEF images is 11.2 ± 1.1 in Wound 2 (with perichondrium) and 7.5 ± 2.0 in Wound 1 (without perichondrium), indicating coarser image texture and faster growth of cells in repaired tissues with perichondrium (p < 0.05). Moreover, the decay length of autocorrelation coefficient based on collagen SHG images also showed significant difference between Wound 2 and 1 (16.2 ± 1.2 vs. 12.2 ± 2.1, p < 0.05), indicating coarser image texture and faster deposition of collagen in repaired tissues with perichondrium (Wound 2). These findings suggest that NLOM is an ideal tool for studying cartilage repair, with potential applications in clinical medicine. NLOM can capture macromolecular details and distinguish between different extents of cartilage repair without the need for labelling agents.

In vivo measurements of cutaneous melanin across spatial scales: using multiphoton microscopy and spatial frequency domain spectroscopy

The combined use of nonlinear optical microscopy and broadband reflectance techniques to assess melanin concentration and distribution thickness in vivo over the full range of Fitzpatrick skin types is presented. Twelve patients were measured using multiphoton microscopy (MPM) and spatial frequency domain spectroscopy (SFDS) on both dorsal forearm and volar arm, which are generally sun-exposed and non-sun-exposed areas, respectively. Both MPM and SFDS measured melanin volume fractions between (skin type I non-sun-exposed) and 20% (skin type VI sun exposed). MPM measured epidermal (anatomical) thickness values ~30-65 μm, while SFDS measured melanin distribution thickness based on diffuse optical path length. There was a strong correlation between melanin concentration and melanin distribution (epidermal) thickness measurements obtained using the two techniques. While SFDS does not have the ability to match the spatial resolution of MPM, this study demonstrates that melanin content as quantified using SFDS is linearly correlated with epidermal melanin as measured using MPM (R² = 0.8895). SFDS melanin distribution thickness is correlated to MPM values (R² = 0.8131). These techniques can be used individually and/or in combination to advance our understanding and guide therapies for pigmentation-related conditions as well as light-based treatments across a full range of skin types.

Single Cell Assay for Molecular Diagnostics and Medicine: Monitoring Intracellular Concentrations of Macromolecules by Two-photon Fluorescence Lifetime Imaging

Molecular organization of a cell is dynamically transformed along the course of cellular physiological processes, pathologic developments or derived from interactions with drugs. The capability to measure and monitor concentrations of macromolecules in a single cell would greatly enhance studies of cellular processes in heterogeneous populations. In this communication, we introduce and experimentally validate a bio-analytical single-cell assay, wherein the overall concentration of macromolecules is estimated in specific subcellular domains, such as structure-function compartments of the cell nucleus as well as in nucleoplasm. We describe quantitative mapping of local biomolecular concentrations, either intrinsic relating to the functional and physiological state of a cell, or altered by a therapeutic drug action, using two-photon excited fluorescence lifetime imaging (FLIM). The proposed assay utilizes a correlation between the fluorescence lifetime of fluorophore and the refractive index of its microenvironment varying due to changes in the concentrations of macromolecules, mainly proteins. Two-photon excitation in Near-Infra Red biological transparency window reduced the photo-toxicity in live cells, as compared with a conventional single-photon approach. Using this new assay, we estimated average concentrations of proteins in the compartments of nuclear speckles and in the nucleoplasm at ~150 mg/ml, and in the nucleolus at ~284 mg/ml. Furthermore, we show a profound influence of pharmaceutical inhibitors of RNA synthesis on intracellular protein density. The approach proposed here will significantly advance theranostics, and studies of drug-cell interactions at the single-cell level, aiding development of personal molecular medicine.

Multi-channel beam-scanning imaging at kHz frame rates by Lissajous trajectory microscopy

A beam-scanning microscope based on Lissajous trajectory imaging is described for achieving streaming 2D imaging with continuous frame rates up to 1.4 kHz. The microscope utilizes two fast-scan resonant mirrors to direct the optical beam on a circuitous trajectory through the field of view. By separating the full Lissajous trajectory time-domain data into sub-trajectories (partial, undersampled trajectories) effective frame-rates much higher than the repeat time of the Lissajous trajectory are achieved with many unsampled pixels present. A model-based image reconstruction (MBIR) 3D in-painting algorithm is then used to interpolate the missing data for the unsampled pixels to recover full images. The MBIR algorithm uses a maximum a posteriori estimation with a generalized Gaussian Markov random field prior model for image interpolation. Because images are acquired using photomultiplier tubes or photodiodes, parallelization for multi-channel imaging is straightforward. Preliminary results show that when combined with the MBIR in-painting algorithm, this technique has the ability to generate kHz frame rate images across 6 total dimensions of space, time, and polarization for SHG, TPEF, and confocal reflective birefringence data on a multimodal imaging platform for biomedical imaging. The use of a multi-channel data acquisition card allows for multimodal imaging with perfect image overlay. Image blur due to sample motion was also reduced by using higher frame rates.

Multiphoton microscopic imaging of rabbit dorsal skin

Rabbits are often preferred to be experimental animals during the skin research. The visualizing and understanding the full-thickness structure of rabbit skin has significance in biology, medicine, and animal husbandry. In this study, multiphoton microscopy (MPM) was employed to examine the rabbit skin on the back, which was based on second harmonic generation and two-photon excited fluorescence. High-resolution images were achieved from the fresh, unfixed, and unstained tissues, showing detailed microstructure of the skin without the administration of exogenous contrast agents. The morphology and distribution of the main components of epidermis and dermis, such as keratin, collagen fibers, elastic fibers, and hair follicles, can be distinctly identified in MPM images. Since the changes in these components are tightly related to skin diseases and wound healing, the noninvasive nature of MPM enables it become a valuable tool in skin research for detecting and monitoring.

Organized chromophoric assemblies for nonlinear optical materials: towards (sub)wavelength scale architectures

Photonic circuits are expected to greatly contribute to the next generation of integrated chips, as electronic integrated circuits become confronted with bottlenecks such as heat generation and bandwidth limitations. One of the main challenges for the state-of-the-art photonic circuits lies in the development of optical materials with high nonlinear optical (NLO) susceptibilities, in particular in the wavelength and subwavelength dimensions which are compatible with on-chip technologies. In this review, the varied approaches to micro-/nanosized NLO materials based on building blocks of bio- and biomimetic molecules, as well as synthetic D-π-A chromophores, have been categorized as supramolecular self-assemblies, molecular scaffolds, and external force directed assemblies. Such molecular and supramolecular NLO materials have intrinsic advantages, such as structural diversities, high NLO susceptibilities, and clear structure-property relationships. These "bottom-up" fabrication approaches are proposed to be combined with the "top-down" techniques such as lithography, etc., to generate multifunctionality by coupling light and matter on the (sub)wavelength scale.

Multimodal Imaging Spectroscopy of Tissue

Advanced optical imaging technologies have experienced increased visibility in medical research, as they allow for a label-free and nondestructive investigation of tissue in either an excised state or living organisms. In addition to a multitude of ex vivo studies proving the applicability of these optical imaging approaches, a transfer of various modalities toward in vivo diagnosis is currently in progress as well. Furthermore, combining optical imaging techniques, referred to as multimodal imaging, allows for an improved diagnostic reliability due to the complementary nature of retrieved information. In this review, we provide a summary of ongoing multifold efforts in multimodal tissue imaging and focus in particular on in vivo applications for medical diagnosis. We also discuss the advantages and potential limitations of the imaging methods and outline opportunities for future developments.

Developing compact multiphoton systems using femtosecond fiber lasers

We implement a fiber-delivered compact femtosecond fiber laser at 1,030-nm wavelength in multiphoton imaging. The laser pulse duration is 150 fs, the average power is 200 mW, and the repetition rate is 40 MHz. The laser measures 200 x 160 x 45 mm in size and its output is delivered through a photonic bandgap fiber. Intrinsic second-harmonic generation signal is excited from rat tail tendon and human skin samples. Two-photon excited fluorescence signal is obtained from human skin tissues stained with exogenous fluorophore. Our results show that femtosecond fiber lasers at 1030-nm wavelength have significant potential in developing compact, all-fiber-based, portable multiphoton systems and endoscopes.

Effect of excitation wavelength on penetration depth in nonlinear optical microscopy of turbid media

We present a comparative study of two-photon excited fluorescence (TPEF) and second harmonic generation (SHG) imaging in turbid media at 800- and 1300-nm excitation. The depth-dependent decay of TPEF and SHG signals in turbid tissue phantoms is used to estimate the impact of light scattering on excitation intensity at each wavelength. A 50 to 80% increase in scattering length is observed using 1300-nm excitation, while peak TPEF emission intensity is obtained 10 to 20 microm beneath the surface for both sources. The increased penetration depth at 1300 nm is confirmed by TPEF and SHG microscopy of tissue phantoms composed of gelatin/microspheres and 3-D organotypic collagen-fibroblast cultures, respectively. Our results establish the feasibility of 1.3-microm excitation in nonlinear optical microscopy.