Intravital imaging by simultaneous label-free autofluorescence-multiharmonic microscopy

Perspectives on label-free microscopy of heterogeneous and dynamic biological systems

Significance

Advancements in label-free microscopy could provide real-time, non-invasive imaging with unique sources of contrast and automated standardized analysis to characterize heterogeneous and dynamic biological processes. These tools would overcome challenges with widely used methods that are destructive (e.g., histology, flow cytometry) or lack cellular resolution (e.g., plate-based assays, whole animal bioluminescence imaging).

Aim

This perspective aims to (1) justify the need for label-free microscopy to track heterogeneous cellular functions over time and space within unperturbed systems and (2) recommend improvements regarding instrumentation, image analysis, and image interpretation to address these needs.

Approach

Three key research areas (cancer research, autoimmune disease, and tissue and cell engineering) are considered to support the need for label-free microscopy to characterize heterogeneity and dynamics within biological systems. Based on the strengths (e.g., multiple sources of molecular contrast, non-invasive monitoring) and weaknesses (e.g., imaging depth, image interpretation) of several label-free microscopy modalities, improvements for future imaging systems are recommended.

Conclusion

Improvements in instrumentation including strategies that increase resolution and imaging speed, standardization and centralization of image analysis tools, and robust data validation and interpretation will expand the applications of label-free microscopy to study heterogeneous and dynamic biological systems.

Multimodal imaging of a liver-on-a-chip model using labelled and label-free optical microscopy techniques

A liver-on-a-chip model is an advanced complex in vitro model (CIVM) that incorporates different cell types and extracellular matrix to mimic the microenvironment of the human liver in a laboratory setting. Given the heterogenous and complex nature of liver-on-a-chip models, brightfield and fluorescence-based imaging techniques are widely utilized for assessing the changes occurring in these models with different treatment and environmental conditions. However, the utilization of optical microscopy techniques for structural and functional evaluation of the liver CIVMs have been limited by the reduced light penetration depth and lack of 3D information obtained using these imaging techniques. In this study, the potential of both labelled as well as label-free multimodal optical imaging techniques for visualization and characterization of the cellular and sub-cellular features of a liver-on-a-chip model was investigated. (1) Cellular uptake and distribution of Alexa 488 (A488)-labelled non-targeted and targeted antisense oligonucleotides (ASO and ASO-GalNAc) in the liver-on-a-chip model was determined using multiphoton microscopy. (2) Hyperspectral stimulated Raman scattering (SRS) microscopy of the C-H region was used to determine the heterogeneity of chemical composition of circular and cuboidal hepatocytes in the liver-on-a-chip model in a label-free manner. Additionally, the spatial overlap between the intracellular localization of ASO and lipid droplets was explored using simultaneous hyperspectral SRS and fluorescence microscopy. (3) The capability of light sheet fluorescence microscopy (LSFM) for full-depth 3D visualization of sub-cellular distribution of A488-ASO and cellular phenotypes in the liver-on-a-chip model was demonstrated. In summary, multimodal optical microscopy is a promising platform that can be utilized for visualization and quantification of 3D cellular organization, drug distribution and functional changes occurring in liver-on-a-chip models, and can provide valuable insights into liver biology and drug uptake mechanisms by enabling better characterization of these liver models.

Deep learning-based virtual staining, segmentation, and classification in label-free photoacoustic histology of human specimens

In pathological diagnostics, histological images highlight the oncological features of excised specimens, but they require laborious and costly staining procedures. Despite recent innovations in label-free microscopy that simplify complex staining procedures, technical limitations and inadequate histological visualization are still problems in clinical settings. Here, we demonstrate an interconnected deep learning (DL)-based framework for performing automated virtual staining, segmentation, and classification in label-free photoacoustic histology (PAH) of human specimens. The framework comprises three components: (1) an explainable contrastive unpaired translation (E-CUT) method for virtual H&E (VHE) staining, (2) an U-net architecture for feature segmentation, and (3) a DL-based stepwise feature fusion method (StepFF) for classification. The framework demonstrates promising performance at each step of its application to human liver cancers. In virtual staining, the E-CUT preserves the morphological aspects of the cell nucleus and cytoplasm, making VHE images highly similar to real H&E ones. In segmentation, various features (e.g., the cell area, number of cells, and the distance between cell nuclei) have been successfully segmented in VHE images. Finally, by using deep feature vectors from PAH, VHE, and segmented images, StepFF has achieved a 98.00% classification accuracy, compared to the 94.80% accuracy of conventional PAH classification. In particular, StepFF's classification reached a sensitivity of 100% based on the evaluation of three pathologists, demonstrating its applicability in real clinical settings. This series of DL methods for label-free PAH has great potential as a practical clinical strategy for digital pathology.

Predicting DNA damage response in non-small cell lung cancer organoids via simultaneous label-free autofluorescence multiharmonic microscopy

The DNA damage response (DDR) is a fundamental readout for evaluating efficacy of cancer therapeutics, many of which target DNA associated processes. Current techniques to evaluate DDR rely on immunostaining for phosphorylated histone H2AX (γH2AX), which is an indicator of DNA double-strand breaks. While γH2AX immunostaining can provide a snapshot of DDR in fixed cell and tissue samples, this method is technically cumbersome due to temporal monitoring of DDR requiring timepoint replicates, extensive assay development efforts for 3D cell culture samples such as organoids, and time-consuming protocols for γH2AX immunostaining and its evaluation. The goal of this current study is to reduce overall burden on assay duration and development in non-small cell lung cancer (NSCLC) organoids by leveraging label-free multiphoton imaging. In this study, simultaneous label-free autofluorescence multiharmonic (SLAM) microscopy was used to provide rich intracellular information based on endogenous contrasts. SLAM microscopy enables imaging of live samples eliminating the need to generate sacrificial sample replicates and has improved image acquisition in 3D space over conventional confocal microscopy. Predictive modeling between label-free SLAM microscopy and γH2AX immunostained images confirmed strong correlation between SLAM image features and γH2AX signal. Across multiple DNA targeting chemotherapeutics and multiple patient-derived NSCLC organoid lines, the optical redox ratio and third harmonic generation channels were used to robustly predict DDR. Imaging via SLAM microscopy can be used to more rapidly predict DDR in live 3D NSCLC organoids with minimal sample handling and without labeling.

An enhanced multimode phase imaging method based on the transport of intensity equation

Label-free biological cell imaging relies on rapid multimode phase imaging of biological samples in natural settings. To improve image contrast, phase is encoded into intensity information using the differential interference contrast (DIC) and Zernike phase contrast (ZPC) techniques. To enable multimode contrast-enhanced observation of unstained specimens, this paper proposes an improved multimode phase imaging method based on the transport of intensity equation (TIE), which combines conventional microscopy with computational imaging. The ZPC imaging module based on adaptive aperture adjustment is applied when the quantitative phase results of biological samples have been obtained by solving the TIE. Simultaneously, a rotationally symmetric shear-based technique is used that can yield isotropic DIC. In this paper, we describe numerical simulation and optical experiments carried out to validate the accuracy and viability of this technology. The calculated Michelson contrast of the ZPC image in the resolution plate experiment increased from 0.196 to 0.394.

Large field-of-view metabolic profiling of murine brain tissue following morphine incubation using label-free multiphoton microscopy

BACKGROUND

Although the effects on neural activation and glucose consumption caused by opiates such as morphine are known, the metabolic machinery underlying opioid use and misuse is not fully explored. Multiphoton microscopy (MPM) techniques have been developed for optical imaging at high spatial resolution. Despite the increased use of MPM for neural imaging, the use of intrinsic optical contrast has seen minimal use in neuroscience.

NEW METHOD

We present a label-free, multimodal microscopy technique for metabolic profiling of murine brain tissue following incubation with morphine sulfate (MSO4). We evaluate two- and three-photon excited autofluorescence, and second and third harmonic generation to determine meaningful intrinsic contrast mechanisms in brain tissue using simultaneous label-free, autofluorescence multi-harmonic (SLAM) microscopy.

RESULTS

Regional differences quantified in the cortex, caudate, and thalamus of the brain demonstrate region-specific changes to metabolic profiles measured from FAD intensity, along with brain-wide quantification. While the overall intensity of FAD signal significantly decreased after morphine incubation, this metabolic molecule accumulated near the nucleus accumbens.

COMPARISON WITH EXISTING METHODS

Histopathology requires tissue fixation and staining to determine cell type and morphology, lacking information about cellular metabolism. Tools such as fMRI or PET imaging have been widely used, but lack cellular resolution. SLAM microscopy obviates the need for tissue preparation, permitting immediate use and imaging of tissue with subcellular resolution in its native environment.

CONCLUSIONS

This study demonstrates the utility of SLAM microscopy for label-free investigations of neural metabolism, especially the intensity changes in FAD autofluorescence and structural morphology from third-harmonic generation.

Dispersion mismatch correction for evident chromatic anomaly in low coherence interferometry

The applications of ultrafast optics to biomedical microscopy have expanded rapidly in recent years, including interferometric techniques like optical coherence tomography and microscopy (OCT/OCM). The advances of ultra-high resolution OCT and the inclusion of OCT/OCM in multimodal systems combined with multiphoton microscopy have marked a transition from using pseudo-continuous broadband sources, such as superluminescent diodes, to ultrafast supercontinuum optical sources. We report anomalies in the dispersion profiles of low-coherence ultrafast pulses through long and non-identical arms of a Michelson interferometer that are well beyond group delay or third-order dispersions. This chromatic anomaly worsens the observed axial resolution and causes fringe artifacts in the reconstructed tomograms in OCT/OCM using traditional algorithms. We present DISpersion COmpensation Techniques for Evident Chromatic Anomalies (DISCOTECA) as a universal solution to address the problem of chromatic dispersion mismatch in interferometry, especially with ultrafast sources. First, we demonstrate the origin of these artifacts through the self-phase modulation of ultrafast pulses due to focusing elements in the beam path. Next, we present three solution paradigms for DISCOTECA: optical, optoelectronic, and computational, along with quantitative comparisons to traditional methods to highlight the improvements to the dynamic range and axial profile. We explain the piecewise reconstruction of the phase mismatch between the arms of the spectral-domain interferometer using a modified short-term Fourier transform algorithm inspired by spectroscopic OCT. Finally, we present a decision-making guide for evaluating the utility of DISCOTECA in interferometry and for the artifact-free reconstruction of OCT images using an ultrafast supercontinuum source for biomedical applications.

Inspiring a convergent engineering approach to measure and model the tissue microenvironment

Understanding the molecular and physical complexity of the tissue microenvironment (TiME) in the context of its spatiotemporal organization has remained an enduring challenge. Recent advances in engineering and data science are now promising the ability to study the structure, functions, and dynamics of the TiME in unprecedented detail; however, many advances still occur in silos that rarely integrate information to study the TiME in its full detail. This review provides an integrative overview of the engineering principles underlying chemical, optical, electrical, mechanical, and computational science to probe, sense, model, and fabricate the TiME. In individual sections, we first summarize the underlying principles, capabilities, and scope of emerging technologies, the breakthrough discoveries enabled by each technology and recent, promising innovations. We provide perspectives on the potential of these advances in answering critical questions about the TiME and its role in various disease and developmental processes. Finally, we present an integrative view that appreciates the major scientific and educational aspects in the study of the TiME.

Automated Whole Slide Imaging for Label-Free Histology Using Photon Absorption Remote Sensing Microscopy

OBJECTIVE

Pathologists rely on histochemical stains to impart contrast in thin translucent tissue samples, revealing tissue features necessary for identifying pathological conditions. However, the chemical labeling process is destructive and often irreversible or challenging to undo, imposing practical limits on the number of stains that can be applied to the same tissue section. Here we present an automated label-free whole slide scanner using a PARS microscope designed for imaging thin, transmissible samples.

METHODS

Peak SNR and in-focus acquisitions are achieved across entire tissue sections using the scattering signal from the PARS detection beam to measure the optimal focal plane. Whole slide images (WSI) are seamlessly stitched together using a custom contrast leveling algorithm. Identical tissue sections are subsequently H&E stained and brightfield imaged. The one-to-one WSIs from both modalities are visually and quantitatively compared.

RESULTS

PARS WSIs are presented at standard 40x magnification in malignant human breast and skin samples. We show correspondence of subcellular diagnostic details in both PARS and H&E WSIs and demonstrate virtual H&E staining of an entire PARS WSI. The one-to-one WSI from both modalities show quantitative similarity in nuclear features and structural information.

CONCLUSION

PARS WSIs are compatible with existing digital pathology tools, and samples remain suitable for histochemical, immunohistochemical, and other staining techniques.

SIGNIFICANCE

This work is a critical advance for integrating label-free optical methods into standard histopathology workflows.

Cholesterol Metabolite 27-Hydroxycholesterol Enhances the Secretion of Cancer Promoting Extracellular Vesicles by a Mitochondrial ROS-Induced Impairment of Lysosomal Function

Extracellular vesicles (EVs) serve as crucial mediators of cell-to-cell communication in normal physiology as well as in diseased states, and have been largely studied in regard to their role in cancer progression. However, the mechanisms by which their biogenesis and secretion are regulated by metabolic or endocrine factors remain unknown. Here, we delineate a mechanism by which EV secretion is regulated by a cholesterol metabolite, 27-Hydroxycholesterol (27HC), where treatment of myeloid immune cells (RAW 264.7 and J774A.1) with 27HC impairs lysosomal homeostasis, leading to shunting of multivesicular bodies (MVBs) away from lysosomal degradation, towards secretion as EVs. This impairment of lysosomal function is caused by mitochondrial dysfunction and subsequent increase in reactive oxygen species (ROS). Interestingly, cotreatment with a mitochondria-targeted antioxidant rescued the lysosomal impairment and attenuated the 27HC-mediated increase in EV secretion. Overall, our findings establish how a cholesterol metabolite regulates EV secretion and paves the way for the development of strategies to regulate cancer progression by controlling EV secretion.

Computer-Aided Multiphoton Microscopy Diagnosis of 5 Different Primary Architecture Subtypes of Meningiomas

Meningiomas rank among the most common intracranial tumors, and surgery stands as the primary treatment modality for meningiomas. The precise subtyping and diagnosis of meningiomas, both before and during surgery, play a pivotal role in enabling neurosurgeons choose the optimal surgical program. In this study, we utilized multiphoton microscopy (MPM) based on 2-photon excited fluorescence and second-harmonic generation to identify 5 common meningioma subtypes. The morphological features of these subtypes were depicted using the MPM multichannel mode. Additionally, we developed 2 distinct programs to quantify collagen content and blood vessel density. Furthermore, the lambda mode of the MPM characterized architectural and spectral features, from which 3 quantitative indicators were extracted. Moreover, we employed machine learning to differentiate meningioma subtypes automatically, achieving high classification accuracy. These findings demonstrate the potential of MPM as a noninvasive diagnostic tool for meningioma subtyping and diagnosis, offering improved accuracy and resolution compared with traditional methods.

Analog multiplexing of a laser clock and computational photon counting for fast fluorescence lifetime imaging microscopy

The dynamic range and fluctuations of fluorescence intensities and lifetimes in biological samples are large, demanding fast, precise, and versatile techniques. Among the high-speed fluorescence lifetime imaging microscopy (FLIM) techniques, directly sampling the output of analog single-photon detectors at GHz rates combined with computational photon counting can handle a larger range of photon rates. Traditionally, the laser clock is not sampled explicitly in fast FLIM; rather the detection is synchronized to the laser clock so that the excitation pulse train can be inferred from the cumulative photon statistics of several pixels. This has two disadvantages for sparse or weakly fluorescent samples: inconsistencies in inferring the laser clock within a frame and inaccuracies in aligning the decay curves from different frames for averaging. The data throughput is also very inefficient in systems with repetition rates much larger than the fluorescence lifetime due to significant silent regions where no photons are expected. We present a method for registering the photon arrival times to the excitation using time-domain multiplexing for fast FLIM. The laser clock is multiplexed with photocurrents into the silent region. Our technique does not add to the existing data bottleneck, has the sub-nanosecond dead time of computational photon counting based fast FLIM, works with various detectors, lasers, and electronics, and eliminates the errors in lifetime estimation in photon-starved conditions. We demonstrate this concept on two multiphoton setups of different laser repetition rates for single and multichannel FLIM multiplexed into a single digitizer channel for real-time imaging of biological samples.

Vibrational spectroscopy and multiphoton microscopy for label-free visualization of nervous system degeneration and regeneration

Neurological disorders, including spinal cord injury, peripheral nerve injury, traumatic brain injury, and neurodegenerative diseases, pose significant challenges in terms of diagnosis, treatment, and understanding the underlying pathophysiological processes. Label-free multiphoton microscopy techniques, such as coherent Raman scattering, two-photon excited autofluorescence, and second and third harmonic generation microscopy, have emerged as powerful tools for visualizing nervous tissue with high resolution and without the need for exogenous labels. Coherent Raman scattering processes as well as third harmonic generation enable label-free visualization of myelin sheaths, while their combination with two-photon excited autofluorescence and second harmonic generation allows for a more comprehensive tissue visualization. They have shown promise in assessing the efficacy of therapeutic interventions and may have future applications in clinical diagnostics. In addition to multiphoton microscopy, vibrational spectroscopy methods such as infrared and Raman spectroscopy offer insights into the molecular signatures of injured nervous tissues and hold potential as diagnostic markers. This review summarizes the application of these label-free optical techniques in preclinical models and illustrates their potential in the diagnosis and treatment of neurological disorders with a special focus on injury, degeneration, and regeneration. Furthermore, it addresses current advancements and challenges for bridging the gap between research findings and their practical applications in a clinical setting.

Temporally optimized and spectrally shaped hyperspectral coherent anti-Stokes Raman scattering microscopy

Coherent anti-Stokes Raman scattering (CARS) microscopy offers label-free chemical contrasts based on molecular vibrations. Hyperspectral CARS (HS-CARS) microscopy enables comprehensive microscale chemical characterization of biological samples. Various HS-CARS methods have been developed with individual advantages and disadvantages. We present what we believe to be a new temporally optimized and spectrally shaped (TOSS) HS-CARS method to overcome the limitations of existing techniques by providing precise control of the spatial and temporal profiles of the excitation beams for efficient and accurate measurements. This method uniquely uses Fourier transform pulse shaping based on a two-dimensional spatial light modulator to control the phase and amplitude of the excitation beams. TOSS-HS-CARS achieves fast, stable, and flexible acquisition, minimizes photodamage, and is highly adaptable to a multimodal multiphoton imaging system.

Label-free nonlinear optical signatures of extracellular vesicles in liquid and tissue biopsies of human breast cancer

Extracellular vesicles (EVs) have been implicated in metastasis and proposed as cancer biomarkers. However, heterogeneity and small size makes assessments of EVs challenging. Often, EVs are isolated from biofluids, losing spatial and temporal context and thus lacking the ability to access EVs in situ in their native microenvironment. This work examines the capabilities of label-free nonlinear optical microscopy to extract biochemical optical metrics of EVs in ex vivo tissue and EVs isolated from biofluids in cases of human breast cancer, comparing these metrics within and between EV sources. Before surgery, fresh urine and blood serum samples were obtained from human participants scheduled for breast tumor surgery (24 malignant, 6 benign) or healthy participants scheduled for breast reduction surgery (4 control). EVs were directly imaged both in intact ex vivo tissue that was removed during surgery and in samples isolated from biofluids by differential ultracentrifugation. Isolated EVs and freshly excised ex vivo breast tissue samples were imaged with custom nonlinear optical microscopes to extract single-EV optical metabolic signatures of NAD(P)H and FAD autofluorescence. Optical metrics were significantly altered in cases of malignant breast cancer in biofluid-derived EVs and intact tissue EVs compared to control samples. Specifically, urinary isolated EVs showed elevated NAD(P)H fluorescence lifetime in cases of malignant cancer, serum-derived isolated EVs showed decreased optical redox ratio in stage II cancer, but not earlier stages, and ex vivo breast tissue showed an elevated number of EVs in cases of malignant cancer. Results further indicated significant differences in the measured optical metabolic signature based on EV source (urine, serum and tissue) within individuals.

Spectral-temporal-spatial customization via modulating multimodal nonlinear pulse propagation

Multimode fibers (MMFs) are gaining renewed interest for nonlinear effects due to their high-dimensional spatiotemporal nonlinear dynamics and scalability for high power. High-brightness MMF sources with effective control of the nonlinear processes would offer possibilities in many areas from high-power fiber lasers, to bioimaging and chemical sensing, and to intriguing physics phenomena. Here we present a simple yet effective way of controlling nonlinear effects at high peak power levels. This is achieved by leveraging not only the spatial but also the temporal degrees of freedom during multimodal nonlinear pulse propagation in step-index MMFs, using a programmable fiber shaper that introduces time-dependent disorders. We achieve high tunability in MMF output fields, resulting in a broadband high-peak-power source. Its potential as a nonlinear imaging source is further demonstrated through widely tunable two-photon and three-photon microscopy. These demonstrations provide possibilities for technology advances in nonlinear optics, bioimaging, spectroscopy, optical computing, and material processing.

Compact simultaneous label-free autofluorescence multi-harmonic microscopy for user-friendly photodamage-monitored imaging

Significance

Label-free nonlinear optical microscopy has become a powerful tool for biomedical research. However, the possible photodamage risk hinders further clinical applications.

Aim

To reduce these adverse effects, we constructed a new platform of simultaneous label-free autofluorescence multi-harmonic (SLAM) microscopy, featuring four-channel multimodal imaging, inline photodamage monitoring, and pulse repetition-rate tuning.

Approach

Using a large-core birefringent photonic crystal fiber for spectral broadening and a prism compressor for pulse pre-chirping, this system allows users to independently adjust pulse width, repetition rate, and energy, which is useful for optimizing imaging conditions towards no/minimal photodamage.

Results

It demonstrates label-free multichannel imaging at one excitation pulse per image pixel and thus paves the way for improving the imaging speed by a faster optical scanner with a low risk of nonlinear photodamage. Moreover, the system grants users the flexibility to autonomously fine-tune repetition rate, pulse width, and average power, free from interference, ensuring the discovery of optimal imaging conditions with high SNR and minimal phototoxicity across various applications.

Conclusions

The combination of a stable laser source, independently tunable ultrashort pulse, photodamage monitoring features, and a compact design makes this new system a robust, powerful, and user-friendly imaging platform.

Fluorescence Microscopy with Deep UV, Near UV, and Visible Excitation for In Situ Detection of Microorganisms

We report a simple, inexpensive design of a fluorescence microscope with light-emitting diode (LED) excitation for detection of labeled and unlabeled microorganisms in mineral substrates. The use of deep UV (DUV) excitation with visible emission requires no specialized optics or slides and can be implemented easily and inexpensively using an oblique illumination geometry. DUV excitation (<280 nm) is preferable to near UV (365 nm) for avoidance of mineral autofluorescence. When excited with DUV, unpigmented bacteria show two emission peaks: one in the near UV ∼320 nm, corresponding to proteins, and another peak in the blue to green range, corresponding to flavins and/or reduced nicotinamide adenine dinucleotide (NADH). Many commonly used dyes also show secondary excitation peaks in the DUV, with identical emission spectra and quantum yields as their primary peak. However, DUV fails to excite key biosignature molecules, especially chlorophyll in cyanobacteria. Visible excitation (violet to blue) also results in less mineral autofluorescence than near UV, and most autofluorescence in the minerals seen here is green, so that red dyes and red autofluorescence of chlorophyll and porphyrins are readily distinguished. The pairing of DUV and near UV or visible excitation, with emission across the visible, represents the most thorough approach to detection of labeled and unlabeled bacteria in soil and rock.

A Pilot Validation Study Comparing Fluorescence-Imitating Brightfield Imaging, A Slide-Free Imaging Method, With Standard Formalin-Fixed, Paraffin-Embedded Hematoxylin-Eosin-Stained Tissue Section Histology for Primary Surgical Pathology Diagnosis

CONTEXT.—

Digital pathology using whole slide images has been recently approved to support primary diagnosis in clinical surgical pathology practices. Here we describe a novel imaging method, fluorescence-imitating brightfield imaging, that can capture the surface of fresh tissue without requiring prior fixation, paraffin embedding, tissue sectioning, or staining.

OBJECTIVE.—

To compare the ability of pathologists to evaluate direct-to-digital images with standard pathology preparations.

DESIGN.—

One hundred surgical pathology samples were obtained. Samples were first digitally imaged, then processed for standard histologic examination on 4-μm hematoxylin-eosin-stained sections and digitally scanned. The resulting digital images from both digital and standard scan sets were viewed by each of 4 reading pathologists. The data set consisted of 100 reference diagnoses and 800 study pathologist reads. Each study read was compared to the reference diagnosis, and also compared to that reader's diagnosis across both modalities.

RESULTS.—

The overall agreement rate, across 800 reads, was 97.9%. This consisted of 400 digital reads at 97.0% versus reference and 400 standard reads versus reference at 98.8%. Minor discordances (defined as alternative diagnoses without clinical treatment or outcome implications) were 6.1% overall, 7.2% for digital, and 5.0% for standard.

CONCLUSIONS.—

Pathologists can provide accurate diagnoses from fluorescence-imitating brightfield imaging slide-free images. Concordance and discordance rates are similar to published rates for comparisons of whole slide imaging to standard light microscopy of glass slides for primary diagnosis. It may be possible, therefore, to develop a slide-free, nondestructive approach for primary pathology diagnosis.

Virtual histological staining of unlabeled autopsy tissue

Traditional histochemical staining of post-mortem samples often confronts inferior staining quality due to autolysis caused by delayed fixation of cadaver tissue, and such chemical staining procedures covering large tissue areas demand substantial labor, cost and time. Here, we demonstrate virtual staining of autopsy tissue using a trained neural network to rapidly transform autofluorescence images of label-free autopsy tissue sections into brightfield equivalent images, matching hematoxylin and eosin (H&E) stained versions of the same samples. The trained model can effectively accentuate nuclear, cytoplasmic and extracellular features in new autopsy tissue samples that experienced severe autolysis, such as COVID-19 samples never seen before, where the traditional histochemical staining fails to provide consistent staining quality. This virtual autopsy staining technique provides a rapid and resource-efficient solution to generate artifact-free H&E stains despite severe autolysis and cell death, also reducing labor, cost and infrastructure requirements associated with the standard histochemical staining.

Probing delivery of a lipid nanoparticle encapsulated self-amplifying mRNA vaccine using coherent Raman microscopy and multiphoton imaging

The COVID-19 pandemic triggered the resurgence of synthetic RNA vaccine platforms allowing rapid, scalable, low-cost manufacturing, and safe administration of therapeutic vaccines. Self-amplifying mRNA (SAM), which self-replicates upon delivery into the cellular cytoplasm, leads to a strong and sustained immune response. Such mRNAs are encapsulated within lipid nanoparticles (LNPs) that act as a vehicle for delivery to the cell cytoplasm. A better understanding of LNP-mediated SAM uptake and release mechanisms in different types of cells is critical for designing effective vaccines. Here, we investigated the cellular uptake of a SAM-LNP formulation and subsequent intracellular expression of SAM in baby hamster kidney (BHK-21) cells using hyperspectral coherent anti-Stokes Raman scattering (HS-CARS) microscopy and multiphoton-excited fluorescence lifetime imaging microscopy (FLIM). Cell classification pipelines based on HS-CARS and FLIM features were developed to obtain insights on spectral and metabolic changes associated with SAM-LNPs uptake. We observed elevated lipid intensities with the HS-CARS modality in cells treated with LNPs versus PBS-treated cells, and simultaneous fluorescence images revealed SAM expression inside BHK-21 cell nuclei and cytoplasm within 5 h of treatment. In a separate experiment, we observed a strong correlation between the SAM expression and mean fluorescence lifetime of the bound NAD(P)H population. This work demonstrates the ability and significance of multimodal optical imaging techniques to assess the cellular uptake of SAM-LNPs and the subsequent changes occurring in the cellular microenvironment following the vaccine expression.

Supercontinuum intrinsic fluorescence imaging heralds free view of living systems

Optimal imaging strategies remain underdeveloped to maximize information for fluorescence microscopy while minimizing the harm to fragile living systems. Taking hint from the supercontinuum generation in ultrafast laser physics, we generated supercontinuum fluorescence from untreated unlabeled live samples before nonlinear photodamage onset. Our imaging achieved high-content cell phenotyping and tissue histology, identified bovine embryo polarization, quantified aging-related stress across cell types and species, demystified embryogenesis before and after implantation, sensed drug cytotoxicity in real-time, scanned brain area for targeted patching, optimized machine learning to track small moving organisms, induced two-photon phototropism of leaf chloroplasts under two-photon photosynthesis, unraveled microscopic origin of autumn colors, and interrogated intestinal microbiome. The results enable a facility-type microscope to freely explore vital molecular biology across life sciences.

SLAM medical imaging enabled by pre-chirp and gain jointly managed Yb-fiber laser

We demonstrate a pre-chirp and gain jointly managed Yb-fiber laser that drives simultaneous label-free autofluorescence-multiharmonic (SLAM) medical imaging. We show that a gain managed Yb-fiber amplifier produces high-quality compressed pulses when the seeding pulses exhibit proper negative pre-chirp. The resulting laser source can generate 43-MHz, 34-fs pulses centered at 1110 nm with more than 90-nJ energy. We apply this ultrafast source to SLAM imaging of cellular and extracellular components in various human tissues of intestinal adenocarcinoma, lung adenocarcinoma, and liver.

Simultaneous label-free autofluorescence multi-harmonic microscopy driven by the supercontinuum generated from a bulk nonlinear crystal

Nonlinear microscopy encompasses several imaging techniques that leverage laser technology to probe intrinsic molecules of biological specimens. These native molecules produce optical fingerprints that allow nonlinear microscopes to reveal the chemical composition and structure of cells and tissues in a label-free and non-destructive fashion, information that enables a plethora of applications, e.g., real-time digital histopathology or image-guided surgery. Because state-of-the-art lasers exhibit either a limited bandwidth or reduced wavelength tunability, nonlinear microscopes lack the spectral support to probe different biomolecules simultaneously, thus losing analytical potential. Therefore, a conventional nonlinear microscope requires multiple or tunable lasers to individually excite endogenous molecules, increasing both the cost and complexity of the system. A solution to this problem is supercontinuum generation, a nonlinear optical phenomenon that supplies broadband femtosecond radiation, granting a wide spectrum for concurrent molecular excitation. This study introduces a source for nonlinear multiphoton microscopy based on the supercontinuum generation from a yttrium aluminum garnet (YAG) crystal, an approach that allows simultaneous label-free autofluorescence multi-harmonic imaging of biological samples and offers a practical and compact alternative for the clinical translation of nonlinear microscopy. While this supercontinuum covered the visible spectrum (550-900 nm) and the near-infrared region (950-1200 nm), the pulses within 1030-1150 nm produced label-free volumetric chemical images of ex vivo chinchilla kidney, thus validating the supercontinuum from bulk crystals as a powerful source for multimodal nonlinear microscopy.

Label-free multimodal imaging with simultaneous two-photon and three-photon microscopy and kernel-based nonlinear scaling denoising

We report on a compact multimodal imaging system that can acquire two-photon microscopy (2PM) and three-photon microscopy (3PM) images simultaneously. With dual excitation wavelengths, multiple contrasts including two-photon-excitation-fluorescence (2PEF), second harmonic generation (SHG), and third harmonic generation (THG) are acquired simultaneously from cells, collagen fibers, and interfaces, all label-free. Challenges related to the excitation by two wavelengths and the effective separation of 2PM and 3PM signals are discussed and addressed. The data processing challenge where multiple contrasts can have significantly varying signal levels is also addressed. A kernel-based nonlinear scaling (KNS) denoising method is introduced to reduce noise from ultra-low signal images and generate high-quality multimodal images. Simultaneous 2PM and 3PM imaging is demonstrated on various tissue samples. The simultaneous acquisition speeds up the imaging process and minimizes the commonly encountered problem of motion artifacts and mechanical drift in sequential acquisition. Multimodal imaging with simultaneous 2PM and 3PM will have great potential for label-free in-vivo imaging of biological tissues.

Visualizing Macrophage Phenotypes and Polarization in Diseases: From Biomarkers to Molecular Probes

Macrophage is a kind of immune cell and performs multiple functions including pathogen phagocytosis, antigen presentation and tissue remodeling. To fulfill their functionally distinct roles, macrophages undergo polarization towards a spectrum of phenotypes, particularly the classically activated (M1) and alternatively activated (M2) subtypes. However, the binary M1/M2 phenotype fails to capture the complexity of macrophages subpopulations in vivo. Hence, it is crucial to employ spatiotemporal imaging techniques to visualize macrophage phenotypes and polarization, enabling the monitoring of disease progression and assessment of therapeutic responses to drug candidates. This review begins by discussing the origin, function and diversity of macrophage under physiological and pathological conditions. Subsequently, we summarize the identified macrophage phenotypes and their specific biomarkers. In addition, we present the imaging probes locating the lesions by visualizing macrophages with specific phenotype in vivo. Finally, we discuss the challenges and prospects associated with monitoring immune microenvironment and disease progression through imaging of macrophage phenotypes.

Gentle label-free nonlinear optical imaging relaxes linear-absorption-mediated triplet

Sample health is critical for live-cell fluorescence microscopy and has promoted light-sheet microscopy that restricts its ultraviolet-visible excitation to one plane inside a three-dimensional sample. It is thus intriguing that laser-scanning nonlinear optical microscopy, which similarly restricts its near-infrared excitation, has not broadly enabled gentle label-free molecular imaging. We hypothesize that intense near-infrared excitation induces phototoxicity via linear absorption of intrinsic biomolecules with subsequent triplet buildup, rather than the commonly assumed mechanism of nonlinear absorption. Using a reproducible phototoxicity assay based on the time-lapse elevation of auto-fluorescence (hyper-fluorescence) from a homogeneous tissue model (chicken breast), we provide strong evidence supporting this hypothesis. Our study justifies a simple imaging technique, e.g., rapidly scanned sub-80-fs excitation with full triplet-relaxation, to mitigate this ubiquitous linear-absorption-mediated phototoxicity independent of sample types. The corresponding label-free imaging can track freely moving C. elegans in real-time at an irradiance up to one-half of water optical breakdown.

Formalin fixation and paraffin embedding interfere with the preservation of optical metabolic assessments based on endogenous NAD(P)H and FAD two-photon excited fluorescence

Endogenous NAD(P)H and FAD two-photon excited fluorescence (TPEF) images provide functional metabolic information with high spatial resolution for a wide range of living specimens. Preservation of metabolic function optical metrics upon fixation would facilitate studies which assess the impact of metabolic changes in the context of numerous diseases. However, robust assessments of the impact of formalin fixation, paraffin embedding, and sectioning on the preservation of optical metabolic readouts are lacking. Here, we evaluate intensity and lifetime images at excitation/emission settings optimized for NAD(P)H and FAD TPEF detection from freshly excised murine oral epithelia and corresponding bulk and sectioned fixed tissues. We find that fixation impacts the overall intensity as well as the intensity fluctuations of the images acquired. Accordingly, the depth-dependent variations of the optical redox ratio (defined as FAD/(NAD(P)H + FAD)) across squamous epithelia are not preserved following fixation. This is consistent with significant changes in the 755 nm excited spectra, which reveal broadening upon fixation and additional distortions upon paraffin embedding and sectioning. Analysis of fluorescence lifetime images acquired for excitation/emission settings optimized for NAD(P)H TPEF detection indicate that fixation alters the long lifetime of the observed fluorescence and the long lifetime intensity fraction. These parameters as well as the short TPEF lifetime are significantly modified upon embedding and sectioning. Thus, our studies highlight that the autofluorescence products formed during formalin fixation, paraffin embedding and sectioning overlap highly with NAD(P)H and FAD emission and limit the potential to utilize such tissues to assess metabolic activity.

Visualizing vasculature and its response to therapy in the tumor microenvironment

Tumor vasculature plays a critical role in the progression and metastasis of tumors, antitumor immunity, drug delivery, and resistance to therapies. The morphological and functional changes of tumor vasculature in response to therapy take place in a spatiotemporal-dependent manner, which can be predictive of treatment outcomes. Dynamic monitoring of intratumor vasculature contributes to an improved understanding of the mechanisms of action of specific therapies or reasons for treatment failure, leading to therapy optimization. There is a rich history of methods used to image the vasculature. This review describes recent advances in imaging technologies to visualize the tumor vasculature, with a focus on enhanced intravital imaging techniques and tumor window models. We summarize new insights on spatial-temporal vascular responses to various therapies, including changes in vascular perfusion and permeability and immune-vascular crosstalk, obtained from intravital imaging. Finally, we briefly discuss the clinical applications of intravital imaging techniques.

In vivo label-free optical signatures of chemotherapy response in human pancreatic ductal adenocarcinoma patient-derived xenografts

Pancreatic cancer is a devastating disease often detected at later stages, necessitating swift and effective chemotherapy treatment. However, chemoresistance is common and its mechanisms are poorly understood. Here, label-free multi-modal nonlinear optical microscopy was applied to study microstructural and functional features of pancreatic tumors in vivo to monitor inter- and intra-tumor heterogeneity and treatment response. Patient-derived xenografts with human pancreatic ductal adenocarcinoma were implanted into mice and characterized over five weeks of intraperitoneal chemotherapy (FIRINOX or Gem/NabP) with known responsiveness/resistance. Resistant and responsive tumors exhibited a similar initial metabolic response, but by week 5 the resistant tumor deviated significantly from the responsive tumor, indicating that a representative response may take up to five weeks to appear. This biphasic metabolic response in a chemoresistant tumor reveals the possibility of intra-tumor spatiotemporal heterogeneity of drug responsiveness. These results, though limited by small sample size, suggest the possibility for further work characterizing chemoresistance mechanisms using nonlinear optical microscopy.

Double Staining with Fluorescent Tracers to Determine Myeloid Cell Migration of Leishmania-infected Cells from Mouse Skin to Lymphatic Tissues by Flow Cytometry

Immune cell trafficking in steady-state conditions and inflammatory cell recruitment into injured tissues is crucial for the surveillance of the immune system and the maintenance of body homeostasis. Tracking the cell journey from the infection site in the skin to lymphoid tissues has been challenging, and is typically determined using fluorescent cell tracers, antibodies, or photoconvertible models. Here, we describe the detailed method to track Leishmania-infected myeloid cells migrating from the skin to lymphatic tissues by multiparametric flow cytometry. These methods involve labeling of infective Leishmania donovani parasites with fluorescent cell tracers and phenotyping of myeloid cells with fluorescent antibodies, to determine the infection status of migratory myeloid cells. We also describe the detailed protocol to trace donor monocytes transferred intradermally into recipient mice in Leishmania donovani infection. These protocols can be adapted to study skin-lymphoid tissue migration of dendritic cells, inflammatory monocytes, neutrophils, and other phagocytic myeloid cells in response to vaccine antigens and infection. Key features • Cell-tracking of cell-trace-labeled parasites and monocytes from the skin to lymphatic tissues after transference into donor mice. • Identification of migratory cells labeled with fluorescent cell tracers and antibodies by flow cytometry. • Isolation, labeling, and transference of bone marrow monocytes from donor mice into the skin of recipient mice. • Description of a double-staining technique with fluorescent cell tracers to determine cell and parasite dissemination from the skin to lymphoid tissues.

Nonlinear Imaging Histopathology: A Pipeline to Correlate Gold-Standard Hematoxylin and Eosin Staining With Modern Nonlinear Microscopy

Hematoxylin and eosin (H&E) staining, the century-old technique, has been the gold standard tool for pathologists to detect anomalies in tissues and diseases such as cancer. H&E staining is a cumbersome, time-consuming process that delays and wastes precious minutes during an intraoperative diagnosis. However, even in the modern era, real-time label-free imaging techniques such as simultaneous label-free autofluorescence multiharmonic (SLAM) microscopy have delivered several more layers of information to characterize a tissue with high precision. Still, they have yet to translate to the clinic. The slow translation rate can be attributed to the lack of direct comparisons between the old and new techniques. Our approach to solving this problem is to: 1) reduce dimensions by pre-sectioning the tissue in 500 μm slices, and 2) produce fiducial laser markings which appear in both SLAM and histological imaging. High peak-power femtosecond laser pulses enable ablation in a controlled and contained manner. We perform laser marking on a grid of points encompassing the SLAM region of interest. We optimize laser power, numerical aperture, and timing to produce axially extended marking, hence multilayered fiducial markers, with minimal damage to the surrounding tissues. We performed this co-registration over an area of 3 × 3 mm2 of freshly excised mouse kidney and intestine, followed by standard H&E staining. Reduced dimensionality and the use of laser markings provided a comparison of the old and new techniques, giving a wealth of correlative information and elevating the potential of translating nonlinear microscopy to the clinic for rapid pathological assessment.

Pre-Implantation Bovine Embryo Evaluation-From Optics to Omics and Beyond

Approximately 80% of the ~1.5 million bovine embryos transferred in 2021 were in vitro produced. However, only ~27% of the transferred IVP embryos will result in live births. The ~73% pregnancy failures are partly due to transferring poor-quality embryos, a result of erroneous stereomicroscopy-based morphological evaluation, the current method of choice for pre-transfer embryo evaluation. Numerous microscopic (e.g., differential interference contrast, electron, fluorescent, time-lapse, and artificial-intelligence-based microscopy) and non-microscopic (e.g., genomics, transcriptomics, epigenomics, proteomics, metabolomics, and nuclear magnetic resonance) methodologies have been tested to find an embryo evaluation technique that is superior to morphologic evaluation. Many of these research tools can accurately determine embryo quality/viability; however, most are invasive, expensive, laborious, technically sophisticated, and/or time-consuming, making them futile in the context of in-field embryo evaluation. However accurate they may be, using complex methods, such as RNA sequencing, SNP chips, mass spectrometry, and multiphoton microscopy, at thousands of embryo production/collection facilities is impractical. Therefore, future research is warranted to innovate field-friendly, simple benchtop tests using findings already available, particularly from omics-based research methodologies. Time-lapse monitoring and artificial-intelligence-based automated image analysis also have the potential for accurate embryo evaluation; however, further research is warranted to innovate economically feasible options for in-field applications.

Formalin fixation and paraffin embedding interfere with preservation of optical metabolic assessments based on endogenous NAD(P)H and FAD two photon excited fluorescence

Endogenous NAD(P)H and FAD two-photon excited fluorescence (TPEF) images provide functional metabolic information with high spatial resolution for a wide range of living specimens. Preservation of metabolic function optical metrics upon fixation would facilitate studies which assess the impact of metabolic changes in the context of numerous diseases. However, robust assessments of the impact of formalin fixation, paraffin embedding, and sectioning on the preservation of optical metabolic readouts are lacking. Here, we evaluate intensity and lifetime images at excitation/emission settings optimized for NAD(P)H and FAD TPEF detection from freshly excised murine oral epithelia and corresponding bulk and sectioned fixed tissues. We find that fixation impacts the overall intensity as well as the intensity fluctuations of the images acquired. Accordingly, the depth-dependent variations of the optical redox ratio (defined as FAD/(NAD(P)H + FAD)) across squamous epithelia are not preserved following fixation. This is consistent with significant changes in the 755 nm excited spectra, which reveal broadening upon fixation and additional distortions upon paraffin embedding and sectioning. Analysis of fluorescence lifetime images acquired for excitation/emission settings optimized for NAD(P)H TPEF detection indicate that fixation alters the long lifetime of the observed fluorescence and the long lifetime intensity fraction. These parameters as well as the short TPEF lifetime are significantly modified upon embedding and sectioning. Thus, our studies highlight that the autofluorescence products formed during formalin fixation, paraffin embedding and sectioning overlap highly with NAD(P)H and FAD emission and limit the potential to utilize such tissues to assess metabolic activity.

Association of collagen deep learning classifier with prognosis and chemotherapy benefits in stage II-III colon cancer

The current tumor-node-metastasis staging system does not provide sufficient prognostic prediction or adjuvant chemotherapy benefit information for stage II-III colon cancer (CC) patients. Collagen in the tumor microenvironment affects the biological behaviors and chemotherapy response of cancer cells. Hence, in this study, we proposed a collagen deep learning (collagen^DL) classifier based on the 50-layer residual network model for predicting disease-free survival (DFS) and overall survival (OS). The collagen^DL classifier was significantly associated with DFS and OS (P < 0.001). The collagen^DL nomogram, integrating the collagen^DL classifier and three clinicopathologic predictors, improved the prediction performance, which showed satisfactory discrimination and calibration. These results were independently validated in the internal and external validation cohorts. In addition, high-risk stage II and III CC patients with high-collagen^DL classifier, rather than low-collagen^DL classifier, exhibited a favorable response to adjuvant chemotherapy. In conclusion, the collagen^DL classifier could predict prognosis and adjuvant chemotherapy benefits in stage II-III CC patients.

Weakly supervised identification of microscopic human breast cancer-related optical signatures from normal-appearing breast tissue

With the latest advancements in optical bioimaging, rich structural and functional information has been generated from biological samples, which calls for capable computational tools to identify patterns and uncover relationships between optical characteristics and various biomedical conditions. Constrained by the existing knowledge of the novel signals obtained by those bioimaging techniques, precise and accurate ground truth annotations can be difficult to obtain. Here we present a weakly supervised deep learning framework for optical signature discovery based on inexact and incomplete supervision. The framework consists of a multiple instance learning-based classifier for the identification of regions of interest in coarsely labeled images and model interpretation techniques for optical signature discovery. We applied this framework to investigate human breast cancer-related optical signatures based on virtual histopathology enabled by simultaneous label-free autofluorescence multiharmonic microscopy (SLAM), with the goal of exploring unconventional cancer-related optical signatures from normal-appearing breast tissues. The framework has achieved an average area under the curve (AUC) of 0.975 on the cancer diagnosis task. In addition to well-known cancer biomarkers, non-obvious cancer-related patterns were revealed by the framework, including NAD(P)H-rich extracellular vesicles observed in normal-appearing breast cancer tissue, which facilitate new insights into the tumor microenvironment and field cancerization. This framework can be further extended to diverse imaging modalities and optical signature discovery tasks.

Detection of pathological response of axillary lymph node metastasis after neoadjuvant chemotherapy in breast cancer using multiphoton microscopy

Neoadjuvant treatment is often considered in breast cancer patients with axillary lymph node involvement, but most of patients do not have a pathologic complete response to therapy. The detection of residual nodal disease has a significant impact on adjuvant therapy recommendations which may improve survival. Here, we investigate whether multiphoton microscopy (MPM) could identify the pathological changes of axillary lymphatic metastasis after neoadjuvant chemotherapy in breast cancer. And furthermore, we find that there are obvious differences in seven collagen morphological features between normal node and residual axillary disease by combining with a semi-automatic image processing method, and also find that there are significant differences in four collagen features between the effective and no-response treatment groups. These research results indicate that MPM may help estimate axillary treatment response in the neoadjuvant setting and thereby tailor more appropriate and personalized adjuvant treatments for breast cancer patients.

Variability of fluorescence intensity distribution measured by flow cytometry is influenced by cell size and cell cycle progression

The distribution of fluorescence signals measured with flow cytometry can be influenced by several factors, including qualitative and quantitative properties of the used fluorochromes, optical properties of the detection system, as well as the variability within the analyzed cell population itself. Most of the single cell samples prepared from in vitrocultures or clinical specimens contain a variable cell cycle component. Cell cycle, together with changes in the cell size, are two of the factors that alter the functional properties of analyzed cells and thus affect the interpretation of obtained results. Here, we describe the association between cell cycle status and cell size, and the variability in the distribution of fluorescence intensity as determined with flow cytometry, at population scale. We show that variability in the distribution of background and specific fluorescence signals is related to the cell cycle state of the selected population, with the 10% low fluorescence signal fraction enriched mainly in cells in their G0/G1 cell cycle phase, and the 10% high fraction containing cells mostly in the G2/M phase. Therefore we advise using caution and additional experimental validation when comparing populations defined by fractions at both ends of fluorescence signal distribution to avoid biases caused by the effect of cell cycle and cell size.

Two-photon fluorescence imaging using a tunable spectral window based on fiber supercontinuum

Two-photon excitation fluorescence (TPEF) microscopy has evolved into a versatile tool in biological research. However, the multiplexing capability of TPEF microscopy is limited by the narrow spectral bandwidth of the light source. In this study, we apply a photonic crystal fiber in TPEF microscopy to broaden the excitation source bandwidth. We tuned the spectral window using a spatial light modulator as a programmable diffraction grating that was placed behind a prism pair. In addition, we combined a grating pair to compensate for dispersion to improve the two-photon excitation efficiency. The combination of a broad spectrum and a programmable grating enabled fast spectral window tuning rate on a time scale of tens of milliseconds. We demonstrate the performance of our method by imaging live B16 cells labeled with four emission spectrum overlapped fluorescent proteins.

Multi-objective optimization of custom compound prism arrays for multiplexed optical imaging

Compound prism arrays are a powerful, yet underutilized, solution for producing high transmission and customized chromatic dispersion profiles over broad bandwidths, the quality of which is unobtainable with commercially available prisms or diffraction gratings. However, the computational complexity associated with designing these prism arrays presents a barrier to the widespread adoption of their use. Here we introduce customizable prism designer software that facilitates high-speed optimization of compound arrays guided by target specifications for chromatic dispersion linearity and detector geometry. Information theory is utilized such that target parameters can be easily modified through user input to efficiently simulate a broad range of possible prism array designs. We demonstrate the capabilities of the designer software to simulate new prism array designs for multiplexed, hyperspectral microscopy that achieve chromatic dispersion linearity and a 70-90% light transmission over a significant portion of the visible wavelength range (500-820 nm). The designer software is applicable to many optical spectroscopy and spectral microscopy applications-with varying requirements for spectral resolution, light ray deviation, and physical size-that are photon-starved and for which the enhanced transmission of refraction versus diffraction warrants custom optical designs.

Approaches to Improve EPR-Based Drug Delivery for Cancer Therapy and Diagnosis

The innovative development of nanomedicine has promised effective treatment options compared to the standard therapeutics for cancer therapy. However, the efficiency of EPR-targeted nanodrugs is not always pleasing as it is strongly prejudiced by the heterogeneity of the enhanced permeability and retention effect (EPR). Targeting the dynamics of the EPR effect and improvement of the therapeutic effects of nanotherapeutics by using EPR enhancers is a vital approach to developing cancer therapy. Inadequate data on the efficacy of EPR in humans hampers the clinical translation of cancer drugs. Molecular targeting, physical amendment, or physiological renovation of the tumor microenvironment (TME) are crucial approaches for improving the EPR effect. Advanced imaging technologies for the visualization of EPR-induced nanomedicine distribution in tumors, and the use of better animal models, are necessary to enhance the EPR effect. This review discusses strategies to enhance EPR effect-based drug delivery approaches for cancer therapy and imaging technologies for the diagnosis of EPR effects. The effort of studying the EPR effect is beneficial, as some of the advanced nanomedicine-based EPR-enhancing approaches are currently undergoing clinical trials, which may be helpful to improve EPR-induced drug delivery and translation to clinics.

Intravital imaging of immune responses in intestinal inflammation

To date, many kinds of immune cells have been identified, but their precise roles in intestinal immunity remain unclear. Understanding the in vivo behavior of these immune cells and their function in gastrointestinal inflammation, including colitis, inflammatory bowel disease, ischemia-reperfusion injury, and neutrophil extracellular traps, is critical for gastrointestinal research to proceed to the next step. Additionally, understanding the immune responses involved in gastrointestinal tumors and tissue repair is becoming increasingly important for the elucidation of disease mechanisms that have been unknown. In recent years, the application of intravital microscopy in gastrointestinal research has provided novel insights into the mechanisms of intestine-specific events including innate and adaptive immunities. In this review, we focus on the emerging role of intravital imaging in gastrointestinal research and describe how to observe the intestines and immune cells using intravital microscopy. Additionally, we outline novel findings obtained by this new technique.

Multiscale Label-Free Imaging of Fibrillar Collagen in the Tumor Microenvironment

With recent advances in cancer therapeutics, there is a great need for improved imaging methods for characterizing cancer onset and progression in a quantitative and actionable way. Collagen, the most abundant extracellular matrix protein in the tumor microenvironment (and the body in general), plays a multifaceted role, both hindering and promoting cancer invasion and progression. Collagen deposition can defend the tumor with immunosuppressive effects, while aligned collagen fiber structures can enable tumor cell migration, aiding invasion and metastasis. Given the complex role of collagen fiber organization and topology, imaging has been a tool of choice to characterize these changes on multiple spatial scales, from the organ and tumor scale to cellular and subcellular level. Macroscale density already aids in the detection and diagnosis of solid cancers, but progress is being made to integrate finer microscale features into the process. Here we review imaging modalities ranging from optical methods of second harmonic generation (SHG), polarized light microscopy (PLM), and optical coherence tomography (OCT) to the medical imaging approaches of ultrasound and magnetic resonance imaging (MRI). These methods have enabled scientists and clinicians to better understand the impact collagen structure has on the tumor environment, at both the bulk scale (density) and microscale (fibrillar structure) levels. We focus on imaging methods with the potential to both examine the collagen structure in as natural a state as possible and still be clinically amenable, with an emphasis on label-free strategies, exploiting intrinsic optical properties of collagen fibers.

Deep learning-based high-speed, large-field, and high-resolution multiphoton imaging

Multiphoton microscopy is a formidable tool for the pathological analysis of tumors. The physical limitations of imaging systems and the low efficiencies inherent in nonlinear processes have prevented the simultaneous achievement of high imaging speed and high resolution. We demonstrate a self-alignment dual-attention-guided residual-in-residual generative adversarial network trained with various multiphoton images. The network enhances image contrast and spatial resolution, suppresses noise, and scanning fringe artifacts, and eliminates the mutual exclusion between field of view, image quality, and imaging speed. The network may be integrated into commercial microscopes for large-scale, high-resolution, and low photobleaching studies of tumor environments.

Nonlinear optical imaging by detection with optical parametric amplification (invited paper)

Nonlinear optical imaging is a versatile tool that has been proven to be exceptionally useful in various research fields. However, due to the use of photomultiplier tubes (PMTs), the wide application of nonlinear optical imaging is limited by the incapability of imaging under ambient light. In this paper, we propose and demonstrate a new optical imaging detection method based on optical parametric amplification (OPA). As a nonlinear optical process, OPA intrinsically rejects ambient light photons by coherence gating. Periodical poled lithium niobate (PPLN) crystals are used in this study as the media for OPA. Compared to bulk nonlinear optical crystals, PPLN crystals support the generation of OPA signal with lower pump power. Therefore, this characteristic of PPLN crystals is particularly beneficial when using high-repetition-rate lasers, which facilitate high-speed optical signal detection, such as in spectroscopy and imaging. A PPLN-based OPA system was built to amplify the emitted imaging signal from second harmonic generation (SHG) and coherent anti-Stokes Raman scattering (CARS) microscopy imaging, and the amplified optical signal was strong enough to be detected by a biased photodiode under ordinary room light conditions. With OPA detection, ambient-light-on SHG and CARS imaging becomes possible, and achieves a similar result as PMT detection under strictly dark environments. These results demonstrate that OPA can be used as a substitute for PMTs in nonlinear optical imaging to adapt it to various applications with complex lighting conditions.

Multiphoton intravital microscopy of rodents

Tissues are heterogeneous with respect to cellular and non-cellular components and in the dynamic interactions between these elements. To study the behaviour and fate of individual cells in these complex tissues, intravital microscopy (IVM) techniques such as multiphoton microscopy have been developed to visualize intact and live tissues at cellular and subcellular resolution. IVM experiments have revealed unique insights into the dynamic interplay between different cell types and their local environment, and how this drives morphogenesis and homeostasis of tissues, inflammation and immune responses, and the development of various diseases. This Primer introduces researchers to IVM technologies, with a focus on multiphoton microscopy of rodents, and discusses challenges, solutions and practical tips on how to perform IVM. To illustrate the unique potential of IVM, several examples of results are highlighted. Finally, we discuss data reproducibility and how to handle big imaging data sets.

Post-operative anastomotic leakage and collagen changes in patients with rectal cancer undergoing neoadjuvant chemotherapy vs chemoradiotherapy

Background

A significant difference in the anastomotic leakage (AL) rate has been observed between patients with locally advanced rectal cancer who have undergone preoperative chemotherapy and those undergoing preoperative chemoradiotherapy. This study aimed to quantitatively analyse collagen structural changes caused by preoperative chemoradiotherapy and illuminate the relationship between collagen changes and AL.

Methods

Anastomotic distal and proximal "doughnut" specimens from the Sixth Affiliated Hospital of Sun Yat-sen University (Guangzhou, China) were quantitatively assessed for collagen structural changes between patients with and without preoperative radiotherapy using multiphoton imaging. Then, patients treated with preoperative chemoradiotherapy were used as a training cohort to construct an AL-SVM classifier by the Mann-Whitney U test and support vector machine (SVM). An independent test cohort from the Fujian Province Cancer Hospital (Fuzhou, China) was used to validate the AL-SVM classifier.

Results

A total of 207 patients were included from the Sixth Affiliated Hospital of Sun Yat-sen University. The AL rate in the preoperative chemoradiotherapy group (n = 107) was significantly higher than that in the preoperative chemotherapy group (n = 100) (21.5% vs 7.0%, P = 0.003). A fully quantitative analysis showed notable morphological and spatial distribution feature changes in collagen in the preoperative chemoradiotherapy group. Then, the patients who received preoperative chemoradiotherapy were used as a training cohort to construct the AL-SVM classifier based on five collagen features and the tumor distance from the anus. The AL-SVM classifier showed satisfactory discrimination and calibration with areas under the curve of 0.907 and 0.856 in the training and test cohorts, respectively.

Conclusions

The collagen structure may be notably altered by preoperative radiotherapy. The AL-SVM classifier was useful for the individualized prediction of AL in rectal cancer patients undergoing preoperative chemoradiotherapy.

Current strategies with implementation of three-dimensional cell culture: the challenge of quantification

From growing cells in spheroids to arranging them on complex engineered scaffolds, three-dimensional cell culture protocols are rapidly expanding and diversifying. While these systems may often improve the physiological relevance of cell culture models, they come with technical challenges, as many of the analytical methods used to characterize traditional two-dimensional (2D) cells must be modified or replaced to be effective. Here we review the advantages and limitations of quantification methods based either on biochemical measurements or microscopy imaging. We focus on the most basic of parameters that one may want to measure, the number of cells. Precise determination of this number is essential for many analytical techniques where measured quantities are only meaningful when normalized to the number of cells (e.g. cytochrome p450 enzyme activity). Thus, accurate measurement of cell number is often a prerequisite to allowing comparisons across different conditions (culturing conditions or drug and treatment screening) or between cells in different spatial states. We note that this issue is often neglected in the literature with little or no information given regarding how normalization was performed, we highlight the pitfalls and complications of quantification and call for more accurate reporting to improve reproducibility.

Evaluation of histopathological response to neoadjuvant therapy in rectal cancer using slide-free, stain-free multimodal multiphoton microscopy

Neoadjuvant therapy has become a standard treatment for patients with locally advanced rectal cancer to achieve better prognostic outcomes. The response to treatment has been shown to correlate closely with the prognosis. However, current evaluation systems only provide coarse assessment on limited information, due to the lack of accurate and reproducible approach for quantitation of different types of responses. In this study, a novel stain-free, slide-free multimodal multiphoton microscopy imaging technique was applied to image rectal cancer tissues after neoadjuvant therapies with high resolution and contrast. Qualitative and quantitative evaluation of tumor, stromal, and inflammatory responses were demonstrated which are consistent with current tumor regression grading system using American Joint Committee on Cancer criteria, showing the great potential of such approach to build a more informative grading system for accurate and standardizable assessment of neoadjuvant therapy in rectal cancer.