Quantitative phase imaging with molecular vibrational sensitivity

Increasing contrast in water-embedded particles via time-gated mid-infrared photothermal microscopy

The transient dynamics of photothermal signals provide interesting insights into material properties and heat diffusion. In a mid-infrared (mid-IR) photothermal microscope, the imaging contrast in a standard amplitude imaging can decrease due to thermal diffusion effects. It is shown that contrast varies for poly-methyl 2-methylpropenoate (PMMA) particles of different sizes when embedded in an absorbing medium of water (H2O) based on levels of heat exchange under the water absorption resonance. Using time-resolved boxcar (BC) detection, analysis of the transient thermal dynamics at the bead-water interface is presented, and the time decay parameters for 500 nm and 100 nm beads are determined. Enhanced (negative) imaging contrast is observed for less heat exchange between the water and bead, as in the case for the 100 nm bead. For the 500 nm bead, boxcar imaging before heat exchange starts occurring, leads to an increase of the imaging contrast up to a factor of 1.6.

Prediction of single-cell RNA expression profiles in live cells by Raman microscopy with Raman2RNA

Single-cell RNA sequencing and other profiling assays have helped interrogate cells at unprecedented resolution and scale, but are inherently destructive. Raman microscopy reports on the vibrational energy levels of proteins and metabolites in a label-free and nondestructive manner at subcellular spatial resolution, but it lacks genetic and molecular interpretability. Here we present Raman2RNA (R2R), a method to infer single-cell expression profiles in live cells through label-free hyperspectral Raman microscopy images and domain translation. We predict single-cell RNA sequencing profiles nondestructively from Raman images using either anchor-based integration with single molecule fluorescence in situ hybridization, or anchor-free generation with adversarial autoencoders. R2R outperformed inference from brightfield images (cosine similarities: R2R >0.85 and brightfield <0.15). In reprogramming of mouse fibroblasts into induced pluripotent stem cells, R2R inferred the expression profiles of various cell states. With live-cell tracking of mouse embryonic stem cell differentiation, R2R traced the early emergence of lineage divergence and differentiation trajectories, overcoming discontinuities in expression space. R2R lays a foundation for future exploration of live genomic dynamics.

Bond-selective full-field optical coherence tomography

Optical coherence tomography (OCT) is a label-free, non-invasive 3D imaging tool widely used in both biological research and clinical diagnosis. Conventional OCT modalities can only visualize specimen tomography without chemical information. Here, we report a bond-selective full-field OCT (BS-FF-OCT), in which a pulsed mid-infrared laser is used to modulate the OCT signal through the photothermal effect, achieving label-free bond-selective 3D sectioned imaging of highly scattering samples. We first demonstrate BS-FF-OCT imaging of 1 µm PMMA beads embedded in agarose gel. Next, we show 3D hyperspectral imaging of up to 75 µm of polypropylene fiber mattress from a standard surgical mask. We then demonstrate BS-FF-OCT imaging on biological samples, including cancer cell spheroids and C. elegans. Using an alternative pulse timing configuration, we finally demonstrate the capability of BS-FF-OCT on imaging a highly scattering myelinated axons region in a mouse brain tissue slice.

Roadmap on Label-Free Super-Resolution Imaging

Label-free super-resolution (LFSR) imaging relies on light-scattering processes in nanoscale objects without a need for fluorescent (FL) staining required in super-resolved FL microscopy. The objectives of this Roadmap are to present a comprehensive vision of the developments, the state-of-the-art in this field, and to discuss the resolution boundaries and hurdles which need to be overcome to break the classical diffraction limit of the LFSR imaging. The scope of this Roadmap spans from the advanced interference detection techniques, where the diffraction-limited lateral resolution is combined with unsurpassed axial and temporal resolution, to techniques with true lateral super-resolution capability which are based on understanding resolution as an information science problem, on using novel structured illumination, near-field scanning, and nonlinear optics approaches, and on designing superlenses based on nanoplasmonics, metamaterials, transformation optics, and microsphere-assisted approaches. To this end, this Roadmap brings under the same umbrella researchers from the physics and biomedical optics communities in which such studies have often been developing separately. The ultimate intent of this paper is to create a vision for the current and future developments of LFSR imaging based on its physical mechanisms and to create a great opening for the series of articles in this field.

Time-Resolved Mid-Infrared Photothermal Microscopy for Imaging Water-Embedded Axon Bundles

Few experimental tools exist for performing label-free imaging of biological samples in a water-rich environment due to the high infrared absorption of water, overlapping with major protein and lipid bands. A novel imaging modality based on time-resolved mid-infrared photothermal microscopy is introduced and applied to imaging axon bundles in a saline bath environment. Photothermally induced spatial gradients at the axon bundle membrane interfaces with saline and surrounding biological tissue are observed and temporally characterized by a high-speed boxcar detection system. Localized time profiles with an enhanced signal-to-noise, hyper-temporal image stacks, and two-dimensional mapping of the time decay profiles are acquired without the need for complex post image processing. Axon bundles are found to have a larger distribution of time decay profiles compared to the water background, allowing background differentiation based on these transient dynamics. The quantitative analysis of the signal evolution over time allows characterizing the level of thermal confinement at different regions. When axon bundles are surrounded by complex heterogeneous tissue, which contains smaller features, a stronger thermal confinement is observed compared to a water environment, thus shedding light on the heat transfer dynamics across aqueous biological interfaces.

Quantitative phase imaging based on motionless optical scanning holography

Optical scanning holography (OSH) can be applied to 3D fluorescent imaging. However, the optical setup for OSH is complicated due to the requirement of a phase shifter, a 2D mechanical scanner, and an interferometer. Although motionless optical scanning holography (MOSH) can overcome the problem, quantitative phase imaging (QPI) has not yet been realized because MOSH can only obtain incoherent holograms. If QPI in MOSH is realized, MOSH can be applied to various applications. In this Letter, MOSH-based QPI (MOSH-QPI) is proposed. In addition, a simple description of a coherent mode of OSH is presented. In the proof-of-principle experiment, the spatially divided phase-shifting technique is applied to reduce the number of measurements. The feasibility of MOSH-QPI is confirmed by measuring a phase distribution of a microlens array. MOSH-QPI is also applied to measure practical samples, and its results are compared with the experimental results of the conventional one using a Mach-Zehnder interferometer.

3D Chemical Imaging by Fluorescence-detected Mid-Infrared Photothermal Fourier Light Field Microscopy

Three-dimensional molecular imaging of living organisms and cells plays a significant role in modern biology. Yet, current volumetric imaging modalities are largely fluorescence-based and thus lack chemical content information. Mid-infrared photothermal microscopy as a chemical imaging technology provides infrared spectroscopic information at submicrometer spatial resolution. Here, by harnessing thermosensitive fluorescent dyes to sense the mid-infrared photothermal effect, we demonstrate 3D fluorescence-detected mid-infrared photothermal Fourier light field (FMIP-FLF) microscopy at the speed of 8 volumes per second and submicron spatial resolution. Protein contents in bacteria and lipid droplets in living pancreatic cancer cells are visualized. Altered lipid metabolism in drug-resistant pancreatic cancer cells is observed with the FMIP-FLF microscope.

Video-rate mid-infrared photothermal imaging by single-pulse photothermal detection per pixel

By optically sensing absorption-induced photothermal effect, mid-infrared (IR) photothermal (MIP) microscope enables super-resolution IR imaging of biological systems in water. However, the speed of current sample-scanning MIP system is limited to milliseconds per pixel, which is insufficient for capturing living dynamics. By detecting the transient photothermal signal induced by a single IR pulse through fast digitization, we report a laser-scanning MIP microscope that increases the imaging speed by three orders of magnitude. To realize single-pulse photothermal detection, we use synchronized galvo scanning of both mid-IR and probe beams to achieve an imaging line rate of more than 2 kilohertz. With video-rate speed, we observed the dynamics of various biomolecules in living organisms at multiple scales. Furthermore, by using hyperspectral imaging, we chemically dissected the layered ultrastructure of fungal cell wall. Last, with a uniform field of view more than 200 by 200 square micrometer, we mapped fat storage in free-moving Caenorhabditis elegans and live embryos.

Far-field super-resolution chemical microscopy

Far-field chemical microscopy providing molecular electronic or vibrational fingerprint information opens a new window for the study of three-dimensional biological, material, and chemical systems. Chemical microscopy provides a nondestructive way of chemical identification without exterior labels. However, the diffraction limit of optics hindered it from discovering more details under the resolution limit. Recent development of super-resolution techniques gives enlightenment to open this door behind far-field chemical microscopy. Here, we review recent advances that have pushed the boundary of far-field chemical microscopy in terms of spatial resolution. We further highlight applications in biomedical research, material characterization, environmental study, cultural heritage conservation, and integrated chip inspection.

Mid-Infrared Photothermal Microscopy: Principle, Instrumentation, and Applications

Midinfrared photothermal (MIP) microscopy, also called optical photothermal infrared (O-PTIR) microscopy, is an emerging tool for bond-selective chemical imaging of living biological and material samples. In MIP microscopy, a visible probe beam detects the photothermal-based contrast induced by a vibrational absorption. With submicron spatial resolution, high spectral fidelity, and reduced water absorption background, MIP microscopy has overcome the limitations in infrared chemical imaging methods. In this review, we summarize the basic principle of MIP microscopy, the different origins of MIP contrasts, and recent technology development that pushed the resolution, speed, and sensitivity of MIP imaging to a new stage. We further emphasize its broad applications in life science and material characterization, and provide a perspective of future technical advances.

Imaging approaches for monitoring three-dimensional cell and tissue culture systems

The past decade has seen an increasing demand for more complex, reproducible and physiologically relevant tissue cultures that can mimic the structural and biological features of living tissues. Monitoring the viability, development and responses of such tissues in real-time are challenging due to the complexities of cell culture physical characteristics and the environments in which these cultures need to be maintained in. Significant developments in optics, such as optical manipulation, improved detection and data analysis, have made optical imaging a preferred choice for many three-dimensional (3D) cell culture monitoring applications. The aim of this review is to discuss the challenges associated with imaging and monitoring 3D tissues and cell culture, and highlight topical label-free imaging tools that enable bioengineers and biophysicists to non-invasively characterise engineered living tissues.

Analysis of Deep Learning-Based Phase Retrieval Algorithm Performance for Quantitative Phase Imaging Microscopy

Quantitative phase imaging has been of interest to the science and engineering community and has been applied in multiple research fields and applications. Recently, the data-driven approach of artificial intelligence has been utilized in several optical applications, including phase retrieval. However, phase images recovered from artificial intelligence are questionable in their correctness and reliability. Here, we propose a theoretical framework to analyze and quantify the performance of a deep learning-based phase retrieval algorithm for quantitative phase imaging microscopy by comparing recovered phase images to their theoretical phase profile in terms of their correctness. This study has employed both lossless and lossy samples, including uniform plasmonic gold sensors and dielectric layer samples; the plasmonic samples are lossy, whereas the dielectric layers are lossless. The uniform samples enable us to quantify the theoretical phase since they are established and well understood. In addition, a context aggregation network has been employed to demonstrate the phase image regression. Several imaging planes have been simulated serving as input and the label for network training, including a back focal plane image, an image at the image plane, and images when the microscope sample is axially defocused. The back focal plane image plays an essential role in phase retrieval for the plasmonic samples, whereas the dielectric layer requires both image plane and back focal plane information to retrieve the phase profile correctly. Here, we demonstrate that phase images recovered using deep learning can be robust and reliable depending on the sample and the input to the deep learning.

Information entropy of quantitative chemometric endogenous fluorescence improves photonic lung cancer diagnosis

Quantitative chemometric widefield endogenous fluorescence microscopy (CFM) maps the endogenous absolute chromophore concentration and spatial distribution in cells and tissue sections label-free from fluorescence color images under broadband excitation and detection. By quantifying the endogenous chromophores, including tryptophan, elastin, reduced nicotinamide adenine dinucleotide [NAD(P)H], and flavin adenine dinucleotide (FAD), CFM reveals the biochemical environment and subcellular structure. Here we show that the chromophore information entropy, marking its spatial distribution pattern of quantitative chemometric endogenous fluorescence at the microscopic scale, improves photonic lung cancer diagnosis with independent diagnostic power to the cellular metabolism biomarker. NAD(P)H and FAD's information entropy is found to decrease from normal to perilesional to cancerous tissue, whereas the information entropy for the redox ratios [FAD/tryptophan and FAD/NAD(P)H] is smaller for the normal tissue than both perilesional and cancerous tissue. CFM imaging of the specimen's inherent biochemical and structural properties eliminates the dependence on measurement details and facilitates robust, accurate diagnosis. The synergy of quantifying absolute chromophore concentration and information entropy achieves high accuracies for a three-class classification of lung tissue into normal, perilesional, and cancerous ones and a three-class classification of lung cancers into grade 1, grade 2, and grade 3 using a support vector machine, outperforming the chromophore concentration biomarkers.

On the Limit of Detection in Infrared Spectroscopic Imaging

Infrared (IR) spectroscopic imaging instruments' performance can be characterized and optimized by an analysis of their limit of detection (LOD). Here we report a systematic analysis of the LOD for Fourier transform IR (FT-IR) and discrete frequency IR (DFIR) imaging spectrometers. In addition to traditional measurements of sample and blank data, we propose a decision theory perspective to pose the determination of LOD as a binary classification problem under different assumptions of noise uniformity and correlation. We also examine three spectral analysis approaches, namely, absorbance at a single frequency, average of absorbance over selected frequencies and total spectral distance - to suit instruments that acquire discrete or contiguous spectral bandwidths. The analysis is validated by refining the fabrication of a bovine serum albumin protein microarray to provide eight uniform spots from ∼2.8 nL of solution for each concentration over a wide range (0.05-10 mg/mL). Using scanning parameters that are typical for each instrument, we estimate a LOD of 0.16 mg/mL and 0.12 mg/mL for widefield and line scanning FT-IR imaging systems, respectively, using the spectral distance approach, and 0.22 mg/mL and 0.15 mg/mL using an optimal set of discrete frequencies. As expected, averaging and the use of post-processing techniques such as minimum noise fraction transformation results in LODs as low as ∼0.075 mg/mL that correspond to a spotted protein mass of ∼112 fg/pixel. We emphasize that these measurements were conducted at typical imaging parameters for each instrument and can be improved using the usual trading rules of IR spectroscopy. This systematic analysis and methodology for determining the LOD can allow for quantitative measures of confidence in imaging an analyte's concentration and a basis for further improving IR imaging technology.

Background-Suppressed High-Throughput Mid-Infrared Photothermal Microscopy via Pupil Engineering

Mid-infrared photothermal (MIP) microscopy has been a promising label-free chemical imaging technique for functional characterization of specimens owing to its enhanced spatial resolution and high specificity. Recently developed wide-field MIP imaging modalities have drastically improved speed and enabled high-throughput imaging of micron-scale subjects. However, the weakly scattered signal from subwavelength particles becomes indistinguishable from the shot-noise as a consequence of the strong background light, leading to limited sensitivity. Here, we demonstrate background-suppressed chemical fingerprinting at a single nanoparticle level by selectively attenuating the reflected light through pupil engineering in the collection path. Our technique provides over 3 orders of magnitude background suppression by quasi-darkfield illumination in the epi-configuration without sacrificing lateral resolution. We demonstrate 6-fold signal-to-background noise ratio improvement, allowing for simultaneous detection and discrimination of hundreds of nanoparticles across a field of view of 70 μm × 70 μm. A comprehensive theoretical framework for photothermal image formation is provided and experimentally validated with 300 and 500 nm PMMA beads. The versatility and utility of our technique are demonstrated via hyperspectral dark-field MIP imaging of S. aureus and E. coli bacteria and MIP imaging of subcellular lipid droplets inside C. albicans and cancer cells.

Bond-selective imaging by optically sensing the mid-infrared photothermal effect

Mid-infrared (IR) spectroscopic imaging using inherent vibrational contrast has been broadly used as a powerful analytical tool for sample identification and characterization. However, the low spatial resolution and large water absorption associated with the long IR wavelengths hinder its applications to study subcellular features in living systems. Recently developed mid-infrared photothermal (MIP) microscopy overcomes these limitations by probing the IR absorption-induced photothermal effect using a visible light. MIP microscopy yields submicrometer spatial resolution with high spectral fidelity and reduced water background. In this review, we categorize different photothermal contrast mechanisms and discuss instrumentations for scanning and widefield MIP microscope configurations. We highlight a broad range of applications from life science to materials. We further provide future perspective and potential venues in MIP microscopy field.

Single-shot higher-order transport-of-intensity quantitative phase imaging based on computer-generated holography

The imaging quality of quantitative phase imaging (QPI) based on the transport of intensity equation (TIE) can be improved using a higher-order approximation for defocused intensity distributions. However, this requires mechanically scanning an image sensor or object along the optical axis, which in turn requires a precisely aligned optical setup. To overcome this problem, a computer-generated hologram (CGH) technique is introduced to TIE-based QPI. A CGH generating defocused point spread function is inserted in the Fourier plane of an object. The CGH acts as a lens and grating with various focal lengths and orientations, allowing multiple defocused intensity distributions to be simultaneously detected on an image sensor plane. The results of a numerical simulation and optical experiment demonstrated the feasibility of the proposed method.

Label-free imaging of fibroblast membrane interfaces and protein signatures with vibrational infrared photothermal and phase signals

Label-free vibrational imaging of biological samples has attracted significant interest due to its integration of structural and chemical information. Vibrational infrared photothermal amplitude and phase signal (VIPPS) imaging provide label-free chemical identification by targeting the characteristic resonances of biological compounds that are present in the mid-infrared fingerprint region (3 µm - 12 µm). High contrast imaging of subcellular features and chemical identification of protein secondary structures in unlabeled and labeled fibroblast cells embedded in a collagen-rich extracellular matrix is demonstrated by combining contrast from absorption signatures (amplitude signals) with sensitive detection of different heat properties (lock-in phase signals). We present that the detectability of nano-sized cell membranes is enhanced to well below the optical diffraction limit since the membranes are found to act as thermal barriers. VIPPS offers a novel combination of chemical imaging and thermal diffusion characterization that paves the way towards label-free imaging of cell models and tissues as well as the study of intracellular heat dynamics.

Adaptive dynamic range shift (ADRIFT) quantitative phase imaging

Quantitative phase imaging (QPI) with its high-contrast images of optical phase delay (OPD) maps is often used for label-free single-cell analysis. Contrary to other imaging methods, sensitivity improvement has not been intensively explored because conventional QPI is sensitive enough to observe the surface roughness of a substrate that restricts the minimum measurable OPD. However, emerging QPI techniques that utilize, for example, differential image analysis of consecutive temporal frames, such as mid-infrared photothermal QPI, mitigate the minimum OPD limit by decoupling the static OPD contribution and allow measurement of much smaller OPDs. Here, we propose and demonstrate supersensitive QPI with an expanded dynamic range. It is enabled by adaptive dynamic range shift through a combination of wavefront shaping and dark-field QPI techniques. As a proof-of-concept demonstration, we show dynamic range expansion (sensitivity improvement) of QPI by a factor of 6.6 and its utility in improving the sensitivity of mid-infrared photothermal QPI. This technique can also be applied for wide-field scattering imaging of dynamically changing nanoscale objects inside and outside a biological cell without losing global cellular morphological image information.

Photothermal Microscopy: Imaging the Optical Absorption of Single Nanoparticles and Single Molecules

The photothermal (PT) signal arises from slight changes of the index of refraction in a sample due to absorption of a heating light beam. Refractive index changes are measured with a second probing beam, usually of a different color. In the past two decades, this all-optical detection method has reached the sensitivity of single particles and single molecules, which gave birth to original applications in material science and biology. PT microscopy enables shot-noise-limited detection of individual nanoabsorbers among strong scatterers and circumvents many of the limitations of fluorescence-based detection. This review describes the theoretical basis of PT microscopy, the methodological developments that improved its sensitivity toward single-nanoparticle and single-molecule imaging, and a vast number of applications to single-nanoparticle imaging and tracking in material science and in cellular biology.

Three-dimensional phase optical transfer function in axially symmetric microscopic quantitative phase imaging

Three-dimensional quantitative phase imaging (3D QPI) is widely recognized as a potentially high-impact microscopic modality. Central to determining the resolution capability of 3D QPI is the phase optical transfer function (POTF). The magnitude of the POTF over its spatial frequency coverage (SFC) specifies the intensity of the response for each allowed spatial frequency. In this paper, a detailed analysis of the POTF for an axially symmetric optical configuration is presented. First, a useful geometric interpretation of the SFC, which enables its visualization, is presented. Second, a closed-form 1D integral expression is derived for the POTF in the general nonparaxial case, which enables rapid calculation of the POTF. Third, this formulation is applied to disk, annular, multi-annuli, and Gaussian illuminations as well as to an annular objective. Taken together, these contributions enable the visualization and simplified calculation of the 3D axially symmetric POTF and provide a basis for optimizing QPI in a wide range of applications.

Bond-selective transient phase imaging via sensing of the infrared photothermal effect

Phase-contrast microscopy converts the phase shift of light passing through a transparent specimen, e.g., a biological cell, into brightness variations in an image. This ability to observe structures without destructive fixation or staining has been widely utilized for applications in materials and life sciences. Despite these advantages, phase-contrast microscopy lacks the ability to reveal molecular information. To address this gap, we developed a bond-selective transient phase (BSTP) imaging technique that excites molecular vibrations by infrared light, resulting in a transient change in phase shift that can be detected by a diffraction phase microscope. By developing a time-gated pump-probe camera system, we demonstrate BSTP imaging of live cells at a 50 Hz frame rate with high spectral fidelity, sub-microsecond temporal resolution, and sub-micron spatial resolution. Our approach paves a new way for spectroscopic imaging investigation in biology and materials science.