Synthetic Fourier transform light scattering

Fourier Ptychographic Microscopy 10 Years on: A Review

Fourier ptychographic microscopy (FPM) emerged as a prominent imaging technique in 2013, attracting significant interest due to its remarkable features such as precise phase retrieval, expansive field of view (FOV), and superior resolution. Over the past decade, FPM has become an essential tool in microscopy, with applications in metrology, scientific research, biomedicine, and inspection. This achievement arises from its ability to effectively address the persistent challenge of achieving a trade-off between FOV and resolution in imaging systems. It has a wide range of applications, including label-free imaging, drug screening, and digital pathology. In this comprehensive review, we present a concise overview of the fundamental principles of FPM and compare it with similar imaging techniques. In addition, we present a study on achieving colorization of restored photographs and enhancing the speed of FPM. Subsequently, we showcase several FPM applications utilizing the previously described technologies, with a specific focus on digital pathology, drug screening, and three-dimensional imaging. We thoroughly examine the benefits and challenges associated with integrating deep learning and FPM. To summarize, we express our own viewpoints on the technological progress of FPM and explore prospective avenues for its future developments.

Phase-sensitive, angle-resolved light-scattering microscopy of single cells

We report what is to our knowledge the first use of Fourier phase microscopy (FPM) to estimate diameters of individual single-micrometer beads and to classify cells based upon changes in scatterer size distribution. FPM, a quantitative phase imaging (QPI) method, combines the planar illumination typically used in off-axis QPI (ideal for Mie theory analysis) with the common-path geometry typically used in on-axis QPI (ideal for optimizing angular scattering range). Low-spatial-frequency imaging artifacts inherent to FPM have negligible impact upon these angular-domain applications. The system is simple to align and stable, and requires no external reference beam. Angular scattering patterns obtained from single 1 µm polystyrene beads in glycerol (Δn=0.11) display unprecedented fidelity to Mie theory, produce diameter estimates consistent with the manufacturer's specifications, and offer precision on the scale of tens of nanometers. Measurements of macrophages at different stages of antibody-dependent cellular phagocytosis demonstrate the ability to detect changes in a cell's scattering caused by the presence of phagocytosed material within.

High-resolution and large field-of-view Fourier ptychographic microscopy and its applications in biomedicine

Fourier ptychographic microscopy (FPM) is a promising and fast-growing computational imaging technique with high resolution, wide field-of-view (FOV) and quantitative phase recovery, which effectively tackles the problems of phase loss, aberration-introduced artifacts, narrow depth-of-field and the trade-off between resolution and FOV in conventional microscopy simultaneously. In this review, we provide a comprehensive roadmap of microscopy, the fundamental principles, advantages, and drawbacks of existing imaging techniques, and the significant roles that FPM plays in the development of science. Since FPM is an optimization problem in nature, we discuss the framework and related work. We also reveal the connection of Euler's formula between FPM and structured illumination microscopy. We review recent advances in FPM, including the implementation of high-precision quantitative phase imaging, high-throughput imaging, high-speed imaging, three-dimensional imaging, mixed-state decoupling, and introduce the prosperous biomedical applications. We conclude by discussing the challenging problems and future applications. FPM can be extended to a kind of framework to tackle the phase loss and system limits in the imaging system. This insight can be used easily in speckle imaging, incoherent imaging for retina imaging, large-FOV fluorescence imaging, etc.

Super-Resolution Lensless Imaging of Cells Using Brownian Motion

The lensless imaging technique, which integrates a microscope into a complementary metal oxide semiconductor (CMOS) digital image sensor, has become increasingly important for the miniaturization of biological microscope and cell detection equipment. However, limited by the pixel size of the CMOS image sensor (CIS), the resolution of a cell image without optical amplification is low. This is also a key defect with the lensless imaging technique, which has been studied by a many scholars. In this manuscript, we propose a method to improve the resolution of the cell images using the Brownian motion of living cells in liquid. A two-step algorithm of motion estimation for image registration is proposed. Then, the raw holographic images are reconstructed using normalized convolution super-resolution algorithm. The result shows that the effect of the collected cell image under the lensless imaging system is close to the effect of a 10× objective lens.

Low-coherent optical diffraction tomography by angle-scanning illumination

Temporally low-coherent optical diffraction tomography (ODT) is proposed and demonstrated based on angle-scanning Mach-Zehnder interferometry. Using a digital micromirror device based on diffractive tilting, the full-field interference of incoherent light is successfully maintained during every angle-scanning sequences. Further, current ODT reconstruction principles for temporally incoherent illuminations are thoroughly reviewed and developed. Several limitations of incoherent illumination are also discussed, such as the nondispersive assumption, optical sectioning capacity and illumination angle limitation. Using the proposed setup and reconstruction algorithms, low-coherent ODT imaging of plastic microspheres, human red blood cells and rat pheochromocytoma cells is experimentally demonstrated.

Biophysical investigation of living monocytes in flow by collaborative coherent imaging techniques

We implemented a completely label-free biophysical (morphometric and optical) property characterization of living monocytes in flow, using measurements obtained from two coherent imaging techniques: a pure light scattering approach to obtain an optical signature (OS) of cells, and a digital holography (DH) approach to achieve optical cell reconstructions in flow. A precise 3D cell alignment platform, taking advantage of viscoelastic fluid properties and microfluidic channel geometry, was used to investigate the OS of cells to achieve their refractive index, ratio of the nucleus over cytoplasm, and overall cell dimension. Further quantitative phase-contrast reconstructions by DH were employed to calculate surface area, dry mass, and biovolume of monocytes by using the OS outcomes as input parameters. The results show significantly different biophysical cell properties, confirming the possibility to differentiate monocytes from other cell classes in flow, thus avoiding chemical cell staining or labeling, which are nowadays used.

High-throughput intensity diffraction tomography with a computational microscope

We demonstrate a motion-free intensity diffraction tomography technique that enables the direct inversion of 3D phase and absorption from intensity-only measurements for weakly scattering samples. We derive a novel linear forward model featuring slice-wise phase and absorption transfer functions using angled illumination. This new framework facilitates flexible and efficient data acquisition, enabling arbitrary sampling of the illumination angles. The reconstruction algorithm performs 3D synthetic aperture using a robust computation and memory efficient slice-wise deconvolution to achieve resolution up to the incoherent limit. We demonstrate our technique with thick biological samples having both sparse 3D structures and dense cell clusters. We further investigate the limitation of our technique when imaging strongly scattering samples. Imaging performance and the influence of multiple scattering is evaluated using a 3D sample consisting of stacked phase and absorption resolution targets. This computational microscopy system is directly built on a standard commercial microscope with a simple LED array source add-on, and promises broad applications by leveraging the ubiquitous microscopy platforms with minimal hardware modifications.

Measurements of complex refractive index change of photoactive yellow protein over a wide wavelength range using hyperspectral quantitative phase imaging

A novel optical holographic technique is presented to simultaneously measure both the real and imaginary components of the complex refractive index (CRI) of a protein solution over a wide visible wavelength range. Quantitative phase imaging was employed to precisely measure the optical field transmitted from a protein solution, from which the CRIs of the protein solution were retrieved using the Fourier light scattering technique. Using this method, we characterized the CRIs of the two dominant structural states of a photoactive yellow protein solution over a broad wavelength range (461-582 nm). The significant CRI deviation between the two structural states was quantified and analysed. The results of both states show the similar overall shape of the expected rRI obtained from the Kramers-Kronig relations.

Tomographic phase microscopy: principles and applications in bioimaging [Invited]

Tomographic phase microscopy (TPM) is an emerging optical microscopic technique for bioimaging. TPM uses digital holographic measurements of complex scattered fields to reconstruct three-dimensional refractive index (RI) maps of cells with diffraction-limited resolution by solving inverse scattering problems. In this paper, we review the developments of TPM from the fundamental physics to its applications in bioimaging. We first provide a comprehensive description of the tomographic reconstruction physical models used in TPM. The RI map reconstruction algorithms and various regularization methods are discussed. Selected TPM applications for cellular imaging, particularly in hematology, are reviewed. Finally, we examine the limitations of current TPM systems, propose future solutions, and envision promising directions in biomedical research.

Holographic deep learning for rapid optical screening of anthrax spores

Establishing early warning systems for anthrax attacks is crucial in biodefense. Despite numerous studies for decades, the limited sensitivity of conventional biochemical methods essentially requires preprocessing steps and thus has limitations to be used in realistic settings of biological warfare. We present an optical method for rapid and label-free screening of Bacillus anthracis spores through the synergistic application of holographic microscopy and deep learning. A deep convolutional neural network is designed to classify holographic images of unlabeled living cells. After training, the network outperforms previous techniques in all accuracy measures, achieving single-spore sensitivity and subgenus specificity. The unique "representation learning" capability of deep learning enables direct training from raw images instead of manually extracted features. The method automatically recognizes key biological traits encoded in the images and exploits them as fingerprints. This remarkable learning ability makes the proposed method readily applicable to classifying various single cells in addition to B. anthracis, as demonstrated for the diagnosis of Listeria monocytogenes, without any modification. We believe that our strategy will make holographic microscopy more accessible to medical doctors and biomedical scientists for easy, rapid, and accurate point-of-care diagnosis of pathogens.

Holographic deep learning for rapid optical screening of anthrax spores

Establishing early warning systems for anthrax attacks is crucial in biodefense. Despite numerous studies for decades, the limited sensitivity of conventional biochemical methods essentially requires preprocessing steps and thus has limitations to be used in realistic settings of biological warfare. We present an optical method for rapid and label-free screening of Bacillus anthracis spores through the synergistic application of holographic microscopy and deep learning. A deep convolutional neural network is designed to classify holographic images of unlabeled living cells. After training, the network outperforms previous techniques in all accuracy measures, achieving single-spore sensitivity and subgenus specificity. The unique "representation learning" capability of deep learning enables direct training from raw images instead of manually extracted features. The method automatically recognizes key biological traits encoded in the images and exploits them as fingerprints. This remarkable learning ability makes the proposed method readily applicable to classifying various single cells in addition to B. anthracis, as demonstrated for the diagnosis of Listeria monocytogenes, without any modification. We believe that our strategy will make holographic microscopy more accessible to medical doctors and biomedical scientists for easy, rapid, and accurate point-of-care diagnosis of pathogens.

Effects of spatiotemporal coherence on interferometric microscopy

Illumination coherence plays a major role in various imaging systems, from microscopy, metrology, digital holography, optical coherence tomography, to ultrasound imaging. Here, we present a systematic study on the effects of degrees of spatiotemporal coherence of an illumination (DSTCI) on imaging quality of interferometric microscopy. An optical field with arbitrary DSTCI was decomposed into wavelets with constituent spatiotemporal frequencies, and the effects on image quality were quantitatively investigated. The results show the synergistic effects on reduction of speckle noise when DSTCI is decreased. This study presents a method to systematically control DSTCI, and the result provides an essential reference on the effects of DSTCI on the imaging quality. We believe that the presented methods and results can be implemented in various imaging systems for characterizing and improving the imaging quality.

Quantitative phase imaging for medical diagnosis

Optical microscopy is an indispensable diagnostic tool in modern healthcare. As a prime example, pathologists rely exclusively on light microscopy to investigate tissue morphology in order to make a diagnosis. While advances in light microscopy and contrast markers allow pathologists to visualize cells and tissues in unprecedented detail, the interpretation of these images remains largely subjective, leading to inter- and intra-observer discrepancy. Furthermore, conventional microscopy images capture qualitative information which makes it difficult to automate the process, reducing the throughput achievable in the diagnostic workflow. Quantitative Phase Imaging (QPI) techniques have been advanced in recent years to address these two challenges. By quantifying physical parameters of cells and tissues, these systems remove subjectivity from the disease diagnosis process and allow for easier automation to increase throughput. In addition to providing quantitative information, QPI systems are also label-free and can be easily assimilated into the current diagnostic workflow in the clinic. In this paper we review the advances made in disease diagnosis by QPI techniques. We focus on the areas of hematological diagnosis and cancer pathology, which are the areas where most significant advances have been made to date. [Image adapted from Y. Park, M. Diez-Silva, G. Popescu, G. Lykotrafitis, W. Choi, M. S. Feld, and S. Suresh, Proc. Natl. Acad. Sci. 105, 13730-13735 (2008).].

Active illumination using a digital micromirror device for quantitative phase imaging

We present a powerful and cost-effective method for active illumination using a digital micromirror device (DMD) for quantitative phase-imaging techniques. Displaying binary illumination patterns on a DMD with appropriate spatial filtering, plane waves with various illumination angles are generated and impinged onto a sample. Complex optical fields of the sample obtained with various incident angles are then measured via Mach-Zehnder interferometry, from which a high-resolution 2D synthetic aperture phase image and a 3D refractive index tomogram of the sample are reconstructed. We demonstrate the fast and stable illumination-control capability of the proposed method by imaging colloidal spheres and biological cells. The capability of high-speed optical diffraction tomography is also demonstrated by measuring 3D Brownian motion of colloidal particles with the tomogram acquisition rate of 100 Hz.

Label-free identification of individual bacteria using Fourier transform light scattering

Rapid identification of bacterial species is crucial in medicine and food hygiene. In order to achieve rapid and label-free identification of bacterial species at the single bacterium level, we propose and experimentally demonstrate an optical method based on Fourier transform light scattering (FTLS) measurements and statistical classification. For individual rod-shaped bacteria belonging to four bacterial species (Listeria monocytogenes, Escherichia coli, Lactobacillus casei, and Bacillus subtilis), two-dimensional angle-resolved light scattering maps are precisely measured using FTLS technique. The scattering maps are then systematically analyzed, employing statistical classification in order to extract the unique fingerprint patterns for each species, so that a new unidentified bacterium can be identified by a single light scattering measurement. The single-bacterial and label-free nature of our method suggests wide applicability for rapid point-of-care bacterial diagnosis.

High numerical aperture Fourier ptychography: principle, implementation and characterization

Fourier ptychography (FP) utilizes illumination control and computational post-processing to increase the resolution of bright-field microscopes. In effect, FP extends the fixed numerical aperture (NA) of an objective lens to form a larger synthetic system NA. Here, we build an FP microscope (FPM) using a 40X 0.75NA objective lens to synthesize a system NA of 1.45. This system achieved a two-slit resolution of 335 nm at a wavelength of 632 nm. This resolution closely adheres to theoretical prediction and is comparable to the measured resolution (315 nm) associated with a standard, commercially available 1.25 NA oil immersion microscope. Our work indicates that Fourier ptychography is an attractive method to improve the resolution-versus-NA performance, increase the working distance, and enlarge the field-of-view of high-resolution bright-field microscopes by employing lower NA objectives.

Biomedical applications of holographic microspectroscopy [invited]

The identification and quantification of specific molecules are crucial for studying the pathophysiology of cells, tissues, and organs as well as diagnosis and treatment of diseases. Recent advances in holographic microspectroscopy, based on quantitative phase imaging or optical coherence tomography techniques, show promise for label-free noninvasive optical detection and quantification of specific molecules in living cells and tissues (e.g., hemoglobin protein). To provide important insight into the potential employment of holographic spectroscopy techniques in biological research and for related practical applications, we review the principles of holographic microspectroscopy techniques and highlight recent studies.

Quantitative phase imaging unit

A simple and cost-effective method is presented for quantitative phase imaging. A common-path lateral phase shifting interferometer is realized through attaching a compact filter set to the output port of an existing microscope. The working principles, design criteria, and limitations are also derived and explained. In order to demonstrate the capability and applicability of the method, the optical phase images of a microsphere and individual human red blood cells are measured with high stability.

Angle-resolved light scattering of individual rod-shaped bacteria based on Fourier transform light scattering

Two-dimensional angle-resolved light scattering maps of individual rod-shaped bacteria are measured at the single-cell level. Using quantitative phase imaging and Fourier transform light scattering techniques, the light scattering patterns of individual bacteria in four rod-shaped species (Bacillus subtilis, Lactobacillus casei, Synechococcus elongatus, and Escherichia coli) are measured with unprecedented sensitivity in a broad angular range from −70° to 70°. The measured light scattering patterns are analyzed along the two principal axes of rod-shaped bacteria in order to systematically investigate the species-specific characteristics of anisotropic light scattering. In addition, the cellular dry mass of individual bacteria is calculated and used to demonstrate that the cell-to-cell variations in light scattering within bacterial species is related to the cellular dry mass and growth.

Fluorescence imaging of nanoscale domains in polymer blends using stochastic optical reconstruction microscopy (STORM)

High-resolution fluorescence techniques that provide spatial resolution below the diffraction limit are attractive new methods for structural characterization of nanostructured materials. For the first time, we apply the super-resolution technique of Stochastic Optical Reconstruction Microscopy (STORM), to characterize nanoscale structures within polymer blend films. The STORM technique involves temporally separating the fluorescence signals from individual labeled polymers, allowing their positions to be localized with high accuracy, yielding a high-resolution composite image of the material. Here, we describe the application of the technique to demixed blend films of polystyrene (PS) and poly(methyl methacrylate) (PMMA), and find that STORM provides comparable structural characteristics as those determined by Atomic Force Microscopy (AFM) and scanning electron microscopy (SEM), but with all of the advantages of a far-field optical technique.

Spectro-angular light scattering measurements of individual microscopic objects

The spectro-angular light scattering measurements of individual microscopic objects are presented. Using spectroscopic quantitative phase microscopy and Fourier transform light scattering, the 2D angle-resolved light scattering intensity and phase patterns are measured in a spectral range of 450-750 nm and an angular range of -70-70°. The spectro-angular light scattering measurements of individual polystyrene beads are demonstrated with high sensitivity and precision.

Real-time visualization of 3-D dynamic microscopic objects using optical diffraction tomography

3-D refractive index (RI) distribution is an intrinsic bio-marker for the chemical and structural information about biological cells. Here we develop an optical diffraction tomography technique for the real-time reconstruction of 3-D RI distribution, employing sparse angle illumination and a graphic processing unit (GPU) implementation. The execution time for the tomographic reconstruction is 0.21 s for 96(3) voxels, which is 17 times faster than that of a conventional approach. We demonstrated the real-time visualization capability with imaging the dynamics of Brownian motion of an anisotropic colloidal dimer and the dynamic shape change in a red blood cell upon shear flow.

Phase retrieval with resolution enhancement by using structured illumination

In this Letter, we present referenceless phase retrieval methods with resolution enhancement. Structured illuminations with different orientations and phase shifts are generated by a spatial light modulator and are used to illuminate the specimen. The generated diffraction patterns are recorded by a CCD camera, and the phase of the wavefront is reconstructed from these patterns.

Spectro-refractometry of individual microscopic objects using swept-source quantitative phase imaging

We present a novel spectroscopic quantitative phase imaging technique with a wavelength swept-source, referred to as swept-source diffraction phase microscopy (ssDPM), for quantifying the optical dispersion of microscopic individual samples. Employing the swept-source and the principle of common-path interferometry, ssDPM measures the multispectral full-field quantitative phase imaging and spectroscopic microrefractometry of transparent microscopic samples in the visible spectrum with a wavelength range of 450-750 nm and a spectral resolution of less than 8 nm. With unprecedented precision and sensitivity, we demonstrate the quantitative spectroscopic microrefractometry of individual polystyrene beads, 30% bovine serum albumin solution, and healthy human red blood cells.