Fourier ptychography: current applications and future promises

Classifying breast cancer and fibroadenoma tissue biopsies from paraffined stain-free slides by fractal biomarkers in Fourier Ptychographic Microscopy

Breast cancer is one of the most spread and monitored pathologies in high-income countries. After breast biopsy, histological tissue is stored in paraffin, sectioned and mounted. Conventional inspection of tissue slides under benchtop light microscopes involves paraffin removal and staining, typically with H&E. Then, expert pathologists are called to judge the stained slides. However, paraffin removal and staining are operator-dependent, time and resources consuming processes that can generate ambiguities due to non-uniform staining. Here we propose a novel method that can work directly on paraffined stain-free slides. We use Fourier Ptychography as a quantitative phase-contrast microscopy method, which allows accessing a very wide field of view (i.e., mm2) in one single image while guaranteeing high lateral resolution (i.e., 0.5 µm). This imaging method is multi-scale, since it enables looking at the big picture, i.e. the complex tissue structure and connections, with the possibility to zoom-in up to the single-cell level. To handle this informative image content, we introduce elements of fractal geometry as multi-scale analysis method. We show the effectiveness of fractal features in describing and classifying fibroadenoma and breast cancer tissue slides from ten patients with very high accuracy. We reach 94.0 ± 4.2% test accuracy in classifying single images. Above all, we show that combining the decisions of the single images, each patient's slide can be classified with no error. Besides, fractal geometry returns a guide map to help pathologist to judge the different tissue portions based on the likelihood these can be associated to a breast cancer or fibroadenoma biomarker. The proposed automatic method could significantly simplify the steps of tissue analysis and make it independent from the sample preparation, the skills of the lab operator and the pathologist.

Efficient, gigapixel-scale, aberration-free whole slide scanner using angular ptychographic imaging with closed-form solution

Whole slide imaging provides a wide field-of-view (FOV) across cross-sections of biopsy or surgery samples, significantly facilitating pathological analysis and clinical diagnosis. Such high-quality images that enable detailed visualization of cellular and tissue structures are essential for effective patient care and treatment planning. To obtain such high-quality images for pathology applications, there is a need for scanners with high spatial bandwidth products, free from aberrations, and without the requirement for z-scanning. Here we report a whole slide imaging system based on angular ptychographic imaging with a closed-form solution (WSI-APIC), which offers efficient, tens-of-gigapixels, large-FOV, aberration-free imaging. WSI-APIC utilizes oblique incoherent illumination for initial high-level segmentation, thereby bypassing unnecessary scanning of the background regions and enhancing image acquisition efficiency. A GPU-accelerated APIC algorithm analytically reconstructs phase images with effective digital aberration corrections and improved optical resolutions. Moreover, an auto-stitching technique based on scale-invariant feature transform ensures the seamless concatenation of whole slide phase images. In our experiment, WSI-APIC achieved an optical resolution of 772 nm using a 10×/0.25 NA objective lens and captures 80-gigapixel aberration-free phase images for a standard 76.2 mm × 25.4 mm microscopic slide.

White Light Diffraction Phase Microscopy in Imaging of Breast and Colon Tissues

This paper reports results obtained using white light diffraction phase microscopy (wDPM) on captured images of breast and colon tissue samples, marking a contribution to the advancement in biomedical imaging. Unlike conventional brightfield microscopy, wDPM offers the capability to capture intricate details of biological specimens with enhanced clarity and precision. It combines high resolution, enhanced contrast, and quantitative capabilities with non-invasive, label-free imaging. These features make it a useful tool for tissue imaging, providing detailed and accurate insights into tissue structure and dynamics without compromising the integrity of the samples. Our findings underscore the potential of quantitative phase imaging in histopathology, in the context of automating the process of tissue analysis and diagnosis. Of particular note are the insights gained from the reconstructed phase images, which provide physical data regarding peripheral glandular cell membranes. These observations serve to focus attention on pathologies involving the basal membrane, such as early invasive carcinoma. Through our analysis, we aim to contribute to catalyzing further advancements in tissue (breast and colon) imaging.

Neural network-based processing and reconstruction of compromised biophotonic image data

In recent years, the integration of deep learning techniques with biophotonic setups has opened new horizons in bioimaging. A compelling trend in this field involves deliberately compromising certain measurement metrics to engineer better bioimaging tools in terms of e.g., cost, speed, and form-factor, followed by compensating for the resulting defects through the utilization of deep learning models trained on a large amount of ideal, superior or alternative data. This strategic approach has found increasing popularity due to its potential to enhance various aspects of biophotonic imaging. One of the primary motivations for employing this strategy is the pursuit of higher temporal resolution or increased imaging speed, critical for capturing fine dynamic biological processes. Additionally, this approach offers the prospect of simplifying hardware requirements and complexities, thereby making advanced imaging standards more accessible in terms of cost and/or size. This article provides an in-depth review of the diverse measurement aspects that researchers intentionally impair in their biophotonic setups, including the point spread function (PSF), signal-to-noise ratio (SNR), sampling density, and pixel resolution. By deliberately compromising these metrics, researchers aim to not only recuperate them through the application of deep learning networks, but also bolster in return other crucial parameters, such as the field of view (FOV), depth of field (DOF), and space-bandwidth product (SBP). Throughout this article, we discuss various biophotonic methods that have successfully employed this strategic approach. These techniques span a wide range of applications and showcase the versatility and effectiveness of deep learning in the context of compromised biophotonic data. Finally, by offering our perspectives on the exciting future possibilities of this rapidly evolving concept, we hope to motivate our readers from various disciplines to explore novel ways of balancing hardware compromises with compensation via artificial intelligence (AI).

Approaching Maximum Resolution in Structured Illumination Microscopy via Accurate Noise Modeling

Biological images captured by microscopes are characterized by heterogeneous signal-to-noise ratios (SNRs) due to spatially varying photon emission across the field of view convoluted with camera noise. State-of-the-art unsupervised structured illumination microscopy (SIM) reconstruction algorithms, commonly implemented in the Fourier domain, do not accurately model this noise and suffer from high-frequency artifacts, user-dependent choices of smoothness constraints making assumptions on biological features, and unphysical negative values in the recovered fluorescence intensity map. On the other hand, supervised methods rely on large datasets for training, and often require retraining for new sample structures. Consequently, achieving high contrast near the maximum theoretical resolution in an unsupervised, physically principled, manner remains an open problem. Here, we propose Bayesian-SIM (B-SIM), an unsupervised Bayesian framework to quantitatively reconstruct SIM data, rectifying these shortcomings by accurately incorporating known noise sources in the spatial domain. To accelerate the reconstruction process, we use the finite extent of the point-spread-function to devise a parallelized Monte Carlo strategy involving chunking and restitching of the inferred fluorescence intensity. We benchmark our framework on both simulated and experimental images, and demonstrate improved contrast permitting feature recovery at up to 25% shorter length scales over state-of-the-art methods at both high- and low-SNR. B-SIM enables unsupervised, quantitative, physically accurate reconstruction without the need for labeled training data, democratizing high-quality SIM reconstruction and expands the capabilities of live-cell SIM to lower SNR, potentially revealing biological features in previously inaccessible regimes.

Anisotropic regularization for sparsely sampled and noise-robust Fourier ptychography

Fourier ptychography (FP) is a powerful computational imaging technique that provides super-resolution and quantitative phase imaging capabilities by scanning samples in Fourier space with angle-varying illuminations. However, the image reconstruction in FP is inherently ill-posed, particularly when the measurements are noisy and have insufficient data redundancy in the Fourier space. To improve FP reconstruction in high-throughput imaging scenarios, we propose a regularized FP reconstruction algorithm utilizing anisotropic total variation (TV) and Tikhonov regularizations for the object and pupil functions, respectively. To solve this regularized FP problem, we formulate a reconstruction algorithm using the alternating direction method of multipliers and show that our approach successfully recovers high-quality images with sparsely sampled and/or noisy measurements. The results are quantitatively and qualitatively compared against various FP reconstruction algorithms to analyze the effect of regularization under harsh imaging conditions. In particular, we demonstrate the effectiveness of our method on the real experimental FP microscopy images, where the TV regularizer effectively suppresses the measurement noise while maintaining the edge information in the biological specimen and helps retrieve the correct amplitude and phase images even under insufficient sampling.

Fourier ptychographic microscopy with adaptive resolution strategy

Fourier ptychographic microscopy (FPM) is a method capable of reconstructing a high-resolution, wide field-of-view (FOV) image, where dark-field images provide the high-frequency information required for the iterative process. Theoretically, using more dark-field images can lead to results with higher resolution. However, the resolution required to clearly detect samples with different microscales varies. For certain samples, the limit resolution of the imaging system may exceed the one required to resolve the details. This suggests that simply increasing the number of dark-field images will not improve the recognition capability for such samples and may instead significantly increase the computational cost. To address this issue, this Letter proposes an adaptive resolution strategy that automatically assigns the resolution required for the sample. Based on a Tenengrad approach, this strategy determines the number of images required for reconstruction by evaluating a series of differential images among the reconstructions for a certain subregion and then efficiently completes the full-FOV reconstruction according to the determined resolution. We conducted the full-FOV reconstruction utilizing feature-domain FPM for both the USAF resolution test chart and a human red blood cell sample. Employing the adaptive resolution strategy, the preservation of reconstruction resolution can be ensured while respectively economizing approximately 76% and 89% of the time.

Quantitative phase imaging based on holography: trends and new perspectives

In 1948, Dennis Gabor proposed the concept of holography, providing a pioneering solution to a quantitative description of the optical wavefront. After 75 years of development, holographic imaging has become a powerful tool for optical wavefront measurement and quantitative phase imaging. The emergence of this technology has given fresh energy to physics, biology, and materials science. Digital holography (DH) possesses the quantitative advantages of wide-field, non-contact, precise, and dynamic measurement capability for complex-waves. DH has unique capabilities for the propagation of optical fields by measuring light scattering with phase information. It offers quantitative visualization of the refractive index and thickness distribution of weak absorption samples, which plays a vital role in the pathophysiology of various diseases and the characterization of various materials. It provides a possibility to bridge the gap between the imaging and scattering disciplines. The propagation of wavefront is described by the complex amplitude. The complex-value in the complex-domain is reconstructed from the intensity-value measurement by camera in the real-domain. Here, we regard the process of holographic recording and reconstruction as a transformation between complex-domain and real-domain, and discuss the mathematics and physical principles of reconstruction. We review the DH in underlying principles, technical approaches, and the breadth of applications. We conclude with emerging challenges and opportunities based on combining holographic imaging with other methodologies that expand the scope and utility of holographic imaging even further. The multidisciplinary nature brings technology and application experts together in label-free cell biology, analytical chemistry, clinical sciences, wavefront sensing, and semiconductor production.

Multimodal 2D and 3D microscopic mapping of growth cartilage by computational imaging techniques - a short review including new research

Being able to image the microstructure of growth cartilage is important for understanding the onset and progression of diseases such as osteochondrosis and osteoarthritis, as well as for developing new treatments and implants. Studies of cartilage using conventional optical brightfield microscopy rely heavily on histological staining, where the added chemicals provide tissue-specific colours. Other microscopy contrast mechanisms include polarization, phase- and scattering contrast, enabling non-stained or 'label-free' imaging that significantly simplifies the sample preparation, thereby also reducing the risk of artefacts. Traditional high-performance microscopes tend to be both bulky and expensive.Computational imagingdenotes a range of techniques where computers with dedicated algorithms are used as an integral part of the image formation process. Computational imaging offers many advantages like 3D measurements, aberration correction and quantitative phase contrast, often combined with comparably cheap and compact hardware. X-ray microscopy is also progressing rapidly, in certain ways trailing the development of optical microscopy. In this study, we first briefly review the structures of growth cartilage and relevant microscopy characterization techniques, with an emphasis on Fourier ptychographic microscopy (FPM) and advanced x-ray microscopies. We next demonstrate with our own results computational imaging through FPM and compare the images with hematoxylin eosin and saffron (HES)-stained histology. Zernike phase contrast, and the nonlinear optical microscopy techniques of second harmonic generation (SHG) and two-photon excitation fluorescence (TPEF) are explored. Furthermore, X-ray attenuation-, phase- and diffraction-contrast computed tomography (CT) images of the very same sample are presented for comparisons. Future perspectives on the links to artificial intelligence, dynamic studies andin vivopossibilities conclude the article.

High-resolution, large field-of-view label-free imaging via aberration-corrected, closed-form complex field reconstruction

Computational imaging methods empower modern microscopes to produce high-resolution, large field-of-view, aberration-free images. Fourier ptychographic microscopy can increase the space-bandwidth product of conventional microscopy, but its iterative reconstruction methods are prone to parameter selection and tend to fail under excessive aberrations. Spatial Kramers-Kronig methods can analytically reconstruct complex fields, but is limited by aberration or providing extended resolution enhancement. Here, we present APIC, a closed-form method that weds the strengths of both methods while using only NA-matching and darkfield measurements. We establish an analytical phase retrieval framework which demonstrates the feasibility of analytically reconstructing the complex field associated with darkfield measurements. APIC can retrieve complex aberrations of an imaging system with no additional hardware and avoids iterative algorithms, requiring no human-designed convergence metrics while always obtaining a closed-form complex field solution. We experimentally demonstrate that APIC gives correct reconstruction results where Fourier ptychographic microscopy fails when constrained to the same number of measurements. APIC achieves 2.8 times faster computation using image tile size of 256 (length-wise), is robust against aberrations compared to Fourier ptychographic microscopy, and capable of addressing aberrations whose maximal phase difference exceeds 3.8π when using a NA 0.25 objective in experiment.

Spatially-coded Fourier ptychography: flexible and detachable coded thin films for quantitative phase imaging with uniform phase transfer characteristics

Fourier ptychography (FP) is an enabling imaging technique that produces high-resolution complex-valued images with extended field coverages. However, when FP images a phase object with any specific spatial frequency, the captured images contain only constant values, rendering the recovery of the corresponding linear phase ramp impossible. This challenge is not unique to FP but also affects other common microscopy techniques -- a rather counterintuitive outcome given their widespread use in phase imaging. The underlying issue originates from the non-uniform phase transfer characteristic inherent in microscope systems, which impedes the conversion of object wavefields into discernible intensity variations. To address this challenge, we present spatially-coded Fourier ptychography (scFP), a new method that synergizes FP with spatial-domain coded detection for true quantitative phase imaging. In scFP, a flexible and detachable coded thin film is attached atop the image sensor in a regular FP setup. The spatial modulation of this thin film ensures a uniform phase response across the entire synthetic bandwidth. It improves reconstruction quality and corrects refractive index underestimation issues prevalent in conventional FP and related tomographic implementations. The inclusion of the coded thin film further adds a new dimension of measurement diversity in the spatial domain. The development of scFP is expected to catalyse new research directions and applications for phase imaging, emphasizing the need for true quantitative accuracy with uniform frequency response.

Lens-free reflective topography for high-resolution wafer inspection

The demand for high-resolution and large-area imaging systems for non-destructive wafer inspection has grown owing to the increasing complexity and extremely fine nature of semiconductor processes. Several studies have focused on developing high-resolution imaging systems; however, they were limited by the tradeoff between image resolution and field of view. Hence, computational imaging has arisen as an alternative method to conventional optical imaging, aimed at enhancing the aforementioned parameters. This study proposes a method for improving the resolution and field of view of an image in a lens-less reflection-type system. Our method was verified by computationally restoring the final image from diffraction images measured at various illumination positions using a visible light source. We introduced speckle illumination to expand the numerical aperture of the entire system, simultaneously improving image resolution and field of view. The image reconstruction process was accelerated by employing a convolutional neural network. Using the reconstructed phase images, we implemented high-resolution topography and demonstrated its applicability in wafer surface inspection. Furthermore, we demonstrated an ideal diffraction-limited spatial resolution of 1.7 μm over a field of view of 1.8 × 1.8 mm2 for the topographic imaging of targets with various surface roughness. The proposed approach is suitable for applications that simultaneously require high throughput and resolution, such as wafer-wide integrated metrology, owing to its compact design, cost-effectiveness, and mechanical robustness.

Noise-robust latent vector reconstruction in ptychography using deep generative models

Computational imaging is increasingly vital for a broad spectrum of applications, ranging from biological to material sciences. This includes applications where the object is known and sufficiently sparse, allowing it to be described with a reduced number of parameters. When no explicit parameterization is available, a deep generative model can be trained to represent an object in a low-dimensional latent space. In this paper, we harness this dimensionality reduction capability of autoencoders to search for the object solution within the latent space rather than the object space. We demonstrate what we believe to be a novel approach to ptychographic image reconstruction by integrating a deep generative model obtained from a pre-trained autoencoder within an automatic differentiation ptychography (ADP) framework. This approach enables the retrieval of objects from highly ill-posed diffraction patterns, offering an effective method for noise-robust latent vector reconstruction in ptychography. Moreover, the mapping into a low-dimensional latent space allows us to visualize the optimization landscape, which provides insight into the convexity and convergence behavior of the inverse problem. With this work, we aim to facilitate new applications for sparse computational imaging such as when low radiation doses or rapid reconstructions are essential.

Redundant information model for Fourier ptychographic microscopy

Fourier ptychographic microscopy (FPM) is a computational optical imaging technique that overcomes the traditional trade-off between resolution and field of view (FOV) by exploiting abundant redundant information in both spatial and frequency domains for high-quality image reconstruction. However, the redundant information in FPM remains ambiguous or abstract, which presents challenges to further enhance imaging capabilities and deepen our understanding of the FPM technique. Inspired by Shannon's information theory and extensive experimental experience in FPM, we defined the specimen complexity and reconstruction algorithm utilization rate and reported a model of redundant information for FPM to predict reconstruction results and guide the optimization of imaging parameters. The model has been validated through extensive simulations and experiments. In addition, it provides a useful tool to evaluate different algorithms, revealing a utilization rate of 24%±1% for the Gauss-Newton algorithm, LED Multiplexing, Wavelength Multiplexing, EPRY-FPM, and GS. In contrast, mPIE exhibits a lower utilization rate of 19%±1%.

Deep learning at the edge enables real-time streaming ptychographic imaging

Coherent imaging techniques provide an unparalleled multi-scale view of materials across scientific and technological fields, from structural materials to quantum devices, from integrated circuits to biological cells. Driven by the construction of brighter sources and high-rate detectors, coherent imaging methods like ptychography are poised to revolutionize nanoscale materials characterization. However, these advancements are accompanied by significant increase in data and compute needs, which precludes real-time imaging, feedback and decision-making capabilities with conventional approaches. Here, we demonstrate a workflow that leverages artificial intelligence at the edge and high-performance computing to enable real-time inversion on X-ray ptychography data streamed directly from a detector at up to 2 kHz. The proposed AI-enabled workflow eliminates the oversampling constraints, allowing low-dose imaging using orders of magnitude less data than required by traditional methods.

Fast and robust Fourier ptychographic microscopy with position misalignment correction

Significance

Fourier ptychographic microscopy (FPM) is a new, developing computational imaging technology. It can realize the quantitative phase imaging of a wide field of view and high-resolution (HR) simultaneously by means of multi-angle illumination via a light emitting diode (LED) array, combined with a phase recovery algorithm and the synthetic aperture principle. However, in the FPM reconstruction process, LED position misalignment affects the quality of the reconstructed image, and the reconstruction efficiency of the existing LED position correction algorithms needs to be improved.

Aim

This study aims to improve the FPM correction method based on simulated annealing (SA) and proposes a position misalignment correction method (AA-C algorithm) using an improved phase recovery strategy.

Approach

The spectrum function update strategy was optimized by adding an adaptive control factor, and the reconstruction efficiency of the algorithm was improved.

Results

The experimental results show that the proposed method is effective and robust for position misalignment correction of LED arrays in FPM, and the convergence speed can be improved by 21.2% and 54.9% compared with SC-FPM and PC-FPM, respectively.

Conclusions

These results can reduce the requirement of the FPM system for LED array accuracy and improve robustness.

Long-range Fourier ptychographic imaging of the dynamic object with a single camera

Fourier ptychographic imaging technology is a new imaging method proposed in recent years. This technology captures multiple low-resolution images, and synthesizes them into a high-resolution image in the Fourier domain by a phase retrieval algorithm, breaking through the diffraction limit of the lens. In the field of macroscopic Fourier ptychographic imaging, most of the existing research generally focus on high-resolution imaging of static objects, and applying Fourier ptychographic imaging technology to dynamic objects is a hot research area now. At present, most of the researches are to use camera arrays combined with multiplexed lighting, deep learning or other algorithms, but the implementation of these methods is complicated or costly. Based on the diffraction theory of Fourier optics, this paper proposes that by expanding and focusing the illumination area, we can apply Fourier ptychographic imaging technology with a single camera to moving objects within a certain range. Theoretical analysis and experiments prove the feasibility of the proposed method. We successfully achieve high-resolution imaging of the dynamic object, increasing the resolution by about 2.5 times. This paper also researches the impact of speckles in the illuminated area on imaging results and proposes a processing method to reduce the impact of speckles.

Unsupervised adaptive coded illumination Fourier ptychographic microscopy based on a physical neural network

Fourier Ptychographic Microscopy (FPM) is a computational technique that achieves a large space-bandwidth product imaging. It addresses the challenge of balancing a large field of view and high resolution by fusing information from multiple images taken with varying illumination angles. Nevertheless, conventional FPM framework always suffers from long acquisition time and a heavy computational burden. In this paper, we propose a novel physical neural network that generates an adaptive illumination mode by incorporating temporally-encoded illumination modes as a distinct layer, aiming to improve the acquisition and calculation efficiency. Both simulations and experiments have been conducted to validate the feasibility and effectiveness of the proposed method. It is worth mentioning that, unlike previous works that obtain the intensity of a multiplexed illumination by post-combination of each sequentially illuminated and obtained low-resolution images, our experimental data is captured directly by turning on multiple LEDs with a coded illumination pattern. Our method has exhibited state-of-the-art performance in terms of both detail fidelity and imaging velocity when assessed through a multitude of evaluative aspects.

Hybrid full-pose parameter calibration of a freeform illuminator for Fourier ptychographic microscopy

As a typical computational method, Fourier ptychographic microscopy (FPM) can realize high spatial resolution and quantitative phase imaging while preserving the large field of view with a low numerical aperture (NA) objective. A programmable light-emitting diode (LED) array is used as a typical illuminator in an FPM system, and the illumination parameters of each LED element are crucial to the success of the FPM reconstruction algorithm. Compared with LED arrays arranged in rectangular arrays, LED arrays with special structures such as domes or rings can effectively improve FPM imaging results and imaging efficiency. As a trade-off, their calibration difficulty is greatly increased due to the lack of geometric constraints of rectangular arrays. In this paper, we propose an effective hybrid full-pose parameter calibration method for freeform LED array illuminators, combining stereoscopic 3D imaging techniques and the geometric constraints of the microscopic platform. First, a stereovision system is used to obtain the accurate 3D position of each LED element of the freeform illuminator and to construct a rigid 3D coordinate LED array system. Then, calibration between the coordinate system of the LED array and that of the optical imaging component is realized according to the geometric features of the brightfield-to-darkfield edges. Finally, we verify the feasibility and effectiveness of the proposed method through full-pose parameter calibration of LED arrays with different arrangement rules.

A Physics-Inspired Deep Learning Framework for an Efficient Fourier Ptychographic Microscopy Reconstruction under Low Overlap Conditions

Two-dimensional observation of biological samples at hundreds of nanometers resolution or even below is of high interest for many sensitive medical applications. Recent advances have been obtained over the last ten years with computational imaging. Among them, Fourier Ptychographic Microscopy is of particular interest because of its important super-resolution factor. In complement to traditional intensity images, phase images are also produced. A large set of N raw images (with typically N = 225) is, however, required because of the reconstruction process that is involved. In this paper, we address the problem of FPM image reconstruction using a few raw images only (here, N = 37) as is highly desirable to increase microscope throughput. In contrast to previous approaches, we develop an algorithmic approach based on a physics-informed optimization deep neural network and statistical reconstruction learning. We demonstrate its efficiency with the help of simulations. The forward microscope image formation model is explicitly introduced in the deep neural network model to optimize its weights starting from an initialization that is based on statistical learning. The simulation results that are presented demonstrate the conceptual benefits of the approach. We show that high-quality images are effectively reconstructed without any appreciable resolution degradation. The learning step is also shown to be mandatory.

Image reconstruction for low cost spatial light interference microscopy with fixed and arbitrary phase modulation

During the past decade, spatial light interference microscopy (SLIM) has undergone rapid development, evidenced by its broadening applications in biology and medicine. However, the need for an expensive spatial light modulator (SLM) may limit its adoption, and the requirement for multiple images per plane limits its speed in volumetric imaging. Here we propose to address these issues by replacing the SLM with a mask fabricated from a low cost optical density (OD) filter, and recover high contrast images computationally rather than through phase-shifting. This is done using a specially constructed Wiener filter to recover the object scattering potential. A crucial part of the Wiener filter is estimating the arbitrary phase introduced by the OD filter. Our results demonstrate that not only were we able to estimate the OD filter's phase modulation in situ, but also the contrast of the reconstructed images is greatly improved. Comparisons with other related methods are also performed, with the conclusion that the combination of an inexpensive OD mask and modified Wiener filtering leads to results that are closest to the traditional SLIM setup. Thus, we have demonstrated the feasibility of a low cost, high speed SLIM system utilizing computational phase reconstruction, paving the way for wider adoption of high resolution phase microscopy.

Reflectional quantitative differential phase microscopy using polarized wavefront phase modulation

Quantitative phase microscopy (QPM), as a label-free and nondestructive technique, has been playing an indispensable tool in biomedical imaging and industrial inspection. Herein, we introduce a reflectional quantitative differential phase microscopy (termed RQDPM) based on polarized wavefront phase modulation and partially coherent full-aperture illumination, which has high spatial resolution and spatio-temporal phase sensitivity and is applicable to opaque surfaces and turbid biological specimens. RQDPM does not require additional polarized devices and can be easily switched from reflectional mode to transmission mode. In addition, RQDPM inherits the characteristic of high axial resolution of differential interference contrast microscope, thereby providing topography for opaque surfaces. We experimentally demonstrate the reflectional phase imaging ability of RQDPM with several samples: semiconductor wafer, thick biological tissues, red blood cells, and Hela cells. Furthermore, we dynamically monitor the flow state of microspheres in a self-built microfluidic channel by using RQDPM converted into the transmission mode.

Spatial- and Fourier-domain ptychography for high-throughput bio-imaging

First envisioned for determining crystalline structures, ptychography has become a useful imaging tool for microscopists. However, ptychography remains underused by biomedical researchers due to its limited resolution and throughput in the visible light regime. Recent developments of spatial- and Fourier-domain ptychography have successfully addressed these issues and now offer the potential for high-resolution, high-throughput optical imaging with minimal hardware modifications to existing microscopy setups, often providing an excellent trade-off between resolution and field of view inherent to conventional imaging systems, giving biomedical researchers the best of both worlds. Here, we provide extensive information to enable the implementation of ptychography by biomedical researchers in the visible light regime. We first discuss the intrinsic connections between spatial-domain coded ptychography and Fourier ptychography. A step-by-step guide then provides the user instructions for developing both systems with practical examples. In the spatial-domain implementation, we explain how a large-scale, high-performance blood-cell lens can be made at negligible expense. In the Fourier-domain implementation, we explain how adding a low-cost light source to a regular microscope can improve the resolution beyond the limit of the objective lens. The turnkey operation of these setups is suitable for use by professional research laboratories, as well as citizen scientists. Users with basic experience in optics and programming can build the setups within a week. The do-it-yourself nature of the setups also allows these procedures to be implemented in laboratory courses related to Fourier optics, biomedical instrumentation, digital image processing, robotics and capstone projects.

PtyLab.m/py/jl: a cross-platform, open-source inverse modeling toolbox for conventional and Fourier ptychography

Conventional (CP) and Fourier (FP) ptychography have emerged as versatile quantitative phase imaging techniques. While the main application cases for each technique are different, namely lens-less short wavelength imaging for CP and lens-based visible light imaging for FP, both methods share a common algorithmic ground. CP and FP have in part independently evolved to include experimentally robust forward models and inversion techniques. This separation has resulted in a plethora of algorithmic extensions, some of which have not crossed the boundary from one modality to the other. Here, we present an open source, cross-platform software, called PtyLab, enabling both CP and FP data analysis in a unified framework. With this framework, we aim to facilitate and accelerate cross-pollination between the two techniques. Moreover, the availability in Matlab, Python, and Julia will set a low barrier to enter each field.

Undersampled Fourier ptychography for reflective-based long range imaging

Fourier ptychography (FP) can be a promising technique for long-range and high-resolution imaging. In this work, we explore reconstructions with undersampled data for meter-scale reflective based Fourier ptychographic imaging. To reconstruct with under-sampling captures, we propose a novel cost function for FP phase retrieval and design a new optimization algorithm based on gradient descent. To verify the proposed methods, we perform the high-fidelity reconstruction of the targets with sampling parameter less than one. Compared to the state-of-the-art alternative-projectionbased FP algorithm, the proposed one can achieve the same performance but with much less data.

Multi-modal imaging using a cascaded microscope design

We present a multi-modal fiber array snapshot technique (M-FAST) based on an array of 96 compact cameras placed behind a primary objective lens and a fiber bundle array. Our technique is capable of large-area, high-resolution, multi-channel video acquisition. The proposed design provides two key improvements to prior cascaded imaging system approaches: a novel optical arrangement that accommodates the use of planar camera arrays, and a new ability to acquire multi-modal image data acquisition. M-FAST is a multi-modal, scalable imaging system that can acquire snapshot dual-channel fluorescence images as well as differential phase contrast measurements over a large 6.59 mm × 9.74 mm field-of-view at 2.2-μm center full-pitch resolution.

Adaptive correction method of hybrid aberrations in Fourier ptychographic microscopy

SIGNIFICANCE

Fourier ptychographic microscopy (FPM) enables quantitative phase imaging with a large field-of-view and high resolution by acquiring a series of low-resolution intensity images corresponding to different spatial frequencies stitched together in the Fourier domain. However, the presence of various aberrations in an imaging system can significantly degrade the quality of reconstruction results. The imaging performance and efficiency of the existing embedded optical pupil function recovery (EPRY-FPM) aberration correction algorithm are low due to the optimization strategy.

AIM

An aberration correction method (AA-P algorithm) based on an improved phase recovery strategy is proposed to improve the reconstruction image quality.

APPROACH

This algorithm uses adaptive modulation factors, which are added while updating iterations to optimize the spectral function and optical pupil function updates of the samples, respectively. The effectiveness of the proposed algorithm is verified through simulations and experiments using an open-source biological sample dataset.

RESULTS

Experimental results show that the proposed AA-P algorithm in an optical system with hybrid aberrations, recovered complex amplitude images with clearer contours and higher phase contrast. The image reconstruction quality was improved by 82.6% when compared with the EPRY-FPM algorithm.

CONCLUSIONS

The proposed AA-P algorithm can reconstruct better results with faster convergence, and the recovered optical pupil function can better characterize the aberration of the imaging system. Thus, our method is expected to reduce the strict requirements of wavefront aberration for the current FPM.

Beyond conventional microscopy: Observing kidney tissues by means of fourier ptychography

Kidney microscopy is a mainstay in studying the morphological structure, physiology and pathology of kidney tissues, as histology provides important results for a reliable diagnosis. A microscopy modality providing at same time high-resolution images and a wide field of view could be very useful for analyzing the whole architecture and the functioning of the renal tissue. Recently, Fourier Ptychography (FP) has been proofed to yield images of biology samples such as tissues and in vitro cells while providing high resolution and large field of view, thus making it a unique and attractive opportunity for histopathology. Moreover, FP offers tissue imaging with high contrast assuring visualization of small desirable features, although with a stain-free mode that avoids any chemical process in histopathology. Here we report an experimental measuring campaign for creating the first comprehensive and extensive collection of images of kidney tissues captured by this FP microscope. We show that FP microscopy unlocks a new opportunity for the physicians to observe and judge renal tissue slides through the novel FP quantitative phase-contrast microscopy. Phase-contrast images of kidney tissue are analyzed by comparing them with the corresponding renal images taken under a conventional bright-field microscope both for stained and unstained tissue samples of different thicknesses. In depth discussion on the advantages and limitations of this new stain-free microscopy modality is reported, showing its usefulness over the classical light microscopy and opening a potential route for using FP in clinical practice for histopathology of kidney.

Optical ptychography for biomedical imaging: recent progress and future directions [Invited]

Ptychography is an enabling microscopy technique for both fundamental and applied sciences. In the past decade, it has become an indispensable imaging tool in most X-ray synchrotrons and national laboratories worldwide. However, ptychography's limited resolution and throughput in the visible light regime have prevented its wide adoption in biomedical research. Recent developments in this technique have resolved these issues and offer turnkey solutions for high-throughput optical imaging with minimum hardware modifications. The demonstrated imaging throughput is now greater than that of a high-end whole slide scanner. In this review, we discuss the basic principle of ptychography and summarize the main milestones of its development. Different ptychographic implementations are categorized into four groups based on their lensless/lens-based configurations and coded-illumination/coded-detection operations. We also highlight the related biomedical applications, including digital pathology, drug screening, urinalysis, blood analysis, cytometric analysis, rare cell screening, cell culture monitoring, cell and tissue imaging in 2D and 3D, polarimetric analysis, among others. Ptychography for high-throughput optical imaging, currently in its early stages, will continue to improve in performance and expand in its applications. We conclude this review article by pointing out several directions for its future development.

Parallel Fourier ptychographic microscopy reconstruction method based on FPGA

Fourier ptychographic microscopy (FPM) can bypass the limitation of spatial bandwidth product to get images with large field-of-view and high resolution. The complicated sequential iterative calculation in the FPM reconstruction process reduces the reconstruction efficiency of the FPM. Therefore, we propose a parallel FPM reconstruction method based on field programmable gate array (FPGA) to accelerate the FPM reconstruction process. Using this method, multiple sub-regions in the Fourier domain can be computed in parallel and we customize a dedicated high-performance computational architecture for this approach. We deploy 4 FPM reconstruct computing architectures with a parallelism of 4 in a FPGA to compute the FPM reconstruction process, achieving the speed nearly 180 times faster than traditional methods. The proposed method provides a new perspective of parallel computing for FPM reconstruction.

Angularly resolved polarization microscopy for birefringent materials with Fourier ptychography

Polarization light microscopy is a very popular approach for structural imaging in optics. So far these methods mainly probe the sample at a fixed angle of illumination. They are consequently only sensitive to the polarization properties along the microscope optical axis. This paper presents a novel method to resolve angularly the polarization properties of birefringent materials, by retrieving quantitatively the spatial variation of their index ellipsoids. Since this method is based on Fourier ptychography microscopy the latter properties are retrieved with a spatial super-resolution factor. An adequate formalism for the Fourier ptychography forward model is introduced to cope with angularly resolved polarization properties. The inverse problem is solved using an unsupervised deep neural network approach that is proven efficient thanks to its performing regularization properties together with its automatic differentiation. Simulated results are reported showing the feasibility of the methods.

Automatic whole blood cell analysis from blood smear using label-free multi-modal imaging with deep neural networks

Whole blood cell analysis is widely used in medical applications since its results are indicators for diagnosing a series of diseases. In this work, we report automatic whole blood cell analysis from blood smear using label-free multi-modal imaging with deep neural networks. First, a commercial microscope equipped with our developed Phase Real-time Microscope Camera (PhaseRMiC) obtains both bright-field and quantitative phase images. Then, these images are automatically processed by our designed blood smear recognition networks (BSRNet) that recognize erythrocytes, leukocytes and platelets. Finally, blood cell parameters such as counts, shapes and volumes can be extracted according to both quantitative phase images and automatic recognition results. The proposed whole blood cell analysis technique provides high-quality blood cell images and supports accurate blood cell recognition and analysis. Moreover, this approach requires rather simple and cost-effective setups as well as easy and rapid sample preparations. Therefore, this proposed method has great potential application in blood testing aiming at disease diagnostics.

Label-free hematology analysis method based on defocusing phase-contrast imaging under illumination of 415 nm light

Label-free imaging technology is a trending way to simplify and improve conventional hematology analysis by bypassing lengthy and laborious staining procedures. However, the existing methods do not well balance system complexity, data acquisition efficiency, and data analysis accuracy, which severely impedes their clinical translation. Here, we propose defocusing phase-contrast imaging under the illumination of 415 nm light to realize label-free hematology analysis. We have verified that the subcellular morphology of blood components can be visualized without complex staining due to the factor that defocusing can convert the second-order derivative distribution of samples' optical phase into intensity and the illumination of 415 nm light can significantly enhance the contrast. It is demonstrated that the defocusing phase-contrast images for the five leucocyte subtypes can be automatically discriminated by a trained deep-learning program with high accuracy (the mean F1 score: 0.986 and mean average precision: 0.980). Since this technique is based on a regular microscope, it simultaneously realizes low system complexity and high data acquisition efficiency with remarkable quantitative analysis ability. It supplies a label-free, reliable, easy-to-use, fast approach to simplifying and reforming the conventional way of hematology analysis.

Quantitative Phase Imaging: Recent Advances and Expanding Potential in Biomedicine

Quantitative phase imaging (QPI) is a label-free, wide-field microscopy approach with significant opportunities for biomedical applications. QPI uses the natural phase shift of light as it passes through a transparent object, such as a mammalian cell, to quantify biomass distribution and spatial and temporal changes in biomass. Reported in cell studies more than 60 years ago, ongoing advances in QPI hardware and software are leading to numerous applications in biology, with a dramatic expansion in utility over the past two decades. Today, investigations of cell size, morphology, behavior, cellular viscoelasticity, drug efficacy, biomass accumulation and turnover, and transport mechanics are supporting studies of development, physiology, neural activity, cancer, and additional physiological processes and diseases. Here, we review the field of QPI in biology starting with underlying principles, followed by a discussion of technical approaches currently available or being developed, and end with an examination of the breadth of applications in use or under development. We comment on strengths and shortcomings for the deployment of QPI in key biomedical contexts and conclude with emerging challenges and opportunities based on combining QPI with other methodologies that expand the scope and utility of QPI even further.

High-speed multi-objective Fourier ptychographic microscopy

The ability of a microscope to rapidly acquire wide-field, high-resolution images is limited by both the optical performance of the microscope objective and the bandwidth of the detector. The use of multiple detectors can increase electronic-acquisition bandwidth, but the use of multiple parallel objectives is problematic since phase coherence is required across the multiple apertures. We report a new synthetic-aperture microscopy technique based on Fourier ptychography, where both the illumination and image-space numerical apertures are synthesized, using a spherical array of low-power microscope objectives that focus images onto mutually incoherent detectors. Phase coherence across apertures is achieved by capturing diffracted fields during angular illumination and using ptychographic reconstruction to synthesize wide-field, high-resolution, amplitude and phase images. Compared to conventional Fourier ptychography, the use of multiple objectives reduces image acquisition times by increasing the area for sampling the diffracted field. We demonstrate the proposed scaleable architecture with a nine-objective microscope that generates an 89-megapixel, 1.1 µm resolution image nine-times faster than can be achieved with a single-objective Fourier-ptychographic microscope. New calibration procedures and reconstruction algorithms enable the use of low-cost 3D-printed components for longitudinal biological sample imaging. Our technique offers a route to high-speed, gigapixel microscopy, for example, imaging the dynamics of large numbers of cells at scales ranging from sub-micron to centimetre, with an enhanced possibility to capture rare phenomena.

Morphological variations to a ptychographic algorithm

Ptychography is a technique widely used in microscopy for achieving high-resolution imaging. This method relies on computational processing of images gathered from diffraction patterns produced by several partial illuminations of a sample. We numerically studied the effect of using different shapes for illuminating the aforementioned sample: convex shapes, such as circles and regular polygons, and unconnected shapes that resemble a QR code. Our results suggest that the use of unconnected shapes seems to outperform convex shapes in terms of convergence and, in some cases, accuracy.

Automated wide-field malaria parasite infection detection using Fourier ptychography on stain-free thin-smears

Diagnosis of malaria in endemic areas is hampered by the lack of a rapid, stain-free and sensitive method to directly identify parasites in peripheral blood. Herein, we report the use of Fourier ptychography to generate wide-field high-resolution quantitative phase images of erythrocytes infected with malaria parasites, from a whole blood sample. We are able to image thousands of erythrocytes (red blood cells) in a single field of view and make a determination of infection status of the quantitative phase image of each segmented cell based on machine learning (random forest) and deep learning (VGG16) models. Our random forest model makes use of morphology and texture based features of the quantitative phase images. In order to label the quantitative images of the cells as either infected or uninfected before training the models, we make use of a Plasmodium berghei strain expressing GFP (green fluorescent protein) in all life cycle stages. By overlaying the fluorescence image with the quantitative phase image we could identify the infected subpopulation of erythrocytes for labelling purposes. Our machine learning model (random forest) achieved 91% specificity and 72% sensitivity while our deep learning model (VGG16) achieved 98% specificity and 57% sensitivity. These results highlight the potential for quantitative phase imaging coupled with artificial intelligence to develop an easy to use platform for the rapid and sensitive diagnosis of malaria.

Addressing phase-curvature in Fourier ptychography

In Fourier ptychography, multiple low resolution images are captured and subsequently combined computationally into a high-resolution, large-field of view micrograph. A theoretical image-formation model based on the assumption of plane-wave illumination from various directions is commonly used, to stitch together the captured information into a high synthetic aperture. The underlying far-field (Fraunhofer) diffraction assumption connects the source, sample, and pupil planes by Fourier transforms. While computationally simple, this assumption neglects phase-curvature due to non-planar illumination from point sources as well as phase-curvature from finite-conjugate microscopes (e.g., using a single-lens for image-formation). We describe a simple, efficient, and accurate extension of Fourier ptychography by embedding the effect of phase-curvature into the underlying forward model. With the improved forward model proposed here, quantitative phase reconstruction is possible even for wide fields-of-views and without the need of image segmentation. Lastly, the proposed method is computationally efficient, requiring only two multiplications: prior and following the reconstruction.

Fast and stable Fourier ptychographic microscopy based on improved phase recovery strategy

Fourier ptychographic microscopy (FPM) imaging is a computational imaging technology that can reconstruct wide-field high-resolution (HR) images. It uses a series of low-resolution images captured by a camera under different illumination angles. The images are stitched in the Fourier domain to expand their spectral range. Under high-angle illumination, a dark-field image is noisy with a low signal-to-noise ratio, which significantly reduces the reconstruction quality of FPM. Conventional reconstruction algorithms often have low FPM imaging performance and efficiency due to optimization strategies. In response to these problems, this paper proposes an FPM imaging method based on an improved phase recovery strategy to optimize the alternating iterative algorithm. The technique uses an improved threshold method to reduce noise in the image preprocessing stage to maximize the retention of high-frequency sample information. Moreover, an adaptive control factor is added in the subsequent iterative update process to balance the sample spectrum function. This study verifies the effectiveness of the proposed method on both simulation and experimental images. The results show that the proposed method can effectively suppress image background noise and has a faster convergence speed and higher robustness. In addition, it can be used to reconstruct HR complex amplitude images of objects under wide field-of-view conditions.

Fourier ptychography multi-parameunter neural network with composite physical priori optimization

Fourier ptychography microscopy(FPM) is a recently developed computational imaging approach for microscopic super-resolution imaging. By turning on each light-emitting-diode (LED) located on different position on the LED array sequentially and acquiring the corresponding images that contain different spatial frequency components, high spatial resolution and quantitative phase imaging can be achieved in the case of large field-of-view. Nevertheless, FPM has high requirements for the system construction and data acquisition processes, such as precise LEDs position, accurate focusing and appropriate exposure time, which brings many limitations to its practical applications. In this paper, inspired by artificial neural network, we propose a Fourier ptychography multi-parameter neural network (FPMN) with composite physical prior optimization. A hybrid parameter determination strategy combining physical imaging model and data-driven network training is proposed to recover the multi layers of the network corresponding to different physical parameters, including sample complex function, system pupil function, defocus distance, LED array position deviation and illumination intensity fluctuation, etc. Among these parameters, LED array position deviation is recovered based on the features of brightfield to darkfield transition low-resolution images while the others are recovered in the process of training of the neural network. The feasibility and effectiveness of FPMN are verified through simulations and actual experiments. Therefore FPMN can evidently reduce the requirement for practical applications of FPM.

Fourier Ptychographic Microscopy via Alternating Direction Method of Multipliers

Fourier ptychographic microscopy (FPM) has risen as a promising computational imaging technique that breaks the trade-off between high resolution and large field of view (FOV). Its reconstruction is normally formulated as a blind phase retrieval problem, where both the object and probe have to be recovered from phaseless measured data. However, the stability and reconstruction quality may dramatically deteriorate in the presence of noise interference. Herein, we utilized the concept of alternating direction method of multipliers (ADMM) to solve this problem (termed ADMM-FPM) by breaking it into multiple subproblems, each of which may be easier to deal with. We compared its performance against existing algorithms in both simulated and practical FPM platform. It is found that ADMM-FPM method belongs to a global optimization algorithm with a high degree of parallelism and thus results in a more stable and robust phase recovery under noisy conditions. We anticipate that ADMM will rekindle interest in FPM as more modifications and innovations are implemented in the future.

100 Hz ROCS microscopy correlated with fluorescence reveals cellular dynamics on different spatiotemporal scales

Fluorescence techniques dominate the field of live-cell microscopy, but bleaching and motion blur from too long integration times limit dynamic investigations of small objects. High contrast, label-free life-cell imaging of thousands of acquisitions at 160 nm resolution and 100 Hz is possible by Rotating Coherent Scattering (ROCS) microscopy, where intensity speckle patterns from all azimuthal illumination directions are added up within 10 ms. In combination with fluorescence, we demonstrate the performance of improved Total Internal Reflection (TIR)-ROCS with variable illumination including timescale decomposition and activity mapping at five different examples: millisecond reorganization of macrophage actin cortex structures, fast degranulation and pore opening in mast cells, nanotube dynamics between cardiomyocytes and fibroblasts, thermal noise driven binding behavior of virus-sized particles at cells, and, bacterial lectin dynamics at the cortex of lung cells. Using analysis methods we present here, we decipher how motion blur hides cellular structures and how slow structure motions cover decisive fast motions.

Quantitative Jones matrix imaging using vectorial Fourier ptychography

This paper presents a microscopic imaging technique that uses variable-angle illumination to recover the complex polarimetric properties of a specimen at high resolution and over a large field-of-view. The approach extends Fourier ptychography, which is a synthetic aperture-based imaging approach to improve resolution with phaseless measurements, to additionally account for the vectorial nature of light. After images are acquired using a standard microscope outfitted with an LED illumination array and two polarizers, our vectorial Fourier ptychography (vFP) algorithm solves for the complex 2x2 Jones matrix of the anisotropic specimen of interest at each resolved spatial location. We introduce a new sequential Gauss-Newton-based solver that additionally jointly estimates and removes polarization-dependent imaging system aberrations. We demonstrate effective vFP performance by generating large-area (29 mm2), high-resolution (1.24 μm full-pitch) reconstructions of sample absorption, phase, orientation, diattenuation, and retardance for a variety of calibration samples and biological specimens.

Physics-based learning with channel attention for Fourier ptychographic microscopy

Fourier ptychographic microscopy (FPM) is a computational imaging technology for large field-of-view, high resolution and quantitative phase imaging. In FPM, low-resolution intensity images captured with angle-varying illumination are synthesized in Fourier space with phase retrieval approaches. However, system errors such as pupil aberration and light-emitting diode (LED) intensity error seriously affect the reconstruction performance. In this article, we propose a physics-based neural network with channel attention for FPM reconstruction. With the channel attention module, which is introduced into physics-based neural networks for the first time, the spatial distribution of LED intensity can be adaptively corrected. Besides, the channel attention module is used to synthesize different Zernike modes and recover the pupil function. Detailed simulations and experiments are carried out to validate the effectiveness and robustness of the proposed method. The results demonstrate that our method achieves better performance in high-resolution complex field reconstruction, LED intensity correction and pupil function recovery compared with the state-of-art methods. The combination with deep neural network structures like channel attention modules significantly enhance the performance of physics-based neural networks and will promote the application of FPM in practical use.

High-performance heterogeneous FPGA data-flow architecture for Fourier ptychographic microscopy

Fourier ptychographic microscopy (FPM) is a recently developed computational imaging technique that can achieve both high-resolution and a wide field-of-view via a sequence of low-resolution images. FPM is a complex iterative process, and it is difficult to meet the needs of rapid reconstruction imaging with the conventional FPM deployed on general purpose processors. In this paper, we propose a high-performance heterogeneous field-programmable gate array (FPGA) architecture based on the principle of full pipeline and the data-flow structure for the iterative reconstruction procedure of FPM. By optimizing the architecture network at gate-level logic circuits, the running time of the FPGA-based FPM reconstruction procedure is nearly 20 times faster than conventional methods. Our proposed architecture can be used to develop FPM imaging equipment that meets resource and performance requirements.

Snapshot ptychography on array cameras

We use convolutional neural networks to recover images optically down-sampled by 6.7 × using coherent aperture synthesis over a 16 camera array. Where conventional ptychography relies on scanning and oversampling, here we apply decompressive neural estimation to recover full resolution image from a single snapshot, although as shown in simulation multiple snapshots can be used to improve signal-to-noise ratio (SNR). In place training on experimental measurements eliminates the need to directly calibrate the measurement system. We also present simulations of diverse array camera sampling strategies to explore how snapshot compressive systems might be optimized.

Fourier ptychographic dark field x-ray microscopy

Dark-field x-ray microscopy (DFXM) is an x-ray imaging technique for mapping three-dimensional (3D) lattice strain and rotation in bulk crystalline materials. At present, these maps of local structural distortions are derived from the raw intensity images using an incoherent analysis framework. In this work, we describe a coherent, Fourier ptychographic approach that requires little change in terms of instrumentation and acquisition strategy, and may be implemented on existing DFXM instruments. We demonstrate the method experimentally and are able to achieve quantitative phase reconstructions of thin film samples and maps of the aberrations in the objective lens. The method holds particular promise for the characterization of crystalline materials containing weak structural contrast.

Increasing a microscope's effective field of view via overlapped imaging and machine learning

This work demonstrates a multi-lens microscopic imaging system that overlaps multiple independent fields of view on a single sensor for high-efficiency automated specimen analysis. Automatic detection, classification and counting of various morphological features of interest is now a crucial component of both biomedical research and disease diagnosis. While convolutional neural networks (CNNs) have dramatically improved the accuracy of counting cells and sub-cellular features from acquired digital image data, the overall throughput is still typically hindered by the limited space-bandwidth product (SBP) of conventional microscopes. Here, we show both in simulation and experiment that overlapped imaging and co-designed analysis software can achieve accurate detection of diagnostically-relevant features for several applications, including counting of white blood cells and the malaria parasite, leading to multi-fold increase in detection and processing throughput with minimal reduction in accuracy.

Transformer oil quality evaluation using quantitative phase microscopy

Transformer oil used in oil-filled electrical power transformers aims at insulating, stopping arcing and corona discharge, and dissipating transformer heat. Transformer running inevitably induces molecule decomposition, thus leading to gases released into transformer oil. The released gases not only reduce the transformer oil's performance but also possibly induce transformer fault. To prevent catastrophic failure, approaches using, e.g., chromatography and spectroscopy, precisely measure dissolved gases to monitor transformer oil quality; however, many of these approaches still suffer from complicated operations, expensive costs, or slow speed. To solve these problems, we provide a new transformer oil quality evaluation method based on quantitative phase microscopy. Using our designed phase real-time microscopic camera (PhaseRMiC), under- and over-focus images of gas bubbles in transformer oil can be simultaneously captured during field of view scanning. Further, oil-to-gas-volume ratio can be computed after phase retrieval via solving the transport of intensity equation to evaluate transformer oil quality. Compared with traditionally and widely used approaches, this newly designed method can successfully distinguish transformer oil quality by only relying on rapid operations and low costs, thus delivering a new solution for transformer prognosis and diagnosis.

Synthetic aperture interference light (SAIL) microscopy for high-throughput label-free imaging

Quantitative phase imaging (QPI) is a valuable label-free modality that has gained significant interest due to its wide potentials, from basic biology to clinical applications. Most existing QPI systems measure microscopic objects via interferometry or nonlinear iterative phase reconstructions from intensity measurements. However, all imaging systems compromise spatial resolution for the field of view and vice versa, i.e., suffer from a limited space bandwidth product. Current solutions to this problem involve computational phase retrieval algorithms, which are time-consuming and often suffer from convergence problems. In this article, we presented synthetic aperture interference light (SAIL) microscopy as a solution for high-resolution, wide field of view QPI. The proposed approach employs low-coherence interferometry to directly measure the optical phase delay under different illumination angles and produces large space-bandwidth product label-free imaging. We validate the performance of SAIL on standard samples and illustrate the biomedical applications on various specimens: pathology slides, entire insects, and dynamic live cells in large cultures. The reconstructed images have a synthetic numeric aperture of 0.45 and a field of view of 2.6 × 2.6 mm2. Due to its direct measurement of the phase information, SAIL microscopy does not require long computational time, eliminates data redundancy, and always converges.