High-throughput lensless whole slide imaging via continuous height-varying modulation of a tilted sensor

Super-resolution lensless on-chip microscopy based on array illumination and sub-pixel shift search

The resolution of a lensless on-chip microscopy system is constrained by the pixel size of image sensors. This Letter introduces a super-resolution on-chip microscopy system based on a compact array light source illumination and sub-pixel shift search. The system utilizes a closely spaced array light source composed by four RGB LED modules, sequentially illuminating the sample. A sub-pixel shift search algorithm is proposed, which determines the sub-pixel shift by comparing the frequency of captured low-resolution holograms. Leveraging this sub-pixel shift, a super-resolution reconstruction algorithm is introduced, building upon a multi-wavelength phase retrieval method, enabling the rapid super-resolution reconstruction of holograms with the region-of-interest. The system and algorithms presented herein obviate the need for a displacement control platform and calibration of the illumination angles of the light source, facilitating a super-resolution phase reconstruction under partially coherent illumination.

Fast autofocusing of recorded planes by salient feature region for coherent diffraction imaging

In multi-distance coherent diffraction imaging, the task of distance calculation for multi-diffraction images is cumbersome. The information features are hard-to-extract and the region of interest extraction algorithms are difficult to be adopted. A universal salient feature region selection algorithm by using the area with the highest density of corners is proposed to extract the most representative feature region. In addition, equally spaced recording modes and mismatched diffraction distances will result in system noise and destroy image quality. The polydirectional maximum gradient is offered as a sharpness criterion to weigh a quantitative feature for the final pattern. A fast, sensitive, and high-accuracy autofocusing and sample reconstruction can be achieved using only a small number of images while ensuring that morphological properties and quantification of the reconstructions are not compromised. The proposed method is promising for biological and medical dynamic observations for computational imaging systems.

sPhaseStation: a whole slide quantitative phase imaging system based on dual-view transport of intensity phase microscopy

Whole slide imaging scans a microscope slide into a high-resolution digital image, and it paves the way from pathology to digital diagnostics. However, most of them rely on bright-field and fluorescence imaging with sample labels. In this work, we designed sPhaseStation, which is a dual-view transport of intensity phase microscopy-based whole slide quantitative phase imaging system for label-free samples. sPhaseStation relies on a compact microscopic system with two imaging recorders that can capture both under and over-focus images. Combined with the field of view (FoV) scan, a series of these defocus images in different FoVs can be captured and stitched into two FoV-extended under and over-focus ones, which are used for phase retrieval via solving the transport of intensity equation. Using a 10× micro-objective, sPhaseStation reaches the spatial resolution of 2.19 µm and obtains the phase with high accuracy. Additionally, it acquires a whole slide image of a 3m m×3m m region in 2 min. The reported sPhaseStation could be a prototype of the whole slide quantitative phase imaging device, which may provide a new perspective for digital pathology.

Optical ptychography for biomedical imaging: recent progress and future directions [Invited]

Ptychography is an enabling microscopy technique for both fundamental and applied sciences. In the past decade, it has become an indispensable imaging tool in most X-ray synchrotrons and national laboratories worldwide. However, ptychography's limited resolution and throughput in the visible light regime have prevented its wide adoption in biomedical research. Recent developments in this technique have resolved these issues and offer turnkey solutions for high-throughput optical imaging with minimum hardware modifications. The demonstrated imaging throughput is now greater than that of a high-end whole slide scanner. In this review, we discuss the basic principle of ptychography and summarize the main milestones of its development. Different ptychographic implementations are categorized into four groups based on their lensless/lens-based configurations and coded-illumination/coded-detection operations. We also highlight the related biomedical applications, including digital pathology, drug screening, urinalysis, blood analysis, cytometric analysis, rare cell screening, cell culture monitoring, cell and tissue imaging in 2D and 3D, polarimetric analysis, among others. Ptychography for high-throughput optical imaging, currently in its early stages, will continue to improve in performance and expand in its applications. We conclude this review article by pointing out several directions for its future development.

High-performance lensless diffraction imaging from diverse holograms by three-dimensional scanning

For lensless diffraction imaging, it is a challenging dilemma to achieve a large field of view (FOV) and high resolution with a small amount of data at the same time. Ptychography can reconstruct the high-resolution image and illumination light simultaneously. But the illumination is limited to a small size by a probe in typical ptychography. For large samples, it takes much time to collect abundant patterns and has strict requirements for the computing power of computers. Another widely applied method, multi-height measurement, can realize a wide FOV with several holograms. But, the recovered image is easily destroyed by the background noise. In this Letter, a lensless diffraction imaging method by three-dimensional scanning is proposed. All positions of the object are different in three directions instead of scanning schemes only on a plane or along the optic axis, so more diversity of diffraction information is obtained. We apply the illumination without the limit of a confined aperture, which means that the imaging FOV of a pattern is equal to the size of the utilized image sensor. In comparison with the multi-height method, our method can separate the illumination background noise from the retrieved object. Consequently, the proposed method realized high resolution and contrast, large FOV, and the removal of background noise simultaneously. Experimental validations and comparisons with other methods are presented.

High-throughput digital pathology via a handheld, multiplexed, and AI-powered ptychographic whole slide scanner

The recent advent of whole slide imaging (WSI) systems has moved digital pathology closer to diagnostic applications and clinical practices. Integrating WSI with machine learning promises the growth of this field in upcoming years. Here we report the design and implementation of a handheld, colour-multiplexed, and AI-powered ptychographic whole slide scanner for digital pathology applications. This handheld scanner is built using low-cost and off-the-shelf components, including red, green, and blue laser diodes for sample illumination, a modified stage for programmable sample positioning, and a synchronized image sensor pair for data acquisition. We smear a monolayer of goat blood cells on the main sensor for high-resolution lensless coded ptychographic imaging. The synchronized secondary sensor acts as a non-contact encoder for precisely tracking the absolute object position for ptychographic reconstruction. For WSI, we introduce a new phase-contrast-based focus metric for post-acquisition autofocusing of both stained and unstained specimens. We show that the scanner can resolve the 388-nm linewidth on the resolution target and acquire gigapixel images with a 14 mm × 11 mm area in ∼70 seconds. The imaging performance is validated with regular stained pathology slides, unstained thyroid smears, and malaria-infected blood smears. The deep neural network developed in this study further enables high-throughput cytometric analysis using the recovered complex amplitude. The reported do-it-yourself scanner offers a portable solution to transform the high-end WSI system into one that can be made widely available at a low cost. The capability of high-throughput quantitative phase imaging may also find applications in rapid on-site evaluations.

Pixel Super-Resolution Phase Retrieval for Lensless On-Chip Microscopy via Accelerated Wirtinger Flow

Empowered by pixel super-resolution (PSR) and phase retrieval techniques, lensless on-chip microscopy opens up new possibilities for high-throughput biomedical imaging. However, the current PSR phase retrieval approaches are time consuming in terms of both the measurement and reconstruction procedures. In this work, we present a novel computational framework for PSR phase retrieval to address these concerns. Specifically, a sparsity-promoting regularizer is introduced to enhance the well posedness of the nonconvex problem under limited measurements, and Nesterov’s momentum is used to accelerate the iterations. The resulting algorithm, termed accelerated Wirtinger flow (AWF), achieves at least an order of magnitude faster rate of convergence and allows a twofold reduction in the measurement number while maintaining competitive reconstruction quality. Furthermore, we provide general guidance for step size selection based on theoretical analyses, facilitating simple implementation without the need for complicated parameter tuning. The proposed AWF algorithm is compatible with most of the existing lensless on-chip microscopes and could help achieve label-free rapid whole slide imaging of dynamic biological activities at subpixel resolution.

Blood-Coated Sensor for High-Throughput Ptychographic Cytometry on a Blu-ray Disc

The Blu-ray drive is an engineering masterpiece that integrates disc rotation, pickup head translation, and three lasers in a compact and portable format. Here, we integrate a blood-coated image sensor with a modified Blu-ray drive for high-throughput cytometric analysis of various biospecimens. In this device, samples are mounted on the rotating Blu-ray disc and illuminated by the built-in lasers from the pickup head. The resulting coherent diffraction patterns are then recorded by the blood-coated image sensor. The rich spatial features of the blood-cell monolayer help down-modulate the object information for sensor detection, thus forming a high-resolution computational biolens with a theoretically unlimited field of view. With the acquired data, we develop a lensless coherent diffraction imaging modality termed rotational ptychography for image reconstruction. We show that our device can resolve the 435 nm line width on the resolution target and has a field of view only limited by the size of the Blu-ray disc. To demonstrate its applications, we perform high-throughput urinalysis by locating disease-related calcium oxalate crystals over the entire microscope slide. We also quantify different types of cells on a blood smear with an acquisition speed of ∼10,000 cells per second. For in vitro experiments, we monitor live bacterial cultures over the entire Petri dish with single-cell resolution. Using biological cells as a computational lens could enable new intriguing imaging devices for point-of-care diagnostics. Modifying a Blu-ray drive with the blood-coated sensor further allows the spread of high-throughput optical microscopy from well-equipped laboratories to citizen scientists worldwide.