Optimizing illumination in three-dimensional deconvolution microscopy for accurate refractive index tomography

Fourier space aberration correction for high resolution refractive index imaging using incoherent light

An aberration correction method is introduced for 3D phase deconvolution microscopy. Our technique capitalizes on multiple illumination patterns to iteratively extract Fourier space aberrations, utilizing the overlapping information inherent in these patterns. By refining the point spread function based on the retrieved aberration data, we significantly improve the precision of refractive index deconvolution. We validate the effectiveness of our method on both synthetic and biological three-dimensional samples, achieving notable enhancements in resolution and measurement accuracy. The method's reliability in aberration retrieval is further confirmed through controlled experiments with intentionally induced spherical aberrations, underscoring its potential for wide-ranging applications in microscopy and biomedicine.

Recent Advances and Current Trends in Transmission Tomographic Diffraction Microscopy

Optical microscopy techniques are among the most used methods in biomedical sample characterization. In their more advanced realization, optical microscopes demonstrate resolution down to the nanometric scale. These methods rely on the use of fluorescent sample labeling in order to break the diffraction limit. However, fluorescent molecules' phototoxicity or photobleaching is not always compatible with the investigated samples. To overcome this limitation, quantitative phase imaging techniques have been proposed. Among these, holographic imaging has demonstrated its ability to image living microscopic samples without staining. However, for a 3D assessment of samples, tomographic acquisitions are needed. Tomographic Diffraction Microscopy (TDM) combines holographic acquisitions with tomographic reconstructions. Relying on a 3D synthetic aperture process, TDM allows for 3D quantitative measurements of the complex refractive index of the investigated sample. Since its initial proposition by Emil Wolf in 1969, the concept of TDM has found a lot of applications and has become one of the hot topics in biomedical imaging. This review focuses on recent achievements in TDM development. Current trends and perspectives of the technique are also discussed.

High-resolution assessment of multidimensional cellular mechanics using label-free refractive-index traction force microscopy

A critical requirement for studying cell mechanics is three-dimensional assessment of cellular shapes and forces with high spatiotemporal resolution. Traction force microscopy with fluorescence imaging enables the measurement of cellular forces, but it is limited by photobleaching and a slow acquisition speed. Here, we present refractive-index traction force microscopy (RI-TFM), which simultaneously quantifies the volumetric morphology and traction force of cells using a high-speed illumination scheme with 0.5-Hz temporal resolution. Without labelling, our method enables quantitative analyses of dry-mass distributions and shear (in-plane) and normal (out-of-plane) tractions of single cells on the extracellular matrix. When combined with a constrained total variation-based deconvolution algorithm, it provides 0.55-Pa shear and 1.59-Pa normal traction sensitivity for a 1-kPa hydrogel substrate. We demonstrate its utility by assessing the effects of compromised intracellular stress and capturing the rapid dynamics of cellular junction formation in the spatiotemporal changes in non-planar traction components.

Roadmap on Label-Free Super-Resolution Imaging

Label-free super-resolution (LFSR) imaging relies on light-scattering processes in nanoscale objects without a need for fluorescent (FL) staining required in super-resolved FL microscopy. The objectives of this Roadmap are to present a comprehensive vision of the developments, the state-of-the-art in this field, and to discuss the resolution boundaries and hurdles which need to be overcome to break the classical diffraction limit of the LFSR imaging. The scope of this Roadmap spans from the advanced interference detection techniques, where the diffraction-limited lateral resolution is combined with unsurpassed axial and temporal resolution, to techniques with true lateral super-resolution capability which are based on understanding resolution as an information science problem, on using novel structured illumination, near-field scanning, and nonlinear optics approaches, and on designing superlenses based on nanoplasmonics, metamaterials, transformation optics, and microsphere-assisted approaches. To this end, this Roadmap brings under the same umbrella researchers from the physics and biomedical optics communities in which such studies have often been developing separately. The ultimate intent of this paper is to create a vision for the current and future developments of LFSR imaging based on its physical mechanisms and to create a great opening for the series of articles in this field.

Artificial intelligence-enabled quantitative phase imaging methods for life sciences

Quantitative phase imaging, integrated with artificial intelligence, allows for the rapid and label-free investigation of the physiology and pathology of biological systems. This review presents the principles of various two-dimensional and three-dimensional label-free phase imaging techniques that exploit refractive index as an intrinsic optical imaging contrast. In particular, we discuss artificial intelligence-based analysis methodologies for biomedical studies including image enhancement, segmentation of cellular or subcellular structures, classification of types of biological samples and image translation to furnish subcellular and histochemical information from label-free phase images. We also discuss the advantages and challenges of artificial intelligence-enabled quantitative phase imaging analyses, summarize recent notable applications in the life sciences, and cover the potential of this field for basic and industrial research in the life sciences.

Deep learning-based label-free hematology analysis framework using optical diffraction tomography

Hematology analysis, a common clinical test for screening various diseases, has conventionally required a chemical staining process that is time-consuming and labor-intensive. To reduce the costs of chemical staining, label-free imaging can be utilized in hematology analysis. In this work, we exploit optical diffraction tomography and the fully convolutional one-stage object detector or FCOS, a deep learning architecture for object detection, to develop a label-free hematology analysis framework. Detected cells are classified into four groups: red blood cell, abnormal red blood cell, platelet, and white blood cell. In the results, the trained object detection model showed superior detection performance for blood cells in refractive index tomograms (0.977 mAP) and also showed high accuracy in the four-class classification of blood cells (0.9708 weighted F1 score, 0.9712 total accuracy). For further verification, mean corpuscular volume (MCV) and mean corpuscular hemoglobin (MCH) were compared with values obtained from reference hematology equipment, with our results showing reasonable correlation in both MCV (0.905) and MCH (0.889). This study provides a successful demonstration of the proposed framework in detecting and classifying blood cells using optical diffraction tomography for label-free hematology analysis.

Cryobiopsy: A Breakthrough Strategy for Clinical Utilization of Lung Cancer Organoids

One major challenge associated with lung cancer organoids (LCOs) is their predominant derivation from surgical specimens of patients with early-stage lung cancer. However, patients with advanced lung cancer, who are in need of chemotherapy, often cannot undergo surgery. Therefore, there is an urgent need to successfully generate LCOs from biopsy specimens. Conventional lung biopsy techniques, such as transthoracic needle biopsy and forceps biopsy, only yield small amounts of lung tissue, resulting in a low success rate for culturing LCOs from biopsy samples. Furthermore, potential complications, like bleeding and pneumothorax, make it difficult to obtain sufficient tissue. Another critical issue is the overgrowth of normal lung cells in later passages of LCO culture, and the optimal culture conditions for LCOs are yet to be determined. To address these limitations, we attempted to create LCOs from cryobiopsy specimens obtained from patients with lung cancer (n = 113). Overall, the initial success rate of establishing LCOs from cryobiopsy samples was 40.7% (n = 46). Transbronchial cryobiopsy enables the retrieval of significantly larger amounts of lung tissue than bronchoscopic forceps biopsy. Additionally, cryobiopsy can be employed for peripheral lesions, and it is aided via radial endobronchial ultrasonography. This study significantly improved the success rate of LCO culture and demonstrated that the LCOs retained characteristics that resembled the primary tumors. Single-cell RNA sequencing confirmed high cancer cell purity in early passages of LCOs derived from patients with advanced lung cancer. Furthermore, the three-dimensional structure and intracellular components of LCOs were characterized using three-dimensional holotomography. Finally, drug screening was performed using a specialized micropillar culture system with cryobiopsy-derived LCOs. LCOs derived from cryobiopsy specimens offer a promising solution to the critical limitations of conventional LCOs. Cryobiopsy can be applied to patients with lung cancer at all stages, including those with peripheral lesions, and can provide sufficient cells for LCO generation. Therefore, we anticipate that cryobiopsy will serve as a breakthrough strategy for the clinical application of LCOs in all stages of lung cancer.

Single-shot refractive index slice imaging using spectrally multiplexed optical transfer function reshaping

The refractive index (RI) of cells and tissues is crucial in pathophysiology as a noninvasive and quantitative imaging contrast. Although its measurements have been demonstrated using three-dimensional quantitative phase imaging methods, these methods often require bulky interferometric setups or multiple measurements, which limits the measurement sensitivity and speed. Here, we present a single-shot RI imaging method that visualizes the RI of the in-focus region of a sample. By exploiting spectral multiplexing and optical transfer function engineering, three color-coded intensity images of a sample with three optimized illuminations were simultaneously obtained in a single-shot measurement. The measured intensity images were then deconvoluted to obtain the RI image of the in-focus slice of the sample. As a proof of concept, a setup was built using Fresnel lenses and a liquid-crystal display. For validation purposes, we measured microspheres of known RI and cross-validated the results with simulated results. Various static and highly dynamic biological cells were imaged to demonstrate that the proposed method can conduct single-shot RI slice imaging of biological samples with subcellular resolution.

Quantification of structural heterogeneity in H&E stained clear cell renal cell carcinoma using refractive index tomography

Clear cell renal cell carcinoma (ccRCC) is a common histopathological subtype of renal cancer and is notorious for its poor prognosis. Its accurate diagnosis by histopathology, which relies on manual microscopic inspection of stained slides, is challenging. Here, we present a correlative approach to utilize stained images and refractive index (RI) tomography and demonstrate quantitative assessments of the structural heterogeneities of ccRCC slides obtained from human patients. Machine-learning-assisted segmentation of nuclei and cytoplasm enabled the quantification at the subcellular level. Compared to benign regions, malignant regions exhibited a considerable increase in structural heterogeneities. The results demonstrate that RI tomography provides quantitative information in synergy with stained images on the structural heterogeneities in ccRCC.

Regularization of dielectric tensor tomography

Dielectric tensor tomography reconstructs the three-dimensional dielectric tensors of microscopic objects and provides information about the crystalline structure orientations and principal refractive indices. Because dielectric tensor tomography is based on transmission measurement, it suffers from the missing cone problem, which causes poor axial resolution, underestimation of the refractive index, and halo artifacts. In this study, we study the application of total variation and positive semi-definiteness regularization to three-dimensional tensor distributions. In particular, we demonstrate the reduction of artifacts when applied to dielectric tensor tomography.

Quantitative phase and refractive index imaging of 3D objects via optical transfer function reshaping

Deconvolution phase microscopy enables high-contrast visualization of transparent samples through reconstructions of their transmitted phases or refractive indexes. Herein, we propose a method to extend 2D deconvolution phase microscopy to thick 3D samples. The refractive index distribution of a sample can be obtained at a specific axial plane by measuring only four intensity images obtained under optimized illumination patterns. Also, the optical phase delay of a sample can be measured using different illumination patterns.

Self-calibrated 3D differential phase contrast microscopy with optimized illumination

3D phase imaging recovers an object's volumetric refractive index from intensity and/or holographic measurements. Partially coherent methods, such as illumination-based differential phase contrast (DPC), are particularly simple to implement in a commercial brightfield microscope. 3D DPC acquires images at multiple focus positions and with different illumination source patterns in order to reconstruct 3D refractive index. Here, we present a practical extension of the 3D DPC method that does not require a precise motion stage for scanning the focus and uses optimized illumination patterns for improved performance. The user scans the focus by hand, using the microscope's focus knob, and the algorithm self-calibrates the axial position to solve for the 3D refractive index of the sample through a computational inverse problem. We further show that the illumination patterns can be optimized by an end-to-end learning procedure. Combining these two, we demonstrate improved 3D DPC with a commercial microscope whose only hardware modification is LED array illumination.