1
|
Chung Y, Hugonnet H, Hong SM, Park Y. Fourier space aberration correction for high resolution refractive index imaging using incoherent light. OPTICS EXPRESS 2024; 32:18790-18799. [PMID: 38859028 DOI: 10.1364/oe.518479] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/10/2024] [Accepted: 04/23/2024] [Indexed: 06/12/2024]
Abstract
An aberration correction method is introduced for 3D phase deconvolution microscopy. Our technique capitalizes on multiple illumination patterns to iteratively extract Fourier space aberrations, utilizing the overlapping information inherent in these patterns. By refining the point spread function based on the retrieved aberration data, we significantly improve the precision of refractive index deconvolution. We validate the effectiveness of our method on both synthetic and biological three-dimensional samples, achieving notable enhancements in resolution and measurement accuracy. The method's reliability in aberration retrieval is further confirmed through controlled experiments with intentionally induced spherical aberrations, underscoring its potential for wide-ranging applications in microscopy and biomedicine.
Collapse
|
2
|
Park J, Bai B, Ryu D, Liu T, Lee C, Luo Y, Lee MJ, Huang L, Shin J, Zhang Y, Ryu D, Li Y, Kim G, Min HS, Ozcan A, Park Y. Artificial intelligence-enabled quantitative phase imaging methods for life sciences. Nat Methods 2023; 20:1645-1660. [PMID: 37872244 DOI: 10.1038/s41592-023-02041-4] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/25/2023] [Accepted: 09/11/2023] [Indexed: 10/25/2023]
Abstract
Quantitative phase imaging, integrated with artificial intelligence, allows for the rapid and label-free investigation of the physiology and pathology of biological systems. This review presents the principles of various two-dimensional and three-dimensional label-free phase imaging techniques that exploit refractive index as an intrinsic optical imaging contrast. In particular, we discuss artificial intelligence-based analysis methodologies for biomedical studies including image enhancement, segmentation of cellular or subcellular structures, classification of types of biological samples and image translation to furnish subcellular and histochemical information from label-free phase images. We also discuss the advantages and challenges of artificial intelligence-enabled quantitative phase imaging analyses, summarize recent notable applications in the life sciences, and cover the potential of this field for basic and industrial research in the life sciences.
Collapse
Affiliation(s)
- Juyeon Park
- Department of Physics, Korea Advanced Institute of Science and Technology (KAIST), Daejeon, Republic of Korea
- KAIST Institute for Health Science and Technology, KAIST, Daejeon, Republic of Korea
| | - Bijie Bai
- Electrical and Computer Engineering Department, University of California, Los Angeles, Los Angeles, CA, USA
- Bioengineering Department, University of California, Los Angeles, Los Angeles, CA, USA
| | - DongHun Ryu
- Department of Physics, Korea Advanced Institute of Science and Technology (KAIST), Daejeon, Republic of Korea
- KAIST Institute for Health Science and Technology, KAIST, Daejeon, Republic of Korea
- Department of Electrical Engineering and Computer Science, Massachusetts Institute of Technology, Cambridge, MA, USA
| | - Tairan Liu
- Electrical and Computer Engineering Department, University of California, Los Angeles, Los Angeles, CA, USA
| | - Chungha Lee
- Department of Physics, Korea Advanced Institute of Science and Technology (KAIST), Daejeon, Republic of Korea
- KAIST Institute for Health Science and Technology, KAIST, Daejeon, Republic of Korea
| | - Yi Luo
- Electrical and Computer Engineering Department, University of California, Los Angeles, Los Angeles, CA, USA
| | - Mahn Jae Lee
- KAIST Institute for Health Science and Technology, KAIST, Daejeon, Republic of Korea
- Graduate School of Medical Science and Engineering, Korea Advanced Institute of Science and Technology (KAIST), Daejeon, Republic of Korea
| | - Luzhe Huang
- Electrical and Computer Engineering Department, University of California, Los Angeles, Los Angeles, CA, USA
| | - Jeongwon Shin
- KAIST Institute for Health Science and Technology, KAIST, Daejeon, Republic of Korea
- Department of Biological Sciences, Korea Advanced Institute of Science and Technology (KAIST), Daejeon, Republic of Korea
| | - Yijie Zhang
- Electrical and Computer Engineering Department, University of California, Los Angeles, Los Angeles, CA, USA
| | | | - Yuzhu Li
- Electrical and Computer Engineering Department, University of California, Los Angeles, Los Angeles, CA, USA
| | - Geon Kim
- Department of Physics, Korea Advanced Institute of Science and Technology (KAIST), Daejeon, Republic of Korea
- KAIST Institute for Health Science and Technology, KAIST, Daejeon, Republic of Korea
| | | | - Aydogan Ozcan
- Electrical and Computer Engineering Department, University of California, Los Angeles, Los Angeles, CA, USA.
- Bioengineering Department, University of California, Los Angeles, Los Angeles, CA, USA.
| | - YongKeun Park
- Department of Physics, Korea Advanced Institute of Science and Technology (KAIST), Daejeon, Republic of Korea.
- KAIST Institute for Health Science and Technology, KAIST, Daejeon, Republic of Korea.
- Tomocube, Daejeon, Republic of Korea.
| |
Collapse
|
3
|
Wakefield DL, Graham R, Wong K, Wang S, Hale C, Yu CC. Cellular analysis using label-free parallel array microscopy with Fourier ptychography. BIOMEDICAL OPTICS EXPRESS 2022; 13:1312-1327. [PMID: 35415005 PMCID: PMC8973186 DOI: 10.1364/boe.451128] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/14/2021] [Revised: 01/27/2022] [Accepted: 01/28/2022] [Indexed: 06/01/2023]
Abstract
Quantitative phase imaging (QPI) is an ideal method to non-invasively monitor cell populations and provide label-free imaging and analysis. QPI offers enhanced sample characterization and cell counting compared to conventional label-free techniques. We demonstrate this in the current study through a comparison of cell counting data from digital phase contrast (DPC) imaging and from QPI using a system based on Fourier ptychographic microscopy (FPM). Our FPM system offers multi-well, parallel imaging and a QPI-specific cell segmentation method to establish automated and reliable cell counting. Three cell types were studied and FPM showed improvement in the ability to resolve fine details and thin cells, despite limitations of the FPM system incurred by imaging artifacts. Relative to manually counted fluorescence ground-truth, cell counting results after automated segmentation showed improved accuracy with QPI over DPC.
Collapse
Affiliation(s)
- Devin L. Wakefield
- Amgen Inc, South San Francisco, CA 94080, USA
- These authors contributed equally to this work
| | - Richard Graham
- Clearbridge Biophotonics FPM Inc, Pasadena, CA 91101, USA (no longer in operation)
- These authors contributed equally to this work
| | - Kevin Wong
- Clearbridge Biophotonics FPM Inc, Pasadena, CA 91101, USA (no longer in operation)
- These authors contributed equally to this work
| | - Songli Wang
- Amgen Inc, South San Francisco, CA 94080, USA
| | | | - Chung-Chieh Yu
- Clearbridge Biophotonics FPM Inc, Pasadena, CA 91101, USA (no longer in operation)
| |
Collapse
|
4
|
Li AC, Vyas S, Lin YH, Huang YY, Huang HM, Luo Y. Patch-Based U-Net Model for Isotropic Quantitative Differential Phase Contrast Imaging. IEEE TRANSACTIONS ON MEDICAL IMAGING 2021; 40:3229-3237. [PMID: 34152982 DOI: 10.1109/tmi.2021.3091207] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/13/2023]
Abstract
Quantitative differential phase-contrast (qDPC) imaging is a label-free phase retrieval method for weak phase objects using asymmetric illumination. However, qDPC imaging with fewer intensity measurements leads to anisotropic phase distribution in reconstructed images. In order to obtain isotropic phase transfer function, multiple measurements are required; thus, it is a time-consuming process. Here, we propose the feasibility of using deep learning (DL) method for isotropic qDPC microscopy from the least number of measurements. We utilize a commonly used convolutional neural network namely U-net architecture, trained to generate 12-axis isotropic reconstructed cell images (i.e. output) from 1-axis anisotropic cell images (i.e. input). To further extend the number of images for training, the U-net model is trained with a patch-wise approach. In this work, seven different types of living cell images were used for training, validation, and testing datasets. The results obtained from testing datasets show that our proposed DL-based method generates 1-axis qDPC images of similar accuracy to 12-axis measurements. The quantitative phase value in the region of interest is recovered from 66% up to 97%, compared to ground-truth values, providing solid evidence for improved phase uniformity, as well as retrieved missing spatial frequencies in 1-axis reconstructed images. In addition, results from our model are compared with paired and unpaired CycleGANs. Higher PSNR and SSIM values show the advantage of using the U-net model for isotropic qDPC microscopy. The proposed DL-based method may help in performing high-resolution quantitative studies for cell biology.
Collapse
|
5
|
Hoffmann L, Fortmeier I, Elster C. Uncertainty quantification by ensemble learning for computational optical form measurements. MACHINE LEARNING: SCIENCE AND TECHNOLOGY 2021. [DOI: 10.1088/2632-2153/ac0495] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022] Open
Abstract
Abstract
Uncertainty quantification by ensemble learning is explored in terms of an application known from the field of computational optical form measurements. The application requires solving a large-scale, nonlinear inverse problem. Ensemble learning is used to extend the scope of a recently developed deep learning approach for this problem in order to provide an uncertainty quantification of the solution to the inverse problem predicted by the deep learning method. By systematically inserting out-of-distribution errors as well as noisy data, the reliability of the developed uncertainty quantification is explored. Results are encouraging and the proposed application exemplifies the ability of ensemble methods to make trustworthy predictions on the basis of high-dimensional data in a real-world context.
Collapse
|
6
|
Baek Y, Hugonnet H, Park Y. Pupil-aberration calibration with controlled illumination for quantitative phase imaging. OPTICS EXPRESS 2021; 29:22127-22135. [PMID: 34265984 DOI: 10.1364/oe.426080] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/24/2021] [Accepted: 06/09/2021] [Indexed: 06/13/2023]
Abstract
Quantitative phase imaging (QPI) exploits sample-induced changes in the optical field to analyze biological specimens in a label-free manner. However, the quantitative nature of QPI makes it susceptible to optical aberrations. We propose a method for calibrating pupil aberrations by imaging a sample of interest. The proposed method recovers pupil information by utilizing the cross-spectral density between optical fields at different incident angles and allows both thin and weakly scattering three-dimensional samples for calibration. We experimentally validate the proposed method by imaging various samples, including a resolution target, breast tissue, and a polystyrene bead, and demonstrate aberration-free two- and three-dimensional QPI.
Collapse
|
7
|
Lai X, Xiao S, Xu C, Fan S, Wei K. Aberration-free digital holographic phase imaging using the derivative-based principal component analysis. JOURNAL OF BIOMEDICAL OPTICS 2021; 26:JBO-200385R. [PMID: 33840164 PMCID: PMC8035573 DOI: 10.1117/1.jbo.26.4.046501] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 12/13/2020] [Accepted: 03/22/2021] [Indexed: 06/12/2023]
Abstract
SIGNIFICANCE Digital holographic microscopy is widely used to get the quantitative phase information of transparent cells. AIM However, the sample phase is superimposed with aberrations. To quantify the phase information, aberrations need to be fully compensated. APPROACH We propose a technique to obtain aberration-free phase imaging, using the derivative-based principal component analysis (dPCA). RESULTS With dPCA, almost all aberrations can be extracted and compensated without requirements on background segmentation, making it efficient and convenient. CONCLUSIONS It solves the problem that the conventional principal component analysis (PCA) algorithm cannot compensate the common but intricate higher order cross-term aberrations, such as astigmatism and coma. Moreover, the dPCA strategy proposed here is not only suitable for aberration compensation but also applicable for other cases where there exist cross-terms that cannot be analyzed with the PCA algorithm.
Collapse
Affiliation(s)
- Xiaomin Lai
- Hangzhou Dianzi University, School of Automation and Artificial Intelligence, Hangzhou, China
| | - Sheng Xiao
- Boston University, Department of Electrical and Computer Engineering, Boston, Massachusetts, United States
| | - Chen Xu
- Hangzhou Dianzi University, School of Automation and Artificial Intelligence, Hangzhou, China
| | - Shanhui Fan
- Hangzhou Dianzi University, School of Automation and Artificial Intelligence, Hangzhou, China
| | - Kaihua Wei
- Hangzhou Dianzi University, School of Automation and Artificial Intelligence, Hangzhou, China
| |
Collapse
|