1
|
Park J, Bai B, Ryu D, Liu T, Lee C, Luo Y, Lee MJ, Huang L, Shin J, Zhang Y, Ryu D, Li Y, Kim G, Min HS, Ozcan A, Park Y. Artificial intelligence-enabled quantitative phase imaging methods for life sciences. Nat Methods 2023; 20:1645-1660. [PMID: 37872244 DOI: 10.1038/s41592-023-02041-4] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/25/2023] [Accepted: 09/11/2023] [Indexed: 10/25/2023]
Abstract
Quantitative phase imaging, integrated with artificial intelligence, allows for the rapid and label-free investigation of the physiology and pathology of biological systems. This review presents the principles of various two-dimensional and three-dimensional label-free phase imaging techniques that exploit refractive index as an intrinsic optical imaging contrast. In particular, we discuss artificial intelligence-based analysis methodologies for biomedical studies including image enhancement, segmentation of cellular or subcellular structures, classification of types of biological samples and image translation to furnish subcellular and histochemical information from label-free phase images. We also discuss the advantages and challenges of artificial intelligence-enabled quantitative phase imaging analyses, summarize recent notable applications in the life sciences, and cover the potential of this field for basic and industrial research in the life sciences.
Collapse
Affiliation(s)
- Juyeon Park
- Department of Physics, Korea Advanced Institute of Science and Technology (KAIST), Daejeon, Republic of Korea
- KAIST Institute for Health Science and Technology, KAIST, Daejeon, Republic of Korea
| | - Bijie Bai
- Electrical and Computer Engineering Department, University of California, Los Angeles, Los Angeles, CA, USA
- Bioengineering Department, University of California, Los Angeles, Los Angeles, CA, USA
| | - DongHun Ryu
- Department of Physics, Korea Advanced Institute of Science and Technology (KAIST), Daejeon, Republic of Korea
- KAIST Institute for Health Science and Technology, KAIST, Daejeon, Republic of Korea
- Department of Electrical Engineering and Computer Science, Massachusetts Institute of Technology, Cambridge, MA, USA
| | - Tairan Liu
- Electrical and Computer Engineering Department, University of California, Los Angeles, Los Angeles, CA, USA
| | - Chungha Lee
- Department of Physics, Korea Advanced Institute of Science and Technology (KAIST), Daejeon, Republic of Korea
- KAIST Institute for Health Science and Technology, KAIST, Daejeon, Republic of Korea
| | - Yi Luo
- Electrical and Computer Engineering Department, University of California, Los Angeles, Los Angeles, CA, USA
| | - Mahn Jae Lee
- KAIST Institute for Health Science and Technology, KAIST, Daejeon, Republic of Korea
- Graduate School of Medical Science and Engineering, Korea Advanced Institute of Science and Technology (KAIST), Daejeon, Republic of Korea
| | - Luzhe Huang
- Electrical and Computer Engineering Department, University of California, Los Angeles, Los Angeles, CA, USA
| | - Jeongwon Shin
- KAIST Institute for Health Science and Technology, KAIST, Daejeon, Republic of Korea
- Department of Biological Sciences, Korea Advanced Institute of Science and Technology (KAIST), Daejeon, Republic of Korea
| | - Yijie Zhang
- Electrical and Computer Engineering Department, University of California, Los Angeles, Los Angeles, CA, USA
| | | | - Yuzhu Li
- Electrical and Computer Engineering Department, University of California, Los Angeles, Los Angeles, CA, USA
| | - Geon Kim
- Department of Physics, Korea Advanced Institute of Science and Technology (KAIST), Daejeon, Republic of Korea
- KAIST Institute for Health Science and Technology, KAIST, Daejeon, Republic of Korea
| | | | - Aydogan Ozcan
- Electrical and Computer Engineering Department, University of California, Los Angeles, Los Angeles, CA, USA.
- Bioengineering Department, University of California, Los Angeles, Los Angeles, CA, USA.
| | - YongKeun Park
- Department of Physics, Korea Advanced Institute of Science and Technology (KAIST), Daejeon, Republic of Korea.
- KAIST Institute for Health Science and Technology, KAIST, Daejeon, Republic of Korea.
- Tomocube, Daejeon, Republic of Korea.
| |
Collapse
|
2
|
Subedi NR, Stolyar S, Tuson SJ, Marx CJ, Vasdekis AE. Scattered-light-sheet microscopy with sub-cellular resolving power. JOURNAL OF BIOPHOTONICS 2023; 16:e202300068. [PMID: 37287076 DOI: 10.1002/jbio.202300068] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/27/2023] [Revised: 05/26/2023] [Accepted: 05/30/2023] [Indexed: 06/09/2023]
Abstract
Since its first demonstration over 100 years ago, scattering-based light-sheet microscopy has recently re-emerged as a key modality in label-free tissue imaging and cellular morphometry; however, scattering-based light-sheet imaging with subcellular resolution remains an unmet target. This is because related approaches inevitably superimpose speckle or granular intensity modulation on to the native subcellular features. Here, we addressed this challenge by deploying a time-averaged pseudo-thermalized light-sheet illumination. While this approach increased the lateral dimensions of the illumination sheet, we achieved subcellular resolving power after image deconvolution. We validated this approach by imaging cytosolic carbon depots in yeast and bacteria with increased specificity, no staining, and ultralow irradiance levels. Overall, we expect this scattering-based light-sheet microscopy approach will advance single, live cell imaging by conferring low-irradiance and label-free operation towards eradicating phototoxicity.
Collapse
Affiliation(s)
- Nava R Subedi
- Department of Physics, University of Idaho, Moscow, Idaho, USA
| | - Sergey Stolyar
- Department of Biological Sciences, University of Idaho, Moscow, Idaho, USA
| | - Sabrina J Tuson
- Department of Physics, University of Idaho, Moscow, Idaho, USA
| | - Christopher J Marx
- Department of Biological Sciences, University of Idaho, Moscow, Idaho, USA
| | | |
Collapse
|
3
|
Zhang H, Dai H, Hao X, Wang Y, Xing C, Lu Q, Li J, Fu Y, Gao M, Chen Z, Cao Y, Zhu J. Airy-type X-ray states generated using 3/2 flat diffractive optics. OPTICS EXPRESS 2023; 31:18063-18071. [PMID: 37381524 DOI: 10.1364/oe.492003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/30/2023] [Accepted: 05/04/2023] [Indexed: 06/30/2023]
Abstract
X-rays have developed into an essential tool in variety of fields, such as biology, materials, chemistry, and physics etc. Numerous X-ray types, including the orbital angular momentum (OAM), the Laguerre-Gauss, and the Hermite-Gauss states, have been proposed. This greatly enhances the depth of application of X-ray. The X-ray states described above are mostly produced by binary amplitude diffraction elements. In light of this, this paper proposes a flat X-ray diffraction grating based on caustic theory to generate Airy-type X-ray. It is proved by the simulation of multislice method that the proposed grating can generate the Airy beam in the X-ray field. The results show that the generated beams have a secondary parabolic trajectory deflection with the propagation distance, which is consistent with the theory. Inspired by the success of Airy beam in light-sheet microscope, the Airy-type X-ray can be anticipated to enable novel image capability for bio or nanoscience.
Collapse
|
4
|
Dunn L, Luo H, Subedi NR, Kasu R, McDonald AG, Christodoulides DN, Vasdekis AE. Video-rate Raman-based metabolic imaging by Airy light-sheet illumination and photon-sparse detection. Proc Natl Acad Sci U S A 2023; 120:e2210037120. [PMID: 36812197 PMCID: PMC9992822 DOI: 10.1073/pnas.2210037120] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/04/2022] [Accepted: 11/15/2022] [Indexed: 02/24/2023] Open
Abstract
Despite its massive potential, Raman imaging represents just a modest fraction of all research and clinical microscopy to date. This is due to the ultralow Raman scattering cross-sections of most biomolecules that impose low-light or photon-sparse conditions. Bioimaging under such conditions is suboptimal, as it either results in ultralow frame rates or requires increased levels of irradiance. Here, we overcome this tradeoff by introducing Raman imaging that operates at both video rates and 1,000-fold lower irradiance than state-of-the-art methods. To accomplish this, we deployed a judicially designed Airy light-sheet microscope to efficiently image large specimen regions. Further, we implemented subphoton per pixel image acquisition and reconstruction to confront issues arising from photon sparsity at just millisecond integrations. We demonstrate the versatility of our approach by imaging a variety of samples, including the three-dimensional (3D) metabolic activity of single microbial cells and the underlying cell-to-cell variability. To image such small-scale targets, we again harnessed photon sparsity to increase magnification without a field-of-view penalty, thus, overcoming another key limitation in modern light-sheet microscopy.
Collapse
Affiliation(s)
- Lochlann Dunn
- Department of Physics, University of Idaho, Moscow, ID83844-0903
| | - Haokun Luo
- The College of Optics and Photonics, University of Central Florida, Orlando, FL32816-2700
| | - Nava R. Subedi
- Department of Physics, University of Idaho, Moscow, ID83844-0903
| | | | - Armando G. McDonald
- Department of Forest, Rangeland, and Fire Sciences, University of Idaho, Moscow, ID83844-1132
| | | | | |
Collapse
|
5
|
Zhou P, He H, Ma H, Wang S, Hu S. A Review of Optical Imaging Technologies for Microfluidics. MICROMACHINES 2022; 13:mi13020274. [PMID: 35208397 PMCID: PMC8877635 DOI: 10.3390/mi13020274] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/14/2021] [Revised: 01/07/2022] [Accepted: 01/11/2022] [Indexed: 12/15/2022]
Abstract
Microfluidics can precisely control and manipulate micro-scale fluids, and are also known as lab-on-a-chip or micro total analysis systems. Microfluidics have huge application potential in biology, chemistry, and medicine, among other fields. Coupled with a suitable detection system, the detection and analysis of small-volume and low-concentration samples can be completed. This paper reviews an optical imaging system combined with microfluidics, including bright-field microscopy, chemiluminescence imaging, spectrum-based microscopy imaging, and fluorescence-based microscopy imaging. At the end of the article, we summarize the advantages and disadvantages of each imaging technology.
Collapse
Affiliation(s)
- Pan Zhou
- School of Physics and Optoelectronic Engineering, Foshan University, Foshan 528225, China;
- Guangdong-Hong Kong-Macao Joint Laboratory for Intelligent Micro-Nano Optoelectronic Technology, Foshan University, Foshan 528225, China;
| | - Haipeng He
- Guangdong-Hong Kong-Macao Joint Laboratory for Intelligent Micro-Nano Optoelectronic Technology, Foshan University, Foshan 528225, China;
| | - Hanbin Ma
- CAS Key Laboratory of Bio-Medical Diagnostics, Suzhou Institute of Biomedical Engineering and Technology, Chinese Academy of Sciences, Suzhou 215163, China;
- Guangdong ACXEL Micro & Nano Tech Co., Ltd., Foshan 528000, China
| | - Shurong Wang
- Guangdong-Hong Kong-Macao Joint Laboratory for Intelligent Micro-Nano Optoelectronic Technology, Foshan University, Foshan 528225, China;
- Correspondence: (S.W.); (S.H.)
| | - Siyi Hu
- CAS Key Laboratory of Bio-Medical Diagnostics, Suzhou Institute of Biomedical Engineering and Technology, Chinese Academy of Sciences, Suzhou 215163, China;
- Correspondence: (S.W.); (S.H.)
| |
Collapse
|
6
|
Subedi NR, Yaraghi S, Jung PS, Kukal G, McDonald AG, Christodoulides DN, Vasdekis AE. Airy light-sheet Raman imaging. OPTICS EXPRESS 2021; 29:31941-31951. [PMID: 34615275 DOI: 10.1364/oe.435293] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/29/2021] [Accepted: 09/02/2021] [Indexed: 06/13/2023]
Abstract
Light-sheet fluorescence microscopy has greatly improved the speed and overall photostability of optically sectioning cellular and multi-cellular specimens. Similar gains have also been conferred by light-sheet Raman imaging; these schemes, however, rely on diffraction limited Gaussian beams that hinder the uniformity and size of the imaging field-of-view, and, as such, the resulting throughput rates. Here, we demonstrate that a digitally scanned Airy beam increases the Raman imaging throughput rates by more than an order of magnitude than conventional diffraction-limited beams. Overall, this, spectrometer-less, approach enabled 3D imaging of microparticles with high contrast and 1 µm axial resolution at 300 msec integration times per plane and orders of magnitude lower irradiation density than coherent Raman imaging schemes. We detail the apparatus and its performance, as well as its compatibility with fluorescence light-sheet and quantitative-phase imaging towards rapid and low phototoxicity multimodal imaging.
Collapse
|
7
|
Chen X, Kandel ME, Popescu G. Spatial light interference microscopy: principle and applications to biomedicine. ADVANCES IN OPTICS AND PHOTONICS 2021; 13:353-425. [PMID: 35494404 PMCID: PMC9048520 DOI: 10.1364/aop.417837] [Citation(s) in RCA: 27] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/03/2023]
Abstract
In this paper, we review spatial light interference microscopy (SLIM), a common-path, phase-shifting interferometer, built onto a phase-contrast microscope, with white-light illumination. As one of the most sensitive quantitative phase imaging (QPI) methods, SLIM allows for speckle-free phase reconstruction with sub-nanometer path-length stability. We first review image formation in QPI, scattering, and full-field methods. Then, we outline SLIM imaging from theory and instrumentation to diffraction tomography. Zernike's phase-contrast microscopy, phase retrieval in SLIM, and halo removal algorithms are discussed. Next, we discuss the requirements for operation, with a focus on software developed in-house for SLIM that enables high-throughput acquisition, whole slide scanning, mosaic tile registration, and imaging with a color camera. We introduce two methods for solving the inverse problem using SLIM, white-light tomography, and Wolf phase tomography. Lastly, we review the applications of SLIM in basic science and clinical studies. SLIM can study cell dynamics, cell growth and proliferation, cell migration, mass transport, etc. In clinical settings, SLIM can assist with cancer studies, reproductive technology, blood testing, etc. Finally, we review an emerging trend, where SLIM imaging in conjunction with artificial intelligence brings computational specificity and, in turn, offers new solutions to outstanding challenges in cell biology and pathology.
Collapse
|