1
|
Park J, Bai B, Ryu D, Liu T, Lee C, Luo Y, Lee MJ, Huang L, Shin J, Zhang Y, Ryu D, Li Y, Kim G, Min HS, Ozcan A, Park Y. Artificial intelligence-enabled quantitative phase imaging methods for life sciences. Nat Methods 2023; 20:1645-1660. [PMID: 37872244 DOI: 10.1038/s41592-023-02041-4] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/25/2023] [Accepted: 09/11/2023] [Indexed: 10/25/2023]
Abstract
Quantitative phase imaging, integrated with artificial intelligence, allows for the rapid and label-free investigation of the physiology and pathology of biological systems. This review presents the principles of various two-dimensional and three-dimensional label-free phase imaging techniques that exploit refractive index as an intrinsic optical imaging contrast. In particular, we discuss artificial intelligence-based analysis methodologies for biomedical studies including image enhancement, segmentation of cellular or subcellular structures, classification of types of biological samples and image translation to furnish subcellular and histochemical information from label-free phase images. We also discuss the advantages and challenges of artificial intelligence-enabled quantitative phase imaging analyses, summarize recent notable applications in the life sciences, and cover the potential of this field for basic and industrial research in the life sciences.
Collapse
Affiliation(s)
- Juyeon Park
- Department of Physics, Korea Advanced Institute of Science and Technology (KAIST), Daejeon, Republic of Korea
- KAIST Institute for Health Science and Technology, KAIST, Daejeon, Republic of Korea
| | - Bijie Bai
- Electrical and Computer Engineering Department, University of California, Los Angeles, Los Angeles, CA, USA
- Bioengineering Department, University of California, Los Angeles, Los Angeles, CA, USA
| | - DongHun Ryu
- Department of Physics, Korea Advanced Institute of Science and Technology (KAIST), Daejeon, Republic of Korea
- KAIST Institute for Health Science and Technology, KAIST, Daejeon, Republic of Korea
- Department of Electrical Engineering and Computer Science, Massachusetts Institute of Technology, Cambridge, MA, USA
| | - Tairan Liu
- Electrical and Computer Engineering Department, University of California, Los Angeles, Los Angeles, CA, USA
| | - Chungha Lee
- Department of Physics, Korea Advanced Institute of Science and Technology (KAIST), Daejeon, Republic of Korea
- KAIST Institute for Health Science and Technology, KAIST, Daejeon, Republic of Korea
| | - Yi Luo
- Electrical and Computer Engineering Department, University of California, Los Angeles, Los Angeles, CA, USA
| | - Mahn Jae Lee
- KAIST Institute for Health Science and Technology, KAIST, Daejeon, Republic of Korea
- Graduate School of Medical Science and Engineering, Korea Advanced Institute of Science and Technology (KAIST), Daejeon, Republic of Korea
| | - Luzhe Huang
- Electrical and Computer Engineering Department, University of California, Los Angeles, Los Angeles, CA, USA
| | - Jeongwon Shin
- KAIST Institute for Health Science and Technology, KAIST, Daejeon, Republic of Korea
- Department of Biological Sciences, Korea Advanced Institute of Science and Technology (KAIST), Daejeon, Republic of Korea
| | - Yijie Zhang
- Electrical and Computer Engineering Department, University of California, Los Angeles, Los Angeles, CA, USA
| | | | - Yuzhu Li
- Electrical and Computer Engineering Department, University of California, Los Angeles, Los Angeles, CA, USA
| | - Geon Kim
- Department of Physics, Korea Advanced Institute of Science and Technology (KAIST), Daejeon, Republic of Korea
- KAIST Institute for Health Science and Technology, KAIST, Daejeon, Republic of Korea
| | | | - Aydogan Ozcan
- Electrical and Computer Engineering Department, University of California, Los Angeles, Los Angeles, CA, USA.
- Bioengineering Department, University of California, Los Angeles, Los Angeles, CA, USA.
| | - YongKeun Park
- Department of Physics, Korea Advanced Institute of Science and Technology (KAIST), Daejeon, Republic of Korea.
- KAIST Institute for Health Science and Technology, KAIST, Daejeon, Republic of Korea.
- Tomocube, Daejeon, Republic of Korea.
| |
Collapse
|
2
|
Lee M, Kunzi M, Neurohr G, Lee SS, Park Y. Hybrid machine-learning framework for volumetric segmentation and quantification of vacuoles in individual yeast cells using holotomography. BIOMEDICAL OPTICS EXPRESS 2023; 14:4567-4578. [PMID: 37791265 PMCID: PMC10545186 DOI: 10.1364/boe.498475] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/22/2023] [Revised: 07/23/2023] [Accepted: 07/31/2023] [Indexed: 10/05/2023]
Abstract
The precise, quantitative evaluation of intracellular organelles in three-dimensional (3D) imaging data poses a significant challenge due to the inherent constraints of traditional microscopy techniques, the requirements of the use of exogenous labeling agents, and existing computational methods. To counter these challenges, we present a hybrid machine-learning framework exploiting correlative imaging of 3D quantitative phase imaging with 3D fluorescence imaging of labeled cells. The algorithm, which synergistically integrates a random-forest classifier with a deep neural network, is trained using the correlative imaging data set, and the trained network is then applied to 3D quantitative phase imaging of cell data. We applied this method to live budding yeast cells. The results revealed precise segmentation of vacuoles inside individual yeast cells, and also provided quantitative evaluations of biophysical parameters, including volumes, concentration, and dry masses of automatically segmented vacuoles.
Collapse
Affiliation(s)
- Moosung Lee
- Department of Physics, Korea Advanced Institute of Science and Technology (KAIST), Daejeon, 34141, Republic of Korea
- KAIST Institute for Health Science and Technology, KAIST, Daejeon 34141, Republic of Korea
- Current affiliation: Institute for Functional Matter and Quantum Technologies, Universität Stuttgart, 70569 Stuttgart, Germany
| | - Marina Kunzi
- Institute for Biochemistry, Department of Biology, ETH Zürich, 8093 Zürich, Switzerland
- Bringing Materials to Life Initiative, ETH Zürich, Zürich, Switzerland
| | - Gabriel Neurohr
- Institute for Biochemistry, Department of Biology, ETH Zürich, 8093 Zürich, Switzerland
- Bringing Materials to Life Initiative, ETH Zürich, Zürich, Switzerland
| | - Sung Sik Lee
- Institute for Biochemistry, Department of Biology, ETH Zürich, 8093 Zürich, Switzerland
- Bringing Materials to Life Initiative, ETH Zürich, Zürich, Switzerland
- ScopeM (Scientific Center of Optical and Electron Microscopy), ETH Zürich, 8093, Zurich, Switzerland
| | - YongKeun Park
- Department of Physics, Korea Advanced Institute of Science and Technology (KAIST), Daejeon, 34141, Republic of Korea
- KAIST Institute for Health Science and Technology, KAIST, Daejeon 34141, Republic of Korea
- Tomocube Inc., Daejeon 34051, Republic of Korea
| |
Collapse
|
3
|
Lee C, Hugonnet H, Park J, Lee MJ, Park W, Park Y. Single-shot refractive index slice imaging using spectrally multiplexed optical transfer function reshaping. OPTICS EXPRESS 2023; 31:13806-13816. [PMID: 37157259 DOI: 10.1364/oe.485559] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/10/2023]
Abstract
The refractive index (RI) of cells and tissues is crucial in pathophysiology as a noninvasive and quantitative imaging contrast. Although its measurements have been demonstrated using three-dimensional quantitative phase imaging methods, these methods often require bulky interferometric setups or multiple measurements, which limits the measurement sensitivity and speed. Here, we present a single-shot RI imaging method that visualizes the RI of the in-focus region of a sample. By exploiting spectral multiplexing and optical transfer function engineering, three color-coded intensity images of a sample with three optimized illuminations were simultaneously obtained in a single-shot measurement. The measured intensity images were then deconvoluted to obtain the RI image of the in-focus slice of the sample. As a proof of concept, a setup was built using Fresnel lenses and a liquid-crystal display. For validation purposes, we measured microspheres of known RI and cross-validated the results with simulated results. Various static and highly dynamic biological cells were imaged to demonstrate that the proposed method can conduct single-shot RI slice imaging of biological samples with subcellular resolution.
Collapse
|
4
|
Ong JJY, Oh J, Yong Ang X, Naidu R, Chu TTT, Hyoung Im J, Manzoor U, Kha Nguyen T, Na SW, Han ET, Davis C, Sun Park W, Chun W, Jun H, Jin Lee S, Na S, Chan JKY, Park Y, Russell B, Chandramohanadas R, Han JH. Optical diffraction tomography and image reconstruction to measure host cell alterations caused by divergent Plasmodium species. SPECTROCHIMICA ACTA. PART A, MOLECULAR AND BIOMOLECULAR SPECTROSCOPY 2023; 286:122026. [PMID: 36395614 DOI: 10.1016/j.saa.2022.122026] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/12/2022] [Revised: 09/29/2022] [Accepted: 10/18/2022] [Indexed: 06/16/2023]
Abstract
Malaria is a life-threatening infectious disease caused by parasites of the genus Plasmodium. Understanding the biological features of various parasite forms is important for the optical diagnosis and defining pathological states, which are often constrained by the lack of ambient visualization approaches. Here, we employ a label-free tomographic technique to visualize the host red blood cell (RBC) remodeling process and quantify changes in biochemical properties arising from parasitization. Through this, we provide a quantitative body of information pertaining to the influence of host cell environment on growth, survival, and replication of P. falciparum and P. vivax in their respective host cells: mature erythrocytes and young reticulocytes. These exquisite three-dimensional measurements of infected red cells demonstrats the potential of evolving 3D imaging to advance our understanding of Plasmodium biology and host-parasite interactions.
Collapse
Affiliation(s)
- Jessica J Y Ong
- Department of Microbiology and Immunology, University of Otago, Dunedin 9054, New Zealand
| | - Jeonghun Oh
- Department of Physics, Korea Advanced Institute of Science and Technology (KAIST), Daejeon 34141, Republic of Korea; KAIST Institute for Health Science and Technology, KAIST, Daejeon 34141, Republic of Korea
| | - Xiang Yong Ang
- Department of Microbiology and Immunology, National University of Singapore, Singapore
| | - Renugah Naidu
- Pillar of Engineering Product Development, Singapore University of Technology and Design, Singapore, Singapore
| | - Trang T T Chu
- Pillar of Engineering Product Development, Singapore University of Technology and Design, Singapore, Singapore
| | - Jae Hyoung Im
- Department of Infectious Disease, Inha University School of Medicine, Incheon 22212, Republic of Korea
| | - Umar Manzoor
- Department of Medical Environmental Biology and Tropical Medicine, School of Medicine, Kangwon National University, Chuncheon 24341, Republic of Korea
| | - Tuyet Kha Nguyen
- Department of Medical Environmental Biology and Tropical Medicine, School of Medicine, Kangwon National University, Chuncheon 24341, Republic of Korea
| | - Seok-Won Na
- Department of Medical Environmental Biology and Tropical Medicine, School of Medicine, Kangwon National University, Chuncheon 24341, Republic of Korea
| | - Eun-Taek Han
- Department of Medical Environmental Biology and Tropical Medicine, School of Medicine, Kangwon National University, Chuncheon 24341, Republic of Korea
| | - Christeen Davis
- DBT Rajiv Gandhi Centre for Biotechnology, Thiruvananthapuram, Kerala, India; Manipal Academy of Higher Education, Manipal, Karnataka 576104, India
| | - Won Sun Park
- Department of Physiology, School of Medicine, Kangwon National University, Chuncheon 24341, Republic of Korea
| | - Wanjoo Chun
- Department of Pharmacology, School of Medicine, Kangwon National University, Chuncheon 24341, Republic of Korea
| | - Hojong Jun
- Department of Tropical Medicine, Inha University College of Medicine, Incheon 22212, Republic of Korea
| | - Se Jin Lee
- Department of Obstetrics and Gynecology, Kangwon National University Hospital, Kangwon National University School of Medicine, Chuncheon 24341, South Korea
| | - Sunghun Na
- Department of Obstetrics and Gynecology, Kangwon National University Hospital, Kangwon National University School of Medicine, Chuncheon 24341, South Korea
| | - Jerry K Y Chan
- KK Womens' and Childrens' Hospital, Singapore; Academic Clinical Program in Obstetrics and Gynaecology, Duke-NUS Medical School, 169857, Singapore
| | - YongKeun Park
- Department of Physics, Korea Advanced Institute of Science and Technology (KAIST), Daejeon 34141, Republic of Korea; KAIST Institute for Health Science and Technology, KAIST, Daejeon 34141, Republic of Korea; Tomocube Inc, Daejeon 34109, Republic of Korea
| | - Bruce Russell
- Department of Microbiology and Immunology, University of Otago, Dunedin 9054, New Zealand
| | - Rajesh Chandramohanadas
- Department of Microbiology and Immunology, National University of Singapore, Singapore; Pillar of Engineering Product Development, Singapore University of Technology and Design, Singapore, Singapore; DBT Rajiv Gandhi Centre for Biotechnology, Thiruvananthapuram, Kerala, India.
| | - Jin-Hee Han
- Department of Microbiology and Immunology, University of Otago, Dunedin 9054, New Zealand; Department of Medical Environmental Biology and Tropical Medicine, School of Medicine, Kangwon National University, Chuncheon 24341, Republic of Korea.
| |
Collapse
|