1
|
Chung Y, Hugonnet H, Hong SM, Park Y. Fourier space aberration correction for high resolution refractive index imaging using incoherent light. OPTICS EXPRESS 2024; 32:18790-18799. [PMID: 38859028 DOI: 10.1364/oe.518479] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/10/2024] [Accepted: 04/23/2024] [Indexed: 06/12/2024]
Abstract
An aberration correction method is introduced for 3D phase deconvolution microscopy. Our technique capitalizes on multiple illumination patterns to iteratively extract Fourier space aberrations, utilizing the overlapping information inherent in these patterns. By refining the point spread function based on the retrieved aberration data, we significantly improve the precision of refractive index deconvolution. We validate the effectiveness of our method on both synthetic and biological three-dimensional samples, achieving notable enhancements in resolution and measurement accuracy. The method's reliability in aberration retrieval is further confirmed through controlled experiments with intentionally induced spherical aberrations, underscoring its potential for wide-ranging applications in microscopy and biomedicine.
Collapse
|
2
|
Astratov VN, Sahel YB, Eldar YC, Huang L, Ozcan A, Zheludev N, Zhao J, Burns Z, Liu Z, Narimanov E, Goswami N, Popescu G, Pfitzner E, Kukura P, Hsiao YT, Hsieh CL, Abbey B, Diaspro A, LeGratiet A, Bianchini P, Shaked NT, Simon B, Verrier N, Debailleul M, Haeberlé O, Wang S, Liu M, Bai Y, Cheng JX, Kariman BS, Fujita K, Sinvani M, Zalevsky Z, Li X, Huang GJ, Chu SW, Tzang O, Hershkovitz D, Cheshnovsky O, Huttunen MJ, Stanciu SG, Smolyaninova VN, Smolyaninov II, Leonhardt U, Sahebdivan S, Wang Z, Luk’yanchuk B, Wu L, Maslov AV, Jin B, Simovski CR, Perrin S, Montgomery P, Lecler S. Roadmap on Label-Free Super-Resolution Imaging. LASER & PHOTONICS REVIEWS 2023; 17:2200029. [PMID: 38883699 PMCID: PMC11178318 DOI: 10.1002/lpor.202200029] [Citation(s) in RCA: 6] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/17/2022] [Indexed: 06/18/2024]
Abstract
Label-free super-resolution (LFSR) imaging relies on light-scattering processes in nanoscale objects without a need for fluorescent (FL) staining required in super-resolved FL microscopy. The objectives of this Roadmap are to present a comprehensive vision of the developments, the state-of-the-art in this field, and to discuss the resolution boundaries and hurdles which need to be overcome to break the classical diffraction limit of the LFSR imaging. The scope of this Roadmap spans from the advanced interference detection techniques, where the diffraction-limited lateral resolution is combined with unsurpassed axial and temporal resolution, to techniques with true lateral super-resolution capability which are based on understanding resolution as an information science problem, on using novel structured illumination, near-field scanning, and nonlinear optics approaches, and on designing superlenses based on nanoplasmonics, metamaterials, transformation optics, and microsphere-assisted approaches. To this end, this Roadmap brings under the same umbrella researchers from the physics and biomedical optics communities in which such studies have often been developing separately. The ultimate intent of this paper is to create a vision for the current and future developments of LFSR imaging based on its physical mechanisms and to create a great opening for the series of articles in this field.
Collapse
Affiliation(s)
- Vasily N. Astratov
- Department of Physics and Optical Science, University of North Carolina at Charlotte, Charlotte, North Carolina 28223-0001, USA
| | - Yair Ben Sahel
- Department of Computer Science and Applied Mathematics, Weizmann Institute of Science, Rehovot 7610001, Israel
| | - Yonina C. Eldar
- Department of Computer Science and Applied Mathematics, Weizmann Institute of Science, Rehovot 7610001, Israel
| | - Luzhe Huang
- Electrical and Computer Engineering Department, University of California, Los Angeles, California 90095, USA
- Bioengineering Department, University of California, Los Angeles, California 90095, USA
- California Nano Systems Institute (CNSI), University of California, Los Angeles, California 90095, USA
| | - Aydogan Ozcan
- Electrical and Computer Engineering Department, University of California, Los Angeles, California 90095, USA
- Bioengineering Department, University of California, Los Angeles, California 90095, USA
- California Nano Systems Institute (CNSI), University of California, Los Angeles, California 90095, USA
- David Geffen School of Medicine, University of California, Los Angeles, California 90095, USA
| | - Nikolay Zheludev
- Optoelectronics Research Centre, University of Southampton, Southampton, SO17 1BJ, UK
- Centre for Disruptive Photonic Technologies, The Photonics Institute, School of Physical and Mathematical Sciences, Nanyang Technological University, 637371, Singapore
| | - Junxiang Zhao
- Department of Electrical and Computer Engineering, University of California, San Diego, 9500 Gilman Drive, La Jolla, California 92093, USA
| | - Zachary Burns
- Department of Electrical and Computer Engineering, University of California, San Diego, 9500 Gilman Drive, La Jolla, California 92093, USA
| | - Zhaowei Liu
- Department of Electrical and Computer Engineering, University of California, San Diego, 9500 Gilman Drive, La Jolla, California 92093, USA
- Material Science and Engineering, University of California, San Diego, 9500 Gilman Drive, La Jolla, California 92093, USA
| | - Evgenii Narimanov
- School of Electrical Engineering, and Birck Nanotechnology Center, Purdue University, West Lafayette, Indiana 47907, USA
| | - Neha Goswami
- Quantitative Light Imaging Laboratory, Beckman Institute of Advanced Science and Technology, University of Illinois at Urbana-Champaign, Illinois 61801, USA
| | - Gabriel Popescu
- Quantitative Light Imaging Laboratory, Beckman Institute of Advanced Science and Technology, University of Illinois at Urbana-Champaign, Illinois 61801, USA
| | - Emanuel Pfitzner
- Department of Chemistry, University of Oxford, Oxford OX1 3QZ, United Kingdom
| | - Philipp Kukura
- Department of Chemistry, University of Oxford, Oxford OX1 3QZ, United Kingdom
| | - Yi-Teng Hsiao
- Institute of Atomic and Molecular Sciences (IAMS), Academia Sinica 1, Roosevelt Rd. Sec. 4, Taipei 10617 Taiwan
| | - Chia-Lung Hsieh
- Institute of Atomic and Molecular Sciences (IAMS), Academia Sinica 1, Roosevelt Rd. Sec. 4, Taipei 10617 Taiwan
| | - Brian Abbey
- Australian Research Council Centre of Excellence for Advanced Molecular Imaging, La Trobe University, Melbourne, Victoria, Australia
- Department of Chemistry and Physics, La Trobe Institute for Molecular Science (LIMS), La Trobe University, Melbourne, Victoria, Australia
| | - Alberto Diaspro
- Optical Nanoscopy and NIC@IIT, CHT, Istituto Italiano di Tecnologia, Via Enrico Melen 83B, 16152 Genoa, Italy
- DIFILAB, Department of Physics, University of Genoa, Via Dodecaneso 33, 16146 Genoa, Italy
| | - Aymeric LeGratiet
- Optical Nanoscopy and NIC@IIT, CHT, Istituto Italiano di Tecnologia, Via Enrico Melen 83B, 16152 Genoa, Italy
- Université de Rennes, CNRS, Institut FOTON - UMR 6082, F-22305 Lannion, France
| | - Paolo Bianchini
- Optical Nanoscopy and NIC@IIT, CHT, Istituto Italiano di Tecnologia, Via Enrico Melen 83B, 16152 Genoa, Italy
- DIFILAB, Department of Physics, University of Genoa, Via Dodecaneso 33, 16146 Genoa, Italy
| | - Natan T. Shaked
- Tel Aviv University, Faculty of Engineering, Department of Biomedical Engineering, Tel Aviv 6997801, Israel
| | - Bertrand Simon
- LP2N, Institut d’Optique Graduate School, CNRS UMR 5298, Université de Bordeaux, Talence France
| | - Nicolas Verrier
- IRIMAS UR UHA 7499, Université de Haute-Alsace, Mulhouse, France
| | | | - Olivier Haeberlé
- IRIMAS UR UHA 7499, Université de Haute-Alsace, Mulhouse, France
| | - Sheng Wang
- School of Physics and Technology, Wuhan University, China
- Wuhan Institute of Quantum Technology, China
| | - Mengkun Liu
- Department of Physics and Astronomy, Stony Brook University, USA
- National Synchrotron Light Source II, Brookhaven National Laboratory, USA
| | - Yeran Bai
- Boston University Photonics Center, Boston, MA 02215, USA
| | - Ji-Xin Cheng
- Boston University Photonics Center, Boston, MA 02215, USA
| | - Behjat S. Kariman
- Optical Nanoscopy and NIC@IIT, CHT, Istituto Italiano di Tecnologia, Via Enrico Melen 83B, 16152 Genoa, Italy
- DIFILAB, Department of Physics, University of Genoa, Via Dodecaneso 33, 16146 Genoa, Italy
| | - Katsumasa Fujita
- Department of Applied Physics and the Advanced Photonics and Biosensing Open Innovation Laboratory (AIST); and the Transdimensional Life Imaging Division, Institute for Open and Transdisciplinary Research Initiatives, Osaka University, Osaka, Japan
| | - Moshe Sinvani
- Faculty of Engineering and the Nano-Technology Center, Bar-Ilan University, Ramat Gan, 52900 Israel
| | - Zeev Zalevsky
- Faculty of Engineering and the Nano-Technology Center, Bar-Ilan University, Ramat Gan, 52900 Israel
| | - Xiangping Li
- Guangdong Provincial Key Laboratory of Optical Fiber Sensing and Communications, Institute of Photonics Technology, Jinan University, Guangzhou 510632, China
| | - Guan-Jie Huang
- Department of Physics and Molecular Imaging Center, National Taiwan University, Taipei 10617, Taiwan
- Brain Research Center, National Tsing Hua University, Hsinchu 30013, Taiwan
| | - Shi-Wei Chu
- Department of Physics and Molecular Imaging Center, National Taiwan University, Taipei 10617, Taiwan
- Brain Research Center, National Tsing Hua University, Hsinchu 30013, Taiwan
| | - Omer Tzang
- School of Chemistry, The Sackler faculty of Exact Sciences, and the Center for Light matter Interactions, and the Tel Aviv University Center for Nanoscience and Nanotechnology, Tel Aviv 69978, Israel
| | - Dror Hershkovitz
- School of Chemistry, The Sackler faculty of Exact Sciences, and the Center for Light matter Interactions, and the Tel Aviv University Center for Nanoscience and Nanotechnology, Tel Aviv 69978, Israel
| | - Ori Cheshnovsky
- School of Chemistry, The Sackler faculty of Exact Sciences, and the Center for Light matter Interactions, and the Tel Aviv University Center for Nanoscience and Nanotechnology, Tel Aviv 69978, Israel
| | - Mikko J. Huttunen
- Laboratory of Photonics, Physics Unit, Tampere University, FI-33014, Tampere, Finland
| | - Stefan G. Stanciu
- Center for Microscopy – Microanalysis and Information Processing, Politehnica University of Bucharest, 313 Splaiul Independentei, 060042, Bucharest, Romania
| | - Vera N. Smolyaninova
- Department of Physics Astronomy and Geosciences, Towson University, 8000 York Rd., Towson, MD 21252, USA
| | - Igor I. Smolyaninov
- Department of Electrical and Computer Engineering, University of Maryland, College Park, MD 20742, USA
| | - Ulf Leonhardt
- Weizmann Institute of Science, Rehovot 7610001, Israel
| | - Sahar Sahebdivan
- EMTensor GmbH, TechGate, Donau-City-Strasse 1, 1220 Wien, Austria
| | - Zengbo Wang
- School of Computer Science and Electronic Engineering, Bangor University, Bangor, LL57 1UT, United Kingdom
| | - Boris Luk’yanchuk
- Faculty of Physics, Lomonosov Moscow State University, Moscow 119991, Russia
| | - Limin Wu
- Department of Materials Science and State Key Laboratory of Molecular Engineering of Polymers, Fudan University, Shanghai 200433, China
| | - Alexey V. Maslov
- Department of Radiophysics, University of Nizhny Novgorod, Nizhny Novgorod, 603022, Russia
| | - Boya Jin
- Department of Physics and Optical Science, University of North Carolina at Charlotte, Charlotte, North Carolina 28223-0001, USA
| | - Constantin R. Simovski
- Department of Electronics and Nano-Engineering, Aalto University, FI-00076, Espoo, Finland
- Faculty of Physics and Engineering, ITMO University, 199034, St-Petersburg, Russia
| | - Stephane Perrin
- ICube Research Institute, University of Strasbourg - CNRS - INSA de Strasbourg, 300 Bd. Sébastien Brant, 67412 Illkirch, France
| | - Paul Montgomery
- ICube Research Institute, University of Strasbourg - CNRS - INSA de Strasbourg, 300 Bd. Sébastien Brant, 67412 Illkirch, France
| | - Sylvain Lecler
- ICube Research Institute, University of Strasbourg - CNRS - INSA de Strasbourg, 300 Bd. Sébastien Brant, 67412 Illkirch, France
| |
Collapse
|
3
|
Bhatt S, Butola A, Kumar A, Thapa P, Joshi A, Jadhav S, Singh N, Prasad DK, Agarwal K, Mehta DS. Single-shot multispectral quantitative phase imaging of biological samples using deep learning. APPLIED OPTICS 2023; 62:3989-3999. [PMID: 37706710 DOI: 10.1364/ao.482788] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/09/2022] [Accepted: 04/18/2023] [Indexed: 09/15/2023]
Abstract
Multispectral quantitative phase imaging (MS-QPI) is a high-contrast label-free technique for morphological imaging of the specimens. The aim of the present study is to extract spectral dependent quantitative information in single-shot using a highly spatially sensitive digital holographic microscope assisted by a deep neural network. There are three different wavelengths used in our method: λ=532, 633, and 808 nm. The first step is to get the interferometric data for each wavelength. The acquired datasets are used to train a generative adversarial network to generate multispectral (MS) quantitative phase maps from a single input interferogram. The network was trained and validated on two different samples: the optical waveguide and MG63 osteosarcoma cells. Validation of the present approach is performed by comparing the predicted MS phase maps with numerically reconstructed (F T+T I E) phase maps and quantifying with different image quality assessment metrices.
Collapse
|
4
|
Ledwig P, Robles FE. Partially coherent broadband 3D optical transfer functions with arbitrary temporal and angular power spectra. APL PHOTONICS 2023; 8:041301. [PMID: 37038474 PMCID: PMC10080387 DOI: 10.1063/5.0123206] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 08/29/2022] [Accepted: 03/10/2023] [Indexed: 06/19/2023]
Abstract
Optical diffraction tomography is a powerful technique to produce 3D volumetric images of biological samples using contrast produced by variations in the index of refraction in an unlabeled specimen. While this is typically performed with coherent illumination from a variety of angles, interest has grown in partially coherent methods due to the simplicity of the illumination and the computation-free axial sectioning provided by the coherence window of the source. However, such methods rely on the symmetry or discretization of a source to facilitate quantitative analysis and are unable to efficiently handle arbitrary illumination that may vary asymmetrically in angle and continuously in the spectrum, such as diffusely scattered or thermal sources. A general broadband theory may expand the scope of illumination methods available for quantitative analysis, as partially coherent sources are commonly available and may benefit from the effects of spatial and temporal incoherence. In this work, we investigate partially coherent tomographic phase microscopy from arbitrary sources regardless of angular distribution and spectrum by unifying the effects of spatial and temporal coherence into a single formulation. This approach further yields a method for efficient computation of the overall systems' optical transfer function, which scales with O(n 3), down from O(mn 4) for existing convolutional methods, where n 3 is the number of spatial voxels in 3D space and m is the number of discrete wavelengths in the illumination spectrum. This work has important implications for enabling partially coherent 3D quantitative phase microscopy and refractive index tomography in virtually any transmission or epi-illumination microscope.
Collapse
|
5
|
Ullah H, Li J, Zhou S, Bai Z, Ye R, Chen Q, Zuo C. Parallel synthetic aperture transport-of-intensity diffraction tomography with annular illumination. OPTICS LETTERS 2023; 48:1638-1641. [PMID: 37221729 DOI: 10.1364/ol.485406] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/11/2023] [Accepted: 02/21/2023] [Indexed: 05/25/2023]
Abstract
Transport-of-intensity diffraction tomography (TIDT) is a recently developed label-free computational microscopy technique that retrieves high-resolution three-dimensional (3D) refractive index (RI) distribution of biological specimens from 3D intensity-only measurements. However, the non-interferometric synthetic aperture in TIDT is generally achieved sequentially through the acquisition of a large number of through-focus intensity stacks captured at different illumination angles, resulting in a very cumbersome and redundant data acquisition process. To this end, we present a parallel implementation of a synthetic aperture in TIDT (PSA-TIDT) with annular illumination. We found that the matched annular illumination provides a mirror-symmetric 3D optical transfer function, indicating the analyticity in the upper half-plane of the complex phase function, which allows for recovery of the 3D RI from a single intensity stack. We experimentally validated PSA-TIDT by conducting high-resolution tomographic imaging of various unlabeled biological samples, including human breast cancer cell lines (MCF-7), human hepatocyte carcinoma cell lines (HepG2), Henrietta Lacks (HeLa) cells, and red blood cells (RBCs).
Collapse
|
6
|
Recovery of continuous 3D refractive index maps from discrete intensity-only measurements using neural fields. NAT MACH INTELL 2022. [DOI: 10.1038/s42256-022-00530-3] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/31/2022]
|
7
|
Hugonnet H, Lee MJ, Park YK. Quantitative phase and refractive index imaging of 3D objects via optical transfer function reshaping. OPTICS EXPRESS 2022; 30:13802-13809. [PMID: 35472985 DOI: 10.1364/oe.454533] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/21/2022] [Accepted: 03/19/2022] [Indexed: 06/14/2023]
Abstract
Deconvolution phase microscopy enables high-contrast visualization of transparent samples through reconstructions of their transmitted phases or refractive indexes. Herein, we propose a method to extend 2D deconvolution phase microscopy to thick 3D samples. The refractive index distribution of a sample can be obtained at a specific axial plane by measuring only four intensity images obtained under optimized illumination patterns. Also, the optical phase delay of a sample can be measured using different illumination patterns.
Collapse
|
8
|
Müllers D, Kuhl J, Kontermann S. Nonparaxial optical transfer function for arbitrary illumination in partially coherent imaging systems and the oblique source application. JOURNAL OF THE OPTICAL SOCIETY OF AMERICA. A, OPTICS, IMAGE SCIENCE, AND VISION 2022; 39:744-758. [PMID: 35471401 DOI: 10.1364/josaa.452462] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/29/2021] [Accepted: 03/03/2022] [Indexed: 06/14/2023]
Abstract
Recent research in quantitative phase and refractive index microscopy showed promising results with methods using a partially coherent imaging setup, such as partially coherent optical diffraction tomography. For these methods, the phase optical transfer function (POTF), which describes the transmission of spatial frequencies by the imaging system, is crucial. Here, a one-dimensional integral representation of the POTF for imaging systems with arbitrary illumination is derived. It generalizes the existing expression, which is limited to axially symmetric setups. From the general integral form, an analytical solution is derived for the case of oblique homogeneous disk-shaped illumination. This demonstrates the potential of the general representation by offering an additional approach for illumination design in quantitative phase and refractive index microscopy.
Collapse
|
9
|
Perspective: Emerging strategies for determining atomic-resolution structures of macromolecular complexes within cells. J Struct Biol 2021; 214:107827. [PMID: 34915129 PMCID: PMC8978977 DOI: 10.1016/j.jsb.2021.107827] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/07/2021] [Revised: 12/05/2021] [Accepted: 12/08/2021] [Indexed: 11/28/2022]
Abstract
In principle, electron cryo-tomography (cryo-ET) of thin portions of cells provides high-resolution images of the three-dimensional spatial arrangement of all members of the proteome. In practice, however, radiation damage creates a tension between recording images at many different tilt angles, but at correspondingly reduced exposure levels, versus limiting the number of tilt angles in order to improve the signal-to-noise ratio (SNR). Either way, it is challenging to read the available information out at the level of atomic structure. Here, we first review work that explores the optimal strategy for data collection, which currently seems to favor the use of a limited angular range for tilting the sample or even the use of a single image to record the high-resolution information. Looking then to the future, we point to the alternative of so-called “deconvolution microscopy”, which may be applied to tilt-series or optically-sectioned, focal series data. Recording data as a focal series has the advantage that little or no translational alignment of frames might be needed, and a three-dimensional reconstruction might require only 2/3 the number of images as does standard tomography. We also point to the unexploited potential of phase plates to increase the contrast, and thus to reduce the electron exposure levels while retaining the ability align and merge the data. In turn, using much lower exposures per image could have the advantage that high-resolution information is retained throughout the full data-set, whether recorded as a tilt series or a focal series of images.
Collapse
|
10
|
Long JM, Chun JY, Gaylord TK. ADMM approach for efficient iterative tomographic deconvolution reconstruction of 3D quantitative phase images. APPLIED OPTICS 2021; 60:8485-8492. [PMID: 34612951 DOI: 10.1364/ao.433999] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/25/2021] [Accepted: 08/20/2021] [Indexed: 06/13/2023]
Abstract
Tomographic deconvolution phase microscopy (TDPM) is a promising approach for 3D quantitative imaging of phase objects such as biological cells and optical fibers. In the present work, the alternating direction method of multipliers (ADMM) is applied to TDPM to shorten its image acquisition and processing times while simultaneously improving its accuracy. ADMM-TDPM is used to optimize the image fidelity by minimizing Gaussian noise and by using total variation regularization with the constraints of nonnegativity and known zeros. ADMM-TDPM can reconstruct phase objects that are shift variant in three spatial dimensions. ADMM-TDPM achieves speedups of 5x in image acquisition time and greater than 10x in image processing time with accompanying higher accuracy compared to TDPM.
Collapse
|
11
|
Xiao S, Zheng S, Mertz J. High-speed multifocus phase imaging in thick tissue. BIOMEDICAL OPTICS EXPRESS 2021; 12:5782-5792. [PMID: 34692215 PMCID: PMC8515987 DOI: 10.1364/boe.436247] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/08/2021] [Revised: 08/06/2021] [Accepted: 08/07/2021] [Indexed: 05/07/2023]
Abstract
Phase microscopy is widely used to image unstained biological samples. However, most phase imaging techniques require transmission geometries, making them unsuited for thick sample applications. Moreover, when applied to volumetric imaging, phase imaging generally requires large numbers of measurements, often making it too slow to capture live biological processes with fast 3D index-of-refraction variations. By combining oblique back-illumination microscopy and a z-splitter prism, we perform phase imaging that is both epi-mode and multifocus, enabling high-speed 3D phase imaging in thick, scattering tissues with a single camera. We demonstrate here 3D qualitative phase imaging of blood flow in chick embryos over a field of view of 546 × 546 × 137 µm3 at speeds up to 47 Hz.
Collapse
Affiliation(s)
- Sheng Xiao
- Department of Biomedical Engineering, Boston University, 44 Cummington Mall, Boston, MA 02215, USA
| | - Shuqi Zheng
- Department of Biomedical Engineering, Boston University, 44 Cummington Mall, Boston, MA 02215, USA
| | - Jerome Mertz
- Department of Biomedical Engineering, Boston University, 44 Cummington Mall, Boston, MA 02215, USA
| |
Collapse
|
12
|
Kwon IH, Kim IY, Heo MB, Park JW, Lee SW, Lee TG. Real-time heart rate monitoring system for cardiotoxicity assessment of Daphnia magna using high-speed digital holographic microscopy. THE SCIENCE OF THE TOTAL ENVIRONMENT 2021; 780:146405. [PMID: 33774290 DOI: 10.1016/j.scitotenv.2021.146405] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/29/2020] [Revised: 02/22/2021] [Accepted: 03/06/2021] [Indexed: 06/12/2023]
Abstract
Machine vision techniques for monitoring heart rates in aquatic bioassays have been applied to cardiotoxicity assessment. However, the requisite large data sizes and long calculation times make long-term observations of heart rates difficult. In this study, we developed a real-time heart rate monitoring system for individual Daphnia magna in a water chamber mounter that immobilizes their movement in 100 mL media. Heart rates are calculated from real-time, time-resolved relative phase information from digital holograms acquired with a 200 fps camera and parallel computation using a graphics processing unit. With this system, we monitored the real-time changes in the heart rates of individual D. magna specimens exposed to H2O2 as a positive control for reactive oxygen species (ROS) levels in an aquatic environment for 10 h, a period long enough to observe dynamic heart rate responses to the mounting process and exposure and to establish heart rate trends. An additional group analysis was conducted to compare to conventional cardiotoxicity assessment, with results of both assessments showing that the heart rates reduced according to ROS level by H2O2 exposure concentration. Notably, the results of our real-time dynamic heart rate monitoring in aquatic conditions indicated that establishing a relaxation heart rate before measurements could improve the accuracy of toxicity assessment. It is believed that the system developed in this study, achieving the simultaneous measurement, analysis, and display of reconstructed results, will find wide application in other aquatic bioassays.
Collapse
Affiliation(s)
- Ik Hwan Kwon
- Safety Measurement Institute, Korea Research Institute of Standards and Science, Daejeon 34113, Republic of Korea
| | - In Young Kim
- Safety Measurement Institute, Korea Research Institute of Standards and Science, Daejeon 34113, Republic of Korea
| | - Min Beom Heo
- Safety Measurement Institute, Korea Research Institute of Standards and Science, Daejeon 34113, Republic of Korea
| | - June-Woo Park
- Environmental Biology Research Group, Korea Institute of Toxicology, 17 Jegok-gil, Jinju 52834, Republic of Korea; Human and Environmental Toxicology Program, University of Science and Technology, Daejeon 34113, Republic of Korea
| | - Sang-Won Lee
- Safety Measurement Institute, Korea Research Institute of Standards and Science, Daejeon 34113, Republic of Korea; Department of Medical Physics, University of Science and Technology, Daejeon 34113, Republic of Korea.
| | - Tae Geol Lee
- Safety Measurement Institute, Korea Research Institute of Standards and Science, Daejeon 34113, Republic of Korea; Department of Nano Science, University of Science and Technology, Daejeon 34113, Republic of Korea.
| |
Collapse
|
13
|
Zdańkowski P, Winnik J, Patorski K, Gocłowski P, Ziemczonok M, Józwik M, Kujawińska M, Trusiak M. Common-path intrinsically achromatic optical diffraction tomography. BIOMEDICAL OPTICS EXPRESS 2021; 12:4219-4234. [PMID: 34457410 PMCID: PMC8367224 DOI: 10.1364/boe.428828] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/26/2021] [Revised: 06/05/2021] [Accepted: 06/07/2021] [Indexed: 06/13/2023]
Abstract
In this work we propose an open-top like common-path intrinsically achromatic optical diffraction tomography system. It operates as a total-shear interferometer and employs Ronchi-type amplitude diffraction grating, positioned in between the camera and the tube lens without an additional 4f system, generating three-beam interferograms with achromatic second harmonic. Such configuration makes the proposed system low cost, compact and immune to vibrations. We present the results of the measurements of 3D-printed cell phantom using laser diode (coherent) and superluminescent diode (partially coherent) light sources. Broadband light sources can be naturally employed without the need for any cumbersome compensation because of the intrinsic achromaticity of the interferometric recording (holograms generated by -1st and +1st conjugated diffraction orders are not affected by the illumination wavelength). The results show that the decreased coherence offers much reduced coherent noise and higher fidelity tomographic reconstruction especially when applied nonnegativity constraint regularization procedure.
Collapse
Affiliation(s)
- Piotr Zdańkowski
- Warsaw University of Technology, Institute of Micromechanics and Photonics, 8 Św. A. Boboli st., 02-525 Warsaw, Poland
- These authors contributed equally to this work
| | - Julianna Winnik
- Warsaw University of Technology, Institute of Micromechanics and Photonics, 8 Św. A. Boboli st., 02-525 Warsaw, Poland
- These authors contributed equally to this work
| | - Krzysztof Patorski
- Warsaw University of Technology, Institute of Micromechanics and Photonics, 8 Św. A. Boboli st., 02-525 Warsaw, Poland
| | - Paweł Gocłowski
- Warsaw University of Technology, Institute of Micromechanics and Photonics, 8 Św. A. Boboli st., 02-525 Warsaw, Poland
| | - Michał Ziemczonok
- Warsaw University of Technology, Institute of Micromechanics and Photonics, 8 Św. A. Boboli st., 02-525 Warsaw, Poland
| | - Michał Józwik
- Warsaw University of Technology, Institute of Micromechanics and Photonics, 8 Św. A. Boboli st., 02-525 Warsaw, Poland
| | - Małgorzata Kujawińska
- Warsaw University of Technology, Institute of Micromechanics and Photonics, 8 Św. A. Boboli st., 02-525 Warsaw, Poland
| | - Maciej Trusiak
- Warsaw University of Technology, Institute of Micromechanics and Photonics, 8 Św. A. Boboli st., 02-525 Warsaw, Poland
| |
Collapse
|
14
|
Chen X, Kandel ME, Popescu G. Spatial light interference microscopy: principle and applications to biomedicine. ADVANCES IN OPTICS AND PHOTONICS 2021; 13:353-425. [PMID: 35494404 PMCID: PMC9048520 DOI: 10.1364/aop.417837] [Citation(s) in RCA: 27] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/03/2023]
Abstract
In this paper, we review spatial light interference microscopy (SLIM), a common-path, phase-shifting interferometer, built onto a phase-contrast microscope, with white-light illumination. As one of the most sensitive quantitative phase imaging (QPI) methods, SLIM allows for speckle-free phase reconstruction with sub-nanometer path-length stability. We first review image formation in QPI, scattering, and full-field methods. Then, we outline SLIM imaging from theory and instrumentation to diffraction tomography. Zernike's phase-contrast microscopy, phase retrieval in SLIM, and halo removal algorithms are discussed. Next, we discuss the requirements for operation, with a focus on software developed in-house for SLIM that enables high-throughput acquisition, whole slide scanning, mosaic tile registration, and imaging with a color camera. We introduce two methods for solving the inverse problem using SLIM, white-light tomography, and Wolf phase tomography. Lastly, we review the applications of SLIM in basic science and clinical studies. SLIM can study cell dynamics, cell growth and proliferation, cell migration, mass transport, etc. In clinical settings, SLIM can assist with cancer studies, reproductive technology, blood testing, etc. Finally, we review an emerging trend, where SLIM imaging in conjunction with artificial intelligence brings computational specificity and, in turn, offers new solutions to outstanding challenges in cell biology and pathology.
Collapse
|
15
|
Huang J, Bao Y, Gaylord TK. Analytical phase optical transfer function for Gaussian illumination and the optimized illumination profiles. JOURNAL OF THE OPTICAL SOCIETY OF AMERICA. A, OPTICS, IMAGE SCIENCE, AND VISION 2021; 38:750-764. [PMID: 33983281 DOI: 10.1364/josaa.417407] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/11/2020] [Accepted: 03/31/2021] [Indexed: 06/12/2023]
Abstract
The imaging performance of tomographic deconvolution phase microscopy can be described in terms of the phase optical transfer function (POTF) which, in turn, depends on the illumination profile. To facilitate the optimization of the illumination profile, an analytical calculation method based on polynomial fitting is developed to describe the POTF for general nonuniform axially symmetric illumination. This is then applied to Gaussian and related profiles. Compared to numerical integration methods that integrate over a series of annuli, the present analytical method is much faster and is equally accurate. Further, a "balanced distribution" criterion for the POTF and a least-squares minimization are presented to optimize the uniformity of the POTF. An optimum general profile is found analytically by relaxed optimal search, and an optimum Gaussian profile is found through a tree search. Numerical simulations confirm the performance of these optimum profiles and support the balanced distribution criterion introduced.
Collapse
|
16
|
Hugonnet H, Lee M, Park Y. Optimizing illumination in three-dimensional deconvolution microscopy for accurate refractive index tomography. OPTICS EXPRESS 2021; 29:6293-6301. [PMID: 33726154 DOI: 10.1364/oe.412510] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/12/2023]
Abstract
In light transmission microscopy, axial scanning does not directly provide tomographic reconstruction of specimen. Phase deconvolution microscopy can convert a raw intensity image stack into a refractive index tomogram, the intrinsic sample contrast which can be exploited for quantitative morphological analysis. However, this technique is limited by reconstruction artifacts due to unoptimized optical conditions, which leads to a sparse and non-uniform optical transfer function. Here, we propose an optimization method based on simulated annealing to systematically obtain optimal illumination schemes that enable artifact-free deconvolution. The proposed method showed precise tomographic reconstruction of unlabeled biological samples.
Collapse
|
17
|
Huang J, Bao Y, Gaylord TK. Three-dimensional phase optical transfer function in axially symmetric microscopic quantitative phase imaging. JOURNAL OF THE OPTICAL SOCIETY OF AMERICA. A, OPTICS, IMAGE SCIENCE, AND VISION 2020; 37:1857-1872. [PMID: 33362127 DOI: 10.1364/josaa.403861] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/27/2020] [Accepted: 09/29/2020] [Indexed: 06/12/2023]
Abstract
Three-dimensional quantitative phase imaging (3D QPI) is widely recognized as a potentially high-impact microscopic modality. Central to determining the resolution capability of 3D QPI is the phase optical transfer function (POTF). The magnitude of the POTF over its spatial frequency coverage (SFC) specifies the intensity of the response for each allowed spatial frequency. In this paper, a detailed analysis of the POTF for an axially symmetric optical configuration is presented. First, a useful geometric interpretation of the SFC, which enables its visualization, is presented. Second, a closed-form 1D integral expression is derived for the POTF in the general nonparaxial case, which enables rapid calculation of the POTF. Third, this formulation is applied to disk, annular, multi-annuli, and Gaussian illuminations as well as to an annular objective. Taken together, these contributions enable the visualization and simplified calculation of the 3D axially symmetric POTF and provide a basis for optimizing QPI in a wide range of applications.
Collapse
|
18
|
Guo SM, Yeh LH, Folkesson J, Ivanov IE, Krishnan AP, Keefe MG, Hashemi E, Shin D, Chhun BB, Cho NH, Leonetti MD, Han MH, Nowakowski TJ, Mehta SB. Revealing architectural order with quantitative label-free imaging and deep learning. eLife 2020; 9:e55502. [PMID: 32716843 PMCID: PMC7431134 DOI: 10.7554/elife.55502] [Citation(s) in RCA: 30] [Impact Index Per Article: 7.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/27/2020] [Accepted: 07/24/2020] [Indexed: 01/21/2023] Open
Abstract
We report quantitative label-free imaging with phase and polarization (QLIPP) for simultaneous measurement of density, anisotropy, and orientation of structures in unlabeled live cells and tissue slices. We combine QLIPP with deep neural networks to predict fluorescence images of diverse cell and tissue structures. QLIPP images reveal anatomical regions and axon tract orientation in prenatal human brain tissue sections that are not visible using brightfield imaging. We report a variant of U-Net architecture, multi-channel 2.5D U-Net, for computationally efficient prediction of fluorescence images in three dimensions and over large fields of view. Further, we develop data normalization methods for accurate prediction of myelin distribution over large brain regions. We show that experimental defects in labeling the human tissue can be rescued with quantitative label-free imaging and neural network model. We anticipate that the proposed method will enable new studies of architectural order at spatial scales ranging from organelles to tissue.
Collapse
Affiliation(s)
| | - Li-Hao Yeh
- Chan Zuckerberg BiohubSan FranciscoUnited States
| | | | | | | | - Matthew G Keefe
- Department of Anatomy, University of California, San FranciscoSan FranciscoUnited States
| | - Ezzat Hashemi
- Department of Neurology, Stanford UniversityStanfordUnited States
| | - David Shin
- Department of Anatomy, University of California, San FranciscoSan FranciscoUnited States
| | | | - Nathan H Cho
- Chan Zuckerberg BiohubSan FranciscoUnited States
| | | | - May H Han
- Department of Neurology, Stanford UniversityStanfordUnited States
| | - Tomasz J Nowakowski
- Department of Anatomy, University of California, San FranciscoSan FranciscoUnited States
| | | |
Collapse
|
19
|
Suzuki Y, Watanabe S, Odaira M, Okamura T, Kawata Y. Numerical simulations of partially coherent illumination for multi-scattering phase objects via a beam propagation method. APPLIED OPTICS 2019; 58:954-962. [PMID: 30874142 DOI: 10.1364/ao.58.000954] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/27/2018] [Accepted: 01/02/2019] [Indexed: 06/09/2023]
Abstract
Many studies have performed imaging under partially coherent illumination. However, to the best of our knowledge, there are no imaging methods for complicated objects such as cell colonies, which are large and diffract light multiple times. In this paper, we propose an image calculation method for the partially coherent illumination of a large-scale three-dimensional multi-diffractive object. The image is calculated via the summation of coherent images of each illumination angle using the beam propagation method. We apply this method to various microscopic observations, including phase contrast and differential interference contrast. Our method shows excellent agreement with experimental images of a bead and a photonic crystal fiber. As with a cell colony, our method reproduced the characteristics of the image through experimentation. Finally, we discuss the accuracy and the restriction conditions of our method.
Collapse
|
20
|
Bao Y, Gaylord TK. Quantitative phase imaging of fiber Bragg gratings in multicore fibers. APPLIED OPTICS 2018; 57:10062-10071. [PMID: 30645265 DOI: 10.1364/ao.57.010062] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/16/2018] [Accepted: 10/31/2018] [Indexed: 06/09/2023]
Abstract
Fiber Bragg gratings (FBGs) and multi-core fibers (MCFs) have independently demonstrated high levels of performance in numerous diverse applications. When integrated together, the devices can offer enhanced performance as well as open more applications. In all of these cases, the refractive index (RI) characterization of the FBGs is crucial in monitoring and validating the fabricated devices. To accomplish this, quantitative phase imaging (QPI) is a promising RI characterization candidate satisfying all of the requirements: noninvasive measurement, quantitative characterization, sub-micrometer resolution, no a priori knowledge, and 3D reconstruction. In this paper, we propose a new QPI method for characterization of the RI distribution of multiple FBGs in a single MCF. We have identified the key challenges associated with this approach: the pixel integration effect, aliasing effect, numerical aperture requirement, and characteristic functions recovery. We have further identified approaches for overcoming each of these challenges that have previously impeded this direction of research. The proposed method is supported by simulations of 2D and 3D gratings.
Collapse
|
21
|
Soto JM, Rodrigo JA, Alieva T. Partially coherent illumination engineering for enhanced refractive index tomography. OPTICS LETTERS 2018; 43:4699-4702. [PMID: 30272718 DOI: 10.1364/ol.43.004699] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/02/2018] [Accepted: 08/27/2018] [Indexed: 05/27/2023]
Abstract
Optical diffraction tomography based on partially coherent illumination (PC-ODT) is a quantitative label-free imaging technique that allows reconstructing of the object's 3D refractive index from measured through-focus intensity images. PC illumination provides advantages such as speckle noise-free imaging and inherent compatibility with conventional wide-field microscopes. Here we experimentally demonstrate that a proper design of the PC illumination, different from the familiar bright-field one, and the use of more realistic optical transfer functions (OTFs) have crucial importance in PC-ODT to significantly increase the accuracy in 3D refractive index reconstruction. While realistic OTFs properly account for the real experimental illumination conditions, the proposed PC illumination design allows for gathering the object spatial-frequency content attenuated when bright-field illumination is used.
Collapse
|
22
|
Li J, Chen Q, Sun J, Zhang J, Ding J, Zuo C. Three-dimensional tomographic microscopy technique with multi-frequency combination with partially coherent illuminations. BIOMEDICAL OPTICS EXPRESS 2018; 9:2526-2542. [PMID: 30258670 PMCID: PMC6154200 DOI: 10.1364/boe.9.002526] [Citation(s) in RCA: 24] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/02/2018] [Revised: 04/30/2018] [Accepted: 05/01/2018] [Indexed: 05/05/2023]
Abstract
We demonstrate a three-dimensional (3D) optical diffraction tomographic technique with multi-frequency combination (MFC-ODT) for the 3D quantitative phase imaging of unlabeled specimens. Three sets of through-focus intensity images are captured under an annular aperture and two circular apertures with different coherence parameters. The 3D phase optical transfer functions (POTF) corresponding to different illumination apertures are combined to obtain a synthesized frequency response, achieving high-quality, low-noise 3D reconstructions with imaging resolution up to the incoherent diffraction limit. Besides, the expression of 3D POTF for arbitrary illumination pupils is derived and analyzed, and the 3D imaging performance of annular illumination is explored. It is shown that the phase-contrast washout effect in high-NA circular apertures can be effectively addressed by introducing a complementary annular aperture, which strongly boosts the phase contrast and improves the imaging resolution. By incorporating high-NA illumination as well as high-NA detection, MFC-ODT can achieve a theoretical transverse resolution up to 200 nm and an axial resolution of 645 nm. To test the feasibility of the proposed MFC-ODT technique, the 3D refractive index reconstruction results are based on a simulated 3D resolution target and experimental investigations of micro polystyrene bead and unstained biological samples are presented. Due to its capability for high-resolution 3D phase imaging as well as the compatibility with a widely available commercial microscope, the MFC-ODT is expected to find versatile applications in biological and biomedical research.
Collapse
Affiliation(s)
- Jiaji Li
- School of Electronic and Optical Engineering, Nanjing University of Science and Technology, No. 200 Xiaolingwei Street, Nanjing, Jiangsu Province 210094,
China
- Jiangsu Key Laboratory of Spectral Imaging & Intelligent Sense, Nanjing University of Science and Technology, Nanjing, Jiangsu Province 210094,
China
- Smart Computational Imaging Laboratory (SCILab), Nanjing University of Science and Technology, Nanjing, Jiangsu Province 210094,
China
| | - Qian Chen
- School of Electronic and Optical Engineering, Nanjing University of Science and Technology, No. 200 Xiaolingwei Street, Nanjing, Jiangsu Province 210094,
China
- Jiangsu Key Laboratory of Spectral Imaging & Intelligent Sense, Nanjing University of Science and Technology, Nanjing, Jiangsu Province 210094,
China
| | - Jiasong Sun
- School of Electronic and Optical Engineering, Nanjing University of Science and Technology, No. 200 Xiaolingwei Street, Nanjing, Jiangsu Province 210094,
China
- Jiangsu Key Laboratory of Spectral Imaging & Intelligent Sense, Nanjing University of Science and Technology, Nanjing, Jiangsu Province 210094,
China
- Smart Computational Imaging Laboratory (SCILab), Nanjing University of Science and Technology, Nanjing, Jiangsu Province 210094,
China
| | - Jialin Zhang
- School of Electronic and Optical Engineering, Nanjing University of Science and Technology, No. 200 Xiaolingwei Street, Nanjing, Jiangsu Province 210094,
China
- Jiangsu Key Laboratory of Spectral Imaging & Intelligent Sense, Nanjing University of Science and Technology, Nanjing, Jiangsu Province 210094,
China
- Smart Computational Imaging Laboratory (SCILab), Nanjing University of Science and Technology, Nanjing, Jiangsu Province 210094,
China
| | - Junyi Ding
- School of Electronic and Optical Engineering, Nanjing University of Science and Technology, No. 200 Xiaolingwei Street, Nanjing, Jiangsu Province 210094,
China
- Jiangsu Key Laboratory of Spectral Imaging & Intelligent Sense, Nanjing University of Science and Technology, Nanjing, Jiangsu Province 210094,
China
- Smart Computational Imaging Laboratory (SCILab), Nanjing University of Science and Technology, Nanjing, Jiangsu Province 210094,
China
| | - Chao Zuo
- School of Electronic and Optical Engineering, Nanjing University of Science and Technology, No. 200 Xiaolingwei Street, Nanjing, Jiangsu Province 210094,
China
- Jiangsu Key Laboratory of Spectral Imaging & Intelligent Sense, Nanjing University of Science and Technology, Nanjing, Jiangsu Province 210094,
China
- Smart Computational Imaging Laboratory (SCILab), Nanjing University of Science and Technology, Nanjing, Jiangsu Province 210094,
China
| |
Collapse
|
23
|
Ling R, Tahir W, Lin HY, Lee H, Tian L. High-throughput intensity diffraction tomography with a computational microscope. BIOMEDICAL OPTICS EXPRESS 2018; 9:2130-2141. [PMID: 29760975 PMCID: PMC5946776 DOI: 10.1364/boe.9.002130] [Citation(s) in RCA: 37] [Impact Index Per Article: 6.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/15/2018] [Accepted: 03/27/2018] [Indexed: 05/11/2023]
Abstract
We demonstrate a motion-free intensity diffraction tomography technique that enables the direct inversion of 3D phase and absorption from intensity-only measurements for weakly scattering samples. We derive a novel linear forward model featuring slice-wise phase and absorption transfer functions using angled illumination. This new framework facilitates flexible and efficient data acquisition, enabling arbitrary sampling of the illumination angles. The reconstruction algorithm performs 3D synthetic aperture using a robust computation and memory efficient slice-wise deconvolution to achieve resolution up to the incoherent limit. We demonstrate our technique with thick biological samples having both sparse 3D structures and dense cell clusters. We further investigate the limitation of our technique when imaging strongly scattering samples. Imaging performance and the influence of multiple scattering is evaluated using a 3D sample consisting of stacked phase and absorption resolution targets. This computational microscopy system is directly built on a standard commercial microscope with a simple LED array source add-on, and promises broad applications by leveraging the ubiquitous microscopy platforms with minimal hardware modifications.
Collapse
Affiliation(s)
- Ruilong Ling
- Department of Electrical and Computer Engineering, Boston University, Boston, MA 02215,
USA
| | - Waleed Tahir
- Department of Electrical and Computer Engineering, Boston University, Boston, MA 02215,
USA
| | - Hsing-Ying Lin
- Center for Systems Biology, Massachusetts General Hospital, Boston, MA 02114,
USA
- Department of Radiology, Massachusetts General Hospital, Harvard Medical School, Boston, MA 02114,
USA
| | - Hakho Lee
- Center for Systems Biology, Massachusetts General Hospital, Boston, MA 02114,
USA
- Department of Radiology, Massachusetts General Hospital, Harvard Medical School, Boston, MA 02114,
USA
| | - Lei Tian
- Department of Electrical and Computer Engineering, Boston University, Boston, MA 02215,
USA
| |
Collapse
|
24
|
Bao Y, Gaylord TK. Iterative optimization in tomographic deconvolution phase microscopy. JOURNAL OF THE OPTICAL SOCIETY OF AMERICA. A, OPTICS, IMAGE SCIENCE, AND VISION 2018; 35:652-660. [PMID: 29603953 DOI: 10.1364/josaa.35.000652] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/12/2018] [Accepted: 02/23/2018] [Indexed: 06/08/2023]
Abstract
Tomographic deconvolution phase microscopy (TDPM) is a three-dimensional (3D) quantitative phase imaging (QPI) method using partially coherent light that can be implemented on a commercial microscope platform. However, the measurement procedure is relatively time-consuming because it requires many illumination angles. In the present work, an edge-preserving iterative optimization algorithm is presented and applied to TDPM, so that the required number of illumination angles is reduced from 15 to 3, while the measurement accuracy remains high. In addition, the iterative algorithm does not require matrix representation of operators, so the memory requirement is correspondingly reduced.
Collapse
|
25
|
Soto JM, Rodrigo JA, Alieva T. Optical diffraction tomography with fully and partially coherent illumination in high numerical aperture label-free microscopy [Invited]. APPLIED OPTICS 2018; 57:A205-A214. [PMID: 29328147 DOI: 10.1364/ao.57.00a205] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/18/2017] [Accepted: 11/15/2017] [Indexed: 05/22/2023]
Abstract
Quantitative label-free imaging is an important tool for the study of living microorganisms that, during the last decade, has attracted wide attention from the optical community. Optical diffraction tomography (ODT) is probably the most relevant technique for quantitative label-free 3D imaging applied in wide-field microscopy in the visible range. The ODT is usually performed using spatially coherent light illumination and specially designed holographic microscopes. Nevertheless, the ODT is also compatible with partially coherent illumination and can be realized in conventional wide-field microscopes by applying refocusing techniques, as it has been recently demonstrated. Here, we compare these two ODT modalities, underlining their pros and cons and discussing the optical setups for their implementation. In particular, we pay special attention to a system that is compatible with a conventional wide-field microscope that can be used for both ODT modalities. It consists of two easily attachable modules: the first for sample illumination engineering based on digital light processing technology; the other for focus scanning by using an electrically driven tunable lens. This hardware allows for a programmable selection of the wavelength and the illumination design, and provides fast data acquisition as well. Its performance is experimentally demonstrated in the case of ODT with partially coherent illumination providing speckle-free 3D quantitative imaging.
Collapse
|
26
|
Rodrigo JA, Soto JM, Alieva T. Fast label-free microscopy technique for 3D dynamic quantitative imaging of living cells. BIOMEDICAL OPTICS EXPRESS 2017; 8:5507-5517. [PMID: 29296484 PMCID: PMC5745099 DOI: 10.1364/boe.8.005507] [Citation(s) in RCA: 22] [Impact Index Per Article: 3.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/22/2017] [Revised: 10/23/2017] [Accepted: 10/25/2017] [Indexed: 05/03/2023]
Abstract
The refractive index (RI) is an important optical characteristic that is often exploited in label-free microscopy for analysis of biological objects. A technique for 3D RI reconstruction of living cells has to be fast enough to capture the cell dynamics and preferably needs to be compatible with standard wide-field microscopes. To solve this challenging problem, we present a technique that provides fast measurement and processing of data required for real-time 3D visualization of the object RI. Specifically, the 3D RI is reconstructed from the measurement of bright-field intensity images, axially scanned by a high-speed focus tunable lens mounted in front of a sCMOS camera, by using a direct deconvolution approach designed for partially coherent light microscopy in the non-paraxial regime. Both the measurement system and the partially coherent illumination, that provides optical sectioning and speckle-noise suppression, enable compatibility with wide-field microscopes resulting in a competitive and affordable alternative to the current holographic laser microscopes. Our experimental demonstrations show video-rate 3D RI visualization of living bacteria both freely swimming and optically manipulated by using freestyle laser traps allowing for their trapping and transport along 3D trajectories. These results prove that is possible to conduct simultaneous 4D label-free quantitative imaging and optical manipulation of living cells, which is promising for the study of the cell biophysics and biology.
Collapse
|
27
|
Bao Y, Gaylord TK. Clarification and unification of the obliquity factor in diffraction and scattering theories: discussion. JOURNAL OF THE OPTICAL SOCIETY OF AMERICA. A, OPTICS, IMAGE SCIENCE, AND VISION 2017; 34:1738-1745. [PMID: 29036043 DOI: 10.1364/josaa.34.001738] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/09/2023]
Abstract
Two-dimensional (2D) and three-dimensional (3D) diffraction theories form the underlying basis of quantitative phase imaging. This paper reviews how 2D and 3D diffraction theories are developed based on thin and thick object requirements. However, some previously reported work has mixed 2D and 3D theories. This discussion shows that it is possible to enable consistent mixed use of 2D and 3D theories by applying appropriate obliquity factor (OF) modifications. The discussion is concluded with an overall unifying representation for the usage of the OF modifications in 2D and 3D diffraction theories as applied to both thin and thick objects.
Collapse
|
28
|
Soto JM, Rodrigo JA, Alieva T. Label-free quantitative 3D tomographic imaging for partially coherent light microscopy. OPTICS EXPRESS 2017; 25:15699-15712. [PMID: 28789083 DOI: 10.1364/oe.25.015699] [Citation(s) in RCA: 36] [Impact Index Per Article: 5.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/11/2017] [Accepted: 06/17/2017] [Indexed: 05/20/2023]
Abstract
Crucial benefits provided by partially coherent light microscopy such as improved spatial resolution, optical sectioning and speckle-noise suppression are exploited here to achieve 3D quantitative imaging: reconstruction of the object refractive index (RI). We present a partially coherent optical diffraction tomography technique (PC-ODT) that can be easily implemented in commercially available bright-field microscopes. We show that the high numerical apertures of the objective and condenser lenses, together with optical refocusing, are main issues for achieving fast and successful 3D RI reconstruction of weak objects. In particular, the optical refocusing is performed by a high-speed focus tunable lens mounted in front of the digital camera enabling compatibility with commercial microscopes. The technique is experimentally demonstrated on different examples: diatom cells (biosilica shells), polystyrene micro-spheres and blood cells. The results confirm the straightforward 3D-RI reconstruction of the samples providing valuable quantitative information for their analysis. Thus, the PC-ODT can be considered as an efficient and affordable alternative to coherent ODT which requires specially designed holographic microscopes.
Collapse
|
29
|
Fan S, Yu M, Jiang G, Wang Y, Jiang H, Zhang Q. A Mismatch Detection Method Based on Affine Transformation for Stereo Light Microscopy Stereo Matching. INT J PATTERN RECOGN 2017. [DOI: 10.1142/s0218001417500136] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
Abstract
For the light microscopy images that have the characteristics of shallow depth of field, serious distortion and poor resolution, mismatch is a ubiquitous phenomenon. The paper presents a mismatch detection method for the stereo light microscopy stereo matching. Affine transformation matrix and matching constraint condition are calibrated by the calibration board which has the precision solid dots and the motorized stage. Bias vector of affine transformation of each matching pair is taken as the criteria to apply mismatch detection. The experimental results show that the method can detect more mismatching pairs and preserve more matching pairs than the traditional RANSAC method and the epipolar rectification method.
Collapse
Affiliation(s)
- Shengli Fan
- Department of Information Science and Engineering, Ningbo University 818 Fenghua Road, Ningbo 315211, P. R. China
- School of Information Science and Engineering, Ningbo Institute of Technology, Zhejiang University 1 Qianhu Road, Ningbo 315100, P. R. China
| | - Mei Yu
- Department of Information Science and Engineering, Ningbo University 818 Fenghua Road, Ningbo 315211, P. R. China
| | - Gangyi Jiang
- Department of Information Science and Engineering, Ningbo University 818 Fenghua Road, Ningbo 315211, P. R. China
| | - Yigang Wang
- School of Information Science and Engineering, Ningbo Institute of Technology, Zhejiang University 1 Qianhu Road, Ningbo 315100, P. R. China
| | - Hao Jiang
- Intelligent Household Appliances Engineering Center, Zhejiang Business Technology Institute 1988 Airport Road, Ningbo 315012, P. R. China
| | - Qingbo Zhang
- Intelligent Household Appliances Engineering Center, Zhejiang Business Technology Institute 1988 Airport Road, Ningbo 315012, P. R. China
| |
Collapse
|
30
|
Lee K, Kim K, Kim G, Shin S, Park Y. Time-multiplexed structured illumination using a DMD for optical diffraction tomography. OPTICS LETTERS 2017; 42:999-1002. [PMID: 28248352 DOI: 10.1364/ol.42.000999] [Citation(s) in RCA: 59] [Impact Index Per Article: 8.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/21/2023]
Abstract
We present a time-multiplexing structured illumination control technique for optical diffraction tomography (ODT). Instead of tilting the angle of illumination, time-multiplexed sinusoidal illumination is exploited using a digital micromirror device (DMD). The present method effectively eliminates unwanted diffracted beams from binary DMD patterns, which deteriorates the image quality of the ODT in the previous binary Lee hologram method. We experimentally show the feasibility and advantage of the present method by reconstructing three-dimensional refractive index distributions of various samples and comparing with a conventional Lee hologram method.
Collapse
|
31
|
Chen M, Tian L, Waller L. 3D differential phase contrast microscopy. BIOMEDICAL OPTICS EXPRESS 2016; 7:3940-3950. [PMID: 27867705 PMCID: PMC5102530 DOI: 10.1364/boe.7.003940] [Citation(s) in RCA: 50] [Impact Index Per Article: 6.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/21/2016] [Revised: 09/02/2016] [Accepted: 09/02/2016] [Indexed: 05/02/2023]
Abstract
We demonstrate 3D phase and absorption recovery from partially coherent intensity images captured with a programmable LED array source. Images are captured through-focus with four different illumination patterns. Using first Born and weak object approximations (WOA), a linear 3D differential phase contrast (DPC) model is derived. The partially coherent transfer functions relate the sample's complex refractive index distribution to intensity measurements at varying defocus. Volumetric reconstruction is achieved by a global FFT-based method, without an intermediate 2D phase retrieval step. Because the illumination is spatially partially coherent, the transverse resolution of the reconstructed field achieves twice the NA of coherent systems and improved axial resolution.
Collapse
Affiliation(s)
- Michael Chen
- Department of Electrical Engineering and Computer Sciences, University of California, Berkeley, CA 94720,
USA
| | - Lei Tian
- Department of Electrical Engineering and Computer Sciences, University of California, Berkeley, CA 94720,
USA
- Department of Electrical & Computer Engineering, Boston University, Boston, MA 02215,
USA
| | - Laura Waller
- Department of Electrical Engineering and Computer Sciences, University of California, Berkeley, CA 94720,
USA
| |
Collapse
|