1
|
Wu X, Zhou N, Chen Y, Sun J, Lu L, Chen Q, Zuo C. Lens-free on-chip 3D microscopy based on wavelength-scanning Fourier ptychographic diffraction tomography. LIGHT, SCIENCE & APPLICATIONS 2024; 13:237. [PMID: 39237522 PMCID: PMC11377727 DOI: 10.1038/s41377-024-01568-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/01/2024] [Revised: 07/16/2024] [Accepted: 08/06/2024] [Indexed: 09/07/2024]
Abstract
Lens-free on-chip microscopy is a powerful and promising high-throughput computational microscopy technique due to its unique advantage of creating high-resolution images across the full field-of-view (FOV) of the imaging sensor. Nevertheless, most current lens-free microscopy methods have been designed for imaging only two-dimensional thin samples. Lens-free on-chip tomography (LFOCT) with a uniform resolution across the entire FOV and at a subpixel level remains a critical challenge. In this paper, we demonstrated a new LFOCT technique and associated imaging platform based on wavelength scanning Fourier ptychographic diffraction tomography (wsFPDT). Instead of using angularly-variable illuminations, in wsFPDT, the sample is illuminated by on-axis wavelength-variable illuminations, ranging from 430 to 1200 nm. The corresponding under-sampled diffraction patterns are recorded, and then an iterative ptychographic reconstruction procedure is applied to fill the spectrum of the three-dimensional (3D) scattering potential to recover the sample's 3D refractive index (RI) distribution. The wavelength-scanning scheme not only eliminates the need for mechanical motion during image acquisition and precise registration of the raw images but secures a quasi-uniform, pixel-super-resolved imaging resolution across the entire imaging FOV. With wsFPDT, we demonstrate the high-throughput, billion-voxel 3D tomographic imaging results with a half-pitch lateral resolution of 775 nm and an axial resolution of 5.43 μm across a large FOV of 29.85 mm2 and an imaging depth of >200 μm. The effectiveness of the proposed method was demonstrated by imaging various types of samples, including micro-polystyrene beads, diatoms, and mouse mononuclear macrophage cells. The unique capability to reveal quantitative morphological properties, such as area, volume, and sphericity index of single cell over large cell populations makes wsFPDT a powerful quantitative and label-free tool for high-throughput biological applications.
Collapse
Affiliation(s)
- Xuejuan Wu
- Smart Computational Imaging (SCI) Laboratory, Nanjing University of Science and Technology, No. 200 Xiaolingwei Street, 210094, Nanjing, Jiangsu, China
- Smart Computational Imaging Research Institute (SCIRI) of Nanjing University of Science and Technology, 210094, Nanjing, Jiangsu, China
- Jiangsu Key Laboratory of Spectral Imaging & Intelligent Sense, No. 200 Xiaolingwei Street, 210094, Nanjing, Jiangsu, China
| | - Ning Zhou
- Smart Computational Imaging (SCI) Laboratory, Nanjing University of Science and Technology, No. 200 Xiaolingwei Street, 210094, Nanjing, Jiangsu, China
- Smart Computational Imaging Research Institute (SCIRI) of Nanjing University of Science and Technology, 210094, Nanjing, Jiangsu, China
- Jiangsu Key Laboratory of Spectral Imaging & Intelligent Sense, No. 200 Xiaolingwei Street, 210094, Nanjing, Jiangsu, China
| | - Yang Chen
- Smart Computational Imaging (SCI) Laboratory, Nanjing University of Science and Technology, No. 200 Xiaolingwei Street, 210094, Nanjing, Jiangsu, China
- Smart Computational Imaging Research Institute (SCIRI) of Nanjing University of Science and Technology, 210094, Nanjing, Jiangsu, China
- Jiangsu Key Laboratory of Spectral Imaging & Intelligent Sense, No. 200 Xiaolingwei Street, 210094, Nanjing, Jiangsu, China
| | - Jiasong Sun
- Smart Computational Imaging (SCI) Laboratory, Nanjing University of Science and Technology, No. 200 Xiaolingwei Street, 210094, Nanjing, Jiangsu, China
- Smart Computational Imaging Research Institute (SCIRI) of Nanjing University of Science and Technology, 210094, Nanjing, Jiangsu, China
- Jiangsu Key Laboratory of Spectral Imaging & Intelligent Sense, No. 200 Xiaolingwei Street, 210094, Nanjing, Jiangsu, China
| | - Linpeng Lu
- Smart Computational Imaging (SCI) Laboratory, Nanjing University of Science and Technology, No. 200 Xiaolingwei Street, 210094, Nanjing, Jiangsu, China
- Smart Computational Imaging Research Institute (SCIRI) of Nanjing University of Science and Technology, 210094, Nanjing, Jiangsu, China
- Jiangsu Key Laboratory of Spectral Imaging & Intelligent Sense, No. 200 Xiaolingwei Street, 210094, Nanjing, Jiangsu, China
| | - Qian Chen
- Jiangsu Key Laboratory of Spectral Imaging & Intelligent Sense, No. 200 Xiaolingwei Street, 210094, Nanjing, Jiangsu, China.
| | - Chao Zuo
- Smart Computational Imaging (SCI) Laboratory, Nanjing University of Science and Technology, No. 200 Xiaolingwei Street, 210094, Nanjing, Jiangsu, China.
- Smart Computational Imaging Research Institute (SCIRI) of Nanjing University of Science and Technology, 210094, Nanjing, Jiangsu, China.
- Jiangsu Key Laboratory of Spectral Imaging & Intelligent Sense, No. 200 Xiaolingwei Street, 210094, Nanjing, Jiangsu, China.
| |
Collapse
|
2
|
Zhang X, Han Y. An Extremely Sparse Tomography Reconstruction of a Multispectral Temperature Field without Any a Priori Knowledge. SENSORS (BASEL, SWITZERLAND) 2024; 24:5264. [PMID: 39204959 PMCID: PMC11360723 DOI: 10.3390/s24165264] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 07/02/2024] [Revised: 08/02/2024] [Accepted: 08/12/2024] [Indexed: 09/04/2024]
Abstract
When undertaking optical sparse projection reconstruction, the reconstruction of the tested field often requires the utilization of a priori knowledge to compensate for the lack of information due to the sparse projection angle. In order to reconstruct the radiation field of unknown materials or in situations where a priori knowledge cannot be obtained, this paper proposes an extremely sparse tomography multispectral temperature field reconstruction algorithm that analyzes the similarity (the similarity here compares and calculates the Euclidean distance of the spectral emissivity values at various wavelengths between different spectral curves) of radiation characteristics of materials under the same pressure and concentration but different temperature, describes the similarity between the radiation information of the tested field using the dynamic time warping (DTW) algorithm, and uses the similarity sum of the radiation information among the subregions of the temperature field as the optimization objective. This is combined with the equation-constrained optimization algorithm and multispectral thermometry to establish the statistical law between the missing information and finally realize the reconstruction of the temperature field. Simulation experiments show that, without any a priori knowledge, the method in this paper can realize reconstruction of the temperature field with an accuracy of 1.53-12.05% under two projection angles and has fewer projection angles and stronger robustness than other methods.
Collapse
Affiliation(s)
- Xuan Zhang
- School of Information and Communication Engineering, North University of China, Taiyuan 030051, China;
| | - Yan Han
- Shanxi Key Laboratory of Signal Capturing & Processing, North University of China, Taiyuan 030051, China
- State Key Laboratory of Dynamic Testing Technology, North University of China, Taiyuan 030051, China
| |
Collapse
|
3
|
Huang CH, Lai YJ, Chen LN, Hung YH, Tu HY, Cheng CJ. Label-Free Three-Dimensional Morphological Characterization of Cell Death Using Holographic Tomography. SENSORS (BASEL, SWITZERLAND) 2024; 24:3435. [PMID: 38894226 PMCID: PMC11174527 DOI: 10.3390/s24113435] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/10/2024] [Revised: 05/16/2024] [Accepted: 05/23/2024] [Indexed: 06/21/2024]
Abstract
This study presents a novel label-free approach for characterizing cell death states, eliminating the need for complex molecular labeling that may yield artificial or ambiguous results due to technical limitations in microscope resolution. The proposed holographic tomography technique offers a label-free avenue for capturing precise three-dimensional (3D) refractive index morphologies of cells and directly analyzing cellular parameters like area, height, volume, and nucleus/cytoplasm ratio within the 3D cellular model. We showcase holographic tomography results illustrating various cell death types and elucidate distinctive refractive index correlations with specific cell morphologies complemented by biochemical assays to verify cell death states. These findings hold promise for advancing in situ single cell state identification and diagnosis applications.
Collapse
Affiliation(s)
- Chung-Hsuan Huang
- Institute of Electro-Optical Engineering, National Taiwan Normal University, Taipei 11677, Taiwan;
| | - Yun-Ju Lai
- Department of Life Science, National Taiwan Normal University, Taipei 11677, Taiwan; (L.-N.C.); (Y.-H.H.)
| | - Li-Nian Chen
- Department of Life Science, National Taiwan Normal University, Taipei 11677, Taiwan; (L.-N.C.); (Y.-H.H.)
| | - Yu-Hsuan Hung
- Department of Life Science, National Taiwan Normal University, Taipei 11677, Taiwan; (L.-N.C.); (Y.-H.H.)
| | - Han-Yen Tu
- Department of Electrical Engineering, Chinese Culture University, Taipei 11114, Taiwan;
| | - Chau-Jern Cheng
- Institute of Electro-Optical Engineering, National Taiwan Normal University, Taipei 11677, Taiwan;
| |
Collapse
|
4
|
Liu Y, Xiao W, Xiao X, Wang H, Peng R, Feng Y, Zhao Q, Pan F. Dynamic tracking of onion-like carbon nanoparticles in cancer cells using limited-angle holographic tomography with self-supervised learning. BIOMEDICAL OPTICS EXPRESS 2024; 15:3076-3091. [PMID: 38855692 PMCID: PMC11161346 DOI: 10.1364/boe.522563] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 03/07/2024] [Revised: 04/03/2024] [Accepted: 04/04/2024] [Indexed: 06/11/2024]
Abstract
This research presents a novel approach for the dynamic monitoring of onion-like carbon nanoparticles inside colorectal cancer cells. Onion-like carbon nanoparticles are widely used in photothermal cancer therapy, and precise 3D tracking of their distribution is crucial. We proposed a limited-angle digital holographic tomography technique with unsupervised learning to achieve rapid and accurate monitoring. A key innovation is our internal learning neural network. This network addresses the information limitations of limited-angle measurements by directly mapping coordinates to measured data and reconstructing phase information at unmeasured angles without external training data. We validated the network using standard SiO2 microspheres. Subsequently, we reconstructed the 3D refractive index of onion-like carbon nanoparticles within cancer cells at various time points. Morphological parameters of the nanoparticles were quantitatively analyzed to understand their temporal evolution, offering initial insights into the underlying mechanisms. This methodology provides a new perspective for efficiently tracking nanoparticles within cancer cells.
Collapse
Affiliation(s)
- Yakun Liu
- Key Laboratory of Precision Opto-mechatronics Technology, School of Instrumentation and Optoelectronic Engineering, Beihang University, Beijing 100191, China
| | - Wen Xiao
- Key Laboratory of Precision Opto-mechatronics Technology, School of Instrumentation and Optoelectronic Engineering, Beihang University, Beijing 100191, China
| | - Xi Xiao
- Department of Radiation Oncology, Peking University Third Hospital, Beijing 100191, China
| | - Hao Wang
- Department of Radiation Oncology, Peking University Third Hospital, Beijing 100191, China
- Cancer Center, Peking University Third Hospital, Beijing 100191, China
| | - Ran Peng
- Department of Radiation Oncology, Peking University Third Hospital, Beijing 100191, China
| | - Yuchen Feng
- Technical Institute of Physics and Chemistry, Chinese Academy of Sciences, Beijing 100190, China
| | - Qi Zhao
- Technical Institute of Physics and Chemistry, Chinese Academy of Sciences, Beijing 100190, China
| | - Feng Pan
- Key Laboratory of Precision Opto-mechatronics Technology, School of Instrumentation and Optoelectronic Engineering, Beihang University, Beijing 100191, China
| |
Collapse
|
5
|
Rajora S, Butola M, Khare K. 3D reconstruction of unstained weakly scattering cells from a single defocused hologram. APPLIED OPTICS 2023; 62:D146-D156. [PMID: 37132780 DOI: 10.1364/ao.478351] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/04/2023]
Abstract
We investigate the problem of 3D complex field reconstruction corresponding to unstained red blood cells (RBCs) with a single defocused off-axis digital hologram. The main challenge in this problem is the localization of cells to the correct axial range. While investigating the volume recovery problem for a continuous phase object like the RBC, we observe an interesting feature of the backpropagated field that it does not show a clear focusing effect. Therefore, sparsity enforcement within the iterative optimization framework using a single hologram data frame cannot effectively restrict the reconstruction to the true object volume. For phase objects, it is known that the amplitude contrast of the backpropagated object field at the focus plane is minimum. We use this information available in the recovered object field in the hologram plane to device depth-dependent weights that are proportional to the inverse of amplitude contrast. This weight function is employed in the iterative steps of the optimization algorithm to assist the object volume localization. The overall reconstruction process is performed using the mean gradient descent (MGD) framework. Experimental illustrations of 3D volume reconstruction of the healthy as well as malaria-infected RBCs are presented. A test sample of polystyrene microsphere bead is also used to validate the axial localization capability of the proposed iterative technique. The proposed methodology is simple to implement experimentally and provides an approximate tomographic solution, which is axially restricted and consistent with the object field data.
Collapse
|
6
|
Ossowski P, Kuś A, Krauze W, Tamborski S, Ziemczonok M, Kuźbicki Ł, Szkulmowski M, Kujawińska M. Near-infrared, wavelength, and illumination scanning holographic tomography. BIOMEDICAL OPTICS EXPRESS 2022; 13:5971-5988. [PMID: 36733741 PMCID: PMC9872886 DOI: 10.1364/boe.468046] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/15/2022] [Revised: 08/19/2022] [Accepted: 08/24/2022] [Indexed: 06/18/2023]
Abstract
We present a holographic tomography technique in which the projections are acquired using both wavelength and illumination scanning in the near-infrared region. We show how to process the acquired data to obtain correct values of three-dimensional refractive index distributions in both single-wavelength and multi-wavelength data acquisition schemes and how to properly account for the dispersion of the sample. We perform numerical and experimental comparisons of different illumination scenarios to determine the most efficient measurement protocol. We show that the multi-wavelength protocol is advantageous in terms of signal-to-noise ratio and contrast-to-noise ratio over single-wavelength protocols, even for the same number of projections used for reconstructions. Finally, we show that this approach is suitable for providing high-quality refractive index distributions of relatively thick colon cancer samples.
Collapse
Affiliation(s)
- Paweł Ossowski
- Warsaw University of Technology, Institute of Micromechanics and Photonics, Boboli 8 street, Warsaw, 02-525, Poland
| | - Arkadiusz Kuś
- Warsaw University of Technology, Institute of Micromechanics and Photonics, Boboli 8 street, Warsaw, 02-525, Poland
| | - Wojciech Krauze
- Warsaw University of Technology, Institute of Micromechanics and Photonics, Boboli 8 street, Warsaw, 02-525, Poland
| | - Szymon Tamborski
- Institute of Physics, Faculty of Physics, Astronomy and Informatics, Nicolaus Copernicus University in Toruń, Grudziadzka 5, 87-100 Toruń, Poland
| | - Michał Ziemczonok
- Warsaw University of Technology, Institute of Micromechanics and Photonics, Boboli 8 street, Warsaw, 02-525, Poland
| | - Łukasz Kuźbicki
- Institute of Biology, Faculty of Biological and Veterinary Sciences, Nicolaus Copernicus University in Toruń, Lwowska 1, 87-100 Toruń, Poland
| | - Maciej Szkulmowski
- Institute of Physics, Faculty of Physics, Astronomy and Informatics, Nicolaus Copernicus University in Toruń, Grudziadzka 5, 87-100 Toruń, Poland
| | - Małgorzata Kujawińska
- Warsaw University of Technology, Institute of Micromechanics and Photonics, Boboli 8 street, Warsaw, 02-525, Poland
| |
Collapse
|
7
|
Stępień P, Ziemczonok M, Kujawińska M, Baczewska M, Valenti L, Cherubini A, Casirati E, Krauze W. Numerical refractive index correction for the stitching procedure in tomographic quantitative phase imaging. BIOMEDICAL OPTICS EXPRESS 2022; 13:5709-5720. [PMID: 36733760 PMCID: PMC9872904 DOI: 10.1364/boe.466403] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/14/2022] [Revised: 08/16/2022] [Accepted: 08/24/2022] [Indexed: 06/18/2023]
Abstract
Tomographic quantitative phase imaging (QPI) lacks an absolute refractive index value baseline, which poses a problem when large dense objects extending over multiple fields of view are measured volume by volume and stitched together. Some of the measurements lack the natural baseline value that is provided by the mounting medium with a known refractive index. In this work, we discuss the problem of the refractive index (RI) baseline of individual reconstructed volumes that are deprived of access to mounting medium due to the extent of the object. The solution of this problem is provided by establishing the RI offsets based on the overlapping regions. We have proven that the process of finding the offset RI values may be justifiably reduced to the analogous procedure in the 2D baseline correction (2D-BC). Finally, we proposed the enhancement of the state-of-the-art 2D-BC procedure previously introduced in the context of 2D QPI. The processing is validated at the examples of a synthetic dataset and a liver organoid.
Collapse
Affiliation(s)
- Piotr Stępień
- Warsaw University of Technology, Institute of Micromechanics and Photonics, ul. Sw. A. Boboli 8, Warsaw, 02-525, Poland
| | - Michał Ziemczonok
- Warsaw University of Technology, Institute of Micromechanics and Photonics, ul. Sw. A. Boboli 8, Warsaw, 02-525, Poland
| | - Małgorzata Kujawińska
- Warsaw University of Technology, Institute of Micromechanics and Photonics, ul. Sw. A. Boboli 8, Warsaw, 02-525, Poland
| | - Maria Baczewska
- Warsaw University of Technology, Institute of Micromechanics and Photonics, ul. Sw. A. Boboli 8, Warsaw, 02-525, Poland
| | - Luca Valenti
- Università degli Studi di Milano, Department of Pathophysiology and Transplantation, Milan, Italy
- Fondazione IRCCS Ca’ Granda Ospedale Maggiore Policlinico, Department of Transfusion Medicine and Hematology, Milan, Italy
| | - Alessandro Cherubini
- Fondazione IRCCS Ca’ Granda Ospedale Maggiore Policlinico, Department of Transfusion Medicine and Hematology, Milan, Italy
| | - Elia Casirati
- Università degli Studi di Milano, Department of Pathophysiology and Transplantation, Milan, Italy
| | - Wojciech Krauze
- Warsaw University of Technology, Institute of Micromechanics and Photonics, ul. Sw. A. Boboli 8, Warsaw, 02-525, Poland
| |
Collapse
|
8
|
Běhal J, Borrelli F, Mugnano M, Bianco V, Capozzoli A, Curcio C, Liseno A, Miccio L, Memmolo P, Ferraro P. Developing a Reliable Holographic Flow Cyto-Tomography Apparatus by Optimizing the Experimental Layout and Computational Processing. Cells 2022; 11:2591. [PMID: 36010667 PMCID: PMC9406712 DOI: 10.3390/cells11162591] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/10/2022] [Revised: 08/17/2022] [Accepted: 08/18/2022] [Indexed: 11/16/2022] Open
Abstract
Digital Holographic Tomography (DHT) has recently been established as a means of retrieving the 3D refractive index mapping of single cells. To make DHT a viable system, it is necessary to develop a reliable and robust holographic apparatus in order that such technology can be utilized outside of specialized optics laboratories and operated in the in-flow modality. In this paper, we propose a quasi-common-path lateral-shearing holographic optical set-up to be used, for the first time, for DHT in a flow-cytometer modality. The proposed solution is able to withstand environmental vibrations that can severely affect the interference process. Furthermore, we have scaled down the system while ensuring that a full 360° rotation of the cells occurs in the field-of-view, in order to retrieve 3D phase-contrast tomograms of single cells flowing along a microfluidic channel. This was achieved by setting the camera sensor at 45° with respect to the microfluidic direction. Additional optimizations were made to the computational elements to ensure the reliable retrieval of 3D refractive index distributions by demonstrating an effective method of tomographic reconstruction, based on high-order total variation. The results were first demonstrated using realistic 3D numerical phantom cells to assess the performance of the proposed high-order total variation method in comparison with the gold-standard algorithm for tomographic reconstructions: namely, filtered back projection. Then, the proposed DHT system and the processing pipeline were experimentally validated for monocytes and mouse embryonic fibroblast NIH-3T3 cells lines. Moreover, the repeatability of these tomographic measurements was also investigated by recording the same cell multiple times and quantifying the ability to provide reliable and comparable tomographic reconstructions, as confirmed by a correlation coefficient greater than 95%. The reported results represent various steps forward in several key aspects of in-flow DHT, thus paving the way for its use in real-world applications.
Collapse
Affiliation(s)
- Jaromír Běhal
- Institute of Applied Sciences and Intelligent Systems, Italian National Research Council (CNR-ISASI), 80078 Pozzuoli, Italy
| | - Francesca Borrelli
- Dipartimento di Ingegneria Elettrica e delle Tecnologie dell’Informazione, Università di Napoli Federico II, 80125 Napoli, Italy
| | - Martina Mugnano
- Institute of Applied Sciences and Intelligent Systems, Italian National Research Council (CNR-ISASI), 80078 Pozzuoli, Italy
| | - Vittorio Bianco
- Institute of Applied Sciences and Intelligent Systems, Italian National Research Council (CNR-ISASI), 80078 Pozzuoli, Italy
| | - Amedeo Capozzoli
- Dipartimento di Ingegneria Elettrica e delle Tecnologie dell’Informazione, Università di Napoli Federico II, 80125 Napoli, Italy
| | - Claudio Curcio
- Dipartimento di Ingegneria Elettrica e delle Tecnologie dell’Informazione, Università di Napoli Federico II, 80125 Napoli, Italy
| | - Angelo Liseno
- Dipartimento di Ingegneria Elettrica e delle Tecnologie dell’Informazione, Università di Napoli Federico II, 80125 Napoli, Italy
| | - Lisa Miccio
- Institute of Applied Sciences and Intelligent Systems, Italian National Research Council (CNR-ISASI), 80078 Pozzuoli, Italy
| | - Pasquale Memmolo
- Institute of Applied Sciences and Intelligent Systems, Italian National Research Council (CNR-ISASI), 80078 Pozzuoli, Italy
| | - Pietro Ferraro
- Institute of Applied Sciences and Intelligent Systems, Italian National Research Council (CNR-ISASI), 80078 Pozzuoli, Italy
| |
Collapse
|
9
|
Lipke W, Winnik J, Trusiak M. Numerical analysis of the effect of reduced temporal coherence in quantitative phase microscopy and tomography. OPTICS EXPRESS 2022; 30:21241-21257. [PMID: 36224847 DOI: 10.1364/oe.458167] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/11/2022] [Accepted: 04/20/2022] [Indexed: 06/16/2023]
Abstract
We present the numerical analysis of the effect of the temporarily partially coherent illumination on the phase measurement accuracy in digital holography microscopy (DHM) and optical diffraction tomography (ODT), as reconstruction algorithms tend to assume purely monochromatic conditions. In the regime of reduced temporal coherence, we simulate the hologram formation in two different optical setups, representing classical off-axis two-beam and grating common-path configurations. We consider two ODT variants: with sample rotation and angle-scanning of illumination. Besides the coherence degree of illumination, our simulation considers the influence of the sample normal dispersion, shape of the light spectrum, and optical parameters of the imaging setup. As reconstruction algorithms we employ Fourier hologram method and first-order Rytov approximation with direct inversion and nonnegativity constraints. Quantitative evaluation of the measurement results deviations introduced by the mentioned error sources is comprehensively analyzed, for the first time to the best of our knowledge. Obtained outcomes indicate low final DHM/ODT reconstruction errors for the grating-assisted common-path configuration. Nevertheless, dispersion and asymmetric spectrum introduce non-negligible overestimated refractive index values and noise, and should be thus carefully considered within experimental frameworks.
Collapse
|
10
|
Muhamad RK, Stępień P, Kujawińska M, Schelkens P. Off-axis image plane hologram compression in holographic tomography - metrological assessment. OPTICS EXPRESS 2022; 30:4261-4273. [PMID: 35209666 DOI: 10.1364/oe.449932] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/29/2021] [Accepted: 12/28/2021] [Indexed: 06/14/2023]
Abstract
In this paper, we present a novel study on the impact of lossy data compression on the metrological properties of holographic tomography reconstruction of the refractive index (RI). We use a spatial bandwidth-optimized compression procedure that leverages the properties of image plane off-axis holograms and standardized compression codecs, both widely applied in research and industry. The compression procedure is tested at multiple bitrates, for four different objects and against three reconstruction algorithms. The metrological evaluation is primarily done by comparison to the reconstruction from original data using the root-mean-squared error (RMSE). We show that due to differences between objects and different noise sensitivities of the reconstruction algorithms, the rate-distortion behaviour varies, but in most cases allows for the compression below 1 bit per pixel, while maintaining an RI RMSE less than 10-4.
Collapse
|
11
|
Taddese AM, Verrier N, Debailleul M, Courbot JB, Haeberlé O. Optimizing sample illumination scanning for reflection and 4Pi tomographic diffractive microscopy. APPLIED OPTICS 2021; 60:7745-7753. [PMID: 34613246 DOI: 10.1364/ao.435721] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/07/2021] [Accepted: 08/02/2021] [Indexed: 06/13/2023]
Abstract
Tomographic diffractive microscopy (TDM) is increasingly gaining attention, owing to its high-resolution, label-free imaging capability. Fast acquisitions necessitate limiting the number of holograms to be recorded. Reconstructions then rely on optimal Fourier space filling to retain image quality and resolution, that is, they rely on optimal scanning of the tomographic illuminations. In this work, we theoretically study reflection TDM, and then the 4Pi TDM, a combination of transmission and reflection systems. Image simulations are conducted to determine optimal angular sweeping. We found that three-dimensional uniform scanning fills Fourier space the best for both reflection and 4Pi configurations, providing a better refractive index estimation for the observed sample.
Collapse
|
12
|
Zdańkowski P, Winnik J, Patorski K, Gocłowski P, Ziemczonok M, Józwik M, Kujawińska M, Trusiak M. Common-path intrinsically achromatic optical diffraction tomography. BIOMEDICAL OPTICS EXPRESS 2021; 12:4219-4234. [PMID: 34457410 PMCID: PMC8367224 DOI: 10.1364/boe.428828] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/26/2021] [Revised: 06/05/2021] [Accepted: 06/07/2021] [Indexed: 06/13/2023]
Abstract
In this work we propose an open-top like common-path intrinsically achromatic optical diffraction tomography system. It operates as a total-shear interferometer and employs Ronchi-type amplitude diffraction grating, positioned in between the camera and the tube lens without an additional 4f system, generating three-beam interferograms with achromatic second harmonic. Such configuration makes the proposed system low cost, compact and immune to vibrations. We present the results of the measurements of 3D-printed cell phantom using laser diode (coherent) and superluminescent diode (partially coherent) light sources. Broadband light sources can be naturally employed without the need for any cumbersome compensation because of the intrinsic achromaticity of the interferometric recording (holograms generated by -1st and +1st conjugated diffraction orders are not affected by the illumination wavelength). The results show that the decreased coherence offers much reduced coherent noise and higher fidelity tomographic reconstruction especially when applied nonnegativity constraint regularization procedure.
Collapse
Affiliation(s)
- Piotr Zdańkowski
- Warsaw University of Technology, Institute of Micromechanics and Photonics, 8 Św. A. Boboli st., 02-525 Warsaw, Poland
- These authors contributed equally to this work
| | - Julianna Winnik
- Warsaw University of Technology, Institute of Micromechanics and Photonics, 8 Św. A. Boboli st., 02-525 Warsaw, Poland
- These authors contributed equally to this work
| | - Krzysztof Patorski
- Warsaw University of Technology, Institute of Micromechanics and Photonics, 8 Św. A. Boboli st., 02-525 Warsaw, Poland
| | - Paweł Gocłowski
- Warsaw University of Technology, Institute of Micromechanics and Photonics, 8 Św. A. Boboli st., 02-525 Warsaw, Poland
| | - Michał Ziemczonok
- Warsaw University of Technology, Institute of Micromechanics and Photonics, 8 Św. A. Boboli st., 02-525 Warsaw, Poland
| | - Michał Józwik
- Warsaw University of Technology, Institute of Micromechanics and Photonics, 8 Św. A. Boboli st., 02-525 Warsaw, Poland
| | - Małgorzata Kujawińska
- Warsaw University of Technology, Institute of Micromechanics and Photonics, 8 Św. A. Boboli st., 02-525 Warsaw, Poland
| | - Maciej Trusiak
- Warsaw University of Technology, Institute of Micromechanics and Photonics, 8 Św. A. Boboli st., 02-525 Warsaw, Poland
| |
Collapse
|
13
|
Ryu D, Ryu D, Baek Y, Cho H, Kim G, Kim YS, Lee Y, Kim Y, Ye JC, Min HS, Park Y. DeepRegularizer: Rapid Resolution Enhancement of Tomographic Imaging Using Deep Learning. IEEE TRANSACTIONS ON MEDICAL IMAGING 2021; 40:1508-1518. [PMID: 33566760 DOI: 10.1109/tmi.2021.3058373] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/27/2023]
Abstract
Optical diffraction tomography measures the three-dimensional refractive index map of a specimen and visualizes biochemical phenomena at the nanoscale in a non-destructive manner. One major drawback of optical diffraction tomography is poor axial resolution due to limited access to the three-dimensional optical transfer function. This missing cone problem has been addressed through regularization algorithms that use a priori information, such as non-negativity and sample smoothness. However, the iterative nature of these algorithms and their parameter dependency make real-time visualization impossible. In this article, we propose and experimentally demonstrate a deep neural network, which we term DeepRegularizer, that rapidly improves the resolution of a three-dimensional refractive index map. Trained with pairs of datasets (a raw refractive index tomogram and a resolution-enhanced refractive index tomogram via the iterative total variation algorithm), the three-dimensional U-net-based convolutional neural network learns a transformation between the two tomogram domains. The feasibility and generalizability of our network are demonstrated using bacterial cells and a human leukaemic cell line, and by validating the model across different samples. DeepRegularizer offers more than an order of magnitude faster regularization performance compared to the conventional iterative method. We envision that the proposed data-driven approach can bypass the high time complexity of various image reconstructions in other imaging modalities.
Collapse
|
14
|
Guo R, Barnea I, Shaked NT. Limited-angle tomographic phase microscopy utilizing confocal scanning fluorescence microscopy. BIOMEDICAL OPTICS EXPRESS 2021; 12:1869-1881. [PMID: 33996204 PMCID: PMC8086471 DOI: 10.1364/boe.419598] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/11/2021] [Revised: 02/12/2021] [Accepted: 02/16/2021] [Indexed: 05/03/2023]
Abstract
We present a multimodal imaging technique, combining tomographic phase microscopy with limited angular projection range and number, and two-channel spinning-disk confocal scanning fluorescence microscopy. This technique allows high-accuracy 3D refractive index (RI) profiling of live cells in spite of the missing projections. The cellular outer shape and its interior organelles measured by the confocal fluorescence imaging not only specify the cell in molecular levels, but also provide the 3D distributions of the whole cell as well as its organelles. We take these additional 3D morphological details as constraints in Gerchberg-Papoulis-based optical diffraction tomography algorithm. We then obtain an accurate 3D RI tomogram, even with a sparse angular range having a small number of perspective projections, otherwise providing low-accuracy RI reconstruction. Then, we obtain both cellular molecular specificity and inner RI values of the cell and its organelles. We compare the reconstructed 3D RI profiles of various samples, demonstrating the superiority of the proposed technique.
Collapse
|
15
|
Baczewska M, Eder K, Ketelhut S, Kemper B, Kujawińska M. Refractive Index Changes of Cells and Cellular Compartments Upon Paraformaldehyde Fixation Acquired by Tomographic Phase Microscopy. Cytometry A 2021; 99:388-398. [PMID: 32959478 PMCID: PMC8048569 DOI: 10.1002/cyto.a.24229] [Citation(s) in RCA: 30] [Impact Index Per Article: 10.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/21/2020] [Revised: 07/28/2020] [Accepted: 08/25/2020] [Indexed: 12/11/2022]
Abstract
Three-dimensional quantitative phase imaging is an emerging method, which provides the 3D distribution of the refractive index (RI) and the dry mass in live and fixed cells as well as in tissues. However, an insufficiently answered question is the influence of chemical cell fixation procedures on the results of RI reconstructions. Therefore, this work is devoted to systematic investigations on the RI in cellular organelles of live and fixed cells including nucleus, nucleolus, nucleoplasm, and cytoplasm. The research was carried out on four different cell lines using a common paraformaldehyde (PFA)-based fixation protocol. The selected cell types represent the diversity of mammalian cells and therefore the results presented provide a picture of fixation caused RI changes in a broader context. A commercial Tomocube HT-1S device was used for 3D RI acquisition. The changes in the RI values after the fixation process are detected in the reconstructed phase distributions and amount to the order of 10-3 . The RI values decrease and the observed RI changes are found to be different between various cell lines; however, all of them show the most significant loss in the nucleolus. In conclusion, our study demonstrates the evident need for standardized preparation procedures in phase tomographic measurements. © 2020 The Authors. Cytometry Part A published by Wiley Periodicals LLC. on behalf of International Society for Advancement of Cytometry.
Collapse
Affiliation(s)
- Maria Baczewska
- Warsaw University of Technology, Institute of Micromechanics and Photonics, Sw. Boboli 8 St.Warsaw02‐525Poland
| | - Kai Eder
- Biomedical Technology Center of the Medical Faculty, University of Muenster Mendelstr 17MuensterD‐48149Germany
| | - Steffi Ketelhut
- Biomedical Technology Center of the Medical Faculty, University of Muenster Mendelstr 17MuensterD‐48149Germany
| | - Björn Kemper
- Biomedical Technology Center of the Medical Faculty, University of Muenster Mendelstr 17MuensterD‐48149Germany
| | - Małgorzata Kujawińska
- Warsaw University of Technology, Institute of Micromechanics and Photonics, Sw. Boboli 8 St.Warsaw02‐525Poland
| |
Collapse
|
16
|
Biological Applications of Short Wavelength Microscopy Based on Compact, Laser-Produced Gas-Puff Plasma Source. APPLIED SCIENCES-BASEL 2020. [DOI: 10.3390/app10238338] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/12/2022]
Abstract
Over the last decades, remarkable efforts have been made to improve the resolution in photon-based microscopes. The employment of compact sources based on table-top laser-produced soft X-ray (SXR) in the “water window” spectral range (λ = 2.3–4.4 nm) and extreme ultraviolet (EUV) plasma allowed to overcome the limitations imposed by large facilities, such as synchrotrons and X-ray free electron lasers (XFEL), because of their high complexity, costs, and limited user access. A laser-plasma double stream gas-puff target source represents a powerful tool for microscopy operating in transmission mode, significantly improving the spatial resolution into the nanometric scale, comparing to the traditional visible light (optical) microscopes. Such an approach allows generating the plasma efficiently, without debris, providing a high flux of EUV and SXR photons. In this review, we present the development and optimization of desktop imaging systems: a EUV and an SXR full field microscope, allowing to achieve a sub-50 nm spatial resolution with short exposure time and an SXR contact microscope, capable to resolve internal structures in a thin layer of sensitive photoresist. Details about the source, as well as imaging results for biological applications, will be presented and discussed.
Collapse
|
17
|
Trusiak M, Cywińska M, Micó V, Picazo-Bueno JÁ, Zuo C, Zdańkowski P, Patorski K. Variational Hilbert Quantitative Phase Imaging. Sci Rep 2020; 10:13955. [PMID: 32811839 PMCID: PMC7435195 DOI: 10.1038/s41598-020-69717-1] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/12/2019] [Accepted: 07/15/2020] [Indexed: 11/09/2022] Open
Abstract
Utilizing the refractive index as the endogenous contrast agent to noninvasively study transparent cells is a working principle of emerging quantitative phase imaging (QPI). In this contribution, we propose the Variational Hilbert Quantitative Phase Imaging (VHQPI)-end-to-end purely computational add-on module able to improve performance of a QPI-unit without hardware modifications. The VHQPI, deploying unique merger of tailored variational image decomposition and enhanced Hilbert spiral transform, adaptively provides high quality map of sample-induced phase delay, accepting particularly wide range of input single-shot interferograms (from off-axis to quasi on-axis configurations). It especially promotes high space-bandwidth-product QPI configurations alleviating the spectral overlapping problem. The VHQPI is tailored to deal with cumbersome interference patterns related to detailed locally varying biological objects with possibly high dynamic range of phase and relatively low carrier. In post-processing, the slowly varying phase-term associated with the instrumental optical aberrations is eliminated upon variational analysis to further boost the phase-imaging capabilities. The VHQPI is thoroughly studied employing numerical simulations and successfully validated using static and dynamic cells phase-analysis. It compares favorably with other single-shot phase reconstruction techniques based on the Fourier and Hilbert-Huang transforms, both in terms of visual inspection and quantitative evaluation, potentially opening up new possibilities in QPI.
Collapse
Affiliation(s)
- Maciej Trusiak
- Institute of Micromechanics and Photonics, Warsaw University of Technology, 8 Sw. A. Boboli St., 02-525, Warsaw, Poland.
| | - Maria Cywińska
- Institute of Micromechanics and Photonics, Warsaw University of Technology, 8 Sw. A. Boboli St., 02-525, Warsaw, Poland.
| | - Vicente Micó
- Departamento de Óptica y de Optometría y Ciencias de la Visión, Facultad de Física, Universitat de Valencia, C/Doctor Moliner 50, 46100, Burjassot, Spain
| | - José Ángel Picazo-Bueno
- Departamento de Óptica y de Optometría y Ciencias de la Visión, Facultad de Física, Universitat de Valencia, C/Doctor Moliner 50, 46100, Burjassot, Spain
| | - Chao Zuo
- Jiangsu Key Laboratory of Spectral Imaging and Intelligence Sense, Nanjing University of Science and Technology, Nanjing, 210094, Jiangsu, China
| | - Piotr Zdańkowski
- Institute of Micromechanics and Photonics, Warsaw University of Technology, 8 Sw. A. Boboli St., 02-525, Warsaw, Poland
| | - Krzysztof Patorski
- Institute of Micromechanics and Photonics, Warsaw University of Technology, 8 Sw. A. Boboli St., 02-525, Warsaw, Poland
| |
Collapse
|
18
|
Zhou KC, Horstmeyer R. Diffraction tomography with a deep image prior. OPTICS EXPRESS 2020; 28:12872-12896. [PMID: 32403775 PMCID: PMC7340379 DOI: 10.1364/oe.379200] [Citation(s) in RCA: 35] [Impact Index Per Article: 8.8] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/04/2019] [Revised: 03/19/2020] [Accepted: 03/25/2020] [Indexed: 05/11/2023]
Abstract
We present a tomographic imaging technique, termed Deep Prior Diffraction Tomography (DP-DT), to reconstruct the 3D refractive index (RI) of thick biological samples at high resolution from a sequence of low-resolution images collected under angularly varying illumination. DP-DT processes the multi-angle data using a phase retrieval algorithm that is extended by a deep image prior (DIP), which reparameterizes the 3D sample reconstruction with an untrained, deep generative 3D convolutional neural network (CNN). We show that DP-DT effectively addresses the missing cone problem, which otherwise degrades the resolution and quality of standard 3D reconstruction algorithms. As DP-DT does not require pre-captured data or pre-training, it is not biased towards any particular dataset. Hence, it is a general technique that can be applied to a wide variety of 3D samples, including scenarios in which large datasets for supervised training would be infeasible or expensive. We applied DP-DT to obtain 3D RI maps of bead phantoms and complex biological specimens, both in simulation and experiment, and show that DP-DT produces higher-quality results than standard regularization techniques. We further demonstrate the generality of DP-DT, using two different scattering models, the first Born and multi-slice models. Our results point to the potential benefits of DP-DT for other 3D imaging modalities, including X-ray computed tomography, magnetic resonance imaging, and electron microscopy.
Collapse
Affiliation(s)
- Kevin C. Zhou
- Department of Biomedical Engineering, Duke University, Durham, NC 27708, USA
| | - Roarke Horstmeyer
- Department of Biomedical Engineering, Duke University, Durham, NC 27708, USA
| |
Collapse
|
19
|
Krauze W. Optical diffraction tomography with finite object support for the minimization of missing cone artifacts. BIOMEDICAL OPTICS EXPRESS 2020; 11:1919-1926. [PMID: 32341857 PMCID: PMC7173890 DOI: 10.1364/boe.386507] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/23/2019] [Revised: 02/03/2020] [Accepted: 02/03/2020] [Indexed: 05/20/2023]
Abstract
Limited-angle optical diffraction tomography suffers from strong artifacts in tomographic reconstructions. Numerous algorithms, mainly based on regularization methods, have been developed recently to overcome this limitation. However, the quality of results still needs further improvement. Here I present a simple yet extremely effective method of increasing the reconstruction quality in limited angle optical diffraction tomography that can be combined with known tomographic algorithms. In the method a finite object support is generated from the object data and utilized in the reconstruction procedure as an additional strong regularizer. Practical aspects of this method are given together with examples of application.
Collapse
|
20
|
Konda PC, Loetgering L, Zhou KC, Xu S, Harvey AR, Horstmeyer R. Fourier ptychography: current applications and future promises. OPTICS EXPRESS 2020; 28:9603-9630. [PMID: 32225565 DOI: 10.1364/oe.386168] [Citation(s) in RCA: 49] [Impact Index Per Article: 12.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/17/2019] [Accepted: 01/30/2020] [Indexed: 05/18/2023]
Abstract
Traditional imaging systems exhibit a well-known trade-off between the resolution and the field of view of their captured images. Typical cameras and microscopes can either "zoom in" and image at high-resolution, or they can "zoom out" to see a larger area at lower resolution, but can rarely achieve both effects simultaneously. In this review, we present details about a relatively new procedure termed Fourier ptychography (FP), which addresses the above trade-off to produce gigapixel-scale images without requiring any moving parts. To accomplish this, FP captures multiple low-resolution, large field-of-view images and computationally combines them in the Fourier domain into a high-resolution, large field-of-view result. Here, we present details about the various implementations of FP and highlight its demonstrated advantages to date, such as aberration recovery, phase imaging, and 3D tomographic reconstruction, to name a few. After providing some basics about FP, we list important details for successful experimental implementation, discuss its relationship with other computational imaging techniques, and point to the latest advances in the field while highlighting persisting challenges.
Collapse
|
21
|
3D-printed biological cell phantom for testing 3D quantitative phase imaging systems. Sci Rep 2019; 9:18872. [PMID: 31827171 PMCID: PMC6906528 DOI: 10.1038/s41598-019-55330-4] [Citation(s) in RCA: 25] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/09/2019] [Accepted: 11/08/2019] [Indexed: 01/26/2023] Open
Abstract
As the 3D quantitative phase imaging (QPI) methods mature, their further development calls for reliable tools and methods to characterize and compare their metrological parameters. We use refractive index engineering during two-photon laser photolithography to fabricate a life-scale phantom of a biological cell with internal structures that mimic optical and structural properties of mammalian cells. After verification with a number of reference techniques, the phantom is used to characterize the performance of a limited-angle holographic tomography microscope.
Collapse
|
22
|
Makowski PL, Ziemczonok M. Projection extrapolation routine for tight-frame limited-angle optical diffraction tomography. OPTICS LETTERS 2019; 44:3442-3445. [PMID: 31305543 DOI: 10.1364/ol.44.003442] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/01/2019] [Accepted: 06/06/2019] [Indexed: 06/10/2023]
Abstract
We propose a data-replenishment-type expansion of the modified Gerchberg-Papoulis (GP) algorithm for limited-angle optical diffraction tomography (LAODT), which prevents artifact buildup in the GP reconstructions of confined bulk objects tightly fitting the active field of view (FoV) of the LAODT microscope. Objects crossing the FoV borders are not considered. The method relies on a Fourier-based forward projector complementary to the GP solver with no additional constraints. Fourier space regridding errors are minimized by means of one-dimensional oversampling in the axial direction, which is demonstrated to be more efficient than standard projection padding. Verification of both synthetic and experimental sinograms confirms the ability of the procedure to deduce missing projection parts necessary for the correct reconstruction.
Collapse
|
23
|
Krauze W, Kuś A, Śladowski D, Skrzypek E, Kujawińska M. Reconstruction method for extended depth-of-field optical diffraction tomography. Methods 2018; 136:40-49. [DOI: 10.1016/j.ymeth.2017.10.005] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/04/2017] [Revised: 09/11/2017] [Accepted: 10/02/2017] [Indexed: 10/18/2022] Open
|
24
|
Boink YE, Lagerwerf MJ, Steenbergen W, van Gils SA, Manohar S, Brune C. A framework for directional and higher-order reconstruction in photoacoustic tomography. Phys Med Biol 2018; 63:045018. [PMID: 29364136 DOI: 10.1088/1361-6560/aaaa4a] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
Abstract
Photoacoustic tomography is a hybrid imaging technique that combines high optical tissue contrast with high ultrasound resolution. Direct reconstruction methods such as filtered back-projection, time reversal and least squares suffer from curved line artefacts and blurring, especially in the case of limited angles or strong noise. In recent years, there has been great interest in regularised iterative methods. These methods employ prior knowledge of the image to provide higher quality reconstructions. However, easy comparisons between regularisers and their properties are limited, since many tomography implementations heavily rely on the specific regulariser chosen. To overcome this bottleneck, we present a modular reconstruction framework for photoacoustic tomography, which enables easy comparisons between regularisers with different properties, e.g. nonlinear, higher-order or directional. We solve the underlying minimisation problem with an efficient first-order primal-dual algorithm. Convergence rates are optimised by choosing an operator-dependent preconditioning strategy. A variety of reconstruction methods are tested on challenging 2D synthetic and experimental data sets. They outperform direct reconstruction approaches for strong noise levels and limited angle measurements, offering immediate benefits in terms of acquisition time and quality. This work provides a basic platform for the investigation of future advanced regularisation methods in photoacoustic tomography.
Collapse
Affiliation(s)
- Yoeri E Boink
- Biomedical Photonic Imaging Group, University of Twente, 7500 AE Enschede, Netherlands. Department of Applied Mathematics, University of Twente, 7500 AE Enschede, Netherlands
| | | | | | | | | | | |
Collapse
|
25
|
Jin D, Zhou R, Yaqoob Z, So PTC. Tomographic phase microscopy: principles and applications in bioimaging [Invited]. JOURNAL OF THE OPTICAL SOCIETY OF AMERICA. B, OPTICAL PHYSICS 2018; 34:B64-B77. [PMID: 29386746 PMCID: PMC5788179 DOI: 10.1364/josab.34.000b64] [Citation(s) in RCA: 97] [Impact Index Per Article: 16.2] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/19/2023]
Abstract
Tomographic phase microscopy (TPM) is an emerging optical microscopic technique for bioimaging. TPM uses digital holographic measurements of complex scattered fields to reconstruct three-dimensional refractive index (RI) maps of cells with diffraction-limited resolution by solving inverse scattering problems. In this paper, we review the developments of TPM from the fundamental physics to its applications in bioimaging. We first provide a comprehensive description of the tomographic reconstruction physical models used in TPM. The RI map reconstruction algorithms and various regularization methods are discussed. Selected TPM applications for cellular imaging, particularly in hematology, are reviewed. Finally, we examine the limitations of current TPM systems, propose future solutions, and envision promising directions in biomedical research.
Collapse
Affiliation(s)
- Di Jin
- Department of Mechanical Engineering, Massachusetts Institute of Technology, Cambridge, Massachusetts 02139, USA
- Laser Biomedical Research Center, G. R. Harrison Spectroscopy Laboratory, Massachusetts Institute of Technology, Cambridge, Massachusetts 02139, USA
| | - Renjie Zhou
- Laser Biomedical Research Center, G. R. Harrison Spectroscopy Laboratory, Massachusetts Institute of Technology, Cambridge, Massachusetts 02139, USA
| | - Zahid Yaqoob
- Laser Biomedical Research Center, G. R. Harrison Spectroscopy Laboratory, Massachusetts Institute of Technology, Cambridge, Massachusetts 02139, USA
| | - Peter T. C. So
- Department of Mechanical Engineering, Massachusetts Institute of Technology, Cambridge, Massachusetts 02139, USA
- Laser Biomedical Research Center, G. R. Harrison Spectroscopy Laboratory, Massachusetts Institute of Technology, Cambridge, Massachusetts 02139, USA
- Department of Biological Engineering, Massachusetts Institute of Technology, Cambridge, Massachusetts 02139, USA
| |
Collapse
|
26
|
Kuś A. Illumination-related errors in limited-angle optical diffraction tomography. APPLIED OPTICS 2017; 56:9247-9256. [PMID: 29216097 DOI: 10.1364/ao.56.009247] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/11/2023]
Abstract
In the paper, the design and tolerances of optical systems and scanning components used in limited-angle optical diffraction tomography are analyzed in order to improve the performance of the measurement systems and to encourage the application of tomography as a standard method for quantitative analysis of 3D refractive index distribution in biological microstructures. The first part of the presented analysis consists of component selection for the scanning device and optical system in the illumination part of the setup and the influence of the illumination wavefront on reconstruction quality. In the second part, the sensitivity of the tomographic reconstruction quality to three representative measurement-related errors based on synthetic data is demonstrated. Finally, a configuration of the system, selected to minimize reconstruction errors, is proposed and alignment tolerances simulated using the Monte Carlo method are provided.
Collapse
|
27
|
Lin YH, Huang SS, Wu SJ, Sung KB. Morphometric analysis of erythrocytes from patients with thalassemia using tomographic diffractive microscopy. JOURNAL OF BIOMEDICAL OPTICS 2017; 22:1-11. [PMID: 29188659 DOI: 10.1117/1.jbo.22.11.116009] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/22/2017] [Accepted: 11/13/2017] [Indexed: 05/23/2023]
Abstract
Complete blood count is the most common test to detect anemia, but it is unable to obtain the abnormal shape of erythrocytes, which highly correlates with the hematologic function. Tomographic diffractive microscopy (TDM) is an emerging technique capable of quantifying three-dimensional (3-D) refractive index (RI) distributions of erythrocytes without labeling. TDM was used to characterize optical and morphological properties of 172 erythrocytes from healthy volunteers and 419 erythrocytes from thalassemic patients. To efficiently extract and analyze the properties of erythrocytes, we developed an adaptive region-growing method for automatically delineating erythrocytes from 3-D RI maps. The thalassemic erythrocytes not only contained lower hemoglobin content but also showed doughnut shape and significantly lower volume, surface area, effective radius, and average thickness. A multi-indices prediction model achieved perfect accuracy of diagnosing thalassemia using four features, including the optical volume, surface-area-to-volume ratio, sphericity index, and surface area. The results demonstrate the ability of TDM to provide quantitative, hematologic measurements and to assess morphological features of erythrocytes to distinguish healthy and thalassemic erythrocytes.
Collapse
Affiliation(s)
- Yang-Hsien Lin
- National Taiwan University, Graduate Institute of Biomedical Electronics and Bioinformatics, Taiwan
| | - Shin-Shyang Huang
- National Taiwan University, Graduate Institute of Biomedical Electronics and Bioinformatics, Taiwan
| | - Shang-Ju Wu
- National Taiwan University Hospital, Department of Internal Medicines, Taiwan
| | - Kung-Bin Sung
- National Taiwan University, Graduate Institute of Biomedical Electronics and Bioinformatics, Taiwan
- National Taiwan University, Department of Electrical Engineering, Taiwan
- National Taiwan University, Molecular Imaging Center, Taiwan
| |
Collapse
|
28
|
Kostencka J, Kozacki T, Józwik M. Holographic tomography with object rotation and two-directional off-axis illumination. OPTICS EXPRESS 2017; 25:23920-23934. [PMID: 29041342 DOI: 10.1364/oe.25.023920] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/26/2017] [Accepted: 08/29/2017] [Indexed: 05/20/2023]
Abstract
A hybrid system of holographic tomography, which utilizes rotation of a sample and two-directional, off-axis illumination is proposed. The applied type of illumination brings two major benefits. First, it offers theoretical potential for the resolution improvement with respect to conventional tomography. Second, it enables effective, numerical compensation of the defocus error, which is achieved with an accurate, noise-immune autofocusing. Hence, the main practical obstacle of hybrid tomography is removed and its high-resolution potential is put into practice. The utility of the proposed concept is experimentally demonstrated with the tomographic measurement of a photonic crystal fiber.
Collapse
|
29
|
Lin YC, Chen HC, Tu HY, Liu CY, Cheng CJ. Optically driven full-angle sample rotation for tomographic imaging in digital holographic microscopy. OPTICS LETTERS 2017; 42:1321-1324. [PMID: 28362759 DOI: 10.1364/ol.42.001321] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/27/2023]
Abstract
This study presents a novel tomographic imaging technique for living biomedical samples using an optically driven full-angle rotation scheme based on digital holographic microscopy, in which the three-dimensional refractive index distribution inside the sample can be measured and analyzed. To accomplish the full-angle sample rotation, two optical traps are driven by highly focused spots on the top and bottom of the sample. The rim image of the sample outside the focal depth at the different rotation angles and propagation distances can be corrected and compensated, respectively, via numerical focusing; therefore, tomographic imaging of the sample can be conducted. The proposed approach shows that an entire symmetric spectrum can be acquired for tomographic reconstruction without the missing apple core problem as in traditional sample-rotation schemes. The three-dimensional refractive index of living yeast in a fluid medium is measured and verified.
Collapse
|
30
|
Kostencka J, Kozacki T, Kuś A, Kemper B, Kujawińska M. Holographic tomography with scanning of illumination: space-domain reconstruction for spatially invariant accuracy. BIOMEDICAL OPTICS EXPRESS 2016; 7:4086-4101. [PMID: 27867717 PMCID: PMC5102545 DOI: 10.1364/boe.7.004086] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/31/2016] [Revised: 08/11/2016] [Accepted: 08/23/2016] [Indexed: 05/25/2023]
Abstract
The paper presents two novel, space-domain reconstruction algorithms for holographic tomography utilizing scanning of illumination and a fixed detector that is highly suitable for imaging of living biomedical specimens. The first proposed algorithm is an adaptation of the filtered backpropagation to the scanning illumination tomography. Its space-domain implementation enables avoiding the error-prone interpolation in the Fourier domain, which is a significant problem of the state-of-the-art tomographic algorithm. The second proposed algorithm is a modified version of the former, which ensures the spatially invariant reconstruction accuracy. The utility of the proposed algorithms is demonstrated with numerical simulations and experimental measurement of a cancer cell.
Collapse
Affiliation(s)
- Julianna Kostencka
- Photonics Engineering Division, Institute of Micromechanics and Photonics, Faculty of Mechatronics, Warsaw University of Technology, A. Boboli 8 Street, 02-525 Warsaw, Poland
| | - Tomasz Kozacki
- Photonics Engineering Division, Institute of Micromechanics and Photonics, Faculty of Mechatronics, Warsaw University of Technology, A. Boboli 8 Street, 02-525 Warsaw, Poland
| | - Arkadiusz Kuś
- Photonics Engineering Division, Institute of Micromechanics and Photonics, Faculty of Mechatronics, Warsaw University of Technology, A. Boboli 8 Street, 02-525 Warsaw, Poland
| | - Björn Kemper
- Biomedical Technology Center of the Medical Faculty, University of Muenster, Mendelstr 17, D-48149 Muenster, Germany
| | - Małgorzata Kujawińska
- Photonics Engineering Division, Institute of Micromechanics and Photonics, Faculty of Mechatronics, Warsaw University of Technology, A. Boboli 8 Street, 02-525 Warsaw, Poland
| |
Collapse
|
31
|
Kozacki T, Falaggis K. Angular spectrum method with compact space-bandwidth: generalization and full-field accuracy. APPLIED OPTICS 2016; 55:5014-5024. [PMID: 27409185 DOI: 10.1364/ao.55.005014] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/06/2023]
Abstract
A recent Letter [Opt. Lett.40, 3420 (2015)OPLEDP0146-959210.1364/OL.40.003420] reported a modified angular spectrum method that uses a sampling scheme based on a compact space-bandwidth product representation. That technique is useful for focusing and defocusing propagation cases and is generalized here for the case of propagation between two defocus planes. The proposed method employs paraxial spherical phase factors and modified propagation kernels to reduce the size of the numerical space-bandwidth product needed for wave field calculations. A Wigner distribution analysis is carried out in order to ensure high accuracy of the calculations in the entire computational domain. This is achieved by analyzing the evolution of the generalized space-bandwidth product when passing through the propagation algorithm for various space-frequency constraints. The results allow the derivations of sampling criteria, and, despite this, also show that a small amount of space/frequency zero padding significantly extends the capability of the recently reported modified angular spectrum method. Simulations validate the high accuracy of that method and verify a computational and memory gain of more than two orders of magnitude when comparing this technique with the conventional angular spectrum method.
Collapse
|